VPP perf per patch: Reverse the order of tests 93/21393/2
authorVratko Polak <vrpolak@cisco.com>
Mon, 19 Aug 2019 13:58:43 +0000 (15:58 +0200)
committerVratko Polak <vrpolak@cisco.com>
Mon, 19 Aug 2019 15:03:35 +0000 (15:03 +0000)
If current VPP is broken, we want to fail early.
If there is API change, we are more interested in current results,
even if parent is likely to fail.

Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
resources/libraries/bash/entry/per_patch_perf.sh

index afe5f97..ad0ae90 100644 (file)
@@ -68,19 +68,20 @@ for ((iter=0; iter<iterations; iter++)); do
         # but we need to clean it explicitly on subsequent iterations.
         cleanup_topo
     fi
-    select_build "build_parent" || die
+    # Testing current first. Good for early failures or for API changes.
+    select_build "build_current" || die
     check_download_dir || die
     run_pybot || die
     copy_archives || die
-    archive_parse_test_results "csit_parent/${iter}" || die
+    archive_parse_test_results "csit_current/${iter}" || die
     die_on_pybot_error || die
     # TODO: Use less heavy way to avoid apt remove failures.
     cleanup_topo
-    select_build "build_current" || die
+    select_build "build_parent" || die
     check_download_dir || die
     run_pybot || die
     copy_archives || die
-    archive_parse_test_results "csit_current/${iter}" || die
+    archive_parse_test_results "csit_parent/${iter}" || die
     die_on_pybot_error || die
 done
 untrap_and_unreserve_testbed || die