Increase reliability of per patch perf job 73/20773/1
authorVratko Polak <vrpolak@cisco.com>
Wed, 10 Apr 2019 08:33:17 +0000 (10:33 +0200)
committerVratko Polak <vrpolak@cisco.com>
Mon, 22 Jul 2019 13:41:59 +0000 (15:41 +0200)
commita8e84e5082d63c21fdfb691216ec54e549958840
treefbcfce0a14a643af10888a503dbdf08b48c54bd4
parentb9b89800946b33a8bbdedf197a2105eed9735e00
Increase reliability of per patch perf job

CSIT-1485

- Measurement results are inconsistent, creating false positives.
- To avoid false positives, sensitivity has to be lowered.
+ Measurements are no more interleaved.
+ Measurement result are no longer filtered.
+ The job now runs faster.
- Ip6base regressions smaller than 4% are tolerated.
+ Ip6base false positives can happen, but less than 10% of the time.
- Part of job parameters is set on ci-management level.
+ Voter script output is improved.

Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
resources/libraries/bash/entry/per_patch_perf.sh
resources/tools/scripts/compare_perpatch.py