Increase reliability of per patch perf job 88/18788/8
authorVratko Polak <vrpolak@cisco.com>
Wed, 10 Apr 2019 08:33:17 +0000 (10:33 +0200)
committerVratko Polak <vrpolak@cisco.com>
Wed, 17 Apr 2019 14:50:25 +0000 (14:50 +0000)
commit661035ac4ce6e51649f302fe2b7a8218257c0587
tree6e7f0a0643fca10c8d4d7da0ab9dff40ba18e626
parent5aa2e158983f61df6d26129ad566b906051fc5b5
Increase reliability of per patch perf job

CSIT-1485

- Measurement results are inconsistent, creating false positives.
- To avoid false positives, sensitivity has to be lowered.
+ Measurements are no more interleaved.
+ Measurement result are no longer filtered.
+ The job now runs faster.
- Ip6base regressions smaller than 4% are tolerated.
+ Ip6base false positives can happen, but less than 10% of the time.
- Part of job parameters is set on ci-management level.
+ Voter script output is improved.

Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
resources/libraries/bash/entry/per_patch_perf.sh
resources/tools/scripts/compare_perpatch.py