Move reservation directory to TG node.

Testing has showed SSH access to DUT affects performance.
Downside: No support for non-Linux TGs.
Complication: After merge there might be conflicts with older jobs,
including jobs for other branches.

Change-Id: Icefddc5a9ca8f4d830460e53a82bb45231f7222e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit e4091a25520e8cf1c62254df74b7ccf57f2ce1c7)

HC Tests: disable failing ACL ODL tests (HC2VPP-337)

Change-Id: I1fa3e3876bcc0b4f5e9908cb4f6920d49eb6dd45
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
(cherry picked from commit aea0a78dd1b090010b6b1262b82a34a2d107a85b)

Add defaultbranch to .gitreview

Without having different values in different branches,
"git review" has trouble contributing to non-master branches.

Here is a console output of what happens without this:

vrpolak@ds:~$ git clone ssh://vrpolak@gerrit.fd.io:29418/csit.git
Cloning into 'csit'...
remote: Counting objects: 2135, done
remote: Finding sources: 100% (20/20)
remote: Total 21750 (delta 0), reused 21734 (delta 0)
Receiving objects: 100% (21750/21750), 11.43 MiB | 1.05 MiB/s, done.
Resolving deltas: 100% (11295/11295), done.
vrpolak@ds:~$ cd csit
vrpolak@ds:~/csit$ git checkout rls1804
Branch rls1804 set up to track remote branch rls1804 from origin.
Switched to a new branch 'rls1804'
vrpolak@ds:~/csit$ git review -s
Creating a git remote called "gerrit" that maps to:
    ssh://vrpolak@gerrit.fd.io:29418/csit.git
vrpolak@ds:~/csit$ touch DELETE_ME.txt
vrpolak@ds:~/csit$ git add DELETE_ME.txt
vrpolak@ds:~/csit$ git commit -sm'DO_NOT_MERGE: git review test'
[rls1804 0ba9aa3e] DO_NOT_MERGE: git review test
 1 file changed, 0 insertions(+), 0 deletions(-)
 create mode 100644 DELETE_ME.txt
vrpolak@ds:~/csit$ git review -y
Errors running git rebase -p -i remotes/gerrit/master
error: could not apply 39ce5d87... Set correct paths to vpp stable/1804 and use vpp stable/1804 builds

When you have resolved this problem, run "git rebase --continue".
If you prefer to skip this patch, run "git rebase --skip" instead.
To check out the original branch and stop rebasing, run "git rebase --abort".
Could not pick 39ce5d87070867c5a906e2a2ed8a683f975289f4
It is likely that your change has a merge conflict. You may resolve it in the working tree now as described above and then run 'git review' again, or if you do not want to resolve it yet (note that the change can not merge until the conflict is resolved) you may run 'git rebase --abort' then 'git review -R' to upload the change without rebasing.
vrpolak@ds:~/csit$

And here is console output of what happens with this Change:

vrpolak@ds:~$ git clone ssh://vrpolak@gerrit.fd.io:29418/csit.git
Cloning into 'csit'...
remote: Counting objects: 1805, done
remote: Finding sources: 100% (6/6)
remote: Total 21736 (delta 0), reused 21732 (delta 0)
Receiving objects: 100% (21736/21736), 11.41 MiB | 871.00 KiB/s, done.
Resolving deltas: 100% (11295/11295), done.
vrpolak@ds:~$ cd csit
vrpolak@ds:~/csit$ git checkout rls1804
Branch rls1804 set up to track remote branch rls1804 from origin.
Switched to a new branch 'rls1804'
vrpolak@ds:~/csit$ git review -s
Creating a git remote called "gerrit" that maps to:
    ssh://vrpolak@gerrit.fd.io:29418/csit.git
vrpolak@ds:~/csit$ git fetch https://gerrit.fd.io/r/csit refs/changes/91/12491/3 && git cherry-pick FETCH_HEAD
remote: Counting objects: 1808, done
remote: Finding sources: 100% (3/3)
remote: Total 3 (delta 1), reused 3 (delta 1)
Unpacking objects: 100% (3/3), done.
From https://gerrit.fd.io/r/csit
 * branch              refs/changes/91/12491/3 -> FETCH_HEAD
[rls1804 09a05f6a] Add defaultbranch to .gitreview
 Date: Wed May 9 12:04:04 2018 +0200
 1 file changed, 1 insertion(+), 1 deletion(-)
vrpolak@ds:~/csit$ touch DELETE_ME.txt
vrpolak@ds:~/csit$ git add DELETE_ME.txt
vrpolak@ds:~/csit$ git commit -sm'DO_NOT_MERGE: git review test'
[rls1804 595f4afa] DO_NOT_MERGE: git review test
 1 file changed, 0 insertions(+), 0 deletions(-)
 create mode 100644 DELETE_ME.txt
vrpolak@ds:~/csit$ git review -y
remote: Processing changes: new: 1, updated: 1, refs: 2, done
remote: (W) No changes between prior commit 9146b22 and new commit 09a05f6
remote:
remote: New Changes:
remote:   https://gerrit.fd.io/r/12699 DO_NOT_MERGE: git review test
remote:
remote:
remote: Updated Changes:
remote:   https://gerrit.fd.io/r/12491 Add defaultbranch to .gitreview
remote:
To ssh://gerrit.fd.io:29418/csit.git
 * [new branch]        HEAD -> refs/publish/rls1804
vrpolak@ds:~/csit$

Change-Id: I4a6797a8646c26bdae49eb4fcc9dbd463b97ab7b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-986: Improve formatting of MDR documentation

Change-Id: I1a67deea51b7ffdc7730a52b56f57baa64747d7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-986: MDR rst documentation

+ Introduction.
+ Phases description.
+ Comparison tables.
+ Graphs.

Change-Id: Iec5143770677c733070fb0444a1a7d898f1eb04e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 359e7958d2041f3ddff901eb2ed5caa8beb20354)

HC tests: archive ODL logs (CSIT-1031)

Change-Id: I444a5d6cd32cb9ee68575dfdb5a208de2c4eb72a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

CSIT-992: Fix intermediate phases MDR parameter

Also add TODOs and improve comments.

Change-Id: I50bd652c83c272c3f7662dd487ab617be2b7de08
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-992: Give MDR parameters official names

Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

HC tests: archive JOB artifacts to logs.fd.io

Change-Id: I305c9fd0b5653cc749716a8e700fb4c75a9252a6
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

HC Tests: fix CPU layout retrieval in the HC perf job

Change-Id: Id99e41a28d01e41d6fb51190d4ab86b667f828af
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

CSIT-1078: Optimize input data files download and processing

Change-Id: I973238d98d549555c0d43c91f9fd96a9209065ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9964155b56020914494f7341c2d1162f2ac9d720)

CSIT-1078: Optimize input data files download and processing

Change-Id: I3fa3c09bc485416e6d2be02fac296d83da16e0d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1078: Optimize input data files download and processing

Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-992: Shorten MDR search test message

Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-992: Add two suites using optimized search

+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot
+ Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot
+ Make sure both IMIX and 9000B test cases are there.
+ Document NDRPDR test tag.
+ Execute some of NDRPDR tests daily.

Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-992: Add libraries for optimized search

+ Place the libraries into resources/libraries/python/search/.
 + Except OptimizedTrexSearch in TrafficGenerator.py
+ Change traffic generator to support floats for duration and warmup.
+ Remove explicit type conversions where not needed.
+ Add robot keywords to performance_utils.robot
 + for calling the optimized search.
 + for reporting the resulting values.
 + for checking the minimal performance has been reached.
 + for running five second "Traffic should pass with no loss" after the search.
- Add methodology documentation in subsequent Change.
- Add simulator for testing algorithm correctness in a subsequent Change.
- Add tests using the libraries in subsequent Change.

Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Report: Data sources

Change-Id: I6c81d52c0b16ae487ab54e89d9bebf1709ff6735
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7577a3ff000ba4c61394bc49754a257fbb3d31ef)

Report: Data sources

Change-Id: I7b3b3451c71cf6912b760660f2af9856c576ecca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9b0de32a2b0f50f725bf635cc8cf302e9411f46c)

Report 1804: VPP functional test framework changes - centos

Change-Id: I9ada32945c87cb2bb6ef4fd1ef6e5c1cb54f6f32
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 012fe403da2baa031d96e536ba4694a8420a0ea6)

Report: remove greps

Change-Id: I57fee701a99bcdb4f523011fa774c42ecdacdde4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4fbf1ec2d535d322725d395c369b6c9f7222c8dd)

Report: Fix greps

Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8443891dd9915ed3439b0045c0e47935606d5e61)

rls1804 report: align methodology section with csit 

Change-Id: I29899b04ab2806c7d6a418defdcad2651a966c9b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

FIX: Small inconsistencies in report sections

Change-Id: I0c27300678414bd3baecccd8e51ca0dc15af73d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add data point to report

- MRR Sel, Perf FULL 4

Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 313946ec3f85d6fc880a80fbc44ddfe03c8eb2fc)

trending docs: fixed maths formulas format again.

Change-Id: Ia9031e720bddf783a26d25de1ed189bf3b09312f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9cb1c051788f2c4cba2e880ec39c142cf688a657)

report: perf rls notes formatting fixes

Change-Id: I075528061822206d17b83cc4b1d475419c4084f9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 995f2727d6306ad05e8ea089632a552ebbf23b21)

trending docs: fixed tables and maths formulas.

Change-Id: Iad93e7a57655835ee1a75664f142d3fd362f5313
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Report: func rls_notes formatting fixes.

Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7e4f0d535fff543b9ec1ef550f3d6bb6068a8160)

Report: perf rls_notes formatting fixes.

Change-Id: I9f9ba3c59ab007d687f4e268ce91b046b731c850
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit e82babd2345f1c499278b71a891b23ddb002ec87)

Report: SRv6 to TSA

Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 23a620dd663d58e433e62dc417f4f053ae599e88)

Report: Add SRv6, fix greps

Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 01b9a636f84ad3b03e2845abd4ebf1a258705b55)

Report: data, figures desc

Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f0ef4dcb6aa7f1157e5b6f2909dde6b89789be14)

Report 1804: Centos func tests

Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit b6ad49a75bf83ddcc89ea92fd9b1dc2fdbb61ae5)

Report: data, figures desc

Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f56e629f1628f938b2a6e1bf27a74375ca3839cf)

Update L2 perf graph section

Change-Id: Iaeff80bd9454e99a97b2d8aeb13450ac06f650ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d520749e07fe534ff278b3713cc5032368bb32fc)

Report: Add TSA plots

Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4bfd1dcd604dac12d1dd00ba63c0d5e4170a1f2b)

FIX: Add default uio driver to perf __init__.robot file

Change-Id: Ib231a8d4bf8ac082250e788c7cae53cd8bb368f3
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report rls notes: added ref to trending docs.

Change-Id: I4690a4e5f9ca9ba34d3f51b2b2068e9007558839
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 202f199be94d87144384f3ea9c6d50e9766b0d73)

Update release note for rls1804 report

Change-Id: I3e80997ace8073edc90f662f6393bd62005fc815
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit ceb7c2545cda1bc7fe3d4bf35cdf75253efe8c6d)

Report: Data, plots, datetime

Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: TCP perf tests

Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2005c286222ebb1456a6dbe41fdca6dbfeb361f6)

Report: Add time to the timestamp

Change-Id: I323517fbac177ef31861be747feeb81968d2b330
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b3d9cf247f3de5558b0a8e42b63178dc1924ee73)

Report: Add time to the timestamp

Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7da4d5715a7d777562f8d524d075d2b08451af83)

Report: Add time to the timestamp

Change-Id: I1343e84353230329362848d1389ae41b169d2791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9c593381a09b1911419e1a67b6af17eb7d801308)

Report: Add time to the timestamp

Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 886bf3329c7027ded79ec0b59184f1fcb047130d)

Report: data

 - ligato

Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 15c597db37ffdc4477916344357af1145d4f28eb)

Report 1804: SRv6 and func part update

Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report: data

Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3acc992d8774e1b65c1e6d8c7147a204c1af6436)

Trending: ignore list for the dashboard

Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 49a8905978a65910a2fb75f04de29b3dd77f825a)

Report: Add MRR detailed results

Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 255db8b62f4623f25c91333d3592d2f411a6ef8a)

Trending: ignore list for the dashboard

Change-Id: Ibdb134517097bc9cacdcb75a11dda59290ab4e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Delete xml file when parsed

Change-Id: Ie28c3f3fb58a76ada1cf292ba4c8a401d0ec7155
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9d9b972b994fc8da54c47e3e9a2ef284776c3f52)

Report: Add MRR detailed results

Change-Id: Ib34689d0a9560c2adc8f9c7e464f5fbf4a2ae1f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c71b538b882cfdf8c5a940b8183a6f75a0915e42)

FIX: Docker container image

Change-Id: I127fe11b9095fb24a536dce7d6c26c7e7fd4be4e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Trending: Add 2vm tests

Change-Id: Ifc008ba50c4c84e781c12dc3080d3a361090efb6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Replace copy with move while archiving input files

Change-Id: Iea741cf3346574cc5def8c13e2660e2760157487
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2093328406eb64ae825a06967632e901ae0ba6db)
(cherry picked from commit ee9041274618cf3103477681603b9185dcd9904c)

Report: Add data

Change-Id: Id860fe218da5fd608aba163588e92c28b4c8cb53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 120cc891f690dab55377f972c2c989cd6e621e95)

FIX: Ligato VPP_AGENT_VERSION

Change-Id: Ifce0fd94652498302d3e36f6b83453a701784619
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Report: data

Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fc3fec34f9befb4781fbdfb4d9cc669f08f70624)

Report: Add CentOS func tests

Change-Id: I2e993738306ee0a5435c0fda7e46de300fcc91fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9eb9f9300831fcdd56dbefac7aaec5659cdfc31c)

Report: Add CentOS func tests

Change-Id: Ib8fae5f152ef11da478f2a8470f20e58bc516aec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 656847dee807b10f89c17d212a0c08848164ee67)

HC tests: reenable NSH plugin (CSIT-994)

Reverts https://gerrit.fd.io/r/#/c/11088/

Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

Report: delete tmp dir

Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f5d0c4d77058099fdd48a161e05c83676b119c2c)

Report: add data

Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 09b5d7df5081bddc9c5257575e7d79038f37f734)

CSIT-1041: Do not include last week for long term

Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 1b8f3a42136d6d4ba3e749eda770bd06b9089ab2)

Report: Add CentOS func tests

Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 06027cf4a33ff75146cbf5e91b029dc801158797)

FIX: Add api-segment conf to TCP tests

Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 021ff1a582f69438f3aa81b1e2d4879ef0ab2952)

Report: Add data

Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 99489ad1ec752855345a432085a96539b8973e1a)

FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr

Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit c4303988fdbe0476ad850450da36732818fe590d)

CSIT-1041: Trending dashboard - colours

Change-Id: I781e901e81f201d1335708c99eb52783f349725c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb6840a319390feb18b2ca32854edf1a6ad15e95)

New section: trending analysis methodology

Change-Id: I09ec04759a5f1f01c3835349c3ae094ae459226e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2cc56891f5e5b399bd5fbe761c64fcd937e46750)

Trending: switch back to 3*stdev

Reporting many fake pro/regressions is worse
then missing few of the real ones.

Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 3c510d8dd18bd8ceb2c5d86ed058976e72ddead4)

Report: Add historical data to performance changes table

Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5d040b65766fa5d7d6ad111def619abb8c878b87)

Report: Add historical data to performance changes table

Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7f9cb1bc6f96ca79fdba328fd14ce197e28c7a7)

Report: Add historical data to performance changes table

Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 52cb667958d954d6233d0865a59d90cca82db026)

CSIT-1041: Trending dashboard

Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0740688e5798f7ab7162fd7f4bc5eb8455164a7c)

Trending: use 2*stdev

Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d5d53957f4686398727469e0f5b1774a5b6560fe)

Report: remove VPP unit tests

Change-Id: I1fb0dd1e2d135fab29014d627e003e08ff0a98d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1090a73a99ea3980fd6bbc9b8acd4ccc47b4fb61)

Report: Add data

Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b892452e1fe2d226f526f9a0685b1095e36b8050)

Report: Add historical data to performance changes table

Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7fe3850f2777db5c5b6d1fbd0877ebd7cac0f18)

Report: Add historical data to performance changes table

Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 623eb22347f7d5218d3536f620d6911cc312d7dd)

CSIT-1041: Use TMM for trending line

+ Make also pro/re-gression detection use TMM.
+ Update graphs.
- Do not update dashboard tables yet.

Change-Id: Iae526c846b329ad99549be61481532e197704fb0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit fde192bc8a6ba1a4e2b4cf5b3297fb076efd58fc)

Update report content

- Update report content to match with rls1804 and master

Change-Id: Ib50df2482635f07c94ba92f0ed766bd95bc8e52c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1261ada9edd22c784a7763d861c5acf87ccd1ae1)

Use VPP release 18.04 builds

Change-Id: I2fdece7633774ba24660b78a465eb4b74bbf26a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1041: Trending dashboard

Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a1728c4f56cc44b9acb45614c20fc0a546ee3161)

CSIT-1041: Trending dashboard

Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0f662ea0defa9b30fa7a7d9256857fce92d20a6e)

CSIT-1041: Trending dashboard

Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6e1a15acc7bd3685d71f9d34238181c681dcd4c0)

CSIT-1041: Do not treat positive jumps as outliers

Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 0a8855adbb30a6079a538bea179a13988fdc20c0)

Edits of intro to perf trending dashboard

Change-Id: Ide9a38ac5798ba5a2c37f42232dc86b186502085
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 28f9f057aadad0b744dc91df3240caac7e311424)

Report: add data

 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/
 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/

Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 59e06f5e3143bf093bdb6b53c0186b050668e3d4)

FIX: Do not ignore zeros while creating csv file

Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d420e98c6838831877f1aad6aa924844fc009195)
(cherry picked from commit 2f5a43baecf26ebe978772efc8f6186509cff1c7)

FIX: Remove feature plots from base graphs

Change-Id: I4118a19bd6204858e96cbf8029aea045478efca7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cbd331c63db1db3ac51133732a0eb63ea8dc0712)

Use stable/1804 vpp builds for NSH_SFC tests

Change-Id: Iaaf1af31fa526108ebdcf3610bca76346d186183
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report: Add data sources

 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/14/
 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/16/

Change-Id: I7603a41f797a6dd5438c3daa40e883b1643ae712
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 53e9d835462c85738a61ce6f069a05d090645ac8)

CSIT-1041: Trending dashboard

Change-Id: I815e61432d418d0f741ed57f5450460951f7191f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9dad3f95c2624808aeb9892049c236fa788a55d9)

CSIT-1041: Trending dashboard

Change-Id: I1e05f75545d97ab186fbc48df44bfe17472d6cfd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 971bf6f4d091e15952199f0172119228d59f584a)

FIX: TCP perf tests

Change-Id: I6424722641b0cefdf1945b57996bf2c48dc86a3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit de0aa31e85515e2d8a2a5db24e4520e1db26936d)

CSIT-1041: Trending dashboard

Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 79e508504fcd6b5b677e567eb09092c5e0821790)

CSIT-1041: Trending dashboard

Change-Id: I8d53c68643acb18bf2b5ab171672b0de02d2d135
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 52f64f232293130904d54a62609eaffc1b145608)

Report: fix performance comparision tables

Change-Id: Ieae746412427980fb86512253cc58ebcee991317
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6f8266f81bb052e2c0e51b029e47f0eb4f04a7ed)