csit.git
6 years agoReport: remove greps 89/12489/1
Tibor Frank [Wed, 9 May 2018 09:26:04 +0000 (11:26 +0200)]
Report: remove greps

Change-Id: I57fee701a99bcdb4f523011fa774c42ecdacdde4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4fbf1ec2d535d322725d395c369b6c9f7222c8dd)

6 years agoReport: Fix greps 86/12486/1
Tibor Frank [Wed, 9 May 2018 07:53:58 +0000 (09:53 +0200)]
Report: Fix greps

Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8443891dd9915ed3439b0045c0e47935606d5e61)

6 years agorls1804 report: align methodology section with csit master. 78/12478/1
Maciek Konstantynowicz [Tue, 8 May 2018 16:06:20 +0000 (17:06 +0100)]
rls1804 report: align methodology section with csit 

Change-Id: I29899b04ab2806c7d6a418defdcad2651a966c9b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoFIX: Small inconsistencies in report sections 64/12464/1
Peter Mikus [Mon, 7 May 2018 11:38:29 +0000 (13:38 +0200)]
FIX: Small inconsistencies in report sections

Change-Id: I0c27300678414bd3baecccd8e51ca0dc15af73d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoAdd data point to report 57/12457/1
Peter Mikus [Sun, 6 May 2018 05:59:09 +0000 (05:59 +0000)]
Add data point to report

- MRR Sel, Perf FULL 4

Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 313946ec3f85d6fc880a80fbc44ddfe03c8eb2fc)

6 years agotrending docs: fixed maths formulas format again. 54/12454/1
Maciek Konstantynowicz [Sat, 5 May 2018 21:24:18 +0000 (22:24 +0100)]
trending docs: fixed maths formulas format again.

Change-Id: Ia9031e720bddf783a26d25de1ed189bf3b09312f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9cb1c051788f2c4cba2e880ec39c142cf688a657)

6 years agoreport: perf rls notes formatting fixes 53/12453/1
Maciek Konstantynowicz [Sat, 5 May 2018 17:56:29 +0000 (18:56 +0100)]
report: perf rls notes formatting fixes

Change-Id: I075528061822206d17b83cc4b1d475419c4084f9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 995f2727d6306ad05e8ea089632a552ebbf23b21)

6 years agotrending docs: fixed tables and maths formulas. 52/12452/1
Maciek Konstantynowicz [Sat, 5 May 2018 17:49:27 +0000 (18:49 +0100)]
trending docs: fixed tables and maths formulas.

Change-Id: Iad93e7a57655835ee1a75664f142d3fd362f5313
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoReport: func rls_notes formatting fixes. 47/12447/1
Maciek Konstantynowicz [Sat, 5 May 2018 15:34:10 +0000 (16:34 +0100)]
Report: func rls_notes formatting fixes.

Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7e4f0d535fff543b9ec1ef550f3d6bb6068a8160)

6 years agoReport: perf rls_notes formatting fixes. 46/12446/1
Maciek Konstantynowicz [Fri, 4 May 2018 20:47:23 +0000 (21:47 +0100)]
Report: perf rls_notes formatting fixes.

Change-Id: I9f9ba3c59ab007d687f4e268ce91b046b731c850
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit e82babd2345f1c499278b71a891b23ddb002ec87)

6 years agoReport: SRv6 to TSA 43/12443/1
Tibor Frank [Sat, 5 May 2018 10:25:51 +0000 (12:25 +0200)]
Report: SRv6 to TSA

Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 23a620dd663d58e433e62dc417f4f053ae599e88)

6 years agoReport: Add SRv6, fix greps 41/12441/1
Tibor Frank [Sat, 5 May 2018 07:13:18 +0000 (09:13 +0200)]
Report: Add SRv6, fix greps

Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 01b9a636f84ad3b03e2845abd4ebf1a258705b55)

6 years agoReport: data, figures desc 36/12436/1
Tibor Frank [Fri, 4 May 2018 17:52:21 +0000 (17:52 +0000)]
Report: data, figures desc

Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f0ef4dcb6aa7f1157e5b6f2909dde6b89789be14)

6 years agoReport 1804: Centos func tests 31/12431/1
Jan Gelety [Fri, 4 May 2018 13:26:36 +0000 (15:26 +0200)]
Report 1804: Centos func tests

Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit b6ad49a75bf83ddcc89ea92fd9b1dc2fdbb61ae5)

6 years agoReport: data, figures desc 27/12427/1
Tibor Frank [Fri, 4 May 2018 13:05:00 +0000 (15:05 +0200)]
Report: data, figures desc

Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f56e629f1628f938b2a6e1bf27a74375ca3839cf)

6 years agoUpdate L2 perf graph section 24/12424/1
Peter Mikus [Fri, 4 May 2018 12:30:24 +0000 (14:30 +0200)]
Update L2 perf graph section

Change-Id: Iaeff80bd9454e99a97b2d8aeb13450ac06f650ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d520749e07fe534ff278b3713cc5032368bb32fc)

6 years agoReport: Add TSA plots 18/12418/1
Tibor Frank [Fri, 4 May 2018 11:41:43 +0000 (13:41 +0200)]
Report: Add TSA plots

Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4bfd1dcd604dac12d1dd00ba63c0d5e4170a1f2b)

6 years agoFIX: Add default uio driver to perf __init__.robot file 12/12412/1
Jan Gelety [Fri, 4 May 2018 10:43:42 +0000 (12:43 +0200)]
FIX: Add default uio driver to perf __init__.robot file

Change-Id: Ib231a8d4bf8ac082250e788c7cae53cd8bb368f3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoReport rls notes: added ref to trending docs. 11/12411/1
Maciek Konstantynowicz [Fri, 4 May 2018 09:55:21 +0000 (10:55 +0100)]
Report rls notes: added ref to trending docs.

Change-Id: I4690a4e5f9ca9ba34d3f51b2b2068e9007558839
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 202f199be94d87144384f3ea9c6d50e9766b0d73)

6 years agoUpdate release note for rls1804 report 08/12408/1
Peter Mikus [Thu, 3 May 2018 08:14:11 +0000 (10:14 +0200)]
Update release note for rls1804 report

Change-Id: I3e80997ace8073edc90f662f6393bd62005fc815
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit ceb7c2545cda1bc7fe3d4bf35cdf75253efe8c6d)

6 years agoReport: Data, plots, datetime 05/12405/2
Tibor Frank [Fri, 4 May 2018 04:31:05 +0000 (06:31 +0200)]
Report: Data, plots, datetime

Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoFIX: TCP perf tests 03/12403/1
Tibor Frank [Wed, 2 May 2018 07:27:17 +0000 (09:27 +0200)]
FIX: TCP perf tests

Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2005c286222ebb1456a6dbe41fdca6dbfeb361f6)

6 years agoReport: Add time to the timestamp 97/12397/1
Tibor Frank [Thu, 3 May 2018 19:50:38 +0000 (19:50 +0000)]
Report: Add time to the timestamp

Change-Id: I323517fbac177ef31861be747feeb81968d2b330
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b3d9cf247f3de5558b0a8e42b63178dc1924ee73)

6 years agoReport: Add time to the timestamp 93/12393/1
Tibor Frank [Thu, 3 May 2018 19:22:44 +0000 (19:22 +0000)]
Report: Add time to the timestamp

Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7da4d5715a7d777562f8d524d075d2b08451af83)

6 years agoReport: Add time to the timestamp 89/12389/1
Tibor Frank [Thu, 3 May 2018 16:38:50 +0000 (16:38 +0000)]
Report: Add time to the timestamp

Change-Id: I1343e84353230329362848d1389ae41b169d2791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9c593381a09b1911419e1a67b6af17eb7d801308)

6 years agoReport: Add time to the timestamp 83/12383/1
Tibor Frank [Thu, 3 May 2018 13:06:10 +0000 (15:06 +0200)]
Report: Add time to the timestamp

Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 886bf3329c7027ded79ec0b59184f1fcb047130d)

6 years agoReport: data 76/12376/1
Tibor Frank [Thu, 3 May 2018 10:51:16 +0000 (12:51 +0200)]
Report: data

 - ligato

Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 15c597db37ffdc4477916344357af1145d4f28eb)

6 years agoReport 1804: SRv6 and func part update 69/12369/1
Jan Gelety [Thu, 26 Apr 2018 12:46:56 +0000 (14:46 +0200)]
Report 1804: SRv6 and func part update

Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoReport: data 66/12366/1
Tibor Frank [Thu, 3 May 2018 06:09:42 +0000 (08:09 +0200)]
Report: data

Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3acc992d8774e1b65c1e6d8c7147a204c1af6436)

6 years agoTrending: ignore list for the dashboard 61/12361/1
Tibor Frank [Thu, 3 May 2018 04:46:14 +0000 (06:46 +0200)]
Trending: ignore list for the dashboard

Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 49a8905978a65910a2fb75f04de29b3dd77f825a)

6 years agoReport: Add MRR detailed results 56/12356/1
Tibor Frank [Wed, 2 May 2018 19:45:00 +0000 (19:45 +0000)]
Report: Add MRR detailed results

Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 255db8b62f4623f25c91333d3592d2f411a6ef8a)

6 years agoTrending: ignore list for the dashboard 47/12347/1
Tibor Frank [Wed, 2 May 2018 14:26:56 +0000 (16:26 +0200)]
Trending: ignore list for the dashboard

Change-Id: Ibdb134517097bc9cacdcb75a11dda59290ab4e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Delete xml file when parsed 43/12343/1
Tibor Frank [Wed, 2 May 2018 13:20:38 +0000 (15:20 +0200)]
Report: Delete xml file when parsed

Change-Id: Ie28c3f3fb58a76ada1cf292ba4c8a401d0ec7155
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9d9b972b994fc8da54c47e3e9a2ef284776c3f52)

6 years agoReport: Add MRR detailed results 40/12340/1
Tibor Frank [Wed, 2 May 2018 08:48:31 +0000 (10:48 +0200)]
Report: Add MRR detailed results

Change-Id: Ib34689d0a9560c2adc8f9c7e464f5fbf4a2ae1f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c71b538b882cfdf8c5a940b8183a6f75a0915e42)

6 years agoFIX: Docker container image 99/12299/6
Peter Mikus [Wed, 2 May 2018 06:45:39 +0000 (06:45 +0000)]
FIX: Docker container image

Change-Id: I127fe11b9095fb24a536dce7d6c26c7e7fd4be4e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoTrending: Add 2vm tests 33/12333/1
Tibor Frank [Wed, 2 May 2018 12:14:27 +0000 (14:14 +0200)]
Trending: Add 2vm tests

Change-Id: Ifc008ba50c4c84e781c12dc3080d3a361090efb6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Replace copy with move while archiving input files 23/12323/1
Tibor Frank [Wed, 2 May 2018 11:02:04 +0000 (13:02 +0200)]
Report: Replace copy with move while archiving input files

Change-Id: Iea741cf3346574cc5def8c13e2660e2760157487
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2093328406eb64ae825a06967632e901ae0ba6db)
(cherry picked from commit ee9041274618cf3103477681603b9185dcd9904c)

6 years agoReport: Add data 12/12312/1
Tibor Frank [Wed, 2 May 2018 08:51:05 +0000 (10:51 +0200)]
Report: Add data

Change-Id: Id860fe218da5fd608aba163588e92c28b4c8cb53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 120cc891f690dab55377f972c2c989cd6e621e95)

6 years agoFIX: Ligato VPP_AGENT_VERSION 05/12305/5
Peter Mikus [Wed, 2 May 2018 07:23:28 +0000 (07:23 +0000)]
FIX: Ligato VPP_AGENT_VERSION

Change-Id: Ifce0fd94652498302d3e36f6b83453a701784619
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoReport: data 02/12302/1
Tibor Frank [Wed, 2 May 2018 06:51:56 +0000 (08:51 +0200)]
Report: data

Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fc3fec34f9befb4781fbdfb4d9cc669f08f70624)

6 years agoReport: Add CentOS func tests 64/12264/1
Tibor Frank [Fri, 27 Apr 2018 16:21:19 +0000 (16:21 +0000)]
Report: Add CentOS func tests

Change-Id: I2e993738306ee0a5435c0fda7e46de300fcc91fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9eb9f9300831fcdd56dbefac7aaec5659cdfc31c)

6 years agoReport: Add CentOS func tests 55/12255/1
Tibor Frank [Fri, 27 Apr 2018 11:37:30 +0000 (11:37 +0000)]
Report: Add CentOS func tests

Change-Id: Ib8fae5f152ef11da478f2a8470f20e58bc516aec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 656847dee807b10f89c17d212a0c08848164ee67)

6 years agoHC tests: reenable NSH plugin (CSIT-994) 62/12162/2
Marek Gradzki [Thu, 26 Apr 2018 08:11:32 +0000 (10:11 +0200)]
HC tests: reenable NSH plugin (CSIT-994)

Reverts https://gerrit.fd.io/r/#/c/11088/

Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
6 years agoReport: delete tmp dir 46/12246/1
Tibor Frank [Fri, 27 Apr 2018 10:02:33 +0000 (12:02 +0200)]
Report: delete tmp dir

Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f5d0c4d77058099fdd48a161e05c83676b119c2c)

6 years agoReport: add data 42/12242/1
Tibor Frank [Fri, 27 Apr 2018 09:50:04 +0000 (11:50 +0200)]
Report: add data

Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 09b5d7df5081bddc9c5257575e7d79038f37f734)

6 years agoCSIT-1041: Do not include last week for long term 37/12237/1
Vratko Polak [Fri, 27 Apr 2018 08:40:09 +0000 (10:40 +0200)]
CSIT-1041: Do not include last week for long term

Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 1b8f3a42136d6d4ba3e749eda770bd06b9089ab2)

6 years agoReport: Add CentOS func tests 33/12233/1
Tibor Frank [Fri, 27 Apr 2018 08:21:28 +0000 (10:21 +0200)]
Report: Add CentOS func tests

Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 06027cf4a33ff75146cbf5e91b029dc801158797)

6 years agoFIX: Add api-segment conf to TCP tests 26/12226/1
Tibor Frank [Wed, 25 Apr 2018 08:23:18 +0000 (10:23 +0200)]
FIX: Add api-segment conf to TCP tests

Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 021ff1a582f69438f3aa81b1e2d4879ef0ab2952)

6 years agoReport: Add data 23/12223/1
Tibor Frank [Fri, 27 Apr 2018 07:28:29 +0000 (09:28 +0200)]
Report: Add data

Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 99489ad1ec752855345a432085a96539b8973e1a)

6 years agoFIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr 19/12219/1
Jan Gelety [Fri, 27 Apr 2018 07:09:14 +0000 (09:09 +0200)]
FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr

Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit c4303988fdbe0476ad850450da36732818fe590d)

6 years agoCSIT-1041: Trending dashboard - colours 16/12216/1
Tibor Frank [Fri, 27 Apr 2018 06:21:54 +0000 (08:21 +0200)]
CSIT-1041: Trending dashboard - colours

Change-Id: I781e901e81f201d1335708c99eb52783f349725c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb6840a319390feb18b2ca32854edf1a6ad15e95)

6 years agoNew section: trending analysis methodology 12/12212/1
Maciek Konstantynowicz [Wed, 25 Apr 2018 21:17:55 +0000 (22:17 +0100)]
New section: trending analysis methodology

Change-Id: I09ec04759a5f1f01c3835349c3ae094ae459226e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2cc56891f5e5b399bd5fbe761c64fcd937e46750)

6 years agoTrending: switch back to 3*stdev 01/12201/1
Vratko Polak [Thu, 26 Apr 2018 16:35:58 +0000 (18:35 +0200)]
Trending: switch back to 3*stdev

Reporting many fake pro/regressions is worse
then missing few of the real ones.

Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 3c510d8dd18bd8ceb2c5d86ed058976e72ddead4)

6 years agoReport: Add historical data to performance changes table 98/12198/1
Tibor Frank [Thu, 26 Apr 2018 18:10:17 +0000 (18:10 +0000)]
Report: Add historical data to performance changes table

Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5d040b65766fa5d7d6ad111def619abb8c878b87)

6 years agoReport: Add historical data to performance changes table 90/12190/1
Tibor Frank [Thu, 26 Apr 2018 15:56:31 +0000 (15:56 +0000)]
Report: Add historical data to performance changes table

Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7f9cb1bc6f96ca79fdba328fd14ce197e28c7a7)

6 years agoReport: Add historical data to performance changes table 85/12185/1
Tibor Frank [Thu, 26 Apr 2018 12:11:11 +0000 (14:11 +0200)]
Report: Add historical data to performance changes table

Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 52cb667958d954d6233d0865a59d90cca82db026)

6 years agoCSIT-1041: Trending dashboard 81/12181/1
Tibor Frank [Thu, 26 Apr 2018 11:09:11 +0000 (13:09 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0740688e5798f7ab7162fd7f4bc5eb8455164a7c)

6 years agoTrending: use 2*stdev 77/12177/1
Tibor Frank [Thu, 26 Apr 2018 10:34:28 +0000 (12:34 +0200)]
Trending: use 2*stdev

Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d5d53957f4686398727469e0f5b1774a5b6560fe)

6 years agoReport: remove VPP unit tests 73/12173/1
Tibor Frank [Thu, 26 Apr 2018 10:27:32 +0000 (12:27 +0200)]
Report: remove VPP unit tests

Change-Id: I1fb0dd1e2d135fab29014d627e003e08ff0a98d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1090a73a99ea3980fd6bbc9b8acd4ccc47b4fb61)

6 years agoReport: Add data 69/12169/1
Tibor Frank [Thu, 26 Apr 2018 10:18:35 +0000 (12:18 +0200)]
Report: Add data

Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b892452e1fe2d226f526f9a0685b1095e36b8050)

6 years agoReport: Add historical data to performance changes table 60/12160/1
Tibor Frank [Thu, 26 Apr 2018 08:08:42 +0000 (10:08 +0200)]
Report: Add historical data to performance changes table

Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7fe3850f2777db5c5b6d1fbd0877ebd7cac0f18)

6 years agoReport: Add historical data to performance changes table 53/12153/1
Tibor Frank [Thu, 26 Apr 2018 06:33:06 +0000 (08:33 +0200)]
Report: Add historical data to performance changes table

Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 623eb22347f7d5218d3536f620d6911cc312d7dd)

6 years agoCSIT-1041: Use TMM for trending line 49/12149/1
Vratko Polak [Wed, 25 Apr 2018 15:35:52 +0000 (17:35 +0200)]
CSIT-1041: Use TMM for trending line

+ Make also pro/re-gression detection use TMM.
+ Update graphs.
- Do not update dashboard tables yet.

Change-Id: Iae526c846b329ad99549be61481532e197704fb0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit fde192bc8a6ba1a4e2b4cf5b3297fb076efd58fc)

6 years agoUpdate report content 47/12147/1
Peter Mikus [Tue, 24 Apr 2018 11:36:20 +0000 (13:36 +0200)]
Update report content

- Update report content to match with rls1804 and master

Change-Id: Ib50df2482635f07c94ba92f0ed766bd95bc8e52c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1261ada9edd22c784a7763d861c5acf87ccd1ae1)

6 years agoUse VPP release 18.04 builds 33/12133/2
Jan Gelety [Wed, 25 Apr 2018 17:18:41 +0000 (19:18 +0200)]
Use VPP release 18.04 builds

Change-Id: I2fdece7633774ba24660b78a465eb4b74bbf26a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-1041: Trending dashboard 38/12138/1
Tibor Frank [Wed, 25 Apr 2018 17:25:30 +0000 (17:25 +0000)]
CSIT-1041: Trending dashboard

Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a1728c4f56cc44b9acb45614c20fc0a546ee3161)

6 years agoCSIT-1041: Trending dashboard 29/12129/1
Tibor Frank [Wed, 25 Apr 2018 15:21:50 +0000 (17:21 +0200)]
CSIT-1041: Trending dashboard

Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0f662ea0defa9b30fa7a7d9256857fce92d20a6e)

6 years agoCSIT-1041: Trending dashboard 21/12121/1
Tibor Frank [Wed, 25 Apr 2018 13:28:14 +0000 (15:28 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6e1a15acc7bd3685d71f9d34238181c681dcd4c0)

6 years agoCSIT-1041: Do not treat positive jumps as outliers 17/12117/1
Vratko Polak [Tue, 24 Apr 2018 12:27:30 +0000 (14:27 +0200)]
CSIT-1041: Do not treat positive jumps as outliers

Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 0a8855adbb30a6079a538bea179a13988fdc20c0)

6 years agoEdits of intro to perf trending dashboard 14/12114/1
Maciek Konstantynowicz [Wed, 25 Apr 2018 12:36:47 +0000 (13:36 +0100)]
Edits of intro to perf trending dashboard

Change-Id: Ide9a38ac5798ba5a2c37f42232dc86b186502085
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 28f9f057aadad0b744dc91df3240caac7e311424)

6 years agoReport: add data 06/12106/1
Tibor Frank [Wed, 25 Apr 2018 08:39:47 +0000 (10:39 +0200)]
Report: add data

 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/
 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/

Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 59e06f5e3143bf093bdb6b53c0186b050668e3d4)

6 years agoFIX: Do not ignore zeros while creating csv file 98/12098/1
Tibor Frank [Wed, 25 Apr 2018 06:48:02 +0000 (08:48 +0200)]
FIX: Do not ignore zeros while creating csv file

Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d420e98c6838831877f1aad6aa924844fc009195)
(cherry picked from commit 2f5a43baecf26ebe978772efc8f6186509cff1c7)

6 years agoFIX: Remove feature plots from base graphs 93/12093/1
Tibor Frank [Wed, 25 Apr 2018 06:27:29 +0000 (08:27 +0200)]
FIX: Remove feature plots from base graphs

Change-Id: I4118a19bd6204858e96cbf8029aea045478efca7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cbd331c63db1db3ac51133732a0eb63ea8dc0712)

6 years agoUse stable/1804 vpp builds for NSH_SFC tests 70/12070/6
Jan Gelety [Tue, 24 Apr 2018 09:56:03 +0000 (11:56 +0200)]
Use stable/1804 vpp builds for NSH_SFC tests

Change-Id: Iaaf1af31fa526108ebdcf3610bca76346d186183
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoReport: Add data sources 68/12068/1
Tibor Frank [Tue, 24 Apr 2018 09:04:35 +0000 (11:04 +0200)]
Report: Add data sources

 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/14/
 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/16/

Change-Id: I7603a41f797a6dd5438c3daa40e883b1643ae712
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 53e9d835462c85738a61ce6f069a05d090645ac8)

6 years agoCSIT-1041: Trending dashboard 63/12063/1
Tibor Frank [Tue, 24 Apr 2018 08:39:38 +0000 (10:39 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I815e61432d418d0f741ed57f5450460951f7191f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9dad3f95c2624808aeb9892049c236fa788a55d9)

6 years agoCSIT-1041: Trending dashboard 59/12059/1
Tibor Frank [Tue, 24 Apr 2018 07:31:21 +0000 (09:31 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I1e05f75545d97ab186fbc48df44bfe17472d6cfd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 971bf6f4d091e15952199f0172119228d59f584a)

6 years agoFIX: TCP perf tests 48/12048/1
Tibor Frank [Tue, 24 Apr 2018 06:07:47 +0000 (08:07 +0200)]
FIX: TCP perf tests

Change-Id: I6424722641b0cefdf1945b57996bf2c48dc86a3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit de0aa31e85515e2d8a2a5db24e4520e1db26936d)

6 years agoCSIT-1041: Trending dashboard 42/12042/1
Tibor Frank [Tue, 24 Apr 2018 05:28:44 +0000 (07:28 +0200)]
CSIT-1041: Trending dashboard

Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 79e508504fcd6b5b677e567eb09092c5e0821790)

6 years agoCSIT-1041: Trending dashboard 19/12019/1
Tibor Frank [Mon, 23 Apr 2018 14:57:44 +0000 (16:57 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I8d53c68643acb18bf2b5ab171672b0de02d2d135
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 52f64f232293130904d54a62609eaffc1b145608)

6 years agoReport: fix performance comparision tables 10/12010/1
Tibor Frank [Mon, 23 Apr 2018 11:41:51 +0000 (13:41 +0200)]
Report: fix performance comparision tables

Change-Id: Ieae746412427980fb86512253cc58ebcee991317
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6f8266f81bb052e2c0e51b029e47f0eb4f04a7ed)

6 years agoCSIT-1041: Trending dashboard 06/12006/1
Tibor Frank [Mon, 23 Apr 2018 11:30:48 +0000 (13:30 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I3b8e545bd198281af502acc6e23268e840112423
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7aa0d625baca67d9789b5db3da2ee468597d254b)

6 years agoCSIT-1009: SRv6 proxy tests 02/12002/1
Jan Gelety [Thu, 22 Mar 2018 12:51:33 +0000 (13:51 +0100)]
CSIT-1009: SRv6 proxy tests

- SRv6 with endpoint to SR-unaware Service Function via static proxy
- SRv6 with endpoint to SR-unaware Service Function via dynamic proxy
- SRv6 with endpoint to SR-unaware Service Function via masquerading proxy

Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 73a01b1a7fc836c964627eea2c08106df0da5aee)

6 years agoCSIT-1041: Trending dashboard 00/12000/1
Tibor Frank [Mon, 23 Apr 2018 10:20:20 +0000 (12:20 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I99b7acbbf6c773a4d2c5fc74cf7ba02aa6f98fa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cd330b5a1bf1a289e7dad68420679a5d94de1eda)

6 years agoReport: data 96/11996/1
Tibor Frank [Mon, 23 Apr 2018 09:47:39 +0000 (11:47 +0200)]
Report: data

Change-Id: I63a4a6f65aa80a4edb11b1ea3ece9787a148f6f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 85a5bd538583f33dc63e072cfa4b3b6750958191)

6 years agoUpdate of VPP_STABLE_VER files 83/11983/2
Jan Gelety [Mon, 23 Apr 2018 06:54:43 +0000 (08:54 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.04-rc2~18-gfd2e376~b37_amd64

- use new vpp ref build - centos7:
  18.04-rc2~18_gfd2e376~b38.x86_64

Change-Id: I597c9189afd0501141aa3417fc7bff235d33d7ef
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoReport: data 91/11991/1
Tibor Frank [Mon, 23 Apr 2018 08:02:24 +0000 (10:02 +0200)]
Report: data

Change-Id: I3fd24ba9030a62f9307a24e8774e703fa8232692
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d94b0d05bad404db4d44bc12a96f29a838394c94)

6 years agoCSIT-1041: Trending dashboard 87/11987/1
Tibor Frank [Mon, 23 Apr 2018 07:29:29 +0000 (09:29 +0200)]
CSIT-1041: Trending dashboard

 - add long term classification

Change-Id: Iec8d2275c01da3b1e41435b9abfb70ec3fe98fd3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7aff808942440ba9729bf60888738b920c024324)

6 years agoPAL Trending: fix in remove_outliers 82/11982/1
Tibor Frank [Mon, 23 Apr 2018 06:17:35 +0000 (08:17 +0200)]
PAL Trending: fix in remove_outliers

Change-Id: Iec4d1683b8bb97224971d803821aced3c37144bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7cfdac0cf07e3a7d9a8b53b7621f8b7500fd1515)

6 years agoFIX: Use rolling window for outlier detection 79/11979/1
Vratko Polak [Fri, 20 Apr 2018 12:23:11 +0000 (14:23 +0200)]
FIX: Use rolling window for outlier detection

+ Rename find_outliers to split_outliers.
+ Make remove_ouliers call split_outliers internally.
+ Add "window" argument to both functions.
+ Add TODOs to call sites not setting window size explicitly.
+ Improve docstrings.

Change-Id: I24961e2859ddbfa62b543031284517c7389a2abb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4f5872c1bb23873b3a93cb471aae8700d5ca029d)

6 years agoFIX: Restart VPP in container before each test 72/11972/1
Peter Mikus [Fri, 20 Apr 2018 11:57:02 +0000 (13:57 +0200)]
FIX: Restart VPP in container before each test

Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit f3d66d9ca20e7fb2b153d83d809f005a93b76a8f)

6 years agoCSIT-1053: csit-dpdk-perf-1804-all data 68/11968/1
Tibor Frank [Fri, 20 Apr 2018 12:23:03 +0000 (14:23 +0200)]
CSIT-1053: csit-dpdk-perf-1804-all data

Change-Id: I38f6260bdaf94c39c105c0faa9779773d76cb972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4cc8b3a4b890ecd7cefcb22a5f2a2acd1036cf78)

6 years agoCSIT-1041: Trending dashboard 62/11962/1
Tibor Frank [Fri, 20 Apr 2018 12:14:23 +0000 (14:14 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I56437bdb0c0b7309e2bdf4a81fd9e9b20843b040
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0bd0db7f4e5333bcc93fc981594bb90a2ed140fb)

6 years agoFIX: Configure number of memif queus properly 45/11945/1
Peter Mikus [Wed, 18 Apr 2018 15:09:33 +0000 (17:09 +0200)]
FIX: Configure number of memif queus properly

Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit c8b2f57cd09355e0e89e6b9d28930281573bec23)

6 years agoCSIT-1041: Trending dashboard 30/11930/1
Tibor Frank [Thu, 19 Apr 2018 13:00:14 +0000 (15:00 +0200)]
CSIT-1041: Trending dashboard

Change-Id: Ide76682e210412fdcd945a21946fa9957429109d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bb81ef05b86154d000128ef15bd3ecffe997ef9a)

6 years agoCSIT-1041: Trending dashboard 24/11924/1
Tibor Frank [Thu, 19 Apr 2018 10:34:22 +0000 (12:34 +0200)]
CSIT-1041: Trending dashboard

Change-Id: Id5a6a431261443eb8616c9d6ff4cc43b6f054791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a0f580f21995185fcbd02aac905d83275faeda72)

6 years agoCSIT-1041: Trending dashboard 19/11919/1
Tibor Frank [Thu, 19 Apr 2018 09:28:15 +0000 (11:28 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I175bf9269a9f958dc35d592a2810b7a6f37268a3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1265b8792b8edd44407c8073aeba2ca24dc0ad82)

6 years agoCSIT-1052: Remove HC Performance from 1804 report 12/11912/1
Tibor Frank [Thu, 19 Apr 2018 06:41:24 +0000 (08:41 +0200)]
CSIT-1052: Remove HC Performance from 1804 report

Change-Id: I924028fd6d56fff1859bc1fd27d7a5273d54435f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 98f7c4743d36b03cbe9952ff7e3e60e39f851e2d)

6 years agoFIX: Memif tests failing 09/11909/1
Peter Mikus [Wed, 18 Apr 2018 09:11:19 +0000 (11:11 +0200)]
FIX: Memif tests failing

- CSIT-1049

Change-Id: I073c1e6d8cdda835fbb955cbf79e982bc2cc6228
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 30c94055dd6ec2fe1cb83455cf6eb4bca8648d45)
(cherry picked from commit 04cf5c92a82b11f8eb2cafc3a07793474e84a322)

6 years agoCSIT-1041: Trending dashboard 05/11905/1
Tibor Frank [Thu, 19 Apr 2018 05:21:03 +0000 (07:21 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I2b08c3c1859302437092456da4bb8f1ebe4756bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6942369b1102a8b9a3b705f9192f1ecb959382d1)