csit.git
4 years agoReport: clean-up ipsec tests 89/19589/1
Tibor Frank [Wed, 15 May 2019 07:52:59 +0000 (09:52 +0200)]
Report: clean-up ipsec tests

Change-Id: I3fd52fdeccc73332a85f695442cbe86fcf94b489
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: Add IPSECSW 85/19585/1
Tibor Frank [Wed, 15 May 2019 07:09:07 +0000 (09:09 +0200)]
Trending: Add IPSECSW

Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1504: Soak tests - box plots 83/19583/1
Tibor Frank [Wed, 15 May 2019 06:53:42 +0000 (08:53 +0200)]
CSIT-1504: Soak tests - box plots

- table: stdev, round deltas to 2 dec places

Change-Id: I29cd1f7c9ba8ef73a8281d42ac9f6a06ed30bbdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Remove old restart sequence - Honeycomb 53/19553/6
Peter Mikus [Tue, 14 May 2019 07:27:33 +0000 (07:27 +0000)]
FIX: Remove old restart sequence - Honeycomb

Change-Id: I12865ea4f48c1902e80e67463fff4cf481a2e24c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1504: Soak tests - graph 59/19559/1
Tibor Frank [Tue, 14 May 2019 08:59:45 +0000 (10:59 +0200)]
CSIT-1504: Soak tests - graph

Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Remove CFS_OPT from 2n/3n-skx ndrpdr full 56/19556/1
Tibor Frank [Tue, 14 May 2019 08:14:42 +0000 (10:14 +0200)]
Report: Remove CFS_OPT from 2n/3n-skx ndrpdr full

Change-Id: If82e9c19e9d2035e62c7e455458ebdef20659adb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 54/19554/1
Tibor Frank [Tue, 14 May 2019 08:04:41 +0000 (10:04 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

- clean-up

Change-Id: I020837a89415fdb891ffbb094c9a5edf50946dd2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Remove old VPP Restart sequence 52/19552/1
Peter Mikus [Tue, 14 May 2019 07:02:14 +0000 (07:02 +0000)]
FIX: Remove old VPP Restart sequence

- Honeycomb __init__

Change-Id: I0a230ac5692e7701b485698e9406461d7a251bf9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRemove CFSRR1 VM tests 44/19544/2
Peter Mikus [Mon, 13 May 2019 14:52:18 +0000 (14:52 +0000)]
Remove CFSRR1 VM tests

- Per agreed

Change-Id: Ie955ebfe19bff8c4a8671a0f62eea5be4407caa5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 42/19542/1
Tibor Frank [Mon, 13 May 2019 14:38:23 +0000 (16:38 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

- fix text case name

Change-Id: I01c228a920729b2e2ab3e4fb4669d68469b1c58f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Latency stream not using VM transformation 33/19533/3
Peter Mikus [Mon, 13 May 2019 11:35:32 +0000 (11:35 +0000)]
FIX: Latency stream not using VM transformation

Change-Id: Ibda7467dac7775427a8edafc6fa76f936d15d272
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 39/19539/1
Tibor Frank [Mon, 13 May 2019 12:43:20 +0000 (14:43 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

 - fix model

Change-Id: Ifae4b4039c905c990dda578a620b9ffc232e5786
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 34/19534/2
Tibor Frank [Mon, 13 May 2019 11:56:39 +0000 (13:56 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add SOAK Tests 30/19530/1
Tibor Frank [Mon, 13 May 2019 08:56:18 +0000 (10:56 +0200)]
Report: Add SOAK Tests

Change-Id: I22eec7cf8ff25958218d4b8ac6bab5a34b2f206c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 28/19528/1
Tibor Frank [Mon, 13 May 2019 08:39:21 +0000 (10:39 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6e35ba3a89e02fa1e34e5ef637598cb6e22baaaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configuration for 1904.20 26/19526/1
Tibor Frank [Mon, 13 May 2019 08:00:32 +0000 (10:00 +0200)]
Report: Configuration for 1904.20

Change-Id: I4bbf1ed196947cc290de943b1e39721021d9d7d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add pdf version 16/19516/1
Tibor Frank [Fri, 10 May 2019 14:28:50 +0000 (16:28 +0200)]
Report: Add pdf version

Change-Id: I6d4770b163844bb5b30d62b2becac13714702b06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoPLRsearch: Use stat trackers to shorten Integrator 67/16667/64
Vratko Polak [Wed, 2 Jan 2019 13:18:50 +0000 (14:18 +0100)]
PLRsearch: Use stat trackers to shorten Integrator

+ Extract several tracker classes and use them in Integrator.
+ Apply next_rate workarounds to focus more on critical region.
+ Rewrite stretch function, as the previous implementation was wrong.
+ Rework logging:
++ Use injected trace() function in Integrator.
++ Inject function that skips trace logging on default initialization.
++ Use the same multiprocessing-safe passing, but separate queue.
+ Set duration to 120m in Robot, but keep at 30m in Python.
+ Apply minor changes to make computations more reproducible:
++ Attempt to log everything needed by reproducibility in one line.
++ Log samples used, and make it settable as upper limit.
++ Use repr output in TRex scripts, to avoid rounding when copypasting.
+- Numpy seems to be sharing PRNG between processes.
+-- An edit to disable one thread is needed for full reproducibility.
+-- Such an edit is prepared, but will not be merged anytime soon.

Change-Id: Icf56429b34ab6de2d18a12e6c676e2d242b3ba4c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add message if no oper data is present 13/19513/2
Tibor Frank [Fri, 10 May 2019 14:25:12 +0000 (16:25 +0200)]
Report: Add message if no oper data is present

Change-Id: Ic70f603a652ae1297aba29187d1f61f30678be41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate perf release notes 1904 10/19510/3
Peter Mikus [Fri, 10 May 2019 14:13:41 +0000 (14:13 +0000)]
Update perf release notes 1904

Change-Id: Ia74d6270ef0b654efb77a369f240e7a9c53156c5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: Hide DMM 09/19509/2
Tibor Frank [Fri, 10 May 2019 14:13:43 +0000 (16:13 +0200)]
Report: Hide DMM

Change-Id: Ib1381365b01cecb701a956a22131d2b4fe1a3b60
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoreport: added missing sub-section header in methodology throughput 07/19507/1
Maciek Konstantynowicz [Fri, 10 May 2019 14:07:00 +0000 (15:07 +0100)]
report: added missing sub-section header in  methodology throughput

Change-Id: Iadeaca5d39be051ef334f98e50a6a17210c503bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoFIX: Missing show run data in NDRPDR 99/19499/2
Peter Mikus [Fri, 10 May 2019 11:59:18 +0000 (11:59 +0000)]
FIX: Missing show run data in NDRPDR

Change-Id: If4b013ef4bf4bc8f857913f3847ab3b2e2aa5a5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: NFV density - diff as integer 02/19502/1
Tibor Frank [Fri, 10 May 2019 12:31:53 +0000 (14:31 +0200)]
Report: NFV density - diff as integer

Change-Id: Iab093484375418765812707935193b35d8b07d3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate PLRsearch methodology to latest code 83/17783/28
Vratko Polak [Fri, 10 May 2019 11:33:22 +0000 (13:33 +0200)]
Update PLRsearch methodology to latest code

Deleted much of terms and generalized descriptions,
added more details on the current implementation.

- Still with old graphs

Change-Id: I9ba6b40d1d9d36d4f10382f60c756f5bc4708e4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add message if no oper data is present 98/19498/2
Tibor Frank [Fri, 10 May 2019 10:50:13 +0000 (12:50 +0200)]
Report: Add message if no oper data is present

Change-Id: I9295dd21934bf5d7f14b282ee5830056362581c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoreport: edits of methodology mlrsearch section 92/19492/2
Maciek Konstantynowicz [Fri, 10 May 2019 10:05:15 +0000 (11:05 +0100)]
report: edits of methodology mlrsearch section

Change-Id: I80b4f8223d2991e258ab422c447bdc09d92c9e9c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 95/19495/2
Tibor Frank [Fri, 10 May 2019 10:12:37 +0000 (12:12 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I36e6b6247a213960047f48d3e1ef5b57564cf242
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: VPP_func update 2 88/19488/3
Jan Gelety [Fri, 10 May 2019 09:21:46 +0000 (11:21 +0200)]
Report: VPP_func update 2

Change-Id: I840f61211bd01e26862ae7af40522a82ce8cfb25
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoUpdate release notes 1904 87/19487/4
Peter Mikus [Fri, 10 May 2019 09:12:07 +0000 (09:12 +0000)]
Update release notes 1904

Change-Id: Ib31d809b2c1741374fe3bd03e21adea6336bc7f5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoreport: further edits of methodology throughput sections 65/19465/6
Maciek Konstantynowicz [Thu, 9 May 2019 11:39:52 +0000 (12:39 +0100)]
report: further edits of methodology throughput sections

Change-Id: I571d1a47743eb31ee10caf3f3336ac7437daf878
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoRelease notes: 1904 85/19485/2
Peter Mikus [Fri, 10 May 2019 07:46:43 +0000 (07:46 +0000)]
Release notes: 1904

Change-Id: I3b075b210f3e3c126d049799aea15f6b75235677
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: VPP_func update 71/19471/2
Jan Gelety [Thu, 9 May 2019 12:46:44 +0000 (14:46 +0200)]
Report: VPP_func update

Change-Id: I7d551e4d62b1678347c8c5c08a42201567a497cf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Hide wrk 82/19482/1
Tibor Frank [Fri, 10 May 2019 06:39:10 +0000 (08:39 +0200)]
Report: Hide wrk

Change-Id: Id1902a98c9a533e87aefd1d14fd936d5c5b90f5f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: hide soak tests 66/19466/1
Tibor Frank [Thu, 9 May 2019 11:43:21 +0000 (13:43 +0200)]
Report: hide soak tests

Change-Id: I0c738764aaf16b5858d70d7a9fda6752b912cc01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: nfv density graphs - update static content 63/19463/2
Tibor Frank [Thu, 9 May 2019 11:36:30 +0000 (13:36 +0200)]
Report: nfv density graphs - update static content

Change-Id: Ia271330e86fdba1332bb12890458a953c4e0832c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoRemove old VPP Restart sequence 80/19380/8
Peter Mikus [Mon, 6 May 2019 15:29:52 +0000 (15:29 +0000)]
Remove old VPP Restart sequence

Change-Id: I7f71a9709ad55ce03d73e23cc8a9f5064947ed51
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: Remove Denverton 61/19461/1
Tibor Frank [Thu, 9 May 2019 11:19:26 +0000 (13:19 +0200)]
Report: Remove Denverton

Change-Id: I1c1fa3b466feb24b647255f2b0f70c2cff4cbf0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Remove Ligato 53/19453/2
Tibor Frank [Thu, 9 May 2019 08:16:34 +0000 (10:16 +0200)]
Report: Remove Ligato

Change-Id: Ia530ef2fb21968852a5366a1bf1c4d0521002c5b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 48/19448/2
Tibor Frank [Thu, 9 May 2019 07:13:38 +0000 (09:13 +0200)]
CSIT-1488: Add data to the Report 1904

- HoneyComb

Change-Id: I0f7d6ef4368d347c245b8962d3ce346b73d5932a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd new higher density NF tests 36/19436/2
Peter Mikus [Wed, 8 May 2019 18:04:37 +0000 (18:04 +0000)]
Add new higher density NF tests

Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1492: Add NF density tests 49/19449/1
Tibor Frank [Thu, 9 May 2019 07:39:55 +0000 (09:39 +0200)]
CSIT-1492: Add NF density tests

Change-Id: I6723485ce71262de13e703b975a551d97f18e968
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 45/19445/1
Tibor Frank [Thu, 9 May 2019 07:01:44 +0000 (09:01 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I88ae579e6061d381c0efa5d7611c4af263ae92d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 90/19390/2
Tibor Frank [Tue, 7 May 2019 08:02:31 +0000 (10:02 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I36449f11d5ab22a97959ba60737cd5d01f1c0618
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: NFV Graphs 43/19443/1
Tibor Frank [Thu, 9 May 2019 06:20:56 +0000 (08:20 +0200)]
Report: NFV Graphs

Change-Id: Id27e66c62b094d1b5dc70710cc7880f06e56b907
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoreport: edits to methodology_kvm_vms_vhost_user 32/19432/2
Maciek Konstantynowicz [Wed, 8 May 2019 13:57:19 +0000 (14:57 +0100)]
report: edits to methodology_kvm_vms_vhost_user

Change-Id: Iaa2cd0bbe6171ac800489b897ddae079332b48ee
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoreport: edits of methodology throughput sections 30/19430/4
Maciek Konstantynowicz [Wed, 8 May 2019 11:13:42 +0000 (12:13 +0100)]
report: edits of methodology throughput sections

Change-Id: I9ed1c2d67bc53f98d36ad17afb9153de5e944b7f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoReport: NFV Graphs 19/19419/2
Tibor Frank [Tue, 7 May 2019 15:44:49 +0000 (17:44 +0200)]
Report: NFV Graphs

Change-Id: I75055264a1b1bc250174eb72228a1f0d5d74b313
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: NFV Graphs 14/19414/1
Tibor Frank [Tue, 7 May 2019 14:25:42 +0000 (16:25 +0200)]
Report: NFV Graphs

Change-Id: I5fd192c2e010226a3e081b3c4e66265dd9654740
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: NFV Graphs 11/19411/1
Tibor Frank [Tue, 7 May 2019 12:55:19 +0000 (14:55 +0200)]
Report: NFV Graphs

Change-Id: I62a6e2f337d198cd2c4da7ba0bd1b1b9752310ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: NFV Graphs 10/19410/1
Tibor Frank [Tue, 7 May 2019 12:46:30 +0000 (14:46 +0200)]
Report: NFV Graphs

Change-Id: I8763f7977a48405787f93e34e750b47c5742c798
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: NFV Graphs 06/19406/1
Tibor Frank [Tue, 7 May 2019 11:46:40 +0000 (13:46 +0200)]
Report: NFV Graphs

Change-Id: I0f395d4bd2ec090e55f6650ea9042a77e82ead4d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Fix NFV Graphs 01/19401/1
Tibor Frank [Tue, 7 May 2019 10:24:38 +0000 (12:24 +0200)]
Report: Fix NFV Graphs

Change-Id: If11ed726cb75134c24cde3a752d2e72188bbe3a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: NFV Service Density - color bar tilte 92/19392/1
Tibor Frank [Tue, 7 May 2019 08:41:27 +0000 (10:41 +0200)]
Report: NFV Service Density - color bar tilte

Change-Id: I01014a5247994b5acb01c6d62d9178e4ddbcd025
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFix typos in DUTsetup.py 61/19361/4
Vratko Polak [Mon, 6 May 2019 10:53:56 +0000 (12:53 +0200)]
Fix typos in DUTsetup.py

Change-Id: I7fb255c26bfb62a273844b3753aa37b742835045
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 85/19385/1
Tibor Frank [Tue, 7 May 2019 06:18:45 +0000 (08:18 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I19d20c6c68b7b280c8fc7c2bba4e5ce4c660a2d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1492: Add NF density tests: Models and data 73/19373/1
Tibor Frank [Mon, 6 May 2019 12:58:39 +0000 (14:58 +0200)]
CSIT-1492: Add NF density tests: Models and data

Change-Id: I010fbf9acffc5a613e7b67810f66822ba2e46f42
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1492: Add NF density tests: Models and data 68/19368/1
Tibor Frank [Mon, 6 May 2019 12:08:55 +0000 (14:08 +0200)]
CSIT-1492: Add NF density tests: Models and data

Change-Id: Icad4c04e45224f694bc484eef6e6dd7903c2f136
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1492: Add new NF density tests to report 65/19165/51
Tibor Frank [Thu, 25 Apr 2019 10:58:43 +0000 (12:58 +0200)]
CSIT-1492: Add new NF density tests to report

Change-Id: Ifdfac80f7fd25124cb08a467329d6c8c525ffc06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1493 VPP restart handling code 41/19141/29
Peter Mikus [Wed, 24 Apr 2019 11:31:30 +0000 (11:31 +0000)]
CSIT-1493 VPP restart handling code

Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 51/19351/1
Tibor Frank [Mon, 6 May 2019 08:20:12 +0000 (10:20 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I49b1f3d9e2ac422ddae8382828756476a696a2c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure the version 46/19346/1
Tibor Frank [Mon, 6 May 2019 07:13:35 +0000 (09:13 +0200)]
Report: Configure the version

Change-Id: I29240b2286f48cc8027d97c9c1895c51b2a11ca5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoreport 1904: updated methodology (nfv density, startup.conf) and vpp perf rls notes 06/19306/3
Maciek Konstantynowicz [Thu, 2 May 2019 18:20:38 +0000 (19:20 +0100)]
report 1904: updated methodology (nfv density, startup.conf) and vpp perf rls notes

Change-Id: If6d24511d5d29dcc25c21437364e0da15af3cca1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoUpdate KVM methodology 13/19313/3
Peter Mikus [Fri, 3 May 2019 06:32:17 +0000 (06:32 +0000)]
Update KVM methodology

Change-Id: I8be9b9295b691a1ec4b810e3a1255ad1bc6947ab
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 24/19324/1
Peter Mikus [Fri, 3 May 2019 12:49:40 +0000 (12:49 +0000)]
CSIT-1488: Add data to the Report 1904

Change-Id: I7d63d16164e0cf54d74cc0b7286cde50a6e71404
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 52/19252/1
Tibor Frank [Tue, 30 Apr 2019 10:35:18 +0000 (12:35 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ibf630b85f2e7b164847628efb9969edba753eb74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate report static content 18/19218/4
Peter Mikus [Mon, 29 Apr 2019 09:34:59 +0000 (09:34 +0000)]
Update report static content

Change-Id: I8aef71fb2cc09d2c7862884f7ca68c9786ad5165
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 24/19224/1
Tibor Frank [Mon, 29 Apr 2019 11:21:10 +0000 (13:21 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Iec3270ccff9db2d8532f6f0d11640bf65d7f9ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure the version 10/19210/1
Tibor Frank [Mon, 29 Apr 2019 08:40:46 +0000 (10:40 +0200)]
Report: Configure the version

Change-Id: I064b16e0a2b7f96e4590622be340ab657d785f16
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoNF density tests with dtc=0.5 and dtcr=2 62/19062/14
Peter Mikus [Fri, 19 Apr 2019 06:40:44 +0000 (06:40 +0000)]
NF density tests with dtc=0.5 and dtcr=2

Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agofix removal of build packages for honeycomb 85/19185/1
Michal Cmarada [Fri, 26 Apr 2019 10:41:14 +0000 (12:41 +0200)]
fix removal of build packages for honeycomb

Change-Id: I19be5008067067c2e7c78e7673a9ceaaf2f52c8f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
4 years agoFIX: Change buffers per numa base on SMT 83/19183/1
Peter Mikus [Fri, 26 Apr 2019 10:29:53 +0000 (10:29 +0000)]
FIX: Change buffers per numa base on SMT

Change-Id: I4955210e2c723d4b91d8829ac42e47937d17833f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 61/19161/1
Tibor Frank [Thu, 25 Apr 2019 10:51:27 +0000 (12:51 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6f787445c0f4e91e4fbde7787c49d08d412347a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1489: Change graphs to display results by suite generator 10/19110/8
Tibor Frank [Tue, 23 Apr 2019 12:31:13 +0000 (14:31 +0200)]
CSIT-1489: Change graphs to display results by suite generator

Change-Id: I00fdc7ce87be5cecf5883ed2c991a8e67efd2e2a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Crypto tests 32/19132/5
Peter Mikus [Wed, 24 Apr 2019 05:53:02 +0000 (05:53 +0000)]
FIX: Crypto tests

- By adding crypto_ipsecmb.so into the list of loaded plugins

Change-Id: I52de9b410441422ad8e337208f40360fbdea264d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: Large number of interfaces and worker threads 43/18743/19
Peter Mikus [Mon, 8 Apr 2019 12:42:08 +0000 (12:42 +0000)]
FIX: Large number of interfaces and worker threads

Add buffers-per-numa (previously num-mbuf)

Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoMove generate_tests earlier in entry scripts 36/19136/1
Vratko Polak [Wed, 24 Apr 2019 08:51:37 +0000 (10:51 +0200)]
Move generate_tests earlier in entry scripts

The idea is to run test generation and archivation
before testbed reservation, as during generation and archivation
the testbed can be used by another job.
The two steps are moved just before (physical or docker) reservation,
as they currently take considerable time,
so simpler steps are kept before to save time if they fail.
Coincidentally, it is also just after activate_virtualenv,
Python is needed for test generation.

Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: TAP tests fix 2 15/19115/1
Jan Gelety [Sun, 14 Apr 2019 02:00:12 +0000 (04:00 +0200)]
FIX: TAP tests fix 2

Change-Id: Ie9591fe3d72f27be0b4cba21c7b0868ed5118de4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit d0293114feed3b8d4badec6bc8cc1ace91a4d3e6)

4 years agoFIX: Create TAP interface after API change 14/19114/1
Jan Gelety [Sat, 13 Apr 2019 23:57:33 +0000 (01:57 +0200)]
FIX: Create TAP interface after API change

Change-Id: Ib39671dcb808142037c2950b8b02b9aa64d72a3b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 48b40a6789050e8f40405663cc0e437df26fc56a)

4 years agoFIX: VTS pinning issue. 93/19093/5
Peter Mikus [Tue, 23 Apr 2019 08:43:12 +0000 (08:43 +0000)]
FIX: VTS pinning issue.

Change-Id: I12a79605a925c00d9c41b7115bc7cbb7f2cd49c1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 00/19100/1
Tibor Frank [Tue, 23 Apr 2019 09:57:23 +0000 (11:57 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I2ba9eeedf5668b5a99acbe0d26add2aa0a836a9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 94/19094/1
Tibor Frank [Tue, 23 Apr 2019 08:45:46 +0000 (10:45 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Idab323612b20ae06d92bd81310abdb1d44c6c9a7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1487: Configure PAL for the Report 1904 88/19088/1
Tibor Frank [Tue, 23 Apr 2019 07:01:12 +0000 (09:01 +0200)]
CSIT-1487: Configure PAL for the Report 1904

- change the week number
- add pdf generation
- change ubuntu and centos images

Change-Id: Iadea2f3dd9cfd77b508bf16ffd154bbd4f1145bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: eth_peer parameter after introducing OptionParams 46/19046/2
Peter Mikus [Thu, 18 Apr 2019 14:54:31 +0000 (14:54 +0000)]
FIX: eth_peer parameter after introducing OptionParams

Change-Id: Ief72af680a6252faf749b06b5289b8033af99b2d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoOptionString: Do not convert None to non-empty string 33/19033/2
Vratko Polak [Thu, 18 Apr 2019 12:19:24 +0000 (14:19 +0200)]
OptionString: Do not convert None to non-empty string

Change-Id: I2947394a478bde3fe048aef99fd7b5a394764ae2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Static content 35/19035/1
Tibor Frank [Thu, 18 Apr 2019 12:40:53 +0000 (14:40 +0200)]
Report: Static content

Change-Id: If8e2593dcaff368b2c7e191f70bab15e8974bb38
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1487: Configure PAL for the Report 1904 72/18972/3
Tibor Frank [Wed, 17 Apr 2019 13:54:45 +0000 (15:54 +0200)]
CSIT-1487: Configure PAL for the Report 1904

Change-Id: I4f112693a3b50665a9c53290de42d8e365c6d415
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd perpatch info to cpta methodology 37/18337/17
Vratko Polak [Tue, 16 Apr 2019 16:59:33 +0000 (18:59 +0200)]
Add perpatch info to cpta methodology

Also, split methodology file into multiple, per section.

Change-Id: I973b93d1a99205d7adb80996a3657215e05b8985
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1482: Change trending graphs 12/18812/5
Tibor Frank [Thu, 11 Apr 2019 11:44:02 +0000 (13:44 +0200)]
CSIT-1482: Change trending graphs

- Change trending graphs to display results when using suite  generator

Change-Id: I4f822c180f9c206be19a9c75ce105c2225ad9171
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCentos 7.6-1810 image update. 60/18860/4
Thomas F Herbert [Sun, 14 Apr 2019 19:12:10 +0000 (15:12 -0400)]
Centos 7.6-1810 image update.

Add python36 and update qemu to 2.12.
add boost-filesystem

Change-Id: I89bba0b807be6d6c2d98b2f07faae9c31b3370e1
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
5 years agoIncrease reliability of per patch perf job 88/18788/8
Vratko Polak [Wed, 10 Apr 2019 08:33:17 +0000 (10:33 +0200)]
Increase reliability of per patch perf job

CSIT-1485

- Measurement results are inconsistent, creating false positives.
- To avoid false positives, sensitivity has to be lowered.
+ Measurements are no more interleaved.
+ Measurement result are no longer filtered.
+ The job now runs faster.
- Ip6base regressions smaller than 4% are tolerated.
+ Ip6base false positives can happen, but less than 10% of the time.
- Part of job parameters is set on ci-management level.
+ Voter script output is improved.

Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1483: Add processing of output_info.xml as the first choice 83/18883/24
Tibor Frank [Mon, 15 Apr 2019 12:17:05 +0000 (14:17 +0200)]
CSIT-1483: Add processing of output_info.xml as the first choice

Change-Id: I27687ed6dda3a8717538653e75ad0d61c6516c7e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoClean up traffic_profile vs osi_layer 37/18937/2
Vratko Polak [Tue, 16 Apr 2019 14:32:59 +0000 (16:32 +0200)]
Clean up traffic_profile vs osi_layer

The two types were not well distinguished before.

Error introduced in:
https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255

Error hotfixed in:
https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109

+ Rename some arguments and improve method docstrings.

Newly introduced argument name osi_layer should be dissimilar enough.

Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoIntroduce OptionString for handling command line 44/18844/21
Vratko Polak [Mon, 15 Apr 2019 14:31:54 +0000 (16:31 +0200)]
Introduce OptionString for handling command line

+ Convert DpdkUtil to use it.
++ Rename args to kwargs where needed.
++ Fix errors in docstrings.
+ Also convert and QemuUtils to use it.
++ Minor formatting edits to save space.
+ Add disconnect parameter to some ssh.py functions.
++ ssh.SSH.disconnect() tries to work without argument.
+ Exec functions in ssh.py accept OptionString commands.

Change-Id: I82da71c568d120c283544c90242993fc76e9e83a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoRemove unused parameter in HoneycombSetup 29/18929/2
Michal Cmarada [Tue, 16 Apr 2019 13:20:03 +0000 (15:20 +0200)]
Remove unused parameter in HoneycombSetup

Change-Id: Ief75fcdc2c3ab77b708d1c7e7aecf312ea852898
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoAdd 2n AVF tests 47/18847/5
Peter Mikus [Fri, 12 Apr 2019 17:53:29 +0000 (17:53 +0000)]
Add 2n AVF tests

- Side effect of other troubleshooting, but better to
merge then throw away.

Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUse package location for apt-cache show command 15/18915/1
Jan Gelety [Sat, 13 Apr 2019 01:23:04 +0000 (03:23 +0200)]
Use package location for apt-cache show command

Change-Id: I141baa77c78ec467a56fcafb86061efe198dca9d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 66/18866/2
Jan Gelety [Fri, 12 Apr 2019 15:12:31 +0000 (17:12 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~14-g4e08316~b6856

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~14-g4e08316f3

- use new vpp ref build - centos7:
  19.08-rc0~14_g4e08316~b6690

Change-Id: Id377e18b0d6bfaa55762b7088c284866f5749a5d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoRemove obsolete QEMU installation 57/18857/3
Peter Mikus [Sat, 13 Apr 2019 06:15:25 +0000 (06:15 +0000)]
Remove obsolete QEMU installation

+Unify QEMU parameter to Contants.

Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd output.xml with only INFO logging leve 08/18808/5
Peter Mikus [Thu, 11 Apr 2019 08:36:06 +0000 (08:36 +0000)]
Add output.xml with only INFO logging leve

- Useful for post-processing.

Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855
Signed-off-by: Peter Mikus <pmikus@cisco.com>