csit.git
16 months agoCSIT-1488: Add data to the Report 1904 80/20080/1
Tibor Frank [Wed, 12 Jun 2019 06:05:23 +0000 (08:05 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agovpp_device: TAP 46/20046/8
Peter Mikus [Sun, 9 Jun 2019 06:44:04 +0000 (06:44 +0000)]
vpp_device: TAP

Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agovpp_device: IPsec 30/20030/7
Peter Mikus [Fri, 7 Jun 2019 13:44:52 +0000 (13:44 +0000)]
vpp_device: IPsec

- Remove VM ipsec tests as they are not interesting
- Remove duplicate (vpp_device/virl) VM tests
- Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM)

Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 55/20055/1
Tibor Frank [Mon, 10 Jun 2019 10:14:46 +0000 (12:14 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoReport: Configure report 1904.24 53/20053/1
Tibor Frank [Mon, 10 Jun 2019 10:08:21 +0000 (12:08 +0200)]
Report: Configure report 1904.24

Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoPython3: TRex driver 01/20001/3
Peter Mikus [Thu, 6 Jun 2019 12:19:59 +0000 (12:19 +0000)]
Python3: TRex driver

Change-Id: I25f7598b52c87ec1a2d4c6f22680d5200b583e2c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoFIX: Disable AVF on 3n-hsw 44/20044/2
Peter Mikus [Sun, 9 Jun 2019 05:59:57 +0000 (05:59 +0000)]
FIX: Disable AVF on 3n-hsw

Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoCSIT-1521 Convert NestedVM testcase into KernelVM 00/20000/7
Peter Mikus [Thu, 6 Jun 2019 12:16:12 +0000 (12:16 +0000)]
CSIT-1521 Convert NestedVM testcase into KernelVM

Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoSimplify mrr daily tag expression 83/19983/10
Vratko Polak [Thu, 6 Jun 2019 10:33:20 +0000 (12:33 +0200)]
Simplify mrr daily tag expression

The number of tests executed is intentionally smaller,
as recently the runtime has gone up too much.

New numbers:
csit-vpp-perf-mrr-daily-master: 120
csit-vpp-perf-mrr-daily-master-2n-skx: 72
csit-vpp-perf-mrr-daily-master-3n-skx: 126

More details included as diff files.

+ Less per-testbed exceptions.
- Single/double links tags still set at two places.

Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 70/19970/1
Tibor Frank [Wed, 5 Jun 2019 11:36:38 +0000 (13:36 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoFIX: OS detection 69/19969/3
Peter Mikus [Wed, 5 Jun 2019 08:59:37 +0000 (08:59 +0000)]
FIX: OS detection

Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoCSIT changes to support new Centos 7 device testing container image. 97/19697/7
Thomas F Herbert [Sat, 18 May 2019 19:12:52 +0000 (15:12 -0400)]
CSIT changes to support new Centos 7 device testing container image.

CSIT-1505

Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.

Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos

Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
16 months agoRemove intrusive useless logging 65/19965/1
Peter Mikus [Wed, 5 Jun 2019 06:52:37 +0000 (06:52 +0000)]
Remove intrusive useless logging

Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoEven more Crypto combinations 25/19825/14
Peter Mikus [Fri, 24 May 2019 18:16:41 +0000 (18:16 +0000)]
Even more Crypto combinations

Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 52/19952/1
Tibor Frank [Tue, 4 Jun 2019 13:22:17 +0000 (15:22 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I8609ecd45a634fccf3e721beac5a0ec640f704db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoVAT-to-PAPI: memif 39/19639/22
Tibor Frank [Thu, 16 May 2019 11:47:50 +0000 (13:47 +0200)]
VAT-to-PAPI: memif

Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agofix Honeycomb failing tests 36/19936/4
Michal Cmarada [Tue, 4 Jun 2019 09:53:38 +0000 (11:53 +0200)]
fix Honeycomb failing tests

 - due to VAT to PAPI migration some tests
   need to be updated
 - fixed HC tests: ACL, Interfaces/SubInterfaces, Tap
   Vhost, Vxlan, Vxlan-gpe

Change-Id: I9adad041a619b48057bdda388becd53dde484483
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
16 months agoVAT-to-PAPI: ContainerUtils 18/19918/7
Tibor Frank [Mon, 3 Jun 2019 07:23:15 +0000 (09:23 +0200)]
VAT-to-PAPI: ContainerUtils

Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoVAT-to-PAPI: VhostUser 99/19899/6
Tibor Frank [Thu, 30 May 2019 13:18:31 +0000 (15:18 +0200)]
VAT-to-PAPI: VhostUser

Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoAdd possibility to use other then default NIC per VPP patch 00/19900/2
Jan Gelety [Thu, 30 May 2019 13:02:09 +0000 (15:02 +0200)]
Add possibility to use other then default NIC per VPP patch

Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
16 months agoUpdate of VPP_STABLE_VER files 19/19919/2
Jan Gelety [Sat, 1 Jun 2019 12:21:27 +0000 (14:21 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~341-gb19bf8d~b7191

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~341-gb19bf8de1

- use new vpp ref build - centos7:
  19.08-rc0~341_gb19bf8d~b7065

Change-Id: I62b61b8d91dce90dfd241d8325b0049c1c02b6a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 22/19922/1
Tibor Frank [Mon, 3 Jun 2019 10:25:20 +0000 (12:25 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I514dbd61dc22736fb3925d6d3cec767d0f4f84a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoReport: Configure Report 1904.23 20/19920/2
Tibor Frank [Mon, 3 Jun 2019 10:16:35 +0000 (12:16 +0200)]
Report: Configure Report 1904.23

Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoAdd meltdown spectre to calibration set 09/19909/3
Peter Mikus [Fri, 31 May 2019 09:25:50 +0000 (09:25 +0000)]
Add meltdown spectre to calibration set

+ Fix the version of MMD tool to always latest

Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoCSIT-1468: InterfaceUtil migration from VAT to PAPI 60/18360/67
Jan Gelety [Mon, 18 Mar 2019 12:30:11 +0000 (13:30 +0100)]
CSIT-1468: InterfaceUtil migration from VAT to PAPI

Change-Id: I0062710d58996be767a852dc00545fedd60a5c72
Signed-off-by: Jan Gelety <jgelety@cisco.com>
17 months agoFix args order in setup_node call 68/19868/1
juraj.linkes [Wed, 29 May 2019 09:02:42 +0000 (11:02 +0200)]
Fix args order in setup_node call

Change-Id: I484cda8c8410e2f38d68da82761b1154dda26b1c
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
17 months agoUse threads for fw setup and cleanup 10/19810/6
juraj.linkes [Fri, 24 May 2019 08:58:52 +0000 (10:58 +0200)]
Use threads for fw setup and cleanup

Using multiprocessing sometimes causes scp to hang when copying files.
Threading is also more lightweight.

Change-Id: I047b4835bbf1584c80469b27af5394d89087e8a9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
17 months agoFIX: Trex 2.54 resolve issue. 50/19850/2
Peter Mikus [Tue, 28 May 2019 06:51:12 +0000 (06:51 +0000)]
FIX: Trex 2.54 resolve issue.

Change-Id: I8ffb360411fe5a0304ba7568828588dc7cfad267
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoCSIT-1488: Add data to the Report 1904 52/19852/1
Tibor Frank [Tue, 28 May 2019 07:15:34 +0000 (09:15 +0200)]
CSIT-1488: Add data to the Report 1904

- remove 'NIC_Cisco-VIC-1385' and '9000B' from vpp perf full

Change-Id: Ic3d6a035945eddf6a5f5c73a62ca872a59c18b46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoHC2VPP-411: migrate interfaces-state to interfaces 38/19838/4
Michal Cmarada [Mon, 27 May 2019 11:58:23 +0000 (13:58 +0200)]
HC2VPP-411: migrate interfaces-state to interfaces

 - new ietf-interfaces makes interfaces-state obsolete
 - updates honeycomb tests to latest ietf-interfaces model

Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
17 months agoFIX: do not generate 9000B perf test in case of vic1385 nic 34/19834/2
Jan Gelety [Thu, 23 May 2019 07:45:01 +0000 (09:45 +0200)]
FIX: do not generate 9000B perf test in case of vic1385 nic

Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
17 months agoCSIT-1488: Add data to the Report 1904 36/19836/1
Tibor Frank [Mon, 27 May 2019 08:56:53 +0000 (10:56 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: If23ed1d2a8b716a2c145a8b13ebc91c9925284d8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1425 Upgrade TRex to v2.54 18/17418/21
Tibor Frank [Tue, 5 Feb 2019 09:20:41 +0000 (10:20 +0100)]
CSIT-1425 Upgrade TRex to v2.54

Change-Id: I71010c18210e88828ded0bc679997d76f34886cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoReport: Configure Report 1904.22 06/19806/1
Tibor Frank [Fri, 24 May 2019 07:33:58 +0000 (09:33 +0200)]
Report: Configure Report 1904.22

Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1488: Add data to the Report 1904 04/19804/1
Tibor Frank [Fri, 24 May 2019 07:29:59 +0000 (09:29 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I23224cba405ad905b65799682f59de126d88bc2b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoFIX: IPsec typo 71/19771/1
Peter Mikus [Thu, 23 May 2019 07:23:22 +0000 (07:23 +0000)]
FIX: IPsec typo

Change-Id: Ic565a5caea57b05e6905698f68fcf2146ae14d72
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoPAL: Add IPSEC to mapping table 83/19683/4
Tibor Frank [Fri, 17 May 2019 13:08:13 +0000 (15:08 +0200)]
PAL: Add IPSEC to mapping table

- waiting for https://gerrit.fd.io/r/19677
- waiting for https://gerrit.fd.io/r/19710

Change-Id: I1c4a09ded8402d9ce60e021414ce7f46781526b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1507: Rework IPsec base testcases 10/19710/2
Peter Mikus [Mon, 20 May 2019 09:56:19 +0000 (09:56 +0000)]
CSIT-1507: Rework IPsec base testcases

Change-Id: Ifb65ad8da9c5b1ef10a65a5174b698f86d2dc9d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoCSIT-1506: Rework IPsec base testcases 77/19677/7
Peter Mikus [Fri, 17 May 2019 12:17:06 +0000 (12:17 +0000)]
CSIT-1506: Rework IPsec base testcases

- Add:
    aes-128-gcm        aes-128-gcm
    aes-256-gcm        aes-256-gcm
    aes-128-cbc        hmac-sha-256
    aes-256-cbc        hmac-sha-512

- Remove:
    hmac-sha1

- Scale will follow in next patch

Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoRe-enable T22 into pool 51/19751/2
Peter Mikus [Wed, 22 May 2019 09:35:56 +0000 (09:35 +0000)]
Re-enable T22 into pool

- Server reinstalled via cobbler

Change-Id: Ic0d45f0b874059af2568d6483517107924a7c66a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoReport: Update report history 55/19755/1
Tibor Frank [Wed, 22 May 2019 10:41:05 +0000 (12:41 +0200)]
Report: Update report history

Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: Fix missing func and vpp_device data 53/19753/1
Tibor Frank [Wed, 22 May 2019 10:35:42 +0000 (12:35 +0200)]
Report: Fix missing func and vpp_device data

Change-Id: Id21e52262904baa9a940e5680a413a1f5ae06b8b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoAnsible: Add CIMC/IPMI/COBBLER 01/17801/19
Peter Mikus [Sat, 23 Feb 2019 16:27:07 +0000 (16:27 +0000)]
Ansible: Add CIMC/IPMI/COBBLER

- added tasks and handlers for CIMC, IPMI, COBBLER
- allows provisioning of servers via COBBLER

Change-Id: I64080069260dabb8a6e3b648aeff12f109d3f7c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoCSIT-1488: Add data to the Report 1904 48/19748/2
Tibor Frank [Wed, 22 May 2019 07:59:18 +0000 (09:59 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I3af37de91450a4ac11eb6e6e8cd271de41e985bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoExclude IPSECHW tests on NICs other than xl710 32/19732/2
Vratko Polak [Tue, 21 May 2019 08:34:30 +0000 (10:34 +0200)]
Exclude IPSECHW tests on NICs other than xl710

The next version of suite generator will avoid generating them,
for now we just exclude by a tag expression.

Change-Id: I68c80c412ea327c11366f539b10de19df50152c2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoUpdate Centos VIRL image to version 2.5 42/19742/1
Thomas F Herbert [Sun, 19 May 2019 21:17:51 +0000 (17:17 -0400)]
Update Centos VIRL image to version 2.5

Update CentOS release.
Add python34.

Change-Id: Ie0a11810c5b120cfd170dc4eaf3e72bbd3155d4a
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
17 months agoCSIT-1488: Add data to the Report 1904 38/19738/1
Tibor Frank [Tue, 21 May 2019 14:45:37 +0000 (16:45 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6c6f478a0dc54a10e4b7568dc86aa883e896e28a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoFIX2: VTS cpu list 14/19714/2
Jan Gelety [Mon, 20 May 2019 12:04:16 +0000 (14:04 +0200)]
FIX2: VTS cpu list

Change-Id: Ibd0f719585d6482a65ae6cea516a4da017281ef5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
17 months agoReport: Remove (IPSECHW and x520) tests from report 15/19715/2
Tibor Frank [Mon, 20 May 2019 12:20:42 +0000 (14:20 +0200)]
Report: Remove (IPSECHW and x520) tests from report

Change-Id: I1481cd889aab7cc1f8d6b7c3a3cd5e96e955bb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoFIX: VTS cpu list 11/19711/2
Jan Gelety [Mon, 20 May 2019 10:55:59 +0000 (12:55 +0200)]
FIX: VTS cpu list

Change-Id: Ic3ac22642e443f30a46914c18cd9a9b54064286b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
17 months agoCSIT-1488: Add data to the Report 1904 06/19706/1
Tibor Frank [Mon, 20 May 2019 08:31:19 +0000 (10:31 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I632ed9e00feb26b734f86bfe75dca9e14ac57f0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: Fix internal links to PLRsearch methodology 80/19680/1
Vratko Polak [Fri, 17 May 2019 12:54:20 +0000 (14:54 +0200)]
Report: Fix internal links to PLRsearch methodology

Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoReport: table_soak_vs_ndr 74/19674/2
Tibor Frank [Fri, 17 May 2019 10:42:19 +0000 (12:42 +0200)]
Report: table_soak_vs_ndr

Change-Id: Ia313fb43c315990212501b4139f3f1f7bc9d67f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReduce the number of tests loops in virl timed jobs 71/19671/2
Jan Gelety [Thu, 16 May 2019 15:01:21 +0000 (17:01 +0200)]
Reduce the number of tests loops in virl timed jobs

- with current number of test loops jobs fail with timeout

Change-Id: Id08cd1a9221eda116e018a44bece68a494286169
Signed-off-by: Jan Gelety <jgelety@cisco.com>
17 months agoTrending: Reduce input data 66/19666/1
Tibor Frank [Fri, 17 May 2019 08:22:45 +0000 (10:22 +0200)]
Trending: Reduce input data

Change-Id: Ib540a687a0b8b27584f6d8c571cfd453122f0f91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1488: Add data to the Report 1904 63/19663/3
Tibor Frank [Fri, 17 May 2019 07:28:20 +0000 (09:28 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ic693d6750007727b6e773e17f8f2fba2f96c2c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport soak comparison: Add stdev for delta 19/19619/3
Vratko Polak [Wed, 15 May 2019 15:58:24 +0000 (17:58 +0200)]
Report soak comparison: Add stdev for delta

Change-Id: Ibbff3c123afac2e68caf33f3ccd5fc4909509917
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoTests: Add IPSEC SW scale tests 31/19631/2
Tibor Frank [Thu, 16 May 2019 08:55:00 +0000 (10:55 +0200)]
Tests: Add IPSEC SW scale tests

Change-Id: I4339059a0cf67acce668abe42aab59bbb17916d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoAvoid !r format appending u on unicode 58/19558/4
Vratko Polak [Tue, 14 May 2019 08:51:15 +0000 (10:51 +0200)]
Avoid !r format appending u on unicode

Change-Id: I2c0877f4d8b6cad2694c43a4350998cd2b830680
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoFIX: IPsec selection backend. 37/19637/2
Peter Mikus [Thu, 16 May 2019 11:17:34 +0000 (11:17 +0000)]
FIX: IPsec selection backend.

Change-Id: Ie4acaecf60e03fc4e843e29d8222fbf2f00bbf44
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoMake topology files read dynamically from directory 94/19594/6
Peter Mikus [Tue, 14 May 2019 14:39:56 +0000 (14:39 +0000)]
Make topology files read dynamically from directory

Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoImprove soak graphs and content 29/19629/1
Vratko Polak [Thu, 16 May 2019 08:43:31 +0000 (10:43 +0200)]
Improve soak graphs and content

+ Fix duration, mention number of tests and runs.
- Hover information still feels wrong.
+ Mention "critical rate" instead of "throughput" where possible.
+ Mention lower bounds are displayed.
+ Rename "plrsearch_algorithm" label to "PLRsearch".
  + Because the previous link did not work. Due to underscore?
+ Rename "SOAK" to "soak" or "Soak" (except when it is a tag).

Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoCSIT-1488: Add data to the Report 1904 27/19627/1
Tibor Frank [Thu, 16 May 2019 08:27:03 +0000 (10:27 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: Configure 1904.21 25/19625/1
Tibor Frank [Thu, 16 May 2019 06:42:59 +0000 (08:42 +0200)]
Report: Configure 1904.21

Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoAvoid double link tests for nic_intel-xxv710 17/19617/1
Vratko Polak [Wed, 15 May 2019 14:39:53 +0000 (16:39 +0200)]
Avoid double link tests for nic_intel-xxv710

Change-Id: Id9beeed270b91a35108adef594f50105198225d6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoUpdate of VPP_STABLE_VER files + quick fix for gre create tunnel 64/19564/3
Jan Gelety [Sat, 11 May 2019 04:52:56 +0000 (06:52 +0200)]
Update of VPP_STABLE_VER files + quick fix for gre create tunnel

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~212-gf6c7aec~b7060

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~212-gf6c7aec95

- use new vpp ref build - centos7:
  19.08-rc0~212_gf6c7aec~b6916

Change-Id: Ifd042fae1a46b07a5f463309f2b9cceb8054412f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
17 months agoReport: Add pdf version 13/19613/2
Tibor Frank [Wed, 15 May 2019 11:54:58 +0000 (13:54 +0200)]
Report: Add pdf version

Change-Id: Idc6936262a968e213f2fafa52adacfee65ad345c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoPLRsearch methodology: Add graphs with descriptions. 09/19609/2
Vratko Polak [Wed, 15 May 2019 11:37:43 +0000 (13:37 +0200)]
PLRsearch methodology: Add graphs with descriptions.

Change-Id: I1acb74c6edb966dcdbbdaf88c05bfde1192bf74b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoCSIT-1504: Soak tests - graph 10/19610/1
Tibor Frank [Wed, 15 May 2019 11:37:39 +0000 (13:37 +0200)]
CSIT-1504: Soak tests - graph

Change-Id: I1e39a995565cbda2184378268e2da2b465b147cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: update known perf issues 67/19567/3
Jan Gelety [Sat, 11 May 2019 05:54:10 +0000 (07:54 +0200)]
Report: update known perf issues

Change-Id: I83863b6a32a1f4d079e126458ba50a358e8de447
Signed-off-by: Jan Gelety <jgelety@cisco.com>
17 months agoFIX: Honeycomb restart sequence 05/19605/2
Peter Mikus [Wed, 15 May 2019 10:00:25 +0000 (10:00 +0000)]
FIX: Honeycomb restart sequence

Change-Id: I31acda10c4bd8de6f0094e697ef1219e77c5fbb1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoCSIT-1504: Soak tests - graph 01/19601/2
Tibor Frank [Wed, 15 May 2019 09:15:14 +0000 (11:15 +0200)]
CSIT-1504: Soak tests - graph

Change-Id: If31eb363680a3cd81c38f078c9ad28a569d321da
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoFix teardown keyword for wrk test 95/19595/3
Vratko Polak [Wed, 15 May 2019 08:21:12 +0000 (10:21 +0200)]
Fix teardown keyword for wrk test

Change-Id: Ib0a86cdb250f4eb7a5a08d205c0b17c7bf9fd851
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoCSIT-1504: Soak tests - box plots 98/19598/1
Tibor Frank [Wed, 15 May 2019 08:49:15 +0000 (10:49 +0200)]
CSIT-1504: Soak tests - box plots

Change-Id: I29a25dad1fee07c0a387dc985718eae858abb2f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1504: Soak tests - box plots 91/19591/1
Tibor Frank [Wed, 15 May 2019 07:56:26 +0000 (09:56 +0200)]
CSIT-1504: Soak tests - box plots

Change-Id: Id066787f4445b675ef0691a405d0f403b45d6fc2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: clean-up ipsec tests 89/19589/1
Tibor Frank [Wed, 15 May 2019 07:52:59 +0000 (09:52 +0200)]
Report: clean-up ipsec tests

Change-Id: I3fd52fdeccc73332a85f695442cbe86fcf94b489
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoTrending: Add IPSECSW 85/19585/1
Tibor Frank [Wed, 15 May 2019 07:09:07 +0000 (09:09 +0200)]
Trending: Add IPSECSW

Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1504: Soak tests - box plots 83/19583/1
Tibor Frank [Wed, 15 May 2019 06:53:42 +0000 (08:53 +0200)]
CSIT-1504: Soak tests - box plots

- table: stdev, round deltas to 2 dec places

Change-Id: I29cd1f7c9ba8ef73a8281d42ac9f6a06ed30bbdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoFIX: Remove old restart sequence - Honeycomb 53/19553/6
Peter Mikus [Tue, 14 May 2019 07:27:33 +0000 (07:27 +0000)]
FIX: Remove old restart sequence - Honeycomb

Change-Id: I12865ea4f48c1902e80e67463fff4cf481a2e24c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoCSIT-1504: Soak tests - graph 59/19559/1
Tibor Frank [Tue, 14 May 2019 08:59:45 +0000 (10:59 +0200)]
CSIT-1504: Soak tests - graph

Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: Remove CFS_OPT from 2n/3n-skx ndrpdr full 56/19556/1
Tibor Frank [Tue, 14 May 2019 08:14:42 +0000 (10:14 +0200)]
Report: Remove CFS_OPT from 2n/3n-skx ndrpdr full

Change-Id: If82e9c19e9d2035e62c7e455458ebdef20659adb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 54/19554/1
Tibor Frank [Tue, 14 May 2019 08:04:41 +0000 (10:04 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

- clean-up

Change-Id: I020837a89415fdb891ffbb094c9a5edf50946dd2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoFIX: Remove old VPP Restart sequence 52/19552/1
Peter Mikus [Tue, 14 May 2019 07:02:14 +0000 (07:02 +0000)]
FIX: Remove old VPP Restart sequence

- Honeycomb __init__

Change-Id: I0a230ac5692e7701b485698e9406461d7a251bf9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoRemove CFSRR1 VM tests 44/19544/2
Peter Mikus [Mon, 13 May 2019 14:52:18 +0000 (14:52 +0000)]
Remove CFSRR1 VM tests

- Per agreed

Change-Id: Ie955ebfe19bff8c4a8671a0f62eea5be4407caa5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 42/19542/1
Tibor Frank [Mon, 13 May 2019 14:38:23 +0000 (16:38 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

- fix text case name

Change-Id: I01c228a920729b2e2ab3e4fb4669d68469b1c58f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoFIX: Latency stream not using VM transformation 33/19533/3
Peter Mikus [Mon, 13 May 2019 11:35:32 +0000 (11:35 +0000)]
FIX: Latency stream not using VM transformation

Change-Id: Ibda7467dac7775427a8edafc6fa76f936d15d272
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 39/19539/1
Tibor Frank [Mon, 13 May 2019 12:43:20 +0000 (14:43 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

 - fix model

Change-Id: Ifae4b4039c905c990dda578a620b9ffc232e5786
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 34/19534/2
Tibor Frank [Mon, 13 May 2019 11:56:39 +0000 (13:56 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: Add SOAK Tests 30/19530/1
Tibor Frank [Mon, 13 May 2019 08:56:18 +0000 (10:56 +0200)]
Report: Add SOAK Tests

Change-Id: I22eec7cf8ff25958218d4b8ac6bab5a34b2f206c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoCSIT-1488: Add data to the Report 1904 28/19528/1
Tibor Frank [Mon, 13 May 2019 08:39:21 +0000 (10:39 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6e35ba3a89e02fa1e34e5ef637598cb6e22baaaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: Configuration for 1904.20 26/19526/1
Tibor Frank [Mon, 13 May 2019 08:00:32 +0000 (10:00 +0200)]
Report: Configuration for 1904.20

Change-Id: I4bbf1ed196947cc290de943b1e39721021d9d7d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoReport: Add pdf version 16/19516/1
Tibor Frank [Fri, 10 May 2019 14:28:50 +0000 (16:28 +0200)]
Report: Add pdf version

Change-Id: I6d4770b163844bb5b30d62b2becac13714702b06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoPLRsearch: Use stat trackers to shorten Integrator 67/16667/64
Vratko Polak [Wed, 2 Jan 2019 13:18:50 +0000 (14:18 +0100)]
PLRsearch: Use stat trackers to shorten Integrator

+ Extract several tracker classes and use them in Integrator.
+ Apply next_rate workarounds to focus more on critical region.
+ Rewrite stretch function, as the previous implementation was wrong.
+ Rework logging:
++ Use injected trace() function in Integrator.
++ Inject function that skips trace logging on default initialization.
++ Use the same multiprocessing-safe passing, but separate queue.
+ Set duration to 120m in Robot, but keep at 30m in Python.
+ Apply minor changes to make computations more reproducible:
++ Attempt to log everything needed by reproducibility in one line.
++ Log samples used, and make it settable as upper limit.
++ Use repr output in TRex scripts, to avoid rounding when copypasting.
+- Numpy seems to be sharing PRNG between processes.
+-- An edit to disable one thread is needed for full reproducibility.
+-- Such an edit is prepared, but will not be merged anytime soon.

Change-Id: Icf56429b34ab6de2d18a12e6c676e2d242b3ba4c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
17 months agoReport: Add message if no oper data is present 13/19513/2
Tibor Frank [Fri, 10 May 2019 14:25:12 +0000 (16:25 +0200)]
Report: Add message if no oper data is present

Change-Id: Ic70f603a652ae1297aba29187d1f61f30678be41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoUpdate perf release notes 1904 10/19510/3
Peter Mikus [Fri, 10 May 2019 14:13:41 +0000 (14:13 +0000)]
Update perf release notes 1904

Change-Id: Ia74d6270ef0b654efb77a369f240e7a9c53156c5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoReport: Hide DMM 09/19509/2
Tibor Frank [Fri, 10 May 2019 14:13:43 +0000 (16:13 +0200)]
Report: Hide DMM

Change-Id: Ib1381365b01cecb701a956a22131d2b4fe1a3b60
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoreport: added missing sub-section header in methodology throughput 07/19507/1
Maciek Konstantynowicz [Fri, 10 May 2019 14:07:00 +0000 (15:07 +0100)]
report: added missing sub-section header in  methodology throughput

Change-Id: Iadeaca5d39be051ef334f98e50a6a17210c503bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
17 months agoFIX: Missing show run data in NDRPDR 99/19499/2
Peter Mikus [Fri, 10 May 2019 11:59:18 +0000 (11:59 +0000)]
FIX: Missing show run data in NDRPDR

Change-Id: If4b013ef4bf4bc8f857913f3847ab3b2e2aa5a5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
17 months agoReport: NFV density - diff as integer 02/19502/1
Tibor Frank [Fri, 10 May 2019 12:31:53 +0000 (14:31 +0200)]
Report: NFV density - diff as integer

Change-Id: Iab093484375418765812707935193b35d8b07d3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 months agoUpdate PLRsearch methodology to latest code 83/17783/28
Vratko Polak [Fri, 10 May 2019 11:33:22 +0000 (13:33 +0200)]
Update PLRsearch methodology to latest code

Deleted much of terms and generalized descriptions,
added more details on the current implementation.

- Still with old graphs

Change-Id: I9ba6b40d1d9d36d4f10382f60c756f5bc4708e4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.