csit.git
4 years agoUpdate comments in crc file. 00/24300/3
Vratko Polak [Mon, 13 Jan 2020 13:55:27 +0000 (14:55 +0100)]
Update comments in crc file.

+ L2patch is already covered.
+ RDMA is not device testable yet.

Change-Id: I1dcccfcb340a8fe61c20d3516340e26db293cfaa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add VNF Service Chains Tunnels 08/24308/2
Tibor Frank [Mon, 13 Jan 2020 14:20:12 +0000 (15:20 +0100)]
Report: Add VNF Service Chains Tunnels

Change-Id: Iafdcb543f6adc583567a05aa5a882dce17b58f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: NF_density tests 02/24302/2
Peter Mikus [Mon, 13 Jan 2020 13:22:31 +0000 (13:22 +0000)]
FIX: NF_density tests

+ Because arp->neigbor was so important to do.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I552e175b7555ebf5053d7994c0c9173c0c96fc58

4 years agoReport: Move VTS tests from 3n to 2n 95/24295/2
Tibor Frank [Mon, 13 Jan 2020 10:23:27 +0000 (11:23 +0100)]
Report: Move VTS tests from 3n to 2n

Change-Id: Ie2faa6cb611d372c4a20584f7b40f3281660f2b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1597 API cleanup: rdma 80/24280/3
Jan Gelety [Thu, 9 Jan 2020 16:22:06 +0000 (17:22 +0100)]
CSIT-1597 API cleanup: rdma

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24225
- update vpp stable to version 20.01-rc0~1011

Change-Id: Ibbfdbe867cf89715619efc5c5507859983025ece
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Add comparison tables 82/24282/1
Tibor Frank [Fri, 10 Jan 2020 12:22:00 +0000 (13:22 +0100)]
Report: Add comparison tables

CSIT-1654

Change-Id: I280195b295d4fc717cb355e78c5f1731bb1eabe5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add 2n-clx 67/24267/4
Tibor Frank [Thu, 9 Jan 2020 14:02:10 +0000 (15:02 +0100)]
Report: Add 2n-clx

Change-Id: I34dc11c28d21f0b9fed87d76942fe8b8cdd86c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Container test 68/24268/2
Peter Mikus [Thu, 9 Jan 2020 13:45:06 +0000 (13:45 +0000)]
FIX: Container test

+ We should check if container is UP
+ We should adjust privileges.

Change-Id: I3f604b7b9740943b4fd3b0574c18d2729e88b816
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: Configure Report 2001 61/24261/3
Tibor Frank [Thu, 9 Jan 2020 09:11:55 +0000 (10:11 +0100)]
Report: Configure Report 2001

Change-Id: I5ef3c37cf329b76a1a7f94d60c3563872eef3c5d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoDMM: Remove 20/23420/11
Tibor Frank [Thu, 14 Nov 2019 08:28:14 +0000 (09:28 +0100)]
DMM: Remove

Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAPI: Add collection for 24225/3 46/24246/1
Jan Gelety [Wed, 8 Jan 2020 02:11:12 +0000 (03:11 +0100)]
API: Add collection for 24225/3

Change-Id: I5c4593d05dbcb4d918611dc7520432a446dbf664
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPAL: Set y-axis for HDRHistogram 36/24236/5
Tibor Frank [Wed, 8 Jan 2020 09:41:50 +0000 (10:41 +0100)]
PAL: Set y-axis for HDRHistogram

Change-Id: Ibdee625d6d9215b18771a6348735dc6a07e9ae58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrack real(er) duration of traffic 56/24156/3
Vratko Polak [Wed, 8 Jan 2020 14:08:14 +0000 (15:08 +0100)]
Track real(er) duration of traffic

+ Print duration.
- Missing: Parse duration.
  - We do not have good formula to compensate, yet.

Change-Id: I1c76ac35ce531b1994480d6aa0638f16992231f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoT-Rex: Upgrade to 2.73 with DDP profile fix 00/23900/7
Peter Mikus [Tue, 10 Dec 2019 09:04:59 +0000 (09:04 +0000)]
T-Rex: Upgrade to 2.73 with DDP profile fix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Icaa99e0a71a19ba23697c21a4b5aa046813a718a

4 years agoVhost: Add GSO option 53/24153/8
Peter Mikus [Thu, 2 Jan 2020 13:25:01 +0000 (13:25 +0000)]
Vhost: Add GSO option

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba9af71c293645b480203af72fcf940cbe9ccb3a

4 years agoFix Trex start configuration 81/24181/11
Vratko Polak [Tue, 7 Jan 2020 09:23:23 +0000 (10:23 +0100)]
Fix Trex start configuration

Since https://gerrit.fd.io/r/c/csit/+/24056
csit-vpp perf tests are failing.

Turns out the reason is too large limit_memory value,
but other improvements applied during investigation
are included as well.

+ Cat trex.log if trex fails to start.
+ Improve trex startup command formatting (remove double spaces).
+ Reorder imports.

Change-Id: I2c1106ea6f88a1a275682e73eba212d08c7947c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoRemove leftovers related to Xenial 17/24217/2
Vratko Polak [Tue, 7 Jan 2020 11:44:19 +0000 (12:44 +0100)]
Remove leftovers related to Xenial

+ File VPP_STABLE_VER_UBUNTU.
+ Subtree docs/report/vpp_functional_tests/.

Change-Id: Ifd9dd922152199de9f1352da709b1533d6c15aba
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoRemove VIRL Func tests from Report 19/24219/1
Tibor Frank [Tue, 7 Jan 2020 13:27:39 +0000 (14:27 +0100)]
Remove VIRL Func tests from Report

Change-Id: Ic6edf1f6f6c12d8e76da76617dbf1c4e8e1e2952
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 12/24212/2
Jan Gelety [Tue, 7 Jan 2020 08:59:10 +0000 (09:59 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~983-g78565f38e

 - use new vpp ref build - centos7:
   20.01-rc0~983_g78565f3~b8651

  + remove EXPECTED_FAILING tag from tc01-64B-ethip4-l2patch-dev test

Change-Id: Iab47a66003926024f87e028b1b1d9136b8fb4ec4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoTrending: Move VTS tests from 3n to 2n 13/24213/1
Tibor Frank [Tue, 7 Jan 2020 09:43:08 +0000 (10:43 +0100)]
Trending: Move VTS tests from 3n to 2n

Change-Id: I420cef699d42973602f1290ccd0cc5e378d42492
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd new NIC limits 52/24152/2
Peter Mikus [Thu, 2 Jan 2020 09:58:34 +0000 (09:58 +0000)]
Add new NIC limits

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1a0d1455ae74a2ad4fdb553286aef5942f2a99

4 years agoRevert "L2Patch: Remove EXPECTED_FAILING" 55/24155/1
Peter Mikus [Thu, 2 Jan 2020 14:31:18 +0000 (14:31 +0000)]
Revert "L2Patch: Remove EXPECTED_FAILING"

This reverts commit 09c5a6b8e1c6efed8826ef34aa64809226e80edb.

Reason for revert: CSIT has not yet the latest VPP version

Change-Id: Ibaa2c00c639bacef1561898daf9485c3a68efec4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoL2Patch: Remove EXPECTED_FAILING 51/24151/1
Peter Mikus [Thu, 2 Jan 2020 09:35:02 +0000 (09:35 +0000)]
L2Patch: Remove EXPECTED_FAILING

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie950370c47403872597f8857edd651df2552ccb2

4 years agoTREX: Ability to configure from outside TrafficGenerator.py 56/24056/4
Peter Mikus [Wed, 18 Dec 2019 16:28:28 +0000 (16:28 +0000)]
TREX: Ability to configure from outside TrafficGenerator.py

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia9832e5e65dbcf2d4f99c52fd0570d456262ab9a

4 years agoVTS: Unify the tests 42/23942/7
Peter Mikus [Wed, 11 Dec 2019 14:22:14 +0000 (14:22 +0000)]
VTS: Unify the tests

- Converting to 2n as they were always 2n (with l2xc on 3rd node)
- Removing KW and converting to layered approach

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie349c50f72eb362815e7c5ede076d421ab386e76

4 years agoAdd VPP NSIM Plugin Keywords 19/24019/4
Dave Wallace [Mon, 16 Dec 2019 14:59:02 +0000 (14:59 +0000)]
Add VPP NSIM Plugin Keywords

Change-Id: I1e080a50a68ded8eebc5e6093c55d06281726684
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agopython3: fix RF 'only continuation marker' warning 63/24063/1
Dave Wallace [Wed, 18 Dec 2019 17:53:03 +0000 (17:53 +0000)]
python3: fix RF 'only continuation marker' warning

Change-Id: I250ffd196045bc623d5d38f30f16a08bcaea137c
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoTrending: Fix input data processing 45/24045/1
Tibor Frank [Wed, 18 Dec 2019 09:42:51 +0000 (10:42 +0100)]
Trending: Fix input data processing

Change-Id: I79cecd07c933cc46beb09de1ee2b4a0db5dd8a79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTelemetry: Add more operational data 33/23533/19
Peter Mikus [Tue, 19 Nov 2019 12:00:57 +0000 (12:00 +0000)]
Telemetry: Add more operational data

+ Add both NDR and PDR telemetry capture
+ Speedup sockets
+ Adjust privileges

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia6fd5d405e6fb410651d8b705c921653753aea10

4 years agoFIX: eth interfaces need numa_node information in topology file 33/24033/2
Jan Gelety [Fri, 13 Dec 2019 10:48:56 +0000 (11:48 +0100)]
FIX: eth interfaces need numa_node information in topology file

Change-Id: I9a3c6947da8ab5033e29b39833c97bcdafdc3ca9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCTPA: Improve handling pps vs Mpps 37/23937/7
Vratko Polak [Mon, 16 Dec 2019 09:49:24 +0000 (10:49 +0100)]
CTPA: Improve handling pps vs Mpps

+ Jumpavg assumes precision is around 1, so gives wrong classifications
  when fed Mpps numbers, and the classification has to be done on pps values.
+ Hover should display Mpps values properly, e.g. as floats.
+ Decided to show 3 digits after decimal point.
+ Better distinguishing between keys and indices.

Change-Id: I99bdad5b401839889463c7cf6f8b0930ec65b457
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agopython3: fix wrk traffic profile YAML load 20/24020/1
Dave Wallace [Mon, 16 Dec 2019 17:13:18 +0000 (17:13 +0000)]
python3: fix wrk traffic profile YAML load

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I3b7493221f3a0378b7f6cb0b0a21e8f18a0cc937

4 years agoVagrant: Introduce CentOS8 09/24009/4
Peter Mikus [Mon, 16 Dec 2019 12:14:44 +0000 (12:14 +0000)]
Vagrant: Introduce CentOS8

+ Full ansible compatibility
- Docker currently not working in Centos8 as it was not yet released

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I837091621db6bbebc9fee729496384cabe2f5357

4 years agoPerpatch compare: pylint fixes. 91/23991/6
Vratko Polak [Mon, 16 Dec 2019 12:18:22 +0000 (13:18 +0100)]
Perpatch compare: pylint fixes.

+ Do not execute on import.
+ Replace hack() with sorted().

Change-Id: Ic439a799ab29d42ae21faf70b2aea6dce6e89510
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoDo not execute crc check on import 92/23992/4
Vratko Polak [Mon, 16 Dec 2019 11:43:37 +0000 (12:43 +0100)]
Do not execute crc check on import

Other guilty scripts already have open changes that fix them.

Change-Id: Ife75e999d6d3f3f506b0f5dcdb679ce1f1e6bdbe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: NAT44 bug 11/24011/1
Peter Mikus [Mon, 16 Dec 2019 12:38:18 +0000 (12:38 +0000)]
FIX: NAT44 bug

+ From trending ...

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0ebb5429f0ad731d42aa43855cd99ae73b1461fc

4 years agoFIX PIP requirement packages 85/23985/8
Peter Mikus [Fri, 13 Dec 2019 12:49:21 +0000 (12:49 +0000)]
FIX PIP requirement packages

+ CSIT will only use packages installed from master
  PIP requirement.txt file
+ All CSIT subsequent code must use single function
  and PIP list for virtualenv
- Report/PAL/doc/trending will follow in next patch

Change-Id: Ia9150fb05a144182a5a163178d553370ede55cdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRemove supervisord dependency from containers 88/23988/5
Peter Mikus [Fri, 13 Dec 2019 15:06:46 +0000 (15:06 +0000)]
Remove supervisord dependency from containers

+ Startup config stream-line

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia12e48202a5fc88461d3d24ac9b9599e7175b1d8

4 years agoReduce spam from device bootstrap 94/23994/1
Vratko Polak [Fri, 13 Dec 2019 17:54:31 +0000 (18:54 +0100)]
Reduce spam from device bootstrap

It uses "declare -f" to paste the complete common.sh file. Twice.
The output from ssh remote side still remains visible,
but avoiding the spam should ease scrolling to Robot console output.

Change-Id: I746484ada7650a6dfa6794e76550757af5413a82
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAPI: Add collection for 22970/5 82/23982/1
Jan Gelety [Thu, 12 Dec 2019 19:46:12 +0000 (20:46 +0100)]
API: Add collection for 22970/5

Change-Id: If865526d833a267eba85e6ae4107e4d0da0dfd0b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPython3: refactor ':FOR' statements 76/23976/2
Dave Wallace [Thu, 12 Dec 2019 22:41:24 +0000 (22:41 +0000)]
Python3: refactor ':FOR' statements

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I76835e3d3acf6955e328f30427f9dd0098947e41

4 years agoCSIT-1597, CSIT-1647 API cleanup: gbp 77/23977/1
Jan Gelety [Thu, 12 Dec 2019 16:43:36 +0000 (17:43 +0100)]
CSIT-1597, CSIT-1647 API cleanup: gbp

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/23835
- update vpp stable to version 20.01-rc0~843

Change-Id: Idb1299cbbba578c09542c23858fb1fc55d090f26
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 23835/1 69/23969/1
Jan Gelety [Thu, 12 Dec 2019 13:31:33 +0000 (14:31 +0100)]
API: Add collection for 23835/1

- update vpp stable to version 20.01-rc0~841

Change-Id: I05fc3878a606852c8348b61b40d8000411709d33
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 23830/1 62/23962/1
Jan Gelety [Sun, 1 Dec 2019 09:43:16 +0000 (10:43 +0100)]
API: Add collection for 23830/1

- update vpp stable to version 20.01-rc0~839

Change-Id: Ic79bccf7cce384f5058218398bbef16cf1c9d40c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 23829/1 56/23956/1
Jan Gelety [Sun, 1 Dec 2019 04:43:49 +0000 (05:43 +0100)]
API: Add collection for 23829/1

Change-Id: I4b2a7bda48fba3050a35966f7a86c8dc7ba62d36
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1597 API cleanup: vhost 38/23938/2
Jan Gelety [Sun, 1 Dec 2019 00:31:13 +0000 (01:31 +0100)]
CSIT-1597 API cleanup: vhost

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22277
- update vpp stable to version 20.01-rc0~831

Change-Id: Icb3801d6a7bc738cf48bc5ecbb0767f115dde964
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-VPP-DEV: move tap tests back to critical pool 47/23947/1
Jan Gelety [Sun, 1 Dec 2019 03:38:10 +0000 (04:38 +0100)]
CSIT-VPP-DEV: move tap tests back to critical pool

Change-Id: Ic99e828588d561a07c169502dff8ca19ac98400f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 22277/5 36/23936/1
Jan Gelety [Sun, 1 Dec 2019 00:06:59 +0000 (01:06 +0100)]
API: Add collection for 22277/5

Change-Id: Icd82e53ba5836302b036dbe41070d11b2ea4d401
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1597 API cleanup: tap 11/23911/7
Jan Gelety [Sat, 30 Nov 2019 16:18:01 +0000 (17:18 +0100)]
CSIT-1597 API cleanup: tap

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
- cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887
- update vpp stable to version 20.01-rc0~828

Change-Id: I70d88741a02729421d4b31010910138838811518
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: NF_Density pipeline ip4 profile 33/23933/3
Peter Mikus [Wed, 11 Dec 2019 10:32:41 +0000 (10:32 +0000)]
FIX: NF_Density pipeline ip4 profile

- Because they are failing

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55c51bd3e4673414e5394cc6ba990257574ab002

4 years agoIntroduce VPP-IPsec container tests. 06/20706/53
Ludovit Mikula [Wed, 17 Jul 2019 14:36:21 +0000 (14:36 +0000)]
Introduce VPP-IPsec container tests.

Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
4 years agoAPI: Add collection for 23887/2 20/23920/1
Jan Gelety [Sat, 30 Nov 2019 19:04:12 +0000 (20:04 +0100)]
API: Add collection for 23887/2

Change-Id: I3c2124aebbab8cac12a7fa661e75b68b70286240
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoVPPD: Add L2patch 37/23337/14
Peter Mikus [Fri, 8 Nov 2019 13:15:23 +0000 (13:15 +0000)]
VPPD: Add L2patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407

4 years agoTrendig" Fix NFV graph 17/23917/1
Tibor Frank [Tue, 10 Dec 2019 13:07:22 +0000 (14:07 +0100)]
Trendig" Fix NFV graph

Change-Id: I92b2e6fb3ff095a16f2b8bf2b26770bb100d51ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAPI: Add collection for 21706/17 02/23902/2
Jan Gelety [Sat, 30 Nov 2019 14:33:21 +0000 (15:33 +0100)]
API: Add collection for 21706/17

Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1597 API cleanup: classify 26/22526/8
Jan Gelety [Wed, 11 Sep 2019 17:49:29 +0000 (19:49 +0200)]
CSIT-1597 API cleanup: classify

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
  https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted

Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoTrending: Add more NFV tests 05/23905/1
Tibor Frank [Tue, 10 Dec 2019 09:46:21 +0000 (10:46 +0100)]
Trending: Add more NFV tests

+ 10R2C, 6R4C
+ Tunnels

Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoPerpatch compare: avg_diff is not an int 86/23886/2
Vratko Polak [Mon, 9 Dec 2019 15:04:42 +0000 (16:04 +0100)]
Perpatch compare: avg_diff is not an int

Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: ip route config for ipsec via VAT 10/23810/21
Jan Gelety [Fri, 29 Nov 2019 13:29:53 +0000 (14:29 +0100)]
FIX: ip route config for ipsec via VAT

Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: integer divisions 73/23873/3
Jan Gelety [Sat, 30 Nov 2019 05:47:45 +0000 (06:47 +0100)]
FIX: integer divisions

Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoTrending: Use Mpps 77/23877/5
Tibor Frank [Mon, 9 Dec 2019 12:10:07 +0000 (13:10 +0100)]
Trending: Use Mpps

Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: Fix Alerts 75/23875/2
Tibor Frank [Mon, 9 Dec 2019 10:21:37 +0000 (11:21 +0100)]
Trending: Fix Alerts

Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFixes: Report 72/23872/8
Tibor Frank [Mon, 9 Dec 2019 08:56:32 +0000 (09:56 +0100)]
Fixes: Report

- show run

Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoImprove quoting of asterisks 12/23812/4
Vratko Polak [Thu, 5 Dec 2019 16:07:24 +0000 (17:07 +0100)]
Improve quoting of asterisks

When quoted, the asterisks are understood as literal characters.
When unquoted, so they act as globs patterns.

When used to match files already present in the filesystem,
the asterisks should be unquoted.
When used to match a package name (not a file),
the asterisks should be quoted to prevent the bash expansion,
as programs such as apt-get and yum do their own expasion afterwards.

Unquoted asterisks for matching package names
may happen to work when there are no files to match the bash expansion,
but quoted asterisks are sure to avoid accidents.

Also, we want an asterisk both before and after "vpp",
due to package names such as libvppinfra-dev and python3-vpp-api.

Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: Some leftovers + csit_sut image sync 18/23818/1
Peter Mikus [Thu, 5 Dec 2019 16:06:40 +0000 (16:06 +0000)]
FIX: Some leftovers + csit_sut image sync

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942

4 years agoUse new gdb commands for core dump examination 94/23694/7
Vratko Polak [Fri, 29 Nov 2019 14:55:43 +0000 (15:55 +0100)]
Use new gdb commands for core dump examination

Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: Deal with some "pylint: disable=" comments 09/23809/1
Peter Mikus [Thu, 5 Dec 2019 07:08:11 +0000 (07:08 +0000)]
FIX: Deal with some "pylint: disable=" comments

Same rules for all

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iaf6b6313750d19132e2f2886e676100878719690

4 years agoDeal with some "pylint: disable=" comments 92/23692/5
Vratko Polak [Wed, 4 Dec 2019 12:24:07 +0000 (13:24 +0100)]
Deal with some "pylint: disable=" comments

+ When possible, fix the violation.
+ Else, add a comment:
  + An explanation (if not already present) and keep disable.
  + A TODO (if not already present) and remove the disable.
- This makes tox job report more pylint violations,
  but any such violation is fixable and should be fixed.
  - Although some need to be fixed in VPP, such as enum item long names.

Change-Id: I48604b5eda070083d79dff1439620dbd9e798e1f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoPython3: IPv4 FIB scale tests with random flows 65/23765/4
Balaji Venkatraman [Tue, 3 Dec 2019 18:05:28 +0000 (10:05 -0800)]
Python3:  IPv4 FIB scale tests with random flows

Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Change-Id: Iadd9e8da655f3ccbd36167c1bbee37a774c3bc1f
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
4 years agoTrending: Fix CLX plots 92/23792/1
Tibor Frank [Wed, 4 Dec 2019 15:02:30 +0000 (16:02 +0100)]
Trending: Fix CLX plots

Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: Fix CLX data set 89/23789/1
Tibor Frank [Wed, 4 Dec 2019 12:59:50 +0000 (13:59 +0100)]
Trending: Fix CLX data set

Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: Reorganization 41/22341/49
Tibor Frank [Fri, 27 Sep 2019 11:02:24 +0000 (13:02 +0200)]
Trending: Reorganization

+ use selection of tests by their full names
+ finalize trending_test_groups.md
+ modify static content
+ modify anchors
+ specifications:
  + container memif
  + ip4
  + ip4 tunnels
  + ip6
  + ipsec
  + l2
  + srv6
  + vhost
  + vts
  + dpdk
+ add 2n-clx
+ hyperlinks

Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate CRC for 21551/27 51/23651/4
Vratko Polak [Wed, 27 Nov 2019 13:04:05 +0000 (14:04 +0100)]
Update CRC for 21551/27

The previously prepared values for 21551/12
are not matching the newer patch sets.

Change-Id: I2ddfcfc96f3f1573b20889dd52e142cf39465f65
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoPAL: Add HDRHistogram graphs for latency 10/22210/78
Tibor Frank [Tue, 24 Sep 2019 09:00:05 +0000 (11:00 +0200)]
PAL: Add HDRHistogram graphs for latency

Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoChange startup show pci to show ver 85/23785/1
juraj.linkes [Fri, 29 Nov 2019 19:29:40 +0000 (20:29 +0100)]
Change startup show pci to show ver

When testing whether a socket is listetning, show pci results in a crash
on the Taishan platform. Temporarily work around this by changing it to
show ver.

Change-Id: Id0f995373bc2f429d59de200e51959b2da408052
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoRemove: VIRL 53/23753/3
Peter Mikus [Tue, 3 Dec 2019 12:53:24 +0000 (12:53 +0000)]
Remove: VIRL

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b

4 years agoFIX: Add ply also to global requirements 58/23758/2
Peter Mikus [Tue, 3 Dec 2019 15:00:13 +0000 (15:00 +0000)]
FIX: Add ply also to global requirements

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fca2c05377f94e9df8c3df1d8d735c25a84e538

4 years agoPython3: PAL 58/23558/50
Tibor Frank [Wed, 20 Nov 2019 10:43:44 +0000 (11:43 +0100)]
Python3: PAL

- files renamed:
  - utils.py --> pal_utils.py
  - errors.py --> pal_errors.py
- functions/methods renamed:
  - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name
  - plot_performance_box_name --> plot_perf_box_name
  - plot_latency_error_bars_name --> plot_lat_err_bars_name
  - plot_throughput_speedup_analysis_name --> plot_tsa_name
  - plot_service_density_heatmap --> plot_nf_heatmap
  - table_performance_comparison --> table_perf_comparison
  - table_performance_comparison_nic --> table_perf_comparison_nic
  - table_performance_trending_dashboard_html --> table_perf_trending_dash_html

- functions/methods removed:
  - plot_service_density_heatmap_compare
  - plot_throughput_speedup_analysis
  - plot_latency_error_bars
  - plot_soak_boxes
  - plot_soak_bars

Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAPI: Add collection for 21551/27 50/23750/1
Jan Gelety [Fri, 29 Nov 2019 08:42:47 +0000 (09:42 +0100)]
API: Add collection for 21551/27

Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: vxlan+vlan perf tests 23/23723/12
Jan Gelety [Fri, 29 Nov 2019 01:10:31 +0000 (02:10 +0100)]
FIX: vxlan+vlan perf tests

Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPython3: Vagrant update 48/23748/1
Peter Mikus [Tue, 3 Dec 2019 09:41:38 +0000 (09:41 +0000)]
Python3: Vagrant update

+ Small styling

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde

4 years agoUse Jumpavg 0.2.0 in PAL 37/23737/4
Vratko Polak [Mon, 2 Dec 2019 18:01:35 +0000 (19:01 +0100)]
Use Jumpavg 0.2.0 in PAL

+ As a side effect, PAL is now part of "resource" package tree.
- Testable only with 23558 (the rest of PAL Python 3 migration).

Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoRefactor jumpavg to be more readable and usable 65/23465/8
Vratko Polak [Mon, 2 Dec 2019 17:38:44 +0000 (18:38 +0100)]
Refactor jumpavg to be more readable and usable

This is the python3 change, the python2 is still used for testing bisect.

+ New version is 0.2.0 due to amount o API changes.
+ Jumpavg is now part of CSIT resource package tree.
+ Perpatch migrated to new jumpavg.
- PAL NOT updated (the update moved to a different Change).

Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: Perpatch PY3 25/23725/2
Peter Mikus [Mon, 2 Dec 2019 14:22:16 +0000 (14:22 +0000)]
FIX: Perpatch PY3

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab

4 years agoFIX: SRV6 proxy 18/23718/2
Jan Gelety [Thu, 28 Nov 2019 20:13:26 +0000 (21:13 +0100)]
FIX: SRV6 proxy

Change-Id: I4afbb0261c21c800bf24e423e505307f596c0045
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: acl 10/23710/1
Jan Gelety [Thu, 28 Nov 2019 18:52:52 +0000 (19:52 +0100)]
FIX: acl

Change-Id: Ieb1569a1dce9fd7c00041ba00f72c67142a581ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoConvert SRv6 from LXC to Docker 07/23707/2
Peter Mikus [Sun, 1 Dec 2019 07:07:06 +0000 (07:07 +0000)]
Convert SRv6 from LXC to Docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7c948be40aaf2eb03434cec5548a89aaf0f1eca6

4 years agoFIX: VAT terminal 06/23706/1
Peter Mikus [Sun, 1 Dec 2019 07:03:45 +0000 (07:03 +0000)]
FIX: VAT terminal

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I98fd62e6b5367b23694017d99a1dae7d893326c9

4 years agoFIX: IPsec naming creation 04/23704/2
Peter Mikus [Sat, 30 Nov 2019 17:27:08 +0000 (17:27 +0000)]
FIX: IPsec naming creation

Change-Id: I066a8b85649654c1c575eb63722de6c51f3d4f78
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoPython3: resources and libraries 78/23478/78
Jan Gelety [Tue, 12 Nov 2019 04:27:43 +0000 (05:27 +0100)]
Python3: resources and libraries

Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPython3: PIP requirement 07/23207/30
Peter Mikus [Mon, 4 Nov 2019 09:27:28 +0000 (09:27 +0000)]
Python3: PIP requirement

- Install via PIP3
- Use virtualenv Python3 interpret

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3

4 years agoNSH_SFC: Remove 21/23421/2
Tibor Frank [Thu, 14 Nov 2019 09:06:03 +0000 (10:06 +0100)]
NSH_SFC: Remove

Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoHONEYCOMB: Remove 63/23363/4
Peter Mikus [Mon, 11 Nov 2019 16:14:32 +0000 (16:14 +0000)]
HONEYCOMB: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e

4 years agoImprove test tag string parsing 33/23433/9
Vratko Polak [Fri, 15 Nov 2019 16:27:43 +0000 (17:27 +0100)]
Improve test tag string parsing

Instead of just adding the missing -clx,
the new way aims to be forward compatible.

The new implementation is quite permissive,
ignoring all "word" chars sticking to the trigger word
and returning everything after that and space up to the endline.

+ Unified perftest and devicetest handling.
 + Consequently, triggers like "devicetest-1n-skx GBP" will work now.

Change-Id: I3bda6105195180d35a589a75318f569e36f03461
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: Ansible remove vpp 95/23495/1
Peter Mikus [Mon, 18 Nov 2019 09:13:38 +0000 (09:13 +0000)]
FIX: Ansible remove vpp

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409

4 years agoFIX: LXC Container directory initialization 67/23467/2
Peter Mikus [Fri, 15 Nov 2019 10:52:49 +0000 (10:52 +0000)]
FIX: LXC Container directory initialization

Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoDoc: CSIT Python2 to Python3 migration plan proposal 38/22638/7
Jan Gelety [Fri, 4 Oct 2019 19:26:05 +0000 (21:26 +0200)]
Doc: CSIT Python2 to Python3 migration plan proposal

Change-Id: I0046ef57744d8d09117e850b60f9d65c7495ed07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCRC: Update comments after lb-nat4 tests 14/23414/3
Vratko Polak [Wed, 13 Nov 2019 16:44:41 +0000 (17:44 +0100)]
CRC: Update comments after lb-nat4 tests

Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: AVF IP6base 30/23430/1
Peter Mikus [Thu, 14 Nov 2019 14:51:54 +0000 (14:51 +0000)]
FIX: AVF IP6base

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc3350acab54100f03f540397bfcbd6e7455ea2c

4 years agoFIX: Ipsec perf 12/23412/22
Peter Mikus [Wed, 13 Nov 2019 14:37:51 +0000 (14:37 +0000)]
FIX: Ipsec perf

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0