csit.git
2 days agoReduce spam from device bootstrap 94/23994/1 master
Vratko Polak [Fri, 13 Dec 2019 17:54:31 +0000 (18:54 +0100)]
Reduce spam from device bootstrap

It uses "declare -f" to paste the complete common.sh file. Twice.
The output from ssh remote side still remains visible,
but avoiding the spam should ease scrolling to Robot console output.

Change-Id: I746484ada7650a6dfa6794e76550757af5413a82
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 days agoAPI: Add collection for 22970/5 82/23982/1
Jan Gelety [Thu, 12 Dec 2019 19:46:12 +0000 (20:46 +0100)]
API: Add collection for 22970/5

Change-Id: If865526d833a267eba85e6ae4107e4d0da0dfd0b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 days agoPython3: refactor ':FOR' statements 76/23976/2
Dave Wallace [Thu, 12 Dec 2019 22:41:24 +0000 (22:41 +0000)]
Python3: refactor ':FOR' statements

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I76835e3d3acf6955e328f30427f9dd0098947e41

3 days agoCSIT-1597, CSIT-1647 API cleanup: gbp 77/23977/1
Jan Gelety [Thu, 12 Dec 2019 16:43:36 +0000 (17:43 +0100)]
CSIT-1597, CSIT-1647 API cleanup: gbp

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/23835
- update vpp stable to version 20.01-rc0~843

Change-Id: Idb1299cbbba578c09542c23858fb1fc55d090f26
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 days agoAPI: Add collection for 23835/1 69/23969/1
Jan Gelety [Thu, 12 Dec 2019 13:31:33 +0000 (14:31 +0100)]
API: Add collection for 23835/1

- update vpp stable to version 20.01-rc0~841

Change-Id: I05fc3878a606852c8348b61b40d8000411709d33
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoAPI: Add collection for 23830/1 62/23962/1
Jan Gelety [Sun, 1 Dec 2019 09:43:16 +0000 (10:43 +0100)]
API: Add collection for 23830/1

- update vpp stable to version 20.01-rc0~839

Change-Id: Ic79bccf7cce384f5058218398bbef16cf1c9d40c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoAPI: Add collection for 23829/1 56/23956/1
Jan Gelety [Sun, 1 Dec 2019 04:43:49 +0000 (05:43 +0100)]
API: Add collection for 23829/1

Change-Id: I4b2a7bda48fba3050a35966f7a86c8dc7ba62d36
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoCSIT-1597 API cleanup: vhost 38/23938/2
Jan Gelety [Sun, 1 Dec 2019 00:31:13 +0000 (01:31 +0100)]
CSIT-1597 API cleanup: vhost

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22277
- update vpp stable to version 20.01-rc0~831

Change-Id: Icb3801d6a7bc738cf48bc5ecbb0767f115dde964
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoCSIT-VPP-DEV: move tap tests back to critical pool 47/23947/1
Jan Gelety [Sun, 1 Dec 2019 03:38:10 +0000 (04:38 +0100)]
CSIT-VPP-DEV: move tap tests back to critical pool

Change-Id: Ic99e828588d561a07c169502dff8ca19ac98400f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoAPI: Add collection for 22277/5 36/23936/1
Jan Gelety [Sun, 1 Dec 2019 00:06:59 +0000 (01:06 +0100)]
API: Add collection for 22277/5

Change-Id: Icd82e53ba5836302b036dbe41070d11b2ea4d401
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 days agoCSIT-1597 API cleanup: tap 11/23911/7
Jan Gelety [Sat, 30 Nov 2019 16:18:01 +0000 (17:18 +0100)]
CSIT-1597 API cleanup: tap

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
- cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887
- update vpp stable to version 20.01-rc0~828

Change-Id: I70d88741a02729421d4b31010910138838811518
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 days agoFIX: NF_Density pipeline ip4 profile 33/23933/3
Peter Mikus [Wed, 11 Dec 2019 10:32:41 +0000 (10:32 +0000)]
FIX: NF_Density pipeline ip4 profile

- Because they are failing

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55c51bd3e4673414e5394cc6ba990257574ab002

4 days agoIntroduce VPP-IPsec container tests. 06/20706/53
Ludovit Mikula [Wed, 17 Jul 2019 14:36:21 +0000 (14:36 +0000)]
Introduce VPP-IPsec container tests.

Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
2 weeks agoAPI: Add collection for 23887/2 20/23920/1
Jan Gelety [Sat, 30 Nov 2019 19:04:12 +0000 (20:04 +0100)]
API: Add collection for 23887/2

Change-Id: I3c2124aebbab8cac12a7fa661e75b68b70286240
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 days agoVPPD: Add L2patch 37/23337/14
Peter Mikus [Fri, 8 Nov 2019 13:15:23 +0000 (13:15 +0000)]
VPPD: Add L2patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407

5 days agoTrendig" Fix NFV graph 17/23917/1
Tibor Frank [Tue, 10 Dec 2019 13:07:22 +0000 (14:07 +0100)]
Trendig" Fix NFV graph

Change-Id: I92b2e6fb3ff095a16f2b8bf2b26770bb100d51ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 days agoAPI: Add collection for 21706/17 02/23902/2
Jan Gelety [Sat, 30 Nov 2019 14:33:21 +0000 (15:33 +0100)]
API: Add collection for 21706/17

Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 days agoCSIT-1597 API cleanup: classify 26/22526/8
Jan Gelety [Wed, 11 Sep 2019 17:49:29 +0000 (19:49 +0200)]
CSIT-1597 API cleanup: classify

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
  https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted

Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 days agoTrending: Add more NFV tests 05/23905/1
Tibor Frank [Tue, 10 Dec 2019 09:46:21 +0000 (10:46 +0100)]
Trending: Add more NFV tests

+ 10R2C, 6R4C
+ Tunnels

Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 days agoPerpatch compare: avg_diff is not an int 86/23886/2
Vratko Polak [Mon, 9 Dec 2019 15:04:42 +0000 (16:04 +0100)]
Perpatch compare: avg_diff is not an int

Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoFIX: ip route config for ipsec via VAT 10/23810/21
Jan Gelety [Fri, 29 Nov 2019 13:29:53 +0000 (14:29 +0100)]
FIX: ip route config for ipsec via VAT

Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 days agoFIX: integer divisions 73/23873/3
Jan Gelety [Sat, 30 Nov 2019 05:47:45 +0000 (06:47 +0100)]
FIX: integer divisions

Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 days agoTrending: Use Mpps 77/23877/5
Tibor Frank [Mon, 9 Dec 2019 12:10:07 +0000 (13:10 +0100)]
Trending: Use Mpps

Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 days agoTrending: Fix Alerts 75/23875/2
Tibor Frank [Mon, 9 Dec 2019 10:21:37 +0000 (11:21 +0100)]
Trending: Fix Alerts

Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 days agoFixes: Report 72/23872/8
Tibor Frank [Mon, 9 Dec 2019 08:56:32 +0000 (09:56 +0100)]
Fixes: Report

- show run

Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 days agoImprove quoting of asterisks 12/23812/4
Vratko Polak [Thu, 5 Dec 2019 16:07:24 +0000 (17:07 +0100)]
Improve quoting of asterisks

When quoted, the asterisks are understood as literal characters.
When unquoted, so they act as globs patterns.

When used to match files already present in the filesystem,
the asterisks should be unquoted.
When used to match a package name (not a file),
the asterisks should be quoted to prevent the bash expansion,
as programs such as apt-get and yum do their own expasion afterwards.

Unquoted asterisks for matching package names
may happen to work when there are no files to match the bash expansion,
but quoted asterisks are sure to avoid accidents.

Also, we want an asterisk both before and after "vpp",
due to package names such as libvppinfra-dev and python3-vpp-api.

Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 days agoFIX: Some leftovers + csit_sut image sync 18/23818/1
Peter Mikus [Thu, 5 Dec 2019 16:06:40 +0000 (16:06 +0000)]
FIX: Some leftovers + csit_sut image sync

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942

10 days agoUse new gdb commands for core dump examination 94/23694/7
Vratko Polak [Fri, 29 Nov 2019 14:55:43 +0000 (15:55 +0100)]
Use new gdb commands for core dump examination

Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 days agoFIX: Deal with some "pylint: disable=" comments 09/23809/1
Peter Mikus [Thu, 5 Dec 2019 07:08:11 +0000 (07:08 +0000)]
FIX: Deal with some "pylint: disable=" comments

Same rules for all

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iaf6b6313750d19132e2f2886e676100878719690

10 days agoDeal with some "pylint: disable=" comments 92/23692/5
Vratko Polak [Wed, 4 Dec 2019 12:24:07 +0000 (13:24 +0100)]
Deal with some "pylint: disable=" comments

+ When possible, fix the violation.
+ Else, add a comment:
  + An explanation (if not already present) and keep disable.
  + A TODO (if not already present) and remove the disable.
- This makes tox job report more pylint violations,
  but any such violation is fixable and should be fixed.
  - Although some need to be fixed in VPP, such as enum item long names.

Change-Id: I48604b5eda070083d79dff1439620dbd9e798e1f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 days agoPython3: IPv4 FIB scale tests with random flows 65/23765/4
Balaji Venkatraman [Tue, 3 Dec 2019 18:05:28 +0000 (10:05 -0800)]
Python3:  IPv4 FIB scale tests with random flows

Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Change-Id: Iadd9e8da655f3ccbd36167c1bbee37a774c3bc1f
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
11 days agoTrending: Fix CLX plots 92/23792/1
Tibor Frank [Wed, 4 Dec 2019 15:02:30 +0000 (16:02 +0100)]
Trending: Fix CLX plots

Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 days agoTrending: Fix CLX data set 89/23789/1
Tibor Frank [Wed, 4 Dec 2019 12:59:50 +0000 (13:59 +0100)]
Trending: Fix CLX data set

Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 days agoTrending: Reorganization 41/22341/49
Tibor Frank [Fri, 27 Sep 2019 11:02:24 +0000 (13:02 +0200)]
Trending: Reorganization

+ use selection of tests by their full names
+ finalize trending_test_groups.md
+ modify static content
+ modify anchors
+ specifications:
  + container memif
  + ip4
  + ip4 tunnels
  + ip6
  + ipsec
  + l2
  + srv6
  + vhost
  + vts
  + dpdk
+ add 2n-clx
+ hyperlinks

Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 days agoUpdate CRC for 21551/27 51/23651/4
Vratko Polak [Wed, 27 Nov 2019 13:04:05 +0000 (14:04 +0100)]
Update CRC for 21551/27

The previously prepared values for 21551/12
are not matching the newer patch sets.

Change-Id: I2ddfcfc96f3f1573b20889dd52e142cf39465f65
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 days agoPAL: Add HDRHistogram graphs for latency 10/22210/78
Tibor Frank [Tue, 24 Sep 2019 09:00:05 +0000 (11:00 +0200)]
PAL: Add HDRHistogram graphs for latency

Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoChange startup show pci to show ver 85/23785/1
juraj.linkes [Fri, 29 Nov 2019 19:29:40 +0000 (20:29 +0100)]
Change startup show pci to show ver

When testing whether a socket is listetning, show pci results in a crash
on the Taishan platform. Temporarily work around this by changing it to
show ver.

Change-Id: Id0f995373bc2f429d59de200e51959b2da408052
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
12 days agoRemove: VIRL 53/23753/3
Peter Mikus [Tue, 3 Dec 2019 12:53:24 +0000 (12:53 +0000)]
Remove: VIRL

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b

12 days agoFIX: Add ply also to global requirements 58/23758/2
Peter Mikus [Tue, 3 Dec 2019 15:00:13 +0000 (15:00 +0000)]
FIX: Add ply also to global requirements

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fca2c05377f94e9df8c3df1d8d735c25a84e538

12 days agoPython3: PAL 58/23558/50
Tibor Frank [Wed, 20 Nov 2019 10:43:44 +0000 (11:43 +0100)]
Python3: PAL

- files renamed:
  - utils.py --> pal_utils.py
  - errors.py --> pal_errors.py
- functions/methods renamed:
  - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name
  - plot_performance_box_name --> plot_perf_box_name
  - plot_latency_error_bars_name --> plot_lat_err_bars_name
  - plot_throughput_speedup_analysis_name --> plot_tsa_name
  - plot_service_density_heatmap --> plot_nf_heatmap
  - table_performance_comparison --> table_perf_comparison
  - table_performance_comparison_nic --> table_perf_comparison_nic
  - table_performance_trending_dashboard_html --> table_perf_trending_dash_html

- functions/methods removed:
  - plot_service_density_heatmap_compare
  - plot_throughput_speedup_analysis
  - plot_latency_error_bars
  - plot_soak_boxes
  - plot_soak_bars

Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoAPI: Add collection for 21551/27 50/23750/1
Jan Gelety [Fri, 29 Nov 2019 08:42:47 +0000 (09:42 +0100)]
API: Add collection for 21551/27

Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
12 days agoFIX: vxlan+vlan perf tests 23/23723/12
Jan Gelety [Fri, 29 Nov 2019 01:10:31 +0000 (02:10 +0100)]
FIX: vxlan+vlan perf tests

Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
12 days agoPython3: Vagrant update 48/23748/1
Peter Mikus [Tue, 3 Dec 2019 09:41:38 +0000 (09:41 +0000)]
Python3: Vagrant update

+ Small styling

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde

13 days agoUse Jumpavg 0.2.0 in PAL 37/23737/4
Vratko Polak [Mon, 2 Dec 2019 18:01:35 +0000 (19:01 +0100)]
Use Jumpavg 0.2.0 in PAL

+ As a side effect, PAL is now part of "resource" package tree.
- Testable only with 23558 (the rest of PAL Python 3 migration).

Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 days agoRefactor jumpavg to be more readable and usable 65/23465/8
Vratko Polak [Mon, 2 Dec 2019 17:38:44 +0000 (18:38 +0100)]
Refactor jumpavg to be more readable and usable

This is the python3 change, the python2 is still used for testing bisect.

+ New version is 0.2.0 due to amount o API changes.
+ Jumpavg is now part of CSIT resource package tree.
+ Perpatch migrated to new jumpavg.
- PAL NOT updated (the update moved to a different Change).

Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 days agoFIX: Perpatch PY3 25/23725/2
Peter Mikus [Mon, 2 Dec 2019 14:22:16 +0000 (14:22 +0000)]
FIX: Perpatch PY3

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab

2 weeks agoFIX: SRV6 proxy 18/23718/2
Jan Gelety [Thu, 28 Nov 2019 20:13:26 +0000 (21:13 +0100)]
FIX: SRV6 proxy

Change-Id: I4afbb0261c21c800bf24e423e505307f596c0045
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoFIX: acl 10/23710/1
Jan Gelety [Thu, 28 Nov 2019 18:52:52 +0000 (19:52 +0100)]
FIX: acl

Change-Id: Ieb1569a1dce9fd7c00041ba00f72c67142a581ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoConvert SRv6 from LXC to Docker 07/23707/2
Peter Mikus [Sun, 1 Dec 2019 07:07:06 +0000 (07:07 +0000)]
Convert SRv6 from LXC to Docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7c948be40aaf2eb03434cec5548a89aaf0f1eca6

2 weeks agoFIX: VAT terminal 06/23706/1
Peter Mikus [Sun, 1 Dec 2019 07:03:45 +0000 (07:03 +0000)]
FIX: VAT terminal

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I98fd62e6b5367b23694017d99a1dae7d893326c9

2 weeks agoFIX: IPsec naming creation 04/23704/2
Peter Mikus [Sat, 30 Nov 2019 17:27:08 +0000 (17:27 +0000)]
FIX: IPsec naming creation

Change-Id: I066a8b85649654c1c575eb63722de6c51f3d4f78
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 weeks agoPython3: resources and libraries 78/23478/78
Jan Gelety [Tue, 12 Nov 2019 04:27:43 +0000 (05:27 +0100)]
Python3: resources and libraries

Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoPython3: PIP requirement 07/23207/30
Peter Mikus [Mon, 4 Nov 2019 09:27:28 +0000 (09:27 +0000)]
Python3: PIP requirement

- Install via PIP3
- Use virtualenv Python3 interpret

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3

3 weeks agoNSH_SFC: Remove 21/23421/2
Tibor Frank [Thu, 14 Nov 2019 09:06:03 +0000 (10:06 +0100)]
NSH_SFC: Remove

Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoHONEYCOMB: Remove 63/23363/4
Peter Mikus [Mon, 11 Nov 2019 16:14:32 +0000 (16:14 +0000)]
HONEYCOMB: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e

3 weeks agoImprove test tag string parsing 33/23433/9 master-backup-191118
Vratko Polak [Fri, 15 Nov 2019 16:27:43 +0000 (17:27 +0100)]
Improve test tag string parsing

Instead of just adding the missing -clx,
the new way aims to be forward compatible.

The new implementation is quite permissive,
ignoring all "word" chars sticking to the trigger word
and returning everything after that and space up to the endline.

+ Unified perftest and devicetest handling.
 + Consequently, triggers like "devicetest-1n-skx GBP" will work now.

Change-Id: I3bda6105195180d35a589a75318f569e36f03461
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agoFIX: Ansible remove vpp 95/23495/1
Peter Mikus [Mon, 18 Nov 2019 09:13:38 +0000 (09:13 +0000)]
FIX: Ansible remove vpp

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409

4 weeks agoFIX: LXC Container directory initialization 67/23467/2
Peter Mikus [Fri, 15 Nov 2019 10:52:49 +0000 (10:52 +0000)]
FIX: LXC Container directory initialization

Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 weeks agoDoc: CSIT Python2 to Python3 migration plan proposal 38/22638/7
Jan Gelety [Fri, 4 Oct 2019 19:26:05 +0000 (21:26 +0200)]
Doc: CSIT Python2 to Python3 migration plan proposal

Change-Id: I0046ef57744d8d09117e850b60f9d65c7495ed07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 weeks agoCRC: Update comments after lb-nat4 tests 14/23414/3
Vratko Polak [Wed, 13 Nov 2019 16:44:41 +0000 (17:44 +0100)]
CRC: Update comments after lb-nat4 tests

Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoFIX: AVF IP6base 30/23430/1
Peter Mikus [Thu, 14 Nov 2019 14:51:54 +0000 (14:51 +0000)]
FIX: AVF IP6base

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc3350acab54100f03f540397bfcbd6e7455ea2c

4 weeks agoFIX: Ipsec perf 12/23412/22
Peter Mikus [Wed, 13 Nov 2019 14:37:51 +0000 (14:37 +0000)]
FIX: Ipsec perf

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0

4 weeks agoUpdate of VPP_STABLE_VER files 11/23411/2
Jan Gelety [Tue, 12 Nov 2019 05:58:51 +0000 (06:58 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~638-gea93e48cf

 - use new vpp ref build - centos7:
   20.01-rc0~638-gea93e48cf

Change-Id: Ib3ab491df32c73ca90178dcd21c3c4e6512371d4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 weeks agoLIGATO: Remove 04/23404/2
Peter Mikus [Wed, 13 Nov 2019 13:30:48 +0000 (13:30 +0000)]
LIGATO: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768

4 weeks agoFIX: missing param in gbp_contract_add_del 78/23378/8
Jan Gelety [Mon, 11 Nov 2019 18:39:06 +0000 (19:39 +0100)]
FIX: missing param in gbp_contract_add_del

Change-Id: I5c2354911505a9d7a95bef894eda8bf7b14b8dc8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 weeks agoFIX: Ansible container cleanup 00/23400/2
Peter Mikus [Wed, 13 Nov 2019 11:40:17 +0000 (11:40 +0000)]
FIX: Ansible container cleanup

Change-Id: I233baca48a3f01d1a206fd004b0503b0f1fad5d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 weeks agoFIX: Ansible cleanup permission 97/23397/2
Peter Mikus [Wed, 13 Nov 2019 10:46:16 +0000 (10:46 +0000)]
FIX: Ansible cleanup permission

Change-Id: Ia79558b579e70aa666e8f84230f4bd2cafb33569
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 weeks agoAdd vpp loadbalancer l3dsr/nat4 mode test suites 36/22636/7
haiyanx1.zhang [Thu, 10 Oct 2019 05:34:43 +0000 (05:34 +0000)]
Add vpp loadbalancer l3dsr/nat4 mode test suites

Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
4 weeks agoTrending: Input data 94/23394/1
Tibor Frank [Wed, 13 Nov 2019 09:12:39 +0000 (10:12 +0100)]
Trending: Input data

Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoNew weekly mrr trigger 41/23341/5
Jan Gelety [Thu, 7 Nov 2019 06:45:55 +0000 (07:45 +0100)]
New weekly mrr trigger

Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 weeks agoFIX: Supervisor initialization 72/23372/2
Peter Mikus [Tue, 12 Nov 2019 07:48:57 +0000 (07:48 +0000)]
FIX: Supervisor initialization

- Next step: remove supervisor entirely

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8

4 weeks agoRemove the leftovers of the old testbed cleanup 65/23365/2
Vratko Polak [Mon, 11 Nov 2019 17:19:30 +0000 (18:19 +0100)]
Remove the leftovers of the old testbed cleanup

Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoAdd accidentally deleted NAT setup command 60/23360/1
Vratko Polak [Mon, 11 Nov 2019 13:03:16 +0000 (14:03 +0100)]
Add accidentally deleted NAT setup command

One suite was missing "And Add NAT to all DUTs".

Change-Id: I6e9c3de9f236a080cfe829db2d155a6f6ba3b3f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoFIX: do not use ping in vpp-device tests 87/23287/15
Jan Gelety [Wed, 30 Oct 2019 03:52:03 +0000 (04:52 +0100)]
FIX: do not use ping in vpp-device tests

Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 weeks agoFIX: Paths for new Docker images 54/23354/2
Peter Mikus [Mon, 11 Nov 2019 08:35:03 +0000 (08:35 +0000)]
FIX: Paths for new Docker images

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50

4 weeks agoFIX: 2lbvpplacp 43/23343/2
Peter Mikus [Fri, 8 Nov 2019 16:03:49 +0000 (16:03 +0000)]
FIX: 2lbvpplacp

- These testcases are non standard so they need to be refactored
  to be able to use the interface layers

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9400846ff04f1864babd6d7fa153f0c3708cb105

5 weeks agoPrevent many TC triggered by bad tag expressions 16/23216/7
Vratko Polak [Fri, 8 Nov 2019 10:14:52 +0000 (11:14 +0100)]
Prevent many TC triggered by bad tag expressions

Typical example: Use multiple perftest lines in a comment.
Atypical example: Use perftest as an expression (without any ANDs).

Fix: Die if "perftest" is found in the tag expression (before prefixing).

Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agoFIX: use correct NIC for mr-daily-master job 32/23332/1
Jan Gelety [Thu, 7 Nov 2019 02:30:47 +0000 (03:30 +0100)]
FIX: use correct NIC for mr-daily-master job

Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 weeks agoFIX: Small ansible fixes 30/23330/2
Peter Mikus [Fri, 8 Nov 2019 08:09:04 +0000 (08:09 +0000)]
FIX: Small ansible fixes

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2

5 weeks agoSource ansible.sh for entry scripts using cleanup 12/23312/1
Vratko Polak [Thu, 7 Nov 2019 13:13:45 +0000 (14:13 +0100)]
Source ansible.sh for entry scripts using cleanup

Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agoCleanup via Ansible 52/22652/8
Peter Mikus [Thu, 10 Oct 2019 15:31:28 +0000 (15:31 +0000)]
Cleanup via Ansible

+ Remove dependency on topo_ scripts that depends on custom SSH()
  that depends on framework itself. This way the cleanup is independent
  of failure in our SSH libs.
+ Simple ansible command can do cleanup of a machine:
  ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \
  --limit '10.32.8.18' --tags 'cleanup'
+ Add vpp_device reset and cleanup.
+ Remove historical scripts.

- Still in testing beta phase.
  - Need to add SRIOV cleanup.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7

5 weeks agoTrending: Fix alerts 21/23221/1
Tibor Frank [Mon, 4 Nov 2019 14:50:18 +0000 (15:50 +0100)]
Trending: Fix alerts

Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoNew daily triggers 87/22987/4
Jan Gelety [Fri, 25 Oct 2019 13:16:46 +0000 (15:16 +0200)]
New daily triggers

New daily triggers defined based on requirements defined in
 https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md

Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 weeks agoRegularize spaces in crc list 57/23157/1
Vratko Polak [Thu, 31 Oct 2019 17:50:19 +0000 (18:50 +0100)]
Regularize spaces in crc list

Two spaces before hash if after quote, single space otherwise
(or 4 spaces if the hash is commenting out the whole line).

Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agoCopy missing lines to second CRC collection 55/23155/1
Vratko Polak [Thu, 31 Oct 2019 16:49:06 +0000 (17:49 +0100)]
Copy missing lines to second CRC collection

Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agoFramework: Add show log as tear down action 98/23098/2
Peter Mikus [Wed, 30 Oct 2019 14:29:49 +0000 (14:29 +0000)]
Framework: Add show log as tear down action

+ We can see what is happening when debug level is increased
+ Big caveat of VPP is that it does not allow to configure
  default global level.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0

6 weeks agoAdd: Use containers for shared TG 52/22052/10
Peter Mikus [Fri, 13 Sep 2019 12:00:49 +0000 (12:00 +0000)]
Add: Use containers for shared TG

+ Ansible
  + Service for auto load during restart
  + By default created 2 instances of Docker container
+ Small modification of Trex to use prefixes
+ DNV topology to use ssh port to connect to docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7

6 weeks agoFIX: IPSecHW 76/23076/1
Peter Mikus [Wed, 30 Oct 2019 06:59:57 +0000 (06:59 +0000)]
FIX: IPSecHW

- IPsec proto is not for GCM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If6a9721574a72dacb4486c837100e4f2ed2bab19

6 weeks agoAPI: Add collection for 21551/12 75/22875/4
Jan Gelety [Thu, 10 Oct 2019 09:50:19 +0000 (11:50 +0200)]
API: Add collection for 21551/12

Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 weeks agoTrafficGenerator: Skip only the first equals 29/23029/1
Vratko Polak [Mon, 28 Oct 2019 12:23:58 +0000 (13:23 +0100)]
TrafficGenerator: Skip only the first equals

HRDhistogram output contains essential trailing equals.
Edit all fields even though we do not expect equals in others.

Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agoPAL: Add sortable html table for comparisons 77/22477/7
Tibor Frank [Wed, 2 Oct 2019 11:07:19 +0000 (13:07 +0200)]
PAL: Add sortable html table for comparisons

Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agoFIX: Limitation for NICs 81/22981/3
Peter Mikus [Fri, 25 Oct 2019 12:41:10 +0000 (12:41 +0000)]
FIX: Limitation for NICs

Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 weeks agoADD: Mellanox RDMA interface support 29/22729/13
Peter Mikus [Tue, 15 Oct 2019 08:13:29 +0000 (08:13 +0000)]
ADD: Mellanox RDMA interface support

+ Add functions for creating rdma interface
+ Fix traffic generator

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1

7 weeks agoIntroduce pre-initialize driver layer 71/22871/20
Peter Mikus [Mon, 21 Oct 2019 08:49:59 +0000 (08:49 +0000)]
Introduce pre-initialize driver layer

+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5

7 weeks agoCRCs: Update comments and improve CSIT checks. 52/22152/17
Vratko Polak [Mon, 21 Oct 2019 12:58:16 +0000 (14:58 +0200)]
CRCs: Update comments and improve CSIT checks.

+ Restore alphabetic order in yaml.
+ Mark the lisp messages verified to be covered by dev instead of virl.
+ Mark the GBP messages verified by devicetest now.
+ Mark acl_add_replace as dev and create_subif as perf.
+ Mark ip_probe_neighbor as unused L1.
+ Improve loadbalancer comments.
  - Nat4 testcase is described, even if not merged yet.
+ Forget reported CRC after initial dir report,
  and report them again (once) in test cases (if hit).
  With this, single run (with fail on crc off) gives full info.
+ Small improvements to CRC library docstrings and messages.

Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoUpdate of VPP_STABLE_VER files 68/22868/1
Jan Gelety [Thu, 10 Oct 2019 05:40:49 +0000 (07:40 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~453-g349cd1a~b8252

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~453-g349cd1af7

 - use new vpp ref build - centos7:
   20.01-rc0~453_g349cd1a~b8066

Change-Id: I083e3b66fa52f4aab1883d0a9855d3be8c64c671
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 weeks agoTests: Introduce driver layer 43/22843/7
Peter Mikus [Fri, 18 Oct 2019 14:15:32 +0000 (14:15 +0000)]
Tests: Introduce driver layer

+ Small bugfixes in various suites

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab

8 weeks agoAutogen checker: Fix difference reporting branch 39/22839/1
Vratko Polak [Fri, 18 Oct 2019 13:34:51 +0000 (15:34 +0200)]
Autogen checker: Fix difference reporting branch

Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 weeks agoTrending: reduce input data 30/22830/1
Tibor Frank [Fri, 18 Oct 2019 10:20:18 +0000 (12:20 +0200)]
Trending: reduce input data

Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 weeks agoFIX: Migrate VPP device Centos image 34/22734/2
Peter Mikus [Tue, 15 Oct 2019 11:13:26 +0000 (11:13 +0000)]
FIX: Migrate VPP device Centos image

+ Migrate to new image

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib08c5169daac76b0b4c97da3faa40585aeafbc60

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.