csit.git
2 months agoAPI: Add collection for 21706/17 02/23902/2
Jan Gelety [Sat, 30 Nov 2019 14:33:21 +0000 (15:33 +0100)]
API: Add collection for 21706/17

Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 months agoCSIT-1597 API cleanup: classify 26/22526/8
Jan Gelety [Wed, 11 Sep 2019 17:49:29 +0000 (19:49 +0200)]
CSIT-1597 API cleanup: classify

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
  https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted

Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 months agoTrending: Add more NFV tests 05/23905/1
Tibor Frank [Tue, 10 Dec 2019 09:46:21 +0000 (10:46 +0100)]
Trending: Add more NFV tests

+ 10R2C, 6R4C
+ Tunnels

Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoPerpatch compare: avg_diff is not an int 86/23886/2
Vratko Polak [Mon, 9 Dec 2019 15:04:42 +0000 (16:04 +0100)]
Perpatch compare: avg_diff is not an int

Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoFIX: ip route config for ipsec via VAT 10/23810/21
Jan Gelety [Fri, 29 Nov 2019 13:29:53 +0000 (14:29 +0100)]
FIX: ip route config for ipsec via VAT

Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 months agoFIX: integer divisions 73/23873/3
Jan Gelety [Sat, 30 Nov 2019 05:47:45 +0000 (06:47 +0100)]
FIX: integer divisions

Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 months agoTrending: Use Mpps 77/23877/5
Tibor Frank [Mon, 9 Dec 2019 12:10:07 +0000 (13:10 +0100)]
Trending: Use Mpps

Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoTrending: Fix Alerts 75/23875/2
Tibor Frank [Mon, 9 Dec 2019 10:21:37 +0000 (11:21 +0100)]
Trending: Fix Alerts

Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoFixes: Report 72/23872/8
Tibor Frank [Mon, 9 Dec 2019 08:56:32 +0000 (09:56 +0100)]
Fixes: Report

- show run

Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoImprove quoting of asterisks 12/23812/4
Vratko Polak [Thu, 5 Dec 2019 16:07:24 +0000 (17:07 +0100)]
Improve quoting of asterisks

When quoted, the asterisks are understood as literal characters.
When unquoted, so they act as globs patterns.

When used to match files already present in the filesystem,
the asterisks should be unquoted.
When used to match a package name (not a file),
the asterisks should be quoted to prevent the bash expansion,
as programs such as apt-get and yum do their own expasion afterwards.

Unquoted asterisks for matching package names
may happen to work when there are no files to match the bash expansion,
but quoted asterisks are sure to avoid accidents.

Also, we want an asterisk both before and after "vpp",
due to package names such as libvppinfra-dev and python3-vpp-api.

Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoFIX: Some leftovers + csit_sut image sync 18/23818/1
Peter Mikus [Thu, 5 Dec 2019 16:06:40 +0000 (16:06 +0000)]
FIX: Some leftovers + csit_sut image sync

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942

2 months agoUse new gdb commands for core dump examination 94/23694/7
Vratko Polak [Fri, 29 Nov 2019 14:55:43 +0000 (15:55 +0100)]
Use new gdb commands for core dump examination

Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoFIX: Deal with some "pylint: disable=" comments 09/23809/1
Peter Mikus [Thu, 5 Dec 2019 07:08:11 +0000 (07:08 +0000)]
FIX: Deal with some "pylint: disable=" comments

Same rules for all

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iaf6b6313750d19132e2f2886e676100878719690

2 months agoDeal with some "pylint: disable=" comments 92/23692/5
Vratko Polak [Wed, 4 Dec 2019 12:24:07 +0000 (13:24 +0100)]
Deal with some "pylint: disable=" comments

+ When possible, fix the violation.
+ Else, add a comment:
  + An explanation (if not already present) and keep disable.
  + A TODO (if not already present) and remove the disable.
- This makes tox job report more pylint violations,
  but any such violation is fixable and should be fixed.
  - Although some need to be fixed in VPP, such as enum item long names.

Change-Id: I48604b5eda070083d79dff1439620dbd9e798e1f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoPython3: IPv4 FIB scale tests with random flows 65/23765/4
Balaji Venkatraman [Tue, 3 Dec 2019 18:05:28 +0000 (10:05 -0800)]
Python3:  IPv4 FIB scale tests with random flows

Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Change-Id: Iadd9e8da655f3ccbd36167c1bbee37a774c3bc1f
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
2 months agoTrending: Fix CLX plots 92/23792/1
Tibor Frank [Wed, 4 Dec 2019 15:02:30 +0000 (16:02 +0100)]
Trending: Fix CLX plots

Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoTrending: Fix CLX data set 89/23789/1
Tibor Frank [Wed, 4 Dec 2019 12:59:50 +0000 (13:59 +0100)]
Trending: Fix CLX data set

Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoTrending: Reorganization 41/22341/49
Tibor Frank [Fri, 27 Sep 2019 11:02:24 +0000 (13:02 +0200)]
Trending: Reorganization

+ use selection of tests by their full names
+ finalize trending_test_groups.md
+ modify static content
+ modify anchors
+ specifications:
  + container memif
  + ip4
  + ip4 tunnels
  + ip6
  + ipsec
  + l2
  + srv6
  + vhost
  + vts
  + dpdk
+ add 2n-clx
+ hyperlinks

Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate CRC for 21551/27 51/23651/4
Vratko Polak [Wed, 27 Nov 2019 13:04:05 +0000 (14:04 +0100)]
Update CRC for 21551/27

The previously prepared values for 21551/12
are not matching the newer patch sets.

Change-Id: I2ddfcfc96f3f1573b20889dd52e142cf39465f65
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoPAL: Add HDRHistogram graphs for latency 10/22210/78
Tibor Frank [Tue, 24 Sep 2019 09:00:05 +0000 (11:00 +0200)]
PAL: Add HDRHistogram graphs for latency

Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoChange startup show pci to show ver 85/23785/1
juraj.linkes [Fri, 29 Nov 2019 19:29:40 +0000 (20:29 +0100)]
Change startup show pci to show ver

When testing whether a socket is listetning, show pci results in a crash
on the Taishan platform. Temporarily work around this by changing it to
show ver.

Change-Id: Id0f995373bc2f429d59de200e51959b2da408052
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2 months agoRemove: VIRL 53/23753/3
Peter Mikus [Tue, 3 Dec 2019 12:53:24 +0000 (12:53 +0000)]
Remove: VIRL

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b

2 months agoFIX: Add ply also to global requirements 58/23758/2
Peter Mikus [Tue, 3 Dec 2019 15:00:13 +0000 (15:00 +0000)]
FIX: Add ply also to global requirements

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fca2c05377f94e9df8c3df1d8d735c25a84e538

2 months agoPython3: PAL 58/23558/50
Tibor Frank [Wed, 20 Nov 2019 10:43:44 +0000 (11:43 +0100)]
Python3: PAL

- files renamed:
  - utils.py --> pal_utils.py
  - errors.py --> pal_errors.py
- functions/methods renamed:
  - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name
  - plot_performance_box_name --> plot_perf_box_name
  - plot_latency_error_bars_name --> plot_lat_err_bars_name
  - plot_throughput_speedup_analysis_name --> plot_tsa_name
  - plot_service_density_heatmap --> plot_nf_heatmap
  - table_performance_comparison --> table_perf_comparison
  - table_performance_comparison_nic --> table_perf_comparison_nic
  - table_performance_trending_dashboard_html --> table_perf_trending_dash_html

- functions/methods removed:
  - plot_service_density_heatmap_compare
  - plot_throughput_speedup_analysis
  - plot_latency_error_bars
  - plot_soak_boxes
  - plot_soak_bars

Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoAPI: Add collection for 21551/27 50/23750/1
Jan Gelety [Fri, 29 Nov 2019 08:42:47 +0000 (09:42 +0100)]
API: Add collection for 21551/27

Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 months agoFIX: vxlan+vlan perf tests 23/23723/12
Jan Gelety [Fri, 29 Nov 2019 01:10:31 +0000 (02:10 +0100)]
FIX: vxlan+vlan perf tests

Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 months agoPython3: Vagrant update 48/23748/1
Peter Mikus [Tue, 3 Dec 2019 09:41:38 +0000 (09:41 +0000)]
Python3: Vagrant update

+ Small styling

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde

2 months agoUse Jumpavg 0.2.0 in PAL 37/23737/4
Vratko Polak [Mon, 2 Dec 2019 18:01:35 +0000 (19:01 +0100)]
Use Jumpavg 0.2.0 in PAL

+ As a side effect, PAL is now part of "resource" package tree.
- Testable only with 23558 (the rest of PAL Python 3 migration).

Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoRefactor jumpavg to be more readable and usable 65/23465/8
Vratko Polak [Mon, 2 Dec 2019 17:38:44 +0000 (18:38 +0100)]
Refactor jumpavg to be more readable and usable

This is the python3 change, the python2 is still used for testing bisect.

+ New version is 0.2.0 due to amount o API changes.
+ Jumpavg is now part of CSIT resource package tree.
+ Perpatch migrated to new jumpavg.
- PAL NOT updated (the update moved to a different Change).

Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoFIX: Perpatch PY3 25/23725/2
Peter Mikus [Mon, 2 Dec 2019 14:22:16 +0000 (14:22 +0000)]
FIX: Perpatch PY3

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab

3 months agoFIX: SRV6 proxy 18/23718/2
Jan Gelety [Thu, 28 Nov 2019 20:13:26 +0000 (21:13 +0100)]
FIX: SRV6 proxy

Change-Id: I4afbb0261c21c800bf24e423e505307f596c0045
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 months agoFIX: acl 10/23710/1
Jan Gelety [Thu, 28 Nov 2019 18:52:52 +0000 (19:52 +0100)]
FIX: acl

Change-Id: Ieb1569a1dce9fd7c00041ba00f72c67142a581ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 months agoConvert SRv6 from LXC to Docker 07/23707/2
Peter Mikus [Sun, 1 Dec 2019 07:07:06 +0000 (07:07 +0000)]
Convert SRv6 from LXC to Docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7c948be40aaf2eb03434cec5548a89aaf0f1eca6

2 months agoFIX: VAT terminal 06/23706/1
Peter Mikus [Sun, 1 Dec 2019 07:03:45 +0000 (07:03 +0000)]
FIX: VAT terminal

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I98fd62e6b5367b23694017d99a1dae7d893326c9

2 months agoFIX: IPsec naming creation 04/23704/2
Peter Mikus [Sat, 30 Nov 2019 17:27:08 +0000 (17:27 +0000)]
FIX: IPsec naming creation

Change-Id: I066a8b85649654c1c575eb63722de6c51f3d4f78
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 months agoPython3: resources and libraries 78/23478/78
Jan Gelety [Tue, 12 Nov 2019 04:27:43 +0000 (05:27 +0100)]
Python3: resources and libraries

Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 months agoPython3: PIP requirement 07/23207/30
Peter Mikus [Mon, 4 Nov 2019 09:27:28 +0000 (09:27 +0000)]
Python3: PIP requirement

- Install via PIP3
- Use virtualenv Python3 interpret

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3

3 months agoNSH_SFC: Remove 21/23421/2
Tibor Frank [Thu, 14 Nov 2019 09:06:03 +0000 (10:06 +0100)]
NSH_SFC: Remove

Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoHONEYCOMB: Remove 63/23363/4
Peter Mikus [Mon, 11 Nov 2019 16:14:32 +0000 (16:14 +0000)]
HONEYCOMB: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e

3 months agoImprove test tag string parsing 33/23433/9
Vratko Polak [Fri, 15 Nov 2019 16:27:43 +0000 (17:27 +0100)]
Improve test tag string parsing

Instead of just adding the missing -clx,
the new way aims to be forward compatible.

The new implementation is quite permissive,
ignoring all "word" chars sticking to the trigger word
and returning everything after that and space up to the endline.

+ Unified perftest and devicetest handling.
 + Consequently, triggers like "devicetest-1n-skx GBP" will work now.

Change-Id: I3bda6105195180d35a589a75318f569e36f03461
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoFIX: Ansible remove vpp 95/23495/1
Peter Mikus [Mon, 18 Nov 2019 09:13:38 +0000 (09:13 +0000)]
FIX: Ansible remove vpp

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409

3 months agoFIX: LXC Container directory initialization 67/23467/2
Peter Mikus [Fri, 15 Nov 2019 10:52:49 +0000 (10:52 +0000)]
FIX: LXC Container directory initialization

Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 months agoDoc: CSIT Python2 to Python3 migration plan proposal 38/22638/7
Jan Gelety [Fri, 4 Oct 2019 19:26:05 +0000 (21:26 +0200)]
Doc: CSIT Python2 to Python3 migration plan proposal

Change-Id: I0046ef57744d8d09117e850b60f9d65c7495ed07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 months agoCRC: Update comments after lb-nat4 tests 14/23414/3
Vratko Polak [Wed, 13 Nov 2019 16:44:41 +0000 (17:44 +0100)]
CRC: Update comments after lb-nat4 tests

Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoFIX: AVF IP6base 30/23430/1
Peter Mikus [Thu, 14 Nov 2019 14:51:54 +0000 (14:51 +0000)]
FIX: AVF IP6base

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc3350acab54100f03f540397bfcbd6e7455ea2c

3 months agoFIX: Ipsec perf 12/23412/22
Peter Mikus [Wed, 13 Nov 2019 14:37:51 +0000 (14:37 +0000)]
FIX: Ipsec perf

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0

3 months agoUpdate of VPP_STABLE_VER files 11/23411/2
Jan Gelety [Tue, 12 Nov 2019 05:58:51 +0000 (06:58 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~638-gea93e48cf

 - use new vpp ref build - centos7:
   20.01-rc0~638-gea93e48cf

Change-Id: Ib3ab491df32c73ca90178dcd21c3c4e6512371d4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 months agoLIGATO: Remove 04/23404/2
Peter Mikus [Wed, 13 Nov 2019 13:30:48 +0000 (13:30 +0000)]
LIGATO: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768

3 months agoFIX: missing param in gbp_contract_add_del 78/23378/8
Jan Gelety [Mon, 11 Nov 2019 18:39:06 +0000 (19:39 +0100)]
FIX: missing param in gbp_contract_add_del

Change-Id: I5c2354911505a9d7a95bef894eda8bf7b14b8dc8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 months agoFIX: Ansible container cleanup 00/23400/2
Peter Mikus [Wed, 13 Nov 2019 11:40:17 +0000 (11:40 +0000)]
FIX: Ansible container cleanup

Change-Id: I233baca48a3f01d1a206fd004b0503b0f1fad5d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 months agoFIX: Ansible cleanup permission 97/23397/2
Peter Mikus [Wed, 13 Nov 2019 10:46:16 +0000 (10:46 +0000)]
FIX: Ansible cleanup permission

Change-Id: Ia79558b579e70aa666e8f84230f4bd2cafb33569
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 months agoAdd vpp loadbalancer l3dsr/nat4 mode test suites 36/22636/7
haiyanx1.zhang [Thu, 10 Oct 2019 05:34:43 +0000 (05:34 +0000)]
Add vpp loadbalancer l3dsr/nat4 mode test suites

Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
3 months agoTrending: Input data 94/23394/1
Tibor Frank [Wed, 13 Nov 2019 09:12:39 +0000 (10:12 +0100)]
Trending: Input data

Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoNew weekly mrr trigger 41/23341/5
Jan Gelety [Thu, 7 Nov 2019 06:45:55 +0000 (07:45 +0100)]
New weekly mrr trigger

Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 months agoFIX: Supervisor initialization 72/23372/2
Peter Mikus [Tue, 12 Nov 2019 07:48:57 +0000 (07:48 +0000)]
FIX: Supervisor initialization

- Next step: remove supervisor entirely

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8

3 months agoRemove the leftovers of the old testbed cleanup 65/23365/2
Vratko Polak [Mon, 11 Nov 2019 17:19:30 +0000 (18:19 +0100)]
Remove the leftovers of the old testbed cleanup

Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoAdd accidentally deleted NAT setup command 60/23360/1
Vratko Polak [Mon, 11 Nov 2019 13:03:16 +0000 (14:03 +0100)]
Add accidentally deleted NAT setup command

One suite was missing "And Add NAT to all DUTs".

Change-Id: I6e9c3de9f236a080cfe829db2d155a6f6ba3b3f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoFIX: do not use ping in vpp-device tests 87/23287/15
Jan Gelety [Wed, 30 Oct 2019 03:52:03 +0000 (04:52 +0100)]
FIX: do not use ping in vpp-device tests

Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 months agoFIX: Paths for new Docker images 54/23354/2
Peter Mikus [Mon, 11 Nov 2019 08:35:03 +0000 (08:35 +0000)]
FIX: Paths for new Docker images

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50

3 months agoFIX: 2lbvpplacp 43/23343/2
Peter Mikus [Fri, 8 Nov 2019 16:03:49 +0000 (16:03 +0000)]
FIX: 2lbvpplacp

- These testcases are non standard so they need to be refactored
  to be able to use the interface layers

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9400846ff04f1864babd6d7fa153f0c3708cb105

3 months agoPrevent many TC triggered by bad tag expressions 16/23216/7
Vratko Polak [Fri, 8 Nov 2019 10:14:52 +0000 (11:14 +0100)]
Prevent many TC triggered by bad tag expressions

Typical example: Use multiple perftest lines in a comment.
Atypical example: Use perftest as an expression (without any ANDs).

Fix: Die if "perftest" is found in the tag expression (before prefixing).

Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoFIX: use correct NIC for mr-daily-master job 32/23332/1
Jan Gelety [Thu, 7 Nov 2019 02:30:47 +0000 (03:30 +0100)]
FIX: use correct NIC for mr-daily-master job

Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 months agoFIX: Small ansible fixes 30/23330/2
Peter Mikus [Fri, 8 Nov 2019 08:09:04 +0000 (08:09 +0000)]
FIX: Small ansible fixes

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2

3 months agoSource ansible.sh for entry scripts using cleanup 12/23312/1
Vratko Polak [Thu, 7 Nov 2019 13:13:45 +0000 (14:13 +0100)]
Source ansible.sh for entry scripts using cleanup

Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoCleanup via Ansible 52/22652/8
Peter Mikus [Thu, 10 Oct 2019 15:31:28 +0000 (15:31 +0000)]
Cleanup via Ansible

+ Remove dependency on topo_ scripts that depends on custom SSH()
  that depends on framework itself. This way the cleanup is independent
  of failure in our SSH libs.
+ Simple ansible command can do cleanup of a machine:
  ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \
  --limit '10.32.8.18' --tags 'cleanup'
+ Add vpp_device reset and cleanup.
+ Remove historical scripts.

- Still in testing beta phase.
  - Need to add SRIOV cleanup.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7

3 months agoTrending: Fix alerts 21/23221/1
Tibor Frank [Mon, 4 Nov 2019 14:50:18 +0000 (15:50 +0100)]
Trending: Fix alerts

Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoNew daily triggers 87/22987/4
Jan Gelety [Fri, 25 Oct 2019 13:16:46 +0000 (15:16 +0200)]
New daily triggers

New daily triggers defined based on requirements defined in
 https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md

Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 months agoRegularize spaces in crc list 57/23157/1
Vratko Polak [Thu, 31 Oct 2019 17:50:19 +0000 (18:50 +0100)]
Regularize spaces in crc list

Two spaces before hash if after quote, single space otherwise
(or 4 spaces if the hash is commenting out the whole line).

Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoCopy missing lines to second CRC collection 55/23155/1
Vratko Polak [Thu, 31 Oct 2019 16:49:06 +0000 (17:49 +0100)]
Copy missing lines to second CRC collection

Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoFramework: Add show log as tear down action 98/23098/2
Peter Mikus [Wed, 30 Oct 2019 14:29:49 +0000 (14:29 +0000)]
Framework: Add show log as tear down action

+ We can see what is happening when debug level is increased
+ Big caveat of VPP is that it does not allow to configure
  default global level.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0

3 months agoAdd: Use containers for shared TG 52/22052/10
Peter Mikus [Fri, 13 Sep 2019 12:00:49 +0000 (12:00 +0000)]
Add: Use containers for shared TG

+ Ansible
  + Service for auto load during restart
  + By default created 2 instances of Docker container
+ Small modification of Trex to use prefixes
+ DNV topology to use ssh port to connect to docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7

3 months agoFIX: IPSecHW 76/23076/1
Peter Mikus [Wed, 30 Oct 2019 06:59:57 +0000 (06:59 +0000)]
FIX: IPSecHW

- IPsec proto is not for GCM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If6a9721574a72dacb4486c837100e4f2ed2bab19

4 months agoAPI: Add collection for 21551/12 75/22875/4
Jan Gelety [Thu, 10 Oct 2019 09:50:19 +0000 (11:50 +0200)]
API: Add collection for 21551/12

Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 months agoTrafficGenerator: Skip only the first equals 29/23029/1
Vratko Polak [Mon, 28 Oct 2019 12:23:58 +0000 (13:23 +0100)]
TrafficGenerator: Skip only the first equals

HRDhistogram output contains essential trailing equals.
Edit all fields even though we do not expect equals in others.

Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoPAL: Add sortable html table for comparisons 77/22477/7
Tibor Frank [Wed, 2 Oct 2019 11:07:19 +0000 (13:07 +0200)]
PAL: Add sortable html table for comparisons

Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoFIX: Limitation for NICs 81/22981/3
Peter Mikus [Fri, 25 Oct 2019 12:41:10 +0000 (12:41 +0000)]
FIX: Limitation for NICs

Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 months agoADD: Mellanox RDMA interface support 29/22729/13
Peter Mikus [Tue, 15 Oct 2019 08:13:29 +0000 (08:13 +0000)]
ADD: Mellanox RDMA interface support

+ Add functions for creating rdma interface
+ Fix traffic generator

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1

4 months agoIntroduce pre-initialize driver layer 71/22871/20
Peter Mikus [Mon, 21 Oct 2019 08:49:59 +0000 (08:49 +0000)]
Introduce pre-initialize driver layer

+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5

4 months agoCRCs: Update comments and improve CSIT checks. 52/22152/17
Vratko Polak [Mon, 21 Oct 2019 12:58:16 +0000 (14:58 +0200)]
CRCs: Update comments and improve CSIT checks.

+ Restore alphabetic order in yaml.
+ Mark the lisp messages verified to be covered by dev instead of virl.
+ Mark the GBP messages verified by devicetest now.
+ Mark acl_add_replace as dev and create_subif as perf.
+ Mark ip_probe_neighbor as unused L1.
+ Improve loadbalancer comments.
  - Nat4 testcase is described, even if not merged yet.
+ Forget reported CRC after initial dir report,
  and report them again (once) in test cases (if hit).
  With this, single run (with fail on crc off) gives full info.
+ Small improvements to CRC library docstrings and messages.

Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoUpdate of VPP_STABLE_VER files 68/22868/1
Jan Gelety [Thu, 10 Oct 2019 05:40:49 +0000 (07:40 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~453-g349cd1a~b8252

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~453-g349cd1af7

 - use new vpp ref build - centos7:
   20.01-rc0~453_g349cd1a~b8066

Change-Id: I083e3b66fa52f4aab1883d0a9855d3be8c64c671
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 months agoTests: Introduce driver layer 43/22843/7
Peter Mikus [Fri, 18 Oct 2019 14:15:32 +0000 (14:15 +0000)]
Tests: Introduce driver layer

+ Small bugfixes in various suites

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab

4 months agoAutogen checker: Fix difference reporting branch 39/22839/1
Vratko Polak [Fri, 18 Oct 2019 13:34:51 +0000 (15:34 +0200)]
Autogen checker: Fix difference reporting branch

Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoTrending: reduce input data 30/22830/1
Tibor Frank [Fri, 18 Oct 2019 10:20:18 +0000 (12:20 +0200)]
Trending: reduce input data

Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoFIX: Migrate VPP device Centos image 34/22734/2
Peter Mikus [Tue, 15 Oct 2019 11:13:26 +0000 (11:13 +0000)]
FIX: Migrate VPP device Centos image

+ Migrate to new image

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib08c5169daac76b0b4c97da3faa40585aeafbc60

4 months agoAnsible: Role cleanup 82/22782/4
Peter Mikus [Wed, 16 Oct 2019 16:25:41 +0000 (16:25 +0000)]
Ansible: Role cleanup

+ Separate and reuse role (better naming)
+ Cleanup in naming
+ Introduce defaults that can be overriden

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iedaf7caba1d05a35a6f61cd21a483cdbc0073d32

4 months agoCore-keeper: Process files instead transfer 31/22731/4
Peter Mikus [Tue, 15 Oct 2019 09:43:19 +0000 (09:43 +0000)]
Core-keeper: Process files instead transfer

+ Instead of transferring large files, post-process directly
  via CSIT. Extract backtrace as a start point.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I79ad760d310c95d807242ad1997dd657d5142459

4 months agoAnsible: Clean Python requirements 67/22767/2
Peter Mikus [Wed, 16 Oct 2019 10:56:16 +0000 (10:56 +0000)]
Ansible: Clean Python requirements

+ minor cleanup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iff9c643f6e9b52dc6a11b04624452f115f3a834e

4 months agoVPPD: GBP test case 95/21195/7
Peter Mikus [Fri, 9 Aug 2019 12:57:00 +0000 (12:57 +0000)]
VPPD: GBP test case

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d

4 months agoAnsible: Mellanox install 18/22718/2
Peter Mikus [Mon, 14 Oct 2019 13:13:46 +0000 (13:13 +0000)]
Ansible: Mellanox install

+ OFED
+ ibdev2netdev
- aligning few naming conventions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4

4 months agoAdd: Parsing of show run over PAPI 05/22605/4
Peter Mikus [Tue, 8 Oct 2019 12:42:35 +0000 (12:42 +0000)]
Add: Parsing of show run over PAPI

+ Add parsing of show run over PAPI STATS
+ Add missing outputs vs show run over CLI

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4

4 months agoTrending: Reorganization of tests in graphs 04/22604/3
Tibor Frank [Tue, 8 Oct 2019 12:35:05 +0000 (14:35 +0200)]
Trending: Reorganization of tests in graphs

Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoTrending: Generate email body for regressions and progressions 41/22641/5
Tibor Frank [Thu, 10 Oct 2019 09:52:22 +0000 (11:52 +0200)]
Trending: Generate email body for regressions and progressions

Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoUpdate of VPP_STABLE_VER files 43/22643/1
Jan Gelety [Wed, 9 Oct 2019 20:16:31 +0000 (22:16 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~375-g3ae9f5a~b8172

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~375-g3ae9f5a90

 - use new vpp ref build - centos7:
   20.01-rc0~375_g3ae9f5a~b7986

Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 months agoFIX: Ansible 18/22618/3
Peter Mikus [Wed, 9 Oct 2019 10:03:04 +0000 (10:03 +0000)]
FIX: Ansible

+ Cover all CSIT devices with netplan to prevent DHCP usage
+ Move netplan to common role

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846

4 months agoAdd vpp loadbalancer maglev mode test suite 77/22077/17
haiyanX1.zhang [Tue, 17 Sep 2019 03:00:26 +0000 (03:00 +0000)]
Add vpp loadbalancer maglev mode test suite

Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
4 months agoFIX: Add SRIOV cleanup 82/22582/6
Peter Mikus [Mon, 7 Oct 2019 13:40:49 +0000 (13:40 +0000)]
FIX: Add SRIOV cleanup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf

4 months agoTrending: Send alerts when regression occurs 17/22517/10 ipsec-191009
Tibor Frank [Fri, 4 Oct 2019 08:41:00 +0000 (10:41 +0200)]
Trending: Send alerts when regression occurs

Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoFIX: LXC tmpfs mount 81/22581/2
Peter Mikus [Mon, 7 Oct 2019 13:37:06 +0000 (13:37 +0000)]
FIX: LXC tmpfs mount

- Should fix the read/write to socket for LXC

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98

4 months agoFIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant 72/22572/1
Jan Gelety [Fri, 4 Oct 2019 03:06:06 +0000 (05:06 +0200)]
FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant

Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 months agoUpdate of VPP_STABLE_VER files 93/22393/12
Jan Gelety [Thu, 26 Sep 2019 07:23:57 +0000 (09:23 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~324-g66a332c~b8122

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~324-g66a332cf1

 - use new vpp ref build - centos7:
   20.01-rc0~324_g66a332c~b7936

Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.