csit.git
2 years agoTrending: Reorganization 41/22341/49
Tibor Frank [Fri, 27 Sep 2019 11:02:24 +0000 (13:02 +0200)]
Trending: Reorganization

+ use selection of tests by their full names
+ finalize trending_test_groups.md
+ modify static content
+ modify anchors
+ specifications:
  + container memif
  + ip4
  + ip4 tunnels
  + ip6
  + ipsec
  + l2
  + srv6
  + vhost
  + vts
  + dpdk
+ add 2n-clx
+ hyperlinks

Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate CRC for 21551/27 51/23651/4
Vratko Polak [Wed, 27 Nov 2019 13:04:05 +0000 (14:04 +0100)]
Update CRC for 21551/27

The previously prepared values for 21551/12
are not matching the newer patch sets.

Change-Id: I2ddfcfc96f3f1573b20889dd52e142cf39465f65
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoPAL: Add HDRHistogram graphs for latency 10/22210/78
Tibor Frank [Tue, 24 Sep 2019 09:00:05 +0000 (11:00 +0200)]
PAL: Add HDRHistogram graphs for latency

Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoChange startup show pci to show ver 85/23785/1
juraj.linkes [Fri, 29 Nov 2019 19:29:40 +0000 (20:29 +0100)]
Change startup show pci to show ver

When testing whether a socket is listetning, show pci results in a crash
on the Taishan platform. Temporarily work around this by changing it to
show ver.

Change-Id: Id0f995373bc2f429d59de200e51959b2da408052
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2 years agoRemove: VIRL 53/23753/3
Peter Mikus [Tue, 3 Dec 2019 12:53:24 +0000 (12:53 +0000)]
Remove: VIRL

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b

2 years agoFIX: Add ply also to global requirements 58/23758/2
Peter Mikus [Tue, 3 Dec 2019 15:00:13 +0000 (15:00 +0000)]
FIX: Add ply also to global requirements

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fca2c05377f94e9df8c3df1d8d735c25a84e538

2 years agoPython3: PAL 58/23558/50
Tibor Frank [Wed, 20 Nov 2019 10:43:44 +0000 (11:43 +0100)]
Python3: PAL

- files renamed:
  - utils.py --> pal_utils.py
  - errors.py --> pal_errors.py
- functions/methods renamed:
  - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name
  - plot_performance_box_name --> plot_perf_box_name
  - plot_latency_error_bars_name --> plot_lat_err_bars_name
  - plot_throughput_speedup_analysis_name --> plot_tsa_name
  - plot_service_density_heatmap --> plot_nf_heatmap
  - table_performance_comparison --> table_perf_comparison
  - table_performance_comparison_nic --> table_perf_comparison_nic
  - table_performance_trending_dashboard_html --> table_perf_trending_dash_html

- functions/methods removed:
  - plot_service_density_heatmap_compare
  - plot_throughput_speedup_analysis
  - plot_latency_error_bars
  - plot_soak_boxes
  - plot_soak_bars

Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoAPI: Add collection for 21551/27 50/23750/1
Jan Gelety [Fri, 29 Nov 2019 08:42:47 +0000 (09:42 +0100)]
API: Add collection for 21551/27

Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: vxlan+vlan perf tests 23/23723/12
Jan Gelety [Fri, 29 Nov 2019 01:10:31 +0000 (02:10 +0100)]
FIX: vxlan+vlan perf tests

Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoPython3: Vagrant update 48/23748/1
Peter Mikus [Tue, 3 Dec 2019 09:41:38 +0000 (09:41 +0000)]
Python3: Vagrant update

+ Small styling

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde

2 years agoUse Jumpavg 0.2.0 in PAL 37/23737/4
Vratko Polak [Mon, 2 Dec 2019 18:01:35 +0000 (19:01 +0100)]
Use Jumpavg 0.2.0 in PAL

+ As a side effect, PAL is now part of "resource" package tree.
- Testable only with 23558 (the rest of PAL Python 3 migration).

Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoRefactor jumpavg to be more readable and usable 65/23465/8
Vratko Polak [Mon, 2 Dec 2019 17:38:44 +0000 (18:38 +0100)]
Refactor jumpavg to be more readable and usable

This is the python3 change, the python2 is still used for testing bisect.

+ New version is 0.2.0 due to amount o API changes.
+ Jumpavg is now part of CSIT resource package tree.
+ Perpatch migrated to new jumpavg.
- PAL NOT updated (the update moved to a different Change).

Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFIX: Perpatch PY3 25/23725/2
Peter Mikus [Mon, 2 Dec 2019 14:22:16 +0000 (14:22 +0000)]
FIX: Perpatch PY3

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab

2 years agoFIX: SRV6 proxy 18/23718/2
Jan Gelety [Thu, 28 Nov 2019 20:13:26 +0000 (21:13 +0100)]
FIX: SRV6 proxy

Change-Id: I4afbb0261c21c800bf24e423e505307f596c0045
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: acl 10/23710/1
Jan Gelety [Thu, 28 Nov 2019 18:52:52 +0000 (19:52 +0100)]
FIX: acl

Change-Id: Ieb1569a1dce9fd7c00041ba00f72c67142a581ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoConvert SRv6 from LXC to Docker 07/23707/2
Peter Mikus [Sun, 1 Dec 2019 07:07:06 +0000 (07:07 +0000)]
Convert SRv6 from LXC to Docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7c948be40aaf2eb03434cec5548a89aaf0f1eca6

2 years agoFIX: VAT terminal 06/23706/1
Peter Mikus [Sun, 1 Dec 2019 07:03:45 +0000 (07:03 +0000)]
FIX: VAT terminal

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I98fd62e6b5367b23694017d99a1dae7d893326c9

2 years agoFIX: IPsec naming creation 04/23704/2
Peter Mikus [Sat, 30 Nov 2019 17:27:08 +0000 (17:27 +0000)]
FIX: IPsec naming creation

Change-Id: I066a8b85649654c1c575eb63722de6c51f3d4f78
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoPython3: resources and libraries 78/23478/78
Jan Gelety [Tue, 12 Nov 2019 04:27:43 +0000 (05:27 +0100)]
Python3: resources and libraries

Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoPython3: PIP requirement 07/23207/30
Peter Mikus [Mon, 4 Nov 2019 09:27:28 +0000 (09:27 +0000)]
Python3: PIP requirement

- Install via PIP3
- Use virtualenv Python3 interpret

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3

2 years agoNSH_SFC: Remove 21/23421/2
Tibor Frank [Thu, 14 Nov 2019 09:06:03 +0000 (10:06 +0100)]
NSH_SFC: Remove

Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHONEYCOMB: Remove 63/23363/4
Peter Mikus [Mon, 11 Nov 2019 16:14:32 +0000 (16:14 +0000)]
HONEYCOMB: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e

2 years agoImprove test tag string parsing 33/23433/9
Vratko Polak [Fri, 15 Nov 2019 16:27:43 +0000 (17:27 +0100)]
Improve test tag string parsing

Instead of just adding the missing -clx,
the new way aims to be forward compatible.

The new implementation is quite permissive,
ignoring all "word" chars sticking to the trigger word
and returning everything after that and space up to the endline.

+ Unified perftest and devicetest handling.
 + Consequently, triggers like "devicetest-1n-skx GBP" will work now.

Change-Id: I3bda6105195180d35a589a75318f569e36f03461
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFIX: Ansible remove vpp 95/23495/1
Peter Mikus [Mon, 18 Nov 2019 09:13:38 +0000 (09:13 +0000)]
FIX: Ansible remove vpp

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409

2 years agoFIX: LXC Container directory initialization 67/23467/2
Peter Mikus [Fri, 15 Nov 2019 10:52:49 +0000 (10:52 +0000)]
FIX: LXC Container directory initialization

Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoDoc: CSIT Python2 to Python3 migration plan proposal 38/22638/7
Jan Gelety [Fri, 4 Oct 2019 19:26:05 +0000 (21:26 +0200)]
Doc: CSIT Python2 to Python3 migration plan proposal

Change-Id: I0046ef57744d8d09117e850b60f9d65c7495ed07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCRC: Update comments after lb-nat4 tests 14/23414/3
Vratko Polak [Wed, 13 Nov 2019 16:44:41 +0000 (17:44 +0100)]
CRC: Update comments after lb-nat4 tests

Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFIX: AVF IP6base 30/23430/1
Peter Mikus [Thu, 14 Nov 2019 14:51:54 +0000 (14:51 +0000)]
FIX: AVF IP6base

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc3350acab54100f03f540397bfcbd6e7455ea2c

2 years agoFIX: Ipsec perf 12/23412/22
Peter Mikus [Wed, 13 Nov 2019 14:37:51 +0000 (14:37 +0000)]
FIX: Ipsec perf

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0

2 years agoUpdate of VPP_STABLE_VER files 11/23411/2
Jan Gelety [Tue, 12 Nov 2019 05:58:51 +0000 (06:58 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~638-gea93e48cf

 - use new vpp ref build - centos7:
   20.01-rc0~638-gea93e48cf

Change-Id: Ib3ab491df32c73ca90178dcd21c3c4e6512371d4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoLIGATO: Remove 04/23404/2
Peter Mikus [Wed, 13 Nov 2019 13:30:48 +0000 (13:30 +0000)]
LIGATO: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768

2 years agoFIX: missing param in gbp_contract_add_del 78/23378/8
Jan Gelety [Mon, 11 Nov 2019 18:39:06 +0000 (19:39 +0100)]
FIX: missing param in gbp_contract_add_del

Change-Id: I5c2354911505a9d7a95bef894eda8bf7b14b8dc8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: Ansible container cleanup 00/23400/2
Peter Mikus [Wed, 13 Nov 2019 11:40:17 +0000 (11:40 +0000)]
FIX: Ansible container cleanup

Change-Id: I233baca48a3f01d1a206fd004b0503b0f1fad5d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFIX: Ansible cleanup permission 97/23397/2
Peter Mikus [Wed, 13 Nov 2019 10:46:16 +0000 (10:46 +0000)]
FIX: Ansible cleanup permission

Change-Id: Ia79558b579e70aa666e8f84230f4bd2cafb33569
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoAdd vpp loadbalancer l3dsr/nat4 mode test suites 36/22636/7
haiyanx1.zhang [Thu, 10 Oct 2019 05:34:43 +0000 (05:34 +0000)]
Add vpp loadbalancer l3dsr/nat4 mode test suites

Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
2 years agoTrending: Input data 94/23394/1
Tibor Frank [Wed, 13 Nov 2019 09:12:39 +0000 (10:12 +0100)]
Trending: Input data

Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoNew weekly mrr trigger 41/23341/5
Jan Gelety [Thu, 7 Nov 2019 06:45:55 +0000 (07:45 +0100)]
New weekly mrr trigger

Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: Supervisor initialization 72/23372/2
Peter Mikus [Tue, 12 Nov 2019 07:48:57 +0000 (07:48 +0000)]
FIX: Supervisor initialization

- Next step: remove supervisor entirely

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8

2 years agoRemove the leftovers of the old testbed cleanup 65/23365/2
Vratko Polak [Mon, 11 Nov 2019 17:19:30 +0000 (18:19 +0100)]
Remove the leftovers of the old testbed cleanup

Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoAdd accidentally deleted NAT setup command 60/23360/1
Vratko Polak [Mon, 11 Nov 2019 13:03:16 +0000 (14:03 +0100)]
Add accidentally deleted NAT setup command

One suite was missing "And Add NAT to all DUTs".

Change-Id: I6e9c3de9f236a080cfe829db2d155a6f6ba3b3f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFIX: do not use ping in vpp-device tests 87/23287/15
Jan Gelety [Wed, 30 Oct 2019 03:52:03 +0000 (04:52 +0100)]
FIX: do not use ping in vpp-device tests

Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: Paths for new Docker images 54/23354/2
Peter Mikus [Mon, 11 Nov 2019 08:35:03 +0000 (08:35 +0000)]
FIX: Paths for new Docker images

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50

2 years agoFIX: 2lbvpplacp 43/23343/2
Peter Mikus [Fri, 8 Nov 2019 16:03:49 +0000 (16:03 +0000)]
FIX: 2lbvpplacp

- These testcases are non standard so they need to be refactored
  to be able to use the interface layers

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9400846ff04f1864babd6d7fa153f0c3708cb105

2 years agoPrevent many TC triggered by bad tag expressions 16/23216/7
Vratko Polak [Fri, 8 Nov 2019 10:14:52 +0000 (11:14 +0100)]
Prevent many TC triggered by bad tag expressions

Typical example: Use multiple perftest lines in a comment.
Atypical example: Use perftest as an expression (without any ANDs).

Fix: Die if "perftest" is found in the tag expression (before prefixing).

Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFIX: use correct NIC for mr-daily-master job 32/23332/1
Jan Gelety [Thu, 7 Nov 2019 02:30:47 +0000 (03:30 +0100)]
FIX: use correct NIC for mr-daily-master job

Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: Small ansible fixes 30/23330/2
Peter Mikus [Fri, 8 Nov 2019 08:09:04 +0000 (08:09 +0000)]
FIX: Small ansible fixes

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2

2 years agoSource ansible.sh for entry scripts using cleanup 12/23312/1
Vratko Polak [Thu, 7 Nov 2019 13:13:45 +0000 (14:13 +0100)]
Source ansible.sh for entry scripts using cleanup

Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCleanup via Ansible 52/22652/8
Peter Mikus [Thu, 10 Oct 2019 15:31:28 +0000 (15:31 +0000)]
Cleanup via Ansible

+ Remove dependency on topo_ scripts that depends on custom SSH()
  that depends on framework itself. This way the cleanup is independent
  of failure in our SSH libs.
+ Simple ansible command can do cleanup of a machine:
  ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \
  --limit '10.32.8.18' --tags 'cleanup'
+ Add vpp_device reset and cleanup.
+ Remove historical scripts.

- Still in testing beta phase.
  - Need to add SRIOV cleanup.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7

2 years agoTrending: Fix alerts 21/23221/1
Tibor Frank [Mon, 4 Nov 2019 14:50:18 +0000 (15:50 +0100)]
Trending: Fix alerts

Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoNew daily triggers 87/22987/4
Jan Gelety [Fri, 25 Oct 2019 13:16:46 +0000 (15:16 +0200)]
New daily triggers

New daily triggers defined based on requirements defined in
 https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md

Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoRegularize spaces in crc list 57/23157/1
Vratko Polak [Thu, 31 Oct 2019 17:50:19 +0000 (18:50 +0100)]
Regularize spaces in crc list

Two spaces before hash if after quote, single space otherwise
(or 4 spaces if the hash is commenting out the whole line).

Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCopy missing lines to second CRC collection 55/23155/1
Vratko Polak [Thu, 31 Oct 2019 16:49:06 +0000 (17:49 +0100)]
Copy missing lines to second CRC collection

Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFramework: Add show log as tear down action 98/23098/2
Peter Mikus [Wed, 30 Oct 2019 14:29:49 +0000 (14:29 +0000)]
Framework: Add show log as tear down action

+ We can see what is happening when debug level is increased
+ Big caveat of VPP is that it does not allow to configure
  default global level.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0

2 years agoAdd: Use containers for shared TG 52/22052/10
Peter Mikus [Fri, 13 Sep 2019 12:00:49 +0000 (12:00 +0000)]
Add: Use containers for shared TG

+ Ansible
  + Service for auto load during restart
  + By default created 2 instances of Docker container
+ Small modification of Trex to use prefixes
+ DNV topology to use ssh port to connect to docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7

2 years agoFIX: IPSecHW 76/23076/1
Peter Mikus [Wed, 30 Oct 2019 06:59:57 +0000 (06:59 +0000)]
FIX: IPSecHW

- IPsec proto is not for GCM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If6a9721574a72dacb4486c837100e4f2ed2bab19

2 years agoAPI: Add collection for 21551/12 75/22875/4
Jan Gelety [Thu, 10 Oct 2019 09:50:19 +0000 (11:50 +0200)]
API: Add collection for 21551/12

Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoTrafficGenerator: Skip only the first equals 29/23029/1
Vratko Polak [Mon, 28 Oct 2019 12:23:58 +0000 (13:23 +0100)]
TrafficGenerator: Skip only the first equals

HRDhistogram output contains essential trailing equals.
Edit all fields even though we do not expect equals in others.

Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoPAL: Add sortable html table for comparisons 77/22477/7
Tibor Frank [Wed, 2 Oct 2019 11:07:19 +0000 (13:07 +0200)]
PAL: Add sortable html table for comparisons

Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: Limitation for NICs 81/22981/3
Peter Mikus [Fri, 25 Oct 2019 12:41:10 +0000 (12:41 +0000)]
FIX: Limitation for NICs

Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoADD: Mellanox RDMA interface support 29/22729/13
Peter Mikus [Tue, 15 Oct 2019 08:13:29 +0000 (08:13 +0000)]
ADD: Mellanox RDMA interface support

+ Add functions for creating rdma interface
+ Fix traffic generator

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1

2 years agoIntroduce pre-initialize driver layer 71/22871/20
Peter Mikus [Mon, 21 Oct 2019 08:49:59 +0000 (08:49 +0000)]
Introduce pre-initialize driver layer

+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5

2 years agoCRCs: Update comments and improve CSIT checks. 52/22152/17
Vratko Polak [Mon, 21 Oct 2019 12:58:16 +0000 (14:58 +0200)]
CRCs: Update comments and improve CSIT checks.

+ Restore alphabetic order in yaml.
+ Mark the lisp messages verified to be covered by dev instead of virl.
+ Mark the GBP messages verified by devicetest now.
+ Mark acl_add_replace as dev and create_subif as perf.
+ Mark ip_probe_neighbor as unused L1.
+ Improve loadbalancer comments.
  - Nat4 testcase is described, even if not merged yet.
+ Forget reported CRC after initial dir report,
  and report them again (once) in test cases (if hit).
  With this, single run (with fail on crc off) gives full info.
+ Small improvements to CRC library docstrings and messages.

Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoUpdate of VPP_STABLE_VER files 68/22868/1
Jan Gelety [Thu, 10 Oct 2019 05:40:49 +0000 (07:40 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~453-g349cd1a~b8252

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~453-g349cd1af7

 - use new vpp ref build - centos7:
   20.01-rc0~453_g349cd1a~b8066

Change-Id: I083e3b66fa52f4aab1883d0a9855d3be8c64c671
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoTests: Introduce driver layer 43/22843/7
Peter Mikus [Fri, 18 Oct 2019 14:15:32 +0000 (14:15 +0000)]
Tests: Introduce driver layer

+ Small bugfixes in various suites

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab

2 years agoAutogen checker: Fix difference reporting branch 39/22839/1
Vratko Polak [Fri, 18 Oct 2019 13:34:51 +0000 (15:34 +0200)]
Autogen checker: Fix difference reporting branch

Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTrending: reduce input data 30/22830/1
Tibor Frank [Fri, 18 Oct 2019 10:20:18 +0000 (12:20 +0200)]
Trending: reduce input data

Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: Migrate VPP device Centos image 34/22734/2
Peter Mikus [Tue, 15 Oct 2019 11:13:26 +0000 (11:13 +0000)]
FIX: Migrate VPP device Centos image

+ Migrate to new image

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib08c5169daac76b0b4c97da3faa40585aeafbc60

2 years agoAnsible: Role cleanup 82/22782/4
Peter Mikus [Wed, 16 Oct 2019 16:25:41 +0000 (16:25 +0000)]
Ansible: Role cleanup

+ Separate and reuse role (better naming)
+ Cleanup in naming
+ Introduce defaults that can be overriden

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iedaf7caba1d05a35a6f61cd21a483cdbc0073d32

2 years agoCore-keeper: Process files instead transfer 31/22731/4
Peter Mikus [Tue, 15 Oct 2019 09:43:19 +0000 (09:43 +0000)]
Core-keeper: Process files instead transfer

+ Instead of transferring large files, post-process directly
  via CSIT. Extract backtrace as a start point.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I79ad760d310c95d807242ad1997dd657d5142459

2 years agoAnsible: Clean Python requirements 67/22767/2
Peter Mikus [Wed, 16 Oct 2019 10:56:16 +0000 (10:56 +0000)]
Ansible: Clean Python requirements

+ minor cleanup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iff9c643f6e9b52dc6a11b04624452f115f3a834e

2 years agoVPPD: GBP test case 95/21195/7
Peter Mikus [Fri, 9 Aug 2019 12:57:00 +0000 (12:57 +0000)]
VPPD: GBP test case

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d

2 years agoAnsible: Mellanox install 18/22718/2
Peter Mikus [Mon, 14 Oct 2019 13:13:46 +0000 (13:13 +0000)]
Ansible: Mellanox install

+ OFED
+ ibdev2netdev
- aligning few naming conventions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4

2 years agoAdd: Parsing of show run over PAPI 05/22605/4
Peter Mikus [Tue, 8 Oct 2019 12:42:35 +0000 (12:42 +0000)]
Add: Parsing of show run over PAPI

+ Add parsing of show run over PAPI STATS
+ Add missing outputs vs show run over CLI

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4

2 years agoTrending: Reorganization of tests in graphs 04/22604/3
Tibor Frank [Tue, 8 Oct 2019 12:35:05 +0000 (14:35 +0200)]
Trending: Reorganization of tests in graphs

Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrending: Generate email body for regressions and progressions 41/22641/5
Tibor Frank [Thu, 10 Oct 2019 09:52:22 +0000 (11:52 +0200)]
Trending: Generate email body for regressions and progressions

Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate of VPP_STABLE_VER files 43/22643/1
Jan Gelety [Wed, 9 Oct 2019 20:16:31 +0000 (22:16 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~375-g3ae9f5a~b8172

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~375-g3ae9f5a90

 - use new vpp ref build - centos7:
   20.01-rc0~375_g3ae9f5a~b7986

Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: Ansible 18/22618/3
Peter Mikus [Wed, 9 Oct 2019 10:03:04 +0000 (10:03 +0000)]
FIX: Ansible

+ Cover all CSIT devices with netplan to prevent DHCP usage
+ Move netplan to common role

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846

2 years agoAdd vpp loadbalancer maglev mode test suite 77/22077/17
haiyanX1.zhang [Tue, 17 Sep 2019 03:00:26 +0000 (03:00 +0000)]
Add vpp loadbalancer maglev mode test suite

Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
2 years agoFIX: Add SRIOV cleanup 82/22582/6
Peter Mikus [Mon, 7 Oct 2019 13:40:49 +0000 (13:40 +0000)]
FIX: Add SRIOV cleanup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf

2 years agoTrending: Send alerts when regression occurs 17/22517/10
Tibor Frank [Fri, 4 Oct 2019 08:41:00 +0000 (10:41 +0200)]
Trending: Send alerts when regression occurs

Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: LXC tmpfs mount 81/22581/2
Peter Mikus [Mon, 7 Oct 2019 13:37:06 +0000 (13:37 +0000)]
FIX: LXC tmpfs mount

- Should fix the read/write to socket for LXC

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98

2 years agoFIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant 72/22572/1
Jan Gelety [Fri, 4 Oct 2019 03:06:06 +0000 (05:06 +0200)]
FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant

Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoUpdate of VPP_STABLE_VER files 93/22393/12
Jan Gelety [Thu, 26 Sep 2019 07:23:57 +0000 (09:23 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~324-g66a332c~b8122

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~324-g66a332cf1

 - use new vpp ref build - centos7:
   20.01-rc0~324_g66a332c~b7936

Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoReport: Set the backgroud of graphs 61/22561/1
Tibor Frank [Mon, 7 Oct 2019 07:17:59 +0000 (09:17 +0200)]
Report: Set the backgroud of graphs

Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: Add SRIOV cleanup 24/22524/2
Peter Mikus [Fri, 4 Oct 2019 10:15:18 +0000 (10:15 +0000)]
FIX: Add SRIOV cleanup

If Jenkins interrupt pybot during AVF tests (that is happening
more frequently as coverage increased) the interfaces remains
in link UP state. Next run VPP cannot grab interfaces as they
are in UP state in and kernel driver. This results in testcase
failing.

Patch is supposed to do put interfaces in topology down so VPP
can bind them back to vfio-pci.

Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFIX: use int of sw_if_index in call of sw_interface_set_flags api 18/22518/2
Jan Gelety [Thu, 3 Oct 2019 17:42:34 +0000 (19:42 +0200)]
FIX: use int of sw_if_index in call of sw_interface_set_flags api

- it will avoid situation that corresponding port is not up and
  its sw_if_index value in topology file is None that is interpreted
  as 0 in vpp api so it set flag for local0 interface

Change-Id: I9145077d787ddde50a29bcd4091035e95077f946
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: IPv6 AVF dot1q 16/22516/2
Peter Mikus [Fri, 4 Oct 2019 08:24:53 +0000 (08:24 +0000)]
FIX: IPv6 AVF dot1q

Change-Id: Id199eb774850153fb225434d4a3d194706fdfdb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoTrending: Report also nr of passed tests in email 78/22478/5
Tibor Frank [Wed, 2 Oct 2019 12:03:57 +0000 (14:03 +0200)]
Trending: Report also nr of passed tests in email

Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Set plot.ly version to 4.1.1 38/22338/6
Tibor Frank [Fri, 27 Sep 2019 08:35:51 +0000 (10:35 +0200)]
PAL: Set plot.ly version to 4.1.1

Change-Id: I137ee807a2802fa1f7b5b635e1162bf7fff07a57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Accept reconf time in scientific notation 87/22487/1
Vratko Polak [Wed, 2 Oct 2019 15:08:39 +0000 (17:08 +0200)]
PAL: Accept reconf time in scientific notation

+ Otherwise "9.58828205237e-05" is understood as "9.58828205237".
+ Replace "[0-9]" with "\d".

Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agosw_interface_details api updated 37/22437/2
Jan Gelety [Thu, 26 Sep 2019 17:29:02 +0000 (19:29 +0200)]
sw_interface_details api updated

- based on pending vpp api change: https://gerrit.fd.io/r/c/vpp/+/21490

Change-Id: I7d7425e8db3bf60ea3d9d7936ed3109c76247457
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT-1471: Policer - VAT API to PAPI 26/20826/58
premkumarv [Wed, 24 Jul 2019 12:43:23 +0000 (08:43 -0400)]
CSIT-1471: Policer - VAT API to PAPI

Change-Id: I6c7eff8d9cbb196ccb684a45579ac59942351cfe
Signed-off-by: premkumarv <preym17@gmail.com>
3 years agoUpdate flag day document 02/22202/4
Vratko Polak [Wed, 25 Sep 2019 14:52:35 +0000 (16:52 +0200)]
Update flag day document

Prevent false -1 from api-crc job.
Add more details on CSIT side of things.
Minimize the breakage of trending jobs.

Also: Add motivation section explaining
why earlier solutions are not good enough.

- Needs more polishing.
- VPP/CSIT, Committer/Developer can be defined in a separate section.
- VPP/CSIT trending and verify jobs can be defined in a separate section.
- The main process section should list only steps.
 - Comments on which jobs are broken/fixed can be moved to a separate section.
 - Name phases, so progress can be described better than "step 9".
- Emphasize that only one API change can be in the process.
  All other changes need to be rebased (to clear any previous +1)
  before next cycle starts.

Change-Id: Ie64a20db3f4abad3c8cddbf13705ff006e5a6382
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoProposal to automate VPP-API "Flag Day" 56/18356/9
Dave Wallace [Mon, 18 Mar 2019 02:05:11 +0000 (22:05 -0400)]
Proposal to automate VPP-API "Flag Day"

Change-Id: I7bfce00762017b1aa8fd91ce1c8e4c0b810ee7b7
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoReport: Fix: Legend in reconf tests 32/22332/1
Tibor Frank [Fri, 27 Sep 2019 07:20:27 +0000 (09:20 +0200)]
Report: Fix: Legend in reconf tests

Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Reconf tests: set autorange for y axis 21/22321/1
Tibor Frank [Thu, 26 Sep 2019 11:37:16 +0000 (13:37 +0200)]
Report: Reconf tests: set autorange for y axis

Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd support for HDRhistogram 40/20540/17
Vratko Polak [Fri, 13 Sep 2019 08:22:11 +0000 (10:22 +0200)]
Add support for HDRhistogram

+ Enable hdrh in trex server.
+ Append hdrh coded output after min/avg/max/.
+ Read (not show nor decode) hdrh value in PAL.
+ Also, remove old ndrpdrdisc code.

Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReconf tests: Fix async measurements 20/22120/19
Vratko Polak [Mon, 23 Sep 2019 13:00:00 +0000 (15:00 +0200)]
Reconf tests: Fix async measurements

TRex does not zero the server counters.
It copies the values to use as reference,
and subtracts them when asked for results.

But the reference is stored in the client (not the server).
And CSIT uses different scripts to start and stop async traffic,
which means different clients.

This patch introduces a workaround.
Async start will return xstats objects to use as reference,
and async stop will use the objects to compute the correct results.
The xstats objects are stored in TrafficGenerator instance.
Sync measurement does not export the counters, to shorten logs.

Other improvements:
+ Make stop_traffic_on_tg return measurement results directly.
+ Rename --async to --async_start as "async" is reserved in Python 3.7
+ Minor pylint, docstring and typo fixes.

Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoPAL: Fix unit for packets lost 14/22114/4
Vratko Polak [Wed, 18 Sep 2019 09:42:08 +0000 (11:42 +0200)]
PAL: Fix unit for packets lost

+ update the static content

Change-Id: I8c4852195e09d7b00555ebb4a7378743c3df45f2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFixing typo tag_documentation for LISP 55/22155/4
Nidhy [Thu, 19 Sep 2019 17:35:33 +0000 (10:35 -0700)]
Fixing typo tag_documentation for LISP

Change-Id: Idd715cb0d3e6b60c660b95ac618e8e114419491b
Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>