csit.git
3 years agoReport: Add RC2 data 01/29101/1
Tibor Frank [Mon, 28 Sep 2020 07:38:25 +0000 (09:38 +0200)]
Report: Add RC2 data

Change-Id: I6c4ae6b428571a392586f5b817c5392a0de8c727
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: Workaround AVF interface down until VPP-1934 86/29086/6
pmikus [Fri, 25 Sep 2020 07:35:45 +0000 (07:35 +0000)]
FIX: Workaround AVF interface down until VPP-1934

- Follow up https://jira.fd.io/browse/VPP-1934

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id0a26c5f67f229480332530a8531401d954f4422

3 years agotest: nat44det - add session number check 08/28708/43
Jan Gelety [Tue, 8 Sep 2020 10:14:21 +0000 (12:14 +0200)]
test: nat44det - add session number check

- some tests need to reduce rate for ramp-up phase
- some tests need to extend trail duration in ramp-up phase
- removed 2n1l-10ge2p1x710-ethip4udp-nat44det-h1-p63-s63 suite
  as nat out ports are randomly selected from available port range
  so T-Rex stateless is not able to provide required out2in traffic

Change-Id: I1145496610d202f81d911e68aa819844d7600918
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: replace snat by nat 52/29052/1
Tibor Frank [Thu, 24 Sep 2020 07:50:05 +0000 (09:50 +0200)]
Report: replace snat by nat

Change-Id: Ia329059955134c7fe30135a43bb1e1ec72b7bb6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Replace snat by nat 51/29051/3
Tibor Frank [Thu, 24 Sep 2020 07:40:01 +0000 (09:40 +0200)]
Trending: Replace snat by nat

Change-Id: Ifcb1311d46b7134502b142933fd1574eb94cc230
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: Race condition 41/29041/3
pmikus [Wed, 23 Sep 2020 12:44:06 +0000 (12:44 +0000)]
FIX: Race condition

avf tests works, but vfio-pci tests are following, the interfaces must
be in down state (ideally unbind, as vpp cannot pick them).

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I77af85ec4239059a5455ef68683ca129548bd7bd

3 years agoTrending: Fix graph file name 39/29039/1
Tibor Frank [Wed, 23 Sep 2020 11:55:39 +0000 (13:55 +0200)]
Trending: Fix graph file name

2n-clx-xxv710-64b-8t4c-ip4-features-snat44det-avf.html

Change-Id: I93b39f9edf3b0d85b08cec97ad647e398da83207
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix: use nat44 not snat44 26/29026/3
Jan Gelety [Thu, 10 Sep 2020 12:47:09 +0000 (14:47 +0200)]
Fix: use nat44 not snat44

Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFIX: Mellanox handling 31/29031/1
pmikus [Wed, 23 Sep 2020 09:47:02 +0000 (09:47 +0000)]
FIX: Mellanox handling

- From 2n-zn2 testing

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9b1f0916f0f1d90a223918cfe48409d29f2ee773

3 years agoInfra: Add 2n-xn2 24/29024/1
pmikus [Wed, 23 Sep 2020 07:10:28 +0000 (07:10 +0000)]
Infra: Add 2n-xn2

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2ff6526b5209dabf70c6593f60162d9b8c147014

3 years agoFramework: AVF 41/28941/4
pmikus [Fri, 18 Sep 2020 12:33:05 +0000 (12:33 +0000)]
Framework: AVF

Fix 1/3: Explicitly put PF interface up (this patch)
Fix 2/3: Done on TB
Fix 3/3: VPP bug displaying VF up if underlying PF is not up

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I45d66986ec76e6e14eebaad6828ef72724c626ab

3 years agotest: lisp moved to plugin 90/28990/2
Jan Gelety [Thu, 10 Sep 2020 06:14:45 +0000 (08:14 +0200)]
test: lisp moved to plugin

- lisp is moving to plugin: https://gerrit.fd.io/r/c/vpp/+/28972

Jira: CSIT-1597

Change-Id: I362f1931b5fc441da9c8a6dda933a66bfed8c4b8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: Heapsize configuration 36/28936/11
pmikus [Fri, 18 Sep 2020 09:46:31 +0000 (09:46 +0000)]
Framework: Heapsize configuration

- https://gerrit.fd.io/r/c/vpp/+/28829
- https://gerrit.fd.io/r/c/vpp/+/28896
- ip6 to be added later

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7b03b8ace5c5c7582d4a2f66bfd788a3ec80a916

3 years agoTrending: Hide 2n-clx-cx556a 87/28987/1
Tibor Frank [Tue, 22 Sep 2020 04:52:54 +0000 (06:52 +0200)]
Trending: Hide 2n-clx-cx556a

Change-Id: I3616ea486c96534534422057e2f80da486ded2b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTests: nat44ed-uni 75/28975/10
pmikus [Mon, 21 Sep 2020 11:36:21 +0000 (11:36 +0000)]
Tests: nat44ed-uni

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iee488e2244a4e253471310bc7fb9640c69c6b0cb

3 years agoUpdate of VPP_STABLE_VER files 69/28969/2
Jan Gelety [Wed, 9 Sep 2020 18:50:43 +0000 (20:50 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~68-g5cc11b121

 - use new vpp ref build - centos7:
   21.01-rc0~68_g5cc11b1~b9959

Change-Id: I253511da672a39f85450808a5f5feaf1b6c5dac9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: 2n-zn2 topology 74/28974/2
pmikus [Mon, 21 Sep 2020 10:27:37 +0000 (10:27 +0000)]
Framework: 2n-zn2 topology

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8207dc1c6b303b4f6c964126785fb714e74913f0

3 years agoPAL: Fix show runtime 73/28973/1
Tibor Frank [Mon, 21 Sep 2020 08:52:09 +0000 (10:52 +0200)]
PAL: Fix show runtime

Change-Id: Id42f087b2e3874a362f17596740feab6af8029d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data for RC1 detailed test results 64/28964/2
Tibor Frank [Mon, 21 Sep 2020 07:18:38 +0000 (09:18 +0200)]
Report: Add data for RC1 detailed test results

Change-Id: Idb15e437beed058133ca9938d45a80caf94ebd73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: Unknown trigger files 80/28880/4
pmikus [Wed, 16 Sep 2020 09:53:45 +0000 (09:53 +0000)]
FIX: Unknown trigger files

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d6108af943d729fecbcfe4867ea820a69b4eb1e

3 years agoTrending: Fix the name of csit-dpdk-perf-mrr-weekly-master-3n-tsh 63/28963/1
Tibor Frank [Mon, 21 Sep 2020 04:42:14 +0000 (06:42 +0200)]
Trending: Fix the name of csit-dpdk-perf-mrr-weekly-master-3n-tsh

Change-Id: I98731ba17d5fbfc10e1b1b91ff3f4afc52566b8d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Dislpay job name in err msg 62/28962/2
Tibor Frank [Mon, 21 Sep 2020 04:36:34 +0000 (06:36 +0200)]
PAL: Dislpay job name in err msg

Change-Id: I008d14bf1f72bcdc9b6bcb478ae851de03a176e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Dislpay job name in err msg 61/28961/2
Tibor Frank [Mon, 21 Sep 2020 04:30:08 +0000 (06:30 +0200)]
PAL: Dislpay job name in err msg

Change-Id: Id7509bd11ac32cc3f72e71c8826ccacdf1fe95a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Replace 2009.0-4 by 2009.0-5 37/28937/2
Tibor Frank [Fri, 18 Sep 2020 10:40:56 +0000 (12:40 +0200)]
Report: Replace 2009.0-4 by 2009.0-5

Change-Id: I87ed119665094d60b9a5452ea222f63fd45dd52c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdded amd 2n-zen2 testbed specification 79/28179/5
Maciek Konstantynowicz [Wed, 5 Aug 2020 13:53:58 +0000 (14:53 +0100)]
Added amd 2n-zen2 testbed specification

Change-Id: I429c64f89d1c93945da375072f6f9cb702fa687f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Fix plot_perf_box_name 15/28915/1
Tibor Frank [Fri, 18 Sep 2020 08:25:09 +0000 (10:25 +0200)]
Report: Fix plot_perf_box_name

Change-Id: I660819b881b1109f6f6bf250b66ba025e9278f56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add csit-dpdk-perf-mrr-weekly-master-3n-tsh 14/28914/2
Tibor Frank [Fri, 18 Sep 2020 08:15:13 +0000 (10:15 +0200)]
Trending: Add csit-dpdk-perf-mrr-weekly-master-3n-tsh

- alerting only
- todo: Graphs

Change-Id: I369d5c1bbcd634b1b4ebfeb4c08c9ac4a5c058ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: add 3n-tsh dpdk mrr weekly set 13/28913/1
Juraj Linkeš [Fri, 18 Sep 2020 07:55:33 +0000 (09:55 +0200)]
job-specs: add 3n-tsh dpdk mrr weekly set

Change-Id: I0cd41129538b5e4ec47f3876813f7df36da2977a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport: Compare NICs 12/28912/2
Tibor Frank [Fri, 18 Sep 2020 07:07:18 +0000 (09:07 +0200)]
Report: Compare NICs

Change-Id: I4a4dd9f12e0a3904c0e21b434af38f9fa974e361
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Add EPYC 06/28906/2
pmikus [Thu, 17 Sep 2020 15:36:22 +0000 (15:36 +0000)]
Ansible: Add EPYC

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic84b7cbcbcd269a5fe548b59d478cd6dfa57a952

3 years agoReport: Add RC1 data 11/28911/1
Tibor Frank [Fri, 18 Sep 2020 05:19:53 +0000 (07:19 +0200)]
Report: Add RC1 data

Change-Id: Ied3df918c0798df546b447b8ffb8d77938a3b904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add snat44det tests to graphs 81/28881/1
Tibor Frank [Wed, 16 Sep 2020 10:39:30 +0000 (12:39 +0200)]
Report: Add snat44det tests to graphs

Change-Id: I65b6b210d500c0f5aedd39e6c70c3c48b8654dfd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add snat44det tests to trending graphs 78/28878/2
Tibor Frank [Wed, 16 Sep 2020 08:42:39 +0000 (10:42 +0200)]
Trending: Add snat44det tests to trending graphs

Change-Id: I7fe24c05a4f7f17355c3bf5c4f635f412656d52f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Fix units in speedup graphs 77/28877/1
Tibor Frank [Wed, 16 Sep 2020 07:35:40 +0000 (09:35 +0200)]
Report: Fix units in speedup graphs

Change-Id: I6e0dc888d00df03e3fbd8cac62d6db19ef6507cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd ipsec async mode performance test cases 08/28508/8
Yulong Pei [Wed, 19 Aug 2020 10:30:34 +0000 (18:30 +0800)]
Add ipsec async mode performance test cases

In VPP 20.05, vpp added async crypto engine that support to use QAT hardware
to do encryption and decryption, vnet/ipsec enabled async mode to use async
crypto engine.

Current async crypto engine also use dpdk_cryptodev as async handlers, in the
future it may add other native QAT driver as async handlers.

Note that async crypto engine is to support vnet/ipsec, it is different
with current existing dpdk backend which itself has ESP implementation
in plugins/dpdk/ipsec.

Change-Id: I4e6eaa7ca1eddb8b1c45212de0684fb26907119b
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
3 years agoReport: Configure rls2009 Report 38/28738/1
Tibor Frank [Thu, 10 Sep 2020 11:05:27 +0000 (13:05 +0200)]
Report: Configure rls2009 Report

Change-Id: I63c058e5fda100cce8e1b83acb8dfe988f1fd904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: Add NAT44 04/28704/2
Tibor Frank [Tue, 8 Sep 2020 07:45:55 +0000 (09:45 +0200)]
job-specs: Add NAT44

Change-Id: If8fbcf6a7720eb75094966b352495d1435f44148
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoVPP-DEV API COV: Add NAT44-DET tests 97/28697/1
Martin Balaz [Mon, 7 Sep 2020 15:23:02 +0000 (17:23 +0200)]
VPP-DEV API COV: Add NAT44-DET tests

Jira: CSIT-1756

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: Ia6fdc6df91f36ffcabd428326195bb9d8f967e52

3 years agoVPP-DEV API COV: Add NAT44-ED tests 59/28559/7
Jan Gelety [Sat, 8 Aug 2020 10:36:02 +0000 (12:36 +0200)]
VPP-DEV API COV: Add NAT44-ED tests

Jira: CSIT-1755

Change-Id: I34baa22a49f44da3fa80d91fa2f4132c982fe610
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 91/28691/1
Jan Gelety [Thu, 3 Sep 2020 23:18:00 +0000 (01:18 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~386-g5c721baeb

 - use new vpp ref build - centos7:
   20.09-rc0~386_g5c721ba~b9869

Change-Id: I0780c9248025ed384596331fc0ec2b2eec20acbf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFIX: use correct minimal packet length in scapy scripts 77/28677/3
Jan Gelety [Thu, 3 Sep 2020 18:39:03 +0000 (20:39 +0200)]
FIX: use correct minimal packet length in scapy scripts

Change-Id: Icd1b4a3edb203cb0963203bb2e3e765b35c81600
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix local CSIT deployment 98/28598/3
Tomas Alexy [Fri, 28 Aug 2020 13:34:54 +0000 (15:34 +0200)]
Fix local CSIT deployment

Change-Id: I6ccf3cc11b4343ebcf02f30a01eddb9204ba53ee
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
3 years agoTrending, Report: use test tag ethip4udp-snat44det-h1-p1-s1 49/28649/2
Tibor Frank [Thu, 3 Sep 2020 07:26:34 +0000 (09:26 +0200)]
Trending, Report: use test tag ethip4udp-snat44det-h1-p1-s1

- use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44

Change-Id: Ie4897430c3b3074fdf3440d56cc1794a4c3046dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFramework: Code aligments 89/28589/5
pmikus [Thu, 27 Aug 2020 07:47:31 +0000 (07:47 +0000)]
Framework: Code aligments

+ Unifying code structures
  - To easily plug another DUT
+ New PCI PassThrough templates
+ Improved perf stat on cores allocated in test.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I325f17b977314f93cb91818feddfddf3e607eb8a

3 years agoFramework: Bump DPDK 20.08 71/28571/21
pmikus [Tue, 25 Aug 2020 06:57:59 +0000 (06:57 +0000)]
Framework: Bump DPDK 20.08

+ DPDK 20.08
+ Migrate make -> meson
+ Fix all trending issues

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I31dcb22627c0f8d17ec63c5b138a2da958b006f4

3 years agojob_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44 42/28642/1
Jan Gelety [Sun, 9 Aug 2020 05:55:12 +0000 (07:55 +0200)]
job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44

Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 38/28638/1
Jan Gelety [Sat, 8 Aug 2020 23:41:33 +0000 (01:41 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~344-gedc816355

 - use new vpp ref build - centos7:
   20.09-rc0~344_gedc8163~b9827

Change-Id: Iad2130f00098235dda068fd45594dd58cd62b175
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAnsible: fix the wrong module and mode for vpp_device.yaml in cleanup role 46/28046/4
Jieqiang Wang [Tue, 9 Jun 2020 11:29:26 +0000 (11:29 +0000)]
Ansible: fix the wrong module and mode for vpp_device.yaml in cleanup role

The src field for ansible template module used in vpp_device.yaml of cleanup role should be jinja2 format and the mode for script to be transfered to the remote host should be executable for the file owner. Fix this error by replacing the ansible template module with ansible copy module and setting the file permission to be 744.

Change-Id: Ibf80b0c5bec77a13509122795a5b12b6faba2f8e
Signed-off-by: Jieqiang Wang <jieqiang.wang@arm.com>
3 years agoTrending: Add DPDK version to alerts 00/28600/1
Tibor Frank [Fri, 28 Aug 2020 08:37:29 +0000 (10:37 +0200)]
Trending: Add DPDK version to alerts

Change-Id: I2f1a16ecfa0336e9c5a52a2efcbfcb2caddee089
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add identification of DUT to alerting email 99/28599/1
Tibor Frank [Fri, 28 Aug 2020 07:44:06 +0000 (09:44 +0200)]
Trending: Add identification of DUT to alerting email

Change-Id: I2e63f16aef48e68b0e86e913431bed7df01f1b70
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Add arm nomads into pool 97/28597/1
pmikus [Fri, 28 Aug 2020 07:07:07 +0000 (07:07 +0000)]
Ansible: Add arm nomads into pool

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I99a33a15e7e87fe6f56deb1ab0e4ce3091508244

3 years agoTrending: Add DPDK tests to list of failed tests 88/28588/1
Tibor Frank [Thu, 27 Aug 2020 06:29:05 +0000 (08:29 +0200)]
Trending: Add DPDK tests to list of failed tests

Change-Id: I25e805125528d67a5eea277df6d88549f129d137
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending, Report: nat44-deterministc test names change 77/28577/4
Tibor Frank [Tue, 25 Aug 2020 12:58:42 +0000 (14:58 +0200)]
Trending, Report: nat44-deterministc test names change

Change-Id: I1956ccaff625f287995765a4c2b0b46cb00d0d65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: remove ip4-08.md from 3n-hsw and 3n-skx 85/28585/1
Tibor Frank [Wed, 26 Aug 2020 07:49:05 +0000 (09:49 +0200)]
job-specs: remove ip4-08.md from 3n-hsw and 3n-skx

- They duplicate specification which is in ip4-01.md files

Change-Id: I818e1c165415b1f7d53ed28ffb345f07e6ac0576
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoJob-specs: Fix the runs durations 73/28573/1
Tibor Frank [Tue, 25 Aug 2020 09:23:49 +0000 (11:23 +0200)]
Job-specs: Fix the runs durations

Change-Id: Ifeb5455140e911b804df55b4ceeda26575ae9da9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: nat44-deterministc test names change 65/28565/7
Tibor Frank [Mon, 24 Aug 2020 08:50:49 +0000 (10:50 +0200)]
job-specs: nat44-deterministc test names change

Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoT-Rex: 2.82, core pin, 8 workers 84/28184/6
pmikus [Thu, 6 Aug 2020 08:45:49 +0000 (08:45 +0000)]
T-Rex: 2.82, core pin, 8 workers

+ Bump T-Rex version. We need new features for ASTF test.
+ Apply core pining. Results in a more stable performance.
+ Tweak the number of T-Rex workers.
 + We need an even value to achieve ymmetric performance with pinning.
 + Value 8 was selected as a best compromise.

This is a combination of 3 commits.
This is the 1st commit message:

T-Rex: 2.82

This is the commit message #2:

Change Trex to CORE_MASK_PIN mode to improve performance

https://trex-tgn.cisco.com/trex/doc/trex_stateless.html#_core_masking_per_interface
Above link have below explaination,

"When the profile is symmetric, performance can be improved by pinning half of
the cores to port 0, and half of the cores to port 1, thus avoiding cache
trashing and bouncing."

The reason to change this is that to run CSIT with 100G NIC often failed with
"TRex stateless runtime error timeout", it caused by Trex can not send enough
traffic within the fixed duration.

by change to CORE_MASK_PIN mode fix the issue.

Not editing ASTF, as that supports different options.

This is the commit message #3:

Experiment: Vary number of TRex workers

With CORE_MASK_PIN, we can get more predictable time distribution.
Decided to use 8 workers, that gives good results
both for high end (RDMA-core l2patch) and low end (vhost) tests.

Change-Id: I5c61127799e0624464e960fcb980ad1c4058e744
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFramework: Qemu alignments 58/28558/2
pmikus [Fri, 21 Aug 2020 09:53:24 +0000 (09:53 +0000)]
Framework: Qemu alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2781e85f44acffb4f8d7f02326ba2ca668dad0c5

3 years agoFix: NAT44 deterministic moved to separate det44 plugin 29/28529/11
Jan Gelety [Sat, 8 Aug 2020 14:41:24 +0000 (16:41 +0200)]
Fix: NAT44 deterministic moved to separate det44 plugin

- align CSIT code with VPP code changes for NAT44 deterministic
  (DET44) feature

- align test names according to snat44ed tests

- remove obsolete 3-node nat tests

- remove 2n1l-10ge2p1x710-ethip4udp-snat44det-h1048576-p63-s66060288 tests
  (not enough memory for such high number of sessions)

Change-Id: I9a22b99b4cfa56d18e9c7ef9c58296e202567d42
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix: Use new-style interface variables 76/28376/2
Vratko Polak [Thu, 13 Aug 2020 13:13:35 +0000 (15:13 +0200)]
Fix: Use new-style interface variables

The old-style variables contain None in some places,
mainly in SRv6 proxy tests.

Change-Id: If3887a7dba051454c504b345a6a316d5d69d0139
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFramework: use 'stl' in trex stateless profile names 12/28512/3
Jan Gelety [Sat, 8 Aug 2020 05:04:20 +0000 (07:04 +0200)]
Framework: use 'stl' in trex stateless profile names

Change-Id: I74641cc89d2f25d50b67d51bf2567082b420aabb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPAL: Add processing of throughput in Gbps 05/28505/3
Tibor Frank [Wed, 19 Aug 2020 08:00:14 +0000 (10:00 +0200)]
PAL: Add processing of throughput in Gbps

Change-Id: I264e329fa94cddf6a759f14bf567c56a50d1895d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd Intel E810CQ 100G NIC configuration 10/27910/7
Yulong Pei [Tue, 14 Jul 2020 19:44:44 +0000 (12:44 -0700)]
Add Intel E810CQ 100G NIC configuration

for Intel E810CQ 100G NIC, kernel driver of PF is ice, kernel driver of VF
is iavf, its VF hardware support VPP native avf driver.

Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ic8d86e5ee00057bbbcd09df619a38bd1371c8fd7

3 years agoSign off on relicensing of scapy related files for Intel 17/28417/2
Ray Kinsella [Fri, 14 Aug 2020 11:22:04 +0000 (12:22 +0100)]
Sign off on relicensing of scapy related files for Intel

Signed-off-by: Ray Kinsella <mdr@ashroe.eu>
Change-Id: I5f328b702ff7faffd432d08925cf1c247de1d680

3 years agoSign off on relicensing of scapy related files for Cisco. 77/28377/4
Ed Warnicke [Thu, 13 Aug 2020 16:18:14 +0000 (11:18 -0500)]
Sign off on relicensing of scapy related files for Cisco.

Change-Id: Ia27726d8bed649a55ac93ea3464b8bf278fe9d8f
Signed-off-by: Ed Warnicke <hagbard@gmail.com>
3 years agoPerf: NAT44 endpoint-dependent mode - tcp, part I 76/28176/30
Jan Gelety [Tue, 4 Aug 2020 21:48:36 +0000 (23:48 +0200)]
Perf: NAT44 endpoint-dependent mode - tcp, part I

Jira: CSIT-1736

- tcp synthetic profiles w/o data packets
- tcp cps perf tests, phase I (no special "search cps" KW)

Change-Id: I52be34b0fdd51d7a33c8c5de9b46d7064c48f7fa
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPerf: NAT44 endpoint-dependent mode - udp, part I 05/28205/8
Jan Gelety [Thu, 6 Aug 2020 01:34:31 +0000 (03:34 +0200)]
Perf: NAT44 endpoint-dependent mode - udp, part I

- continuation of https://gerrit.fd.io/r/c/csit/+/26898 as there was
reached limit of changes (1000)

Jira: CSIT-1711

- udp synthetic profiles w/o data packets
- udp cps perf tests, phase I (no special "search cps" KW)

Part I means that we are using MRR tests to collect traffic data
until there is ready new CPS test type with corresponding algorithm.

Change-Id: I0d30feb9ecf1d0bff937152656f8eb422f831378
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: Qemu alignments 42/28442/2
pmikus [Tue, 18 Aug 2020 09:57:26 +0000 (09:57 +0000)]
Framework: Qemu alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I20098fca8fb513accef3edc9a72bfd3c56bf9be2

3 years agoFramework: Alignments 39/28439/1
pmikus [Tue, 18 Aug 2020 09:38:28 +0000 (09:38 +0000)]
Framework: Alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b535ea61ab68f6e37989ffc942979cdfd24f55e

3 years agoFramework: Profiles load 36/28036/14
pmikus [Wed, 22 Jul 2020 12:35:54 +0000 (12:35 +0000)]
Framework: Profiles load

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iab84aff31a23bb9d8e1165f5314004803fd8a501

3 years agoMeasure latency only in special cases 38/28038/6
Vratko Polak [Fri, 7 Aug 2020 12:31:42 +0000 (14:31 +0200)]
Measure latency only in special cases

+ Measure latency in 90/50/10/0% PDR loads in ndrpdr tests.
+ Do not measure latency anywhere else.
- Needs manual editing to re-enable in soak tests.

Change-Id: I69fa11bfcf71012f683061c5effea52a1be91620
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 25/28425/2
Jan Gelety [Fri, 7 Aug 2020 10:46:06 +0000 (12:46 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~296-g17ec577f7

 - use new vpp ref build - centos7:
   20.09-rc0~296_g17ec577~b9779

Change-Id: I4b66014a4c39adc3c1e22fb29ef000474e1ac099
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoTrending: Fixes after review 26/28426/1
Tibor Frank [Mon, 17 Aug 2020 10:16:57 +0000 (12:16 +0200)]
Trending: Fixes after review

Change-Id: Ia2fdd4d222c723c063f267a20e1a4f18b4e03d69
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: NFV Tests 41/28341/11
Tibor Frank [Thu, 13 Aug 2020 06:56:46 +0000 (08:56 +0200)]
Trending: NFV Tests

- 2n-skx
- 2n-clx

Change-Id: I6dd55ed167dc4267b2a4e4c52ec0874ad0e4a4b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: NFV Tests 75/28275/2
Tibor Frank [Wed, 12 Aug 2020 13:15:29 +0000 (15:15 +0200)]
Trending: NFV Tests

Change-Id: I882c0af852a9e556df3c748164360cdbc336d654
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 98/28198/1
Jan Gelety [Wed, 5 Aug 2020 17:53:48 +0000 (19:53 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~277-g6042d2815

 - use new vpp ref build - centos7:
   20.09-rc0~277_g6042d28~b9760

Change-Id: I1da941f54a6338846a3478923dbb5988ffbf842a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoLimit user triggers: no OR 83/28183/1
Vratko Polak [Thu, 6 Aug 2020 08:32:46 +0000 (10:32 +0200)]
Limit user triggers: no OR

To avoid runs such as:
https://jenkins.fd.io/job/vpp-csit-verify-perf-master-3n-hsw/340/

Change-Id: I1b30d5f440ddf8ff32b11265b2ac2176f4b9a665
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agojob-specs: align mrr-weekly NFV tests with report-iter 66/28166/2
Tibor Frank [Tue, 4 Aug 2020 09:10:41 +0000 (11:10 +0200)]
job-specs: align mrr-weekly NFV tests with report-iter

- 2n-skx
- 2n-clx

Change-Id: I8e96d335be2c26ffb03e210f6f658fba1825c597
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd Denverton testbeds BIOS configuration doc 08/28108/2
Yulong Pei [Wed, 29 Jul 2020 20:41:32 +0000 (13:41 -0700)]
Add Denverton testbeds BIOS configuration doc

Signed-off-by: Xinfeng Zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I531b380277a885f45af0749d048f44ba12285dd2

3 years agoReport 2005: Add data, configure rls2005.32 72/28172/1
Tibor Frank [Wed, 5 Aug 2020 04:52:06 +0000 (06:52 +0200)]
Report 2005: Add data, configure rls2005.32

Change-Id: I79129cac48c60a959e4dc1ebfc9d63b9b230e933
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Set longer time period 70/28170/1
Tibor Frank [Tue, 4 Aug 2020 11:17:00 +0000 (13:17 +0200)]
Trending: Set longer time period

- daily: up to 180 sets, max 180 days
- weekly: up to 26 sets, max 180 days

Change-Id: I59c550e5728fcb83f247b0c958f21209d927ee98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Implement the latest changes in job specs 02/28102/11
Tibor Frank [Wed, 29 Jul 2020 13:35:41 +0000 (15:35 +0200)]
Trending: Implement the latest changes in job specs

Graphs:
 - MRR
   - 2n-clx
   - 2n-skx
   - 3n-skx
   - 3n-hsw
   - 3n-tsh
 - NDRPDR
   - 2n-skx
   - 3n-skx
   - 3n-hsw
   - 2n-clx

Change-Id: Ieab26ba1d2ee56e66c5c8598c4dba240a14e53e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 40/28140/1
Jan Gelety [Thu, 23 Jul 2020 21:00:29 +0000 (23:00 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~266-ge6c3e8f0e

 - use new vpp ref build - centos7:
   20.09-rc0~266_ge6c3e8f~b9748

Change-Id: I3d173d9b67657b238f7a65e24d81f0ac8f9d0093
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoT-Rex: Add advanced stateful mode 68/27168/46
Jan Gelety [Thu, 7 May 2020 02:37:19 +0000 (04:37 +0200)]
T-Rex: Add advanced stateful mode

- provide base routines to run T-Rex in advanced stateful mode

Change-Id: Ib0dc5f2919c370753335f6446860683dc4b12d93
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: Perf stat capturing 16/28116/17
Peter Mikus [Thu, 5 Mar 2020 11:12:18 +0000 (11:12 +0000)]
Framework: Perf stat capturing

Change-Id: I3bbe1fe0073ddeead5219993675f24955e8c3dfd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoIntroduce per DUT configurable stats 59/28059/12
pmikus [Fri, 24 Jul 2020 12:57:43 +0000 (12:57 +0000)]
Introduce per DUT configurable stats

- test/suite/global
- binary logic is not working

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia3d81cbf2c5f04d1093a0a408c84a9ffc6f3eef0

3 years agoTRex stateless: Fix unidirectional tests 11/28111/2
Vratko Polak [Thu, 30 Jul 2020 11:25:33 +0000 (13:25 +0200)]
TRex stateless: Fix unidirectional tests

Change-Id: I5e101f012ae4a4383e61b274499817d146479993
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate RCA files with new findings 53/28053/5
Vratko Polak [Wed, 29 Jul 2020 12:33:10 +0000 (14:33 +0200)]
Update RCA files with new findings

Change-Id: I0db4d513cdc84c6f8c1e2dffa46cd41e13df5b21
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoAnsible: Nomad 0.12.0 upgrade 00/28100/1
pmikus [Wed, 29 Jul 2020 09:09:00 +0000 (09:09 +0000)]
Ansible: Nomad 0.12.0 upgrade

+ random fixes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icb320d1ba4bbe3b5f99956cf8e89c2a29e114e41

3 years agoSoak: Avoid a possible deadlock. 81/28081/3
Vratko Polak [Tue, 28 Jul 2020 14:38:55 +0000 (16:38 +0200)]
Soak: Avoid a possible deadlock.

Change-Id: I31c2d7744b5cd3021132fb188480b8edec74986c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agovsap: install ab using ansible 30/28030/2
Xiaolong Jiang [Wed, 22 Jul 2020 09:28:27 +0000 (17:28 +0800)]
vsap: install ab using ansible

Signed-off-by: Xiaolong Jiang <xiaolongx.jiang@intel.com>
Change-Id: I275ad9dccc02e6b1f1c791fabf8896fb03acb3fb

3 years agoDocs testing_in_vagrant: add header sections and make command line codes more readable 58/28058/3
Martin Balaz [Fri, 24 Jul 2020 10:08:07 +0000 (12:08 +0200)]
Docs testing_in_vagrant: add header sections and make command line codes more readable

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: I0b8fdaad1e68e41e4a436d9f2fc566d8896adbd6
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
3 years agoDoc: Update durations of test runs 56/27756/11
Tibor Frank [Wed, 1 Jul 2020 12:31:42 +0000 (14:31 +0200)]
Doc: Update durations of test runs

Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 69/28069/1
Jan Gelety [Tue, 21 Jul 2020 21:44:26 +0000 (23:44 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~243-gc72995dd7

 - use new vpp ref build - centos7:
   20.09-rc0~243_gc72995d~b9727

Change-Id: Ib37d4a51bee9782077c537531d67e91ac52a358d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoNDRPDR: Allow smaller min_rate, 9001 pps 37/28037/5
Vratko Polak [Fri, 24 Jul 2020 11:55:53 +0000 (13:55 +0200)]
NDRPDR: Allow smaller min_rate, 9001 pps

+ Latency measurements need more than 9000 pps.
- Previously 0% measurement used 9500 pps.

Change-Id: Ic0841de096dfa8a61329f98aa1ba6d3f0ce60c66
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agojob-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrn 18/28018/3
Tibor Frank [Tue, 21 Jul 2020 11:57:31 +0000 (13:57 +0200)]
job-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrn

Change-Id: Icfecc2b9576d1be32c78f6b0019b64d6f401745e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 55/28055/1
Tibor Frank [Fri, 24 Jul 2020 05:14:07 +0000 (07:14 +0200)]
Report 2005: Add data

Change-Id: Id91ac52634fbf4c6b931a61946eb7a9d8019dd76
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoansible nomad: install htop 40/28040/2
Dave Wallace [Wed, 22 Jul 2020 17:22:13 +0000 (17:22 +0000)]
ansible nomad: install htop

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I0549e9b5ac6769e3fc760ab2047d89a188baa36a

3 years agoFIX: Log required cli_cmd not "cli_inband" 20/28020/3
Jan Gelety [Mon, 20 Jul 2020 22:13:53 +0000 (00:13 +0200)]
FIX: Log required cli_cmd not "cli_inband"

Change-Id: If0975b1d54882390c5be418927e2961d0f4c8429
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoperpatch: Echo MAKE_PARALLEL_* var before build 21/27821/5
Juraj Linkeš [Mon, 1 Jun 2020 06:22:42 +0000 (08:22 +0200)]
perpatch: Echo MAKE_PARALLEL_* var before build

VPP uses MAKE_PARALLEL_FLAGS or MAKE_PARALLEL_JOBS to limit the number
of cpus to use during build, so emit a line on stdout if it's used.

Change-Id: I669398d474d172abb6c848a45f24f1bdd56990d8
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>