csit.git
3 years agoUpdate of VPP_STABLE_VER files 91/28691/1
Jan Gelety [Thu, 3 Sep 2020 23:18:00 +0000 (01:18 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~386-g5c721baeb

 - use new vpp ref build - centos7:
   20.09-rc0~386_g5c721ba~b9869

Change-Id: I0780c9248025ed384596331fc0ec2b2eec20acbf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFIX: use correct minimal packet length in scapy scripts 77/28677/3
Jan Gelety [Thu, 3 Sep 2020 18:39:03 +0000 (20:39 +0200)]
FIX: use correct minimal packet length in scapy scripts

Change-Id: Icd1b4a3edb203cb0963203bb2e3e765b35c81600
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix local CSIT deployment 98/28598/3
Tomas Alexy [Fri, 28 Aug 2020 13:34:54 +0000 (15:34 +0200)]
Fix local CSIT deployment

Change-Id: I6ccf3cc11b4343ebcf02f30a01eddb9204ba53ee
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
3 years agoTrending, Report: use test tag ethip4udp-snat44det-h1-p1-s1 49/28649/2
Tibor Frank [Thu, 3 Sep 2020 07:26:34 +0000 (09:26 +0200)]
Trending, Report: use test tag ethip4udp-snat44det-h1-p1-s1

- use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44

Change-Id: Ie4897430c3b3074fdf3440d56cc1794a4c3046dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFramework: Code aligments 89/28589/5
pmikus [Thu, 27 Aug 2020 07:47:31 +0000 (07:47 +0000)]
Framework: Code aligments

+ Unifying code structures
  - To easily plug another DUT
+ New PCI PassThrough templates
+ Improved perf stat on cores allocated in test.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I325f17b977314f93cb91818feddfddf3e607eb8a

3 years agoFramework: Bump DPDK 20.08 71/28571/21
pmikus [Tue, 25 Aug 2020 06:57:59 +0000 (06:57 +0000)]
Framework: Bump DPDK 20.08

+ DPDK 20.08
+ Migrate make -> meson
+ Fix all trending issues

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I31dcb22627c0f8d17ec63c5b138a2da958b006f4

3 years agojob_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44 42/28642/1
Jan Gelety [Sun, 9 Aug 2020 05:55:12 +0000 (07:55 +0200)]
job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44

Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 38/28638/1
Jan Gelety [Sat, 8 Aug 2020 23:41:33 +0000 (01:41 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~344-gedc816355

 - use new vpp ref build - centos7:
   20.09-rc0~344_gedc8163~b9827

Change-Id: Iad2130f00098235dda068fd45594dd58cd62b175
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAnsible: fix the wrong module and mode for vpp_device.yaml in cleanup role 46/28046/4
Jieqiang Wang [Tue, 9 Jun 2020 11:29:26 +0000 (11:29 +0000)]
Ansible: fix the wrong module and mode for vpp_device.yaml in cleanup role

The src field for ansible template module used in vpp_device.yaml of cleanup role should be jinja2 format and the mode for script to be transfered to the remote host should be executable for the file owner. Fix this error by replacing the ansible template module with ansible copy module and setting the file permission to be 744.

Change-Id: Ibf80b0c5bec77a13509122795a5b12b6faba2f8e
Signed-off-by: Jieqiang Wang <jieqiang.wang@arm.com>
3 years agoTrending: Add DPDK version to alerts 00/28600/1
Tibor Frank [Fri, 28 Aug 2020 08:37:29 +0000 (10:37 +0200)]
Trending: Add DPDK version to alerts

Change-Id: I2f1a16ecfa0336e9c5a52a2efcbfcb2caddee089
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add identification of DUT to alerting email 99/28599/1
Tibor Frank [Fri, 28 Aug 2020 07:44:06 +0000 (09:44 +0200)]
Trending: Add identification of DUT to alerting email

Change-Id: I2e63f16aef48e68b0e86e913431bed7df01f1b70
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Add arm nomads into pool 97/28597/1
pmikus [Fri, 28 Aug 2020 07:07:07 +0000 (07:07 +0000)]
Ansible: Add arm nomads into pool

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I99a33a15e7e87fe6f56deb1ab0e4ce3091508244

3 years agoTrending: Add DPDK tests to list of failed tests 88/28588/1
Tibor Frank [Thu, 27 Aug 2020 06:29:05 +0000 (08:29 +0200)]
Trending: Add DPDK tests to list of failed tests

Change-Id: I25e805125528d67a5eea277df6d88549f129d137
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending, Report: nat44-deterministc test names change 77/28577/4
Tibor Frank [Tue, 25 Aug 2020 12:58:42 +0000 (14:58 +0200)]
Trending, Report: nat44-deterministc test names change

Change-Id: I1956ccaff625f287995765a4c2b0b46cb00d0d65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: remove ip4-08.md from 3n-hsw and 3n-skx 85/28585/1
Tibor Frank [Wed, 26 Aug 2020 07:49:05 +0000 (09:49 +0200)]
job-specs: remove ip4-08.md from 3n-hsw and 3n-skx

- They duplicate specification which is in ip4-01.md files

Change-Id: I818e1c165415b1f7d53ed28ffb345f07e6ac0576
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoJob-specs: Fix the runs durations 73/28573/1
Tibor Frank [Tue, 25 Aug 2020 09:23:49 +0000 (11:23 +0200)]
Job-specs: Fix the runs durations

Change-Id: Ifeb5455140e911b804df55b4ceeda26575ae9da9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: nat44-deterministc test names change 65/28565/7
Tibor Frank [Mon, 24 Aug 2020 08:50:49 +0000 (10:50 +0200)]
job-specs: nat44-deterministc test names change

Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoT-Rex: 2.82, core pin, 8 workers 84/28184/6
pmikus [Thu, 6 Aug 2020 08:45:49 +0000 (08:45 +0000)]
T-Rex: 2.82, core pin, 8 workers

+ Bump T-Rex version. We need new features for ASTF test.
+ Apply core pining. Results in a more stable performance.
+ Tweak the number of T-Rex workers.
 + We need an even value to achieve ymmetric performance with pinning.
 + Value 8 was selected as a best compromise.

This is a combination of 3 commits.
This is the 1st commit message:

T-Rex: 2.82

This is the commit message #2:

Change Trex to CORE_MASK_PIN mode to improve performance

https://trex-tgn.cisco.com/trex/doc/trex_stateless.html#_core_masking_per_interface
Above link have below explaination,

"When the profile is symmetric, performance can be improved by pinning half of
the cores to port 0, and half of the cores to port 1, thus avoiding cache
trashing and bouncing."

The reason to change this is that to run CSIT with 100G NIC often failed with
"TRex stateless runtime error timeout", it caused by Trex can not send enough
traffic within the fixed duration.

by change to CORE_MASK_PIN mode fix the issue.

Not editing ASTF, as that supports different options.

This is the commit message #3:

Experiment: Vary number of TRex workers

With CORE_MASK_PIN, we can get more predictable time distribution.
Decided to use 8 workers, that gives good results
both for high end (RDMA-core l2patch) and low end (vhost) tests.

Change-Id: I5c61127799e0624464e960fcb980ad1c4058e744
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFramework: Qemu alignments 58/28558/2
pmikus [Fri, 21 Aug 2020 09:53:24 +0000 (09:53 +0000)]
Framework: Qemu alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2781e85f44acffb4f8d7f02326ba2ca668dad0c5

3 years agoFix: NAT44 deterministic moved to separate det44 plugin 29/28529/11
Jan Gelety [Sat, 8 Aug 2020 14:41:24 +0000 (16:41 +0200)]
Fix: NAT44 deterministic moved to separate det44 plugin

- align CSIT code with VPP code changes for NAT44 deterministic
  (DET44) feature

- align test names according to snat44ed tests

- remove obsolete 3-node nat tests

- remove 2n1l-10ge2p1x710-ethip4udp-snat44det-h1048576-p63-s66060288 tests
  (not enough memory for such high number of sessions)

Change-Id: I9a22b99b4cfa56d18e9c7ef9c58296e202567d42
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix: Use new-style interface variables 76/28376/2
Vratko Polak [Thu, 13 Aug 2020 13:13:35 +0000 (15:13 +0200)]
Fix: Use new-style interface variables

The old-style variables contain None in some places,
mainly in SRv6 proxy tests.

Change-Id: If3887a7dba051454c504b345a6a316d5d69d0139
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFramework: use 'stl' in trex stateless profile names 12/28512/3
Jan Gelety [Sat, 8 Aug 2020 05:04:20 +0000 (07:04 +0200)]
Framework: use 'stl' in trex stateless profile names

Change-Id: I74641cc89d2f25d50b67d51bf2567082b420aabb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPAL: Add processing of throughput in Gbps 05/28505/3
Tibor Frank [Wed, 19 Aug 2020 08:00:14 +0000 (10:00 +0200)]
PAL: Add processing of throughput in Gbps

Change-Id: I264e329fa94cddf6a759f14bf567c56a50d1895d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd Intel E810CQ 100G NIC configuration 10/27910/7
Yulong Pei [Tue, 14 Jul 2020 19:44:44 +0000 (12:44 -0700)]
Add Intel E810CQ 100G NIC configuration

for Intel E810CQ 100G NIC, kernel driver of PF is ice, kernel driver of VF
is iavf, its VF hardware support VPP native avf driver.

Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ic8d86e5ee00057bbbcd09df619a38bd1371c8fd7

3 years agoSign off on relicensing of scapy related files for Intel 17/28417/2
Ray Kinsella [Fri, 14 Aug 2020 11:22:04 +0000 (12:22 +0100)]
Sign off on relicensing of scapy related files for Intel

Signed-off-by: Ray Kinsella <mdr@ashroe.eu>
Change-Id: I5f328b702ff7faffd432d08925cf1c247de1d680

3 years agoSign off on relicensing of scapy related files for Cisco. 77/28377/4
Ed Warnicke [Thu, 13 Aug 2020 16:18:14 +0000 (11:18 -0500)]
Sign off on relicensing of scapy related files for Cisco.

Change-Id: Ia27726d8bed649a55ac93ea3464b8bf278fe9d8f
Signed-off-by: Ed Warnicke <hagbard@gmail.com>
3 years agoPerf: NAT44 endpoint-dependent mode - tcp, part I 76/28176/30
Jan Gelety [Tue, 4 Aug 2020 21:48:36 +0000 (23:48 +0200)]
Perf: NAT44 endpoint-dependent mode - tcp, part I

Jira: CSIT-1736

- tcp synthetic profiles w/o data packets
- tcp cps perf tests, phase I (no special "search cps" KW)

Change-Id: I52be34b0fdd51d7a33c8c5de9b46d7064c48f7fa
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPerf: NAT44 endpoint-dependent mode - udp, part I 05/28205/8
Jan Gelety [Thu, 6 Aug 2020 01:34:31 +0000 (03:34 +0200)]
Perf: NAT44 endpoint-dependent mode - udp, part I

- continuation of https://gerrit.fd.io/r/c/csit/+/26898 as there was
reached limit of changes (1000)

Jira: CSIT-1711

- udp synthetic profiles w/o data packets
- udp cps perf tests, phase I (no special "search cps" KW)

Part I means that we are using MRR tests to collect traffic data
until there is ready new CPS test type with corresponding algorithm.

Change-Id: I0d30feb9ecf1d0bff937152656f8eb422f831378
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: Qemu alignments 42/28442/2
pmikus [Tue, 18 Aug 2020 09:57:26 +0000 (09:57 +0000)]
Framework: Qemu alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I20098fca8fb513accef3edc9a72bfd3c56bf9be2

3 years agoFramework: Alignments 39/28439/1
pmikus [Tue, 18 Aug 2020 09:38:28 +0000 (09:38 +0000)]
Framework: Alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b535ea61ab68f6e37989ffc942979cdfd24f55e

3 years agoFramework: Profiles load 36/28036/14
pmikus [Wed, 22 Jul 2020 12:35:54 +0000 (12:35 +0000)]
Framework: Profiles load

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iab84aff31a23bb9d8e1165f5314004803fd8a501

3 years agoMeasure latency only in special cases 38/28038/6
Vratko Polak [Fri, 7 Aug 2020 12:31:42 +0000 (14:31 +0200)]
Measure latency only in special cases

+ Measure latency in 90/50/10/0% PDR loads in ndrpdr tests.
+ Do not measure latency anywhere else.
- Needs manual editing to re-enable in soak tests.

Change-Id: I69fa11bfcf71012f683061c5effea52a1be91620
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 25/28425/2
Jan Gelety [Fri, 7 Aug 2020 10:46:06 +0000 (12:46 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~296-g17ec577f7

 - use new vpp ref build - centos7:
   20.09-rc0~296_g17ec577~b9779

Change-Id: I4b66014a4c39adc3c1e22fb29ef000474e1ac099
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoTrending: Fixes after review 26/28426/1
Tibor Frank [Mon, 17 Aug 2020 10:16:57 +0000 (12:16 +0200)]
Trending: Fixes after review

Change-Id: Ia2fdd4d222c723c063f267a20e1a4f18b4e03d69
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: NFV Tests 41/28341/11
Tibor Frank [Thu, 13 Aug 2020 06:56:46 +0000 (08:56 +0200)]
Trending: NFV Tests

- 2n-skx
- 2n-clx

Change-Id: I6dd55ed167dc4267b2a4e4c52ec0874ad0e4a4b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: NFV Tests 75/28275/2
Tibor Frank [Wed, 12 Aug 2020 13:15:29 +0000 (15:15 +0200)]
Trending: NFV Tests

Change-Id: I882c0af852a9e556df3c748164360cdbc336d654
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 98/28198/1
Jan Gelety [Wed, 5 Aug 2020 17:53:48 +0000 (19:53 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~277-g6042d2815

 - use new vpp ref build - centos7:
   20.09-rc0~277_g6042d28~b9760

Change-Id: I1da941f54a6338846a3478923dbb5988ffbf842a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoLimit user triggers: no OR 83/28183/1
Vratko Polak [Thu, 6 Aug 2020 08:32:46 +0000 (10:32 +0200)]
Limit user triggers: no OR

To avoid runs such as:
https://jenkins.fd.io/job/vpp-csit-verify-perf-master-3n-hsw/340/

Change-Id: I1b30d5f440ddf8ff32b11265b2ac2176f4b9a665
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agojob-specs: align mrr-weekly NFV tests with report-iter 66/28166/2
Tibor Frank [Tue, 4 Aug 2020 09:10:41 +0000 (11:10 +0200)]
job-specs: align mrr-weekly NFV tests with report-iter

- 2n-skx
- 2n-clx

Change-Id: I8e96d335be2c26ffb03e210f6f658fba1825c597
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd Denverton testbeds BIOS configuration doc 08/28108/2
Yulong Pei [Wed, 29 Jul 2020 20:41:32 +0000 (13:41 -0700)]
Add Denverton testbeds BIOS configuration doc

Signed-off-by: Xinfeng Zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I531b380277a885f45af0749d048f44ba12285dd2

3 years agoReport 2005: Add data, configure rls2005.32 72/28172/1
Tibor Frank [Wed, 5 Aug 2020 04:52:06 +0000 (06:52 +0200)]
Report 2005: Add data, configure rls2005.32

Change-Id: I79129cac48c60a959e4dc1ebfc9d63b9b230e933
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Set longer time period 70/28170/1
Tibor Frank [Tue, 4 Aug 2020 11:17:00 +0000 (13:17 +0200)]
Trending: Set longer time period

- daily: up to 180 sets, max 180 days
- weekly: up to 26 sets, max 180 days

Change-Id: I59c550e5728fcb83f247b0c958f21209d927ee98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Implement the latest changes in job specs 02/28102/11
Tibor Frank [Wed, 29 Jul 2020 13:35:41 +0000 (15:35 +0200)]
Trending: Implement the latest changes in job specs

Graphs:
 - MRR
   - 2n-clx
   - 2n-skx
   - 3n-skx
   - 3n-hsw
   - 3n-tsh
 - NDRPDR
   - 2n-skx
   - 3n-skx
   - 3n-hsw
   - 2n-clx

Change-Id: Ieab26ba1d2ee56e66c5c8598c4dba240a14e53e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 40/28140/1
Jan Gelety [Thu, 23 Jul 2020 21:00:29 +0000 (23:00 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~266-ge6c3e8f0e

 - use new vpp ref build - centos7:
   20.09-rc0~266_ge6c3e8f~b9748

Change-Id: I3d173d9b67657b238f7a65e24d81f0ac8f9d0093
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoT-Rex: Add advanced stateful mode 68/27168/46
Jan Gelety [Thu, 7 May 2020 02:37:19 +0000 (04:37 +0200)]
T-Rex: Add advanced stateful mode

- provide base routines to run T-Rex in advanced stateful mode

Change-Id: Ib0dc5f2919c370753335f6446860683dc4b12d93
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: Perf stat capturing 16/28116/17
Peter Mikus [Thu, 5 Mar 2020 11:12:18 +0000 (11:12 +0000)]
Framework: Perf stat capturing

Change-Id: I3bbe1fe0073ddeead5219993675f24955e8c3dfd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoIntroduce per DUT configurable stats 59/28059/12
pmikus [Fri, 24 Jul 2020 12:57:43 +0000 (12:57 +0000)]
Introduce per DUT configurable stats

- test/suite/global
- binary logic is not working

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia3d81cbf2c5f04d1093a0a408c84a9ffc6f3eef0

3 years agoTRex stateless: Fix unidirectional tests 11/28111/2
Vratko Polak [Thu, 30 Jul 2020 11:25:33 +0000 (13:25 +0200)]
TRex stateless: Fix unidirectional tests

Change-Id: I5e101f012ae4a4383e61b274499817d146479993
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate RCA files with new findings 53/28053/5
Vratko Polak [Wed, 29 Jul 2020 12:33:10 +0000 (14:33 +0200)]
Update RCA files with new findings

Change-Id: I0db4d513cdc84c6f8c1e2dffa46cd41e13df5b21
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoAnsible: Nomad 0.12.0 upgrade 00/28100/1
pmikus [Wed, 29 Jul 2020 09:09:00 +0000 (09:09 +0000)]
Ansible: Nomad 0.12.0 upgrade

+ random fixes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icb320d1ba4bbe3b5f99956cf8e89c2a29e114e41

3 years agoSoak: Avoid a possible deadlock. 81/28081/3
Vratko Polak [Tue, 28 Jul 2020 14:38:55 +0000 (16:38 +0200)]
Soak: Avoid a possible deadlock.

Change-Id: I31c2d7744b5cd3021132fb188480b8edec74986c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agovsap: install ab using ansible 30/28030/2
Xiaolong Jiang [Wed, 22 Jul 2020 09:28:27 +0000 (17:28 +0800)]
vsap: install ab using ansible

Signed-off-by: Xiaolong Jiang <xiaolongx.jiang@intel.com>
Change-Id: I275ad9dccc02e6b1f1c791fabf8896fb03acb3fb

3 years agoDocs testing_in_vagrant: add header sections and make command line codes more readable 58/28058/3
Martin Balaz [Fri, 24 Jul 2020 10:08:07 +0000 (12:08 +0200)]
Docs testing_in_vagrant: add header sections and make command line codes more readable

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: I0b8fdaad1e68e41e4a436d9f2fc566d8896adbd6
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
3 years agoDoc: Update durations of test runs 56/27756/11
Tibor Frank [Wed, 1 Jul 2020 12:31:42 +0000 (14:31 +0200)]
Doc: Update durations of test runs

Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 69/28069/1
Jan Gelety [Tue, 21 Jul 2020 21:44:26 +0000 (23:44 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~243-gc72995dd7

 - use new vpp ref build - centos7:
   20.09-rc0~243_gc72995d~b9727

Change-Id: Ib37d4a51bee9782077c537531d67e91ac52a358d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoNDRPDR: Allow smaller min_rate, 9001 pps 37/28037/5
Vratko Polak [Fri, 24 Jul 2020 11:55:53 +0000 (13:55 +0200)]
NDRPDR: Allow smaller min_rate, 9001 pps

+ Latency measurements need more than 9000 pps.
- Previously 0% measurement used 9500 pps.

Change-Id: Ic0841de096dfa8a61329f98aa1ba6d3f0ce60c66
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agojob-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrn 18/28018/3
Tibor Frank [Tue, 21 Jul 2020 11:57:31 +0000 (13:57 +0200)]
job-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrn

Change-Id: Icfecc2b9576d1be32c78f6b0019b64d6f401745e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 55/28055/1
Tibor Frank [Fri, 24 Jul 2020 05:14:07 +0000 (07:14 +0200)]
Report 2005: Add data

Change-Id: Id91ac52634fbf4c6b931a61946eb7a9d8019dd76
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoansible nomad: install htop 40/28040/2
Dave Wallace [Wed, 22 Jul 2020 17:22:13 +0000 (17:22 +0000)]
ansible nomad: install htop

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I0549e9b5ac6769e3fc760ab2047d89a188baa36a

3 years agoFIX: Log required cli_cmd not "cli_inband" 20/28020/3
Jan Gelety [Mon, 20 Jul 2020 22:13:53 +0000 (00:13 +0200)]
FIX: Log required cli_cmd not "cli_inband"

Change-Id: If0975b1d54882390c5be418927e2961d0f4c8429
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoperpatch: Echo MAKE_PARALLEL_* var before build 21/27821/5
Juraj Linkeš [Mon, 1 Jun 2020 06:22:42 +0000 (08:22 +0200)]
perpatch: Echo MAKE_PARALLEL_* var before build

VPP uses MAKE_PARALLEL_FLAGS or MAKE_PARALLEL_JOBS to limit the number
of cpus to use during build, so emit a line on stdout if it's used.

Change-Id: I669398d474d172abb6c848a45f24f1bdd56990d8
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Configure rls2005.31, add data 45/28045/1
Tibor Frank [Thu, 23 Jul 2020 05:54:18 +0000 (07:54 +0200)]
Report 2005: Configure rls2005.31, add data

Change-Id: I87e07e334783e10dc863194f240e5dbcbf141915
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 24/28024/1
Tibor Frank [Wed, 22 Jul 2020 05:43:36 +0000 (07:43 +0200)]
Report 2005: Add data

Change-Id: Ic6574e2bb24ce4004ed8c917d9deeff9a45b37ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 16/28016/1
Jan Gelety [Mon, 20 Jul 2020 18:23:18 +0000 (20:23 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~223-g459d17bb7

 - use new vpp ref build - centos7:
   20.09-rc0~223_g459d17b~b9700

Change-Id: I369f708dc4423f6897562e2597d6296a473f77b1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport 2005: Add data 78/27978/1
Tibor Frank [Tue, 21 Jul 2020 07:54:24 +0000 (09:54 +0200)]
Report 2005: Add data

Change-Id: I677f2aa67bcd51a31509aefacbe9c428578beec5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 75/27975/1
Tibor Frank [Mon, 20 Jul 2020 17:58:24 +0000 (19:58 +0200)]
Report 2005: Add data

Change-Id: I312d707aeb5feccacb393009e6cd02959ced4145
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 71/27971/1
Tibor Frank [Sun, 19 Jul 2020 19:23:08 +0000 (21:23 +0200)]
Report 2005: Add data

Change-Id: I4c674a7821a83b523a9406515849d10341a0d2ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: Align 2n-skx nfv tests with 2n-clx 15/27915/3
Tibor Frank [Wed, 15 Jul 2020 13:33:35 +0000 (15:33 +0200)]
job-specs: Align 2n-skx nfv tests with 2n-clx

Change-Id: I6c828ee146bab8ebdb24be6b03369f6e772d25c8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 56/27956/1
Tibor Frank [Fri, 17 Jul 2020 06:59:45 +0000 (08:59 +0200)]
Report 2005: Add data

Change-Id: I1d1b802481449c29056e541752228c47a6e3ea72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoRemove remains of WRK tests 75/27875/3
Tibor Frank [Mon, 13 Jul 2020 12:08:13 +0000 (14:08 +0200)]
Remove remains of WRK tests

Change-Id: If61783fb717757c6189f06924412bd079e15a08f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: CSIT annoyances II 49/27949/2
pmikus [Thu, 16 Jul 2020 14:21:35 +0000 (14:21 +0000)]
FIX: CSIT annoyances II

- useless code

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I65dd0f4e1744e4ff84661cd38a67d4490c9733e7

3 years agoFIX: CSIT annoyances I. 48/27948/2
pmikus [Thu, 16 Jul 2020 14:18:20 +0000 (14:18 +0000)]
FIX: CSIT annoyances I.

- As time flies

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If4cc9575b3fa828ad598b524c8cbf943c623b485

3 years agoAdd ADL plugin to cop tests 47/27947/2
Vratko Polak [Thu, 16 Jul 2020 12:54:37 +0000 (14:54 +0200)]
Add ADL plugin to cop tests

The following VPP change renames and moves
COP functionality into a brand new plugin:
https://gerrit.fd.io/r/c/vpp/+/27916

In a subsequent change we should rename tests
and start using the new API messages.
This change is just a minimal edit to avoid test failures.

Change-Id: I1c4b81060dd533ef447f3cc44443b71c5e524d59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data 44/27944/1
Tibor Frank [Thu, 16 Jul 2020 11:47:35 +0000 (13:47 +0200)]
Report 2005: Add data

Change-Id: I24215fa78d3ee9affb301d22c655b925dbb5bc14
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Configure 2005.30, add data 14/27914/2
Tibor Frank [Wed, 15 Jul 2020 12:04:11 +0000 (14:04 +0200)]
Report 2005: Configure 2005.30, add data

Change-Id: I33908f6967e89e894560fd5f63c57a76c110e9ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add pdf version 11/27911/1
Tibor Frank [Wed, 15 Jul 2020 08:31:13 +0000 (10:31 +0200)]
Report 2005: Add pdf version

Change-Id: I020559c4782b98700dfe5606a80695a1cfecbdcf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: 2n-clx, 2n-skx, 3n-skx RCA edits in comparison tables 79/27879/3
Maciek Konstantynowicz [Mon, 13 Jul 2020 16:14:16 +0000 (18:14 +0200)]
report: 2n-clx, 2n-skx, 3n-skx RCA edits in comparison tables

Change-Id: I9810b0b33355d880b606d7402564a3150d12397c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport: Updated vpp performance tests release notes 06/27906/2
Maciek Konstantynowicz [Tue, 14 Jul 2020 10:09:14 +0000 (12:09 +0200)]
report: Updated vpp performance tests release notes

Change-Id: I1028f4fc9d0f38d70ba8b838a66f74274e534a40
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport 2005: Fix legend in comparison tables 05/27905/2
Tibor Frank [Tue, 14 Jul 2020 09:31:09 +0000 (11:31 +0200)]
Report 2005: Fix legend in comparison tables

Change-Id: I79265bb14c6daf75944ed596c21b9929f8524333
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add soak tests 81/27881/1
Tibor Frank [Tue, 14 Jul 2020 06:02:38 +0000 (08:02 +0200)]
Report 2005: Add soak tests

Change-Id: Ib56215e906afba34d52b390ebc5a2d58bab4bf71
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add NFV tests 73/27873/6
Tibor Frank [Mon, 13 Jul 2020 11:42:13 +0000 (13:42 +0200)]
Report 2005: Add NFV tests

- 2n-skx - ndrpdr, mrr
- 2n-clx - ndrpdr, mrr

Change-Id: I75f78a3986b17bb03187a4cc91260c4a60a7d515
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: remove wrk tests 80/27880/1
Tibor Frank [Mon, 13 Jul 2020 19:15:50 +0000 (21:15 +0200)]
Report: remove wrk tests

Change-Id: Ie3f6ad2e4b5542e915f310c7b9ebeddf88b6fd8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: updated environment versioning section 74/27874/4
Maciek Konstantynowicz [Mon, 13 Jul 2020 12:02:24 +0000 (14:02 +0200)]
report: updated environment versioning section

Change-Id: I95adc8730d379286511398754042ad88b8c7d681
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Improve vnf_service_chains_reconf.rst 41/27541/7
Vratko Polak [Thu, 25 Jun 2020 12:50:16 +0000 (14:50 +0200)]
Report: Improve vnf_service_chains_reconf.rst

+ Use the quantity name from methodology (not from test implementation).

Change-Id: Ic46f0447af840b392fe5dbbfec2bd11a847b06ca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: vpp_performance_tests/overview.rst 38/27538/6
Vratko Polak [Thu, 25 Jun 2020 12:26:45 +0000 (14:26 +0200)]
Report: vpp_performance_tests/overview.rst

Change-Id: I1c5c1a26574861e22485e7b40e19304bb635bc4a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoDocs: Update TRex information 76/27876/2
Vratko Polak [Mon, 13 Jul 2020 12:32:08 +0000 (14:32 +0200)]
Docs: Update TRex information

The previous was describing CSIT version 3.

+ Stateless profile is now under GPL directory.

Change-Id: I9810ca224159053386557493eaf90b4aa682710e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoRCA 2005: Update status in RCA files 57/27857/4
Vratko Polak [Fri, 10 Jul 2020 19:06:04 +0000 (21:06 +0200)]
RCA 2005: Update status in RCA files

CSIT-1738, CSIT-1740 and CSIT-1741 are now DONE.

Change-Id: Id9b93ace9464a7e6af64f7860ad1a15c7a287a53
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoRCA: Improve footnotes for ACL VPP. 54/27854/3
Vratko Polak [Fri, 10 Jul 2020 11:58:40 +0000 (13:58 +0200)]
RCA: Improve footnotes for ACL VPP.

+ Stateful ends with single l.

Change-Id: I7be89b3f536d05ed9b21ba8849a4eef33259d312
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoSoak: Do not allow negative loss 97/27297/5
Vratko Polak [Mon, 13 Jul 2020 10:17:44 +0000 (12:17 +0200)]
Soak: Do not allow negative loss

Change-Id: I6da359d25edc415e44263d3f85f166369e564987
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add reconf tests 70/27870/2
Tibor Frank [Mon, 13 Jul 2020 10:48:02 +0000 (12:48 +0200)]
Report 2005: Add reconf tests

Change-Id: Ic9466d4c0e6fb757e7d7c01d1aa83a59c1389371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoSoak: Fix worker exception passing 96/27296/4
Vratko Polak [Wed, 27 May 2020 18:45:26 +0000 (20:45 +0200)]
Soak: Fix worker exception passing

Change-Id: I636f020e97df1b37ac8b6a30af511eebe611b56f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoSoak: Fix failure condition 67/27267/4
Vratko Polak [Tue, 26 May 2020 11:57:08 +0000 (13:57 +0200)]
Soak: Fix failure condition

Previously, number of directions was not taken into account.
Also, ideally PLRsearch never reports value under the hard minimum,
so successful results are now required to be more than 10% better.

Change-Id: I8622726b97bd1da3e139c8044a2932837fc268b7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 66/27866/2
Jan Gelety [Thu, 9 Jul 2020 09:28:37 +0000 (11:28 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~194-g52e9aaf0b

 - use new vpp ref build - centos7:
   20.09-rc0~193_gea7e708~b9670
   (build 20.09-rc0~197 not uploaded to packagecloud.io)

Change-Id: I3a6e284daf67e826eda184aa7a9af1dd3b7a6043
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport 2005: Fix titles in test env 69/27869/1
Tibor Frank [Mon, 13 Jul 2020 08:47:54 +0000 (10:47 +0200)]
Report 2005: Fix titles in test env

Change-Id: I55e7a596d5fa23531e68d7ace9364411c3c372fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 67/27867/1
Tibor Frank [Mon, 13 Jul 2020 08:19:28 +0000 (10:19 +0200)]
Report 2005: Add data

- perf-iter-3n-tsh - 1 run
- perf-cov-3n-hsw - 35 runs

Change-Id: I9951cd2aa1883efa944b5c16b3b736761c1ff64f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Configure rls2005.39 65/27865/1
Tibor Frank [Mon, 13 Jul 2020 07:17:03 +0000 (09:17 +0200)]
Report 2005: Configure rls2005.39

Change-Id: I7ea2e004b79d47420f6a1e0beb88731529b03706
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: fixed misplaced environment versioning section 62/27862/3
Maciek Konstantynowicz [Fri, 10 Jul 2020 16:49:27 +0000 (18:49 +0200)]
report: fixed misplaced environment versioning section

Change-Id: Id0da363b376e12dac583f95624ed6525b24290eb
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoDocs: job-specs: dpdk and nfv-density test sets 50/27850/2
Tibor Frank [Fri, 10 Jul 2020 07:24:02 +0000 (09:24 +0200)]
Docs: job-specs: dpdk and nfv-density test sets

+ synchronize iter dpdk test sets with coverage dpdk test sets
+ add iter nfv-density-mrr test sets

Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoRCA 2005: Update RCA files. 76/27676/9
Vratko Polak [Fri, 10 Jul 2020 10:10:01 +0000 (12:10 +0200)]
RCA 2005: Update RCA files.

+ Current state.
+ Covers skx (also 3n) and clx.
+ Specific Jira sub-tasks, even for VPP progressions.
- Only 2n-skx data for NDR.

Change-Id: I56cf870aedc1319891b7188268ff6cf7bc744ff8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoreport: added versioning sub-section to VPP Test Environment section 46/27846/3
Maciek Konstantynowicz [Thu, 9 Jul 2020 19:56:19 +0000 (21:56 +0200)]
report: added versioning sub-section to VPP Test Environment section

Change-Id: I59a93c0594ab5e5f0e267cacdf03d1f345e02b29
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>