csit.git
2 years agoReport: Add rls data 58/33258/1
Tibor Frank [Tue, 27 Jul 2021 08:54:40 +0000 (10:54 +0200)]
Report: Add rls data

Change-Id: Ia101a6d412473d957a81d794f34f1c1d2ad58abb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoAnsible: fix multiple shell commands 53/33253/2
Juraj Linkeš [Mon, 26 Jul 2021 13:29:30 +0000 (15:29 +0200)]
Ansible: fix multiple shell commands

Ansible passes "&&" as arguments to the command being called, which
prevents us from using it for calling multiple commands in one ansible
task. Fix by replacing this with "with_items".

Change-Id: Ie07a1b1969bda9569cf82ef0741ec52260e2c736
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoUpdate VPP_STABLE_VER files 08/33208/3
Tibor Frank [Mon, 26 Jul 2021 08:32:26 +0000 (08:32 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1a70a930709da39bceb0bc6d77402bb40a6368d1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoInfra: Terraform add ansible plugin init 52/33252/2
pmikus [Mon, 26 Jul 2021 12:54:58 +0000 (12:54 +0000)]
Infra: Terraform add ansible plugin init

+ Manual override

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If296d28dc3eaa023c935a0887a14ac10e83076ba

2 years agoTrending: Save latency data in csv files 84/33184/9
Tibor Frank [Tue, 20 Jul 2021 08:19:09 +0000 (10:19 +0200)]
Trending: Save latency data in csv files

Change-Id: I397dc1711f52324c158c775522cfef3044724ad7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: configure rls2106.30 50/33250/1
Tibor Frank [Mon, 26 Jul 2021 12:32:13 +0000 (14:32 +0200)]
Report: configure rls2106.30

Change-Id: If1af4d7c5865a7466eda5c2de18d07ff9491d458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add af-xdp data 39/33239/2
Tibor Frank [Fri, 23 Jul 2021 09:49:17 +0000 (11:49 +0200)]
Report: Add af-xdp data

Change-Id: I8beef5f0072e0c52476a8053f26640c537422a63
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoDocs: Firmware upgrades on TG nodes 41/33241/4
pmikus [Fri, 23 Jul 2021 13:56:17 +0000 (13:56 +0000)]
Docs: Firmware upgrades on TG nodes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6460d17d4811038ed1246570b7641a90804ee03

2 years agoAnsible: iavf driver install 40/33240/2
Juraj Linkeš [Fri, 23 Jul 2021 11:20:52 +0000 (13:20 +0200)]
Ansible: iavf driver install

* move iavf driver install from vpp_device to intel role
* differentiate the names of tasks of various drivers to get better
ansible logs
* add .5 sleep when creating VFs with iavf to avoid improper init
* fix install commands
* add XL710QDA2 NIC to supported i40e NICs

Change-Id: Id50e1552a322b9473e58222bfed3405d2d73c824
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoTrending: Add exception handling for anomalies classification 38/33238/1
Tibor Frank [Fri, 23 Jul 2021 09:05:04 +0000 (11:05 +0200)]
Trending: Add exception handling for anomalies classification

Change-Id: I6f2ee7552c513ccf2fa453f143dd52ea880bd412
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 17/33217/2
Tibor Frank [Wed, 21 Jul 2021 06:12:33 +0000 (08:12 +0200)]
Report: Add rls data

Change-Id: Id234d16ebbca84b663f23d295accddaf8c045417
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add af-xdp 26/33226/4
Tibor Frank [Wed, 21 Jul 2021 13:13:42 +0000 (15:13 +0200)]
Report: Add af-xdp

- elements(tput, speed-up)
- static content (tput, speedup)
- data
- Latency

Change-Id: I793fd4e6e6b189d93a267635b8bf07baad19accd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: IPsec udir methodology 44/33144/2
Juraj Linkeš [Thu, 15 Jul 2021 09:27:03 +0000 (11:27 +0200)]
Report: IPsec udir methodology

Update IPsec uni-directional tests methodology.
Remove Deep SPD Policy section as these tests are not in the report.

Change-Id: Idca538a03a05e12130c7d786c098b218fa88f7ef
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoInfra: Add mnaser ssh-key 32/33232/2
pmikus [Thu, 22 Jul 2021 09:01:10 +0000 (09:01 +0000)]
Infra: Add mnaser ssh-key

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia4869d0fecb68dc828ad3732dbfe0279afeba648

2 years agoTrending: Add graph with statistics 51/33151/15
Tibor Frank [Tue, 13 Jul 2021 06:47:31 +0000 (08:47 +0200)]
Trending: Add graph with statistics

- x-axis: time [MM-DD]
- y-axis: nr of passed/failed tests
- y-axis: build duration

Change-Id: I269af5a728a32d02ffcdecc7e25138ad1a183c4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFramework: increase framework setup timeout 76/33176/2
Juraj Linkeš [Mon, 19 Jul 2021 10:25:32 +0000 (12:25 +0200)]
Framework: increase framework setup timeout

With increasing number of tests the amount of time needed to extract the
framework also increases. Double the timeout to leave some headroom as
well.

Change-Id: Ia012272a9a33f2d5d346277cc982e10603a4d3db
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoUpdate VPP_STABLE_VER files 14/33114/4
Tibor Frank [Mon, 19 Jul 2021 07:28:49 +0000 (07:28 +0000)]
Update VPP_STABLE_VER files

Change-Id: I03478151d4d9e0a0c47edb155abade8fdbf01455
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPerf: Enable af_xdp for Intel x500 series 28/33228/1
pmikus [Wed, 21 Jul 2021 13:43:32 +0000 (13:43 +0000)]
Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If45e592aeade12fe643791b431adc860a745be3d

2 years agoAnsible: i40e driver install 16/33216/3
pmikus [Wed, 21 Jul 2021 06:11:02 +0000 (06:11 +0000)]
Ansible: i40e driver install

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib0e1b37e3d920f8d9a9e88896b6898fe13e4acba

2 years agoPerf: Enable af_xdp for Intel x500 series 25/33225/1
pmikus [Wed, 21 Jul 2021 12:17:21 +0000 (12:17 +0000)]
Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I331fe9134c62594189ca231349ab4c5ba43b51e5

2 years agojob_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs 93/33193/2
Maciek Konstantynowicz [Tue, 20 Jul 2021 16:08:22 +0000 (17:08 +0100)]
job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node ThunderX2 testbeds.
- NICs covered: xl710.

Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs 90/33190/3
Maciek Konstantynowicz [Tue, 20 Jul 2021 15:38:32 +0000 (16:38 +0100)]
job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Skylake testbeds.
- NICs covered: x710, xxv710.

Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs 91/33191/3
Maciek Konstantynowicz [Tue, 20 Jul 2021 15:51:16 +0000 (16:51 +0100)]
job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Zen2 testbeds.
- NICs covered: x710, xxv710.

Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoFIX: Testbed driver and firmware versions 18/33218/1
pmikus [Wed, 21 Jul 2021 06:20:26 +0000 (06:20 +0000)]
FIX: Testbed driver and firmware versions

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2bb08a3cd7f2138ab98b3c4dacdd1dc46ac8b523

2 years agoFIX: Mellanox 82/33182/1
pmikus [Tue, 20 Jul 2021 07:04:31 +0000 (07:04 +0000)]
FIX: Mellanox

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6aba0123c1f79e5c2acbac07503f74fc0050f472

2 years agojob-spec: Fix af-xdp mlr iterative job spec 72/33172/1
Tibor Frank [Mon, 19 Jul 2021 07:18:39 +0000 (09:18 +0200)]
job-spec: Fix af-xdp mlr iterative job spec

Change-Id: I012d504309eea97edac7f11bd22935bb8325f988
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 59/33159/3
Tibor Frank [Fri, 16 Jul 2021 06:21:20 +0000 (08:21 +0200)]
Report: Add rls data

Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs 65/33165/3
Maciek Konstantynowicz [Fri, 16 Jul 2021 12:09:56 +0000 (13:09 +0100)]
job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Cascadelake testbeds only.
- NICs covered: x710, xxv710 only.

Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Remove missing latency graphs 49/33149/3
Tibor Frank [Thu, 15 Jul 2021 11:20:46 +0000 (13:20 +0200)]
Report: Remove missing latency graphs

- they were not generated as the tests failed
- Fixed legend in dpdk comparison tables

Change-Id: Idd57c1702c883d4f6ece470310e823f5885a9bce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Configure rls2106.29, add data 41/33141/1
Tibor Frank [Thu, 15 Jul 2021 07:52:14 +0000 (09:52 +0200)]
Report: Configure rls2106.29, add data

Change-Id: Ib51ee05d67a5a6506367b9f194441be50f360d38
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: Typo's in perf suites 40/33140/1
pmikus [Thu, 15 Jul 2021 06:51:42 +0000 (06:51 +0000)]
FIX: Typo's in perf suites

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I770bb2114d92bda4ab2408be9b075263c1cd2223

2 years agoReport: Add rls data 31/33131/2
Tibor Frank [Wed, 14 Jul 2021 12:40:02 +0000 (14:40 +0200)]
Report: Add rls data

Change-Id: I013515f98c3aaa4b347d61dd2c815f2ac67d56f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add per thread resources allocation methodology 85/33085/8
pmikus [Mon, 12 Jul 2021 14:47:17 +0000 (14:47 +0000)]
Report: Add per thread resources allocation methodology

Per thread resources include:
- pcores and lcores.
- RxQs.
- TxQs.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64b418a99673bf05b37a9e97be4aaa80e4ffb835
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoreport: update to rls notes and add methodology sections TODO placeholders 27/33127/3
Maciek Konstantynowicz [Wed, 14 Jul 2021 10:35:35 +0000 (11:35 +0100)]
report: update to rls notes and add methodology sections TODO placeholders

- Update VPP and DPDK rls notes.
- Added methodology sections TODO placeholders
  - IPsec with Async Crypto Feature Workers
  - IPsec Uni-Directional Tests
  - IPsec Deep SPD Policy Tests
  - GTPU Tunnels

Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Add data, set archiving and pdf version 23/33123/1
Tibor Frank [Wed, 14 Jul 2021 09:46:16 +0000 (11:46 +0200)]
Report: Add data, set archiving and pdf version

Change-Id: Iaa1ef8bd12f536723d6894fbf86acfe280929ade
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 20/33120/1
Tibor Frank [Wed, 14 Jul 2021 07:55:40 +0000 (09:55 +0200)]
Report: Add rls data

Change-Id: I6a133fd2fe99ec851d2eb0c5b5cc52a5169522c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Fix links to graphs in hoststack section 92/33092/1
Tibor Frank [Tue, 13 Jul 2021 07:19:41 +0000 (09:19 +0200)]
Report: Fix links to graphs in hoststack section

Change-Id: If75297ecb4c55b2a1c40dffbe354d77c537e905f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 90/33090/1
Tibor Frank [Tue, 13 Jul 2021 07:10:22 +0000 (09:10 +0200)]
Report: Add rls data

Change-Id: I0167c72751aa5deae576335bbf91f62557ea8526
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHoststack report content 41/32941/4
Dave Wallace [Mon, 28 Jun 2021 21:36:30 +0000 (17:36 -0400)]
Hoststack report content

- Methodology section
- Align dynamic content structure with methodology section

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I852c0f8147947dd8418de5fc2fdbd16a1c1e2057

2 years agojob-spec: Add hoststack and vsap 27/32727/8
Tibor Frank [Tue, 15 Jun 2021 08:34:51 +0000 (10:34 +0200)]
job-spec: Add hoststack and vsap

+ hoststack
+ vsap (cps, rps)
+ add e810cq to common.sh

Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoreport: add 2n-icx and 3n-icx testbed documentation 64/33064/6
Maciek Konstantynowicz [Thu, 8 Jul 2021 14:47:53 +0000 (15:47 +0100)]
report: add 2n-icx and 3n-icx testbed documentation

Add:
- Physical testbeds description in Introduction.
  - Add physical topology diagrams.
- VPP pre-release 21.06 version used in Intel labs for CSIT tests.

Change-Id: I3c17402de8c657f66ea840c9d8692212cbf0501a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoIETF: Update MLRsearch draft 70/33070/22
Vratko Polak [Mon, 12 Jul 2021 17:52:26 +0000 (19:52 +0200)]
IETF: Update MLRsearch draft

Change-Id: I591b76b72868697242cfbece8f569dc82128ed85
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTox: Move logs to archive also on -1 82/33082/2
Vratko Polak [Mon, 12 Jul 2021 14:53:50 +0000 (16:53 +0200)]
Tox: Move logs to archive also on -1

Change-Id: Id29925da9c8e0bc0a28a9f4d38c332852c687317
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Add rls data 80/33080/1
Tibor Frank [Mon, 12 Jul 2021 08:58:32 +0000 (10:58 +0200)]
Report: Add rls data

Change-Id: Id69117a538294622a9c24efc9fb41aa70d61fedd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 54/33054/2
Tibor Frank [Mon, 12 Jul 2021 05:22:52 +0000 (05:22 +0000)]
Update VPP_STABLE_VER files

Change-Id: I5cfd5539b52824176703fe34e5c79134898140ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCI-MAN: Unify backups 73/33073/5
pmikus [Fri, 9 Jul 2021 17:41:54 +0000 (17:41 +0000)]
CI-MAN: Unify backups

+ tox must follow the $WORKSPACE/archives rule

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I717afded894c3a5468bbf5013b242be5e1a9cb6e

2 years agoReport: Add rls data 68/33068/1
Tibor Frank [Fri, 9 Jul 2021 07:01:16 +0000 (09:01 +0200)]
Report: Add rls data

Change-Id: I950a9b3ba9066d1552649cbd4031a2ba1cf14ccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoInfra: Bump minio server 59/33059/2
pmikus [Thu, 8 Jul 2021 11:57:52 +0000 (11:57 +0000)]
Infra: Bump minio server

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib3cbf35c6ed1ed221c7c74e74494b188bd106a92

2 years agoPAL: Process sh run from telemetry 26/33026/3
Tibor Frank [Wed, 7 Jul 2021 09:52:02 +0000 (11:52 +0200)]
PAL: Process sh run from telemetry

Change-Id: I62ef60362f2921122c2f71e4f90c10cdc7185e1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 3n-tsh reduce number of report coverage tests 34/33034/3
Maciek Konstantynowicz [Wed, 7 Jul 2021 16:27:24 +0000 (17:27 +0100)]
job_specs: 3n-tsh reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 3n-dnv reduce number of report coverage tests 32/33032/3
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:26:41 +0000 (14:26 +0100)]
job_specs: 3n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-zn2 reduce number of report coverage tests 31/33031/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:16:40 +0000 (14:16 +0100)]
job_specs: 2n-zn2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 3n-skx reduce number of report coverage tests 33/33033/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 15:00:05 +0000 (16:00 +0100)]
job_specs: 3n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoInfra: AWS Jenkins Integration 24/33024/6
pmikus [Wed, 7 Jul 2021 06:02:57 +0000 (06:02 +0000)]
Infra: AWS Jenkins Integration

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c

2 years agoReport: Add rls data 57/33057/1
Tibor Frank [Thu, 8 Jul 2021 06:52:16 +0000 (08:52 +0200)]
Report: Add rls data

Change-Id: I336d3d291be38dbc6483386945e0edcdca4a9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 2n-tx2 reduce number of report coverage tests 30/33030/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 12:05:00 +0000 (13:05 +0100)]
job_specs: 2n-tx2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-skx reduce number of report coverage tests 28/33028/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 11:45:21 +0000 (12:45 +0100)]
job_specs: 2n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-dnv reduce number of report coverage tests 27/33027/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 10:59:16 +0000 (11:59 +0100)]
job_specs: 2n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Add rls data 29/33029/1
Tibor Frank [Wed, 7 Jul 2021 11:59:35 +0000 (13:59 +0200)]
Report: Add rls data

Change-Id: I82522a17b1b3b919adc6de28772d4323c57b0b2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 2n-clx reduce number of report coverage tests 52/32452/5
Maciek Konstantynowicz [Wed, 26 May 2021 13:46:14 +0000 (14:46 +0100)]
job_specs: 2n-clx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Publish icx results 17/33017/2
Tibor Frank [Tue, 6 Jul 2021 12:36:07 +0000 (14:36 +0200)]
Report: Publish icx results

Change-Id: Iea22c61f97e62743b4a99b961290a7f722496162
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 25/33025/2
Tibor Frank [Wed, 7 Jul 2021 07:29:37 +0000 (09:29 +0200)]
Report: Add rls data

Change-Id: I47f36db2b42c3d12c3173fc336fead94fe626abe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTelemetry: Add node info 16/33016/3
pmikus [Tue, 6 Jul 2021 12:31:26 +0000 (12:31 +0000)]
Telemetry: Add node info

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I428bf2628f5d6b87d335de415a82d6e94867d8c0

2 years agoDocs: DPDK release notes 11/33011/1
pmikus [Tue, 6 Jul 2021 10:47:26 +0000 (10:47 +0000)]
Docs: DPDK release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie7c009d541fbedf7513b7decac9839eb4a98e520

2 years agoDocs: Update release notes 10/33010/1
pmikus [Tue, 6 Jul 2021 10:35:09 +0000 (10:35 +0000)]
Docs: Update release notes

- Add AVF issue.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic0830df665de20466c7bd4ab80b3ea597005b4e1

2 years agoUpdate VPP_STABLE_VER files 92/32992/2
Tibor Frank [Tue, 6 Jul 2021 04:53:45 +0000 (04:53 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ie14f4f955b9e28de9c334998e4db6798734de717
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add gtpu tests 64/32964/1
Tibor Frank [Thu, 1 Jul 2021 08:39:33 +0000 (10:39 +0200)]
Report: Add gtpu tests

Change-Id: I0c48f48a927bb75554f0d9eca4f32f0a3dc30d20
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Change Throughput to Tput in graphs titles 58/32958/1
Tibor Frank [Wed, 30 Jun 2021 11:44:45 +0000 (13:44 +0200)]
Report: Change Throughput to Tput in graphs titles

Change-Id: Icbd23f4c7339765985f1614debeadf1f4332753a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Implement changes from job-specs 47/32947/2
Tibor Frank [Tue, 29 Jun 2021 11:58:59 +0000 (13:58 +0200)]
Report: Implement changes from job-specs

Change-Id: Id9497ae02eb47fed40b9e4c33b98a81c34b71964
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add re-test data 43/32943/1
Tibor Frank [Tue, 29 Jun 2021 05:08:56 +0000 (07:08 +0200)]
Report: Add re-test data

Change-Id: Ifa6bc912d4b0dd5c377ebe1654bff694c0c006e7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrendig: Change the priority of data sources 37/32937/1
Tibor Frank [Mon, 28 Jun 2021 12:15:33 +0000 (14:15 +0200)]
Trendig: Change the priority of data sources

Change-Id: Iee015d717034fd08e86037e5800fbe8231cbd89a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Hide re-test data in cmp tbls for tsh, tx2 36/32936/1
Tibor Frank [Mon, 28 Jun 2021 11:56:26 +0000 (13:56 +0200)]
Report: Hide re-test data in cmp tbls for tsh, tx2

Change-Id: I7cf8a819f5fbd84882006ec0ca1891b38b2fb58d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 14/32914/1
Tibor Frank [Mon, 28 Jun 2021 10:30:26 +0000 (12:30 +0200)]
Report: Add rc2 data

Change-Id: I71f1d3957073b5fee66cd38efde003cf19b36396
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Process sh-run from telemetry 02/32902/3
Tibor Frank [Fri, 25 Jun 2021 11:56:43 +0000 (13:56 +0200)]
PAL: Process sh-run from telemetry

Change-Id: Ia1a3427609b284d0036dfe3b2ffbb17a9b4f8a65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 21/32921/2
Tibor Frank [Mon, 28 Jun 2021 04:26:21 +0000 (04:26 +0000)]
Update VPP_STABLE_VER files

Change-Id: I4a7729a86c4ade435c8c18aba043e583c4fa16fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoMetrics: Fix timestamps, they were not epoch 83/32883/4
Vratko Polak [Thu, 24 Jun 2021 17:40:38 +0000 (19:40 +0200)]
Metrics: Fix timestamps, they were not epoch

Library documentation [0] says this about monotonic():

  The reference point of the returned value is undefined,
  so that only the difference between the results of two calls is valid.

Switching to time().

[0] https://docs.python.org/3/library/time.html

Change-Id: Ia7ef8d89119f7dc72619cac44b213611163ff054
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoPerf actions: Skip vpp-runtime in stat_pre_trial 44/32844/9
Vratko Polak [Thu, 24 Jun 2021 10:39:32 +0000 (12:39 +0200)]
Perf actions: Skip vpp-runtime in stat_pre_trial

The list of actions stat_pre_trial is executed
after the list stat_runtime, which already contains vpp-runtime.

Change-Id: If9b403f38b2f811d77f36d9cae973130f30015da
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Fix typo in spec 92/32792/2
Tibor Frank [Wed, 23 Jun 2021 08:42:51 +0000 (08:42 +0000)]
Report: Fix typo in spec

Change-Id: I19ad258be06e30bfb31e9178d646be93ac733cec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 62/32862/1
Tibor Frank [Wed, 23 Jun 2021 08:26:12 +0000 (10:26 +0200)]
Report: Add rc2 data

Change-Id: Id7fc6305c09cfc32fbeb59f723828443d70b4ab9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Do not read sh run for trending 43/32843/2
Tibor Frank [Tue, 22 Jun 2021 11:49:05 +0000 (13:49 +0200)]
PAL: Do not read sh run for trending

Change-Id: I0e142c1c3bb48ddeb0bcd2bfa11c0323461c1368
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrending: Remove 3n-hsw from dynamic content 41/32841/1
Tibor Frank [Tue, 22 Jun 2021 11:31:29 +0000 (13:31 +0200)]
Trending: Remove 3n-hsw from dynamic content

Change-Id: I65cfc9a7730d6b154d6085d5f817a7023f994bba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoJSON: Implement latest changes 17/32817/5
Tibor Frank [Mon, 21 Jun 2021 14:34:23 +0000 (16:34 +0200)]
JSON: Implement latest changes

Change-Id: Ife5feacad6885427066a5b28978f25965394b557
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 27/32827/1
Tibor Frank [Tue, 22 Jun 2021 07:27:17 +0000 (09:27 +0200)]
Report: Add rc2 data

Change-Id: I24e16127179ebda53cf35260d436332101c79706
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFrameworkSetup: fix timeout in Arm setup 02/32802/2
Juraj Linkeš [Mon, 21 Jun 2021 06:19:06 +0000 (08:19 +0200)]
FrameworkSetup: fix timeout in Arm setup

Framework extraction in Arm jobs is taking longer than the current
timeout. Increase the timeout to fix this.

Change-Id: Iaddbbe9690eabbed47b19d5264a4f4502e5ed948
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoReport: Add rc2 data 06/32806/1
Tibor Frank [Mon, 21 Jun 2021 10:29:29 +0000 (12:29 +0200)]
Report: Add rc2 data

Change-Id: I032a897f7724a978b96ec7533f505bedfa0c03d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 05/32805/2
Tibor Frank [Mon, 21 Jun 2021 10:21:30 +0000 (12:21 +0200)]
Report: Add rc2 data

Change-Id: I177c3237088c5f12288c463a2d6f1b690533079c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 77/32777/2
Tibor Frank [Mon, 21 Jun 2021 05:14:52 +0000 (05:14 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7bd79638800034f4a0329a197000661ca81c1b3a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCore: Rework CPU allocation 87/32687/12
pmikus [Fri, 11 Jun 2021 13:06:34 +0000 (13:06 +0000)]
Core: Rework CPU allocation

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6826add7b3032041632c3952c45a3c64409400b0

2 years agoTraffic scripts: Move valid_ipv* to a library 30/32730/5
Vratko Polak [Thu, 17 Jun 2021 12:03:43 +0000 (14:03 +0200)]
Traffic scripts: Move valid_ipv* to a library

No need to implement the same two functions in 5 places.

Change-Id: I7bbcfaba18030a0520aaef5dcf06ed155bcf806b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Add rc1 data 59/32759/1
Tibor Frank [Thu, 17 Jun 2021 11:22:47 +0000 (13:22 +0200)]
Report: Add rc1 data

Change-Id: Iedc10183e127167fefcfa8369e33b344b20b5d28
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTraffic scripts: Fix docstrings 29/32729/3
Vratko Polak [Wed, 16 Jun 2021 10:58:22 +0000 (12:58 +0200)]
Traffic scripts: Fix docstrings

The IP address checking functions do not raise the exceptions listed,
they except them and return False.

Change-Id: I74e52b65bac99c8ca8679d4cc6395067ccc6a961
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoLine length: Fix recent merges 21/32421/5
Vratko Polak [Tue, 15 Jun 2021 12:35:41 +0000 (14:35 +0200)]
Line length: Fix recent merges

Not fixing .rst, .md, .yaml, conf.py, .vat, and so on.

Change-Id: Icc585d6dbebc8eb5c483b10326302571e94c614d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoip6lisp: Do not fail on string overhead value 70/32570/3
Vratko Polak [Tue, 15 Jun 2021 11:06:32 +0000 (13:06 +0200)]
ip6lisp: Do not fail on string overhead value

+ Set overhead in those suites to numeric values.
+ Change the library to tolerate string representations anyway.

Change-Id: Ic6215840f7797801c994a38db5637999eb85a034
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agojob_specs: reduce number of report coverage tests for ipsec 19/32719/3
Maciek Konstantynowicz [Mon, 14 Jun 2021 13:12:00 +0000 (15:12 +0200)]
job_specs: reduce number of report coverage tests for ipsec

Remove:
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: I1443f35b7bf852fd665e8856d05bf04b9827913f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: disable reconf plots 43/32743/1
Tibor Frank [Wed, 16 Jun 2021 10:10:54 +0000 (12:10 +0200)]
Report: disable reconf plots

Change-Id: I983d521142b5725aab43d20a1bf9c8837c0e23af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add vsap 33/32733/2
Tibor Frank [Tue, 15 Jun 2021 12:24:26 +0000 (14:24 +0200)]
Report: Add vsap

Change-Id: I3e8719ab2da0d9b4ae1b24c6b8479724064c8dce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Update Infra sections 26/32726/2
pmikus [Tue, 15 Jun 2021 07:57:50 +0000 (07:57 +0000)]
Report: Update Infra sections

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I14aa6f64b2621ad306e1cd79fafefe94dd1ed85a

2 years agoReport: Add RC1 data 16/32716/1
Tibor Frank [Mon, 14 Jun 2021 11:33:20 +0000 (13:33 +0200)]
Report: Add RC1 data

Change-Id: I8bb69b896438c84cdd280e781697773b8cf91475
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: vpp_device ignore packets list 93/32693/2
pmikus [Mon, 14 Jun 2021 08:15:25 +0000 (08:15 +0000)]
FIX: vpp_device ignore packets list

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifda8fcb102661e7c585bc5fe3a16113ae629d516

2 years agoFIX: eval expression 94/32694/1
pmikus [Mon, 14 Jun 2021 08:42:02 +0000 (08:42 +0000)]
FIX: eval expression

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I746a40af0a051978706e7c696d391a051133145f