csit.git
2 years agoUpdate VPP_STABLE_VER files 79/33279/2
Tibor Frank [Mon, 2 Aug 2021 05:33:05 +0000 (05:33 +0000)]
Update VPP_STABLE_VER files

Change-Id: I58d6d5b86516ee81c9fca0ce4738b695ca4ba1e1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Add s3-logs 71/33171/3
pmikus [Mon, 19 Jul 2021 06:53:00 +0000 (06:53 +0000)]
PAL: Add s3-logs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia8cc2c59a84a61263b2cf88af16f6fd7bad637a8

2 years agoCSIT-1782: 4c AVF tests are failing 57/33257/5
pmikus [Tue, 27 Jul 2021 07:24:04 +0000 (07:24 +0000)]
CSIT-1782: 4c AVF tests are failing

+ Implement temporary ugly workaround as I cannot do
  driver upgrade now after discussions with PTL.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I400e3b61bd831b9c9820b1fab8852118f2d48f0e

2 years agoIPsec: add nth matching SPD entry outbound TCs 08/32308/38
Juraj Linkeš [Thu, 24 Jun 2021 15:58:23 +0000 (17:58 +0200)]
IPsec: add nth matching SPD entry outbound TCs

Add testcases with plain ipv4 forwarding with 1, 10, 100 and 1000 SPD
entries on outbound traffic in both directions both directions. Only
match the last SPD entry and process others before the matching entry.
Add testcases only without flow cache optimization.
Refactor the Python functions that add SPD entries:
- Unify the args in functions that add one and multiple entries.
- For multiple entries, add the ability to pass an object that will
handle how values in each iteration (i.e. for each entry) are modified.

Change-Id: I061922eec6acc75a4e115202c07e72d89bf1f4d3
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoInfra: upgrade monitoring solution 74/33274/2
pmikus [Wed, 28 Jul 2021 10:44:43 +0000 (10:44 +0000)]
Infra: upgrade monitoring solution

+ bump versions
- remove cadvisor

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3de95531f1b09f7254152254e92f225dde653e45

2 years agoReport: Add rls data 71/33271/1
Tibor Frank [Wed, 28 Jul 2021 06:42:47 +0000 (08:42 +0200)]
Report: Add rls data

Change-Id: I2ad71d35bb2503adbe10cf3e7982e883339a4fee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: Executable bit for ansible plugin 59/33259/4
pmikus [Tue, 27 Jul 2021 10:11:21 +0000 (10:11 +0000)]
FIX: Executable bit for ansible plugin

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2416a9682710441d098acfff50e943ac3f788500

2 years agoReport: Add rls data 58/33258/1
Tibor Frank [Tue, 27 Jul 2021 08:54:40 +0000 (10:54 +0200)]
Report: Add rls data

Change-Id: Ia101a6d412473d957a81d794f34f1c1d2ad58abb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoAnsible: fix multiple shell commands 53/33253/2
Juraj Linkeš [Mon, 26 Jul 2021 13:29:30 +0000 (15:29 +0200)]
Ansible: fix multiple shell commands

Ansible passes "&&" as arguments to the command being called, which
prevents us from using it for calling multiple commands in one ansible
task. Fix by replacing this with "with_items".

Change-Id: Ie07a1b1969bda9569cf82ef0741ec52260e2c736
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoUpdate VPP_STABLE_VER files 08/33208/3
Tibor Frank [Mon, 26 Jul 2021 08:32:26 +0000 (08:32 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1a70a930709da39bceb0bc6d77402bb40a6368d1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoInfra: Terraform add ansible plugin init 52/33252/2
pmikus [Mon, 26 Jul 2021 12:54:58 +0000 (12:54 +0000)]
Infra: Terraform add ansible plugin init

+ Manual override

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If296d28dc3eaa023c935a0887a14ac10e83076ba

2 years agoTrending: Save latency data in csv files 84/33184/9
Tibor Frank [Tue, 20 Jul 2021 08:19:09 +0000 (10:19 +0200)]
Trending: Save latency data in csv files

Change-Id: I397dc1711f52324c158c775522cfef3044724ad7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: configure rls2106.30 50/33250/1
Tibor Frank [Mon, 26 Jul 2021 12:32:13 +0000 (14:32 +0200)]
Report: configure rls2106.30

Change-Id: If1af4d7c5865a7466eda5c2de18d07ff9491d458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add af-xdp data 39/33239/2
Tibor Frank [Fri, 23 Jul 2021 09:49:17 +0000 (11:49 +0200)]
Report: Add af-xdp data

Change-Id: I8beef5f0072e0c52476a8053f26640c537422a63
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoDocs: Firmware upgrades on TG nodes 41/33241/4
pmikus [Fri, 23 Jul 2021 13:56:17 +0000 (13:56 +0000)]
Docs: Firmware upgrades on TG nodes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6460d17d4811038ed1246570b7641a90804ee03

2 years agoAnsible: iavf driver install 40/33240/2
Juraj Linkeš [Fri, 23 Jul 2021 11:20:52 +0000 (13:20 +0200)]
Ansible: iavf driver install

* move iavf driver install from vpp_device to intel role
* differentiate the names of tasks of various drivers to get better
ansible logs
* add .5 sleep when creating VFs with iavf to avoid improper init
* fix install commands
* add XL710QDA2 NIC to supported i40e NICs

Change-Id: Id50e1552a322b9473e58222bfed3405d2d73c824
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoTrending: Add exception handling for anomalies classification 38/33238/1
Tibor Frank [Fri, 23 Jul 2021 09:05:04 +0000 (11:05 +0200)]
Trending: Add exception handling for anomalies classification

Change-Id: I6f2ee7552c513ccf2fa453f143dd52ea880bd412
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 17/33217/2
Tibor Frank [Wed, 21 Jul 2021 06:12:33 +0000 (08:12 +0200)]
Report: Add rls data

Change-Id: Id234d16ebbca84b663f23d295accddaf8c045417
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add af-xdp 26/33226/4
Tibor Frank [Wed, 21 Jul 2021 13:13:42 +0000 (15:13 +0200)]
Report: Add af-xdp

- elements(tput, speed-up)
- static content (tput, speedup)
- data
- Latency

Change-Id: I793fd4e6e6b189d93a267635b8bf07baad19accd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: IPsec udir methodology 44/33144/2
Juraj Linkeš [Thu, 15 Jul 2021 09:27:03 +0000 (11:27 +0200)]
Report: IPsec udir methodology

Update IPsec uni-directional tests methodology.
Remove Deep SPD Policy section as these tests are not in the report.

Change-Id: Idca538a03a05e12130c7d786c098b218fa88f7ef
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoInfra: Add mnaser ssh-key 32/33232/2
pmikus [Thu, 22 Jul 2021 09:01:10 +0000 (09:01 +0000)]
Infra: Add mnaser ssh-key

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia4869d0fecb68dc828ad3732dbfe0279afeba648

2 years agoTrending: Add graph with statistics 51/33151/15
Tibor Frank [Tue, 13 Jul 2021 06:47:31 +0000 (08:47 +0200)]
Trending: Add graph with statistics

- x-axis: time [MM-DD]
- y-axis: nr of passed/failed tests
- y-axis: build duration

Change-Id: I269af5a728a32d02ffcdecc7e25138ad1a183c4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFramework: increase framework setup timeout 76/33176/2
Juraj Linkeš [Mon, 19 Jul 2021 10:25:32 +0000 (12:25 +0200)]
Framework: increase framework setup timeout

With increasing number of tests the amount of time needed to extract the
framework also increases. Double the timeout to leave some headroom as
well.

Change-Id: Ia012272a9a33f2d5d346277cc982e10603a4d3db
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoUpdate VPP_STABLE_VER files 14/33114/4
Tibor Frank [Mon, 19 Jul 2021 07:28:49 +0000 (07:28 +0000)]
Update VPP_STABLE_VER files

Change-Id: I03478151d4d9e0a0c47edb155abade8fdbf01455
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPerf: Enable af_xdp for Intel x500 series 28/33228/1
pmikus [Wed, 21 Jul 2021 13:43:32 +0000 (13:43 +0000)]
Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If45e592aeade12fe643791b431adc860a745be3d

2 years agoAnsible: i40e driver install 16/33216/3
pmikus [Wed, 21 Jul 2021 06:11:02 +0000 (06:11 +0000)]
Ansible: i40e driver install

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib0e1b37e3d920f8d9a9e88896b6898fe13e4acba

2 years agoPerf: Enable af_xdp for Intel x500 series 25/33225/1
pmikus [Wed, 21 Jul 2021 12:17:21 +0000 (12:17 +0000)]
Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I331fe9134c62594189ca231349ab4c5ba43b51e5

2 years agojob_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs 93/33193/2
Maciek Konstantynowicz [Tue, 20 Jul 2021 16:08:22 +0000 (17:08 +0100)]
job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node ThunderX2 testbeds.
- NICs covered: xl710.

Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs 90/33190/3
Maciek Konstantynowicz [Tue, 20 Jul 2021 15:38:32 +0000 (16:38 +0100)]
job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Skylake testbeds.
- NICs covered: x710, xxv710.

Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs 91/33191/3
Maciek Konstantynowicz [Tue, 20 Jul 2021 15:51:16 +0000 (16:51 +0100)]
job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Zen2 testbeds.
- NICs covered: x710, xxv710.

Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoFIX: Testbed driver and firmware versions 18/33218/1
pmikus [Wed, 21 Jul 2021 06:20:26 +0000 (06:20 +0000)]
FIX: Testbed driver and firmware versions

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2bb08a3cd7f2138ab98b3c4dacdd1dc46ac8b523

2 years agoFIX: Mellanox 82/33182/1
pmikus [Tue, 20 Jul 2021 07:04:31 +0000 (07:04 +0000)]
FIX: Mellanox

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6aba0123c1f79e5c2acbac07503f74fc0050f472

2 years agojob-spec: Fix af-xdp mlr iterative job spec 72/33172/1
Tibor Frank [Mon, 19 Jul 2021 07:18:39 +0000 (09:18 +0200)]
job-spec: Fix af-xdp mlr iterative job spec

Change-Id: I012d504309eea97edac7f11bd22935bb8325f988
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 59/33159/3
Tibor Frank [Fri, 16 Jul 2021 06:21:20 +0000 (08:21 +0200)]
Report: Add rls data

Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs 65/33165/3
Maciek Konstantynowicz [Fri, 16 Jul 2021 12:09:56 +0000 (13:09 +0100)]
job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Cascadelake testbeds only.
- NICs covered: x710, xxv710 only.

Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Remove missing latency graphs 49/33149/3
Tibor Frank [Thu, 15 Jul 2021 11:20:46 +0000 (13:20 +0200)]
Report: Remove missing latency graphs

- they were not generated as the tests failed
- Fixed legend in dpdk comparison tables

Change-Id: Idd57c1702c883d4f6ece470310e823f5885a9bce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Configure rls2106.29, add data 41/33141/1
Tibor Frank [Thu, 15 Jul 2021 07:52:14 +0000 (09:52 +0200)]
Report: Configure rls2106.29, add data

Change-Id: Ib51ee05d67a5a6506367b9f194441be50f360d38
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: Typo's in perf suites 40/33140/1
pmikus [Thu, 15 Jul 2021 06:51:42 +0000 (06:51 +0000)]
FIX: Typo's in perf suites

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I770bb2114d92bda4ab2408be9b075263c1cd2223

2 years agoReport: Add rls data 31/33131/2
Tibor Frank [Wed, 14 Jul 2021 12:40:02 +0000 (14:40 +0200)]
Report: Add rls data

Change-Id: I013515f98c3aaa4b347d61dd2c815f2ac67d56f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add per thread resources allocation methodology 85/33085/8
pmikus [Mon, 12 Jul 2021 14:47:17 +0000 (14:47 +0000)]
Report: Add per thread resources allocation methodology

Per thread resources include:
- pcores and lcores.
- RxQs.
- TxQs.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64b418a99673bf05b37a9e97be4aaa80e4ffb835
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoreport: update to rls notes and add methodology sections TODO placeholders 27/33127/3
Maciek Konstantynowicz [Wed, 14 Jul 2021 10:35:35 +0000 (11:35 +0100)]
report: update to rls notes and add methodology sections TODO placeholders

- Update VPP and DPDK rls notes.
- Added methodology sections TODO placeholders
  - IPsec with Async Crypto Feature Workers
  - IPsec Uni-Directional Tests
  - IPsec Deep SPD Policy Tests
  - GTPU Tunnels

Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Add data, set archiving and pdf version 23/33123/1
Tibor Frank [Wed, 14 Jul 2021 09:46:16 +0000 (11:46 +0200)]
Report: Add data, set archiving and pdf version

Change-Id: Iaa1ef8bd12f536723d6894fbf86acfe280929ade
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 20/33120/1
Tibor Frank [Wed, 14 Jul 2021 07:55:40 +0000 (09:55 +0200)]
Report: Add rls data

Change-Id: I6a133fd2fe99ec851d2eb0c5b5cc52a5169522c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Fix links to graphs in hoststack section 92/33092/1
Tibor Frank [Tue, 13 Jul 2021 07:19:41 +0000 (09:19 +0200)]
Report: Fix links to graphs in hoststack section

Change-Id: If75297ecb4c55b2a1c40dffbe354d77c537e905f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 90/33090/1
Tibor Frank [Tue, 13 Jul 2021 07:10:22 +0000 (09:10 +0200)]
Report: Add rls data

Change-Id: I0167c72751aa5deae576335bbf91f62557ea8526
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHoststack report content 41/32941/4
Dave Wallace [Mon, 28 Jun 2021 21:36:30 +0000 (17:36 -0400)]
Hoststack report content

- Methodology section
- Align dynamic content structure with methodology section

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I852c0f8147947dd8418de5fc2fdbd16a1c1e2057

2 years agojob-spec: Add hoststack and vsap 27/32727/8
Tibor Frank [Tue, 15 Jun 2021 08:34:51 +0000 (10:34 +0200)]
job-spec: Add hoststack and vsap

+ hoststack
+ vsap (cps, rps)
+ add e810cq to common.sh

Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoreport: add 2n-icx and 3n-icx testbed documentation 64/33064/6
Maciek Konstantynowicz [Thu, 8 Jul 2021 14:47:53 +0000 (15:47 +0100)]
report: add 2n-icx and 3n-icx testbed documentation

Add:
- Physical testbeds description in Introduction.
  - Add physical topology diagrams.
- VPP pre-release 21.06 version used in Intel labs for CSIT tests.

Change-Id: I3c17402de8c657f66ea840c9d8692212cbf0501a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoIETF: Update MLRsearch draft 70/33070/22
Vratko Polak [Mon, 12 Jul 2021 17:52:26 +0000 (19:52 +0200)]
IETF: Update MLRsearch draft

Change-Id: I591b76b72868697242cfbece8f569dc82128ed85
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTox: Move logs to archive also on -1 82/33082/2
Vratko Polak [Mon, 12 Jul 2021 14:53:50 +0000 (16:53 +0200)]
Tox: Move logs to archive also on -1

Change-Id: Id29925da9c8e0bc0a28a9f4d38c332852c687317
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Add rls data 80/33080/1
Tibor Frank [Mon, 12 Jul 2021 08:58:32 +0000 (10:58 +0200)]
Report: Add rls data

Change-Id: Id69117a538294622a9c24efc9fb41aa70d61fedd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 54/33054/2
Tibor Frank [Mon, 12 Jul 2021 05:22:52 +0000 (05:22 +0000)]
Update VPP_STABLE_VER files

Change-Id: I5cfd5539b52824176703fe34e5c79134898140ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCI-MAN: Unify backups 73/33073/5
pmikus [Fri, 9 Jul 2021 17:41:54 +0000 (17:41 +0000)]
CI-MAN: Unify backups

+ tox must follow the $WORKSPACE/archives rule

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I717afded894c3a5468bbf5013b242be5e1a9cb6e

2 years agoReport: Add rls data 68/33068/1
Tibor Frank [Fri, 9 Jul 2021 07:01:16 +0000 (09:01 +0200)]
Report: Add rls data

Change-Id: I950a9b3ba9066d1552649cbd4031a2ba1cf14ccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoInfra: Bump minio server 59/33059/2
pmikus [Thu, 8 Jul 2021 11:57:52 +0000 (11:57 +0000)]
Infra: Bump minio server

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib3cbf35c6ed1ed221c7c74e74494b188bd106a92

2 years agoPAL: Process sh run from telemetry 26/33026/3
Tibor Frank [Wed, 7 Jul 2021 09:52:02 +0000 (11:52 +0200)]
PAL: Process sh run from telemetry

Change-Id: I62ef60362f2921122c2f71e4f90c10cdc7185e1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 3n-tsh reduce number of report coverage tests 34/33034/3
Maciek Konstantynowicz [Wed, 7 Jul 2021 16:27:24 +0000 (17:27 +0100)]
job_specs: 3n-tsh reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 3n-dnv reduce number of report coverage tests 32/33032/3
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:26:41 +0000 (14:26 +0100)]
job_specs: 3n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-zn2 reduce number of report coverage tests 31/33031/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:16:40 +0000 (14:16 +0100)]
job_specs: 2n-zn2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 3n-skx reduce number of report coverage tests 33/33033/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 15:00:05 +0000 (16:00 +0100)]
job_specs: 3n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoInfra: AWS Jenkins Integration 24/33024/6
pmikus [Wed, 7 Jul 2021 06:02:57 +0000 (06:02 +0000)]
Infra: AWS Jenkins Integration

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c

2 years agoReport: Add rls data 57/33057/1
Tibor Frank [Thu, 8 Jul 2021 06:52:16 +0000 (08:52 +0200)]
Report: Add rls data

Change-Id: I336d3d291be38dbc6483386945e0edcdca4a9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 2n-tx2 reduce number of report coverage tests 30/33030/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 12:05:00 +0000 (13:05 +0100)]
job_specs: 2n-tx2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-skx reduce number of report coverage tests 28/33028/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 11:45:21 +0000 (12:45 +0100)]
job_specs: 2n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-dnv reduce number of report coverage tests 27/33027/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 10:59:16 +0000 (11:59 +0100)]
job_specs: 2n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Add rls data 29/33029/1
Tibor Frank [Wed, 7 Jul 2021 11:59:35 +0000 (13:59 +0200)]
Report: Add rls data

Change-Id: I82522a17b1b3b919adc6de28772d4323c57b0b2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 2n-clx reduce number of report coverage tests 52/32452/5
Maciek Konstantynowicz [Wed, 26 May 2021 13:46:14 +0000 (14:46 +0100)]
job_specs: 2n-clx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Publish icx results 17/33017/2
Tibor Frank [Tue, 6 Jul 2021 12:36:07 +0000 (14:36 +0200)]
Report: Publish icx results

Change-Id: Iea22c61f97e62743b4a99b961290a7f722496162
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 25/33025/2
Tibor Frank [Wed, 7 Jul 2021 07:29:37 +0000 (09:29 +0200)]
Report: Add rls data

Change-Id: I47f36db2b42c3d12c3173fc336fead94fe626abe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTelemetry: Add node info 16/33016/3
pmikus [Tue, 6 Jul 2021 12:31:26 +0000 (12:31 +0000)]
Telemetry: Add node info

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I428bf2628f5d6b87d335de415a82d6e94867d8c0

2 years agoDocs: DPDK release notes 11/33011/1
pmikus [Tue, 6 Jul 2021 10:47:26 +0000 (10:47 +0000)]
Docs: DPDK release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie7c009d541fbedf7513b7decac9839eb4a98e520

2 years agoDocs: Update release notes 10/33010/1
pmikus [Tue, 6 Jul 2021 10:35:09 +0000 (10:35 +0000)]
Docs: Update release notes

- Add AVF issue.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic0830df665de20466c7bd4ab80b3ea597005b4e1

2 years agoUpdate VPP_STABLE_VER files 92/32992/2
Tibor Frank [Tue, 6 Jul 2021 04:53:45 +0000 (04:53 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ie14f4f955b9e28de9c334998e4db6798734de717
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add gtpu tests 64/32964/1
Tibor Frank [Thu, 1 Jul 2021 08:39:33 +0000 (10:39 +0200)]
Report: Add gtpu tests

Change-Id: I0c48f48a927bb75554f0d9eca4f32f0a3dc30d20
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Change Throughput to Tput in graphs titles 58/32958/1
Tibor Frank [Wed, 30 Jun 2021 11:44:45 +0000 (13:44 +0200)]
Report: Change Throughput to Tput in graphs titles

Change-Id: Icbd23f4c7339765985f1614debeadf1f4332753a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Implement changes from job-specs 47/32947/2
Tibor Frank [Tue, 29 Jun 2021 11:58:59 +0000 (13:58 +0200)]
Report: Implement changes from job-specs

Change-Id: Id9497ae02eb47fed40b9e4c33b98a81c34b71964
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add re-test data 43/32943/1
Tibor Frank [Tue, 29 Jun 2021 05:08:56 +0000 (07:08 +0200)]
Report: Add re-test data

Change-Id: Ifa6bc912d4b0dd5c377ebe1654bff694c0c006e7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrendig: Change the priority of data sources 37/32937/1
Tibor Frank [Mon, 28 Jun 2021 12:15:33 +0000 (14:15 +0200)]
Trendig: Change the priority of data sources

Change-Id: Iee015d717034fd08e86037e5800fbe8231cbd89a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Hide re-test data in cmp tbls for tsh, tx2 36/32936/1
Tibor Frank [Mon, 28 Jun 2021 11:56:26 +0000 (13:56 +0200)]
Report: Hide re-test data in cmp tbls for tsh, tx2

Change-Id: I7cf8a819f5fbd84882006ec0ca1891b38b2fb58d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 14/32914/1
Tibor Frank [Mon, 28 Jun 2021 10:30:26 +0000 (12:30 +0200)]
Report: Add rc2 data

Change-Id: I71f1d3957073b5fee66cd38efde003cf19b36396
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Process sh-run from telemetry 02/32902/3
Tibor Frank [Fri, 25 Jun 2021 11:56:43 +0000 (13:56 +0200)]
PAL: Process sh-run from telemetry

Change-Id: Ia1a3427609b284d0036dfe3b2ffbb17a9b4f8a65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 21/32921/2
Tibor Frank [Mon, 28 Jun 2021 04:26:21 +0000 (04:26 +0000)]
Update VPP_STABLE_VER files

Change-Id: I4a7729a86c4ade435c8c18aba043e583c4fa16fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoMetrics: Fix timestamps, they were not epoch 83/32883/4
Vratko Polak [Thu, 24 Jun 2021 17:40:38 +0000 (19:40 +0200)]
Metrics: Fix timestamps, they were not epoch

Library documentation [0] says this about monotonic():

  The reference point of the returned value is undefined,
  so that only the difference between the results of two calls is valid.

Switching to time().

[0] https://docs.python.org/3/library/time.html

Change-Id: Ia7ef8d89119f7dc72619cac44b213611163ff054
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoPerf actions: Skip vpp-runtime in stat_pre_trial 44/32844/9
Vratko Polak [Thu, 24 Jun 2021 10:39:32 +0000 (12:39 +0200)]
Perf actions: Skip vpp-runtime in stat_pre_trial

The list of actions stat_pre_trial is executed
after the list stat_runtime, which already contains vpp-runtime.

Change-Id: If9b403f38b2f811d77f36d9cae973130f30015da
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Fix typo in spec 92/32792/2
Tibor Frank [Wed, 23 Jun 2021 08:42:51 +0000 (08:42 +0000)]
Report: Fix typo in spec

Change-Id: I19ad258be06e30bfb31e9178d646be93ac733cec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 62/32862/1
Tibor Frank [Wed, 23 Jun 2021 08:26:12 +0000 (10:26 +0200)]
Report: Add rc2 data

Change-Id: Id7fc6305c09cfc32fbeb59f723828443d70b4ab9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Do not read sh run for trending 43/32843/2
Tibor Frank [Tue, 22 Jun 2021 11:49:05 +0000 (13:49 +0200)]
PAL: Do not read sh run for trending

Change-Id: I0e142c1c3bb48ddeb0bcd2bfa11c0323461c1368
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrending: Remove 3n-hsw from dynamic content 41/32841/1
Tibor Frank [Tue, 22 Jun 2021 11:31:29 +0000 (13:31 +0200)]
Trending: Remove 3n-hsw from dynamic content

Change-Id: I65cfc9a7730d6b154d6085d5f817a7023f994bba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoJSON: Implement latest changes 17/32817/5
Tibor Frank [Mon, 21 Jun 2021 14:34:23 +0000 (16:34 +0200)]
JSON: Implement latest changes

Change-Id: Ife5feacad6885427066a5b28978f25965394b557
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 27/32827/1
Tibor Frank [Tue, 22 Jun 2021 07:27:17 +0000 (09:27 +0200)]
Report: Add rc2 data

Change-Id: I24e16127179ebda53cf35260d436332101c79706
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFrameworkSetup: fix timeout in Arm setup 02/32802/2
Juraj Linkeš [Mon, 21 Jun 2021 06:19:06 +0000 (08:19 +0200)]
FrameworkSetup: fix timeout in Arm setup

Framework extraction in Arm jobs is taking longer than the current
timeout. Increase the timeout to fix this.

Change-Id: Iaddbbe9690eabbed47b19d5264a4f4502e5ed948
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoReport: Add rc2 data 06/32806/1
Tibor Frank [Mon, 21 Jun 2021 10:29:29 +0000 (12:29 +0200)]
Report: Add rc2 data

Change-Id: I032a897f7724a978b96ec7533f505bedfa0c03d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 05/32805/2
Tibor Frank [Mon, 21 Jun 2021 10:21:30 +0000 (12:21 +0200)]
Report: Add rc2 data

Change-Id: I177c3237088c5f12288c463a2d6f1b690533079c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 77/32777/2
Tibor Frank [Mon, 21 Jun 2021 05:14:52 +0000 (05:14 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7bd79638800034f4a0329a197000661ca81c1b3a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCore: Rework CPU allocation 87/32687/12
pmikus [Fri, 11 Jun 2021 13:06:34 +0000 (13:06 +0000)]
Core: Rework CPU allocation

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6826add7b3032041632c3952c45a3c64409400b0

2 years agoTraffic scripts: Move valid_ipv* to a library 30/32730/5
Vratko Polak [Thu, 17 Jun 2021 12:03:43 +0000 (14:03 +0200)]
Traffic scripts: Move valid_ipv* to a library

No need to implement the same two functions in 5 places.

Change-Id: I7bbcfaba18030a0520aaef5dcf06ed155bcf806b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Add rc1 data 59/32759/1
Tibor Frank [Thu, 17 Jun 2021 11:22:47 +0000 (13:22 +0200)]
Report: Add rc1 data

Change-Id: Iedc10183e127167fefcfa8369e33b344b20b5d28
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTraffic scripts: Fix docstrings 29/32729/3
Vratko Polak [Wed, 16 Jun 2021 10:58:22 +0000 (12:58 +0200)]
Traffic scripts: Fix docstrings

The IP address checking functions do not raise the exceptions listed,
they except them and return False.

Change-Id: I74e52b65bac99c8ca8679d4cc6395067ccc6a961
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoLine length: Fix recent merges 21/32421/5
Vratko Polak [Tue, 15 Jun 2021 12:35:41 +0000 (14:35 +0200)]
Line length: Fix recent merges

Not fixing .rst, .md, .yaml, conf.py, .vat, and so on.

Change-Id: Icc585d6dbebc8eb5c483b10326302571e94c614d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoip6lisp: Do not fail on string overhead value 70/32570/3
Vratko Polak [Tue, 15 Jun 2021 11:06:32 +0000 (13:06 +0200)]
ip6lisp: Do not fail on string overhead value

+ Set overhead in those suites to numeric values.
+ Change the library to tolerate string representations anyway.

Change-Id: Ic6215840f7797801c994a38db5637999eb85a034
Signed-off-by: Vratko Polak <vrpolak@cisco.com>