csit.git
3 months agoReport: Add icx rls data 85/33485/1
Tibor Frank [Fri, 13 Aug 2021 05:59:46 +0000 (07:59 +0200)]
Report: Add icx rls data

Change-Id: I3f16f058b257f2f4ccb48bd5ff725c9161d1176f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoInfra: AWS self termination 48/33448/1
pmikus [Wed, 11 Aug 2021 09:55:22 +0000 (09:55 +0000)]
Infra: AWS self termination

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9ecd85d1086f6be1bbaf6a6925da362cc4c1a9ad

3 months agoInfra: Add terraform no-color output. 46/33446/1
pmikus [Wed, 11 Aug 2021 07:18:46 +0000 (07:18 +0000)]
Infra: Add terraform no-color output.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I851e979c9b0db41c83facb92010c1b16885ee5a0

3 months agoreport: indexed error message added to report emails 98/32898/22
Viliam Luc [Fri, 25 Jun 2021 08:05:28 +0000 (10:05 +0200)]
report: indexed error message added to report emails

Report emails will contain error message index now.
Index assigned to error message is described at the end of report.

sample:
avf-dot1q-l2bdbasemaclrn-eth-2memif-1dcr                               25ge2p1xxv710  64b   2t1c[0] 4t2c[0] 8t4c[0]

Legend:

[0] - Failed to run 'cli_inband clear runtime' PAPI command on host xxx.xxx.xxx.xxx

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I6c71eb8a8767827e18f88a9a1142b899158a190c

3 months agoRCA: Add CSIT-1791 84/33384/2
Vratko Polak [Thu, 5 Aug 2021 15:34:40 +0000 (17:34 +0200)]
RCA: Add CSIT-1791

Change-Id: Ibe9d8265ed1dc8a9c4d480211b3292ebae986e65
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoReport: Improve RCA 34/33434/1
Vratko Polak [Tue, 10 Aug 2021 12:20:16 +0000 (14:20 +0200)]
Report: Improve RCA

First comment at VPP-1972 clarifies this is not a 2101 issue.

Change-Id: I0b9a7398c44fd8a69304f0931f245c746664c413
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoFIX: Terraform installation 29/33429/2
pmikus [Mon, 9 Aug 2021 14:54:03 +0000 (14:54 +0000)]
FIX: Terraform installation

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2963520237c0bcc30836df3722a945060bd438d3

3 months agoFIX: Terraform install 28/33428/2
pmikus [Mon, 9 Aug 2021 14:26:45 +0000 (14:26 +0000)]
FIX: Terraform install

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1bc29338bf677c5777474ea07954df4ca0ed0a31

3 months agoInfra: Install terraform 27/33427/1
pmikus [Mon, 9 Aug 2021 13:58:59 +0000 (13:58 +0000)]
Infra: Install terraform

+ Unless docker images gets updated

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9d09b24ca7bef71dad5774ae2b5e2e67e7b8f285

3 months agoMove AWS jobs specs to mrr_weekly 26/33426/1
pmikus [Mon, 9 Aug 2021 13:37:09 +0000 (13:37 +0000)]
Move AWS jobs specs to mrr_weekly

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I80c49260dab44fb9a10cb2b93b076fa3b92f692b

3 months agoInfra: Vault 62/32362/10
pmikus [Tue, 18 May 2021 13:30:08 +0000 (13:30 +0000)]
Infra: Vault

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia6e728f98d20144c3771405b32933a77fe15b19b

3 months agoUpdate VPP_STABLE_VER files 01/33401/3
Tibor Frank [Mon, 9 Aug 2021 06:59:39 +0000 (06:59 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3337973f335e7b47a591b2a630ea322d97a67c66
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Configure rls2106.32 23/33423/1
Tibor Frank [Mon, 9 Aug 2021 08:52:39 +0000 (10:52 +0200)]
Report: Configure rls2106.32

Change-Id: Ia4e7a2436e038cebaaa080dd7c86f6de1b39b018
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoVerify tags: Use suite tags 16/33416/1
Vratko Polak [Fri, 6 Aug 2021 13:48:33 +0000 (15:48 +0200)]
Verify tags: Use suite tags

When I make a typo in GERRIT_EVENT,
old code starts many ASTF tests.

Change-Id: Iac1c2cc620919d33b0e77bd28b145f3fd38d28ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoAnsible: remove 10.30.51.30 from server pool 94/33394/2
pmikus [Fri, 6 Aug 2021 11:46:33 +0000 (11:46 +0000)]
Ansible: remove 10.30.51.30 from server pool

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1e0b374b4d57e8dd0c0399cb5b32b8308a9f2285

3 months agoTrending: Fix broken graphs 82/33382/1
Tibor Frank [Thu, 5 Aug 2021 12:09:49 +0000 (14:09 +0200)]
Trending: Fix broken graphs

Change-Id: I73b9446e9e76811f88d6b0fa2ee657e7ae0ceab3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoDocs: issues added to csit_release_notes 54/33254/5
Viliam Luc [Mon, 26 Jul 2021 14:50:32 +0000 (16:50 +0200)]
Docs: issues added to csit_release_notes

Change-Id: I2e47e1c494a3d83d005c605b4a9214e8561b1b1d
Signed-off-by: Viliam Luc <vluc@cisco.com>
3 months agoreport: add nic and drivers section to physical testbeds description 31/33331/6
Maciek Konstantynowicz [Tue, 3 Aug 2021 19:51:12 +0000 (20:51 +0100)]
report: add nic and drivers section to physical testbeds description

Change-Id: I75fd902e32b290e62f7eb9fcd8b2b5b7a4b713e6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 months agoInfra: Update monitoring for new layout 35/33335/2
pmikus [Wed, 4 Aug 2021 13:11:35 +0000 (13:11 +0000)]
Infra: Update monitoring for new layout

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I299515fc676a9995e006bbb197068160044dbd98

3 months agoTrending: Set y-axis for stats to zero 34/33334/3
Tibor Frank [Wed, 4 Aug 2021 10:43:40 +0000 (12:43 +0200)]
Trending: Set y-axis for stats to zero

Change-Id: I5235d734d37709367c56878fffd3243aaba3f0b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: add gtpu tunnel description to methodology 09/33309/2
xinfeng zhao [Fri, 30 Jul 2021 06:45:18 +0000 (14:45 +0800)]
Report: add gtpu tunnel description to methodology

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I4c066713bb37e35d25b5ab1225a361e05b7a1146

3 months agoreport: update vpp rls notes with trex latency measurement issue for FVL NICs 30/33330/2
Maciek Konstantynowicz [Tue, 3 Aug 2021 18:41:25 +0000 (19:41 +0100)]
report: update vpp rls notes with trex latency measurement issue for FVL NICs

Change-Id: Ia6de51914f7d31194796538cdd81183c7a16e1d7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 months agoMethodology: Update MLRsearch descriptions 33/33333/2
Vratko Polak [Wed, 4 Aug 2021 08:26:28 +0000 (10:26 +0200)]
Methodology: Update MLRsearch descriptions

Change-Id: Icdcb7210835fa90a6f5f1688b815a6edf07a4b39
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoInfra: Decommission 3n-hsw - pxe/ansible 11/32511/12
pmikus [Tue, 1 Jun 2021 12:00:08 +0000 (12:00 +0000)]
Infra: Decommission 3n-hsw - pxe/ansible

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie3ddec5487192217d0921f892098384da73a1ef2

3 months agoTrending: Add Latency trending 62/33262/10
Tibor Frank [Tue, 27 Jul 2021 13:02:37 +0000 (15:02 +0200)]
Trending: Add Latency trending

Change-Id: I28c1f1cf113d2537f3e564cdca0fd61ef57737a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: configure rls2106.31 32/33332/1
Tibor Frank [Wed, 4 Aug 2021 07:29:01 +0000 (09:29 +0200)]
Report: configure rls2106.31

Change-Id: I9d5da2d71525b53096e9c77e9d338243b16f05c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoFIX: update VPP_STABLE_VER_UBUNTU_FOCAL 27/33327/1
Juraj Linkeš [Tue, 3 Aug 2021 11:27:18 +0000 (13:27 +0200)]
FIX: update VPP_STABLE_VER_UBUNTU_FOCAL

The current version (216) only has x86 artifacts. Move to 215 which is
the latest with both aarch64 and 86.

Change-Id: I6285e5832792d29ede51e6147b8ef3d41c652338
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 months agoReport: latency comparison 25/33325/1
Tibor Frank [Tue, 3 Aug 2021 09:03:14 +0000 (11:03 +0200)]
Report: latency comparison

Change-Id: Ic47209e1911317b6f42a7f8257309607d3a21e04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Configure 2106.31, fix latency 23/33323/1
Tibor Frank [Tue, 3 Aug 2021 05:40:23 +0000 (07:40 +0200)]
Report: Configure 2106.31, fix latency

Change-Id: I6f9e3cc3b79be84acb6b5619016a9aa7d4296e02
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoRCA: Add CSIT-1789 as a known issue 73/33273/2
Vratko Polak [Wed, 28 Jul 2021 08:44:23 +0000 (10:44 +0200)]
RCA: Add CSIT-1789 as a known issue

Change-Id: Ia01eddc69f64d7f4360cda7a612b5b8fae2c41b4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoReport: Add Latency comparison tables 20/33320/2
Tibor Frank [Mon, 2 Aug 2021 12:31:37 +0000 (14:31 +0200)]
Report: Add Latency comparison tables

Change-Id: I6774383eef9839352ed3924e7482177fd85b34e6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoFIX: init_interface driver and sr-iov 91/32891/7
Juraj Linkeš [Thu, 24 Jun 2021 14:47:55 +0000 (16:47 +0200)]
FIX: init_interface driver and sr-iov

Add checks for not unbinding a driver that is not bound and not
trying to remove VFs from interfaces not supporting SR-IOV.

Change-Id: Iae7ce37aabeadbb541fe9eac8b83b4ee18d028e6
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 months agoFIX: init interfaces for rdma-core driver 10/33310/3
Juraj Linkeš [Fri, 30 Jul 2021 08:11:12 +0000 (10:11 +0200)]
FIX: init interfaces for rdma-core driver

We're only initializing interfaces for avf and af_xdp VPP drivers. This
causes issues for the rdma-core driver when the underlying mlnx kernel
driver is not bound. Fix this so that all interfaces are properly bound
to the kernel driver required by rdma-core.

Change-Id: I204309a9bb61b56b96497a287178f0b1efe2f362
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 months agoUpdate VPP_STABLE_VER files 79/33279/2
Tibor Frank [Mon, 2 Aug 2021 05:33:05 +0000 (05:33 +0000)]
Update VPP_STABLE_VER files

Change-Id: I58d6d5b86516ee81c9fca0ce4738b695ca4ba1e1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoPAL: Add s3-logs 71/33171/3
pmikus [Mon, 19 Jul 2021 06:53:00 +0000 (06:53 +0000)]
PAL: Add s3-logs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia8cc2c59a84a61263b2cf88af16f6fd7bad637a8

4 months agoCSIT-1782: 4c AVF tests are failing 57/33257/5
pmikus [Tue, 27 Jul 2021 07:24:04 +0000 (07:24 +0000)]
CSIT-1782: 4c AVF tests are failing

+ Implement temporary ugly workaround as I cannot do
  driver upgrade now after discussions with PTL.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I400e3b61bd831b9c9820b1fab8852118f2d48f0e

4 months agoIPsec: add nth matching SPD entry outbound TCs 08/32308/38
Juraj Linkeš [Thu, 24 Jun 2021 15:58:23 +0000 (17:58 +0200)]
IPsec: add nth matching SPD entry outbound TCs

Add testcases with plain ipv4 forwarding with 1, 10, 100 and 1000 SPD
entries on outbound traffic in both directions both directions. Only
match the last SPD entry and process others before the matching entry.
Add testcases only without flow cache optimization.
Refactor the Python functions that add SPD entries:
- Unify the args in functions that add one and multiple entries.
- For multiple entries, add the ability to pass an object that will
handle how values in each iteration (i.e. for each entry) are modified.

Change-Id: I061922eec6acc75a4e115202c07e72d89bf1f4d3
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
4 months agoInfra: upgrade monitoring solution 74/33274/2
pmikus [Wed, 28 Jul 2021 10:44:43 +0000 (10:44 +0000)]
Infra: upgrade monitoring solution

+ bump versions
- remove cadvisor

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3de95531f1b09f7254152254e92f225dde653e45

4 months agoReport: Add rls data 71/33271/1
Tibor Frank [Wed, 28 Jul 2021 06:42:47 +0000 (08:42 +0200)]
Report: Add rls data

Change-Id: I2ad71d35bb2503adbe10cf3e7982e883339a4fee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoFIX: Executable bit for ansible plugin 59/33259/4
pmikus [Tue, 27 Jul 2021 10:11:21 +0000 (10:11 +0000)]
FIX: Executable bit for ansible plugin

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2416a9682710441d098acfff50e943ac3f788500

4 months agoReport: Add rls data 58/33258/1
Tibor Frank [Tue, 27 Jul 2021 08:54:40 +0000 (10:54 +0200)]
Report: Add rls data

Change-Id: Ia101a6d412473d957a81d794f34f1c1d2ad58abb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoAnsible: fix multiple shell commands 53/33253/2
Juraj Linkeš [Mon, 26 Jul 2021 13:29:30 +0000 (15:29 +0200)]
Ansible: fix multiple shell commands

Ansible passes "&&" as arguments to the command being called, which
prevents us from using it for calling multiple commands in one ansible
task. Fix by replacing this with "with_items".

Change-Id: Ie07a1b1969bda9569cf82ef0741ec52260e2c736
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
4 months agoUpdate VPP_STABLE_VER files 08/33208/3
Tibor Frank [Mon, 26 Jul 2021 08:32:26 +0000 (08:32 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1a70a930709da39bceb0bc6d77402bb40a6368d1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoInfra: Terraform add ansible plugin init 52/33252/2
pmikus [Mon, 26 Jul 2021 12:54:58 +0000 (12:54 +0000)]
Infra: Terraform add ansible plugin init

+ Manual override

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If296d28dc3eaa023c935a0887a14ac10e83076ba

4 months agoTrending: Save latency data in csv files 84/33184/9
Tibor Frank [Tue, 20 Jul 2021 08:19:09 +0000 (10:19 +0200)]
Trending: Save latency data in csv files

Change-Id: I397dc1711f52324c158c775522cfef3044724ad7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: configure rls2106.30 50/33250/1
Tibor Frank [Mon, 26 Jul 2021 12:32:13 +0000 (14:32 +0200)]
Report: configure rls2106.30

Change-Id: If1af4d7c5865a7466eda5c2de18d07ff9491d458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add af-xdp data 39/33239/2
Tibor Frank [Fri, 23 Jul 2021 09:49:17 +0000 (11:49 +0200)]
Report: Add af-xdp data

Change-Id: I8beef5f0072e0c52476a8053f26640c537422a63
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoDocs: Firmware upgrades on TG nodes 41/33241/4
pmikus [Fri, 23 Jul 2021 13:56:17 +0000 (13:56 +0000)]
Docs: Firmware upgrades on TG nodes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6460d17d4811038ed1246570b7641a90804ee03

4 months agoAnsible: iavf driver install 40/33240/2
Juraj Linkeš [Fri, 23 Jul 2021 11:20:52 +0000 (13:20 +0200)]
Ansible: iavf driver install

* move iavf driver install from vpp_device to intel role
* differentiate the names of tasks of various drivers to get better
ansible logs
* add .5 sleep when creating VFs with iavf to avoid improper init
* fix install commands
* add XL710QDA2 NIC to supported i40e NICs

Change-Id: Id50e1552a322b9473e58222bfed3405d2d73c824
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
4 months agoTrending: Add exception handling for anomalies classification 38/33238/1
Tibor Frank [Fri, 23 Jul 2021 09:05:04 +0000 (11:05 +0200)]
Trending: Add exception handling for anomalies classification

Change-Id: I6f2ee7552c513ccf2fa453f143dd52ea880bd412
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add rls data 17/33217/2
Tibor Frank [Wed, 21 Jul 2021 06:12:33 +0000 (08:12 +0200)]
Report: Add rls data

Change-Id: Id234d16ebbca84b663f23d295accddaf8c045417
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add af-xdp 26/33226/4
Tibor Frank [Wed, 21 Jul 2021 13:13:42 +0000 (15:13 +0200)]
Report: Add af-xdp

- elements(tput, speed-up)
- static content (tput, speedup)
- data
- Latency

Change-Id: I793fd4e6e6b189d93a267635b8bf07baad19accd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: IPsec udir methodology 44/33144/2
Juraj Linkeš [Thu, 15 Jul 2021 09:27:03 +0000 (11:27 +0200)]
Report: IPsec udir methodology

Update IPsec uni-directional tests methodology.
Remove Deep SPD Policy section as these tests are not in the report.

Change-Id: Idca538a03a05e12130c7d786c098b218fa88f7ef
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
4 months agoInfra: Add mnaser ssh-key 32/33232/2
pmikus [Thu, 22 Jul 2021 09:01:10 +0000 (09:01 +0000)]
Infra: Add mnaser ssh-key

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia4869d0fecb68dc828ad3732dbfe0279afeba648

4 months agoTrending: Add graph with statistics 51/33151/15
Tibor Frank [Tue, 13 Jul 2021 06:47:31 +0000 (08:47 +0200)]
Trending: Add graph with statistics

- x-axis: time [MM-DD]
- y-axis: nr of passed/failed tests
- y-axis: build duration

Change-Id: I269af5a728a32d02ffcdecc7e25138ad1a183c4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoFramework: increase framework setup timeout 76/33176/2
Juraj Linkeš [Mon, 19 Jul 2021 10:25:32 +0000 (12:25 +0200)]
Framework: increase framework setup timeout

With increasing number of tests the amount of time needed to extract the
framework also increases. Double the timeout to leave some headroom as
well.

Change-Id: Ia012272a9a33f2d5d346277cc982e10603a4d3db
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
4 months agoUpdate VPP_STABLE_VER files 14/33114/4
Tibor Frank [Mon, 19 Jul 2021 07:28:49 +0000 (07:28 +0000)]
Update VPP_STABLE_VER files

Change-Id: I03478151d4d9e0a0c47edb155abade8fdbf01455
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoPerf: Enable af_xdp for Intel x500 series 28/33228/1
pmikus [Wed, 21 Jul 2021 13:43:32 +0000 (13:43 +0000)]
Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If45e592aeade12fe643791b431adc860a745be3d

4 months agoAnsible: i40e driver install 16/33216/3
pmikus [Wed, 21 Jul 2021 06:11:02 +0000 (06:11 +0000)]
Ansible: i40e driver install

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib0e1b37e3d920f8d9a9e88896b6898fe13e4acba

4 months agoPerf: Enable af_xdp for Intel x500 series 25/33225/1
pmikus [Wed, 21 Jul 2021 12:17:21 +0000 (12:17 +0000)]
Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I331fe9134c62594189ca231349ab4c5ba43b51e5

4 months agojob_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs 93/33193/2
Maciek Konstantynowicz [Tue, 20 Jul 2021 16:08:22 +0000 (17:08 +0100)]
job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node ThunderX2 testbeds.
- NICs covered: xl710.

Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agojob_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs 90/33190/3
Maciek Konstantynowicz [Tue, 20 Jul 2021 15:38:32 +0000 (16:38 +0100)]
job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Skylake testbeds.
- NICs covered: x710, xxv710.

Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agojob_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs 91/33191/3
Maciek Konstantynowicz [Tue, 20 Jul 2021 15:51:16 +0000 (16:51 +0100)]
job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Zen2 testbeds.
- NICs covered: x710, xxv710.

Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agoFIX: Testbed driver and firmware versions 18/33218/1
pmikus [Wed, 21 Jul 2021 06:20:26 +0000 (06:20 +0000)]
FIX: Testbed driver and firmware versions

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2bb08a3cd7f2138ab98b3c4dacdd1dc46ac8b523

4 months agoFIX: Mellanox 82/33182/1
pmikus [Tue, 20 Jul 2021 07:04:31 +0000 (07:04 +0000)]
FIX: Mellanox

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6aba0123c1f79e5c2acbac07503f74fc0050f472

4 months agojob-spec: Fix af-xdp mlr iterative job spec 72/33172/1
Tibor Frank [Mon, 19 Jul 2021 07:18:39 +0000 (09:18 +0200)]
job-spec: Fix af-xdp mlr iterative job spec

Change-Id: I012d504309eea97edac7f11bd22935bb8325f988
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add rls data 59/33159/3
Tibor Frank [Fri, 16 Jul 2021 06:21:20 +0000 (08:21 +0200)]
Report: Add rls data

Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agojob_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs 65/33165/3
Maciek Konstantynowicz [Fri, 16 Jul 2021 12:09:56 +0000 (13:09 +0100)]
job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Cascadelake testbeds only.
- NICs covered: x710, xxv710 only.

Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agoReport: Remove missing latency graphs 49/33149/3
Tibor Frank [Thu, 15 Jul 2021 11:20:46 +0000 (13:20 +0200)]
Report: Remove missing latency graphs

- they were not generated as the tests failed
- Fixed legend in dpdk comparison tables

Change-Id: Idd57c1702c883d4f6ece470310e823f5885a9bce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Configure rls2106.29, add data 41/33141/1
Tibor Frank [Thu, 15 Jul 2021 07:52:14 +0000 (09:52 +0200)]
Report: Configure rls2106.29, add data

Change-Id: Ib51ee05d67a5a6506367b9f194441be50f360d38
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoFIX: Typo's in perf suites 40/33140/1
pmikus [Thu, 15 Jul 2021 06:51:42 +0000 (06:51 +0000)]
FIX: Typo's in perf suites

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I770bb2114d92bda4ab2408be9b075263c1cd2223

4 months agoReport: Add rls data 31/33131/2
Tibor Frank [Wed, 14 Jul 2021 12:40:02 +0000 (14:40 +0200)]
Report: Add rls data

Change-Id: I013515f98c3aaa4b347d61dd2c815f2ac67d56f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add per thread resources allocation methodology 85/33085/8
pmikus [Mon, 12 Jul 2021 14:47:17 +0000 (14:47 +0000)]
Report: Add per thread resources allocation methodology

Per thread resources include:
- pcores and lcores.
- RxQs.
- TxQs.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64b418a99673bf05b37a9e97be4aaa80e4ffb835
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agoreport: update to rls notes and add methodology sections TODO placeholders 27/33127/3
Maciek Konstantynowicz [Wed, 14 Jul 2021 10:35:35 +0000 (11:35 +0100)]
report: update to rls notes and add methodology sections TODO placeholders

- Update VPP and DPDK rls notes.
- Added methodology sections TODO placeholders
  - IPsec with Async Crypto Feature Workers
  - IPsec Uni-Directional Tests
  - IPsec Deep SPD Policy Tests
  - GTPU Tunnels

Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agoReport: Add data, set archiving and pdf version 23/33123/1
Tibor Frank [Wed, 14 Jul 2021 09:46:16 +0000 (11:46 +0200)]
Report: Add data, set archiving and pdf version

Change-Id: Iaa1ef8bd12f536723d6894fbf86acfe280929ade
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add rls data 20/33120/1
Tibor Frank [Wed, 14 Jul 2021 07:55:40 +0000 (09:55 +0200)]
Report: Add rls data

Change-Id: I6a133fd2fe99ec851d2eb0c5b5cc52a5169522c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Fix links to graphs in hoststack section 92/33092/1
Tibor Frank [Tue, 13 Jul 2021 07:19:41 +0000 (09:19 +0200)]
Report: Fix links to graphs in hoststack section

Change-Id: If75297ecb4c55b2a1c40dffbe354d77c537e905f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add rls data 90/33090/1
Tibor Frank [Tue, 13 Jul 2021 07:10:22 +0000 (09:10 +0200)]
Report: Add rls data

Change-Id: I0167c72751aa5deae576335bbf91f62557ea8526
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoHoststack report content 41/32941/4
Dave Wallace [Mon, 28 Jun 2021 21:36:30 +0000 (17:36 -0400)]
Hoststack report content

- Methodology section
- Align dynamic content structure with methodology section

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I852c0f8147947dd8418de5fc2fdbd16a1c1e2057

4 months agojob-spec: Add hoststack and vsap 27/32727/8
Tibor Frank [Tue, 15 Jun 2021 08:34:51 +0000 (10:34 +0200)]
job-spec: Add hoststack and vsap

+ hoststack
+ vsap (cps, rps)
+ add e810cq to common.sh

Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoreport: add 2n-icx and 3n-icx testbed documentation 64/33064/6
Maciek Konstantynowicz [Thu, 8 Jul 2021 14:47:53 +0000 (15:47 +0100)]
report: add 2n-icx and 3n-icx testbed documentation

Add:
- Physical testbeds description in Introduction.
  - Add physical topology diagrams.
- VPP pre-release 21.06 version used in Intel labs for CSIT tests.

Change-Id: I3c17402de8c657f66ea840c9d8692212cbf0501a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agoIETF: Update MLRsearch draft 70/33070/22
Vratko Polak [Mon, 12 Jul 2021 17:52:26 +0000 (19:52 +0200)]
IETF: Update MLRsearch draft

Change-Id: I591b76b72868697242cfbece8f569dc82128ed85
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoTox: Move logs to archive also on -1 82/33082/2
Vratko Polak [Mon, 12 Jul 2021 14:53:50 +0000 (16:53 +0200)]
Tox: Move logs to archive also on -1

Change-Id: Id29925da9c8e0bc0a28a9f4d38c332852c687317
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoReport: Add rls data 80/33080/1
Tibor Frank [Mon, 12 Jul 2021 08:58:32 +0000 (10:58 +0200)]
Report: Add rls data

Change-Id: Id69117a538294622a9c24efc9fb41aa70d61fedd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoUpdate VPP_STABLE_VER files 54/33054/2
Tibor Frank [Mon, 12 Jul 2021 05:22:52 +0000 (05:22 +0000)]
Update VPP_STABLE_VER files

Change-Id: I5cfd5539b52824176703fe34e5c79134898140ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoCI-MAN: Unify backups 73/33073/5
pmikus [Fri, 9 Jul 2021 17:41:54 +0000 (17:41 +0000)]
CI-MAN: Unify backups

+ tox must follow the $WORKSPACE/archives rule

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I717afded894c3a5468bbf5013b242be5e1a9cb6e

4 months agoReport: Add rls data 68/33068/1
Tibor Frank [Fri, 9 Jul 2021 07:01:16 +0000 (09:01 +0200)]
Report: Add rls data

Change-Id: I950a9b3ba9066d1552649cbd4031a2ba1cf14ccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoInfra: Bump minio server 59/33059/2
pmikus [Thu, 8 Jul 2021 11:57:52 +0000 (11:57 +0000)]
Infra: Bump minio server

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib3cbf35c6ed1ed221c7c74e74494b188bd106a92

4 months agoPAL: Process sh run from telemetry 26/33026/3
Tibor Frank [Wed, 7 Jul 2021 09:52:02 +0000 (11:52 +0200)]
PAL: Process sh run from telemetry

Change-Id: I62ef60362f2921122c2f71e4f90c10cdc7185e1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agojob_specs: 3n-tsh reduce number of report coverage tests 34/33034/3
Maciek Konstantynowicz [Wed, 7 Jul 2021 16:27:24 +0000 (17:27 +0100)]
job_specs: 3n-tsh reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agojob_specs: 3n-dnv reduce number of report coverage tests 32/33032/3
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:26:41 +0000 (14:26 +0100)]
job_specs: 3n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agojob_specs: 2n-zn2 reduce number of report coverage tests 31/33031/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:16:40 +0000 (14:16 +0100)]
job_specs: 2n-zn2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agojob_specs: 3n-skx reduce number of report coverage tests 33/33033/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 15:00:05 +0000 (16:00 +0100)]
job_specs: 3n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agoInfra: AWS Jenkins Integration 24/33024/6
pmikus [Wed, 7 Jul 2021 06:02:57 +0000 (06:02 +0000)]
Infra: AWS Jenkins Integration

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c

4 months agoReport: Add rls data 57/33057/1
Tibor Frank [Thu, 8 Jul 2021 06:52:16 +0000 (08:52 +0200)]
Report: Add rls data

Change-Id: I336d3d291be38dbc6483386945e0edcdca4a9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agojob_specs: 2n-tx2 reduce number of report coverage tests 30/33030/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 12:05:00 +0000 (13:05 +0100)]
job_specs: 2n-tx2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agojob_specs: 2n-skx reduce number of report coverage tests 28/33028/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 11:45:21 +0000 (12:45 +0100)]
job_specs: 2n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agojob_specs: 2n-dnv reduce number of report coverage tests 27/33027/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 10:59:16 +0000 (11:59 +0100)]
job_specs: 2n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 months agoReport: Add rls data 29/33029/1
Tibor Frank [Wed, 7 Jul 2021 11:59:35 +0000 (13:59 +0200)]
Report: Add rls data

Change-Id: I82522a17b1b3b919adc6de28772d4323c57b0b2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agojob_specs: 2n-clx reduce number of report coverage tests 52/32452/5
Maciek Konstantynowicz [Wed, 26 May 2021 13:46:14 +0000 (14:46 +0100)]
job_specs: 2n-clx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>