csit.git
2 years agoTrending: Add 2n-icx 09/35109/3
Tibor Frank [Thu, 27 Jan 2022 11:01:09 +0000 (12:01 +0100)]
Trending: Add 2n-icx

Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 21/35121/2
Tibor Frank [Mon, 31 Jan 2022 05:40:48 +0000 (05:40 +0000)]
Update VPP_STABLE_VER files

Change-Id: If7be325e8c10ae12a30bc3363b6d5daadc685e56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoDoc: Add discussion about common anomaly patterns 10/34910/5
Vratko Polak [Fri, 28 Jan 2022 10:06:00 +0000 (11:06 +0100)]
Doc: Add discussion about common anomaly patterns

Change-Id: Ic70c653cb660663abe48c2a0ae3e496a4e8c85f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agofix(core): 3n-icx topology 10/35110/1
Peter Mikus [Thu, 27 Jan 2022 12:24:58 +0000 (13:24 +0100)]
fix(core): 3n-icx topology

+ Temporarily disable, until investigated

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9fd0ec96fe27b674dfcc4a36df05cc9a7a1db6ab

2 years agofix(dpdk): Jumbo 07/35107/2
Peter Mikus [Thu, 27 Jan 2022 09:30:26 +0000 (10:30 +0100)]
fix(dpdk): Jumbo

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0e659937440e9ff7070f0d13b7a1db99f27cf2bb

2 years agofix(core): ICX topology file 06/35106/2
Peter Mikus [Thu, 27 Jan 2022 08:49:25 +0000 (09:49 +0100)]
fix(core): ICX topology file

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I11b6a1d953f850240e1e95e0fc9e3c2b460cd43a

2 years agoReport: Add data 05/35105/1
Tibor Frank [Thu, 27 Jan 2022 07:19:01 +0000 (08:19 +0100)]
Report: Add data

Change-Id: I1b8a3c10a065bf9f68ad855f2a892cd47af35f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add data 00/35100/1
Tibor Frank [Wed, 26 Jan 2022 09:35:11 +0000 (10:35 +0100)]
Report: Add data

Change-Id: I29e3bab8bcb57076f0eece519fa870a8645c2ce6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(core): topology files, tox 74/35074/1
Peter Mikus [Tue, 25 Jan 2022 12:13:45 +0000 (13:13 +0100)]
fix(core): topology files, tox

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I93e2035568527c2f68732a0c7fe1865d100831ad

2 years agofix(core): Remove unused stuff 73/35073/2
Peter Mikus [Tue, 25 Jan 2022 11:37:43 +0000 (12:37 +0100)]
fix(core): Remove unused stuff

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0cfc9d9fbb1a82a308231a5d2c0b12cb632c469b

2 years agotrending: fix re-pro showing wrong data 57/35057/3
Viliam Luc [Mon, 24 Jan 2022 11:59:47 +0000 (12:59 +0100)]
trending: fix re-pro showing wrong data

vpp-2n-zn2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-zn2/484, vpp version: 22.06-rc0~0-g017a67665~b2179

4t2c-avf-eth-l2bdbasemaclrn-mrr                   10ge2p1x710    64B    29.6   1  -0.2
2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.14   1  -58.08
4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.98   1  -57.73
4t4c-ethip4-ip4base-mrr                           10ge2p1x553    64B    2.97   1  -79.05
1t1c-eth-l2patch-mrr                              10ge2p1x553    64B    2.98   1  -75.94
2t2c-eth-l2bdbasemaclrn-mrr                       10ge2p1x553    64B    8.27   1  -11.0
2t1c-af-xdp-ethip4-ip4scale2m-mrr                 25ge2p1xxv710  64B    6.21   1  -53.14

vpp-2n-tx2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-tx2/265, vpp version: 22.02-rc0~508-g88a9c0e02~b851

4t2c-avf-eth-l2bdbasemaclrn-mrr                   10ge2p1x710    64B    29.6   1  -0.2
2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.14   1  -58.08
4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.98   1  -57.73
4t4c-ethip4-ip4base-mrr                           10ge2p1x553    64B    2.97   1  -79.05
1t1c-eth-l2patch-mrr                              10ge2p1x553    64B    2.98   1  -75.94
2t2c-eth-l2bdbasemaclrn-mrr                       10ge2p1x553    64B    8.27   1  -11.0
2t1c-af-xdp-ethip4-ip4scale2m-mrr                 25ge2p1xxv710  64B    6.21   1  -53.14

The same data for different TB.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iefce9a7196bae6fde45ee1935184efab4735e6e0

2 years agoReport: Add Comparison tables 70/35070/1
Tibor Frank [Tue, 25 Jan 2022 08:51:38 +0000 (09:51 +0100)]
Report: Add Comparison tables

- DPDK: 2n-tx2, 3n-tsh
- VPP: 2n-aws, 3n-aws

Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrending: Add aws 61/35061/2
Tibor Frank [Mon, 24 Jan 2022 15:13:23 +0000 (16:13 +0100)]
Trending: Add aws

Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofeat(core): Add ICX 92/34992/5
Peter Mikus [Fri, 21 Jan 2022 13:11:13 +0000 (14:11 +0100)]
feat(core): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505

2 years agoReport: Configure Report 2202 58/35058/1
Tibor Frank [Mon, 24 Jan 2022 13:31:40 +0000 (14:31 +0100)]
Report: Configure Report 2202

Change-Id: I9be8b74716b09b2395fbab95eb37877867abbc22
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 76/35076/2
Tibor Frank [Mon, 24 Jan 2022 05:25:31 +0000 (05:25 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia9d9b107ac7c10ea058e1fc0263b0461ef73ed9e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofeat(ansible): Add ICX 90/34990/1
Peter Mikus [Fri, 21 Jan 2022 11:51:39 +0000 (12:51 +0100)]
feat(ansible): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9

2 years agofeat(doc): Add ICX 81/34981/4
Peter Mikus [Thu, 20 Jan 2022 10:49:49 +0000 (11:49 +0100)]
feat(doc): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0

2 years agofeat(pxe): Add ICX 69/34969/3
Peter Mikus [Wed, 19 Jan 2022 12:53:56 +0000 (13:53 +0100)]
feat(pxe): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I96918306e280cdefb023d24ff466be7c6eab44b6

2 years agofeat(ansible): Compatibility matrix bump 79/34979/1
Peter Mikus [Thu, 20 Jan 2022 09:13:26 +0000 (10:13 +0100)]
feat(ansible): Compatibility matrix bump

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79

2 years agotrending: fix empty regressions and progressions 71/34971/2
Viliam Luc [Wed, 19 Jan 2022 14:29:23 +0000 (15:29 +0100)]
trending: fix empty regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1405c5d1dbf9e137afbc5fd5d9f83ea572613ea9

2 years agofix(vpp_device): pci address existence condition 81/34481/3
Juraj Linkeš [Fri, 12 Nov 2021 13:34:52 +0000 (14:34 +0100)]
fix(vpp_device): pci address existence condition

The function get_pci_addr could check a different PCI_ADDR in case the
netdev device directory doesn't exit. Move the check so that it always
uses the proper PCI_ADDR and add a failure case when the netdev device
directory doesn't exist.

Change-Id: Ibadfea3fba34509cd3ea8f906ac5962c0f01dd17
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agofix(ansible): Compatibility matrix 64/34964/2
Peter Mikus [Wed, 19 Jan 2022 11:09:56 +0000 (12:09 +0100)]
fix(ansible): Compatibility matrix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I298625dc75cdc6ffc168484e19ca30f02c2f46a0

2 years agoTrending: Add NAT44Det tests for 2n-zn2 62/34962/1
Tibor Frank [Wed, 19 Jan 2022 08:36:00 +0000 (09:36 +0100)]
Trending: Add NAT44Det tests for 2n-zn2

Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoDoc: Update anomaly methodology documentation 27/34627/4
Vratko Polak [Fri, 14 Jan 2022 13:26:53 +0000 (14:26 +0100)]
Doc: Update anomaly methodology documentation

+ Define currently used compliance metrics (e.g. no short term change),
+ Clarify that (and why) column names in Dashboard and Alerting
  are somewhat different from the ones in the methodology document.

Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTrending: Unify anomaly related column names 09/34909/3
Vratko Polak [Fri, 14 Jan 2022 13:25:46 +0000 (14:25 +0100)]
Trending: Unify anomaly related column names

The most recent update merged was related to alerting,
so this Change uses the new column names defined there
also in Dashboard tables and legend.

Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agotrending: new view in regressions and progressions 64/34764/16
Viliam Luc [Fri, 17 Dec 2021 14:26:36 +0000 (15:26 +0100)]
trending: new view in regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I8524319a215ff551cf67c30d0b08ddae69883f61

2 years agofix(perpatch): Correct the autogen archive name 26/34926/3
Vratko Polak [Mon, 17 Jan 2022 17:09:16 +0000 (18:09 +0100)]
fix(perpatch): Correct the autogen archive name

Change-Id: I82bc5cd69de82a2d6b6689cf3380f667ea905886
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agotrending: shorten error messages 20/34920/5
Viliam Luc [Mon, 17 Jan 2022 09:45:15 +0000 (10:45 +0100)]
trending: shorten error messages

Sometimes error messages are longer than 1000 chars. This change
looks for [;, :, '] in messages between 128 and 256 character.
If it finds any of these the error message will be cut from
beggining to this character. If there's no character from the list
in error message and message is longer than 128 chars. It will
be cut from beggining to 129 character of error message

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I283f8ee8d81422235d897370dbc9508fafda6a7f

2 years agoReport: Add 2n-tx2 ipsec tests 29/34629/3
Tibor Frank [Wed, 1 Dec 2021 14:55:10 +0000 (15:55 +0100)]
Report: Add 2n-tx2 ipsec tests

- throughput
- speedup
- todo: latency

Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoRevert "Report: Temporarily change report specs" 41/34941/2
Tibor Frank [Mon, 17 Jan 2022 13:26:56 +0000 (13:26 +0000)]
Revert "Report: Temporarily change report specs"

This reverts commit cd1f9904e173ecb34836b33cb551ab9b9d378e18.

Reason for revert: Not needed

Change-Id: Id0739d4fba2d2abadd8ee9954c724a54b39cd8a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(uti): Fixing broken code part V 12/34912/9
Peter Mikus [Fri, 14 Jan 2022 14:02:31 +0000 (15:02 +0100)]
fix(uti): Fixing broken code part V

- UTI export breaks local execution
- disabling useless tox rules

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2f610b08f06f437e4482f291fa7b47cbb7b92984

2 years agoReport: Temporarily change report specs 36/34936/2
Tibor Frank [Mon, 17 Jan 2022 10:20:13 +0000 (10:20 +0000)]
Report: Temporarily change report specs

Change-Id: Ic8724a9676c2b2c37ee4f2de4c056b770a10d5af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoRevert "Temporarily change report specs" 55/34755/1
Tibor Frank [Mon, 17 Jan 2022 10:18:03 +0000 (10:18 +0000)]
Revert "Temporarily change report specs"

This reverts commit cc04963a4ad9bfd8dce0e31fd41226fa35e5e5d6.

Reason for revert: Some data-sets missing.

Change-Id: Id2363c2a71c0e87ad3d3e206a09d7af3984a1f36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTemporarily change report specs 53/34753/2
Tibor Frank [Mon, 17 Jan 2022 09:53:03 +0000 (09:53 +0000)]
Temporarily change report specs

- to generate tables with oper data

Change-Id: I06878713cd085d72eb3b9fef0c1aae1102dfb363
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(IPsec): fix policy tests 91/34591/27
Juraj Linkeš [Fri, 26 Nov 2021 10:03:05 +0000 (11:03 +0100)]
fix(IPsec): fix policy tests

Replace the hardcoded SPD inbound/outbound ranges with values derived
from test inputs.
Add the necessary routes now that the tunnel endpoints are not in the
same subnet. Also add ip neighbor entry on DUT2 for the same reason.
Also replace ipsec sa dump with show ipsec all in teardown of tests
where both SAs and SPDs are configured to improve troubleshooting.

Change-Id: I7d89a99fcf457a701c87bf6ac07364b62802677d
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoPAL: Fix sh-run 06/34906/8
Tibor Frank [Fri, 14 Jan 2022 08:43:47 +0000 (09:43 +0100)]
PAL: Fix sh-run

- do not post-process telemetry data

Change-Id: I800a99d8e92016d1fa675b18e2b2d30db4a15077
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 50/34750/2
Tibor Frank [Mon, 17 Jan 2022 05:05:05 +0000 (05:05 +0000)]
Update VPP_STABLE_VER files

Change-Id: I686383bddec601403c2fbc11d79260f9579a7470
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoJumpAvg: Fix string format 03/34903/2
Vratko Polak [Fri, 14 Jan 2022 09:16:23 +0000 (10:16 +0100)]
JumpAvg: Fix string format

Change-Id: Id3975dfcca0040b799f31dcd14789d8c90993b14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agofix(uti): Fixing broken code part IV 86/34886/1
Peter Mikus [Wed, 12 Jan 2022 09:12:49 +0000 (10:12 +0100)]
fix(uti): Fixing broken code part IV

Part of fixing chain

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie423ccf5a51751e605d906dd1214f5174bb364ac

2 years agofeat(uti): Dash demo 72/34872/4
Peter Mikus [Mon, 10 Jan 2022 12:19:31 +0000 (13:19 +0100)]
feat(uti): Dash demo

- displays the table with trending data downloaded from trending pages

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic0d48290105ccd846c7de9ee4d8acb78e0b72f00

2 years agofix(core): Constants.py 67/34867/3
Peter Mikus [Mon, 10 Jan 2022 10:03:27 +0000 (11:03 +0100)]
fix(core): Constants.py

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia5a097797b54c2e71acdcc8d72706e5540536252

2 years agoDoc: Tweak trend analysis document 32/34532/4
Vratko Polak [Wed, 1 Dec 2021 13:45:56 +0000 (14:45 +0100)]
Doc: Tweak trend analysis document

Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 46/34746/2
Tibor Frank [Mon, 10 Jan 2022 06:15:50 +0000 (06:15 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1b4b92a69a31c3a934acb6e305631eeb9152ef31
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(uti): Fixing broken code part III 89/34789/5
pmikus [Wed, 22 Dec 2021 13:29:53 +0000 (14:29 +0100)]
fix(uti): Fixing broken code part III

Part of fixing chain after early merge.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I06e19def003575993bc3d97c0dc7fbedd3e5ff7a

2 years agoUpdate VPP_STABLE_VER files 45/34745/2
Tibor Frank [Fri, 7 Jan 2022 06:08:10 +0000 (06:08 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ic468388973a84b00bf3f62de88bf65c1f37d780f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 44/34744/2
Tibor Frank [Mon, 27 Dec 2021 06:34:02 +0000 (06:34 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7a91fd0d8bbfcfffa2a4ae9c6873826b56299e22
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 43/34743/2
Tibor Frank [Thu, 23 Dec 2021 08:03:37 +0000 (08:03 +0000)]
Update VPP_STABLE_VER files

Change-Id: I2ff994b6eb9a2b87d4ea99f861a5b47b15a5d642
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(uti): Fixing broken code part II 87/34787/2
pmikus [Wed, 22 Dec 2021 11:38:26 +0000 (12:38 +0100)]
fix(uti): Fixing broken code part II

Part of fixing chain after early merge.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I983b3036a388656bbad91aba71cf14b503f875bd

2 years agofeat(telemetry): show hardware 83/34783/3
pmikus [Wed, 22 Dec 2021 08:49:25 +0000 (09:49 +0100)]
feat(telemetry): show hardware

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0c0bf055e5963ac794f66cce9d5d45bb628facee

2 years agofix(uti): Fixing broken code part I 81/34781/2
pmikus [Wed, 22 Dec 2021 07:24:24 +0000 (08:24 +0100)]
fix(uti): Fixing broken code part I

Part of fixing chain after early merge.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624

2 years agoadd 2-node ipsec hwasync cases 00/34600/3
xinfeng zhao [Mon, 29 Nov 2021 03:59:52 +0000 (11:59 +0800)]
add 2-node ipsec hwasync cases

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I1590d438216e4c886aae03f83364837153623dbc

2 years agoansible: match vpp device config to perf config 56/34556/2
Juraj Linkeš [Thu, 26 Aug 2021 08:43:45 +0000 (10:43 +0200)]
ansible: match vpp device config to perf config

We're not using unsafe noiommu on perf testbeds and we should mirror
that config in vpp device.
As a side note, on arm vpp device, enabling unsafe noiommu leads to
corrupted packets, so it must be disabled at least on arm vpp device.

Also update arm vpp device kernel parameters to match perf testbeds.

Change-Id: Id3d3e8fcf71583cc04887b4180cd20561856d902
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agofeat(infra): DPDK 21.11 78/34778/2
pmikus [Tue, 21 Dec 2021 09:34:45 +0000 (10:34 +0100)]
feat(infra): DPDK 21.11

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib52fab112d458decfecf39c77085bcd85f811eba

2 years agofeat(infra): Add new compatibility matrix 77/34777/1
pmikus [Tue, 21 Dec 2021 09:23:49 +0000 (10:23 +0100)]
feat(infra): Add new compatibility matrix

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64deff93308771c2b3fc2e07fa8f2614b5e4ac9a

2 years agoansible: add kernel pinning to vpp device 79/34479/4
Juraj Linkeš [Fri, 12 Nov 2021 12:31:12 +0000 (13:31 +0100)]
ansible: add kernel pinning to vpp device

Change-Id: Ife26766e5f92ab95b537b39c25202fec6be27db3
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agotrending: hotfix failing trending emails 56/34756/4
Viliam Luc [Thu, 16 Dec 2021 08:22:43 +0000 (09:22 +0100)]
trending: hotfix failing trending emails

Legend was showing for each job_name. When trying to fix it
we broke the cpta with I/O operation. This fixes legend
positioning and I/O operation error.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I809daa3eabe6a728e5e183630fc7c6615dfef8bf

2 years agofeat(dpdk): bump dpdk version 33/34733/1
pmikus [Wed, 15 Dec 2021 17:07:55 +0000 (18:07 +0100)]
feat(dpdk): bump dpdk version

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia3601c7d990bfe491e2b927b1208742e506f7c43

2 years agofix(dpdk): allow 32/34732/1
pmikus [Wed, 15 Dec 2021 16:59:45 +0000 (17:59 +0100)]
fix(dpdk): allow

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic7f24767b60eef5ddb7cdf5f933d82930c625f5c

2 years agoUTI: Export results 27/34727/3
Vratko Polak [Wed, 15 Dec 2021 16:14:36 +0000 (17:14 +0100)]
UTI: Export results

+ Model version 1.0.0.
- Only some result types are exported.
 + MRR, NDRPDR and SOAK.
 - Other result types to be added later.
 + In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
 + Sort dict keys before converting to JSON.
  + Override the order for some known keys.
 + Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
 + Info files for setup/teardown exist only temporarily.
 + The data is merged into suite.info.json file.
  + This simplifies presentation of total suite duration.
+ Define model via JSON schema:
 - Just test case, suite setup/teardown/suite to be added later.
 - Just info, raw to be added later.
 + Proper descriptions.
 + Json is generated from yaml.
  + This is a convenience for maintainers.
  + The officially used schema is the .json one.
 + TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
 + Include format checking.
 + Update CSIT requirements for validation dependencies.
  + This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
 + This unifies with NDRPDR to simplify schema definition.
 - PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
 + Move raw outputs into test_output_raw.tar.xz.
 + Rename existing tar with suites to generated_robot_files.tar.xz.

Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTox: Add checker for CSIT model version 88/32488/55
Vratko Polak [Mon, 29 Nov 2021 15:17:15 +0000 (16:17 +0100)]
Tox: Add checker for CSIT model version

+ Implementation stub so checker can check already.
+ Also add documentation stub for the implemented model.
+ Checker checks also for bumps in documentation version.
- Not comparing implementation and documentation version yet.

Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoINFO: Remove Jan from committers 81/34581/2
Vratko Polak [Wed, 24 Nov 2021 15:53:56 +0000 (16:53 +0100)]
INFO: Remove Jan from committers

He is no longer active on the project.

Change-Id: Ic7621fb3dc4148ba41760f227e39bc52256b7463
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agotrending: legend positioning 29/34729/2
Viliam Luc [Wed, 15 Dec 2021 07:40:09 +0000 (08:40 +0100)]
trending: legend positioning

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc

2 years agodocs: small update structure fix 24/34724/3
Viliam Luc [Tue, 14 Dec 2021 13:44:27 +0000 (14:44 +0100)]
docs: small update structure fix

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib0a853f7bd8cdbb0dee747e4f601bc4e54d006e9

2 years agotrending: fix broken trending 23/34723/3
Viliam Luc [Tue, 14 Dec 2021 11:03:33 +0000 (12:03 +0100)]
trending: fix broken trending

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a

2 years agodocs(lab): Intel Icelake 73/34673/8
pmikus [Fri, 3 Dec 2021 08:53:23 +0000 (09:53 +0100)]
docs(lab): Intel Icelake

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98

2 years agotrending: regression and progression add info to email 78/34678/6
Viliam Luc [Fri, 3 Dec 2021 13:54:25 +0000 (14:54 +0100)]
trending: regression and progression add info to email

adding trend in Mpps, runs for trend in #, trend change in %
+ dashboard - removed Short-Term change and added # of runs for trend

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib02d2a2224fc52b79832560241b0530aa2eaaf77

2 years agodoc: fixing documentation structure 77/34277/29
Viliam Luc [Thu, 28 Oct 2021 13:05:53 +0000 (15:05 +0200)]
doc: fixing documentation structure

When building documentation using sphinx we see ~1200 similar warnings [0]
[0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz

These warning are harmless and can be fixed later

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ac1099d38935971d47491dde905715345d3935c

2 years agoUpdate VPP_STABLE_VER files 51/34651/3
Tibor Frank [Mon, 13 Dec 2021 05:49:53 +0000 (05:49 +0000)]
Update VPP_STABLE_VER files

Change-Id: I460247c30a19adb41e6c9ccd5f8c9c914791d219
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Hide empty latency graph(s) for 3n-icx 17/34717/1
Tibor Frank [Mon, 13 Dec 2021 07:58:42 +0000 (08:58 +0100)]
Report: Hide empty latency graph(s) for 3n-icx

Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add Latency graphs for 3n-icx 11/34711/2
Tibor Frank [Fri, 10 Dec 2021 13:57:00 +0000 (14:57 +0100)]
Report: Add Latency graphs for 3n-icx

Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add 3n-icx - fixes 08/34708/1
Tibor Frank [Fri, 10 Dec 2021 06:54:55 +0000 (07:54 +0100)]
Report: Add 3n-icx - fixes

Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add 3n-icx 01/34701/3
Tibor Frank [Wed, 8 Dec 2021 15:52:36 +0000 (16:52 +0100)]
Report: Add 3n-icx

Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPLRsearch: Update docscrings 85/34685/3
Vratko Polak [Mon, 6 Dec 2021 12:54:34 +0000 (13:54 +0100)]
PLRsearch: Update docscrings

Previous code changes updated code comments, but not docstring.

Change-Id: I5be3fd07620cc97c9088efceb72c2f68ab103915
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 41/34641/2
Tibor Frank [Mon, 6 Dec 2021 06:03:25 +0000 (06:03 +0000)]
Update VPP_STABLE_VER files

Change-Id: I31046025e88ee0e7a13b8d7dd4d40574687a1bd8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphs 77/34677/1
Tibor Frank [Fri, 3 Dec 2021 13:20:01 +0000 (14:20 +0100)]
Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphs

Change-Id: Iec877a74701409c87f941b540494e1f313b32911
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofeat(AWS): Remove obsolete code 65/34665/1
pmikus [Thu, 2 Dec 2021 13:17:15 +0000 (14:17 +0100)]
feat(AWS): Remove obsolete code

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I97bba8f2092bc0554702a3acac10594426bd79c3

2 years agolab WIP: add new 3n-alt Arm testbed 92/33592/3
Juraj Linkeš [Wed, 25 Aug 2021 11:37:17 +0000 (13:37 +0200)]
lab WIP: add new 3n-alt Arm testbed

Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agofeat(Performance): Add 2M/1G hugepages 27/33827/20
pmikus [Mon, 27 Sep 2021 08:30:45 +0000 (08:30 +0000)]
feat(Performance): Add 2M/1G hugepages

+ Add ability to switch between hugepages.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I84d8eae28ed414a32e5ba82e6c9ed10d7f0ef9cb

2 years agoTrending: Fix ethip4ipsecNspe tests for 2n-tx2 19/34619/1
Tibor Frank [Tue, 30 Nov 2021 16:00:04 +0000 (17:00 +0100)]
Trending: Fix ethip4ipsecNspe tests for 2n-tx2

Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoRemove executable flag from suite files 06/34606/1
Vratko Polak [Mon, 29 Nov 2021 12:59:06 +0000 (13:59 +0100)]
Remove executable flag from suite files

If ./{filename} does not execute, {filename} should not be flagged as executable.
No .robot file is executable.

Change-Id: I7add9d223ad0e587bc041a4cca6bac222a89e078
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 13/34513/3
Tibor Frank [Mon, 29 Nov 2021 05:06:34 +0000 (05:06 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia7a75e03c7e5a1c8009ea04e2f515e495b516de0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrending: Add ethip4ipsecNspe tests for 2n-tx2 01/34601/2
Tibor Frank [Mon, 29 Nov 2021 05:37:15 +0000 (06:37 +0100)]
Trending: Add ethip4ipsecNspe tests for 2n-tx2

Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPal: Process oper data only from coverage builds 83/34583/3
Tibor Frank [Thu, 25 Nov 2021 09:53:23 +0000 (10:53 +0100)]
Pal: Process oper data only from coverage builds

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I9340f4a34d95320e833c209fdec4bff7649522f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAPI: Include more details in PAPI fail message 63/34563/7
Vratko Polak [Tue, 23 Nov 2021 16:03:16 +0000 (17:03 +0100)]
PAPI: Include more details in PAPI fail message

This helps to distinguish different symptoms for PAL failure alerting.

Change-Id: Idd8e8f4b427641fa055516bdf17715f6b967ca72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoNAT44det: Decrease ramp-up rate at big scales 66/34566/2
Vratko Polak [Mon, 22 Nov 2021 16:30:03 +0000 (17:30 +0100)]
NAT44det: Decrease ramp-up rate at big scales

Some testbeds occasionally miss one session with the previous value.

+ Increase ramp-up duration proportionally.

Change-Id: I5300127d7e8fbc670c37ae392ab514b077b3c9b1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Small fixes in static content 75/34575/1
Tibor Frank [Tue, 23 Nov 2021 13:39:30 +0000 (14:39 +0100)]
Report: Small fixes in static content

Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add 2n-icx data 62/34562/1
Tibor Frank [Mon, 22 Nov 2021 13:57:48 +0000 (14:57 +0100)]
Report: Add 2n-icx data

Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 08/34508/3
Tibor Frank [Mon, 22 Nov 2021 07:48:29 +0000 (07:48 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9cc4424bb4d0dfa3949321349267d190c939f4e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Hide 2n-icx empty graphs 60/34560/1
Tibor Frank [Mon, 22 Nov 2021 10:42:50 +0000 (11:42 +0100)]
Report: Hide 2n-icx empty graphs

Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Remove 2n-icx build nr 3 06/34506/2
Tibor Frank [Sat, 20 Nov 2021 09:16:07 +0000 (09:16 +0000)]
Report: Remove 2n-icx build nr 3

- seems to be corrupted

Change-Id: I7f7cb780c0a94601a2c2808d4ef384cb24c3fd99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Add boxpoints to all box graphs 53/34553/2
Tibor Frank [Fri, 19 Nov 2021 12:08:01 +0000 (13:08 +0100)]
PAL: Add boxpoints to all box graphs

Change-Id: Ic316149bab15c6fe1efccb53df0afa1cc78b3672
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: update 2n-tx2 daily and report 56/34256/2
Juraj Linkeš [Wed, 27 Oct 2021 09:50:11 +0000 (11:50 +0200)]
job_specs: update 2n-tx2 daily and report

Add newly added spd outbound tests with and without flowcache. These new
test may result in too many mlr tests, so remove the least needed tests,
which are 2m and 1m scale tests. This also unifies which scale tests we
run between af_xdp and dpdk tests.

Also cleanup all 2n-tx2 job specs.

Change-Id: I99bedefcef86f4b921f359f1ebf6c42ebdd8c20f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoReport: Improve docs related to TRex 33/34533/2
Vratko Polak [Tue, 16 Nov 2021 16:32:50 +0000 (17:32 +0100)]
Report: Improve docs related to TRex

Change-Id: I0ed346ff30c61d28b5a2232ef2f9d32d26c1ae2c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Add data 41/34541/1
Tibor Frank [Thu, 18 Nov 2021 06:25:27 +0000 (07:25 +0100)]
Report: Add data

Change-Id: I1dcddef704898cfa4ff9a84934fd11b8cf7b139a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Add box points to all box graphs 30/34530/2
Tibor Frank [Tue, 16 Nov 2021 12:07:39 +0000 (13:07 +0100)]
PAL: Add box points to all box graphs

- enabled only for aws throughput and soak

Change-Id: I3c4266e35d98d8319ef1e5c365734338195a40d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add boxpoints to aws tput graphs 20/34520/2
Tibor Frank [Mon, 15 Nov 2021 15:50:47 +0000 (16:50 +0100)]
Report: Add boxpoints to aws tput graphs

Change-Id: Idaeba305747863178a5eebc1d42f389a14d6084e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(Ansible): iavf install condition 75/34475/3
Juraj Linkeš [Fri, 12 Nov 2021 10:18:05 +0000 (11:18 +0100)]
fix(Ansible): iavf install condition

The existing condition is missing parentheses and doesn't work as
expected.

Change-Id: I3c45f5764b95bc8dcfbdd8ee6e2698bfb022dfb6
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoUpdate VPP_STABLE_VER files 96/34496/3
Tibor Frank [Mon, 15 Nov 2021 05:35:55 +0000 (05:35 +0000)]
Update VPP_STABLE_VER files

Change-Id: I2d5ff51cc5410ff1bcb12b44a22a7bd314b05f12
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add data 92/34492/1
Tibor Frank [Mon, 15 Nov 2021 06:32:54 +0000 (07:32 +0100)]
Report: Add data

Change-Id: Ie384ab9db8f3ba909ec0b6eaf39a04c5c7f3157a
Signed-off-by: Tibor Frank <tifrank@cisco.com>