csit.git
9 months agofeat(telemetry): show hardware 83/34783/3
pmikus [Wed, 22 Dec 2021 08:49:25 +0000 (09:49 +0100)]
feat(telemetry): show hardware

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0c0bf055e5963ac794f66cce9d5d45bb628facee

9 months agofix(uti): Fixing broken code part I 81/34781/2
pmikus [Wed, 22 Dec 2021 07:24:24 +0000 (08:24 +0100)]
fix(uti): Fixing broken code part I

Part of fixing chain after early merge.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624

9 months agoadd 2-node ipsec hwasync cases 00/34600/3
xinfeng zhao [Mon, 29 Nov 2021 03:59:52 +0000 (11:59 +0800)]
add 2-node ipsec hwasync cases

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I1590d438216e4c886aae03f83364837153623dbc

9 months agoansible: match vpp device config to perf config 56/34556/2
Juraj Linkeš [Thu, 26 Aug 2021 08:43:45 +0000 (10:43 +0200)]
ansible: match vpp device config to perf config

We're not using unsafe noiommu on perf testbeds and we should mirror
that config in vpp device.
As a side note, on arm vpp device, enabling unsafe noiommu leads to
corrupted packets, so it must be disabled at least on arm vpp device.

Also update arm vpp device kernel parameters to match perf testbeds.

Change-Id: Id3d3e8fcf71583cc04887b4180cd20561856d902
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
9 months agofeat(infra): DPDK 21.11 78/34778/2
pmikus [Tue, 21 Dec 2021 09:34:45 +0000 (10:34 +0100)]
feat(infra): DPDK 21.11

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib52fab112d458decfecf39c77085bcd85f811eba

9 months agofeat(infra): Add new compatibility matrix 77/34777/1
pmikus [Tue, 21 Dec 2021 09:23:49 +0000 (10:23 +0100)]
feat(infra): Add new compatibility matrix

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64deff93308771c2b3fc2e07fa8f2614b5e4ac9a

9 months agoansible: add kernel pinning to vpp device 79/34479/4
Juraj Linkeš [Fri, 12 Nov 2021 12:31:12 +0000 (13:31 +0100)]
ansible: add kernel pinning to vpp device

Change-Id: Ife26766e5f92ab95b537b39c25202fec6be27db3
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
9 months agotrending: hotfix failing trending emails 56/34756/4
Viliam Luc [Thu, 16 Dec 2021 08:22:43 +0000 (09:22 +0100)]
trending: hotfix failing trending emails

Legend was showing for each job_name. When trying to fix it
we broke the cpta with I/O operation. This fixes legend
positioning and I/O operation error.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I809daa3eabe6a728e5e183630fc7c6615dfef8bf

9 months agofeat(dpdk): bump dpdk version 33/34733/1
pmikus [Wed, 15 Dec 2021 17:07:55 +0000 (18:07 +0100)]
feat(dpdk): bump dpdk version

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia3601c7d990bfe491e2b927b1208742e506f7c43

9 months agofix(dpdk): allow 32/34732/1
pmikus [Wed, 15 Dec 2021 16:59:45 +0000 (17:59 +0100)]
fix(dpdk): allow

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic7f24767b60eef5ddb7cdf5f933d82930c625f5c

9 months agoUTI: Export results 27/34727/3
Vratko Polak [Wed, 15 Dec 2021 16:14:36 +0000 (17:14 +0100)]
UTI: Export results

+ Model version 1.0.0.
- Only some result types are exported.
 + MRR, NDRPDR and SOAK.
 - Other result types to be added later.
 + In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
 + Sort dict keys before converting to JSON.
  + Override the order for some known keys.
 + Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
 + Info files for setup/teardown exist only temporarily.
 + The data is merged into suite.info.json file.
  + This simplifies presentation of total suite duration.
+ Define model via JSON schema:
 - Just test case, suite setup/teardown/suite to be added later.
 - Just info, raw to be added later.
 + Proper descriptions.
 + Json is generated from yaml.
  + This is a convenience for maintainers.
  + The officially used schema is the .json one.
 + TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
 + Include format checking.
 + Update CSIT requirements for validation dependencies.
  + This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
 + This unifies with NDRPDR to simplify schema definition.
 - PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
 + Move raw outputs into test_output_raw.tar.xz.
 + Rename existing tar with suites to generated_robot_files.tar.xz.

Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoTox: Add checker for CSIT model version 88/32488/55
Vratko Polak [Mon, 29 Nov 2021 15:17:15 +0000 (16:17 +0100)]
Tox: Add checker for CSIT model version

+ Implementation stub so checker can check already.
+ Also add documentation stub for the implemented model.
+ Checker checks also for bumps in documentation version.
- Not comparing implementation and documentation version yet.

Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoINFO: Remove Jan from committers 81/34581/2
Vratko Polak [Wed, 24 Nov 2021 15:53:56 +0000 (16:53 +0100)]
INFO: Remove Jan from committers

He is no longer active on the project.

Change-Id: Ic7621fb3dc4148ba41760f227e39bc52256b7463
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agotrending: legend positioning 29/34729/2
Viliam Luc [Wed, 15 Dec 2021 07:40:09 +0000 (08:40 +0100)]
trending: legend positioning

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc

9 months agodocs: small update structure fix 24/34724/3
Viliam Luc [Tue, 14 Dec 2021 13:44:27 +0000 (14:44 +0100)]
docs: small update structure fix

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib0a853f7bd8cdbb0dee747e4f601bc4e54d006e9

9 months agotrending: fix broken trending 23/34723/3
Viliam Luc [Tue, 14 Dec 2021 11:03:33 +0000 (12:03 +0100)]
trending: fix broken trending

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a

9 months agodocs(lab): Intel Icelake 73/34673/8
pmikus [Fri, 3 Dec 2021 08:53:23 +0000 (09:53 +0100)]
docs(lab): Intel Icelake

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98

9 months agotrending: regression and progression add info to email 78/34678/6
Viliam Luc [Fri, 3 Dec 2021 13:54:25 +0000 (14:54 +0100)]
trending: regression and progression add info to email

adding trend in Mpps, runs for trend in #, trend change in %
+ dashboard - removed Short-Term change and added # of runs for trend

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib02d2a2224fc52b79832560241b0530aa2eaaf77

9 months agodoc: fixing documentation structure 77/34277/29
Viliam Luc [Thu, 28 Oct 2021 13:05:53 +0000 (15:05 +0200)]
doc: fixing documentation structure

When building documentation using sphinx we see ~1200 similar warnings [0]
[0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz

These warning are harmless and can be fixed later

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ac1099d38935971d47491dde905715345d3935c

9 months agoUpdate VPP_STABLE_VER files 51/34651/3
Tibor Frank [Mon, 13 Dec 2021 05:49:53 +0000 (05:49 +0000)]
Update VPP_STABLE_VER files

Change-Id: I460247c30a19adb41e6c9ccd5f8c9c914791d219
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Hide empty latency graph(s) for 3n-icx 17/34717/1
Tibor Frank [Mon, 13 Dec 2021 07:58:42 +0000 (08:58 +0100)]
Report: Hide empty latency graph(s) for 3n-icx

Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add Latency graphs for 3n-icx 11/34711/2
Tibor Frank [Fri, 10 Dec 2021 13:57:00 +0000 (14:57 +0100)]
Report: Add Latency graphs for 3n-icx

Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 3n-icx - fixes 08/34708/1
Tibor Frank [Fri, 10 Dec 2021 06:54:55 +0000 (07:54 +0100)]
Report: Add 3n-icx - fixes

Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 3n-icx 01/34701/3
Tibor Frank [Wed, 8 Dec 2021 15:52:36 +0000 (16:52 +0100)]
Report: Add 3n-icx

Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoPLRsearch: Update docscrings 85/34685/3
Vratko Polak [Mon, 6 Dec 2021 12:54:34 +0000 (13:54 +0100)]
PLRsearch: Update docscrings

Previous code changes updated code comments, but not docstring.

Change-Id: I5be3fd07620cc97c9088efceb72c2f68ab103915
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 41/34641/2
Tibor Frank [Mon, 6 Dec 2021 06:03:25 +0000 (06:03 +0000)]
Update VPP_STABLE_VER files

Change-Id: I31046025e88ee0e7a13b8d7dd4d40574687a1bd8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphs 77/34677/1
Tibor Frank [Fri, 3 Dec 2021 13:20:01 +0000 (14:20 +0100)]
Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphs

Change-Id: Iec877a74701409c87f941b540494e1f313b32911
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofeat(AWS): Remove obsolete code 65/34665/1
pmikus [Thu, 2 Dec 2021 13:17:15 +0000 (14:17 +0100)]
feat(AWS): Remove obsolete code

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I97bba8f2092bc0554702a3acac10594426bd79c3

9 months agolab WIP: add new 3n-alt Arm testbed 92/33592/3
Juraj Linkeš [Wed, 25 Aug 2021 11:37:17 +0000 (13:37 +0200)]
lab WIP: add new 3n-alt Arm testbed

Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
9 months agofeat(Performance): Add 2M/1G hugepages 27/33827/20
pmikus [Mon, 27 Sep 2021 08:30:45 +0000 (08:30 +0000)]
feat(Performance): Add 2M/1G hugepages

+ Add ability to switch between hugepages.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I84d8eae28ed414a32e5ba82e6c9ed10d7f0ef9cb

9 months agoTrending: Fix ethip4ipsecNspe tests for 2n-tx2 19/34619/1
Tibor Frank [Tue, 30 Nov 2021 16:00:04 +0000 (17:00 +0100)]
Trending: Fix ethip4ipsecNspe tests for 2n-tx2

Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoRemove executable flag from suite files 06/34606/1
Vratko Polak [Mon, 29 Nov 2021 12:59:06 +0000 (13:59 +0100)]
Remove executable flag from suite files

If ./{filename} does not execute, {filename} should not be flagged as executable.
No .robot file is executable.

Change-Id: I7add9d223ad0e587bc041a4cca6bac222a89e078
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 13/34513/3
Tibor Frank [Mon, 29 Nov 2021 05:06:34 +0000 (05:06 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia7a75e03c7e5a1c8009ea04e2f515e495b516de0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Add ethip4ipsecNspe tests for 2n-tx2 01/34601/2
Tibor Frank [Mon, 29 Nov 2021 05:37:15 +0000 (06:37 +0100)]
Trending: Add ethip4ipsecNspe tests for 2n-tx2

Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoPal: Process oper data only from coverage builds 83/34583/3
Tibor Frank [Thu, 25 Nov 2021 09:53:23 +0000 (10:53 +0100)]
Pal: Process oper data only from coverage builds

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I9340f4a34d95320e833c209fdec4bff7649522f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoPAPI: Include more details in PAPI fail message 63/34563/7
Vratko Polak [Tue, 23 Nov 2021 16:03:16 +0000 (17:03 +0100)]
PAPI: Include more details in PAPI fail message

This helps to distinguish different symptoms for PAL failure alerting.

Change-Id: Idd8e8f4b427641fa055516bdf17715f6b967ca72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoNAT44det: Decrease ramp-up rate at big scales 66/34566/2
Vratko Polak [Mon, 22 Nov 2021 16:30:03 +0000 (17:30 +0100)]
NAT44det: Decrease ramp-up rate at big scales

Some testbeds occasionally miss one session with the previous value.

+ Increase ramp-up duration proportionally.

Change-Id: I5300127d7e8fbc670c37ae392ab514b077b3c9b1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Small fixes in static content 75/34575/1
Tibor Frank [Tue, 23 Nov 2021 13:39:30 +0000 (14:39 +0100)]
Report: Small fixes in static content

Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add 2n-icx data 62/34562/1
Tibor Frank [Mon, 22 Nov 2021 13:57:48 +0000 (14:57 +0100)]
Report: Add 2n-icx data

Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoUpdate VPP_STABLE_VER files 08/34508/3
Tibor Frank [Mon, 22 Nov 2021 07:48:29 +0000 (07:48 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9cc4424bb4d0dfa3949321349267d190c939f4e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Hide 2n-icx empty graphs 60/34560/1
Tibor Frank [Mon, 22 Nov 2021 10:42:50 +0000 (11:42 +0100)]
Report: Hide 2n-icx empty graphs

Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Remove 2n-icx build nr 3 06/34506/2
Tibor Frank [Sat, 20 Nov 2021 09:16:07 +0000 (09:16 +0000)]
Report: Remove 2n-icx build nr 3

- seems to be corrupted

Change-Id: I7f7cb780c0a94601a2c2808d4ef384cb24c3fd99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoPAL: Add boxpoints to all box graphs 53/34553/2
Tibor Frank [Fri, 19 Nov 2021 12:08:01 +0000 (13:08 +0100)]
PAL: Add boxpoints to all box graphs

Change-Id: Ic316149bab15c6fe1efccb53df0afa1cc78b3672
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agojob_specs: update 2n-tx2 daily and report 56/34256/2
Juraj Linkeš [Wed, 27 Oct 2021 09:50:11 +0000 (11:50 +0200)]
job_specs: update 2n-tx2 daily and report

Add newly added spd outbound tests with and without flowcache. These new
test may result in too many mlr tests, so remove the least needed tests,
which are 2m and 1m scale tests. This also unifies which scale tests we
run between af_xdp and dpdk tests.

Also cleanup all 2n-tx2 job specs.

Change-Id: I99bedefcef86f4b921f359f1ebf6c42ebdd8c20f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoReport: Improve docs related to TRex 33/34533/2
Vratko Polak [Tue, 16 Nov 2021 16:32:50 +0000 (17:32 +0100)]
Report: Improve docs related to TRex

Change-Id: I0ed346ff30c61d28b5a2232ef2f9d32d26c1ae2c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 41/34541/1
Tibor Frank [Thu, 18 Nov 2021 06:25:27 +0000 (07:25 +0100)]
Report: Add data

Change-Id: I1dcddef704898cfa4ff9a84934fd11b8cf7b139a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoPAL: Add box points to all box graphs 30/34530/2
Tibor Frank [Tue, 16 Nov 2021 12:07:39 +0000 (13:07 +0100)]
PAL: Add box points to all box graphs

- enabled only for aws throughput and soak

Change-Id: I3c4266e35d98d8319ef1e5c365734338195a40d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add boxpoints to aws tput graphs 20/34520/2
Tibor Frank [Mon, 15 Nov 2021 15:50:47 +0000 (16:50 +0100)]
Report: Add boxpoints to aws tput graphs

Change-Id: Idaeba305747863178a5eebc1d42f389a14d6084e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(Ansible): iavf install condition 75/34475/3
Juraj Linkeš [Fri, 12 Nov 2021 10:18:05 +0000 (11:18 +0100)]
fix(Ansible): iavf install condition

The existing condition is missing parentheses and doesn't work as
expected.

Change-Id: I3c45f5764b95bc8dcfbdd8ee6e2698bfb022dfb6
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoUpdate VPP_STABLE_VER files 96/34496/3
Tibor Frank [Mon, 15 Nov 2021 05:35:55 +0000 (05:35 +0000)]
Update VPP_STABLE_VER files

Change-Id: I2d5ff51cc5410ff1bcb12b44a22a7bd314b05f12
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 92/34492/1
Tibor Frank [Mon, 15 Nov 2021 06:32:54 +0000 (07:32 +0100)]
Report: Add data

Change-Id: Ie384ab9db8f3ba909ec0b6eaf39a04c5c7f3157a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Show min/avg/max latency for aws - fixes 84/34484/1
Tibor Frank [Fri, 12 Nov 2021 18:04:07 +0000 (19:04 +0100)]
Report: Show min/avg/max latency for aws - fixes

Change-Id: I119fa64da4b178cb6a8abe63fb16e0bc7f18fd70
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Show min/avg/max latency for aws 78/34478/2
Tibor Frank [Fri, 12 Nov 2021 12:15:10 +0000 (13:15 +0100)]
Report: Show min/avg/max latency for aws

Change-Id: I4acbe6b20054881f95bf4bab03958ad2dab60629
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoPAL: Round report comparisons to 1 digit more 60/34360/3
Vratko Polak [Mon, 8 Nov 2021 12:43:29 +0000 (13:43 +0100)]
PAL: Round report comparisons to 1 digit more

Change-Id: Ifc2fdd04270628053646a6b3d8b15bc730325eb6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 71/34471/1
Tibor Frank [Fri, 12 Nov 2021 06:06:32 +0000 (07:06 +0100)]
Report: Add data

Change-Id: I2ee6005d499c4d93cca72cffd3373ced16d7c994
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 61/34461/1
Tibor Frank [Thu, 11 Nov 2021 11:43:52 +0000 (12:43 +0100)]
Report: Add data

Change-Id: Ifea5d3b84dbc0df4d8365ed1c1b4dfdd4c49f140
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add DPDK speedup graphs 60/34460/2
Tibor Frank [Thu, 11 Nov 2021 11:36:29 +0000 (12:36 +0100)]
Report: Add DPDK speedup graphs

Change-Id: I0c763ae0371515955037f0aaa867251b5aaec604
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months ago"fix(job_specs): Remove flow based tests" 27/34427/2
Peter Mikus [Thu, 11 Nov 2021 08:52:23 +0000 (08:52 +0000)]
"fix(job_specs): Remove flow based tests"

Reason for revert: Fixed

Change-Id: Idbafdb953964967276f4f5748c78398a33635e2b
Signed-off-by: pmikus <pmikus@cisco.com>
10 months agofix(Ansible): Configure systemd as service manager 58/34458/1
pmikus [Thu, 11 Nov 2021 08:44:38 +0000 (09:44 +0100)]
fix(Ansible): Configure systemd as service manager

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I80ec9854b311af7a8da9363cf569598e1eb667f4

10 months agofeat(Terraform): Minio S3 gateway proxy 57/34457/2
pmikus [Thu, 11 Nov 2021 08:28:10 +0000 (09:28 +0100)]
feat(Terraform): Minio S3 gateway proxy

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idfd4a61b37233384ba2010c896522ad79327ecb6

10 months agoReport: Add 4t2c graphs for aws 56/34456/2
Tibor Frank [Thu, 11 Nov 2021 07:36:20 +0000 (08:36 +0100)]
Report: Add 4t2c graphs for aws

Change-Id: I4fd625bc5139ebcb8430a4228986eafe39672532
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofeat(Terraform): Minio S3 gateway proxy 90/34390/6
pmikus [Mon, 8 Nov 2021 11:50:51 +0000 (12:50 +0100)]
feat(Terraform): Minio S3 gateway proxy

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9543a856a2e5791b61accd7a183bc5a2bf2e6187

10 months agoReport: Add stats tables, aws tests 46/34446/2
Tibor Frank [Wed, 10 Nov 2021 13:30:08 +0000 (14:30 +0100)]
Report: Add stats tables, aws tests

Change-Id: I212b0e6e70008e15ced0167ab34e613cc0a1aea4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Update known issues 91/34391/3
Vratko Polak [Wed, 10 Nov 2021 12:36:27 +0000 (13:36 +0100)]
Report: Update known issues

+ Remove MLRsearch comment, it happened a release before.
+ Separated known issues to fixed, old and new.
+ RCA section present, but empty yet.

Change-Id: Ic713319017d6c2eb7ba2750de7c27de5237ee2c7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoPAL: Fix heatmap graph 44/34444/1
Tibor Frank [Wed, 10 Nov 2021 10:58:53 +0000 (11:58 +0100)]
PAL: Fix heatmap graph

Change-Id: I4992c8f4ae63aa25794cdab98532722c45263e8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Fixes in dynamic content 43/34443/2
Tibor Frank [Wed, 10 Nov 2021 10:47:51 +0000 (11:47 +0100)]
Report: Fixes in dynamic content

Change-Id: If90ba8c66427061341888dcfc946450efe66010b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoreport: update to vpp performance release notes 36/34436/2
Maciek Konstantynowicz [Tue, 9 Nov 2021 19:13:17 +0000 (19:13 +0000)]
report: update to vpp performance release notes

Change-Id: I170d14555b21e91d0ce1f11ea3f2911e8b01341c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
10 months agoFix autogen.sh checker 06/34406/3
Vratko Polak [Tue, 9 Nov 2021 11:05:07 +0000 (12:05 +0100)]
Fix autogen.sh checker

Previously, the FAIL message was not printed.

Change-Id: Id3fc6c126edd42b55cec73294696a0426a73d634
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 42/34442/1
Tibor Frank [Wed, 10 Nov 2021 06:00:32 +0000 (07:00 +0100)]
Report: Add data

Change-Id: Ib00909a62739e488ad809463c08cec14b4b96e91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 12/34412/1
Tibor Frank [Tue, 9 Nov 2021 16:39:38 +0000 (17:39 +0100)]
Report: Add data

Change-Id: I21eedf3ecabe0672daaaf87819960cd986420fa0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: 2n-icx: disable elements without data 10/34410/1
Tibor Frank [Tue, 9 Nov 2021 16:27:51 +0000 (17:27 +0100)]
Report: 2n-icx: disable elements without data

Change-Id: Id908e094129e6becd70a63667ebe61a6433db07e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add 2n-icx, part 2 07/34407/2
Tibor Frank [Tue, 9 Nov 2021 13:42:00 +0000 (14:42 +0100)]
Report: Add 2n-icx, part 2

- packet throughput
- speedup
- latency

Change-Id: If871dcc1888e7a49ac2fd2ba8e3632a87fa035bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoreport: edits in aws methodology section 98/34398/4
Maciek Konstantynowicz [Mon, 8 Nov 2021 21:17:53 +0000 (21:17 +0000)]
report: edits in aws methodology section

Edits include:
- add description of used testbed topologies.
- cleaned up references.
- other editing nits.

Change-Id: I43069541f3da8e844529a00a127fb1a360197647
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
10 months agoReport: Hide aws latency 05/34405/1
Tibor Frank [Tue, 9 Nov 2021 07:28:17 +0000 (08:28 +0100)]
Report: Hide aws latency

- it is not measured

Change-Id: I1c3d2f629d8ed07a208c37a20642b0e6b336242e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 04/34404/1
Tibor Frank [Tue, 9 Nov 2021 06:57:38 +0000 (07:57 +0100)]
Report: Add data

Change-Id: Iec138a93b18f02046d7c13b7243463048ff695ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add aws latency 94/34394/1
Tibor Frank [Mon, 8 Nov 2021 16:31:21 +0000 (17:31 +0100)]
Report: Add aws latency

Change-Id: I0780ddabce015cf1809ea178bf53ab9fc6e18f2d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add 2n-icx, part 1 93/34393/1
Tibor Frank [Mon, 8 Nov 2021 14:45:40 +0000 (15:45 +0100)]
Report: Add 2n-icx, part 1

Change-Id: Idf1e56231afa14648d7c3db661eb9a04ef7a5c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Remove tests removed by 34207 62/34362/4
Tibor Frank [Fri, 5 Nov 2021 13:48:18 +0000 (14:48 +0100)]
Report: Remove tests removed by 34207

Change-Id: Ibe960b8dd4340c2c5b8a01fc490cab906dc330fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agovpp_device: bind to vfio-pci before running tests 45/34045/14
Juraj Linkeš [Tue, 12 Oct 2021 08:03:04 +0000 (10:03 +0200)]
vpp_device: bind to vfio-pci before running tests

In rare cases, binding the whole /dev/vfio folder will result in
unusable VFs:
notice dpdk EAL: Cannot open /dev/vfio/151: Device or resource busy

[0], section 4.3.1. provides some clues as to what's going on and how to
avoid the failure. Mounting /dev/vfio reset the file descriptors of all
devices under /dev/vfio. Vfio-pci creates a device when an interface is
bound to it. The rare failure then occurs when /dev/vfio is mounted
while a process is using the file descriptors result in that process
using invalid file descriptors (or file descriptors belonging to a
different VF).

Fix the issue by binding i40e and ice VFs to vfio-pci before containers
are created and make sure that the VFs are not unbound later in testing.
Only bind DUT VFs since the TG uses the kernel driver.

[0]: https://connect.redhat.com/sites/default/files/2021-03/Cloud Native Network Function Requirements.pdf

Ticket: CSIT-1794

Change-Id: I83db91b29d16669fb034b141ad247f6f796fdf64
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoReport: Add data 87/34387/1
Tibor Frank [Mon, 8 Nov 2021 08:33:31 +0000 (09:33 +0100)]
Report: Add data

Change-Id: I76a36cb19d6c121b1d668d1ff8f71085baa2ed2e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoUpdate VPP_STABLE_VER files 44/34344/2
Tibor Frank [Mon, 8 Nov 2021 05:16:35 +0000 (05:16 +0000)]
Update VPP_STABLE_VER files

Change-Id: I8414908647401d188fd41834f02711666dd6d307
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Small edits in static content. 61/34361/1
Tibor Frank [Fri, 5 Nov 2021 12:30:45 +0000 (13:30 +0100)]
Report: Small edits in static content.

Change-Id: I621e9818cb929c9558c38d41cb4804a19ed2a468
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 59/34359/1
Tibor Frank [Fri, 5 Nov 2021 09:08:23 +0000 (10:08 +0100)]
Report: Add data

Change-Id: Ia1709ebd3543ac4ee5fa63cefa6b18411c3c58f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: update tables 34/34334/2
Tibor Frank [Thu, 4 Nov 2021 13:20:25 +0000 (14:20 +0100)]
Report: update tables

- statistics
- latency comparison

Change-Id: I84069c26e07ced08bad92e19e6cdb0953cd24d3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 33/34333/1
Tibor Frank [Thu, 4 Nov 2021 10:05:37 +0000 (11:05 +0100)]
Report: Add data

Change-Id: I9fce2c74eb564a80b7b7002538376ec6aefaeac2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(Docs): Report section updates 25/34325/2
pmikus [Wed, 3 Nov 2021 15:34:22 +0000 (15:34 +0000)]
fix(Docs): Report section updates

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icd04b75d320f067bd66402d5bb499070ee2768f3

10 months agoReport: Add rls data 22/34322/4
Tibor Frank [Wed, 3 Nov 2021 12:08:47 +0000 (13:08 +0100)]
Report: Add rls data

Change-Id: I7868b419fa47c6130826948bbdfbb288abb8d1e4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agojob_specs: add ipsec 40 tunnel sw tests for 3n-skx testbeds 81/34281/3
Maciek Konstantynowicz [Thu, 28 Oct 2021 17:52:09 +0000 (18:52 +0100)]
job_specs: add ipsec 40 tunnel sw tests for 3n-skx testbeds

Change-Id: I4bb79bf34f64b1096be9e81586d718dbe283b3cd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
10 months agojob_specs: add report_iterative tests to 2n-icx and 3n-icx testbeds 80/34280/3
Maciek Konstantynowicz [Thu, 28 Oct 2021 17:37:08 +0000 (18:37 +0100)]
job_specs: add report_iterative tests to 2n-icx and 3n-icx testbeds

Assumed icx testbeds equipped only with Intel e810cq 2p100GbE NIC.
2n-icx test set based on 2n-clx job spec.
3n-icx test set based on 3n-skx job spec.

Change-Id: I9305693b55008a6a626618122f238bb3e8700fdb
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
10 months agoRe-adressing ipsec int tests to fit deployment in AWS 72/25272/7
Maros Mullner [Wed, 19 Feb 2020 14:11:10 +0000 (15:11 +0100)]
Re-adressing ipsec int tests to fit deployment in AWS

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I83b00d56a50d98c36547621cb2f41cb3b2f35741

10 months agoperf: remove depracted ipsec scale reconf test suites 07/34307/2
Maciek Konstantynowicz [Tue, 2 Nov 2021 14:52:38 +0000 (14:52 +0000)]
perf: remove depracted ipsec scale reconf test suites

Remaining ipsec reconf test suites for 40 tunnels include:
- int-aes128cbc-hmac512sha
- int-aes256gcm

Change-Id: I9c5f549368595bb0cbd0d7e9918b7695184d31c4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
10 months agofix(Tests): Hoststack drivers 19/34319/1
pmikus [Wed, 3 Nov 2021 07:30:41 +0000 (07:30 +0000)]
fix(Tests): Hoststack drivers

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If98f575503a59106fe8b94d5c683881412ea4f1c

10 months agofeat(Terraform): AWS account migration 84/34284/4
pmikus [Fri, 29 Oct 2021 06:58:05 +0000 (06:58 +0000)]
feat(Terraform): AWS account migration

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2aeece4296aff18bf87304312a26368df267fac0

10 months agocrypto: remove deprecated ipsec scale perf test suites 68/34168/3
Maciek Konstantynowicz [Wed, 20 Oct 2021 12:23:56 +0000 (13:23 +0100)]
crypto: remove deprecated ipsec scale perf test suites

Remove following test suites:
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: Ib4915213f6c440c70f9b17cbaac834245e51bd85
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
10 months agoUpdate VPP_STABLE_VER files 30/34230/3
Tibor Frank [Tue, 2 Nov 2021 05:53:35 +0000 (05:53 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ie6d1522b7cb021ada7191cf74a770ff0a18f8160
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(autogen): VSAP testcase naming 02/34302/1
pmikus [Tue, 2 Nov 2021 06:44:27 +0000 (06:44 +0000)]
fix(autogen): VSAP testcase naming

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic6d440ffdf7e27c9e6ce65605178163652758f77

10 months agofeat(Terraform): AWS backend role migration 83/34283/1
pmikus [Fri, 29 Oct 2021 06:19:46 +0000 (06:19 +0000)]
feat(Terraform): AWS backend role migration

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8c93eaaa766c48b705a19e38123b69c994669dc0

10 months agofix(Autogen): VSAP driver combinations 71/34271/1
pmikus [Thu, 28 Oct 2021 07:25:41 +0000 (07:25 +0000)]
fix(Autogen): VSAP driver combinations

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ieac8cd32009bebbd1a3324a81becfbf3abb814ab

10 months agojob_specs: remove nat44ed udp and tcp scale 16m session tests 31/34131/5
Maciek Konstantynowicz [Mon, 18 Oct 2021 13:50:39 +0000 (14:50 +0100)]
job_specs: remove nat44ed udp and tcp scale 16m session tests

Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily
and mlr_weekly performance jobs. Tests are failing due to
slower session setup rate and very long ramp up time, too
long to be accommodated by CSIT resources.

Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
10 months agofix(docs): AWS job specs 58/34258/1
pmikus [Wed, 27 Oct 2021 13:28:31 +0000 (13:28 +0000)]
fix(docs): AWS job specs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I34b1475f0cabe8a6d9f260c77d5a3b10f7ead61c