csit.git
13 months agoInfra: AWS Update to Ubuntu 20.04 62/31862/7
Tomas Alexy [Thu, 1 Apr 2021 13:44:14 +0000 (15:44 +0200)]
Infra: AWS Update to Ubuntu 20.04

- Change AMI image to Ubuntu 20.04
- Add calibration role
- Add AWS vfio-patch for kernel 5.8+
- Prepare root module's main.tf to be used with environment variables

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I7db3f28ba573a5a8a1dc07179ef78ef34ce9ebf3

13 months agojob-specs: Update durations of arm mrr jobs 18/31918/1
Juraj Linkeš [Wed, 7 Apr 2021 09:31:24 +0000 (11:31 +0200)]
job-specs: Update durations of arm mrr jobs

Update after new policy tests were enabled in iterative 2n-tx2 and
3n-tsh.

Change-Id: I53986f8c7ba6cd83c73d7d615da07a32ad99c24b
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
13 months agoSetupFramework: Log env activation outputs 03/31903/3
Vratko Polak [Tue, 6 Apr 2021 14:53:09 +0000 (16:53 +0200)]
SetupFramework: Log env activation outputs

Useful for verifying how much is SUT ready for requirements.txt content.

Change-Id: I1e8443f2f9391d646e79a451a88df961845700e4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 months agoDPDK buid: Fix sed command 07/31907/1
Vratko Polak [Tue, 6 Apr 2021 16:56:25 +0000 (18:56 +0200)]
DPDK buid: Fix sed command

The previous way of concatenating strings would not work even in Python.

Change-Id: Ice06f4a06fefbc4e42ee2572786244207dfefa11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 months agoUpdate VPP_STABLE_VER files 79/31879/2
Tibor Frank [Tue, 6 Apr 2021 05:44:39 +0000 (05:44 +0000)]
Update VPP_STABLE_VER files

Change-Id: I8030b6efcb8c510bfdb82523ffe1610707fcc7c5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
13 months agoJob specs: add crypto tests to Arm perf jobs 63/31863/1
Juraj Linkeš [Thu, 1 Apr 2021 14:05:36 +0000 (16:05 +0200)]
Job specs: add crypto tests to Arm perf jobs

Increase coverage by adding aes128gcm protection mode and policy
testcases.

Change-Id: I6f9e7b89208397efe4e06a63d3e06caaf19f3b0a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
13 months agoIPsec: add 4, 40 and 400 tunnel policy tests 40/31840/3
Juraj Linkeš [Wed, 31 Mar 2021 13:45:44 +0000 (15:45 +0200)]
IPsec: add 4, 40 and 400 tunnel policy tests

Add more granularity test policy tests. Mirror the number of tunnels in
other IPsec tests under 1000 tunnels.

Change-Id: I9bde7447a5d809bab05db132bf6cb524e97e19b3
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
13 months agoMLRsearch: Update PyPI metadata for v0.4.0 42/31842/1
Vratko Polak [Wed, 31 Mar 2021 15:26:11 +0000 (17:26 +0200)]
MLRsearch: Update PyPI metadata for v0.4.0

Change-Id: I8107097843a3bcddc28ac8a61f72614a3c3145ac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 months agoTrafficGenerator: Less logging of unsent 94/31794/3
Vratko Polak [Mon, 29 Mar 2021 15:54:51 +0000 (17:54 +0200)]
TrafficGenerator: Less logging of unsent

When a trial has explicit stop instead of duration
(e.g. for show run), the computation of unsent packets is wrong,
so simply do not log the result.

Change-Id: I7722c85b156f92e456eda212104abdb216e78b04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 months agoIPsec: add 2n crypto policy udir perf tests 05/31605/23
Juraj Linkeš [Wed, 10 Mar 2021 08:31:23 +0000 (09:31 +0100)]
IPsec: add 2n crypto policy udir perf tests

Add 2n1l udir 1 and 1000 tunnel sw policy IPsec tests to mirror the
existing 3n tests.

Add static ip neighbor mac entries which can't be retrieved in 2node
setups.

Change-Id: I13dd557cbeed7f907fa9b4c21e4e245d48916513
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
13 months agoDevice: Add stats test with AVF 28/31828/5
Vratko Polak [Tue, 30 Mar 2021 13:20:41 +0000 (15:20 +0200)]
Device: Add stats test with AVF

+ Extract the stats keyword into a library.

Change-Id: Icfaaa32c2a97d479ba0339acf34b865006949a89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 months agoPAPI stats: Use list as argument to ls 26/31826/2
Vratko Polak [Tue, 30 Mar 2021 14:31:26 +0000 (16:31 +0200)]
PAPI stats: Use list as argument to ls

In the VPP PAPI stats code, the "ls" argument has always [0]
been named "patterns", suggesting it expects a list of strings.
In the CSIT utility we have always [1] been using it wrong
(passing a single string), but it happened to work
as VPP code had a workaround [2] for that.
This workaround that got removed by accident in [3],
and will be reintroduced in [4].

This change fixes occasional failures in CSIT
(if merged sooner than [4]), mainly useful
in aviding such failures during bisection.

[0] https://gerrit.fd.io/r/c/vpp/+/14584/4/src/vpp-api/python/vpp_papi/vpp_stats.py#122
[1] https://gerrit.fd.io/r/c/csit/+/18419/13/resources/tools/papi/vpp_papi_provider.py#181
[2] https://gerrit.fd.io/r/c/vpp/+/14584/4/src/vpp-api/python/vpp_papi/vpp_stats.py#64
[3] https://gerrit.fd.io/r/c/vpp/+/31678
[4] https://gerrit.fd.io/r/c/vpp/+/31817

Change-Id: Ic0f9d906be064b386b67154ba738646c4362aa2b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 months agodoc: add fdio dc vexxhost server inventory across all locations 62/30662/14
Maciek Konstantynowicz [Thu, 7 Jan 2021 19:51:56 +0000 (19:51 +0000)]
doc: add fdio dc vexxhost server inventory across all locations

Change-Id: I17ffb5912964bd0c2da59ad4843dfb411f9c3e0c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
13 months agoUpdate VPP_STABLE_VER files 25/31725/6
Tibor Frank [Mon, 29 Mar 2021 06:07:01 +0000 (06:07 +0000)]
Update VPP_STABLE_VER files

Change-Id: I696cb7687574faa5b8acc14c469a0861e1ed9294
Signed-off-by: Tibor Frank <tifrank@cisco.com>
13 months agoInfra: AWS deployment improvements 59/31659/2
Tomas Alexy [Tue, 16 Mar 2021 11:25:09 +0000 (12:25 +0100)]
Infra: AWS deployment improvements

- Add checks where missing
- Serialize instance deployment to prevent race conditions
Deploy tg -> sut1 (-> sut2) then start ansible provisioning on all instances
- Bump AWS provisioner version to 3.32

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I9a53b1de96574674f3608f19a8f5ac297eb1bd86

13 months agoFIX: VPP version file name based on OS 76/31776/5
pmikus [Thu, 25 Mar 2021 18:38:33 +0000 (18:38 +0000)]
FIX: VPP version file name based on OS

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icab8b87498e8487268857bb04c5ba7069d9297e3

14 months agoSTL traffic: Use the sleep+stop logic 84/31284/96
Vratko Polak [Thu, 25 Mar 2021 18:26:35 +0000 (19:26 +0100)]
STL traffic: Use the sleep+stop logic

+ PPS limit for AWS set to 1.2 Mpps.
+ The logic is very similar to that one in ASTF driver.
 + This helps for testbeds with high duration stretching (e.g. AWS).
 + Difference: No transaction scale, and we deal with floats.
+ Update loss counting to count unsent packets as lost.
 + Also count "unsent" transactions for other transaction types.
 + If nonzero, log the number of unsent packets/transactions.
+ Make STL and ASTF time overhead constant (called delay) configurable.
+ Subtract delay from approximated_duration, also for ASTF.

Change-Id: I6ee6aa6fba4f110ba1636e1b0ff76cac64383e33
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agoParametrize T-Rex rx/tx descriptors count 67/31767/16
Tomas Alexy [Thu, 25 Mar 2021 14:15:17 +0000 (15:15 +0100)]
Parametrize T-Rex rx/tx descriptors count

Additional configuration can provide performance boosts when running in virtual environments
If set to 0, uses default DPDK value
By tuning this value it's also possible to run T-Rex 2.88 with ENA NICs on AWS

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I43c86ea1d9aa854a1087f07fe544ac77a5b80397

14 months agoansible: update TX2 VPP Device hugepages and ifs 78/31778/2
Juraj Linkeš [Fri, 26 Mar 2021 08:30:58 +0000 (09:30 +0100)]
ansible: update TX2 VPP Device hugepages and ifs

These interfaces are not used, so remove them until we actually use
them.
Use less amount of hugepages since we don't need as much and the rest of
the memory is more useful for build/host processes.

Change-Id: I52b2d6e2812e5cadeab9e51a1bae3688794f414a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
14 months agoFrameworkSetup: fix timeout in Arm setup 45/31745/1
Juraj Linkeš [Wed, 24 Mar 2021 14:28:22 +0000 (15:28 +0100)]
FrameworkSetup: fix timeout in Arm setup

Framework extraction in Arm jobs is taking longer than the current
timeout. Increase the timeout to fix this.

Change-Id: I436d3131fcd7c25fd1f9607095712b4a8aa2d28c
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
14 months agoFrameworkSetup: catch all exceptions in threads 04/31704/5
Juraj Linkeš [Tue, 23 Mar 2021 07:46:16 +0000 (08:46 +0100)]
FrameworkSetup: catch all exceptions in threads

Any uncaught exception in a thread running setup_node or cleanup_node
will prevent the result of that thread's execution from being passed
to the main thread. Since the main thread assumes there will be a result
for each thread, this leads to false positives. Catch all exceptions
in those background threads to fix this.

Change-Id: I64013dfc671e576290c8376a58c754ed21b9ba3e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
14 months agoInfra: fix NUMA count in Arm DPDK build 05/31705/3
Juraj Linkeš [Tue, 23 Mar 2021 09:06:50 +0000 (10:06 +0100)]
Infra: fix NUMA count in Arm DPDK build

The default NUMA value for Taishan build is insufficient and results in
failed test runs. Fix by increasing the amount to what's on the device.

Change-Id: Ia7c761e81ee9063d7129472d9caa8cebbbb7e1cf
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
14 months agoGeneve: Re-write the creation of tunnels in python 67/31167/11
Tibor Frank [Mon, 8 Feb 2021 16:19:32 +0000 (17:19 +0100)]
Geneve: Re-write the creation of tunnels in python

Change-Id: I8b20134ad10abd9c021270b98c3110bd186946d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoMLRsearch: Support other than just two ratios 54/30954/61
Vratko Polak [Mon, 22 Mar 2021 16:11:21 +0000 (17:11 +0100)]
MLRsearch: Support other than just two ratios

+ Change some method names and argument types:
 + Do not mention NDR and PDR, except as examples.
 + Return list of ReceiveRateInterval instead of NdrPdrResult.
 + The resulting intervals can be degenerate when hitting min/max rate.
+ Rename quantity name parts from "fraction" to "ratio".
+ Intervals are no longer tracked for each target ratio.
 + They are found dynamically from known results.
+ Add effective_loss_ratio field to avoid loss inversion effects.
+ Move some functions to separate files.
 + Bound search logic moved to MeasurementDatabase.py
 + ProgressState moved to its file.
 + WidthArithmetics.py holds small computation functions.
+ Use parameter expansion_coefficient instead of "doublings".
+ Do uneven bisect to save time when width is not power of two times goal.
+ Timeout now correctly tracked for the whole search,
  not just the current phase.
+ Make logging (debug) function pluggable.
 + Added debug log messages for initial phase.
+ Do not mark as subclass if contructor signature differs.
+ Avoid re-measure on scale-limited (ASTF) profiles.
+ Remove outdated comments.
+ Bump copyright years.

Change-Id: I93f693b4f186f59030ee5ac21b78acc890109813
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agoFIX: LXC image 99/31699/1
pmikus [Mon, 22 Mar 2021 13:07:24 +0000 (13:07 +0000)]
FIX: LXC image

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I73f7a1095b7cee52fade8a31285e405727548394

14 months agoUpdate VPP_STABLE_VER files 73/31573/2
Tibor Frank [Mon, 22 Mar 2021 07:29:56 +0000 (07:29 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9649d4b7ed84e0dc7a0dafaf6aa78bc93c7fe5a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoTox: Increase verbosity 90/31690/3
Vratko Polak [Fri, 19 Mar 2021 10:45:20 +0000 (11:45 +0100)]
Tox: Increase verbosity

CSIT is becoming stricter in avoiding downloads during run,
as everything should be pre-cached in executor image.
This change makes it easier for human to detect downloads.

Change-Id: If7085f96ef1033f7f9405a86232a3d39a239d3e1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agoFrameworkSetup: Detect socket.timeout 91/31691/1
Vratko Polak [Fri, 19 Mar 2021 13:01:52 +0000 (14:01 +0100)]
FrameworkSetup: Detect socket.timeout

Otherwise setup "passes" leading to confusing errors later.
Example: https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-skx/1251/archives/log.html.gz#s1-s1-s1-k1-k2

Change-Id: I56b14e2eb75679c7c10b00b3f9c6bf07902e5166
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agofix two issues 58/31658/2
Yulong Pei [Tue, 16 Mar 2021 16:43:08 +0000 (00:43 +0800)]
fix two issues

1. wrong symbol link path for MLRsearch.
2. self._received force to integer in _parse_traffic_results function.

Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ie86a549b222d28b8cecc889807044476975dffb1

14 months agoInfra: Shared TG Ansible rules 76/31676/1
pmikus [Thu, 18 Mar 2021 08:36:38 +0000 (08:36 +0000)]
Infra: Shared TG Ansible rules

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d505d99003c4ab48b191c1d534513768d03bc83

14 months agoRevert "Ubuntu 20.04: Bump dill version." 71/31571/1
Peter Mikus [Thu, 18 Mar 2021 07:21:23 +0000 (07:21 +0000)]
Revert "Ubuntu 20.04: Bump dill version."

This reverts commit b6ab0f191ddc6b98b15c6629be34d3566b8d3992.

Reason for revert: wrong procedure, must be updated on all testbed and all images

Change-Id: I16e5d017d6b6413fe8474af90805970fb8832304
Signed-off-by: pmikus <pmikus@cisco.com>
14 months agoUbuntu 20.04: Bump dill version. 69/31669/4
Vratko Polak [Wed, 17 Mar 2021 13:35:44 +0000 (14:35 +0100)]
Ubuntu 20.04: Bump dill version.

This fixes the "an integer is required (got type bytes)" TypeError.

Change-Id: I63e23f1261cdfd86338d2f37ec9dff99d130f175
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agoPAL: Remove instalation of system dependencies 68/31668/3
Tibor Frank [Wed, 17 Mar 2021 09:49:31 +0000 (10:49 +0100)]
PAL: Remove instalation of system dependencies

Change-Id: I66024f3110804499fa32628b0f72711413d741ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoIPsec: fix SA policy cli 67/31667/3
Juraj Linkeš [Wed, 17 Mar 2021 07:27:33 +0000 (08:27 +0100)]
IPsec: fix SA policy cli

The tunnel specification in "ipsec sa add" has changed. Update the cli
the reflect this.

Change-Id: I11d788798419b96b1289c53052eedb9767252df6
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
14 months agoansible: arm perf TG update 20/30520/6
Juraj Linkeš [Fri, 18 Dec 2020 08:28:38 +0000 (09:28 +0100)]
ansible: arm perf TG update

Update TG to shared (docker) TG and add hugepages accordingly.

Change-Id: I45ece9d1c8d6dbc3174661447ae46a7e28613313
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
14 months agoFIX: ARM VPP_DEVICE executor 66/31666/1
pmikus [Wed, 17 Mar 2021 07:26:12 +0000 (07:26 +0000)]
FIX: ARM VPP_DEVICE executor

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2a5554884d49ab8063d84c914e447b29d79c676b

14 months agoInfra: csit-sut temporary build 64/31664/2
pmikus [Tue, 16 Mar 2021 20:41:48 +0000 (20:41 +0000)]
Infra: csit-sut temporary build

- Untill the issue with fdiotools will be solved

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3c2b06f37014a0571487d527447d90ceafdf52a9

14 months agoInfra: Upgrade csit-dut image 55/31655/4
pmikus [Tue, 16 Mar 2021 06:51:48 +0000 (06:51 +0000)]
Infra: Upgrade csit-dut image

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0341a1564ba510acf46bda3e24225209abef2f82

14 months agoPerf: Bump T-Rex to 2.88 52/31652/4
pmikus [Mon, 15 Mar 2021 19:45:04 +0000 (19:45 +0000)]
Perf: Bump T-Rex to 2.88

+ Mellanox 4.6 is not for Ubuntu 20.04
+ Mellanox for ubuntu 20.04 is 4.9+
+ T-Rex 2.86 is not for Mellanox 4.6+
+ T-Rex for Mellanox 5.2 is 2.88+
==================================
= Bump

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I902dfc2a43e6718b385e89f31a34260e09d61bd3

14 months agoAPI options: Fix case when no options are present 40/31640/2
Vratko Polak [Mon, 15 Mar 2021 09:02:45 +0000 (10:02 +0100)]
API options: Fix case when no options are present

In that case we want to pass by returning an empty dict,
as docstring already describes.
Before this, the code failed when checking for included version.

Change-Id: Ia0d6b81a64ad0e7027ac7daf15c72ace1f6982ce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agoInfra: Ansible Ubuntu 20.04 follow-ups 51/31651/1
pmikus [Mon, 15 Mar 2021 19:36:40 +0000 (19:36 +0000)]
Infra: Ansible Ubuntu 20.04 follow-ups

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I36a8b4a6cab976f51685df56c0dc2d95c00e248f

14 months agoPAL: set DEBIAN_FRONTEND=noninteractive in run_report.sh 39/31639/1
Tibor Frank [Mon, 15 Mar 2021 08:32:41 +0000 (09:32 +0100)]
PAL: set DEBIAN_FRONTEND=noninteractive in run_report.sh

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I30037a41019ca1071b1dad443a0d09054c09fb3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoUpdate VPP_STABLE_VER files 64/31564/2
Tibor Frank [Mon, 15 Mar 2021 05:18:56 +0000 (05:18 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ic0ab23721178d8e8c7322806899bc36d33ae59ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoAllow IPSECSW on 2node testbeds 27/31627/2
Vratko Polak [Fri, 12 Mar 2021 11:39:37 +0000 (12:39 +0100)]
Allow IPSECSW on 2node testbeds

Change-Id: I71d72699a7fa99749e2554fcb2252f8bd86bfdfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agoPAL: Optimize specification of elements 24/31524/29
Tibor Frank [Thu, 4 Mar 2021 11:30:07 +0000 (12:30 +0100)]
PAL: Optimize specification of elements

- plot_mrr_box_name
- plot_ndrpdr_box_name
- plot_perf_box_name
- plot_tsa_name
- plot_nf_reconf_box_name
- plot_nf_heatmap
- plot_cpta

Change-Id: I28ff2ea0e4f610e5ce48ffd083bf9a37bdc2f62d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoInfra: Minor ansible tweaks 11/31611/1
pmikus [Thu, 11 Mar 2021 08:30:44 +0000 (08:30 +0000)]
Infra: Minor ansible tweaks

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I47de0b78ed64b2426d39c5edf22ec36866609e8e

14 months agoInfra: Switch csit-shim to fdiotools 77/31577/7
pmikus [Sun, 7 Mar 2021 08:57:13 +0000 (08:57 +0000)]
Infra: Switch csit-shim to fdiotools

+ use /u/fdiotools
+ use ubuntu 20.04

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I091e63a0d9e50de203b1527c7500b3864a616af6

14 months agoInfra: Do not strict check keys in Ansible 86/31586/8
pmikus [Mon, 8 Mar 2021 12:08:26 +0000 (12:08 +0000)]
Infra: Do not strict check keys in Ansible

- not until we migrate to SSH keys in ubuntu 2004

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I796f86922c672ba053d64f317cf6adb46b845cac

14 months agoAPI: Track options and version 84/31584/5
Vratko Polak [Tue, 9 Mar 2021 13:22:34 +0000 (14:22 +0100)]
API: Track options and version

If options are not present in .api.json file
(e.g. old PVP build), use an empty dict.
If a message is used in CSIT, check its options.
Tolerate vat_help, but print warning for others.
This aims to discover in-progress and obsolete APIs.

If .api.json version is not detected, or starts with "0.",
add a "version" item to options, so they get reported.

Change-Id: Ic5a9423157728a58f7ad306c7bd9eaef3bd92488
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agoInfra: AWS/Azure fix OOM issues on smaller instances 41/31541/2
Tomas Alexy [Fri, 5 Mar 2021 10:15:55 +0000 (11:15 +0100)]
Infra: AWS/Azure fix OOM issues on smaller instances

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ic799f5eeaf03f34386603421c1d9282167c25aa5

14 months agoInfra: Add reschedule policy 76/31576/4
pmikus [Sat, 6 Mar 2021 21:03:37 +0000 (21:03 +0000)]
Infra: Add reschedule policy

Add rechedule policy to jobs so in case of failure they will respawn
in a endless loop

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I15698d9e147644e68bec549fc53474d421b25d9a

14 months agoUpdate VPP_STABLE_VER files 59/31559/2
Tibor Frank [Mon, 8 Mar 2021 05:56:28 +0000 (05:56 +0000)]
Update VPP_STABLE_VER files

Change-Id: I6ebf0bb7eb831619140a4a556f9c24b95760774e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoInfra: Docker DNS on Nomad hosts 55/31555/2
pmikus [Sat, 6 Mar 2021 19:34:41 +0000 (19:34 +0000)]
Infra: Docker DNS on Nomad hosts

+ Make the host default resolver

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifadb8901c66b65b2213878180c87370262ab22f0

14 months agoInfra: Move nginx service closer to storage 44/31544/5
pmikus [Fri, 5 Mar 2021 11:48:19 +0000 (11:48 +0000)]
Infra: Move nginx service closer to storage

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bbaa6c458e7994e964f7a07f69f9dab008a48fd

14 months agoPAL: repeat the download if it fails 2 47/31547/1
Tibor Frank [Fri, 5 Mar 2021 13:10:08 +0000 (14:10 +0100)]
PAL: repeat the download if it fails 2

Change-Id: I9bba50281bfe65f62a1cfab76364d834dc10d80c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoPAL: repeat the download if it fails 46/31546/2
Tibor Frank [Fri, 5 Mar 2021 12:36:47 +0000 (13:36 +0100)]
PAL: repeat the download if it fails

Change-Id: I0a977009345ca5e46d23cc55405c6fd9b6e61c58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoFIX: JenkinsJob alert condition 43/31543/2
pmikus [Fri, 5 Mar 2021 11:36:29 +0000 (11:36 +0000)]
FIX: JenkinsJob alert condition

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b996d0ed6252ed2b790656879e9068ff9c52039

14 months agoPAL: Fix: ignore verifying the SSL certificate 39/31539/1
Tibor Frank [Fri, 5 Mar 2021 08:00:47 +0000 (09:00 +0100)]
PAL: Fix: ignore verifying the SSL certificate

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ia39c9fcfc6240a30d48b492ec5e1451d8279c646
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoPAL: download - ignore verifying the SSL certificate 38/31538/1
Tibor Frank [Fri, 5 Mar 2021 07:43:45 +0000 (08:43 +0100)]
PAL: download - ignore verifying the SSL certificate

- only for https://logs.nginx.service.consul/vex-yul-rot-jenkins-1

Change-Id: Ibdcc59a44d5aae331aeef22fad54c4e90b2eec6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoPAL: use http instead of https for S3 36/31536/1
Tibor Frank [Fri, 5 Mar 2021 06:01:19 +0000 (07:01 +0100)]
PAL: use http instead of https for S3

Change-Id: Ie70f48142d182518d794e542052c31427d788849
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoPAL: Add s3_storage as the data source 22/31522/2
Tibor Frank [Thu, 4 Mar 2021 08:52:20 +0000 (09:52 +0100)]
PAL: Add s3_storage as the data source

Priorities for download:
1. s3_storage
2. logs.fd.io
3. docs.fd.io release
4. docs.fd.io master
5. jenkins

Change-Id: I7114715c3ec9a33acc8edf3c5c473f4eaffa639d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoFIX: Methodology GSO headers 26/31526/1
pmikus [Thu, 4 Mar 2021 13:07:16 +0000 (13:07 +0000)]
FIX: Methodology GSO headers

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I38f8b16ced2c5cfd0ea8b2b0e767f5a73f6a7dd7

14 months agoReport: Hide 2c and 4c GSO tests 21/31521/2
Tibor Frank [Thu, 4 Mar 2021 07:07:47 +0000 (08:07 +0100)]
Report: Hide 2c and 4c GSO tests

Change-Id: Ifab207f12b056a8c77911ed69590337cea4355af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoReport: GSO release notes 20/31520/1
pmikus [Thu, 4 Mar 2021 06:57:55 +0000 (06:57 +0000)]
Report: GSO release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I369afd2c90d68078443436402a6224fa42ca646d

14 months agoFIX: Ansible storage bugs 19/31519/3
pmikus [Thu, 4 Mar 2021 06:24:13 +0000 (06:24 +0000)]
FIX: Ansible storage bugs

- daily digest

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifa2dc10831fde0a101c916f2b8abd26abb93cb7f

14 months agoMethodology: GSO 86/31486/5
pmikus [Wed, 3 Mar 2021 10:13:28 +0000 (10:13 +0000)]
Methodology: GSO

- Report methodology

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1726af15ab003ff6ee4411ca1ceace986d3ee42b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
14 months agojob-specs: Update durations of jobs 80/31480/10
Tibor Frank [Tue, 2 Mar 2021 11:55:57 +0000 (12:55 +0100)]
job-specs: Update durations of jobs

- coverage
  - 2n-clx
  - 2n-skx
  - 2n-zn2
  - 2n-tx2
  - 2n-dnv
  - 3n-skx
  - 3n-hsw
  - 3n-tsh
  - 3n-dnv
- iterative
  - 2n-clx
  - 2n-skx
  - 2n-zn2
  - 2n-tx2
  - 2n-dnv
  - 3n-skx
  - 3n-hsw
  - 3n-tsh
  - 3n-dnv

Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoJob specs: add 2n-tx2 crypto mrr-daily tests 78/31478/2
Juraj Linkeš [Tue, 2 Mar 2021 08:02:20 +0000 (09:02 +0100)]
Job specs: add 2n-tx2 crypto mrr-daily tests

Iteratively increase coverage, but only of mrr-daily tests.

Because of time constraints (i.e. we won't have enough time to run all
of the tests), only add mrr-daily tests and not ndrpdr iterative/cov
tests. For iter tests, add the tests commented out which documents which
tests we're omitting from iter runs compared to mrr-daily.

Change-Id: I35625a1f67004473305cb752a98a962dcb825e16
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
14 months agojob-specs: Fix ipsec scheduler 84/31484/1
Tibor Frank [Wed, 3 Mar 2021 06:07:55 +0000 (07:07 +0100)]
job-specs: Fix ipsec scheduler

Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoFix: Async scheduler tests are not hw 83/31483/2
Vratko Polak [Tue, 2 Mar 2021 16:46:44 +0000 (17:46 +0100)]
Fix: Async scheduler tests are not hw

Suite name part is correct: swasync.
This fixes the tag, from IPSECHW to IPSECSW.

Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
14 months agoInfra: Configurable CSIT SHIM image 74/31474/3
pmikus [Mon, 1 Mar 2021 08:07:04 +0000 (08:07 +0000)]
Infra: Configurable CSIT SHIM image

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I299ed8032f9210e20c304327abca3f62cd85ee81

14 months agoUpdate VPP_STABLE_VER files 93/31393/2
Tibor Frank [Mon, 1 Mar 2021 05:23:18 +0000 (05:23 +0000)]
Update VPP_STABLE_VER files

Change-Id: I332decea2b783f7868e4a512d417c5c50990adae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoIPsec: add 2n crypto udir perf tests 09/31309/7
Juraj Linkeš [Tue, 16 Feb 2021 12:59:59 +0000 (13:59 +0100)]
IPsec: add 2n crypto udir perf tests

Add unidirectional 2n crypto tests. Only one direction can be tested on
a 2 node topology, since we can't use the same interface for both
encrypted and unencrypted traffic. Add the following tests:
* {n}tnlsw-ip4base-int ndrpdr tests
* {n}tnlsw-1atnl-ip4base-int reconf tests
* {n}tnlswasync-scheduler-ip4base-int ndrpdr tests

Where n is the number of tunnels:
1, 4, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 for the first two
1, 2, 4, 8 for the async scheduler tests

All of these with the following ecryption-auth algorithms:
aes128gcm
aes256gcm
aes128cbc-hmac256sha
aes128cbc-hmac512sha

Also add the corresponding trex profiles:
trex-stl-2n-ethip4-ip4dst{n}-udir.py

Where n is the number of tunnels listed above. The profiles are shared
among the tests.

Change-Id: I22bb46e6ad59801581a78aa19310bee8a5293e56
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
14 months agoReport: Configure rls2101.09 32/31432/1
Tibor Frank [Thu, 25 Feb 2021 06:33:33 +0000 (07:33 +0100)]
Report: Configure rls2101.09

Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
14 months agoTrending: Fix file names fro nat44 tput graphs 31/31431/3
Tibor Frank [Thu, 25 Feb 2021 06:16:38 +0000 (07:16 +0100)]
Trending: Fix file names fro nat44 tput graphs

Change-Id: I7e722b268595e8b1de370b3dde9d2b00c566f143
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoInfra: Azure - file cleanup 72/31372/2
Tomas Alexy [Mon, 22 Feb 2021 08:43:54 +0000 (09:43 +0100)]
Infra: Azure - file cleanup

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I8b97123711a76bf8851f6c4997e819d79364b83b

15 months agojob-spec: Add test suites for crypto sw scheduler engine 00/31400/3
Tibor Frank [Mon, 22 Feb 2021 14:53:05 +0000 (15:53 +0100)]
job-spec: Add test suites for crypto sw scheduler engine

Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoTrending: Add nat44-tput tests 23/31423/1
Tibor Frank [Wed, 24 Feb 2021 08:41:10 +0000 (09:41 +0100)]
Trending: Add nat44-tput tests

Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoReport: Set .08 revision, fix GSO graphs 07/31407/9
Tibor Frank [Tue, 23 Feb 2021 10:57:27 +0000 (11:57 +0100)]
Report: Set .08 revision, fix GSO graphs

Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoIpsec: Always generate ikey 25/31325/7
Vratko Polak [Mon, 22 Feb 2021 13:43:46 +0000 (14:43 +0100)]
Ipsec: Always generate ikey

Some tests use a crypto algorithm with no integrity algorithm.
Generate empty binary strings as fake integrity keys
to keep return values of low level methods consistent.

+ Add return_keys argument to avoid returning long lists.
+ Improve various docstrings.

Change-Id: Idae1877bdde32d194ce4e3bb3053c8dba39d377a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoietf: renamed mlrsearch to bmwg adopted draft 99/31399/2
Maciek Konstantynowicz [Mon, 22 Feb 2021 14:23:26 +0000 (14:23 +0000)]
ietf: renamed mlrsearch to bmwg adopted draft

Change-Id: I86401078e63c01a88b606f27bfbbd17491de99fd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
15 months agoUpdate VPP_STABLE_VER files 80/31380/5
Tibor Frank [Mon, 22 Feb 2021 06:42:26 +0000 (06:42 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3058879ed54a686eb596b2822ff943568d0d5405
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoJob specs: add 2n-tx2 memif tests 73/31373/4
Juraj Linkeš [Mon, 22 Feb 2021 08:56:42 +0000 (09:56 +0100)]
Job specs: add 2n-tx2 memif tests

Iteratively increase coverage.

Change-Id: Ia506232e68db70608b415003a031661b73023c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
15 months agoReport: Add gso tests 71/31371/22
Tibor Frank [Fri, 19 Feb 2021 13:07:29 +0000 (14:07 +0100)]
Report: Add gso tests

Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoAdd test suites for crypto sw scheduler engine 39/30039/22
Yulong Pei [Thu, 19 Nov 2020 20:56:18 +0000 (13:56 -0700)]
Add test suites for crypto sw scheduler engine

This patch is to add test suites for vpp plugin crypto_sw_scheduler,
IPsec sync mode is to do crypto and packet forward work in same worker cores,
crypto_sw_scheduler can schedule crypto work to other async crypto cores to
improve whole crypto processing capability.

This test suites configure fixed 1 rx queues per port, then measure IPsec
performance with 1, 2, 3 crypto cores.

This patchset include 1, 2, 4, 8 ipsec tunnels test cases.

+Vratko help to change to count total physical cores instead of previous only
count crypto cores in test cases.

Change-Id: I0e67182e3d13273890a23703d838101900e25126
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
15 months agoFIX: Use x710 for gso tests 61/31361/1
pmikus [Fri, 19 Feb 2021 13:31:51 +0000 (13:31 +0000)]
FIX: Use x710 for gso tests

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32

15 months agoFIX: Naming convention compliance 60/31360/4
pmikus [Fri, 19 Feb 2021 12:51:16 +0000 (12:51 +0000)]
FIX: Naming convention compliance

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046

15 months agoAPI: Use newer messages 28/31328/6
Vratko Polak [Wed, 17 Feb 2021 19:04:36 +0000 (20:04 +0100)]
API: Use newer messages

The mesages are the newest present in last common ancestor
of master and rls2101 (so not yet ipsec_sad_entry_add_del_v3).

Added a TODO for the RDMA create improvement,
to be implemented in a separate change.

Change-Id: I94bcd2f1bc109fb995c4dd6df44f8928865634f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoPerformance: Add GSO tests to report execution 58/31358/2
pmikus [Fri, 19 Feb 2021 11:40:52 +0000 (11:40 +0000)]
Performance: Add GSO tests to report execution

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb

15 months agoInfra: Ansible Ubuntu Focal 90/31290/10
pmikus [Mon, 15 Feb 2021 16:16:31 +0000 (16:16 +0000)]
Infra: Ansible Ubuntu Focal

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc

15 months agoFramework: GSO test 51/31351/5
pmikus [Thu, 18 Feb 2021 14:52:31 +0000 (14:52 +0000)]
Framework: GSO test

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad

15 months agoInfra: AWS deployment - minor fixes 55/31355/1
Tomas Alexy [Fri, 19 Feb 2021 09:10:18 +0000 (10:10 +0100)]
Infra: AWS deployment - minor fixes

Bump aws provider to 3.28
Code readability improvements

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Iaa966f2795f228e31e90acf27ca9999a730a87f0

15 months agoInfra: Fix AWS deployment 64/30964/22
Tomas Alexy [Thu, 28 Jan 2021 07:59:22 +0000 (08:59 +0100)]
Infra: Fix AWS deployment

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910

15 months agoFramework: SciPy upgrade 38/31338/4
pmikus [Thu, 18 Feb 2021 09:56:27 +0000 (09:56 +0000)]
Framework: SciPy upgrade

+ 1.5.4 to solve python3.8 dependency.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb

15 months agoFramework: Qemu 4.2 compatibility fix 39/31339/1
pmikus [Thu, 18 Feb 2021 10:02:55 +0000 (10:02 +0000)]
Framework: Qemu 4.2 compatibility fix

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d

15 months agoPAPI: Python 3.8 compatibility 26/31326/2
pmikus [Wed, 17 Feb 2021 14:27:12 +0000 (14:27 +0000)]
PAPI: Python 3.8 compatibility

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4

15 months agoInfra: Ansible docker images cleanup 05/31205/6
pmikus [Wed, 10 Feb 2021 08:14:40 +0000 (08:14 +0000)]
Infra: Ansible docker images cleanup

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0

15 months agoReport: Add data 18/31318/2
Tibor Frank [Wed, 17 Feb 2021 06:11:08 +0000 (07:11 +0100)]
Report: Add data

Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoreport: fixed typo AMD 2n-tx2 to Arm 14/31314/2
Maciek Konstantynowicz [Tue, 16 Feb 2021 18:44:21 +0000 (18:44 +0000)]
report: fixed typo AMD 2n-tx2 to Arm

Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
15 months agoInfra: Ansible 2.10 73/25173/25
Peter Mikus [Fri, 14 Feb 2020 13:03:43 +0000 (13:03 +0000)]
Infra: Ansible 2.10

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997