csit.git
3 months agoInfra: Decommission 3n-hsw - NICs 13/32513/3
pmikus [Tue, 1 Jun 2021 12:52:34 +0000 (12:52 +0000)]
Infra: Decommission 3n-hsw - NICs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5bbb573fb75d0ee7b5e9b21591e4d6ff48df917e

3 months agoInfra: Decommission 3n-hsw - topologies 09/32509/3
pmikus [Tue, 1 Jun 2021 11:17:55 +0000 (11:17 +0000)]
Infra: Decommission 3n-hsw - topologies

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iebf8dc936f8ce44f3c9250cad35d8908aabd0f33

3 months agoReport: Configure report 98/32498/12
Tibor Frank [Mon, 31 May 2021 08:35:20 +0000 (10:35 +0200)]
Report: Configure report

+ 2101 --> 2106
+ remove 3n-hsw
+ unify data sets
+ configure data sets
- implement changes from job-specs

Change-Id: I200e7a80ebf88864ce4a7a2134f5251b557f6a3a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoASTF: Fix syntax error in stop 05/32505/2
Vratko Polak [Tue, 1 Jun 2021 09:09:58 +0000 (11:09 +0200)]
ASTF: Fix syntax error in stop

When ASTF suites were introduced,
they already edited [0] actions to avoid explicit stop.
Then a refactor [1] introduced the syntax error,
but as stop never run, we didnot see it as a failure.
Finally another refactor [2] caused the stop to be called again,
exposing the syntax error.

As a related issue, pylint script was not updated to check files
in GPL directory until [3].

[0] https://gerrit.fd.io/r/c/csit/+/28205/8/tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-ip4base-h1024-p63-s64512-ndrpdr.robot#84
[1] https://gerrit.fd.io/r/c/csit/+/28208/179/GPL/tools/trex/trex_astf_stop.py#102
[2] https://gerrit.fd.io/r/c/csit/+/32030/37/resources/libraries/robot/performance/performance_utils.robot#518
[3] https://gerrit.fd.io/r/c/csit/+/32504

Change-Id: Ibd20b43cb263170d9f17255ff1bcd20f09c42cb5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoTox: Run pylint also for GPL 04/32504/3
Vratko Polak [Tue, 1 Jun 2021 08:29:17 +0000 (10:29 +0200)]
Tox: Run pylint also for GPL

Change-Id: Ic6c5d35dc602638b06962fcad30d8517c9553552
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoUpdate VPP_STABLE_VER files 29/32329/3
Tibor Frank [Mon, 31 May 2021 05:23:46 +0000 (05:23 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7f97ad53d337f78460e19a6ed4aec1dc0475d31d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoFramework: Telemetry retake 30/32030/37
pmikus [Mon, 19 Apr 2021 12:22:20 +0000 (12:22 +0000)]
Framework: Telemetry retake

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2f019a083916aec9f7816266f6ad5b92dcc31fa0

3 months agoAdd dpdk max-simd-bitwidth configuration. 09/32409/3
xinfeng zhao [Thu, 20 May 2021 02:59:02 +0000 (10:59 +0800)]
Add dpdk max-simd-bitwidth configuration.

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Reviewed-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ie7b9912eacdb60689012936580d3d774f7e470ae

3 months agoPAL: Fix requirements 48/32448/1
Tibor Frank [Wed, 26 May 2021 10:41:18 +0000 (12:41 +0200)]
PAL: Fix requirements

Change-Id: Ia40cce641e69e8155a6f1ca7e3b0631acf9fb7cb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agorxq_ratio default value changed to 1 68/32368/6
viliam.luc [Wed, 19 May 2021 08:01:47 +0000 (10:01 +0200)]
rxq_ratio default value changed to 1

Change-Id: I0c973ceffc13f4f3c5f959d56cb0890b87091a82
Signed-off-by: Viliam Luc <viliam.luc@pantheon.tech>
3 months agoPerf: Add perfmon_plugin for telemetry 44/32444/3
pmikus [Wed, 26 May 2021 05:52:51 +0000 (05:52 +0000)]
Perf: Add perfmon_plugin for telemetry

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I710af90aa5474381a82095c8a11ecf6c01c2483b

3 months agoInfra: Add fdio-marvel-dev 33/32433/1
pmikus [Tue, 25 May 2021 12:17:37 +0000 (12:17 +0000)]
Infra: Add fdio-marvel-dev

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic851dea3b763006b57e1b9c017274d3279b6a1ba

3 months agoCSIT Data driver 10/32410/13
pmikus [Fri, 21 May 2021 08:11:19 +0000 (08:11 +0000)]
CSIT Data driver

+ S3 storage driver implementation

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifafec2afbbeb4cd4724c17208ad7ec40b6cd7c96

3 months agoUpdate VPP_STABLE_VER files 24/32324/2
Tibor Frank [Mon, 24 May 2021 05:27:47 +0000 (05:27 +0000)]
Update VPP_STABLE_VER files

Change-Id: I4061323045f493a89246fd784ae1abf7760216f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agohoststack perf: iperf3 udp hoststack performance tests. 83/31983/6
Dave Wallace [Thu, 15 Apr 2021 00:58:12 +0000 (00:58 +0000)]
hoststack perf: iperf3 udp hoststack performance tests.

Change-Id: Ie2e735971934d8aeac2d436505c120f09ce67ac7
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 months agoperf: add TCP Nginx+LDPRELOAD suites 87/31987/45
xizhanx [Thu, 15 Apr 2021 05:22:40 +0000 (13:22 +0800)]
perf: add TCP Nginx+LDPRELOAD suites

1. Suite steup add download nginx
2. Add nginx-1.14.2/1.15.0 ldp test suite
3. Add NginxUtils,NginxConfigGenerator method
4. Taskset the PID of nginx to the unused cores in VPP and these cores are under NIC's NUMA ID
5. cleanup add Kill Processes - nohup

Signed-off-by: xizhanx <xix.zhang@intel.com>
Change-Id: Idbf0e4ec3bf63e88281a8e3e34f52e00a6801c85
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 months agoInfra: Additional changes 04/32304/3
pmikus [Thu, 13 May 2021 19:19:40 +0000 (19:19 +0000)]
Infra: Additional changes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie08bd125c0d7b8e47344d34db77526f6714f5c0d

4 months agoUpdate VPP_STABLE_VER files 23/32323/2
Tibor Frank [Mon, 17 May 2021 05:20:20 +0000 (05:20 +0000)]
Update VPP_STABLE_VER files

Change-Id: I6bf95404aafbbb250c7483d1333d2ddee3c01ba7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoInfra: DC move logistics update 52/32152/17
pmikus [Wed, 28 Apr 2021 06:11:26 +0000 (06:11 +0000)]
Infra: DC move logistics update

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib3c8d51ef10c73bee56ce5e440174bbede7e4806

4 months agoInfra: Nomad 91/32291/2
pmikus [Wed, 12 May 2021 18:55:13 +0000 (18:55 +0000)]
Infra: Nomad

+ Cleanup vault
+ Add native GC
+ add raid to skx

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I402cb96fb7d1dc0c7d026ae69bf29d84be171269

4 months agoPAPI stats: Use single dump 84/32284/1
Vratko Polak [Wed, 12 May 2021 08:56:45 +0000 (10:56 +0200)]
PAPI stats: Use single dump

There is only one call site (VppCounters.vpp_show_runtime)
which uses a single path ("^/sys/node"),
so we do not need to split the replies anymore.
This simplifies investigating bugs related to VPP stats.

Change-Id: Idfc029c795cd78cf6d41c2f461f7844aed53410d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoInfra: Backend infra upgrade 19/32219/14
pmikus [Wed, 5 May 2021 14:56:45 +0000 (14:56 +0000)]
Infra: Backend infra upgrade

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If1e659339f0d25ebcaab4388745c62aa0852abb3

4 months agoUpdate VPP_STABLE_VER files 94/31894/2
Tibor Frank [Mon, 10 May 2021 04:17:32 +0000 (04:17 +0000)]
Update VPP_STABLE_VER files

Change-Id: I2607595cf3c41453e18d1989a774df7aa8366fdc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add 3n-icx 48/32248/2
Tibor Frank [Fri, 7 May 2021 07:55:41 +0000 (09:55 +0200)]
Report: Add 3n-icx

Change-Id: Iad037e8c921913869db7ed3b8da145e142d14a6c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoCRC: Remove the collection from before 30345 14/32214/1
Vratko Polak [Wed, 5 May 2021 12:17:17 +0000 (14:17 +0200)]
CRC: Remove the collection from before 30345

Use current stable VPP version as collection label.

Change-Id: I10552ca78f7496ccb94d4f05ff9af17df682acce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoFIX: Vagrant ansible install 11/32211/1
pmikus [Wed, 5 May 2021 07:58:45 +0000 (07:58 +0000)]
FIX: Vagrant ansible install

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia81698d423f8545985bc1451080ae02cec91822b

4 months agoPAL: Fix plots generator 88/32188/1
Tibor Frank [Mon, 3 May 2021 10:17:03 +0000 (12:17 +0200)]
PAL: Fix plots generator

Csth hange-Id: I960c575841a92687a1272c905bbcc057de4a737e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Idb1bad40d7bd138f072f84377c4706bfcce19238
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoPAL: Refactor the processing of spec and download 21/32121/29
Tibor Frank [Mon, 26 Apr 2021 13:57:02 +0000 (15:57 +0200)]
PAL: Refactor the processing of spec and download

Change-Id: I204fdc3593a3702366727238f2b469d3d4320c2b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoUpdate VPP_STABLE_VER files 92/31892/2
Tibor Frank [Mon, 3 May 2021 05:29:12 +0000 (05:29 +0000)]
Update VPP_STABLE_VER files

Change-Id: I44fe8f5237da614194576156221562960cccf237
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoTrending: Add 2n-tx2 crypto 78/32178/1
Tibor Frank [Fri, 30 Apr 2021 11:52:41 +0000 (13:52 +0200)]
Trending: Add 2n-tx2 crypto

Change-Id: I1c0235a5a3799627ba759372fa1d3355aa2b7eea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoInfra: Vagrant ansible version 36/32136/1
pmikus [Tue, 27 Apr 2021 12:56:06 +0000 (12:56 +0000)]
Infra: Vagrant ansible version

+ In some corner cases wrong ansible version can be installed.
  Fixing to specific version.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia7f1a5644454af0819d06dbac900f69d083ca475

4 months agoInfra: Vagrant fix ansible path 35/32135/2
pmikus [Tue, 27 Apr 2021 12:08:15 +0000 (12:08 +0000)]
Infra: Vagrant fix ansible path

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id7a7b71461cad40faeca7311679e7eedec2504fe

4 months agoInfra: Vagrant typo 34/32134/2
pmikus [Tue, 27 Apr 2021 11:37:05 +0000 (11:37 +0000)]
Infra: Vagrant typo

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9c228c880c7cfc5b5007c08a5c1aa876594721f8

4 months agoInfra: AWS - add CSIT parameters to bootstrap 26/32126/5
Tomas Alexy [Mon, 26 Apr 2021 15:34:28 +0000 (17:34 +0200)]
Infra: AWS - add CSIT parameters to bootstrap

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I41b5905bcaab303a74d9985283e469922e5fba94

4 months agoInfra: Add AWS how-to 59/32059/8
Tomas Alexy [Tue, 20 Apr 2021 10:57:43 +0000 (12:57 +0200)]
Infra: Add AWS how-to

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Id111ee8e3113dae00a389ebfbb49628f35bbda6a

4 months agoUpdate VPP_STABLE_VER files 90/31890/2
Tibor Frank [Mon, 26 Apr 2021 05:25:14 +0000 (05:25 +0000)]
Update VPP_STABLE_VER files

Change-Id: Idc344ba9a83090ab181cf1bc34f2103821bf34b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoFIX: Jenkins job health config 01/32101/1
pmikus [Fri, 23 Apr 2021 06:51:23 +0000 (06:51 +0000)]
FIX: Jenkins job health config

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6acd32a210ab48c96f0dc96827a280794ebf79b0

5 months agoInfra: Vagrant upgrade to focal 39/31939/4
pmikus [Fri, 9 Apr 2021 07:04:27 +0000 (07:04 +0000)]
Infra: Vagrant upgrade to focal

+ Upgradfe to focal
+ Move to better place
+ Integrate with ansible library

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibddea33efa2c3587251f9f03921282fb47ffee31

5 months agoFrameworkSetup: increase timeout 73/32073/1
Juraj Linkeš [Wed, 21 Apr 2021 11:21:32 +0000 (13:21 +0200)]
FrameworkSetup: increase timeout

We're hitting a SSHTimeout exception when copying the framework,
increase the timeout to fix this.

Change-Id: Ic72b9b8b96290c3f0e705d79742bbd39b0bf1e71
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
5 months agoReport: Hide 2n-icx 68/32068/1
Tibor Frank [Wed, 21 Apr 2021 04:59:11 +0000 (06:59 +0200)]
Report: Hide 2n-icx

Change-Id: I1b324586e0ba64b114ad43b9404ee35faee0f787
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoCRC: Add collection for 30345 62/32062/2
Vratko Polak [Tue, 20 Apr 2021 14:11:34 +0000 (16:11 +0200)]
CRC: Add collection for 30345

30345 only afects CRC values, not what the messages do.

Change-Id: I83b64a30d56e54164a5b3150101f702a9f2fba34
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agotox: Add job-spec checker 40/31940/8
Tibor Frank [Fri, 9 Apr 2021 07:37:30 +0000 (09:37 +0200)]
tox: Add job-spec checker

Change-Id: I2bbdc28431b6271d1950ec0e74bf708cae841146
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoDPDK bump 89/31989/6
pmikus [Thu, 15 Apr 2021 10:12:10 +0000 (10:12 +0000)]
DPDK bump

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6edd980cb72111a008ae7fa19e1a4df279febdb2

5 months agoUpdate VPP_STABLE_VER files 86/31886/2
Tibor Frank [Mon, 19 Apr 2021 05:44:15 +0000 (05:44 +0000)]
Update VPP_STABLE_VER files

Change-Id: I027539dc5309d4a927a5fdd3a6b5059f7fea9d09
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoReport: 2n-icx - fix the order of chapters 26/32026/1
Tibor Frank [Mon, 19 Apr 2021 05:31:10 +0000 (07:31 +0200)]
Report: 2n-icx - fix the order of chapters

Change-Id: I736a4a20a216e935f409d3a385574f20b3df63ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoReport: Add 2n-icx latency 15/32015/2
Tibor Frank [Fri, 16 Apr 2021 17:35:25 +0000 (19:35 +0200)]
Report: Add 2n-icx latency

Change-Id: Ie8a4c93340aa6f74dc3f5ac5f1a4669ac8469dbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoReport: Add 2n-icx 08/32008/5
Tibor Frank [Fri, 16 Apr 2021 12:21:38 +0000 (14:21 +0200)]
Report: Add 2n-icx

Change-Id: I22e089ebb343bbb3fd057c1f1638942ea03f65fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoPAL: Add a new download path 91/31991/5
Tibor Frank [Thu, 15 Apr 2021 11:38:01 +0000 (13:38 +0200)]
PAL: Add a new download path

- "{job}/{build}/{filename}"

Change-Id: Ibdd86a708e17df32b4866e058614da5e9814a8f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoAWS: Add jobspecs 75/31975/3
Tomas Alexy [Wed, 14 Apr 2021 11:57:30 +0000 (13:57 +0200)]
AWS: Add jobspecs

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I93c3d2a25bddc6623c131b5cd1742bb55b1ee7c3

5 months agocommon.sh - fix 3n AWS topology tag selection 88/31988/2
Tomas Alexy [Thu, 15 Apr 2021 08:49:14 +0000 (10:49 +0200)]
common.sh - fix 3n AWS topology tag selection

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ic6dd4a14887d572487d7d4efcca8a437cf140ca9

5 months agorequirements: Update Sphinx to the latest versions 86/31986/1
Tibor Frank [Thu, 15 Apr 2021 04:34:14 +0000 (06:34 +0200)]
requirements: Update Sphinx to the latest versions

Change-Id: I4efcbe62d696227ce33444da38d06573fbfcbba6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoPAL: Update Sphinx to the latest versions 74/31974/1
Tibor Frank [Wed, 14 Apr 2021 11:17:29 +0000 (13:17 +0200)]
PAL: Update Sphinx to the latest versions

Change-Id: Id42b7e63f5bef7c99d9c1cd564e1e749ed3d2542
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoPAL: Fix path to the theme 73/31973/9
Tibor Frank [Wed, 14 Apr 2021 08:27:57 +0000 (10:27 +0200)]
PAL: Fix path to the theme

Change-Id: I960c575841a92687a1272c905bbcc057de4a737e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoInfra: common.sh - add ENA 50g NIC 65/31965/2
Tomas Alexy [Tue, 13 Apr 2021 13:11:17 +0000 (15:11 +0200)]
Infra: common.sh - add ENA 50g NIC

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Idc672f6086ab9d4ad38b52947a52c667d0908d8f

5 months agoTerraform: change slack api hooks 64/31964/1
pmikus [Tue, 13 Apr 2021 12:44:30 +0000 (12:44 +0000)]
Terraform: change slack api hooks

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3ae716a6a35f8fce994c3333e29a33b8aa2ebe56

5 months agoInfra: Ansible E810 ddp/driver 63/31963/2
pmikus [Tue, 13 Apr 2021 12:01:20 +0000 (12:01 +0000)]
Infra: Ansible E810 ddp/driver

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I383ae63bdfb24a9e8a5cd629a711537607ebf4e9

5 months agoTrening: unhide cx556a tests 62/31962/1
Tibor Frank [Tue, 13 Apr 2021 11:54:06 +0000 (13:54 +0200)]
Trening: unhide cx556a tests

Change-Id: Ie5543ac0da678a10a2e62fc7be1b0b3f212c746b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoUpdate VPP_STABLE_VER files 81/31881/3
Tibor Frank [Mon, 12 Apr 2021 05:29:09 +0000 (05:29 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7f998fef3250368ea9b88ff3eb5d46762ece82ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoInfra: AWS bootstrap integration 31/31931/5
Tomas Alexy [Thu, 8 Apr 2021 13:50:24 +0000 (15:50 +0200)]
Infra: AWS bootstrap integration

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I254c79201a198ee054851c934167a24e9e8803cb

5 months agojob-spec: Fix job-specs 41/31941/2
Tibor Frank [Fri, 9 Apr 2021 07:42:25 +0000 (09:42 +0200)]
job-spec: Fix job-specs

- remove redundant empty lines
- fix the number of tests in job-spec and its duration

Change-Id: I50fc0f151dedf7d2e9858ecc3959ab42a243bb1d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoDocs: Update file structure 28/31928/2
pmikus [Thu, 8 Apr 2021 12:08:47 +0000 (12:08 +0000)]
Docs: Update file structure

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9422584caf87cb163c44ff4ac16df07f288581ce

5 months agoRemove obsolete image builder 29/31929/1
pmikus [Thu, 8 Apr 2021 12:12:30 +0000 (12:12 +0000)]
Remove obsolete image builder

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6cb73a6b9fbbdec2d7127f2457cbe21d12cd3e64

5 months agoInfra: UEFI PXE integrated infra 83/31283/33
pmikus [Mon, 15 Feb 2021 12:01:48 +0000 (12:01 +0000)]
Infra: UEFI PXE integrated infra

+ uefi
 + dnsmasq
 + nginx
+ ubuntu focal {arm64|amd64}

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9974a5b9255d64ba8b8231cf81f59c048b52bbba

5 months agoAnsible git move 25/31925/4
pmikus [Thu, 8 Apr 2021 10:44:18 +0000 (10:44 +0000)]
Ansible git move

+ Better accessibility
+ Compliant with fdio.infra._function_
  - function [pxe|terraform|ansible|vagrant]
+ dill==0.3.3 also applied on TBs
  - ci-man to follow today
- Docs to be updated in separate patch

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iff9eaa29d63044188cc8160db2d9b44b7635782a

5 months agoInfra: AWS Update to Ubuntu 20.04 62/31862/7
Tomas Alexy [Thu, 1 Apr 2021 13:44:14 +0000 (15:44 +0200)]
Infra: AWS Update to Ubuntu 20.04

- Change AMI image to Ubuntu 20.04
- Add calibration role
- Add AWS vfio-patch for kernel 5.8+
- Prepare root module's main.tf to be used with environment variables

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I7db3f28ba573a5a8a1dc07179ef78ef34ce9ebf3

5 months agojob-specs: Update durations of arm mrr jobs 18/31918/1
Juraj Linkeš [Wed, 7 Apr 2021 09:31:24 +0000 (11:31 +0200)]
job-specs: Update durations of arm mrr jobs

Update after new policy tests were enabled in iterative 2n-tx2 and
3n-tsh.

Change-Id: I53986f8c7ba6cd83c73d7d615da07a32ad99c24b
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
5 months agoSetupFramework: Log env activation outputs 03/31903/3
Vratko Polak [Tue, 6 Apr 2021 14:53:09 +0000 (16:53 +0200)]
SetupFramework: Log env activation outputs

Useful for verifying how much is SUT ready for requirements.txt content.

Change-Id: I1e8443f2f9391d646e79a451a88df961845700e4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agoDPDK buid: Fix sed command 07/31907/1
Vratko Polak [Tue, 6 Apr 2021 16:56:25 +0000 (18:56 +0200)]
DPDK buid: Fix sed command

The previous way of concatenating strings would not work even in Python.

Change-Id: Ice06f4a06fefbc4e42ee2572786244207dfefa11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agoUpdate VPP_STABLE_VER files 79/31879/2
Tibor Frank [Tue, 6 Apr 2021 05:44:39 +0000 (05:44 +0000)]
Update VPP_STABLE_VER files

Change-Id: I8030b6efcb8c510bfdb82523ffe1610707fcc7c5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoJob specs: add crypto tests to Arm perf jobs 63/31863/1
Juraj Linkeš [Thu, 1 Apr 2021 14:05:36 +0000 (16:05 +0200)]
Job specs: add crypto tests to Arm perf jobs

Increase coverage by adding aes128gcm protection mode and policy
testcases.

Change-Id: I6f9e7b89208397efe4e06a63d3e06caaf19f3b0a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
5 months agoIPsec: add 4, 40 and 400 tunnel policy tests 40/31840/3
Juraj Linkeš [Wed, 31 Mar 2021 13:45:44 +0000 (15:45 +0200)]
IPsec: add 4, 40 and 400 tunnel policy tests

Add more granularity test policy tests. Mirror the number of tunnels in
other IPsec tests under 1000 tunnels.

Change-Id: I9bde7447a5d809bab05db132bf6cb524e97e19b3
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
5 months agoMLRsearch: Update PyPI metadata for v0.4.0 42/31842/1
Vratko Polak [Wed, 31 Mar 2021 15:26:11 +0000 (17:26 +0200)]
MLRsearch: Update PyPI metadata for v0.4.0

Change-Id: I8107097843a3bcddc28ac8a61f72614a3c3145ac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agoTrafficGenerator: Less logging of unsent 94/31794/3
Vratko Polak [Mon, 29 Mar 2021 15:54:51 +0000 (17:54 +0200)]
TrafficGenerator: Less logging of unsent

When a trial has explicit stop instead of duration
(e.g. for show run), the computation of unsent packets is wrong,
so simply do not log the result.

Change-Id: I7722c85b156f92e456eda212104abdb216e78b04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agoIPsec: add 2n crypto policy udir perf tests 05/31605/23
Juraj Linkeš [Wed, 10 Mar 2021 08:31:23 +0000 (09:31 +0100)]
IPsec: add 2n crypto policy udir perf tests

Add 2n1l udir 1 and 1000 tunnel sw policy IPsec tests to mirror the
existing 3n tests.

Add static ip neighbor mac entries which can't be retrieved in 2node
setups.

Change-Id: I13dd557cbeed7f907fa9b4c21e4e245d48916513
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
5 months agoDevice: Add stats test with AVF 28/31828/5
Vratko Polak [Tue, 30 Mar 2021 13:20:41 +0000 (15:20 +0200)]
Device: Add stats test with AVF

+ Extract the stats keyword into a library.

Change-Id: Icfaaa32c2a97d479ba0339acf34b865006949a89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agoPAPI stats: Use list as argument to ls 26/31826/2
Vratko Polak [Tue, 30 Mar 2021 14:31:26 +0000 (16:31 +0200)]
PAPI stats: Use list as argument to ls

In the VPP PAPI stats code, the "ls" argument has always [0]
been named "patterns", suggesting it expects a list of strings.
In the CSIT utility we have always [1] been using it wrong
(passing a single string), but it happened to work
as VPP code had a workaround [2] for that.
This workaround that got removed by accident in [3],
and will be reintroduced in [4].

This change fixes occasional failures in CSIT
(if merged sooner than [4]), mainly useful
in aviding such failures during bisection.

[0] https://gerrit.fd.io/r/c/vpp/+/14584/4/src/vpp-api/python/vpp_papi/vpp_stats.py#122
[1] https://gerrit.fd.io/r/c/csit/+/18419/13/resources/tools/papi/vpp_papi_provider.py#181
[2] https://gerrit.fd.io/r/c/vpp/+/14584/4/src/vpp-api/python/vpp_papi/vpp_stats.py#64
[3] https://gerrit.fd.io/r/c/vpp/+/31678
[4] https://gerrit.fd.io/r/c/vpp/+/31817

Change-Id: Ic0f9d906be064b386b67154ba738646c4362aa2b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agodoc: add fdio dc vexxhost server inventory across all locations 62/30662/14
Maciek Konstantynowicz [Thu, 7 Jan 2021 19:51:56 +0000 (19:51 +0000)]
doc: add fdio dc vexxhost server inventory across all locations

Change-Id: I17ffb5912964bd0c2da59ad4843dfb411f9c3e0c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 months agoUpdate VPP_STABLE_VER files 25/31725/6
Tibor Frank [Mon, 29 Mar 2021 06:07:01 +0000 (06:07 +0000)]
Update VPP_STABLE_VER files

Change-Id: I696cb7687574faa5b8acc14c469a0861e1ed9294
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoInfra: AWS deployment improvements 59/31659/2
Tomas Alexy [Tue, 16 Mar 2021 11:25:09 +0000 (12:25 +0100)]
Infra: AWS deployment improvements

- Add checks where missing
- Serialize instance deployment to prevent race conditions
Deploy tg -> sut1 (-> sut2) then start ansible provisioning on all instances
- Bump AWS provisioner version to 3.32

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I9a53b1de96574674f3608f19a8f5ac297eb1bd86

5 months agoFIX: VPP version file name based on OS 76/31776/5
pmikus [Thu, 25 Mar 2021 18:38:33 +0000 (18:38 +0000)]
FIX: VPP version file name based on OS

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icab8b87498e8487268857bb04c5ba7069d9297e3

5 months agoSTL traffic: Use the sleep+stop logic 84/31284/96
Vratko Polak [Thu, 25 Mar 2021 18:26:35 +0000 (19:26 +0100)]
STL traffic: Use the sleep+stop logic

+ PPS limit for AWS set to 1.2 Mpps.
+ The logic is very similar to that one in ASTF driver.
 + This helps for testbeds with high duration stretching (e.g. AWS).
 + Difference: No transaction scale, and we deal with floats.
+ Update loss counting to count unsent packets as lost.
 + Also count "unsent" transactions for other transaction types.
 + If nonzero, log the number of unsent packets/transactions.
+ Make STL and ASTF time overhead constant (called delay) configurable.
+ Subtract delay from approximated_duration, also for ASTF.

Change-Id: I6ee6aa6fba4f110ba1636e1b0ff76cac64383e33
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agoParametrize T-Rex rx/tx descriptors count 67/31767/16
Tomas Alexy [Thu, 25 Mar 2021 14:15:17 +0000 (15:15 +0100)]
Parametrize T-Rex rx/tx descriptors count

Additional configuration can provide performance boosts when running in virtual environments
If set to 0, uses default DPDK value
By tuning this value it's also possible to run T-Rex 2.88 with ENA NICs on AWS

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I43c86ea1d9aa854a1087f07fe544ac77a5b80397

5 months agoansible: update TX2 VPP Device hugepages and ifs 78/31778/2
Juraj Linkeš [Fri, 26 Mar 2021 08:30:58 +0000 (09:30 +0100)]
ansible: update TX2 VPP Device hugepages and ifs

These interfaces are not used, so remove them until we actually use
them.
Use less amount of hugepages since we don't need as much and the rest of
the memory is more useful for build/host processes.

Change-Id: I52b2d6e2812e5cadeab9e51a1bae3688794f414a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
5 months agoFrameworkSetup: fix timeout in Arm setup 45/31745/1
Juraj Linkeš [Wed, 24 Mar 2021 14:28:22 +0000 (15:28 +0100)]
FrameworkSetup: fix timeout in Arm setup

Framework extraction in Arm jobs is taking longer than the current
timeout. Increase the timeout to fix this.

Change-Id: I436d3131fcd7c25fd1f9607095712b4a8aa2d28c
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
5 months agoFrameworkSetup: catch all exceptions in threads 04/31704/5
Juraj Linkeš [Tue, 23 Mar 2021 07:46:16 +0000 (08:46 +0100)]
FrameworkSetup: catch all exceptions in threads

Any uncaught exception in a thread running setup_node or cleanup_node
will prevent the result of that thread's execution from being passed
to the main thread. Since the main thread assumes there will be a result
for each thread, this leads to false positives. Catch all exceptions
in those background threads to fix this.

Change-Id: I64013dfc671e576290c8376a58c754ed21b9ba3e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
6 months agoInfra: fix NUMA count in Arm DPDK build 05/31705/3
Juraj Linkeš [Tue, 23 Mar 2021 09:06:50 +0000 (10:06 +0100)]
Infra: fix NUMA count in Arm DPDK build

The default NUMA value for Taishan build is insufficient and results in
failed test runs. Fix by increasing the amount to what's on the device.

Change-Id: Ia7c761e81ee9063d7129472d9caa8cebbbb7e1cf
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
6 months agoGeneve: Re-write the creation of tunnels in python 67/31167/11
Tibor Frank [Mon, 8 Feb 2021 16:19:32 +0000 (17:19 +0100)]
Geneve: Re-write the creation of tunnels in python

Change-Id: I8b20134ad10abd9c021270b98c3110bd186946d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 months agoMLRsearch: Support other than just two ratios 54/30954/61
Vratko Polak [Mon, 22 Mar 2021 16:11:21 +0000 (17:11 +0100)]
MLRsearch: Support other than just two ratios

+ Change some method names and argument types:
 + Do not mention NDR and PDR, except as examples.
 + Return list of ReceiveRateInterval instead of NdrPdrResult.
 + The resulting intervals can be degenerate when hitting min/max rate.
+ Rename quantity name parts from "fraction" to "ratio".
+ Intervals are no longer tracked for each target ratio.
 + They are found dynamically from known results.
+ Add effective_loss_ratio field to avoid loss inversion effects.
+ Move some functions to separate files.
 + Bound search logic moved to MeasurementDatabase.py
 + ProgressState moved to its file.
 + WidthArithmetics.py holds small computation functions.
+ Use parameter expansion_coefficient instead of "doublings".
+ Do uneven bisect to save time when width is not power of two times goal.
+ Timeout now correctly tracked for the whole search,
  not just the current phase.
+ Make logging (debug) function pluggable.
 + Added debug log messages for initial phase.
+ Do not mark as subclass if contructor signature differs.
+ Avoid re-measure on scale-limited (ASTF) profiles.
+ Remove outdated comments.
+ Bump copyright years.

Change-Id: I93f693b4f186f59030ee5ac21b78acc890109813
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 months agoFIX: LXC image 99/31699/1
pmikus [Mon, 22 Mar 2021 13:07:24 +0000 (13:07 +0000)]
FIX: LXC image

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I73f7a1095b7cee52fade8a31285e405727548394

6 months agoUpdate VPP_STABLE_VER files 73/31573/2
Tibor Frank [Mon, 22 Mar 2021 07:29:56 +0000 (07:29 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9649d4b7ed84e0dc7a0dafaf6aa78bc93c7fe5a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 months agoTox: Increase verbosity 90/31690/3
Vratko Polak [Fri, 19 Mar 2021 10:45:20 +0000 (11:45 +0100)]
Tox: Increase verbosity

CSIT is becoming stricter in avoiding downloads during run,
as everything should be pre-cached in executor image.
This change makes it easier for human to detect downloads.

Change-Id: If7085f96ef1033f7f9405a86232a3d39a239d3e1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 months agoFrameworkSetup: Detect socket.timeout 91/31691/1
Vratko Polak [Fri, 19 Mar 2021 13:01:52 +0000 (14:01 +0100)]
FrameworkSetup: Detect socket.timeout

Otherwise setup "passes" leading to confusing errors later.
Example: https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-skx/1251/archives/log.html.gz#s1-s1-s1-k1-k2

Change-Id: I56b14e2eb75679c7c10b00b3f9c6bf07902e5166
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 months agofix two issues 58/31658/2
Yulong Pei [Tue, 16 Mar 2021 16:43:08 +0000 (00:43 +0800)]
fix two issues

1. wrong symbol link path for MLRsearch.
2. self._received force to integer in _parse_traffic_results function.

Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ie86a549b222d28b8cecc889807044476975dffb1

6 months agoInfra: Shared TG Ansible rules 76/31676/1
pmikus [Thu, 18 Mar 2021 08:36:38 +0000 (08:36 +0000)]
Infra: Shared TG Ansible rules

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d505d99003c4ab48b191c1d534513768d03bc83

6 months agoRevert "Ubuntu 20.04: Bump dill version." 71/31571/1
Peter Mikus [Thu, 18 Mar 2021 07:21:23 +0000 (07:21 +0000)]
Revert "Ubuntu 20.04: Bump dill version."

This reverts commit b6ab0f191ddc6b98b15c6629be34d3566b8d3992.

Reason for revert: wrong procedure, must be updated on all testbed and all images

Change-Id: I16e5d017d6b6413fe8474af90805970fb8832304
Signed-off-by: pmikus <pmikus@cisco.com>
6 months agoUbuntu 20.04: Bump dill version. 69/31669/4
Vratko Polak [Wed, 17 Mar 2021 13:35:44 +0000 (14:35 +0100)]
Ubuntu 20.04: Bump dill version.

This fixes the "an integer is required (got type bytes)" TypeError.

Change-Id: I63e23f1261cdfd86338d2f37ec9dff99d130f175
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 months agoPAL: Remove instalation of system dependencies 68/31668/3
Tibor Frank [Wed, 17 Mar 2021 09:49:31 +0000 (10:49 +0100)]
PAL: Remove instalation of system dependencies

Change-Id: I66024f3110804499fa32628b0f72711413d741ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 months agoIPsec: fix SA policy cli 67/31667/3
Juraj Linkeš [Wed, 17 Mar 2021 07:27:33 +0000 (08:27 +0100)]
IPsec: fix SA policy cli

The tunnel specification in "ipsec sa add" has changed. Update the cli
the reflect this.

Change-Id: I11d788798419b96b1289c53052eedb9767252df6
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
6 months agoansible: arm perf TG update 20/30520/6
Juraj Linkeš [Fri, 18 Dec 2020 08:28:38 +0000 (09:28 +0100)]
ansible: arm perf TG update

Update TG to shared (docker) TG and add hugepages accordingly.

Change-Id: I45ece9d1c8d6dbc3174661447ae46a7e28613313
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
6 months agoFIX: ARM VPP_DEVICE executor 66/31666/1
pmikus [Wed, 17 Mar 2021 07:26:12 +0000 (07:26 +0000)]
FIX: ARM VPP_DEVICE executor

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2a5554884d49ab8063d84c914e447b29d79c676b