csit.git
3 years agoInfra: Ansible Ubuntu Focal 90/31290/10
pmikus [Mon, 15 Feb 2021 16:16:31 +0000 (16:16 +0000)]
Infra: Ansible Ubuntu Focal

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc

3 years agoFramework: GSO test 51/31351/5
pmikus [Thu, 18 Feb 2021 14:52:31 +0000 (14:52 +0000)]
Framework: GSO test

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad

3 years agoInfra: AWS deployment - minor fixes 55/31355/1
Tomas Alexy [Fri, 19 Feb 2021 09:10:18 +0000 (10:10 +0100)]
Infra: AWS deployment - minor fixes

Bump aws provider to 3.28
Code readability improvements

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Iaa966f2795f228e31e90acf27ca9999a730a87f0

3 years agoInfra: Fix AWS deployment 64/30964/22
Tomas Alexy [Thu, 28 Jan 2021 07:59:22 +0000 (08:59 +0100)]
Infra: Fix AWS deployment

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910

3 years agoFramework: SciPy upgrade 38/31338/4
pmikus [Thu, 18 Feb 2021 09:56:27 +0000 (09:56 +0000)]
Framework: SciPy upgrade

+ 1.5.4 to solve python3.8 dependency.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb

3 years agoFramework: Qemu 4.2 compatibility fix 39/31339/1
pmikus [Thu, 18 Feb 2021 10:02:55 +0000 (10:02 +0000)]
Framework: Qemu 4.2 compatibility fix

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d

3 years agoPAPI: Python 3.8 compatibility 26/31326/2
pmikus [Wed, 17 Feb 2021 14:27:12 +0000 (14:27 +0000)]
PAPI: Python 3.8 compatibility

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4

3 years agoInfra: Ansible docker images cleanup 05/31205/6
pmikus [Wed, 10 Feb 2021 08:14:40 +0000 (08:14 +0000)]
Infra: Ansible docker images cleanup

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0

3 years agoReport: Add data 18/31318/2
Tibor Frank [Wed, 17 Feb 2021 06:11:08 +0000 (07:11 +0100)]
Report: Add data

Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: fixed typo AMD 2n-tx2 to Arm 14/31314/2
Maciek Konstantynowicz [Tue, 16 Feb 2021 18:44:21 +0000 (18:44 +0000)]
report: fixed typo AMD 2n-tx2 to Arm

Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoInfra: Ansible 2.10 73/25173/25
Peter Mikus [Fri, 14 Feb 2020 13:03:43 +0000 (13:03 +0000)]
Infra: Ansible 2.10

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997

3 years agoRCA: Link to NAT44ed performance regression bug 08/31308/1
Vratko Polak [Tue, 16 Feb 2021 09:33:15 +0000 (10:33 +0100)]
RCA: Link to NAT44ed performance regression bug

Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: Add data 07/31307/1
Tibor Frank [Tue, 16 Feb 2021 08:43:47 +0000 (09:43 +0100)]
Report: Add data

Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add comp tables for 2n-clx with mellanox NIC 82/31282/6
Tibor Frank [Mon, 15 Feb 2021 10:51:04 +0000 (11:51 +0100)]
Report: Add comp tables for 2n-clx with mellanox NIC

Change-Id: I64f1821877f749cfb44b886b4760faba577a2014
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add framework speedup to notes 91/31291/1
Vratko Polak [Mon, 15 Feb 2021 16:18:26 +0000 (17:18 +0100)]
Report: Add framework speedup to notes

Change-Id: If01c977a48bb64c53608f6b937a715fc11000446
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoRelease notes: Tput tests and jumbo ipsec 63/31263/1
Vratko Polak [Mon, 15 Feb 2021 09:33:59 +0000 (10:33 +0100)]
Release notes: Tput tests and jumbo ipsec

+ Also randomized profiles.

Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 1b6c4949b794b0efd091f101ff450a04944c21ba)

3 years agoReport: Add 2n-clx cx556a Latency graphs 81/31281/1
Tibor Frank [Mon, 15 Feb 2021 09:57:15 +0000 (10:57 +0100)]
Report: Add 2n-clx cx556a Latency graphs

Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate VPP_STABLE_VER files 57/31257/2
Tibor Frank [Mon, 15 Feb 2021 05:21:11 +0000 (05:21 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7baa8931325b16363b7d95c1bc17d82f75a109d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Fix spec for Latency by percentile: 2n-clx MLX 50/31250/1
Tibor Frank [Fri, 12 Feb 2021 13:17:23 +0000 (14:17 +0100)]
Report: Fix spec for Latency by percentile: 2n-clx MLX

Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: re-group RND tests 48/31248/1
Tibor Frank [Fri, 12 Feb 2021 12:56:53 +0000 (13:56 +0100)]
Report: re-group RND tests

Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoMethodology: Added packet flow ordering 65/31165/5
Vratko Polak [Tue, 9 Feb 2021 16:16:21 +0000 (17:16 +0100)]
Methodology: Added packet flow ordering

Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Add data 36/31236/2
Tibor Frank [Thu, 11 Feb 2021 11:51:34 +0000 (12:51 +0100)]
Report: Add data

Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoJob specs: Add -tput tests to iterative 37/31237/1
Tibor Frank [Thu, 11 Feb 2021 12:01:01 +0000 (13:01 +0100)]
Job specs: Add -tput tests to iterative

- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
 + Because ip4base is stateless.
 + So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.

Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add 2n-clx Mellanox tests and graphs 28/31228/2
Tibor Frank [Thu, 11 Feb 2021 09:04:07 +0000 (10:04 +0100)]
Report: Add 2n-clx Mellanox tests and graphs

Change-Id: Ib947d47b31138ac816acefee03429d454511dd05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: vpp device i40e known issue 13/31213/2
Juraj Linkeš [Wed, 10 Feb 2021 13:46:46 +0000 (14:46 +0100)]
Report: vpp device i40e known issue

Add the i40e PF/VF race condition known issue to the known issues list.

Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport: Add data 11/31211/2
Tibor Frank [Wed, 10 Feb 2021 12:12:05 +0000 (13:12 +0100)]
Report: Add data

Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoMethodology: Add NAT44ed tput tests 00/31200/2
Vratko Polak [Tue, 9 Feb 2021 17:18:12 +0000 (18:18 +0100)]
Methodology: Add NAT44ed tput tests

Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: Small fixes 09/31209/2
Tibor Frank [Wed, 10 Feb 2021 10:35:45 +0000 (11:35 +0100)]
Report: Small fixes

Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: Hide slack url 08/31208/1
pmikus [Wed, 10 Feb 2021 09:39:28 +0000 (09:39 +0000)]
FIX: Hide slack url

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If965c0d4ff52d96c407cf83b642119c321cc25fc

3 years agoInfra: JenkinsJobHealthExporter 28/31128/7
pmikus [Fri, 5 Feb 2021 14:51:43 +0000 (14:51 +0000)]
Infra: JenkinsJobHealthExporter

- Integration of Jenkins Job checker

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I822039cb64a3a352b49314ddab7c6099af3fe644

3 years agoReport: Update release note section 60/31160/5
pmikus [Mon, 8 Feb 2021 11:39:24 +0000 (11:39 +0000)]
Report: Update release note section

- Infra update
- Cleanup

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35

3 years agoReport: Add data 04/31204/1
Tibor Frank [Wed, 10 Feb 2021 06:24:07 +0000 (07:24 +0100)]
Report: Add data

Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Hide nat44 tput tests 98/31198/1
Tibor Frank [Tue, 9 Feb 2021 14:08:08 +0000 (15:08 +0100)]
Report: Hide nat44 tput tests

Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add latency graphs for NAT44 tput tests 73/31173/1
Tibor Frank [Tue, 9 Feb 2021 10:30:58 +0000 (11:30 +0100)]
Report: Add latency graphs for NAT44 tput tests

Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add NAT44 tput tests 71/31171/1
Tibor Frank [Tue, 9 Feb 2021 06:57:19 +0000 (07:57 +0100)]
Report: Add NAT44 tput tests

Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: Update packet latency methodology 02/31102/4
Maciek Konstantynowicz [Wed, 3 Feb 2021 14:37:01 +0000 (14:37 +0000)]
report: Update packet latency methodology

Change-Id: I0378e96c6f64a1dd035d56465710b82f64dc4d32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoFIX: Nic selection 61/31161/2
pmikus [Mon, 8 Feb 2021 11:43:51 +0000 (11:43 +0000)]
FIX: Nic selection

- Buggy unnoticed for quite some time

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa

3 years agoLatency graphs: Do not hardcode x range 59/31159/1
Vratko Polak [Mon, 8 Feb 2021 10:31:57 +0000 (11:31 +0100)]
Latency graphs: Do not hardcode x range

+ Compute it from PERCENTILE_MAX.
+ Use slightly higher PERCENTILE_MAX to avoid rounding errors.
+ Add a comment why slightly higher value is needed.

Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agojob-spec: fix report_coverage/2n-tx2/l2-04.md 57/31157/2
Tibor Frank [Mon, 8 Feb 2021 09:05:10 +0000 (10:05 +0100)]
job-spec: fix report_coverage/2n-tx2/l2-04.md

- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by
  eth-l2bdbasemaclrn-macip-iacl50sl-10kflows

Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate VPP_STABLE_VER files 49/31149/3
Tibor Frank [Mon, 8 Feb 2021 08:53:25 +0000 (08:53 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3fbe46788e8b3b5701134e842b4db4583d842214
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: add 2n-tx2 phy testbed diagram and update description 88/31088/3
Maciek Konstantynowicz [Tue, 2 Feb 2021 12:00:21 +0000 (12:00 +0000)]
report: add 2n-tx2 phy testbed diagram and update description

Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoTraffic generator: Force ramp-up in next test 29/31129/2
Vratko Polak [Fri, 5 Feb 2021 15:14:27 +0000 (16:14 +0100)]
Traffic generator: Force ramp-up in next test

The behavior was already documented, just not implemented properly.

Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: Add data 56/31156/1
Tibor Frank [Mon, 8 Feb 2021 08:41:43 +0000 (09:41 +0100)]
Report: Add data

Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 33/31133/2
Tibor Frank [Fri, 5 Feb 2021 19:36:00 +0000 (20:36 +0100)]
Report: Add data

Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoRevert "Job specs: Add -tput tests to iterative" 45/31145/2
Tibor Frank [Fri, 5 Feb 2021 19:19:04 +0000 (19:19 +0000)]
Revert "Job specs: Add -tput tests to iterative"

This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5.

Reason for revert: Faulty tests, those which are running
take too much time

Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoJob specs: Add -tput tests to iterative 25/31125/2
Vratko Polak [Fri, 5 Feb 2021 12:48:06 +0000 (13:48 +0100)]
Job specs: Add -tput tests to iterative

- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
 + Because ip4base is stateless.
 + So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.

Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: Various fixes 26/31126/3
Tibor Frank [Fri, 5 Feb 2021 13:28:06 +0000 (14:28 +0100)]
Report: Various fixes

Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoNAT44ed: Add pure throuhput bidir tests 78/30278/39
Vratko Polak [Fri, 5 Feb 2021 10:46:40 +0000 (11:46 +0100)]
NAT44ed: Add pure throuhput bidir tests

+ With ramp-up, without reset, with session verification.
+ Uses the same profile as pps tests.
+ Ramp up duration is not specified, as duration is computed.
+ Timeout tracking with automated ramp-up.
 + Correct computation of next duration.
 + Checking both early and late sessions.
 + No loss measurement also acts as a ramp-up.
+ Return ReceiveRateMeasurement from send_traffic_on_tg_internal,
  as that is needed for detecting whether trial is ok as ramp up.
- Udp needs quite low ramp-up rate after recent regression.
 - Max scale has higher rate (so failing) to avoid session timeouts.
+ Bump copyright year.

Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: Set range of x-axis for latency graphs, add data 24/31124/1
Tibor Frank [Fri, 5 Feb 2021 09:44:24 +0000 (10:44 +0100)]
Report: Set range of x-axis for latency graphs, add data

Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: RND tests 21/31121/1
Tibor Frank [Fri, 5 Feb 2021 08:28:48 +0000 (09:28 +0100)]
Trending: RND tests

Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 20/31120/1
Tibor Frank [Fri, 5 Feb 2021 07:42:12 +0000 (08:42 +0100)]
Report: Add data

Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Move probes under ansible instead of terraform 16/31116/4
pmikus [Thu, 4 Feb 2021 13:03:12 +0000 (13:03 +0000)]
Infra: Move probes under ansible instead of terraform

+ More stable probe handling.
+ Naming cleanup due to errors.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bb1237af20636919f869f2eee53597202d00792

3 years agoReport: Set the range of x-axis fro Latency graphs 17/31117/1
Tibor Frank [Thu, 4 Feb 2021 13:19:00 +0000 (14:19 +0100)]
Report: Set the range of x-axis fro Latency graphs

Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add 2n-clx rnd latency graphs 09/31109/1
Tibor Frank [Thu, 4 Feb 2021 08:48:30 +0000 (09:48 +0100)]
Report: Add 2n-clx rnd latency graphs

Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 08/31108/1
Tibor Frank [Thu, 4 Feb 2021 08:42:42 +0000 (09:42 +0100)]
Report: Add data

Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 06/31106/1
Tibor Frank [Thu, 4 Feb 2021 07:16:47 +0000 (08:16 +0100)]
Report: Add data

Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Latency graphs 03/31103/9
Tibor Frank [Wed, 3 Feb 2021 16:03:54 +0000 (17:03 +0100)]
Report: Latency graphs

Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUDP_PPS: Ensure keepalive is long enough 06/30006/8
Vratko Polak [Thu, 14 Jan 2021 15:23:05 +0000 (16:23 +0100)]
UDP_PPS: Ensure keepalive is long enough

Previously, it was long enough for the current performance,
but not long enough for the theoretical worst case.

See https://gerrit.fd.io/r/c/csit/+/29803/9/docs/report/introduction/methodology_nat44.rst#293

Change-Id: I3f57a834c77d93b38bca81fdbb714a6374b81bae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoTrending: Add IPv4 and IPv6 rnd tests 99/31099/2
Tibor Frank [Wed, 3 Feb 2021 14:28:56 +0000 (15:28 +0100)]
Trending: Add IPv4 and IPv6 rnd tests

Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Fix package cache updates 86/31086/3
Tomas Alexy [Tue, 2 Feb 2021 11:37:01 +0000 (12:37 +0100)]
Ansible: Fix package cache updates

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I5c7b2636bde999fef3a60e6cbf2b36db9978a74a

3 years agoReport: Add RND Latency graphs, add data 98/31098/1
Tibor Frank [Wed, 3 Feb 2021 06:30:41 +0000 (07:30 +0100)]
Report: Add RND Latency graphs, add data

Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Fix spec 95/31095/1
Tibor Frank [Tue, 2 Feb 2021 20:58:16 +0000 (21:58 +0100)]
Report: Fix spec

Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add RND tests 94/31094/1
Tibor Frank [Tue, 2 Feb 2021 20:36:52 +0000 (21:36 +0100)]
Report: Add RND tests

Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Fix nat44 tests in NDRPDR trending 89/31089/1
Tibor Frank [Tue, 2 Feb 2021 18:05:07 +0000 (19:05 +0100)]
Trending: Fix nat44 tests in NDRPDR trending

Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 87/31087/1
Tibor Frank [Tue, 2 Feb 2021 11:43:49 +0000 (12:43 +0100)]
Report: Add data

Change-Id: I97bdba256d5886c0ffdd42d4427038bd3b443043
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add 2101.release data 29/31029/3
Tibor Frank [Mon, 1 Feb 2021 08:52:48 +0000 (09:52 +0100)]
Report: Add 2101.release data

Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agomaster: Update VPP_STABLE_VER files 58/31058/2
Tibor Frank [Mon, 1 Feb 2021 06:26:02 +0000 (06:26 +0000)]
master: Update VPP_STABLE_VER files

Change-Id: I34b797d9596ac5df3ffb5d5f49e13185e0a8f70e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix: Slack API key 22/31022/2
pmikus [Fri, 29 Jan 2021 13:12:43 +0000 (13:12 +0000)]
Fix: Slack API key

- Clearly we must implement key storage vault to avoid storing key in
.tfstate

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7

3 years agoTOI: Update TOI: branches 20/31020/2
Tibor Frank [Fri, 29 Jan 2021 11:29:10 +0000 (12:29 +0100)]
TOI: Update TOI: branches

Change-Id: Ie7fe6fbe58f87243bf502bd14886182fbc11beb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix: Slack key workaround 18/31018/1
pmikus [Fri, 29 Jan 2021 10:03:46 +0000 (10:03 +0000)]
Fix: Slack key workaround

- Todo: Deploy hashi vault.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad

3 years agoInfra: Monitoring capability 56/30656/33
pmikus [Thu, 7 Jan 2021 14:27:38 +0000 (14:27 +0000)]
Infra: Monitoring capability

+ Monitoring SOA
  + Nomad alertmanager job
  + Nomad prometheus job
  + Nomad grafana job

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2

3 years agoInfra: Remove Consul TLS on clients (Nomad conflict) 68/30968/1
pmikus [Thu, 28 Jan 2021 08:47:01 +0000 (08:47 +0000)]
Infra: Remove Consul TLS on clients (Nomad conflict)

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf

3 years agoInfra: Remove unwanted terraform output 66/30966/1
pmikus [Thu, 28 Jan 2021 08:37:12 +0000 (08:37 +0000)]
Infra: Remove unwanted terraform output

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a

3 years agoInfra: Terraform vpp_device module 65/30965/1
pmikus [Thu, 28 Jan 2021 08:24:35 +0000 (08:24 +0000)]
Infra: Terraform vpp_device module

+ Convert to module
+ Fix memory limit

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c

3 years agoInfra: Adjust vpp_device x86 memory layout 63/30963/1
pmikus [Thu, 28 Jan 2021 07:38:34 +0000 (07:38 +0000)]
Infra: Adjust vpp_device x86 memory layout

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43b3b891b270903419b7fcf132813563306b6e10

3 years agoInfra: Align Nomad settings across cluster 62/30962/1
pmikus [Thu, 28 Jan 2021 07:22:24 +0000 (07:22 +0000)]
Infra: Align Nomad settings across cluster

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66

3 years agojob-specs: Add rnd tests 57/30957/2
Tibor Frank [Wed, 27 Jan 2021 19:23:53 +0000 (20:23 +0100)]
job-specs: Add rnd tests

Change-Id: I877f46608853401c5226845737ace691e3f393b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 49/30949/1
Tibor Frank [Wed, 27 Jan 2021 11:59:44 +0000 (12:59 +0100)]
Report: Add data

Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Fix reconfig graphs 48/30948/8
Tibor Frank [Wed, 27 Jan 2021 09:54:59 +0000 (10:54 +0100)]
Report: Fix reconfig graphs

Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Improve reconf graphs 45/30945/2
Tibor Frank [Wed, 27 Jan 2021 06:03:01 +0000 (07:03 +0100)]
Report: Improve reconf graphs

Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add GENEVE tests 35/30935/2
Tibor Frank [Tue, 26 Jan 2021 13:56:27 +0000 (14:56 +0100)]
Trending: Add GENEVE tests

Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add GENEVE tests 34/30934/3
Tibor Frank [Tue, 26 Jan 2021 13:20:23 +0000 (14:20 +0100)]
Report: Add GENEVE tests

Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoMaster: Update VPP_STABLE_VER files 01/30901/2
Tibor Frank [Mon, 25 Jan 2021 13:30:33 +0000 (13:30 +0000)]
Master: Update VPP_STABLE_VER files

Change-Id: I609d6efcd6934e513521df63aef2c25ac9bbfdea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 21/30921/1
Tibor Frank [Mon, 25 Jan 2021 08:45:06 +0000 (09:45 +0100)]
Report: Add data

Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoHdrh latency graphs: Do not skip the last value 57/30857/5
Vratko Polak [Thu, 21 Jan 2021 11:44:11 +0000 (12:44 +0100)]
Hdrh latency graphs: Do not skip the last value

Linear x axis does not need any skipping.
For logarithmic axis, descrease from 100% to avoid infinity.
Currently using a fixed PERCENTILE_MAX value.
Added a comment on when to change that value.

Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: add geneve to perf release notes 72/30872/2
Jan Gelety [Mon, 11 Jan 2021 01:34:17 +0000 (02:34 +0100)]
Report: add geneve to perf release notes

Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 83/30883/2
Tibor Frank [Fri, 22 Jan 2021 11:25:19 +0000 (12:25 +0100)]
Report: Add data

Change-Id: I1d5031780b1bef169509058233e02624d7afecb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: vpp-device release notes 69/30869/3
Jan Gelety [Sun, 10 Jan 2021 20:56:40 +0000 (21:56 +0100)]
Report: vpp-device release notes

Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoTests: Temporarily disable IPv6 VM test that is randomly failing 80/30880/2
pmikus [Thu, 21 Jan 2021 19:27:02 +0000 (19:27 +0000)]
Tests: Temporarily disable IPv6 VM test that is randomly failing

- To be debugged

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I62ea2427d716f10dbf6af179edfaa41e73952db0

3 years agoReconf: Fix bidir/unidir mismatch 70/30870/3
Vratko Polak [Thu, 21 Jan 2021 10:15:56 +0000 (11:15 +0100)]
Reconf: Fix bidir/unidir mismatch

Results if NDR search is in TPS (so unidir) since
https://gerrit.fd.io/r/c/csit/+/28208

The bug was causing all reconf tests report zero loss,
as they used half of NDR load during reconfiguration.

+ Small improvements to descriptions of other traffic keywords.

Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoTrending: Fix bugs in 2n-tx2 67/30867/2
Tibor Frank [Thu, 21 Jan 2021 06:09:02 +0000 (07:09 +0100)]
Trending: Fix bugs in 2n-tx2

Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 68/30868/1
Tibor Frank [Thu, 21 Jan 2021 09:25:33 +0000 (10:25 +0100)]
Report: Add data

Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add 2n-tx2 45/30845/3
Tibor Frank [Tue, 19 Jan 2021 19:12:09 +0000 (20:12 +0100)]
Trending: Add 2n-tx2

Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoacl: add L2BD dev tests 79/28779/6
Martin Balaz [Thu, 10 Sep 2020 16:18:48 +0000 (18:18 +0200)]
acl: add L2BD dev tests

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agojob_specs: add geneve tests 41/30841/5
Jan Gelety [Sun, 10 Jan 2021 13:34:01 +0000 (14:34 +0100)]
job_specs: add geneve tests

Geneve tests added to report_iterative and report_coverage job
specifications.

- tests with 1024 geneve tunnels added only to report_coverage jobs
  until fast PAPI is finished

Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoTox: Improve tox.ini 99/30799/3
Vratko Polak [Mon, 18 Jan 2021 13:35:17 +0000 (14:35 +0100)]
Tox: Improve tox.ini

Just stylistic improvements, no functional change.

+ Use "ignore_outcome = true" instead of "|| true".
+ Document and apply recommended ordering within testenv definition.
+ Fix some typos.

Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoAdd suites with randomized ip6 profiles 42/30442/9
Vratko Polak [Mon, 18 Jan 2021 15:59:42 +0000 (16:59 +0100)]
Add suites with randomized ip6 profiles

+ Replace pair of traffic profiles (2n and 3n) with single nodeless one.
+ Compared to incremental suites, randomized ones add IP6_RND tag.

Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: Add data 51/30851/1
Tibor Frank [Wed, 20 Jan 2021 08:16:08 +0000 (09:16 +0100)]
Report: Add data

Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add ip6 latency graphs 43/30843/1
Tibor Frank [Tue, 19 Jan 2021 18:00:47 +0000 (19:00 +0100)]
Report: Add ip6 latency graphs

Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data, 2n-tx2 latency graphs 14/30814/3
Tibor Frank [Tue, 19 Jan 2021 12:26:34 +0000 (13:26 +0100)]
Report: Add data, 2n-tx2 latency graphs

Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644
Signed-off-by: Tibor Frank <tifrank@cisco.com>