csit.git
9 hours agoInfra: Move nginx service closer to storage 44/31544/5 master
pmikus [Fri, 5 Mar 2021 11:48:19 +0000 (11:48 +0000)]
Infra: Move nginx service closer to storage

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bbaa6c458e7994e964f7a07f69f9dab008a48fd

15 hours agoPAL: repeat the download if it fails 2 47/31547/1
Tibor Frank [Fri, 5 Mar 2021 13:10:08 +0000 (14:10 +0100)]
PAL: repeat the download if it fails 2

Change-Id: I9bba50281bfe65f62a1cfab76364d834dc10d80c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 hours agoPAL: repeat the download if it fails 46/31546/2
Tibor Frank [Fri, 5 Mar 2021 12:36:47 +0000 (13:36 +0100)]
PAL: repeat the download if it fails

Change-Id: I0a977009345ca5e46d23cc55405c6fd9b6e61c58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
17 hours agoFIX: JenkinsJob alert condition 43/31543/2
pmikus [Fri, 5 Mar 2021 11:36:29 +0000 (11:36 +0000)]
FIX: JenkinsJob alert condition

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b996d0ed6252ed2b790656879e9068ff9c52039

21 hours agoPAL: Fix: ignore verifying the SSL certificate 39/31539/1
Tibor Frank [Fri, 5 Mar 2021 08:00:47 +0000 (09:00 +0100)]
PAL: Fix: ignore verifying the SSL certificate

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ia39c9fcfc6240a30d48b492ec5e1451d8279c646
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 hours agoPAL: download - ignore verifying the SSL certificate 38/31538/1
Tibor Frank [Fri, 5 Mar 2021 07:43:45 +0000 (08:43 +0100)]
PAL: download - ignore verifying the SSL certificate

- only for https://logs.nginx.service.consul/vex-yul-rot-jenkins-1

Change-Id: Ibdcc59a44d5aae331aeef22fad54c4e90b2eec6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 hours agoPAL: use http instead of https for S3 36/31536/1
Tibor Frank [Fri, 5 Mar 2021 06:01:19 +0000 (07:01 +0100)]
PAL: use http instead of https for S3

Change-Id: Ie70f48142d182518d794e542052c31427d788849
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 hours agoPAL: Add s3_storage as the data source 22/31522/2
Tibor Frank [Thu, 4 Mar 2021 08:52:20 +0000 (09:52 +0100)]
PAL: Add s3_storage as the data source

Priorities for download:
1. s3_storage
2. logs.fd.io
3. docs.fd.io release
4. docs.fd.io master
5. jenkins

Change-Id: I7114715c3ec9a33acc8edf3c5c473f4eaffa639d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
39 hours agoFIX: Methodology GSO headers 26/31526/1
pmikus [Thu, 4 Mar 2021 13:07:16 +0000 (13:07 +0000)]
FIX: Methodology GSO headers

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I38f8b16ced2c5cfd0ea8b2b0e767f5a73f6a7dd7

45 hours agoReport: Hide 2c and 4c GSO tests 21/31521/2
Tibor Frank [Thu, 4 Mar 2021 07:07:47 +0000 (08:07 +0100)]
Report: Hide 2c and 4c GSO tests

Change-Id: Ifab207f12b056a8c77911ed69590337cea4355af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
46 hours agoReport: GSO release notes 20/31520/1
pmikus [Thu, 4 Mar 2021 06:57:55 +0000 (06:57 +0000)]
Report: GSO release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I369afd2c90d68078443436402a6224fa42ca646d

46 hours agoFIX: Ansible storage bugs 19/31519/3
pmikus [Thu, 4 Mar 2021 06:24:13 +0000 (06:24 +0000)]
FIX: Ansible storage bugs

- daily digest

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifa2dc10831fde0a101c916f2b8abd26abb93cb7f

2 days agoMethodology: GSO 86/31486/5
pmikus [Wed, 3 Mar 2021 10:13:28 +0000 (10:13 +0000)]
Methodology: GSO

- Report methodology

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1726af15ab003ff6ee4411ca1ceace986d3ee42b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 days agojob-specs: Update durations of jobs 80/31480/10
Tibor Frank [Tue, 2 Mar 2021 11:55:57 +0000 (12:55 +0100)]
job-specs: Update durations of jobs

- coverage
  - 2n-clx
  - 2n-skx
  - 2n-zn2
  - 2n-tx2
  - 2n-dnv
  - 3n-skx
  - 3n-hsw
  - 3n-tsh
  - 3n-dnv
- iterative
  - 2n-clx
  - 2n-skx
  - 2n-zn2
  - 2n-tx2
  - 2n-dnv
  - 3n-skx
  - 3n-hsw
  - 3n-tsh
  - 3n-dnv

Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 days agoJob specs: add 2n-tx2 crypto mrr-daily tests 78/31478/2
Juraj Linkeš [Tue, 2 Mar 2021 08:02:20 +0000 (09:02 +0100)]
Job specs: add 2n-tx2 crypto mrr-daily tests

Iteratively increase coverage, but only of mrr-daily tests.

Because of time constraints (i.e. we won't have enough time to run all
of the tests), only add mrr-daily tests and not ndrpdr iterative/cov
tests. For iter tests, add the tests commented out which documents which
tests we're omitting from iter runs compared to mrr-daily.

Change-Id: I35625a1f67004473305cb752a98a962dcb825e16
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 days agojob-specs: Fix ipsec scheduler 84/31484/1
Tibor Frank [Wed, 3 Mar 2021 06:07:55 +0000 (07:07 +0100)]
job-specs: Fix ipsec scheduler

Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 days agoFix: Async scheduler tests are not hw 83/31483/2
Vratko Polak [Tue, 2 Mar 2021 16:46:44 +0000 (17:46 +0100)]
Fix: Async scheduler tests are not hw

Suite name part is correct: swasync.
This fixes the tag, from IPSECHW to IPSECSW.

Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 days agoInfra: Configurable CSIT SHIM image 74/31474/3
pmikus [Mon, 1 Mar 2021 08:07:04 +0000 (08:07 +0000)]
Infra: Configurable CSIT SHIM image

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I299ed8032f9210e20c304327abca3f62cd85ee81

4 days agoUpdate VPP_STABLE_VER files 93/31393/2
Tibor Frank [Mon, 1 Mar 2021 05:23:18 +0000 (05:23 +0000)]
Update VPP_STABLE_VER files

Change-Id: I332decea2b783f7868e4a512d417c5c50990adae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 days agoIPsec: add 2n crypto udir perf tests 09/31309/7
Juraj Linkeš [Tue, 16 Feb 2021 12:59:59 +0000 (13:59 +0100)]
IPsec: add 2n crypto udir perf tests

Add unidirectional 2n crypto tests. Only one direction can be tested on
a 2 node topology, since we can't use the same interface for both
encrypted and unencrypted traffic. Add the following tests:
* {n}tnlsw-ip4base-int ndrpdr tests
* {n}tnlsw-1atnl-ip4base-int reconf tests
* {n}tnlswasync-scheduler-ip4base-int ndrpdr tests

Where n is the number of tunnels:
1, 4, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 for the first two
1, 2, 4, 8 for the async scheduler tests

All of these with the following ecryption-auth algorithms:
aes128gcm
aes256gcm
aes128cbc-hmac256sha
aes128cbc-hmac512sha

Also add the corresponding trex profiles:
trex-stl-2n-ethip4-ip4dst{n}-udir.py

Where n is the number of tunnels listed above. The profiles are shared
among the tests.

Change-Id: I22bb46e6ad59801581a78aa19310bee8a5293e56
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
8 days agoReport: Configure rls2101.09 32/31432/1
Tibor Frank [Thu, 25 Feb 2021 06:33:33 +0000 (07:33 +0100)]
Report: Configure rls2101.09

Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 days agoTrending: Fix file names fro nat44 tput graphs 31/31431/3
Tibor Frank [Thu, 25 Feb 2021 06:16:38 +0000 (07:16 +0100)]
Trending: Fix file names fro nat44 tput graphs

Change-Id: I7e722b268595e8b1de370b3dde9d2b00c566f143
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 days agoInfra: Azure - file cleanup 72/31372/2
Tomas Alexy [Mon, 22 Feb 2021 08:43:54 +0000 (09:43 +0100)]
Infra: Azure - file cleanup

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I8b97123711a76bf8851f6c4997e819d79364b83b

9 days agojob-spec: Add test suites for crypto sw scheduler engine 00/31400/3
Tibor Frank [Mon, 22 Feb 2021 14:53:05 +0000 (15:53 +0100)]
job-spec: Add test suites for crypto sw scheduler engine

Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 days agoTrending: Add nat44-tput tests 23/31423/1
Tibor Frank [Wed, 24 Feb 2021 08:41:10 +0000 (09:41 +0100)]
Trending: Add nat44-tput tests

Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 days agoReport: Set .08 revision, fix GSO graphs 07/31407/9
Tibor Frank [Tue, 23 Feb 2021 10:57:27 +0000 (11:57 +0100)]
Report: Set .08 revision, fix GSO graphs

Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 days agoIpsec: Always generate ikey 25/31325/7
Vratko Polak [Mon, 22 Feb 2021 13:43:46 +0000 (14:43 +0100)]
Ipsec: Always generate ikey

Some tests use a crypto algorithm with no integrity algorithm.
Generate empty binary strings as fake integrity keys
to keep return values of low level methods consistent.

+ Add return_keys argument to avoid returning long lists.
+ Improve various docstrings.

Change-Id: Idae1877bdde32d194ce4e3bb3053c8dba39d377a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 days agoietf: renamed mlrsearch to bmwg adopted draft 99/31399/2
Maciek Konstantynowicz [Mon, 22 Feb 2021 14:23:26 +0000 (14:23 +0000)]
ietf: renamed mlrsearch to bmwg adopted draft

Change-Id: I86401078e63c01a88b606f27bfbbd17491de99fd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
11 days agoUpdate VPP_STABLE_VER files 80/31380/5
Tibor Frank [Mon, 22 Feb 2021 06:42:26 +0000 (06:42 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3058879ed54a686eb596b2822ff943568d0d5405
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 days agoJob specs: add 2n-tx2 memif tests 73/31373/4
Juraj Linkeš [Mon, 22 Feb 2021 08:56:42 +0000 (09:56 +0100)]
Job specs: add 2n-tx2 memif tests

Iteratively increase coverage.

Change-Id: Ia506232e68db70608b415003a031661b73023c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
11 days agoReport: Add gso tests 71/31371/22
Tibor Frank [Fri, 19 Feb 2021 13:07:29 +0000 (14:07 +0100)]
Report: Add gso tests

Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoAdd test suites for crypto sw scheduler engine 39/30039/22
Yulong Pei [Thu, 19 Nov 2020 20:56:18 +0000 (13:56 -0700)]
Add test suites for crypto sw scheduler engine

This patch is to add test suites for vpp plugin crypto_sw_scheduler,
IPsec sync mode is to do crypto and packet forward work in same worker cores,
crypto_sw_scheduler can schedule crypto work to other async crypto cores to
improve whole crypto processing capability.

This test suites configure fixed 1 rx queues per port, then measure IPsec
performance with 1, 2, 3 crypto cores.

This patchset include 1, 2, 4, 8 ipsec tunnels test cases.

+Vratko help to change to count total physical cores instead of previous only
count crypto cores in test cases.

Change-Id: I0e67182e3d13273890a23703d838101900e25126
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
2 weeks agoFIX: Use x710 for gso tests 61/31361/1
pmikus [Fri, 19 Feb 2021 13:31:51 +0000 (13:31 +0000)]
FIX: Use x710 for gso tests

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32

2 weeks agoFIX: Naming convention compliance 60/31360/4
pmikus [Fri, 19 Feb 2021 12:51:16 +0000 (12:51 +0000)]
FIX: Naming convention compliance

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046

2 weeks agoAPI: Use newer messages 28/31328/6
Vratko Polak [Wed, 17 Feb 2021 19:04:36 +0000 (20:04 +0100)]
API: Use newer messages

The mesages are the newest present in last common ancestor
of master and rls2101 (so not yet ipsec_sad_entry_add_del_v3).

Added a TODO for the RDMA create improvement,
to be implemented in a separate change.

Change-Id: I94bcd2f1bc109fb995c4dd6df44f8928865634f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoPerformance: Add GSO tests to report execution 58/31358/2
pmikus [Fri, 19 Feb 2021 11:40:52 +0000 (11:40 +0000)]
Performance: Add GSO tests to report execution

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb

2 weeks agoInfra: Ansible Ubuntu Focal 90/31290/10
pmikus [Mon, 15 Feb 2021 16:16:31 +0000 (16:16 +0000)]
Infra: Ansible Ubuntu Focal

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc

2 weeks agoFramework: GSO test 51/31351/5
pmikus [Thu, 18 Feb 2021 14:52:31 +0000 (14:52 +0000)]
Framework: GSO test

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad

2 weeks agoInfra: AWS deployment - minor fixes 55/31355/1
Tomas Alexy [Fri, 19 Feb 2021 09:10:18 +0000 (10:10 +0100)]
Infra: AWS deployment - minor fixes

Bump aws provider to 3.28
Code readability improvements

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Iaa966f2795f228e31e90acf27ca9999a730a87f0

2 weeks agoInfra: Fix AWS deployment 64/30964/22
Tomas Alexy [Thu, 28 Jan 2021 07:59:22 +0000 (08:59 +0100)]
Infra: Fix AWS deployment

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910

2 weeks agoFramework: SciPy upgrade 38/31338/4
pmikus [Thu, 18 Feb 2021 09:56:27 +0000 (09:56 +0000)]
Framework: SciPy upgrade

+ 1.5.4 to solve python3.8 dependency.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb

2 weeks agoFramework: Qemu 4.2 compatibility fix 39/31339/1
pmikus [Thu, 18 Feb 2021 10:02:55 +0000 (10:02 +0000)]
Framework: Qemu 4.2 compatibility fix

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d

2 weeks agoPAPI: Python 3.8 compatibility 26/31326/2
pmikus [Wed, 17 Feb 2021 14:27:12 +0000 (14:27 +0000)]
PAPI: Python 3.8 compatibility

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4

2 weeks agoInfra: Ansible docker images cleanup 05/31205/6
pmikus [Wed, 10 Feb 2021 08:14:40 +0000 (08:14 +0000)]
Infra: Ansible docker images cleanup

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0

2 weeks agoReport: Add data 18/31318/2
Tibor Frank [Wed, 17 Feb 2021 06:11:08 +0000 (07:11 +0100)]
Report: Add data

Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoreport: fixed typo AMD 2n-tx2 to Arm 14/31314/2
Maciek Konstantynowicz [Tue, 16 Feb 2021 18:44:21 +0000 (18:44 +0000)]
report: fixed typo AMD 2n-tx2 to Arm

Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 weeks agoInfra: Ansible 2.10 73/25173/25
Peter Mikus [Fri, 14 Feb 2020 13:03:43 +0000 (13:03 +0000)]
Infra: Ansible 2.10

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997

2 weeks agoRCA: Link to NAT44ed performance regression bug 08/31308/1
Vratko Polak [Tue, 16 Feb 2021 09:33:15 +0000 (10:33 +0100)]
RCA: Link to NAT44ed performance regression bug

Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoReport: Add data 07/31307/1
Tibor Frank [Tue, 16 Feb 2021 08:43:47 +0000 (09:43 +0100)]
Report: Add data

Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoReport: Add comp tables for 2n-clx with mellanox NIC 82/31282/6
Tibor Frank [Mon, 15 Feb 2021 10:51:04 +0000 (11:51 +0100)]
Report: Add comp tables for 2n-clx with mellanox NIC

Change-Id: I64f1821877f749cfb44b886b4760faba577a2014
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoReport: Add framework speedup to notes 91/31291/1
Vratko Polak [Mon, 15 Feb 2021 16:18:26 +0000 (17:18 +0100)]
Report: Add framework speedup to notes

Change-Id: If01c977a48bb64c53608f6b937a715fc11000446
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoRelease notes: Tput tests and jumbo ipsec 63/31263/1
Vratko Polak [Mon, 15 Feb 2021 09:33:59 +0000 (10:33 +0100)]
Release notes: Tput tests and jumbo ipsec

+ Also randomized profiles.

Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 1b6c4949b794b0efd091f101ff450a04944c21ba)

2 weeks agoReport: Add 2n-clx cx556a Latency graphs 81/31281/1
Tibor Frank [Mon, 15 Feb 2021 09:57:15 +0000 (10:57 +0100)]
Report: Add 2n-clx cx556a Latency graphs

Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoUpdate VPP_STABLE_VER files 57/31257/2
Tibor Frank [Mon, 15 Feb 2021 05:21:11 +0000 (05:21 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7baa8931325b16363b7d95c1bc17d82f75a109d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: Fix spec for Latency by percentile: 2n-clx MLX 50/31250/1
Tibor Frank [Fri, 12 Feb 2021 13:17:23 +0000 (14:17 +0100)]
Report: Fix spec for Latency by percentile: 2n-clx MLX

Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: re-group RND tests 48/31248/1
Tibor Frank [Fri, 12 Feb 2021 12:56:53 +0000 (13:56 +0100)]
Report: re-group RND tests

Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoMethodology: Added packet flow ordering 65/31165/5
Vratko Polak [Tue, 9 Feb 2021 16:16:21 +0000 (17:16 +0100)]
Methodology: Added packet flow ordering

Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 weeks agoReport: Add data 36/31236/2
Tibor Frank [Thu, 11 Feb 2021 11:51:34 +0000 (12:51 +0100)]
Report: Add data

Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoJob specs: Add -tput tests to iterative 37/31237/1
Tibor Frank [Thu, 11 Feb 2021 12:01:01 +0000 (13:01 +0100)]
Job specs: Add -tput tests to iterative

- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
 + Because ip4base is stateless.
 + So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.

Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: Add 2n-clx Mellanox tests and graphs 28/31228/2
Tibor Frank [Thu, 11 Feb 2021 09:04:07 +0000 (10:04 +0100)]
Report: Add 2n-clx Mellanox tests and graphs

Change-Id: Ib947d47b31138ac816acefee03429d454511dd05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: vpp device i40e known issue 13/31213/2
Juraj Linkeš [Wed, 10 Feb 2021 13:46:46 +0000 (14:46 +0100)]
Report: vpp device i40e known issue

Add the i40e PF/VF race condition known issue to the known issues list.

Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 weeks agoReport: Add data 11/31211/2
Tibor Frank [Wed, 10 Feb 2021 12:12:05 +0000 (13:12 +0100)]
Report: Add data

Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoMethodology: Add NAT44ed tput tests 00/31200/2
Vratko Polak [Tue, 9 Feb 2021 17:18:12 +0000 (18:18 +0100)]
Methodology: Add NAT44ed tput tests

Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agoReport: Small fixes 09/31209/2
Tibor Frank [Wed, 10 Feb 2021 10:35:45 +0000 (11:35 +0100)]
Report: Small fixes

Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoFIX: Hide slack url 08/31208/1
pmikus [Wed, 10 Feb 2021 09:39:28 +0000 (09:39 +0000)]
FIX: Hide slack url

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If965c0d4ff52d96c407cf83b642119c321cc25fc

3 weeks agoInfra: JenkinsJobHealthExporter 28/31128/7
pmikus [Fri, 5 Feb 2021 14:51:43 +0000 (14:51 +0000)]
Infra: JenkinsJobHealthExporter

- Integration of Jenkins Job checker

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I822039cb64a3a352b49314ddab7c6099af3fe644

3 weeks agoReport: Update release note section 60/31160/5
pmikus [Mon, 8 Feb 2021 11:39:24 +0000 (11:39 +0000)]
Report: Update release note section

- Infra update
- Cleanup

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35

3 weeks agoReport: Add data 04/31204/1
Tibor Frank [Wed, 10 Feb 2021 06:24:07 +0000 (07:24 +0100)]
Report: Add data

Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: Hide nat44 tput tests 98/31198/1
Tibor Frank [Tue, 9 Feb 2021 14:08:08 +0000 (15:08 +0100)]
Report: Hide nat44 tput tests

Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: Add latency graphs for NAT44 tput tests 73/31173/1
Tibor Frank [Tue, 9 Feb 2021 10:30:58 +0000 (11:30 +0100)]
Report: Add latency graphs for NAT44 tput tests

Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: Add NAT44 tput tests 71/31171/1
Tibor Frank [Tue, 9 Feb 2021 06:57:19 +0000 (07:57 +0100)]
Report: Add NAT44 tput tests

Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoreport: Update packet latency methodology 02/31102/4
Maciek Konstantynowicz [Wed, 3 Feb 2021 14:37:01 +0000 (14:37 +0000)]
report: Update packet latency methodology

Change-Id: I0378e96c6f64a1dd035d56465710b82f64dc4d32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 weeks agoFIX: Nic selection 61/31161/2
pmikus [Mon, 8 Feb 2021 11:43:51 +0000 (11:43 +0000)]
FIX: Nic selection

- Buggy unnoticed for quite some time

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa

3 weeks agoLatency graphs: Do not hardcode x range 59/31159/1
Vratko Polak [Mon, 8 Feb 2021 10:31:57 +0000 (11:31 +0100)]
Latency graphs: Do not hardcode x range

+ Compute it from PERCENTILE_MAX.
+ Use slightly higher PERCENTILE_MAX to avoid rounding errors.
+ Add a comment why slightly higher value is needed.

Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agojob-spec: fix report_coverage/2n-tx2/l2-04.md 57/31157/2
Tibor Frank [Mon, 8 Feb 2021 09:05:10 +0000 (10:05 +0100)]
job-spec: fix report_coverage/2n-tx2/l2-04.md

- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by
  eth-l2bdbasemaclrn-macip-iacl50sl-10kflows

Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoUpdate VPP_STABLE_VER files 49/31149/3
Tibor Frank [Mon, 8 Feb 2021 08:53:25 +0000 (08:53 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3fbe46788e8b3b5701134e842b4db4583d842214
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoreport: add 2n-tx2 phy testbed diagram and update description 88/31088/3
Maciek Konstantynowicz [Tue, 2 Feb 2021 12:00:21 +0000 (12:00 +0000)]
report: add 2n-tx2 phy testbed diagram and update description

Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 weeks agoTraffic generator: Force ramp-up in next test 29/31129/2
Vratko Polak [Fri, 5 Feb 2021 15:14:27 +0000 (16:14 +0100)]
Traffic generator: Force ramp-up in next test

The behavior was already documented, just not implemented properly.

Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agoReport: Add data 56/31156/1
Tibor Frank [Mon, 8 Feb 2021 08:41:43 +0000 (09:41 +0100)]
Report: Add data

Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add data 33/31133/2
Tibor Frank [Fri, 5 Feb 2021 19:36:00 +0000 (20:36 +0100)]
Report: Add data

Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoRevert "Job specs: Add -tput tests to iterative" 45/31145/2
Tibor Frank [Fri, 5 Feb 2021 19:19:04 +0000 (19:19 +0000)]
Revert "Job specs: Add -tput tests to iterative"

This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5.

Reason for revert: Faulty tests, those which are running
take too much time

Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoJob specs: Add -tput tests to iterative 25/31125/2
Vratko Polak [Fri, 5 Feb 2021 12:48:06 +0000 (13:48 +0100)]
Job specs: Add -tput tests to iterative

- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
 + Because ip4base is stateless.
 + So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.

Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoReport: Various fixes 26/31126/3
Tibor Frank [Fri, 5 Feb 2021 13:28:06 +0000 (14:28 +0100)]
Report: Various fixes

Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoNAT44ed: Add pure throuhput bidir tests 78/30278/39
Vratko Polak [Fri, 5 Feb 2021 10:46:40 +0000 (11:46 +0100)]
NAT44ed: Add pure throuhput bidir tests

+ With ramp-up, without reset, with session verification.
+ Uses the same profile as pps tests.
+ Ramp up duration is not specified, as duration is computed.
+ Timeout tracking with automated ramp-up.
 + Correct computation of next duration.
 + Checking both early and late sessions.
 + No loss measurement also acts as a ramp-up.
+ Return ReceiveRateMeasurement from send_traffic_on_tg_internal,
  as that is needed for detecting whether trial is ok as ramp up.
- Udp needs quite low ramp-up rate after recent regression.
 - Max scale has higher rate (so failing) to avoid session timeouts.
+ Bump copyright year.

Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoReport: Set range of x-axis for latency graphs, add data 24/31124/1
Tibor Frank [Fri, 5 Feb 2021 09:44:24 +0000 (10:44 +0100)]
Report: Set range of x-axis for latency graphs, add data

Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoTrending: RND tests 21/31121/1
Tibor Frank [Fri, 5 Feb 2021 08:28:48 +0000 (09:28 +0100)]
Trending: RND tests

Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add data 20/31120/1
Tibor Frank [Fri, 5 Feb 2021 07:42:12 +0000 (08:42 +0100)]
Report: Add data

Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoInfra: Move probes under ansible instead of terraform 16/31116/4
pmikus [Thu, 4 Feb 2021 13:03:12 +0000 (13:03 +0000)]
Infra: Move probes under ansible instead of terraform

+ More stable probe handling.
+ Naming cleanup due to errors.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bb1237af20636919f869f2eee53597202d00792

4 weeks agoReport: Set the range of x-axis fro Latency graphs 17/31117/1
Tibor Frank [Thu, 4 Feb 2021 13:19:00 +0000 (14:19 +0100)]
Report: Set the range of x-axis fro Latency graphs

Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add 2n-clx rnd latency graphs 09/31109/1
Tibor Frank [Thu, 4 Feb 2021 08:48:30 +0000 (09:48 +0100)]
Report: Add 2n-clx rnd latency graphs

Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add data 08/31108/1
Tibor Frank [Thu, 4 Feb 2021 08:42:42 +0000 (09:42 +0100)]
Report: Add data

Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add data 06/31106/1
Tibor Frank [Thu, 4 Feb 2021 07:16:47 +0000 (08:16 +0100)]
Report: Add data

Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Latency graphs 03/31103/9
Tibor Frank [Wed, 3 Feb 2021 16:03:54 +0000 (17:03 +0100)]
Report: Latency graphs

Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoUDP_PPS: Ensure keepalive is long enough 06/30006/8
Vratko Polak [Thu, 14 Jan 2021 15:23:05 +0000 (16:23 +0100)]
UDP_PPS: Ensure keepalive is long enough

Previously, it was long enough for the current performance,
but not long enough for the theoretical worst case.

See https://gerrit.fd.io/r/c/csit/+/29803/9/docs/report/introduction/methodology_nat44.rst#293

Change-Id: I3f57a834c77d93b38bca81fdbb714a6374b81bae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoTrending: Add IPv4 and IPv6 rnd tests 99/31099/2
Tibor Frank [Wed, 3 Feb 2021 14:28:56 +0000 (15:28 +0100)]
Trending: Add IPv4 and IPv6 rnd tests

Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoAnsible: Fix package cache updates 86/31086/3
Tomas Alexy [Tue, 2 Feb 2021 11:37:01 +0000 (12:37 +0100)]
Ansible: Fix package cache updates

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I5c7b2636bde999fef3a60e6cbf2b36db9978a74a

4 weeks agoReport: Add RND Latency graphs, add data 98/31098/1
Tibor Frank [Wed, 3 Feb 2021 06:30:41 +0000 (07:30 +0100)]
Report: Add RND Latency graphs, add data

Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Fix spec 95/31095/1
Tibor Frank [Tue, 2 Feb 2021 20:58:16 +0000 (21:58 +0100)]
Report: Fix spec

Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add RND tests 94/31094/1
Tibor Frank [Tue, 2 Feb 2021 20:36:52 +0000 (21:36 +0100)]
Report: Add RND tests

Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoTrending: Fix nat44 tests in NDRPDR trending 89/31089/1
Tibor Frank [Tue, 2 Feb 2021 18:05:07 +0000 (19:05 +0100)]
Trending: Fix nat44 tests in NDRPDR trending

Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.