csit.git
9 months agoReport: Set .08 revision, fix GSO graphs 07/31407/9
Tibor Frank [Tue, 23 Feb 2021 10:57:27 +0000 (11:57 +0100)]
Report: Set .08 revision, fix GSO graphs

Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoIpsec: Always generate ikey 25/31325/7
Vratko Polak [Mon, 22 Feb 2021 13:43:46 +0000 (14:43 +0100)]
Ipsec: Always generate ikey

Some tests use a crypto algorithm with no integrity algorithm.
Generate empty binary strings as fake integrity keys
to keep return values of low level methods consistent.

+ Add return_keys argument to avoid returning long lists.
+ Improve various docstrings.

Change-Id: Idae1877bdde32d194ce4e3bb3053c8dba39d377a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoietf: renamed mlrsearch to bmwg adopted draft 99/31399/2
Maciek Konstantynowicz [Mon, 22 Feb 2021 14:23:26 +0000 (14:23 +0000)]
ietf: renamed mlrsearch to bmwg adopted draft

Change-Id: I86401078e63c01a88b606f27bfbbd17491de99fd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 80/31380/5
Tibor Frank [Mon, 22 Feb 2021 06:42:26 +0000 (06:42 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3058879ed54a686eb596b2822ff943568d0d5405
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoJob specs: add 2n-tx2 memif tests 73/31373/4
Juraj Linkeš [Mon, 22 Feb 2021 08:56:42 +0000 (09:56 +0100)]
Job specs: add 2n-tx2 memif tests

Iteratively increase coverage.

Change-Id: Ia506232e68db70608b415003a031661b73023c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
9 months agoReport: Add gso tests 71/31371/22
Tibor Frank [Fri, 19 Feb 2021 13:07:29 +0000 (14:07 +0100)]
Report: Add gso tests

Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoAdd test suites for crypto sw scheduler engine 39/30039/22
Yulong Pei [Thu, 19 Nov 2020 20:56:18 +0000 (13:56 -0700)]
Add test suites for crypto sw scheduler engine

This patch is to add test suites for vpp plugin crypto_sw_scheduler,
IPsec sync mode is to do crypto and packet forward work in same worker cores,
crypto_sw_scheduler can schedule crypto work to other async crypto cores to
improve whole crypto processing capability.

This test suites configure fixed 1 rx queues per port, then measure IPsec
performance with 1, 2, 3 crypto cores.

This patchset include 1, 2, 4, 8 ipsec tunnels test cases.

+Vratko help to change to count total physical cores instead of previous only
count crypto cores in test cases.

Change-Id: I0e67182e3d13273890a23703d838101900e25126
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
9 months agoFIX: Use x710 for gso tests 61/31361/1
pmikus [Fri, 19 Feb 2021 13:31:51 +0000 (13:31 +0000)]
FIX: Use x710 for gso tests

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32

9 months agoFIX: Naming convention compliance 60/31360/4
pmikus [Fri, 19 Feb 2021 12:51:16 +0000 (12:51 +0000)]
FIX: Naming convention compliance

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046

9 months agoAPI: Use newer messages 28/31328/6
Vratko Polak [Wed, 17 Feb 2021 19:04:36 +0000 (20:04 +0100)]
API: Use newer messages

The mesages are the newest present in last common ancestor
of master and rls2101 (so not yet ipsec_sad_entry_add_del_v3).

Added a TODO for the RDMA create improvement,
to be implemented in a separate change.

Change-Id: I94bcd2f1bc109fb995c4dd6df44f8928865634f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoPerformance: Add GSO tests to report execution 58/31358/2
pmikus [Fri, 19 Feb 2021 11:40:52 +0000 (11:40 +0000)]
Performance: Add GSO tests to report execution

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb

9 months agoInfra: Ansible Ubuntu Focal 90/31290/10
pmikus [Mon, 15 Feb 2021 16:16:31 +0000 (16:16 +0000)]
Infra: Ansible Ubuntu Focal

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc

9 months agoFramework: GSO test 51/31351/5
pmikus [Thu, 18 Feb 2021 14:52:31 +0000 (14:52 +0000)]
Framework: GSO test

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad

9 months agoInfra: AWS deployment - minor fixes 55/31355/1
Tomas Alexy [Fri, 19 Feb 2021 09:10:18 +0000 (10:10 +0100)]
Infra: AWS deployment - minor fixes

Bump aws provider to 3.28
Code readability improvements

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Iaa966f2795f228e31e90acf27ca9999a730a87f0

9 months agoInfra: Fix AWS deployment 64/30964/22
Tomas Alexy [Thu, 28 Jan 2021 07:59:22 +0000 (08:59 +0100)]
Infra: Fix AWS deployment

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910

9 months agoFramework: SciPy upgrade 38/31338/4
pmikus [Thu, 18 Feb 2021 09:56:27 +0000 (09:56 +0000)]
Framework: SciPy upgrade

+ 1.5.4 to solve python3.8 dependency.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb

9 months agoFramework: Qemu 4.2 compatibility fix 39/31339/1
pmikus [Thu, 18 Feb 2021 10:02:55 +0000 (10:02 +0000)]
Framework: Qemu 4.2 compatibility fix

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d

9 months agoPAPI: Python 3.8 compatibility 26/31326/2
pmikus [Wed, 17 Feb 2021 14:27:12 +0000 (14:27 +0000)]
PAPI: Python 3.8 compatibility

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4

9 months agoInfra: Ansible docker images cleanup 05/31205/6
pmikus [Wed, 10 Feb 2021 08:14:40 +0000 (08:14 +0000)]
Infra: Ansible docker images cleanup

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0

9 months agoReport: Add data 18/31318/2
Tibor Frank [Wed, 17 Feb 2021 06:11:08 +0000 (07:11 +0100)]
Report: Add data

Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoreport: fixed typo AMD 2n-tx2 to Arm 14/31314/2
Maciek Konstantynowicz [Tue, 16 Feb 2021 18:44:21 +0000 (18:44 +0000)]
report: fixed typo AMD 2n-tx2 to Arm

Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
9 months agoInfra: Ansible 2.10 73/25173/25
Peter Mikus [Fri, 14 Feb 2020 13:03:43 +0000 (13:03 +0000)]
Infra: Ansible 2.10

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997

9 months agoRCA: Link to NAT44ed performance regression bug 08/31308/1
Vratko Polak [Tue, 16 Feb 2021 09:33:15 +0000 (10:33 +0100)]
RCA: Link to NAT44ed performance regression bug

Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Add data 07/31307/1
Tibor Frank [Tue, 16 Feb 2021 08:43:47 +0000 (09:43 +0100)]
Report: Add data

Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add comp tables for 2n-clx with mellanox NIC 82/31282/6
Tibor Frank [Mon, 15 Feb 2021 10:51:04 +0000 (11:51 +0100)]
Report: Add comp tables for 2n-clx with mellanox NIC

Change-Id: I64f1821877f749cfb44b886b4760faba577a2014
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add framework speedup to notes 91/31291/1
Vratko Polak [Mon, 15 Feb 2021 16:18:26 +0000 (17:18 +0100)]
Report: Add framework speedup to notes

Change-Id: If01c977a48bb64c53608f6b937a715fc11000446
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoRelease notes: Tput tests and jumbo ipsec 63/31263/1
Vratko Polak [Mon, 15 Feb 2021 09:33:59 +0000 (10:33 +0100)]
Release notes: Tput tests and jumbo ipsec

+ Also randomized profiles.

Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 1b6c4949b794b0efd091f101ff450a04944c21ba)

9 months agoReport: Add 2n-clx cx556a Latency graphs 81/31281/1
Tibor Frank [Mon, 15 Feb 2021 09:57:15 +0000 (10:57 +0100)]
Report: Add 2n-clx cx556a Latency graphs

Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 57/31257/2
Tibor Frank [Mon, 15 Feb 2021 05:21:11 +0000 (05:21 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7baa8931325b16363b7d95c1bc17d82f75a109d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Fix spec for Latency by percentile: 2n-clx MLX 50/31250/1
Tibor Frank [Fri, 12 Feb 2021 13:17:23 +0000 (14:17 +0100)]
Report: Fix spec for Latency by percentile: 2n-clx MLX

Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: re-group RND tests 48/31248/1
Tibor Frank [Fri, 12 Feb 2021 12:56:53 +0000 (13:56 +0100)]
Report: re-group RND tests

Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoMethodology: Added packet flow ordering 65/31165/5
Vratko Polak [Tue, 9 Feb 2021 16:16:21 +0000 (17:16 +0100)]
Methodology: Added packet flow ordering

Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
9 months agoReport: Add data 36/31236/2
Tibor Frank [Thu, 11 Feb 2021 11:51:34 +0000 (12:51 +0100)]
Report: Add data

Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoJob specs: Add -tput tests to iterative 37/31237/1
Tibor Frank [Thu, 11 Feb 2021 12:01:01 +0000 (13:01 +0100)]
Job specs: Add -tput tests to iterative

- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
 + Because ip4base is stateless.
 + So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.

Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 2n-clx Mellanox tests and graphs 28/31228/2
Tibor Frank [Thu, 11 Feb 2021 09:04:07 +0000 (10:04 +0100)]
Report: Add 2n-clx Mellanox tests and graphs

Change-Id: Ib947d47b31138ac816acefee03429d454511dd05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: vpp device i40e known issue 13/31213/2
Juraj Linkeš [Wed, 10 Feb 2021 13:46:46 +0000 (14:46 +0100)]
Report: vpp device i40e known issue

Add the i40e PF/VF race condition known issue to the known issues list.

Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
9 months agoReport: Add data 11/31211/2
Tibor Frank [Wed, 10 Feb 2021 12:12:05 +0000 (13:12 +0100)]
Report: Add data

Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoMethodology: Add NAT44ed tput tests 00/31200/2
Vratko Polak [Tue, 9 Feb 2021 17:18:12 +0000 (18:18 +0100)]
Methodology: Add NAT44ed tput tests

Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Small fixes 09/31209/2
Tibor Frank [Wed, 10 Feb 2021 10:35:45 +0000 (11:35 +0100)]
Report: Small fixes

Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoFIX: Hide slack url 08/31208/1
pmikus [Wed, 10 Feb 2021 09:39:28 +0000 (09:39 +0000)]
FIX: Hide slack url

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If965c0d4ff52d96c407cf83b642119c321cc25fc

9 months agoInfra: JenkinsJobHealthExporter 28/31128/7
pmikus [Fri, 5 Feb 2021 14:51:43 +0000 (14:51 +0000)]
Infra: JenkinsJobHealthExporter

- Integration of Jenkins Job checker

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I822039cb64a3a352b49314ddab7c6099af3fe644

9 months agoReport: Update release note section 60/31160/5
pmikus [Mon, 8 Feb 2021 11:39:24 +0000 (11:39 +0000)]
Report: Update release note section

- Infra update
- Cleanup

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35

9 months agoReport: Add data 04/31204/1
Tibor Frank [Wed, 10 Feb 2021 06:24:07 +0000 (07:24 +0100)]
Report: Add data

Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Hide nat44 tput tests 98/31198/1
Tibor Frank [Tue, 9 Feb 2021 14:08:08 +0000 (15:08 +0100)]
Report: Hide nat44 tput tests

Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add latency graphs for NAT44 tput tests 73/31173/1
Tibor Frank [Tue, 9 Feb 2021 10:30:58 +0000 (11:30 +0100)]
Report: Add latency graphs for NAT44 tput tests

Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add NAT44 tput tests 71/31171/1
Tibor Frank [Tue, 9 Feb 2021 06:57:19 +0000 (07:57 +0100)]
Report: Add NAT44 tput tests

Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoreport: Update packet latency methodology 02/31102/4
Maciek Konstantynowicz [Wed, 3 Feb 2021 14:37:01 +0000 (14:37 +0000)]
report: Update packet latency methodology

Change-Id: I0378e96c6f64a1dd035d56465710b82f64dc4d32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
9 months agoFIX: Nic selection 61/31161/2
pmikus [Mon, 8 Feb 2021 11:43:51 +0000 (11:43 +0000)]
FIX: Nic selection

- Buggy unnoticed for quite some time

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa

9 months agoLatency graphs: Do not hardcode x range 59/31159/1
Vratko Polak [Mon, 8 Feb 2021 10:31:57 +0000 (11:31 +0100)]
Latency graphs: Do not hardcode x range

+ Compute it from PERCENTILE_MAX.
+ Use slightly higher PERCENTILE_MAX to avoid rounding errors.
+ Add a comment why slightly higher value is needed.

Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agojob-spec: fix report_coverage/2n-tx2/l2-04.md 57/31157/2
Tibor Frank [Mon, 8 Feb 2021 09:05:10 +0000 (10:05 +0100)]
job-spec: fix report_coverage/2n-tx2/l2-04.md

- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by
  eth-l2bdbasemaclrn-macip-iacl50sl-10kflows

Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 49/31149/3
Tibor Frank [Mon, 8 Feb 2021 08:53:25 +0000 (08:53 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3fbe46788e8b3b5701134e842b4db4583d842214
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoreport: add 2n-tx2 phy testbed diagram and update description 88/31088/3
Maciek Konstantynowicz [Tue, 2 Feb 2021 12:00:21 +0000 (12:00 +0000)]
report: add 2n-tx2 phy testbed diagram and update description

Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
9 months agoTraffic generator: Force ramp-up in next test 29/31129/2
Vratko Polak [Fri, 5 Feb 2021 15:14:27 +0000 (16:14 +0100)]
Traffic generator: Force ramp-up in next test

The behavior was already documented, just not implemented properly.

Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Add data 56/31156/1
Tibor Frank [Mon, 8 Feb 2021 08:41:43 +0000 (09:41 +0100)]
Report: Add data

Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 33/31133/2
Tibor Frank [Fri, 5 Feb 2021 19:36:00 +0000 (20:36 +0100)]
Report: Add data

Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoRevert "Job specs: Add -tput tests to iterative" 45/31145/2
Tibor Frank [Fri, 5 Feb 2021 19:19:04 +0000 (19:19 +0000)]
Revert "Job specs: Add -tput tests to iterative"

This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5.

Reason for revert: Faulty tests, those which are running
take too much time

Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoJob specs: Add -tput tests to iterative 25/31125/2
Vratko Polak [Fri, 5 Feb 2021 12:48:06 +0000 (13:48 +0100)]
Job specs: Add -tput tests to iterative

- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
 + Because ip4base is stateless.
 + So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.

Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Various fixes 26/31126/3
Tibor Frank [Fri, 5 Feb 2021 13:28:06 +0000 (14:28 +0100)]
Report: Various fixes

Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoNAT44ed: Add pure throuhput bidir tests 78/30278/39
Vratko Polak [Fri, 5 Feb 2021 10:46:40 +0000 (11:46 +0100)]
NAT44ed: Add pure throuhput bidir tests

+ With ramp-up, without reset, with session verification.
+ Uses the same profile as pps tests.
+ Ramp up duration is not specified, as duration is computed.
+ Timeout tracking with automated ramp-up.
 + Correct computation of next duration.
 + Checking both early and late sessions.
 + No loss measurement also acts as a ramp-up.
+ Return ReceiveRateMeasurement from send_traffic_on_tg_internal,
  as that is needed for detecting whether trial is ok as ramp up.
- Udp needs quite low ramp-up rate after recent regression.
 - Max scale has higher rate (so failing) to avoid session timeouts.
+ Bump copyright year.

Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Set range of x-axis for latency graphs, add data 24/31124/1
Tibor Frank [Fri, 5 Feb 2021 09:44:24 +0000 (10:44 +0100)]
Report: Set range of x-axis for latency graphs, add data

Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: RND tests 21/31121/1
Tibor Frank [Fri, 5 Feb 2021 08:28:48 +0000 (09:28 +0100)]
Trending: RND tests

Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 20/31120/1
Tibor Frank [Fri, 5 Feb 2021 07:42:12 +0000 (08:42 +0100)]
Report: Add data

Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoInfra: Move probes under ansible instead of terraform 16/31116/4
pmikus [Thu, 4 Feb 2021 13:03:12 +0000 (13:03 +0000)]
Infra: Move probes under ansible instead of terraform

+ More stable probe handling.
+ Naming cleanup due to errors.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bb1237af20636919f869f2eee53597202d00792

9 months agoReport: Set the range of x-axis fro Latency graphs 17/31117/1
Tibor Frank [Thu, 4 Feb 2021 13:19:00 +0000 (14:19 +0100)]
Report: Set the range of x-axis fro Latency graphs

Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 2n-clx rnd latency graphs 09/31109/1
Tibor Frank [Thu, 4 Feb 2021 08:48:30 +0000 (09:48 +0100)]
Report: Add 2n-clx rnd latency graphs

Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 08/31108/1
Tibor Frank [Thu, 4 Feb 2021 08:42:42 +0000 (09:42 +0100)]
Report: Add data

Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 06/31106/1
Tibor Frank [Thu, 4 Feb 2021 07:16:47 +0000 (08:16 +0100)]
Report: Add data

Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Latency graphs 03/31103/9
Tibor Frank [Wed, 3 Feb 2021 16:03:54 +0000 (17:03 +0100)]
Report: Latency graphs

Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUDP_PPS: Ensure keepalive is long enough 06/30006/8
Vratko Polak [Thu, 14 Jan 2021 15:23:05 +0000 (16:23 +0100)]
UDP_PPS: Ensure keepalive is long enough

Previously, it was long enough for the current performance,
but not long enough for the theoretical worst case.

See https://gerrit.fd.io/r/c/csit/+/29803/9/docs/report/introduction/methodology_nat44.rst#293

Change-Id: I3f57a834c77d93b38bca81fdbb714a6374b81bae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoTrending: Add IPv4 and IPv6 rnd tests 99/31099/2
Tibor Frank [Wed, 3 Feb 2021 14:28:56 +0000 (15:28 +0100)]
Trending: Add IPv4 and IPv6 rnd tests

Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoAnsible: Fix package cache updates 86/31086/3
Tomas Alexy [Tue, 2 Feb 2021 11:37:01 +0000 (12:37 +0100)]
Ansible: Fix package cache updates

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I5c7b2636bde999fef3a60e6cbf2b36db9978a74a

9 months agoReport: Add RND Latency graphs, add data 98/31098/1
Tibor Frank [Wed, 3 Feb 2021 06:30:41 +0000 (07:30 +0100)]
Report: Add RND Latency graphs, add data

Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Fix spec 95/31095/1
Tibor Frank [Tue, 2 Feb 2021 20:58:16 +0000 (21:58 +0100)]
Report: Fix spec

Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add RND tests 94/31094/1
Tibor Frank [Tue, 2 Feb 2021 20:36:52 +0000 (21:36 +0100)]
Report: Add RND tests

Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Fix nat44 tests in NDRPDR trending 89/31089/1
Tibor Frank [Tue, 2 Feb 2021 18:05:07 +0000 (19:05 +0100)]
Trending: Fix nat44 tests in NDRPDR trending

Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 87/31087/1
Tibor Frank [Tue, 2 Feb 2021 11:43:49 +0000 (12:43 +0100)]
Report: Add data

Change-Id: I97bdba256d5886c0ffdd42d4427038bd3b443043
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 2101.release data 29/31029/3
Tibor Frank [Mon, 1 Feb 2021 08:52:48 +0000 (09:52 +0100)]
Report: Add 2101.release data

Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agomaster: Update VPP_STABLE_VER files 58/31058/2
Tibor Frank [Mon, 1 Feb 2021 06:26:02 +0000 (06:26 +0000)]
master: Update VPP_STABLE_VER files

Change-Id: I34b797d9596ac5df3ffb5d5f49e13185e0a8f70e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoFix: Slack API key 22/31022/2
pmikus [Fri, 29 Jan 2021 13:12:43 +0000 (13:12 +0000)]
Fix: Slack API key

- Clearly we must implement key storage vault to avoid storing key in
.tfstate

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7

10 months agoTOI: Update TOI: branches 20/31020/2
Tibor Frank [Fri, 29 Jan 2021 11:29:10 +0000 (12:29 +0100)]
TOI: Update TOI: branches

Change-Id: Ie7fe6fbe58f87243bf502bd14886182fbc11beb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoFix: Slack key workaround 18/31018/1
pmikus [Fri, 29 Jan 2021 10:03:46 +0000 (10:03 +0000)]
Fix: Slack key workaround

- Todo: Deploy hashi vault.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad

10 months agoInfra: Monitoring capability 56/30656/33
pmikus [Thu, 7 Jan 2021 14:27:38 +0000 (14:27 +0000)]
Infra: Monitoring capability

+ Monitoring SOA
  + Nomad alertmanager job
  + Nomad prometheus job
  + Nomad grafana job

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2

10 months agoInfra: Remove Consul TLS on clients (Nomad conflict) 68/30968/1
pmikus [Thu, 28 Jan 2021 08:47:01 +0000 (08:47 +0000)]
Infra: Remove Consul TLS on clients (Nomad conflict)

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf

10 months agoInfra: Remove unwanted terraform output 66/30966/1
pmikus [Thu, 28 Jan 2021 08:37:12 +0000 (08:37 +0000)]
Infra: Remove unwanted terraform output

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a

10 months agoInfra: Terraform vpp_device module 65/30965/1
pmikus [Thu, 28 Jan 2021 08:24:35 +0000 (08:24 +0000)]
Infra: Terraform vpp_device module

+ Convert to module
+ Fix memory limit

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c

10 months agoInfra: Adjust vpp_device x86 memory layout 63/30963/1
pmikus [Thu, 28 Jan 2021 07:38:34 +0000 (07:38 +0000)]
Infra: Adjust vpp_device x86 memory layout

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43b3b891b270903419b7fcf132813563306b6e10

10 months agoInfra: Align Nomad settings across cluster 62/30962/1
pmikus [Thu, 28 Jan 2021 07:22:24 +0000 (07:22 +0000)]
Infra: Align Nomad settings across cluster

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66

10 months agojob-specs: Add rnd tests 57/30957/2
Tibor Frank [Wed, 27 Jan 2021 19:23:53 +0000 (20:23 +0100)]
job-specs: Add rnd tests

Change-Id: I877f46608853401c5226845737ace691e3f393b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 49/30949/1
Tibor Frank [Wed, 27 Jan 2021 11:59:44 +0000 (12:59 +0100)]
Report: Add data

Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Fix reconfig graphs 48/30948/8
Tibor Frank [Wed, 27 Jan 2021 09:54:59 +0000 (10:54 +0100)]
Report: Fix reconfig graphs

Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Improve reconf graphs 45/30945/2
Tibor Frank [Wed, 27 Jan 2021 06:03:01 +0000 (07:03 +0100)]
Report: Improve reconf graphs

Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTrending: Add GENEVE tests 35/30935/2
Tibor Frank [Tue, 26 Jan 2021 13:56:27 +0000 (14:56 +0100)]
Trending: Add GENEVE tests

Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add GENEVE tests 34/30934/3
Tibor Frank [Tue, 26 Jan 2021 13:20:23 +0000 (14:20 +0100)]
Report: Add GENEVE tests

Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoMaster: Update VPP_STABLE_VER files 01/30901/2
Tibor Frank [Mon, 25 Jan 2021 13:30:33 +0000 (13:30 +0000)]
Master: Update VPP_STABLE_VER files

Change-Id: I609d6efcd6934e513521df63aef2c25ac9bbfdea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 21/30921/1
Tibor Frank [Mon, 25 Jan 2021 08:45:06 +0000 (09:45 +0100)]
Report: Add data

Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoHdrh latency graphs: Do not skip the last value 57/30857/5
Vratko Polak [Thu, 21 Jan 2021 11:44:11 +0000 (12:44 +0100)]
Hdrh latency graphs: Do not skip the last value

Linear x axis does not need any skipping.
For logarithmic axis, descrease from 100% to avoid infinity.
Currently using a fixed PERCENTILE_MAX value.
Added a comment on when to change that value.

Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: add geneve to perf release notes 72/30872/2
Jan Gelety [Mon, 11 Jan 2021 01:34:17 +0000 (02:34 +0100)]
Report: add geneve to perf release notes

Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Add data 83/30883/2
Tibor Frank [Fri, 22 Jan 2021 11:25:19 +0000 (12:25 +0100)]
Report: Add data

Change-Id: I1d5031780b1bef169509058233e02624d7afecb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: vpp-device release notes 69/30869/3
Jan Gelety [Sun, 10 Jan 2021 20:56:40 +0000 (21:56 +0100)]
Report: vpp-device release notes

Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoTests: Temporarily disable IPv6 VM test that is randomly failing 80/30880/2
pmikus [Thu, 21 Jan 2021 19:27:02 +0000 (19:27 +0000)]
Tests: Temporarily disable IPv6 VM test that is randomly failing

- To be debugged

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I62ea2427d716f10dbf6af179edfaa41e73952db0