csit.git
3 years agoReport: Add GENEVE tests 04/30904/1
Tibor Frank [Tue, 26 Jan 2021 13:20:23 +0000 (14:20 +0100)]
Report: Add GENEVE tests

Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1e3c01e0e458d62ed228e8d6a916c24992304252)

3 years agorls2101: Update VPP_STABLE_VER files 03/30903/2
Tibor Frank [Mon, 25 Jan 2021 13:34:27 +0000 (13:34 +0000)]
rls2101: Update VPP_STABLE_VER files

Change-Id: I4db975fab589594f7551217b64adfe13cf628f65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 99/30899/1
Tibor Frank [Mon, 25 Jan 2021 08:45:06 +0000 (09:45 +0100)]
Report: Add data

Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 88bbb1908b4aa58163374c983b4b8e85e78460d5)

3 years agoHdrh latency graphs: Do not skip the last value 98/30898/1
Vratko Polak [Thu, 21 Jan 2021 11:44:11 +0000 (12:44 +0100)]
Hdrh latency graphs: Do not skip the last value

Linear x axis does not need any skipping.
For logarithmic axis, descrease from 100% to avoid infinity.
Currently using a fixed PERCENTILE_MAX value.
Added a comment on when to change that value.

Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit d4f12e6931c7fdf84043d8fb2f71e2f38965f26b)

3 years agoReport: add geneve to perf release notes 35/30835/1
Jan Gelety [Mon, 11 Jan 2021 01:34:17 +0000 (02:34 +0100)]
Report: add geneve to perf release notes

Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 67d3b2a44d49dd2c4a1b2f722849f57432787137)

3 years agoReport: Add data 34/30834/1
Tibor Frank [Fri, 22 Jan 2021 11:25:19 +0000 (12:25 +0100)]
Report: Add data

Change-Id: I1d5031780b1bef169509058233e02624d7afecb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0c489b1767a031837f320c1fb5e45947ac82ea4d)

3 years agoReport: vpp-device release notes 33/30833/1
Jan Gelety [Sun, 10 Jan 2021 20:56:40 +0000 (21:56 +0100)]
Report: vpp-device release notes

Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 7b9b65a3af83267a4e6a36fc98996aaa05060a87)

3 years agoReconf: Fix bidir/unidir mismatch 31/30831/1
Vratko Polak [Thu, 21 Jan 2021 10:15:56 +0000 (11:15 +0100)]
Reconf: Fix bidir/unidir mismatch

Results if NDR search is in TPS (so unidir) since
https://gerrit.fd.io/r/c/csit/+/28208

The bug was causing all reconf tests report zero loss,
as they used half of NDR load during reconfiguration.

+ Small improvements to descriptions of other traffic keywords.

Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 293a88b56179094f655178b838b84844a672390d)

3 years agoTrending: Fix bugs in 2n-tx2 30/30830/1
Tibor Frank [Thu, 21 Jan 2021 06:09:02 +0000 (07:09 +0100)]
Trending: Fix bugs in 2n-tx2

Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7f7f2fd7363637d0da626a28bb8a0b357d314a9d)

3 years agoReport: Add data 28/30828/1
Tibor Frank [Thu, 21 Jan 2021 09:25:33 +0000 (10:25 +0100)]
Report: Add data

Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9e08f1dfb125d092a48f92c764f52ae97f8a9995)

3 years agoTrending: Add 2n-tx2 27/30827/1
Tibor Frank [Tue, 19 Jan 2021 19:12:09 +0000 (20:12 +0100)]
Trending: Add 2n-tx2

Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3fc6ce9f08f0a1c1293dfc032fdddfe5e3f7eb16)

3 years agoacl: add L2BD dev tests 25/30825/1
Martin Balaz [Thu, 10 Sep 2020 16:18:48 +0000 (18:18 +0200)]
acl: add L2BD dev tests

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 0f3baca2366f969de6b5d3b889c1b05f72995ec2)

3 years agojob_specs: add geneve tests 24/30824/1
Jan Gelety [Sun, 10 Jan 2021 13:34:01 +0000 (14:34 +0100)]
job_specs: add geneve tests

Geneve tests added to report_iterative and report_coverage job
specifications.

- tests with 1024 geneve tunnels added only to report_coverage jobs
  until fast PAPI is finished

Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 3d0d137bf45e1cd3c7aa06480f5ea08175a6df01)

3 years agoTox: Improve tox.ini 22/30822/1
Vratko Polak [Mon, 18 Jan 2021 13:35:17 +0000 (14:35 +0100)]
Tox: Improve tox.ini

Just stylistic improvements, no functional change.

+ Use "ignore_outcome = true" instead of "|| true".
+ Document and apply recommended ordering within testenv definition.
+ Fix some typos.

Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 52a39f861bb645831130ef109a14e629be9bde7a)

3 years agoReport: Add data 20/30820/1
Tibor Frank [Wed, 20 Jan 2021 08:16:08 +0000 (09:16 +0100)]
Report: Add data

Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 216c68cc8b010642c4de21673b7d8e18006767e2)

3 years agoReport: Add ip6 latency graphs 19/30819/1
Tibor Frank [Tue, 19 Jan 2021 18:00:47 +0000 (19:00 +0100)]
Report: Add ip6 latency graphs

Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5e0fe5a28969dfc9fe36415a065122a668d5a273)

3 years agoReport: Add data, 2n-tx2 latency graphs 17/30817/1
Tibor Frank [Tue, 19 Jan 2021 12:26:34 +0000 (13:26 +0100)]
Report: Add data, 2n-tx2 latency graphs

Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4bc1e70ad02b198a7b9ea32b72da3ae98978e8c5)

3 years agoJob specs: Add some ipsec reconf to iterative 16/30816/1
Vratko Polak [Tue, 19 Jan 2021 11:04:08 +0000 (12:04 +0100)]
Job specs: Add some ipsec reconf to iterative

We now have more time for 3n-hsw testbeds.
Added only scales of 4, 1000 and 60000 tunnels.

Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit be5833232791a24921e7e9695e53efcbd7ff248e)

3 years agoReport: Add data 55/30755/1
Tibor Frank [Tue, 19 Jan 2021 06:12:35 +0000 (07:12 +0100)]
Report: Add data

Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f5863d6213bf0066b9647a7dde10d56bd7260f80)

3 years agoRandom flows: Use seeds again and increase limit. 54/30754/2
Vratko Polak [Wed, 13 Jan 2021 18:38:50 +0000 (19:38 +0100)]
Random flows: Use seeds again and increase limit.

TRex does mix seeds when distributing over workers,
but it is multiplicative [0], so zero is the only bad value.

Limit restricts the cycle length of PRNG (by resetting [1] the seed).
We want the cycle as long as possible.

[0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616
[1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314

Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit eedb7dff222d2590ac2cb5a5e67dc7d90317f05c)

3 years ago2101: Update VPP_STABLE_VER_ files 03/30803/2
Tibor Frank [Mon, 18 Jan 2021 14:31:20 +0000 (15:31 +0100)]
2101: Update VPP_STABLE_VER_ files

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ica196e6a309e4dc2fdfb51b7faed72a627311991

3 years agoReport: Remove slider for Latency graphs 53/30753/1
Tibor Frank [Mon, 18 Jan 2021 15:30:28 +0000 (16:30 +0100)]
Report: Remove slider for Latency graphs

Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 69264aed8d43f3c4a8342dd7584f80336108c879)

3 years agoReport: Fix specification 51/30751/1
Tibor Frank [Mon, 18 Jan 2021 13:57:45 +0000 (14:57 +0100)]
Report: Fix specification

Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4d04d11497eb87f94d6ac4982e4b17ae0f48d811)

3 years agojob-specs: Fix hoststack 50/30750/1
Tibor Frank [Mon, 18 Jan 2021 13:52:38 +0000 (14:52 +0100)]
job-specs: Fix hoststack

Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e4d7b3b4d4185e97443830e7e9fb0f570031a376)

3 years agoReport: Add data, add 2n-tx2 49/30749/1
Tibor Frank [Mon, 18 Jan 2021 09:43:14 +0000 (10:43 +0100)]
Report: Add data, add 2n-tx2

Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit caef25a1412689fc0906e024e9b26c547ecfc5bd)

3 years agoReport: add 2n-tx2 static content 47/30747/2
Juraj Linkeš [Fri, 15 Jan 2021 12:09:43 +0000 (13:09 +0100)]
Report: add 2n-tx2 static content

Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 7f0abbb8f56342fc09b09beb47661f4d55b7eb62)

3 years agoPAL: Improve latency graphs 48/30748/1
Vratko Polak [Thu, 14 Jan 2021 12:34:08 +0000 (13:34 +0100)]
PAL: Improve latency graphs

Previously, they used sloped lines connecting reported points.
But HdrHistogram reports only the upper bound of percentile.
Example: If all samples are 10us,
HdrHistogram reports a single value at 100%.

This change attempts to show the whole intervals (0%-100% for the example)
as a series (vertically connected) of horizontal lines.
Hover also shows percentiles as intervals.

Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 826d80373dbd20bc1feac2403e9cade9e5633336)

3 years agoAdd 3n ip4-rnd tests 40/30740/2
Vratko Polak [Thu, 14 Jan 2021 15:08:25 +0000 (16:08 +0100)]
Add 3n ip4-rnd tests

+ Rename traffic profiles to avoid mentioning number of nodes.
+ Improve 2n rnd suite documentation slightly.

This is a manual cherry-pick of https://gerrit.fd.io/r/c/csit/+/27679

Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoLicense: Update block replacer 44/30744/1
Vratko Polak [Wed, 13 Jan 2021 09:02:51 +0000 (10:02 +0100)]
License: Update block replacer

... so it replaces also long (older) form of GPL license.
This way replacing to apache and back ensures GPL has (newer) short form.

Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 193fc1732fdacf424d36bbb979037ba261457cb4)

3 years agoLicense: Wrap GPL block to 80 characters 41/30741/2
Vratko Polak [Tue, 12 Jan 2021 16:22:01 +0000 (17:22 +0100)]
License: Wrap GPL block to 80 characters

The original license block was adapted from
https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts
resulting in a line longer than 80 chars,
but those are reported (although not blocked) by tox verify job.

As the text from wiki was not used in verbatim
(it uses c-style comment block),
minor formatting change like this should not be a big deal.

+ Bump copyright year.

Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 624e580159dc056035d7e962582e86a000f8c3d6)

3 years agoperf: GENEVE tunnel test, l3 mode 58/30758/2
Jan Gelety [Thu, 3 Dec 2020 15:22:41 +0000 (16:22 +0100)]
perf: GENEVE tunnel test, l3 mode

Jira: CSIT-1768

Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 6962831a1f1905e50a3d663c0cf3ce8c2873ecc9)

Change-Id: I6496ae773b176b2abfedab843110d6f870c62888
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years ago2101: Update the stable ver files to rc2 56/30756/2
Tibor Frank [Thu, 14 Jan 2021 06:16:03 +0000 (07:16 +0100)]
2101: Update the stable ver files to rc2

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ibec19f45e307af8b6c92d76ed0da126650973c3b

3 years agoReport: Add data 42/30742/1
Tibor Frank [Thu, 14 Jan 2021 06:38:16 +0000 (07:38 +0100)]
Report: Add data

Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ef5c30213bb28824a55f4ebbcade6410ee8d2461)

3 years agojob_specs: fix 2n-tx2 ip6 iacldst job specs 37/30737/1
Juraj Linkeš [Wed, 13 Jan 2021 16:00:58 +0000 (17:00 +0100)]
job_specs: fix 2n-tx2 ip6 iacldst job specs

Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 55eb33d7469ec635755d0942c74ff798f9f3d498)

3 years agoReport: Fix plots 36/30736/1
Tibor Frank [Wed, 13 Jan 2021 15:18:03 +0000 (16:18 +0100)]
Report: Fix plots

Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 81958d4bc5ec4803be0726d94564680e2a0f9a5c)

3 years agojob_specs: update 2n-tx2 coverage specs 28/30728/2
Juraj Linkeš [Wed, 13 Jan 2021 14:40:55 +0000 (15:40 +0100)]
job_specs: update 2n-tx2 coverage specs

Start out with l2, l3, classifier and acl tests.

Change-Id: I8fc390c77e410e4f4832b4412114253dd34a5fbb
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport: Add data 15/30715/1
Tibor Frank [Wed, 13 Jan 2021 13:47:55 +0000 (14:47 +0100)]
Report: Add data

Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 98a94315dae63bd19c7bc16ce50b3219386aa34c)

3 years agoReport: Add data 10/30710/1
Tibor Frank [Wed, 13 Jan 2021 06:50:35 +0000 (07:50 +0100)]
Report: Add data

Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7a26d43c4f71869695ba19ce58f9afac9a1d176d)

3 years agoReport: Add data 09/30709/1
Tibor Frank [Tue, 12 Jan 2021 11:58:01 +0000 (12:58 +0100)]
Report: Add data

Change-Id: I70153753ccc69597dc2c69133b3828cd76174468
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1899cf849e938512df8bac9ea7cb6479732dda42)

3 years agoAdd 2n-tx2 job specs 08/30708/2
Tibor Frank [Tue, 12 Jan 2021 10:15:56 +0000 (10:15 +0000)]
Add 2n-tx2 job specs

Change-Id: I992c1466b2226337a043b46e1bdba82de2dc2368
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 07/30707/1
Tibor Frank [Tue, 12 Jan 2021 06:48:31 +0000 (07:48 +0100)]
Report: Add data

Change-Id: I648732e98941b562c31a9db735332bd215d65870
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1b141f8090e9b067dce9d182a81aa530213d4a66)

3 years agotests: add 2n1l l2 acl tests, update 2n-tx2 specs 06/30706/2
Juraj Linkeš [Thu, 7 Jan 2021 15:25:31 +0000 (16:25 +0100)]
tests: add 2n1l l2 acl tests, update 2n-tx2 specs

Modify initialize L2BD ACL keywords to be usable for both 2-node and
3-node topologies and update testsuites accordingly.
Add the missing macip T-rex profile.
Add classifier tests to 2n-tx2 job specs.

Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 9d510d595f73d26e3f7c6646fa6530e8f252f790)

3 years agoInfra: Increase shm-size 05/30705/1
pmikus [Mon, 11 Jan 2021 08:33:05 +0000 (08:33 +0000)]
Infra: Increase shm-size

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66
(cherry picked from commit 2f4b14bc83437afcc242190a121ba47a6d10bd09)

3 years agoReport: Fix plot layout 04/30704/1
Tibor Frank [Mon, 11 Jan 2021 14:40:08 +0000 (15:40 +0100)]
Report: Fix plot layout

Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fa0e6315e4db3d96b281fb7467a9416150c0bc9f)

3 years agoReport: Add data 03/30703/1
Tibor Frank [Mon, 11 Jan 2021 14:27:31 +0000 (15:27 +0100)]
Report: Add data

Change-Id: Ic584b2340bbaebf5699213358292159518546334
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7c71f5e3de89d0e9f0b6d5d0ee099e1ee97c2db)

3 years agoFIX: Backward compatibility include selection 01/30701/1
pmikus [Fri, 18 Dec 2020 06:38:48 +0000 (06:38 +0000)]
FIX: Backward compatibility include selection

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ieff60a44d42d66acee8ba1680e7e285d6cd01bc9
(cherry picked from commit e62ade12b7c9918cda2d363387ed0f517aa9840d)

3 years agoReport: Add Latency graphs with logaritmic x-axis 00/30700/1
Tibor Frank [Mon, 11 Jan 2021 12:20:13 +0000 (13:20 +0100)]
Report: Add Latency graphs with logaritmic x-axis

Change-Id: Ic41b8761aed4256cb3f8ab9d14831e9d2be1598c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b370b24ad548c2caba20fcfd1c4796416d829c7a)

3 years agoReport: Configuration 35/30635/1
Tibor Frank [Mon, 11 Jan 2021 08:49:08 +0000 (09:49 +0100)]
Report: Configuration

Change-Id: Ia1d95d610ede86127797eecd89eb68091d15d54c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5dd28c508cf6f04dee46580c73272c2cb31f5831)

3 years agoReport: Configure report 34/30634/1
Tibor Frank [Tue, 5 Jan 2021 13:12:40 +0000 (14:12 +0100)]
Report: Configure report

Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fc3f7fa58880d2327c3364bbcf8338d2256fb8f0)

3 years agoPAPI: Cache connected client instances 26/30626/1
Vratko Polak [Tue, 15 Dec 2020 12:39:56 +0000 (13:39 +0100)]
PAPI: Cache connected client instances

Disconnect+connect cycle is expensive and slow.
This change tracks connected client instances
so later "connect" to the same target uses it.

Explicit disconnects are allowed (and executed before VPP ends),
but once again disconnected instances are cached and reused,
as creating a new instance is more expensive than just connect.

+ Add missing checks on interfaces being up to appropriate keyword.
 + Use appropriate keywords.
 + Add a comment explaining why a simpler keyword is not appropriate.
+ Improve VPP checks in containers.
 + Fix the vppctl check to actually work.
 + Add PAPI check to ensure VPP is really ready.
 + Delay/reorder checks to make them faster with multiple containers.
 + Leave some TODOs to improve various lifecycles later.
+ As we do not stop VPP in test/suite teardown:
 + One final disconnect is needed, added to __init__.robot teardowns.
 - Import of the final disconnect keyword is ugly, but it works.
- We could use a hashable class for distinguishing node+socket pairs.
- Are we connecting to VPP inside VMs?

Change-Id: I49cd726740c3e8cae1591c7c84b85a447241228f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit a33b52ae0f255021d89307ebc694f6e907906151)

3 years agoSet DPDK version to 20.11 22/30622/1
Tibor Frank [Thu, 7 Jan 2021 06:38:15 +0000 (07:38 +0100)]
Set DPDK version to 20.11

Change-Id: I6f95ad79c891def175dcbc778d26ced0ec84f799
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4e2347f3996290fbc2386938791c2f272d052c63)

3 years agoInfra: Ansible sync 04/30604/1
pmikus [Tue, 5 Jan 2021 08:56:03 +0000 (08:56 +0000)]
Infra: Ansible sync

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ida73c8acab94ad334fe57bb52f4dab33c40dded6

3 years agofix: geneve 92/30592/1
Jan Gelety [Fri, 18 Dec 2020 22:24:12 +0000 (23:24 +0100)]
fix: geneve

Change-Id: I23541e1c07a42b4baa560c343ffeed3b963fe694
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit d7a3262b58c86868a18c29244f29196203e1eb39)

3 years agoAPI: deprecated COP APIs 87/30587/2
Tomas Alexy [Mon, 4 Jan 2021 09:15:51 +0000 (10:15 +0100)]
API: deprecated COP APIs

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64
(cherry picked from commit 9446b9bf9c15999feec3c8a48fec428bca094500)

3 years agoGSO: TAP/VHOST use case 81/30581/1
pmikus [Fri, 2 Oct 2020 05:48:34 +0000 (05:48 +0000)]
GSO: TAP/VHOST use case

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibafaaca4438587284d1e255c764f0701002941e8
(cherry picked from commit 44dcb3113c8ade2e44543746abca861a89362c9b)

3 years ago2101: Update of VPP_STABLE_VER files 64/30564/2
Tibor Frank [Mon, 4 Jan 2021 07:49:58 +0000 (08:49 +0100)]
2101: Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc1~3-gf097300c2

 - use new vpp ref build - centos8:
   21.01-rc1~3_gf097300c2~b6

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I3c3d62cf1dcfab38075387c496b6849d790f53b1

3 years agoFIX: AWK NIC replace in case of x520 14/30514/1
pmikus [Mon, 4 Jan 2021 08:00:55 +0000 (08:00 +0000)]
FIX: AWK NIC replace in case of x520

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d83ba048e0609d6b8623fab5c2960e48a37c023
(cherry picked from commit 3c3930b9f6f9a40d6b30f6e56e8c40279e34f650)

3 years agoSwitch include to test 66/30566/1
pmikus [Thu, 17 Dec 2020 08:34:58 +0000 (08:34 +0000)]
Switch include to test

+ Reduce time overhead when parsing --include vs --test
+ Input files will remain the same
+ 3n-hsw 150include ~24min, 150test ~5min
+ 2n-clx 489include ~61min, 489test ~9min

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7e5957c32385aecbc4551bd124da41afa5bc63c9

3 years agoFramework: add 2n-tx2 perf testbed 06/30506/1
Juraj Linkeš [Fri, 18 Dec 2020 12:07:16 +0000 (13:07 +0100)]
Framework: add 2n-tx2 perf testbed

Add testbed file and make code changes in common.sh.

Change-Id: I493bb92db3c66358afa81ec81bcd99b296f49c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 7aa013cf087993ca4546fd7988e177d43cfedfaf)

3 years agoAPI: deprecated bond APIs 13/30313/3
Jan Gelety [Fri, 11 Dec 2020 05:03:31 +0000 (06:03 +0100)]
API: deprecated bond APIs

Jira: CSIT-1597

Change-Id: I77b746584851331d46eca1caafd4468d18f1e78d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 925b50c85a24b3c91031d09eeca19f17b4e01f2c)

3 years agoUpdate of VPP_STABLE_VER files 95/30495/1
Jan Gelety [Fri, 18 Dec 2020 18:40:24 +0000 (19:40 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc1~2-gda45810ce

 - use new vpp ref build - centos8:
   21.01-rc1~2_gda45810ce~b5

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Ib9468d5ceb0bee5cf347d2f603536e5fbefb3563

3 years agoFramework: 3n-tsh topology file update 14/30314/1
Juraj Linkeš [Fri, 18 Dec 2020 08:47:56 +0000 (09:47 +0100)]
Framework: 3n-tsh topology file update

The TG is now shared, update port and user accordingly.

Change-Id: I8be4f41887498ae42935b7ab22a7f22dc21e6b50
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 1d6448f6c2eea55ec82694b30d6d5081ff631482)

3 years agoUpdate of VPP_REPO_URL and VPP_STABLE_VER files 61/30461/1
Jan Gelety [Fri, 11 Dec 2020 16:09:03 +0000 (17:09 +0100)]
Update of VPP_REPO_URL and VPP_STABLE_VER files

- use vpp builds from vpp stable/2101 branch

- use new vpp ref build - ubuntu 18.04:
  21.01-rc1~0-g9dab7b941

- use new vpp ref build - centos8:
  21.01-rc1~0_g9dab7b941~b3

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Iad5b328871062f1a476c648322132deb6fcc234b

3 years agoAPI: deprecated nsim APIs 47/30447/2
Jan Gelety [Fri, 11 Dec 2020 13:57:28 +0000 (14:57 +0100)]
API: deprecated nsim APIs

Jira: CSIT-1597

Change-Id: Ice342d6cb7cd244d712c42a3d468c851c79739f4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAPI: deprecated IPSEC APIs 60/30260/20
Jan Gelety [Thu, 26 Nov 2020 14:27:26 +0000 (15:27 +0100)]
API: deprecated IPSEC APIs

Jira: CSIT-1597

+ add ipsec_sa tear down action

Change-Id: I4d1e6f26c14e61e8ddc6f29fbf5528a034c84eb0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoreport: added report static content for new testbed type AMD EPYC Zen2 7532 43/30443/1
Maciek Konstantynowicz [Wed, 16 Dec 2020 13:07:42 +0000 (13:07 +0000)]
report: added report static content for new testbed type AMD EPYC Zen2 7532

Change-Id: I9099cce7c4da15a1b3a9aafd37825b284c5ed7fe
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Add data 37/30437/1
Tibor Frank [Wed, 16 Dec 2020 06:23:47 +0000 (07:23 +0100)]
Report: Add data

Change-Id: If43441b9e918220a0e16ab5d1fe678e9ee38a89d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTerraform: Small fixup in storage templates 20/30420/3
pmikus [Tue, 15 Dec 2020 09:28:01 +0000 (09:28 +0000)]
Terraform: Small fixup in storage templates

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0cefbc62d097b01b1c31739d2049157281e2a671

3 years agoUpdate of VPP_STABLE_VER files 03/30403/1
Tibor Frank [Mon, 14 Dec 2020 07:27:56 +0000 (08:27 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~540-ga8ebb5184

 - use new vpp ref build - centos8:
   21.01-rc0~540_ga8ebb5184~b437

Change-Id: I1e6d03ec1a01e1586de37015058f9bc70d9a72d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 99/30399/2
Tibor Frank [Mon, 14 Dec 2020 06:39:45 +0000 (07:39 +0100)]
Report: Add data

Change-Id: I298c3bdec3f9254a2644401a9ffb7ff09c4ecbd2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoImprove release notes 57/30357/2
Vratko Polak [Wed, 9 Dec 2020 13:00:20 +0000 (14:00 +0100)]
Improve release notes

+ Add a link to NAT44 methodology.
+ Mention TCP tests are not using 64B packets.

Change-Id: Ief6334e84abdf4d099dfbc455cfc7c9b2179ccfe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoAnsible: Add 10.32.8.17 into nomad pool 39/30339/4
pmikus [Tue, 8 Dec 2020 11:45:24 +0000 (11:45 +0000)]
Ansible: Add 10.32.8.17 into nomad pool

+ Extra storage capacity

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifbdc26581776e9885b0eb9929d8ac1f731282426

3 years agoRefactor storage solution 62/30362/10
pmikus [Wed, 9 Dec 2020 20:11:42 +0000 (20:11 +0000)]
Refactor storage solution

+ Minio terraform module
  + XL mode enabled with erasure code
  + Upload script as a sample

+ Nginx terraform module

+ Updating ansible to reflect changes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia8c439b749aa0de82bd6f1d0cfbecce4d7000a8f

3 years agoReport: Add data 80/30380/1
Tibor Frank [Fri, 11 Dec 2020 06:01:43 +0000 (07:01 +0100)]
Report: Add data

Change-Id: I96125f0db3b627177f159f8dffa07fb6a6f61671
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTox: Add GPL license checker 34/30234/5
Vratko Polak [Wed, 9 Dec 2020 14:50:06 +0000 (15:50 +0100)]
Tox: Add GPL license checker

A common mistage is to add a file into GPL directory,
with Apache license only.
This adds a tox checker to vote -1 on such changes,
gpl_license.log contains the list of affected files.

There are TODOs related to unlicensed files
or unconventional GPL licenses.

Change-Id: I267e4fb98afd199d5acc7d211068b28c97b31dc9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agovpp-device: GENEVE tunnel test, l3 mode 53/30353/1
Jan Gelety [Thu, 3 Dec 2020 12:08:43 +0000 (13:08 +0100)]
vpp-device: GENEVE tunnel test, l3 mode

Jira: CSIT-1769

Change-Id: I98510cd8e627d7347f77d0032b7bac28f2e36c61
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 51/30351/1
Tibor Frank [Wed, 9 Dec 2020 06:04:56 +0000 (07:04 +0100)]
Report: Add data

Change-Id: Ic7d559d30c2c7d314ba029dfe7c1db99e25e20f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoRevert "vpp-device: GENEVE tunnel test, l3 mode" 01/30301/1
Peter Mikus [Tue, 8 Dec 2020 15:01:28 +0000 (15:01 +0000)]
Revert "vpp-device: GENEVE tunnel test, l3 mode"

This reverts commit a9f54ca5080aeef17686f300a6807bf9b46b7c90.

Reason for revert: DO NOT MERGE BROKEN TESTS!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-device-master-ubuntu1804-1n-skx/9918/archives/log.html.gz

Change-Id: I2ce2970a43e5dd7487eeb54d1ccbb149e06cf8fa
Signed-off-by: pmikus <pmikus@cisco.com>
3 years agovpp-device: GENEVE tunnel test, l3 mode 58/29658/127
Jan Gelety [Sat, 24 Oct 2020 05:12:05 +0000 (07:12 +0200)]
vpp-device: GENEVE tunnel test, l3 mode

Jira: CSIT-1769

Change-Id: I0ab906966f760b809b8431530c010a8f0835d62c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix vpp-csit device script 29/30329/2
Vratko Polak [Mon, 7 Dec 2020 14:11:15 +0000 (15:11 +0100)]
Fix vpp-csit device script

In Gerrit 30041 that was not tested properly.

Change-Id: I42f57f1933b0e7d029030f4ec502f7268780827b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 24/30324/1
Jan Gelety [Wed, 2 Dec 2020 23:07:49 +0000 (00:07 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~515-gd6f221789

 - use new vpp ref build - centos8:
   21.01-rc0~515_gd6f221789~b175

Change-Id: If2599e424ba9db5e24b4981b3b63d48e0edac801
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAnsible: Enable consul TLS 92/30292/3
pmikus [Sat, 5 Dec 2020 23:29:01 +0000 (23:29 +0000)]
Ansible: Enable consul TLS

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia53acc4441087e93a51d87097adea0b220d10144

3 years agoReport: Add 2n-zn2 turbo boost on/off data 54/30254/4
Tibor Frank [Thu, 3 Dec 2020 14:32:08 +0000 (15:32 +0100)]
Report: Add 2n-zn2 turbo boost on/off data

Change-Id: I1eb0475d30048d6b42458d1fb696d7fac93ac948
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoStats: Use the new client class name 76/30276/2
Vratko Polak [Fri, 4 Dec 2020 11:59:51 +0000 (12:59 +0100)]
Stats: Use the new client class name

Change-Id: I4c6555068145eb21b7843f9d27433a5ba3f5b13d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport: Configure 2009.50 77/30277/1
Tibor Frank [Fri, 4 Dec 2020 12:30:10 +0000 (13:30 +0100)]
Report: Configure 2009.50

Change-Id: Ia8e71df86d561c1d9bc388fa6b70ef850c94e66e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agovpp_device: fix vpp device kernel driver binding 27/29927/3
Juraj Linkeš [Fri, 13 Nov 2020 12:46:20 +0000 (13:46 +0100)]
vpp_device: fix vpp device kernel driver binding

Attempt to unbind a driver from a device only if it is bound to a
driver.

Remove the dynamic addition of an existing device ID to a driver. From
the docs [0]:
Writing a device ID to this file will attempt to
dynamically add a new device ID to a PCI device driver.

Since we assume the VFs are bound to the kernel driver when VPP Device
topology creation is done, it implies that the kernel driver supports
the device ID of those VFs, removing the need to add the support.

[0]: https://www.kernel.org/doc/Documentation/ABI/testing/sysfs-bus-pci

Change-Id: I20f3ca071a5a84a06ff358ba514532248a8f9ad0
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoTerraform: csit-shim refactor 72/30272/1
pmikus [Fri, 4 Dec 2020 08:44:21 +0000 (08:44 +0000)]
Terraform: csit-shim refactor

- remove snergster image dependency

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I76fef60371e35dddc6da56db5f9207e003d1c792

3 years agoAvoid ci-management archiving files twice 41/30041/7
Vratko Polak [Thu, 26 Nov 2020 09:25:06 +0000 (10:25 +0100)]
Avoid ci-management archiving files twice

This is a follow-up to https://gerrit.fd.io/r/c/csit/+/20394

https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).

The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directtories,
usually archives/ and archives/archive/.

This change renames copy_archives to move_archives,
with few workarounds to support multiple calls.

I also renamed ARCHIVE_DIR value from $CSIT_DIR/archive
to $CSIT_DIR/archives to make "move" operation look natural.

Finally, download_builds function is being removed,
as after recent improvements to VPP compilation speed
nobody seems to be using it.

Change-Id: I19a429e1dfdfaab7fcf32a9609963b1aebd33c6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoAPI: deprecated NAT APIs 52/30152/5
Jan Gelety [Wed, 25 Nov 2020 20:49:11 +0000 (21:49 +0100)]
API: deprecated NAT APIs

Jira: CSIT-1597

Change-Id: Ib48d20ba087bc9828970c3acc081ac6e4447c20c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoTerraform: Nomad resource definitions 09/30209/6
pmikus [Tue, 1 Dec 2020 07:38:28 +0000 (07:38 +0000)]
Terraform: Nomad resource definitions

+ storage
  - final until more ssd arive.
+ nginx
  - final
+ vpp_device
  - untested yet (restored from EdK setups)
  - to be rewritten

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib9499fc8cfb0d9f5c5d5bbd1ccd856ecc951ec2a

3 years agoTolerate base64 encoded Gerrit comments 10/30210/3
Vratko Polak [Tue, 1 Dec 2020 10:41:18 +0000 (11:41 +0100)]
Tolerate base64 encoded Gerrit comments

+ Move "|| true" to a place that really aviods errors.
+ Attemp to parse decoded string if trigger is not found in plain one.

Change-Id: If3587229ec588f9ad41acb3050add1142032d2d8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoIntel E810 hardware onboarding 98/29998/2
pmikus [Thu, 19 Nov 2020 10:29:26 +0000 (10:29 +0000)]
Intel E810 hardware onboarding

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia055011626212472f65d18a5c1a10440973ecd48

3 years agoReport: Add data 06/30206/1
Tibor Frank [Tue, 1 Dec 2020 06:22:17 +0000 (07:22 +0100)]
Report: Add data

Change-Id: Ib095788b071c74131351045df80ab373f067f1a7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoansible: remove yul2 hosts from nomad server pool 46/28946/3
Dave Wallace [Fri, 18 Sep 2020 14:33:45 +0000 (14:33 +0000)]
ansible: remove yul2 hosts from nomad server pool

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Ibcbd95408fb4859a13c7f2659a9e15c5498b788b

3 years agoAnsible: Final consul.d fixes 03/30203/2
pmikus [Mon, 30 Nov 2020 15:33:33 +0000 (15:33 +0000)]
Ansible: Final consul.d fixes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2b5f2d090ac752c85508030c4dfe206023f1184f

3 years agoTrending: Fix links to NAT44 files 96/30196/1
Tibor Frank [Mon, 30 Nov 2020 11:43:41 +0000 (12:43 +0100)]
Trending: Fix links to NAT44 files

Change-Id: Ia19cfa32430c7f12e0093d0b540d23876ca9da8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Fix filenames 95/30195/1
Tibor Frank [Mon, 30 Nov 2020 11:04:00 +0000 (12:04 +0100)]
Trending: Fix filenames

Change-Id: Idf754d624443ceef1db5ea5e1d4ab2a9f1c5649b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 89/30189/2
Jan Gelety [Thu, 26 Nov 2020 06:42:09 +0000 (07:42 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~469-g7acab3790

 - use new vpp ref build - centos7:
   21.01-rc0~469_g7acab3790~b129

Change-Id: I99a218543390fd184da4595e75f2491f2d7317b6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 93/30193/1
Tibor Frank [Mon, 30 Nov 2020 09:03:17 +0000 (10:03 +0100)]
Report: Add data

Change-Id: I38f4054cddf01557e8482adcdc804760ef7a9c4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Reorganize the NAT44 chapters 90/30190/1
Tibor Frank [Mon, 30 Nov 2020 08:35:18 +0000 (09:35 +0100)]
Trending: Reorganize the NAT44 chapters

Change-Id: Ifec550ae69c6454d0adbc08d3e49435c3cca380f
Signed-off-by: Tibor Frank <tifrank@cisco.com>