csit.git
9 months agoTrending: RND tests 21/31121/1
Tibor Frank [Fri, 5 Feb 2021 08:28:48 +0000 (09:28 +0100)]
Trending: RND tests

Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 20/31120/1
Tibor Frank [Fri, 5 Feb 2021 07:42:12 +0000 (08:42 +0100)]
Report: Add data

Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoInfra: Move probes under ansible instead of terraform 16/31116/4
pmikus [Thu, 4 Feb 2021 13:03:12 +0000 (13:03 +0000)]
Infra: Move probes under ansible instead of terraform

+ More stable probe handling.
+ Naming cleanup due to errors.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bb1237af20636919f869f2eee53597202d00792

9 months agoReport: Set the range of x-axis fro Latency graphs 17/31117/1
Tibor Frank [Thu, 4 Feb 2021 13:19:00 +0000 (14:19 +0100)]
Report: Set the range of x-axis fro Latency graphs

Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 2n-clx rnd latency graphs 09/31109/1
Tibor Frank [Thu, 4 Feb 2021 08:48:30 +0000 (09:48 +0100)]
Report: Add 2n-clx rnd latency graphs

Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 08/31108/1
Tibor Frank [Thu, 4 Feb 2021 08:42:42 +0000 (09:42 +0100)]
Report: Add data

Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 06/31106/1
Tibor Frank [Thu, 4 Feb 2021 07:16:47 +0000 (08:16 +0100)]
Report: Add data

Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Latency graphs 03/31103/9
Tibor Frank [Wed, 3 Feb 2021 16:03:54 +0000 (17:03 +0100)]
Report: Latency graphs

Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUDP_PPS: Ensure keepalive is long enough 06/30006/8
Vratko Polak [Thu, 14 Jan 2021 15:23:05 +0000 (16:23 +0100)]
UDP_PPS: Ensure keepalive is long enough

Previously, it was long enough for the current performance,
but not long enough for the theoretical worst case.

See https://gerrit.fd.io/r/c/csit/+/29803/9/docs/report/introduction/methodology_nat44.rst#293

Change-Id: I3f57a834c77d93b38bca81fdbb714a6374b81bae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoTrending: Add IPv4 and IPv6 rnd tests 99/31099/2
Tibor Frank [Wed, 3 Feb 2021 14:28:56 +0000 (15:28 +0100)]
Trending: Add IPv4 and IPv6 rnd tests

Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoAnsible: Fix package cache updates 86/31086/3
Tomas Alexy [Tue, 2 Feb 2021 11:37:01 +0000 (12:37 +0100)]
Ansible: Fix package cache updates

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I5c7b2636bde999fef3a60e6cbf2b36db9978a74a

9 months agoReport: Add RND Latency graphs, add data 98/31098/1
Tibor Frank [Wed, 3 Feb 2021 06:30:41 +0000 (07:30 +0100)]
Report: Add RND Latency graphs, add data

Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Fix spec 95/31095/1
Tibor Frank [Tue, 2 Feb 2021 20:58:16 +0000 (21:58 +0100)]
Report: Fix spec

Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add RND tests 94/31094/1
Tibor Frank [Tue, 2 Feb 2021 20:36:52 +0000 (21:36 +0100)]
Report: Add RND tests

Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Fix nat44 tests in NDRPDR trending 89/31089/1
Tibor Frank [Tue, 2 Feb 2021 18:05:07 +0000 (19:05 +0100)]
Trending: Fix nat44 tests in NDRPDR trending

Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 87/31087/1
Tibor Frank [Tue, 2 Feb 2021 11:43:49 +0000 (12:43 +0100)]
Report: Add data

Change-Id: I97bdba256d5886c0ffdd42d4427038bd3b443043
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 2101.release data 29/31029/3
Tibor Frank [Mon, 1 Feb 2021 08:52:48 +0000 (09:52 +0100)]
Report: Add 2101.release data

Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agomaster: Update VPP_STABLE_VER files 58/31058/2
Tibor Frank [Mon, 1 Feb 2021 06:26:02 +0000 (06:26 +0000)]
master: Update VPP_STABLE_VER files

Change-Id: I34b797d9596ac5df3ffb5d5f49e13185e0a8f70e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoFix: Slack API key 22/31022/2
pmikus [Fri, 29 Jan 2021 13:12:43 +0000 (13:12 +0000)]
Fix: Slack API key

- Clearly we must implement key storage vault to avoid storing key in
.tfstate

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7

10 months agoTOI: Update TOI: branches 20/31020/2
Tibor Frank [Fri, 29 Jan 2021 11:29:10 +0000 (12:29 +0100)]
TOI: Update TOI: branches

Change-Id: Ie7fe6fbe58f87243bf502bd14886182fbc11beb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoFix: Slack key workaround 18/31018/1
pmikus [Fri, 29 Jan 2021 10:03:46 +0000 (10:03 +0000)]
Fix: Slack key workaround

- Todo: Deploy hashi vault.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad

10 months agoInfra: Monitoring capability 56/30656/33
pmikus [Thu, 7 Jan 2021 14:27:38 +0000 (14:27 +0000)]
Infra: Monitoring capability

+ Monitoring SOA
  + Nomad alertmanager job
  + Nomad prometheus job
  + Nomad grafana job

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2

10 months agoInfra: Remove Consul TLS on clients (Nomad conflict) 68/30968/1
pmikus [Thu, 28 Jan 2021 08:47:01 +0000 (08:47 +0000)]
Infra: Remove Consul TLS on clients (Nomad conflict)

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf

10 months agoInfra: Remove unwanted terraform output 66/30966/1
pmikus [Thu, 28 Jan 2021 08:37:12 +0000 (08:37 +0000)]
Infra: Remove unwanted terraform output

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a

10 months agoInfra: Terraform vpp_device module 65/30965/1
pmikus [Thu, 28 Jan 2021 08:24:35 +0000 (08:24 +0000)]
Infra: Terraform vpp_device module

+ Convert to module
+ Fix memory limit

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c

10 months agoInfra: Adjust vpp_device x86 memory layout 63/30963/1
pmikus [Thu, 28 Jan 2021 07:38:34 +0000 (07:38 +0000)]
Infra: Adjust vpp_device x86 memory layout

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43b3b891b270903419b7fcf132813563306b6e10

10 months agoInfra: Align Nomad settings across cluster 62/30962/1
pmikus [Thu, 28 Jan 2021 07:22:24 +0000 (07:22 +0000)]
Infra: Align Nomad settings across cluster

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66

10 months agojob-specs: Add rnd tests 57/30957/2
Tibor Frank [Wed, 27 Jan 2021 19:23:53 +0000 (20:23 +0100)]
job-specs: Add rnd tests

Change-Id: I877f46608853401c5226845737ace691e3f393b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 49/30949/1
Tibor Frank [Wed, 27 Jan 2021 11:59:44 +0000 (12:59 +0100)]
Report: Add data

Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Fix reconfig graphs 48/30948/8
Tibor Frank [Wed, 27 Jan 2021 09:54:59 +0000 (10:54 +0100)]
Report: Fix reconfig graphs

Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Improve reconf graphs 45/30945/2
Tibor Frank [Wed, 27 Jan 2021 06:03:01 +0000 (07:03 +0100)]
Report: Improve reconf graphs

Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTrending: Add GENEVE tests 35/30935/2
Tibor Frank [Tue, 26 Jan 2021 13:56:27 +0000 (14:56 +0100)]
Trending: Add GENEVE tests

Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add GENEVE tests 34/30934/3
Tibor Frank [Tue, 26 Jan 2021 13:20:23 +0000 (14:20 +0100)]
Report: Add GENEVE tests

Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoMaster: Update VPP_STABLE_VER files 01/30901/2
Tibor Frank [Mon, 25 Jan 2021 13:30:33 +0000 (13:30 +0000)]
Master: Update VPP_STABLE_VER files

Change-Id: I609d6efcd6934e513521df63aef2c25ac9bbfdea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 21/30921/1
Tibor Frank [Mon, 25 Jan 2021 08:45:06 +0000 (09:45 +0100)]
Report: Add data

Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoHdrh latency graphs: Do not skip the last value 57/30857/5
Vratko Polak [Thu, 21 Jan 2021 11:44:11 +0000 (12:44 +0100)]
Hdrh latency graphs: Do not skip the last value

Linear x axis does not need any skipping.
For logarithmic axis, descrease from 100% to avoid infinity.
Currently using a fixed PERCENTILE_MAX value.
Added a comment on when to change that value.

Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: add geneve to perf release notes 72/30872/2
Jan Gelety [Mon, 11 Jan 2021 01:34:17 +0000 (02:34 +0100)]
Report: add geneve to perf release notes

Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Add data 83/30883/2
Tibor Frank [Fri, 22 Jan 2021 11:25:19 +0000 (12:25 +0100)]
Report: Add data

Change-Id: I1d5031780b1bef169509058233e02624d7afecb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: vpp-device release notes 69/30869/3
Jan Gelety [Sun, 10 Jan 2021 20:56:40 +0000 (21:56 +0100)]
Report: vpp-device release notes

Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoTests: Temporarily disable IPv6 VM test that is randomly failing 80/30880/2
pmikus [Thu, 21 Jan 2021 19:27:02 +0000 (19:27 +0000)]
Tests: Temporarily disable IPv6 VM test that is randomly failing

- To be debugged

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I62ea2427d716f10dbf6af179edfaa41e73952db0

10 months agoReconf: Fix bidir/unidir mismatch 70/30870/3
Vratko Polak [Thu, 21 Jan 2021 10:15:56 +0000 (11:15 +0100)]
Reconf: Fix bidir/unidir mismatch

Results if NDR search is in TPS (so unidir) since
https://gerrit.fd.io/r/c/csit/+/28208

The bug was causing all reconf tests report zero loss,
as they used half of NDR load during reconfiguration.

+ Small improvements to descriptions of other traffic keywords.

Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoTrending: Fix bugs in 2n-tx2 67/30867/2
Tibor Frank [Thu, 21 Jan 2021 06:09:02 +0000 (07:09 +0100)]
Trending: Fix bugs in 2n-tx2

Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 68/30868/1
Tibor Frank [Thu, 21 Jan 2021 09:25:33 +0000 (10:25 +0100)]
Report: Add data

Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTrending: Add 2n-tx2 45/30845/3
Tibor Frank [Tue, 19 Jan 2021 19:12:09 +0000 (20:12 +0100)]
Trending: Add 2n-tx2

Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoacl: add L2BD dev tests 79/28779/6
Martin Balaz [Thu, 10 Sep 2020 16:18:48 +0000 (18:18 +0200)]
acl: add L2BD dev tests

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agojob_specs: add geneve tests 41/30841/5
Jan Gelety [Sun, 10 Jan 2021 13:34:01 +0000 (14:34 +0100)]
job_specs: add geneve tests

Geneve tests added to report_iterative and report_coverage job
specifications.

- tests with 1024 geneve tunnels added only to report_coverage jobs
  until fast PAPI is finished

Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoTox: Improve tox.ini 99/30799/3
Vratko Polak [Mon, 18 Jan 2021 13:35:17 +0000 (14:35 +0100)]
Tox: Improve tox.ini

Just stylistic improvements, no functional change.

+ Use "ignore_outcome = true" instead of "|| true".
+ Document and apply recommended ordering within testenv definition.
+ Fix some typos.

Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoAdd suites with randomized ip6 profiles 42/30442/9
Vratko Polak [Mon, 18 Jan 2021 15:59:42 +0000 (16:59 +0100)]
Add suites with randomized ip6 profiles

+ Replace pair of traffic profiles (2n and 3n) with single nodeless one.
+ Compared to incremental suites, randomized ones add IP6_RND tag.

Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 51/30851/1
Tibor Frank [Wed, 20 Jan 2021 08:16:08 +0000 (09:16 +0100)]
Report: Add data

Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add ip6 latency graphs 43/30843/1
Tibor Frank [Tue, 19 Jan 2021 18:00:47 +0000 (19:00 +0100)]
Report: Add ip6 latency graphs

Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data, 2n-tx2 latency graphs 14/30814/3
Tibor Frank [Tue, 19 Jan 2021 12:26:34 +0000 (13:26 +0100)]
Report: Add data, 2n-tx2 latency graphs

Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoJob specs: Add some ipsec reconf to iterative 13/30813/1
Vratko Polak [Tue, 19 Jan 2021 11:04:08 +0000 (12:04 +0100)]
Job specs: Add some ipsec reconf to iterative

We now have more time for 3n-hsw testbeds.
Added only scales of 4, 1000 and 60000 tunnels.

Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 08/30808/1
Tibor Frank [Tue, 19 Jan 2021 06:12:35 +0000 (07:12 +0100)]
Report: Add data

Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoMaster: Update VPP_STABLE_VER_ files 02/30802/2
Tibor Frank [Mon, 18 Jan 2021 14:24:40 +0000 (15:24 +0100)]
Master: Update VPP_STABLE_VER_ files

Change-Id: I8766254c5cb67afe913facec0477e5ba7550fba0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoRandom flows: Use seeds again and increase limit. 11/27711/29
Vratko Polak [Wed, 13 Jan 2021 18:38:50 +0000 (19:38 +0100)]
Random flows: Use seeds again and increase limit.

TRex does mix seeds when distributing over workers,
but it is multiplicative [0], so zero is the only bad value.

Limit restricts the cycle length of PRNG (by resetting [1] the seed).
We want the cycle as long as possible.

[0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616
[1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314

Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Remove slider for Latency graphs 05/30805/1
Tibor Frank [Mon, 18 Jan 2021 15:30:28 +0000 (16:30 +0100)]
Report: Remove slider for Latency graphs

Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Fix specification 01/30801/3
Tibor Frank [Mon, 18 Jan 2021 13:57:45 +0000 (14:57 +0100)]
Report: Fix specification

Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agojob-specs: Fix hoststack 00/30800/1
Tibor Frank [Mon, 18 Jan 2021 13:52:38 +0000 (14:52 +0100)]
job-specs: Fix hoststack

Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data, add 2n-tx2 98/30798/3
Tibor Frank [Mon, 18 Jan 2021 09:43:14 +0000 (10:43 +0100)]
Report: Add data, add 2n-tx2

Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoPAL: Improve latency graphs 31/30731/5
Vratko Polak [Thu, 14 Jan 2021 12:34:08 +0000 (13:34 +0100)]
PAL: Improve latency graphs

Previously, they used sloped lines connecting reported points.
But HdrHistogram reports only the upper bound of percentile.
Example: If all samples are 10us,
HdrHistogram reports a single value at 100%.

This change attempts to show the whole intervals (0%-100% for the example)
as a series (vertically connected) of horizontal lines.
Hover also shows percentiles as intervals.

Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: add 2n-tx2 static content 77/30777/2
Juraj Linkeš [Fri, 15 Jan 2021 12:09:43 +0000 (13:09 +0100)]
Report: add 2n-tx2 static content

Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoperf: GENEVE tunnel test, l3 mode 56/30356/21
Jan Gelety [Thu, 3 Dec 2020 15:22:41 +0000 (16:22 +0100)]
perf: GENEVE tunnel test, l3 mode

Jira: CSIT-1768

Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Add data 57/30757/2
Tibor Frank [Thu, 14 Jan 2021 06:38:16 +0000 (07:38 +0100)]
Report: Add data

Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoAdd 3n ip4-rnd tests 79/27679/13
Vratko Polak [Wed, 13 Jan 2021 13:49:02 +0000 (14:49 +0100)]
Add 3n ip4-rnd tests

+ Rename traffic profiles to avoid mentioning number of nodes.
+ Improve 2n rnd suite documentation slightly.

Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agojob_specs: fix 2n-tx2 ip6 iacldst job specs 30/30730/1
Juraj Linkeš [Wed, 13 Jan 2021 16:00:58 +0000 (17:00 +0100)]
job_specs: fix 2n-tx2 ip6 iacldst job specs

Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoReport: Fix plots 29/30729/1
Tibor Frank [Wed, 13 Jan 2021 15:18:03 +0000 (16:18 +0100)]
Report: Fix plots

Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agojob_specs: update 2n-tx2 coverage specs 25/30725/2
Juraj Linkeš [Wed, 13 Jan 2021 11:55:04 +0000 (12:55 +0100)]
job_specs: update 2n-tx2 coverage specs

Start out with l2, l3, classifier and acl tests.

Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoDocs: TOI - How to create branches 28/30328/14
Tibor Frank [Mon, 7 Dec 2020 12:17:58 +0000 (13:17 +0100)]
Docs: TOI - How to create branches

Change-Id: I7588d7ac7a0200df5b660ffbc31f7c2496496d06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 27/30727/1
Tibor Frank [Wed, 13 Jan 2021 13:47:55 +0000 (14:47 +0100)]
Report: Add data

Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoLicense: Update block replacer 94/30694/5
Vratko Polak [Wed, 13 Jan 2021 09:02:51 +0000 (10:02 +0100)]
License: Update block replacer

... so it replaces also long (older) form of GPL license.
This way replacing to apache and back ensures GPL has (newer) short form.

Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 20/30720/3
Tibor Frank [Wed, 13 Jan 2021 06:50:35 +0000 (07:50 +0100)]
Report: Add data

Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoLicense: Wrap GPL block to 80 characters 92/30692/2
Vratko Polak [Tue, 12 Jan 2021 16:22:01 +0000 (17:22 +0100)]
License: Wrap GPL block to 80 characters

The original license block was adapted from
https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts
resulting in a line longer than 80 chars,
but those are reported (although not blocked) by tox verify job.

As the text from wiki was not used in verbatim
(it uses c-style comment block),
minor formatting change like this should not be a big deal.

+ Bump copyright year.

Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 91/30691/1
Tibor Frank [Tue, 12 Jan 2021 11:58:01 +0000 (12:58 +0100)]
Report: Add data

Change-Id: I70153753ccc69597dc2c69133b3828cd76174468
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 88/30688/2
Tibor Frank [Tue, 12 Jan 2021 06:48:31 +0000 (07:48 +0100)]
Report: Add data

Change-Id: I648732e98941b562c31a9db735332bd215d65870
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoMaster: Update of VPP_STABLE_VER files 87/30687/1
Tibor Frank [Tue, 12 Jan 2021 06:03:14 +0000 (07:03 +0100)]
Master: Update of VPP_STABLE_VER files

Change-Id: I87fc785ad934066a6dfa21334f38b16587261c61
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agotests: add 2n1l l2 acl tests, update 2n-tx2 specs 57/30657/7
Juraj Linkeš [Thu, 7 Jan 2021 15:25:31 +0000 (16:25 +0100)]
tests: add 2n1l l2 acl tests, update 2n-tx2 specs

Modify initialize L2BD ACL keywords to be usable for both 2-node and
3-node topologies and update testsuites accordingly.
Add the missing macip T-rex profile.
Add classifier tests to 2n-tx2 job specs.

Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoInfra: Increase shm-size 78/30678/3
pmikus [Mon, 11 Jan 2021 08:33:05 +0000 (08:33 +0000)]
Infra: Increase shm-size

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66

10 months agoReport: Fix plot layout 86/30686/1
Tibor Frank [Mon, 11 Jan 2021 14:40:08 +0000 (15:40 +0100)]
Report: Fix plot layout

Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 85/30685/1
Tibor Frank [Mon, 11 Jan 2021 14:27:31 +0000 (15:27 +0100)]
Report: Add data

Change-Id: Ic584b2340bbaebf5699213358292159518546334
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add Latency graphs with logaritmic x-axis 84/30684/1
Tibor Frank [Mon, 11 Jan 2021 12:20:13 +0000 (13:20 +0100)]
Report: Add Latency graphs with logaritmic x-axis

Change-Id: Ic41b8761aed4256cb3f8ab9d14831e9d2be1598c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agojumpavg: fix setup.py 57/30557/2
Paul Vinciguerra [Wed, 30 Dec 2020 03:17:02 +0000 (22:17 -0500)]
jumpavg: fix setup.py

Fix typo introduced in https://gerrit.fd.io/r/c/csit/+/23465

Signed-off-by: Paul Vinciguerra <pvinci@vinciconsulting.com>
Change-Id: Ie581fd612e7849500e061ac6f56f56b6eb322553

10 months agoReport: Configuration 79/30679/1
Tibor Frank [Mon, 11 Jan 2021 08:49:08 +0000 (09:49 +0100)]
Report: Configuration

Change-Id: Ia1d95d610ede86127797eecd89eb68091d15d54c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Configure report 09/30609/8
Tibor Frank [Tue, 5 Jan 2021 13:12:40 +0000 (14:12 +0100)]
Report: Configure report

Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoansible: remove unused old ARM nomad hosts 59/30659/1
Dave Wallace [Thu, 7 Jan 2021 16:39:15 +0000 (11:39 -0500)]
ansible: remove unused old ARM nomad hosts

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Ie2a653fa46119b5971c58478e306920376a8f874

10 months agofix: use csit lts branch in vpp-csit lts jobs 08/30608/4
Jan Gelety [Mon, 21 Dec 2020 23:22:48 +0000 (00:22 +0100)]
fix: use csit lts branch in vpp-csit lts jobs

Change-Id: Iebd62fd6b0c798f7b4dd1f3b093c156e533b3900
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoSet DPDK version to 20.11 53/30653/1
Tibor Frank [Thu, 7 Jan 2021 06:38:15 +0000 (07:38 +0100)]
Set DPDK version to 20.11

Change-Id: I6f95ad79c891def175dcbc778d26ced0ec84f799
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agofix: geneve 19/30519/7
Jan Gelety [Fri, 18 Dec 2020 22:24:12 +0000 (23:24 +0100)]
fix: geneve

Change-Id: I23541e1c07a42b4baa560c343ffeed3b963fe694
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoAPI: deprecated COP APIs 67/30567/11
Tomas Alexy [Mon, 4 Jan 2021 09:15:51 +0000 (10:15 +0100)]
API: deprecated COP APIs

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64

10 months agoGSO: TAP/VHOST use case 10/29210/72
pmikus [Fri, 2 Oct 2020 05:48:34 +0000 (05:48 +0000)]
GSO: TAP/VHOST use case

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibafaaca4438587284d1e255c764f0701002941e8

10 months agoUpdate of VPP_STABLE_VER files 62/30562/2
Tibor Frank [Mon, 4 Jan 2021 07:27:34 +0000 (08:27 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.06-rc0~40-g17672aa49

 - use new vpp ref build - centos8:
   21.06-rc0~40_g17672aa49~b505

Change-Id: I025b906b730fe3f3c8fbbd5455bc2ca8a58f721f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoFIX: AWK NIC replace in case of x520 65/30565/1
pmikus [Mon, 4 Jan 2021 08:00:55 +0000 (08:00 +0000)]
FIX: AWK NIC replace in case of x520

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d83ba048e0609d6b8623fab5c2960e48a37c023

10 months agoReport: Remove GBP tests 24/29524/8
Tibor Frank [Mon, 19 Oct 2020 08:37:33 +0000 (10:37 +0200)]
Report: Remove GBP tests

- only in master

Change-Id: I111c7d425d8693e8baf54892c3ecd384c99477c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agojob_specs: add 2x-tx2 job specs 37/30537/1
Juraj Linkeš [Tue, 22 Dec 2020 10:12:19 +0000 (11:12 +0100)]
job_specs: add 2x-tx2 job specs

Add job specs for the new 2n-tx2 performance testbed.

Change-Id: Ife1db4caba3ad17286727fed143e0c0556c4a2a4
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
11 months agoFramework: add 2n-tx2 perf testbed 80/30480/5
Juraj Linkeš [Fri, 18 Dec 2020 12:07:16 +0000 (13:07 +0100)]
Framework: add 2n-tx2 perf testbed

Add testbed file and make code changes in common.sh.

Change-Id: I493bb92db3c66358afa81ec81bcd99b296f49c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
11 months agoUpdate of VPP_STABLE_VER files 94/30494/1
Jan Gelety [Fri, 18 Dec 2020 18:19:02 +0000 (19:19 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.06-rc0~14-gac9a585c6

 - use new vpp ref build - centos8:
   21.06-rc0~14_gac9a585c6~b240

Change-Id: Ic82d57625de00fb89390150683284aa68ca905ce
Signed-off-by: Jan Gelety <jgelety@cisco.com>
11 months agoFramework: 3n-tsh topology file update 73/30473/4
Juraj Linkeš [Fri, 18 Dec 2020 08:47:56 +0000 (09:47 +0100)]
Framework: 3n-tsh topology file update

The TG is now shared, update port and user accordingly.

Change-Id: I8be4f41887498ae42935b7ab22a7f22dc21e6b50
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
11 months agoKeep robot example lines short 84/30184/3
Vratko Polak [Fri, 18 Dec 2020 14:58:13 +0000 (15:58 +0100)]
Keep robot example lines short

Do not expand argument expressions into actual verbose values.

Change-Id: I3d86cd826e9cd03cefefe2e197250f76414ac101
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoAPI: deprecated bond APIs 22/30422/6
Jan Gelety [Fri, 11 Dec 2020 05:03:31 +0000 (06:03 +0100)]
API: deprecated bond APIs

Jira: CSIT-1597

Change-Id: I77b746584851331d46eca1caafd4468d18f1e78d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
11 months agoFIX: Backward compatibility include selection 70/30470/2
pmikus [Fri, 18 Dec 2020 06:38:48 +0000 (06:38 +0000)]
FIX: Backward compatibility include selection

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ieff60a44d42d66acee8ba1680e7e285d6cd01bc9

11 months agoPAPI: Cache connected client instances 79/30179/48
Vratko Polak [Tue, 15 Dec 2020 12:39:56 +0000 (13:39 +0100)]
PAPI: Cache connected client instances

Disconnect+connect cycle is expensive and slow.
This change tracks connected client instances
so later "connect" to the same target uses it.

Explicit disconnects are allowed (and executed before VPP ends),
but once again disconnected instances are cached and reused,
as creating a new instance is more expensive than just connect.

+ Add missing checks on interfaces being up to appropriate keyword.
 + Use appropriate keywords.
 + Add a comment explaining why a simpler keyword is not appropriate.
+ Improve VPP checks in containers.
 + Fix the vppctl check to actually work.
 + Add PAPI check to ensure VPP is really ready.
 + Delay/reorder checks to make them faster with multiple containers.
 + Leave some TODOs to improve various lifecycles later.
+ As we do not stop VPP in test/suite teardown:
 + One final disconnect is needed, added to __init__.robot teardowns.
 - Import of the final disconnect keyword is ugly, but it works.
- We could use a hashable class for distinguishing node+socket pairs.
- Are we connecting to VPP inside VMs?

Change-Id: I49cd726740c3e8cae1591c7c84b85a447241228f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>