csit.git
9 months agoReport: Hide nat44 tput tests 98/31198/1
Tibor Frank [Tue, 9 Feb 2021 14:08:08 +0000 (15:08 +0100)]
Report: Hide nat44 tput tests

Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add latency graphs for NAT44 tput tests 73/31173/1
Tibor Frank [Tue, 9 Feb 2021 10:30:58 +0000 (11:30 +0100)]
Report: Add latency graphs for NAT44 tput tests

Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add NAT44 tput tests 71/31171/1
Tibor Frank [Tue, 9 Feb 2021 06:57:19 +0000 (07:57 +0100)]
Report: Add NAT44 tput tests

Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoreport: Update packet latency methodology 02/31102/4
Maciek Konstantynowicz [Wed, 3 Feb 2021 14:37:01 +0000 (14:37 +0000)]
report: Update packet latency methodology

Change-Id: I0378e96c6f64a1dd035d56465710b82f64dc4d32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
9 months agoFIX: Nic selection 61/31161/2
pmikus [Mon, 8 Feb 2021 11:43:51 +0000 (11:43 +0000)]
FIX: Nic selection

- Buggy unnoticed for quite some time

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa

9 months agoLatency graphs: Do not hardcode x range 59/31159/1
Vratko Polak [Mon, 8 Feb 2021 10:31:57 +0000 (11:31 +0100)]
Latency graphs: Do not hardcode x range

+ Compute it from PERCENTILE_MAX.
+ Use slightly higher PERCENTILE_MAX to avoid rounding errors.
+ Add a comment why slightly higher value is needed.

Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agojob-spec: fix report_coverage/2n-tx2/l2-04.md 57/31157/2
Tibor Frank [Mon, 8 Feb 2021 09:05:10 +0000 (10:05 +0100)]
job-spec: fix report_coverage/2n-tx2/l2-04.md

- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by
  eth-l2bdbasemaclrn-macip-iacl50sl-10kflows

Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 49/31149/3
Tibor Frank [Mon, 8 Feb 2021 08:53:25 +0000 (08:53 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3fbe46788e8b3b5701134e842b4db4583d842214
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoreport: add 2n-tx2 phy testbed diagram and update description 88/31088/3
Maciek Konstantynowicz [Tue, 2 Feb 2021 12:00:21 +0000 (12:00 +0000)]
report: add 2n-tx2 phy testbed diagram and update description

Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
9 months agoTraffic generator: Force ramp-up in next test 29/31129/2
Vratko Polak [Fri, 5 Feb 2021 15:14:27 +0000 (16:14 +0100)]
Traffic generator: Force ramp-up in next test

The behavior was already documented, just not implemented properly.

Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Add data 56/31156/1
Tibor Frank [Mon, 8 Feb 2021 08:41:43 +0000 (09:41 +0100)]
Report: Add data

Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 33/31133/2
Tibor Frank [Fri, 5 Feb 2021 19:36:00 +0000 (20:36 +0100)]
Report: Add data

Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoRevert "Job specs: Add -tput tests to iterative" 45/31145/2
Tibor Frank [Fri, 5 Feb 2021 19:19:04 +0000 (19:19 +0000)]
Revert "Job specs: Add -tput tests to iterative"

This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5.

Reason for revert: Faulty tests, those which are running
take too much time

Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoJob specs: Add -tput tests to iterative 25/31125/2
Vratko Polak [Fri, 5 Feb 2021 12:48:06 +0000 (13:48 +0100)]
Job specs: Add -tput tests to iterative

- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
 + Because ip4base is stateless.
 + So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.

Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Various fixes 26/31126/3
Tibor Frank [Fri, 5 Feb 2021 13:28:06 +0000 (14:28 +0100)]
Report: Various fixes

Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoNAT44ed: Add pure throuhput bidir tests 78/30278/39
Vratko Polak [Fri, 5 Feb 2021 10:46:40 +0000 (11:46 +0100)]
NAT44ed: Add pure throuhput bidir tests

+ With ramp-up, without reset, with session verification.
+ Uses the same profile as pps tests.
+ Ramp up duration is not specified, as duration is computed.
+ Timeout tracking with automated ramp-up.
 + Correct computation of next duration.
 + Checking both early and late sessions.
 + No loss measurement also acts as a ramp-up.
+ Return ReceiveRateMeasurement from send_traffic_on_tg_internal,
  as that is needed for detecting whether trial is ok as ramp up.
- Udp needs quite low ramp-up rate after recent regression.
 - Max scale has higher rate (so failing) to avoid session timeouts.
+ Bump copyright year.

Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Set range of x-axis for latency graphs, add data 24/31124/1
Tibor Frank [Fri, 5 Feb 2021 09:44:24 +0000 (10:44 +0100)]
Report: Set range of x-axis for latency graphs, add data

Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: RND tests 21/31121/1
Tibor Frank [Fri, 5 Feb 2021 08:28:48 +0000 (09:28 +0100)]
Trending: RND tests

Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 20/31120/1
Tibor Frank [Fri, 5 Feb 2021 07:42:12 +0000 (08:42 +0100)]
Report: Add data

Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoInfra: Move probes under ansible instead of terraform 16/31116/4
pmikus [Thu, 4 Feb 2021 13:03:12 +0000 (13:03 +0000)]
Infra: Move probes under ansible instead of terraform

+ More stable probe handling.
+ Naming cleanup due to errors.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bb1237af20636919f869f2eee53597202d00792

9 months agoReport: Set the range of x-axis fro Latency graphs 17/31117/1
Tibor Frank [Thu, 4 Feb 2021 13:19:00 +0000 (14:19 +0100)]
Report: Set the range of x-axis fro Latency graphs

Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 2n-clx rnd latency graphs 09/31109/1
Tibor Frank [Thu, 4 Feb 2021 08:48:30 +0000 (09:48 +0100)]
Report: Add 2n-clx rnd latency graphs

Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 08/31108/1
Tibor Frank [Thu, 4 Feb 2021 08:42:42 +0000 (09:42 +0100)]
Report: Add data

Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 06/31106/1
Tibor Frank [Thu, 4 Feb 2021 07:16:47 +0000 (08:16 +0100)]
Report: Add data

Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Latency graphs 03/31103/9
Tibor Frank [Wed, 3 Feb 2021 16:03:54 +0000 (17:03 +0100)]
Report: Latency graphs

Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUDP_PPS: Ensure keepalive is long enough 06/30006/8
Vratko Polak [Thu, 14 Jan 2021 15:23:05 +0000 (16:23 +0100)]
UDP_PPS: Ensure keepalive is long enough

Previously, it was long enough for the current performance,
but not long enough for the theoretical worst case.

See https://gerrit.fd.io/r/c/csit/+/29803/9/docs/report/introduction/methodology_nat44.rst#293

Change-Id: I3f57a834c77d93b38bca81fdbb714a6374b81bae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoTrending: Add IPv4 and IPv6 rnd tests 99/31099/2
Tibor Frank [Wed, 3 Feb 2021 14:28:56 +0000 (15:28 +0100)]
Trending: Add IPv4 and IPv6 rnd tests

Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoAnsible: Fix package cache updates 86/31086/3
Tomas Alexy [Tue, 2 Feb 2021 11:37:01 +0000 (12:37 +0100)]
Ansible: Fix package cache updates

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I5c7b2636bde999fef3a60e6cbf2b36db9978a74a

9 months agoReport: Add RND Latency graphs, add data 98/31098/1
Tibor Frank [Wed, 3 Feb 2021 06:30:41 +0000 (07:30 +0100)]
Report: Add RND Latency graphs, add data

Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Fix spec 95/31095/1
Tibor Frank [Tue, 2 Feb 2021 20:58:16 +0000 (21:58 +0100)]
Report: Fix spec

Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add RND tests 94/31094/1
Tibor Frank [Tue, 2 Feb 2021 20:36:52 +0000 (21:36 +0100)]
Report: Add RND tests

Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Fix nat44 tests in NDRPDR trending 89/31089/1
Tibor Frank [Tue, 2 Feb 2021 18:05:07 +0000 (19:05 +0100)]
Trending: Fix nat44 tests in NDRPDR trending

Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 87/31087/1
Tibor Frank [Tue, 2 Feb 2021 11:43:49 +0000 (12:43 +0100)]
Report: Add data

Change-Id: I97bdba256d5886c0ffdd42d4427038bd3b443043
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add 2101.release data 29/31029/3
Tibor Frank [Mon, 1 Feb 2021 08:52:48 +0000 (09:52 +0100)]
Report: Add 2101.release data

Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agomaster: Update VPP_STABLE_VER files 58/31058/2
Tibor Frank [Mon, 1 Feb 2021 06:26:02 +0000 (06:26 +0000)]
master: Update VPP_STABLE_VER files

Change-Id: I34b797d9596ac5df3ffb5d5f49e13185e0a8f70e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoFix: Slack API key 22/31022/2
pmikus [Fri, 29 Jan 2021 13:12:43 +0000 (13:12 +0000)]
Fix: Slack API key

- Clearly we must implement key storage vault to avoid storing key in
.tfstate

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7

9 months agoTOI: Update TOI: branches 20/31020/2
Tibor Frank [Fri, 29 Jan 2021 11:29:10 +0000 (12:29 +0100)]
TOI: Update TOI: branches

Change-Id: Ie7fe6fbe58f87243bf502bd14886182fbc11beb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoFix: Slack key workaround 18/31018/1
pmikus [Fri, 29 Jan 2021 10:03:46 +0000 (10:03 +0000)]
Fix: Slack key workaround

- Todo: Deploy hashi vault.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad

9 months agoInfra: Monitoring capability 56/30656/33
pmikus [Thu, 7 Jan 2021 14:27:38 +0000 (14:27 +0000)]
Infra: Monitoring capability

+ Monitoring SOA
  + Nomad alertmanager job
  + Nomad prometheus job
  + Nomad grafana job

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2

9 months agoInfra: Remove Consul TLS on clients (Nomad conflict) 68/30968/1
pmikus [Thu, 28 Jan 2021 08:47:01 +0000 (08:47 +0000)]
Infra: Remove Consul TLS on clients (Nomad conflict)

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf

9 months agoInfra: Remove unwanted terraform output 66/30966/1
pmikus [Thu, 28 Jan 2021 08:37:12 +0000 (08:37 +0000)]
Infra: Remove unwanted terraform output

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a

9 months agoInfra: Terraform vpp_device module 65/30965/1
pmikus [Thu, 28 Jan 2021 08:24:35 +0000 (08:24 +0000)]
Infra: Terraform vpp_device module

+ Convert to module
+ Fix memory limit

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c

9 months agoInfra: Adjust vpp_device x86 memory layout 63/30963/1
pmikus [Thu, 28 Jan 2021 07:38:34 +0000 (07:38 +0000)]
Infra: Adjust vpp_device x86 memory layout

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43b3b891b270903419b7fcf132813563306b6e10

9 months agoInfra: Align Nomad settings across cluster 62/30962/1
pmikus [Thu, 28 Jan 2021 07:22:24 +0000 (07:22 +0000)]
Infra: Align Nomad settings across cluster

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66

9 months agojob-specs: Add rnd tests 57/30957/2
Tibor Frank [Wed, 27 Jan 2021 19:23:53 +0000 (20:23 +0100)]
job-specs: Add rnd tests

Change-Id: I877f46608853401c5226845737ace691e3f393b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 49/30949/1
Tibor Frank [Wed, 27 Jan 2021 11:59:44 +0000 (12:59 +0100)]
Report: Add data

Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Fix reconfig graphs 48/30948/8
Tibor Frank [Wed, 27 Jan 2021 09:54:59 +0000 (10:54 +0100)]
Report: Fix reconfig graphs

Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Improve reconf graphs 45/30945/2
Tibor Frank [Wed, 27 Jan 2021 06:03:01 +0000 (07:03 +0100)]
Report: Improve reconf graphs

Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTrending: Add GENEVE tests 35/30935/2
Tibor Frank [Tue, 26 Jan 2021 13:56:27 +0000 (14:56 +0100)]
Trending: Add GENEVE tests

Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add GENEVE tests 34/30934/3
Tibor Frank [Tue, 26 Jan 2021 13:20:23 +0000 (14:20 +0100)]
Report: Add GENEVE tests

Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoMaster: Update VPP_STABLE_VER files 01/30901/2
Tibor Frank [Mon, 25 Jan 2021 13:30:33 +0000 (13:30 +0000)]
Master: Update VPP_STABLE_VER files

Change-Id: I609d6efcd6934e513521df63aef2c25ac9bbfdea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 21/30921/1
Tibor Frank [Mon, 25 Jan 2021 08:45:06 +0000 (09:45 +0100)]
Report: Add data

Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoHdrh latency graphs: Do not skip the last value 57/30857/5
Vratko Polak [Thu, 21 Jan 2021 11:44:11 +0000 (12:44 +0100)]
Hdrh latency graphs: Do not skip the last value

Linear x axis does not need any skipping.
For logarithmic axis, descrease from 100% to avoid infinity.
Currently using a fixed PERCENTILE_MAX value.
Added a comment on when to change that value.

Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: add geneve to perf release notes 72/30872/2
Jan Gelety [Mon, 11 Jan 2021 01:34:17 +0000 (02:34 +0100)]
Report: add geneve to perf release notes

Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Add data 83/30883/2
Tibor Frank [Fri, 22 Jan 2021 11:25:19 +0000 (12:25 +0100)]
Report: Add data

Change-Id: I1d5031780b1bef169509058233e02624d7afecb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: vpp-device release notes 69/30869/3
Jan Gelety [Sun, 10 Jan 2021 20:56:40 +0000 (21:56 +0100)]
Report: vpp-device release notes

Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoTests: Temporarily disable IPv6 VM test that is randomly failing 80/30880/2
pmikus [Thu, 21 Jan 2021 19:27:02 +0000 (19:27 +0000)]
Tests: Temporarily disable IPv6 VM test that is randomly failing

- To be debugged

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I62ea2427d716f10dbf6af179edfaa41e73952db0

10 months agoReconf: Fix bidir/unidir mismatch 70/30870/3
Vratko Polak [Thu, 21 Jan 2021 10:15:56 +0000 (11:15 +0100)]
Reconf: Fix bidir/unidir mismatch

Results if NDR search is in TPS (so unidir) since
https://gerrit.fd.io/r/c/csit/+/28208

The bug was causing all reconf tests report zero loss,
as they used half of NDR load during reconfiguration.

+ Small improvements to descriptions of other traffic keywords.

Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoTrending: Fix bugs in 2n-tx2 67/30867/2
Tibor Frank [Thu, 21 Jan 2021 06:09:02 +0000 (07:09 +0100)]
Trending: Fix bugs in 2n-tx2

Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 68/30868/1
Tibor Frank [Thu, 21 Jan 2021 09:25:33 +0000 (10:25 +0100)]
Report: Add data

Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTrending: Add 2n-tx2 45/30845/3
Tibor Frank [Tue, 19 Jan 2021 19:12:09 +0000 (20:12 +0100)]
Trending: Add 2n-tx2

Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoacl: add L2BD dev tests 79/28779/6
Martin Balaz [Thu, 10 Sep 2020 16:18:48 +0000 (18:18 +0200)]
acl: add L2BD dev tests

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agojob_specs: add geneve tests 41/30841/5
Jan Gelety [Sun, 10 Jan 2021 13:34:01 +0000 (14:34 +0100)]
job_specs: add geneve tests

Geneve tests added to report_iterative and report_coverage job
specifications.

- tests with 1024 geneve tunnels added only to report_coverage jobs
  until fast PAPI is finished

Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoTox: Improve tox.ini 99/30799/3
Vratko Polak [Mon, 18 Jan 2021 13:35:17 +0000 (14:35 +0100)]
Tox: Improve tox.ini

Just stylistic improvements, no functional change.

+ Use "ignore_outcome = true" instead of "|| true".
+ Document and apply recommended ordering within testenv definition.
+ Fix some typos.

Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoAdd suites with randomized ip6 profiles 42/30442/9
Vratko Polak [Mon, 18 Jan 2021 15:59:42 +0000 (16:59 +0100)]
Add suites with randomized ip6 profiles

+ Replace pair of traffic profiles (2n and 3n) with single nodeless one.
+ Compared to incremental suites, randomized ones add IP6_RND tag.

Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 51/30851/1
Tibor Frank [Wed, 20 Jan 2021 08:16:08 +0000 (09:16 +0100)]
Report: Add data

Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add ip6 latency graphs 43/30843/1
Tibor Frank [Tue, 19 Jan 2021 18:00:47 +0000 (19:00 +0100)]
Report: Add ip6 latency graphs

Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data, 2n-tx2 latency graphs 14/30814/3
Tibor Frank [Tue, 19 Jan 2021 12:26:34 +0000 (13:26 +0100)]
Report: Add data, 2n-tx2 latency graphs

Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoJob specs: Add some ipsec reconf to iterative 13/30813/1
Vratko Polak [Tue, 19 Jan 2021 11:04:08 +0000 (12:04 +0100)]
Job specs: Add some ipsec reconf to iterative

We now have more time for 3n-hsw testbeds.
Added only scales of 4, 1000 and 60000 tunnels.

Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 08/30808/1
Tibor Frank [Tue, 19 Jan 2021 06:12:35 +0000 (07:12 +0100)]
Report: Add data

Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoMaster: Update VPP_STABLE_VER_ files 02/30802/2
Tibor Frank [Mon, 18 Jan 2021 14:24:40 +0000 (15:24 +0100)]
Master: Update VPP_STABLE_VER_ files

Change-Id: I8766254c5cb67afe913facec0477e5ba7550fba0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoRandom flows: Use seeds again and increase limit. 11/27711/29
Vratko Polak [Wed, 13 Jan 2021 18:38:50 +0000 (19:38 +0100)]
Random flows: Use seeds again and increase limit.

TRex does mix seeds when distributing over workers,
but it is multiplicative [0], so zero is the only bad value.

Limit restricts the cycle length of PRNG (by resetting [1] the seed).
We want the cycle as long as possible.

[0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616
[1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314

Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Remove slider for Latency graphs 05/30805/1
Tibor Frank [Mon, 18 Jan 2021 15:30:28 +0000 (16:30 +0100)]
Report: Remove slider for Latency graphs

Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Fix specification 01/30801/3
Tibor Frank [Mon, 18 Jan 2021 13:57:45 +0000 (14:57 +0100)]
Report: Fix specification

Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agojob-specs: Fix hoststack 00/30800/1
Tibor Frank [Mon, 18 Jan 2021 13:52:38 +0000 (14:52 +0100)]
job-specs: Fix hoststack

Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data, add 2n-tx2 98/30798/3
Tibor Frank [Mon, 18 Jan 2021 09:43:14 +0000 (10:43 +0100)]
Report: Add data, add 2n-tx2

Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoPAL: Improve latency graphs 31/30731/5
Vratko Polak [Thu, 14 Jan 2021 12:34:08 +0000 (13:34 +0100)]
PAL: Improve latency graphs

Previously, they used sloped lines connecting reported points.
But HdrHistogram reports only the upper bound of percentile.
Example: If all samples are 10us,
HdrHistogram reports a single value at 100%.

This change attempts to show the whole intervals (0%-100% for the example)
as a series (vertically connected) of horizontal lines.
Hover also shows percentiles as intervals.

Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: add 2n-tx2 static content 77/30777/2
Juraj Linkeš [Fri, 15 Jan 2021 12:09:43 +0000 (13:09 +0100)]
Report: add 2n-tx2 static content

Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoperf: GENEVE tunnel test, l3 mode 56/30356/21
Jan Gelety [Thu, 3 Dec 2020 15:22:41 +0000 (16:22 +0100)]
perf: GENEVE tunnel test, l3 mode

Jira: CSIT-1768

Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Add data 57/30757/2
Tibor Frank [Thu, 14 Jan 2021 06:38:16 +0000 (07:38 +0100)]
Report: Add data

Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoAdd 3n ip4-rnd tests 79/27679/13
Vratko Polak [Wed, 13 Jan 2021 13:49:02 +0000 (14:49 +0100)]
Add 3n ip4-rnd tests

+ Rename traffic profiles to avoid mentioning number of nodes.
+ Improve 2n rnd suite documentation slightly.

Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agojob_specs: fix 2n-tx2 ip6 iacldst job specs 30/30730/1
Juraj Linkeš [Wed, 13 Jan 2021 16:00:58 +0000 (17:00 +0100)]
job_specs: fix 2n-tx2 ip6 iacldst job specs

Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoReport: Fix plots 29/30729/1
Tibor Frank [Wed, 13 Jan 2021 15:18:03 +0000 (16:18 +0100)]
Report: Fix plots

Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agojob_specs: update 2n-tx2 coverage specs 25/30725/2
Juraj Linkeš [Wed, 13 Jan 2021 11:55:04 +0000 (12:55 +0100)]
job_specs: update 2n-tx2 coverage specs

Start out with l2, l3, classifier and acl tests.

Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoDocs: TOI - How to create branches 28/30328/14
Tibor Frank [Mon, 7 Dec 2020 12:17:58 +0000 (13:17 +0100)]
Docs: TOI - How to create branches

Change-Id: I7588d7ac7a0200df5b660ffbc31f7c2496496d06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 27/30727/1
Tibor Frank [Wed, 13 Jan 2021 13:47:55 +0000 (14:47 +0100)]
Report: Add data

Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoLicense: Update block replacer 94/30694/5
Vratko Polak [Wed, 13 Jan 2021 09:02:51 +0000 (10:02 +0100)]
License: Update block replacer

... so it replaces also long (older) form of GPL license.
This way replacing to apache and back ensures GPL has (newer) short form.

Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 20/30720/3
Tibor Frank [Wed, 13 Jan 2021 06:50:35 +0000 (07:50 +0100)]
Report: Add data

Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoLicense: Wrap GPL block to 80 characters 92/30692/2
Vratko Polak [Tue, 12 Jan 2021 16:22:01 +0000 (17:22 +0100)]
License: Wrap GPL block to 80 characters

The original license block was adapted from
https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts
resulting in a line longer than 80 chars,
but those are reported (although not blocked) by tox verify job.

As the text from wiki was not used in verbatim
(it uses c-style comment block),
minor formatting change like this should not be a big deal.

+ Bump copyright year.

Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 91/30691/1
Tibor Frank [Tue, 12 Jan 2021 11:58:01 +0000 (12:58 +0100)]
Report: Add data

Change-Id: I70153753ccc69597dc2c69133b3828cd76174468
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 88/30688/2
Tibor Frank [Tue, 12 Jan 2021 06:48:31 +0000 (07:48 +0100)]
Report: Add data

Change-Id: I648732e98941b562c31a9db735332bd215d65870
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoMaster: Update of VPP_STABLE_VER files 87/30687/1
Tibor Frank [Tue, 12 Jan 2021 06:03:14 +0000 (07:03 +0100)]
Master: Update of VPP_STABLE_VER files

Change-Id: I87fc785ad934066a6dfa21334f38b16587261c61
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agotests: add 2n1l l2 acl tests, update 2n-tx2 specs 57/30657/7
Juraj Linkeš [Thu, 7 Jan 2021 15:25:31 +0000 (16:25 +0100)]
tests: add 2n1l l2 acl tests, update 2n-tx2 specs

Modify initialize L2BD ACL keywords to be usable for both 2-node and
3-node topologies and update testsuites accordingly.
Add the missing macip T-rex profile.
Add classifier tests to 2n-tx2 job specs.

Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoInfra: Increase shm-size 78/30678/3
pmikus [Mon, 11 Jan 2021 08:33:05 +0000 (08:33 +0000)]
Infra: Increase shm-size

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66

10 months agoReport: Fix plot layout 86/30686/1
Tibor Frank [Mon, 11 Jan 2021 14:40:08 +0000 (15:40 +0100)]
Report: Fix plot layout

Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 85/30685/1
Tibor Frank [Mon, 11 Jan 2021 14:27:31 +0000 (15:27 +0100)]
Report: Add data

Change-Id: Ic584b2340bbaebf5699213358292159518546334
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add Latency graphs with logaritmic x-axis 84/30684/1
Tibor Frank [Mon, 11 Jan 2021 12:20:13 +0000 (13:20 +0100)]
Report: Add Latency graphs with logaritmic x-axis

Change-Id: Ic41b8761aed4256cb3f8ab9d14831e9d2be1598c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agojumpavg: fix setup.py 57/30557/2
Paul Vinciguerra [Wed, 30 Dec 2020 03:17:02 +0000 (22:17 -0500)]
jumpavg: fix setup.py

Fix typo introduced in https://gerrit.fd.io/r/c/csit/+/23465

Signed-off-by: Paul Vinciguerra <pvinci@vinciconsulting.com>
Change-Id: Ie581fd612e7849500e061ac6f56f56b6eb322553

10 months agoReport: Configuration 79/30679/1
Tibor Frank [Mon, 11 Jan 2021 08:49:08 +0000 (09:49 +0100)]
Report: Configuration

Change-Id: Ia1d95d610ede86127797eecd89eb68091d15d54c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Configure report 09/30609/8
Tibor Frank [Tue, 5 Jan 2021 13:12:40 +0000 (14:12 +0100)]
Report: Configure report

Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62
Signed-off-by: Tibor Frank <tifrank@cisco.com>