Tibor Frank [Fri, 5 Feb 2021 09:44:24 +0000 (10:44 +0100)]
Report: Set range of x-axis for latency graphs, add data
Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
0c02e000ae58474120246c484cf5458a76510288)
Tibor Frank [Fri, 5 Feb 2021 08:28:48 +0000 (09:28 +0100)]
Trending: RND tests
Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
340c20a3f3908d832ad093349e1ccb14060e8035)
Tibor Frank [Fri, 5 Feb 2021 07:42:12 +0000 (08:42 +0100)]
Report: Add data
Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
f60c0957d9d66a19a05c06e27839401f7ec97829)
Tibor Frank [Thu, 4 Feb 2021 13:19:00 +0000 (14:19 +0100)]
Report: Set the range of x-axis fro Latency graphs
Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
879b31f02fb4df52016d7465e21377121dfbb515)
Tibor Frank [Thu, 4 Feb 2021 08:48:30 +0000 (09:48 +0100)]
Report: Add 2n-clx rnd latency graphs
Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
eecc9da92caae82e9e9a608c41fd0b192780fe4c)
Tibor Frank [Thu, 4 Feb 2021 08:42:42 +0000 (09:42 +0100)]
Report: Add data
Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
2e769b838081d49868ea793f8c38318f5a1a6cef)
Tibor Frank [Thu, 4 Feb 2021 07:16:47 +0000 (08:16 +0100)]
Report: Add data
Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
29ce700b9cf1a6b275f13fc3975991289b062e53)
Tibor Frank [Wed, 3 Feb 2021 16:03:54 +0000 (17:03 +0100)]
Report: Latency graphs
Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
df3b53935c5db2e53cf8e72ca2ef5be995071e69)
Tibor Frank [Wed, 3 Feb 2021 14:28:56 +0000 (15:28 +0100)]
Trending: Add IPv4 and IPv6 rnd tests
Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
38b98cea69a149ac5b1be23f0dbad79e7e1cb01c)
Tibor Frank [Wed, 3 Feb 2021 06:30:41 +0000 (07:30 +0100)]
Report: Add RND Latency graphs, add data
Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
b5073afc4a941ea33ce874e016fe86384ae7a60d)
Tibor Frank [Tue, 2 Feb 2021 20:58:16 +0000 (21:58 +0100)]
Report: Fix spec
Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
9387a7bd3187faa7c1e75daa084bda5564c74d94)
Tibor Frank [Tue, 2 Feb 2021 20:36:52 +0000 (21:36 +0100)]
Report: Add RND tests
Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
50a4e5e45f5e6e18f2dac6aee69adb85ef4d12c4)
Tibor Frank [Tue, 2 Feb 2021 18:05:07 +0000 (19:05 +0100)]
Trending: Fix nat44 tests in NDRPDR trending
Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
45423631acb4ddc58f20fffa096b46724de75ee8)
Tibor Frank [Tue, 2 Feb 2021 11:43:49 +0000 (12:43 +0100)]
Report: Add data
Change-Id: I97bdba256d5886c0ffdd42d4427038bd3b443043
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
b4cc5ae04a3cefa5e4a3b6819003c223299b61b2)
Vratko Polak [Mon, 18 Jan 2021 15:59:42 +0000 (16:59 +0100)]
Add suites with randomized ip6 profiles
+ Replace pair of traffic profiles (2n and 3n) with single nodeless one.
+ Compared to incremental suites, randomized ones add IP6_RND tag.
Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
ad98ea70cf435d104b6a4f0090575e137660da77)
Tibor Frank [Mon, 1 Feb 2021 09:08:25 +0000 (10:08 +0100)]
Report: Synchronize report spec with master
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Iaaa64ad82319a8176bf25693815136851925d38b
Tibor Frank [Mon, 1 Feb 2021 08:52:48 +0000 (09:52 +0100)]
Report: Add 2101.release data
Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
1a82cf21d8ec419543fd46bbce3d64528fbb6bb4)
pmikus [Fri, 29 Jan 2021 13:12:43 +0000 (13:12 +0000)]
Fix: Slack API key
- Clearly we must implement key storage vault to avoid storing key in
.tfstate
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7
(cherry picked from commit
101d3251d3f30f894a9143f8c1062761f3ed8337)
(cherry picked from commit
6b4b75acf819a8a7c68d0f57365bbd6e0b4d3933)
pmikus [Fri, 29 Jan 2021 10:03:46 +0000 (10:03 +0000)]
Fix: Slack key workaround
- Todo: Deploy hashi vault.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad
(cherry picked from commit
993696b15c5f5b63c5d206fd9cc9b32c4af4e2dd)
(cherry picked from commit
3715b48d91e15d0f961963acb641abce67a101d1)
pmikus [Thu, 7 Jan 2021 14:27:38 +0000 (14:27 +0000)]
Infra: Monitoring capability
+ Monitoring SOA
+ Nomad alertmanager job
+ Nomad prometheus job
+ Nomad grafana job
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2
(cherry picked from commit
a44eef233de959c5679602dc6cd1ed866d6abc14)
(cherry picked from commit
2856c0a0c19319de146a93c27e106351faf1926c)
(cherry picked from commit
6717a3bc8b5fb81c1a19964fd367878230331457)
pmikus [Thu, 28 Jan 2021 08:47:01 +0000 (08:47 +0000)]
Infra: Remove Consul TLS on clients (Nomad conflict)
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf
(cherry picked from commit
474163bc78aa418595b227c81056987b1114104d)
(cherry picked from commit
dae934efdf9c773b90cc4a9595d217dd55035561)
(cherry picked from commit
ba5dcdbecd4c009c832c2a186a58566a5ef4dc81)
pmikus [Thu, 28 Jan 2021 08:37:12 +0000 (08:37 +0000)]
Infra: Remove unwanted terraform output
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a
(cherry picked from commit
6cc6235c7a693d7d4c22bb8a067924372bad6faf)
(cherry picked from commit
95a7a55f4b7f77a1af8ddd8a8088896b7c8bcae5)
pmikus [Thu, 28 Jan 2021 08:24:35 +0000 (08:24 +0000)]
Infra: Terraform vpp_device module
+ Convert to module
+ Fix memory limit
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c
(cherry picked from commit
2afd8f4fe26ae1f1d183ecac8f9daa85f68bc634)
(cherry picked from commit
7c90b6a0f1d0e14f64364d0213e473d447980d05)
(cherry picked from commit
7a760c915e1d905f6cc0b2ef99ad293e3e5e290d)
pmikus [Thu, 28 Jan 2021 07:38:34 +0000 (07:38 +0000)]
Infra: Adjust vpp_device x86 memory layout
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43b3b891b270903419b7fcf132813563306b6e10
(cherry picked from commit
f6882e6231ef0a39d137862d1fb5b75f8eddd9c4)
(cherry picked from commit
d04cbd87772bf94648f130ce356ad53406760485)
(cherry picked from commit
66946b2e17f15f09f03f2c1e646aa8fc844d614b)
pmikus [Thu, 28 Jan 2021 07:22:24 +0000 (07:22 +0000)]
Infra: Align Nomad settings across cluster
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66
(cherry picked from commit
d69b5158e2c4ef0bae7acb1f99c103607a4d7b2a)
(cherry picked from commit
45cb36933587e92ceb901725134d0eaeece82104)
(cherry picked from commit
db5da5b55359cf824ca1a06371622d9094d9cebc)
Tibor Frank [Thu, 28 Jan 2021 05:02:37 +0000 (05:02 +0000)]
rls2101: Update VPP_STABLE_VER files to release version
Change-Id: I1b4ceae9027f2d439c29058f4a19f0a28a698c0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 27 Jan 2021 19:23:53 +0000 (20:23 +0100)]
job-specs: Add rnd tests
Change-Id: I877f46608853401c5226845737ace691e3f393b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
3354bdb7f7c183322c886ab1c89c8f3bbf42366b)
Tibor Frank [Wed, 27 Jan 2021 11:59:44 +0000 (12:59 +0100)]
Report: Add data
Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
d6615bce0d5ac4cb88bbeec584fa7094a6db2c06)
Tibor Frank [Wed, 27 Jan 2021 09:54:59 +0000 (10:54 +0100)]
Report: Fix reconfig graphs
Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
3f8cd3759d371a5ac2df46cfb981cc3a599574ea)
Tibor Frank [Wed, 27 Jan 2021 06:03:01 +0000 (07:03 +0100)]
Report: Improve reconf graphs
Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
7d7ec5e661abec4dda2546843addf1a71580e97e)
Tibor Frank [Tue, 26 Jan 2021 13:56:27 +0000 (14:56 +0100)]
Trending: Add GENEVE tests
Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
5e996684dd0c95089256631c696e4fb9e72e21a2)
Tibor Frank [Tue, 26 Jan 2021 13:20:23 +0000 (14:20 +0100)]
Report: Add GENEVE tests
Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
1e3c01e0e458d62ed228e8d6a916c24992304252)
Tibor Frank [Mon, 25 Jan 2021 13:34:27 +0000 (13:34 +0000)]
rls2101: Update VPP_STABLE_VER files
Change-Id: I4db975fab589594f7551217b64adfe13cf628f65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 25 Jan 2021 08:45:06 +0000 (09:45 +0100)]
Report: Add data
Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
88bbb1908b4aa58163374c983b4b8e85e78460d5)
Vratko Polak [Thu, 21 Jan 2021 11:44:11 +0000 (12:44 +0100)]
Hdrh latency graphs: Do not skip the last value
Linear x axis does not need any skipping.
For logarithmic axis, descrease from 100% to avoid infinity.
Currently using a fixed PERCENTILE_MAX value.
Added a comment on when to change that value.
Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
d4f12e6931c7fdf84043d8fb2f71e2f38965f26b)
Jan Gelety [Mon, 11 Jan 2021 01:34:17 +0000 (02:34 +0100)]
Report: add geneve to perf release notes
Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
67d3b2a44d49dd2c4a1b2f722849f57432787137)
Tibor Frank [Fri, 22 Jan 2021 11:25:19 +0000 (12:25 +0100)]
Report: Add data
Change-Id: I1d5031780b1bef169509058233e02624d7afecb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
0c489b1767a031837f320c1fb5e45947ac82ea4d)
Jan Gelety [Sun, 10 Jan 2021 20:56:40 +0000 (21:56 +0100)]
Report: vpp-device release notes
Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
7b9b65a3af83267a4e6a36fc98996aaa05060a87)
Vratko Polak [Thu, 21 Jan 2021 10:15:56 +0000 (11:15 +0100)]
Reconf: Fix bidir/unidir mismatch
Results if NDR search is in TPS (so unidir) since
https://gerrit.fd.io/r/c/csit/+/28208
The bug was causing all reconf tests report zero loss,
as they used half of NDR load during reconfiguration.
+ Small improvements to descriptions of other traffic keywords.
Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
293a88b56179094f655178b838b84844a672390d)
Tibor Frank [Thu, 21 Jan 2021 06:09:02 +0000 (07:09 +0100)]
Trending: Fix bugs in 2n-tx2
Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
7f7f2fd7363637d0da626a28bb8a0b357d314a9d)
Tibor Frank [Thu, 21 Jan 2021 09:25:33 +0000 (10:25 +0100)]
Report: Add data
Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
9e08f1dfb125d092a48f92c764f52ae97f8a9995)
Tibor Frank [Tue, 19 Jan 2021 19:12:09 +0000 (20:12 +0100)]
Trending: Add 2n-tx2
Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
3fc6ce9f08f0a1c1293dfc032fdddfe5e3f7eb16)
Martin Balaz [Thu, 10 Sep 2020 16:18:48 +0000 (18:18 +0200)]
acl: add L2BD dev tests
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
0f3baca2366f969de6b5d3b889c1b05f72995ec2)
Jan Gelety [Sun, 10 Jan 2021 13:34:01 +0000 (14:34 +0100)]
job_specs: add geneve tests
Geneve tests added to report_iterative and report_coverage job
specifications.
- tests with 1024 geneve tunnels added only to report_coverage jobs
until fast PAPI is finished
Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
3d0d137bf45e1cd3c7aa06480f5ea08175a6df01)
Vratko Polak [Mon, 18 Jan 2021 13:35:17 +0000 (14:35 +0100)]
Tox: Improve tox.ini
Just stylistic improvements, no functional change.
+ Use "ignore_outcome = true" instead of "|| true".
+ Document and apply recommended ordering within testenv definition.
+ Fix some typos.
Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
52a39f861bb645831130ef109a14e629be9bde7a)
Tibor Frank [Wed, 20 Jan 2021 08:16:08 +0000 (09:16 +0100)]
Report: Add data
Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
216c68cc8b010642c4de21673b7d8e18006767e2)
Tibor Frank [Tue, 19 Jan 2021 18:00:47 +0000 (19:00 +0100)]
Report: Add ip6 latency graphs
Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
5e0fe5a28969dfc9fe36415a065122a668d5a273)
Tibor Frank [Tue, 19 Jan 2021 12:26:34 +0000 (13:26 +0100)]
Report: Add data, 2n-tx2 latency graphs
Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
4bc1e70ad02b198a7b9ea32b72da3ae98978e8c5)
Vratko Polak [Tue, 19 Jan 2021 11:04:08 +0000 (12:04 +0100)]
Job specs: Add some ipsec reconf to iterative
We now have more time for 3n-hsw testbeds.
Added only scales of 4, 1000 and 60000 tunnels.
Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
be5833232791a24921e7e9695e53efcbd7ff248e)
Tibor Frank [Tue, 19 Jan 2021 06:12:35 +0000 (07:12 +0100)]
Report: Add data
Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
f5863d6213bf0066b9647a7dde10d56bd7260f80)
Vratko Polak [Wed, 13 Jan 2021 18:38:50 +0000 (19:38 +0100)]
Random flows: Use seeds again and increase limit.
TRex does mix seeds when distributing over workers,
but it is multiplicative [0], so zero is the only bad value.
Limit restricts the cycle length of PRNG (by resetting [1] the seed).
We want the cycle as long as possible.
[0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616
[1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314
Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
eedb7dff222d2590ac2cb5a5e67dc7d90317f05c)
Tibor Frank [Mon, 18 Jan 2021 14:31:20 +0000 (15:31 +0100)]
2101: Update VPP_STABLE_VER_ files
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ica196e6a309e4dc2fdfb51b7faed72a627311991
Tibor Frank [Mon, 18 Jan 2021 15:30:28 +0000 (16:30 +0100)]
Report: Remove slider for Latency graphs
Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
69264aed8d43f3c4a8342dd7584f80336108c879)
Tibor Frank [Mon, 18 Jan 2021 13:57:45 +0000 (14:57 +0100)]
Report: Fix specification
Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
4d04d11497eb87f94d6ac4982e4b17ae0f48d811)
Tibor Frank [Mon, 18 Jan 2021 13:52:38 +0000 (14:52 +0100)]
job-specs: Fix hoststack
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
e4d7b3b4d4185e97443830e7e9fb0f570031a376)
Tibor Frank [Mon, 18 Jan 2021 09:43:14 +0000 (10:43 +0100)]
Report: Add data, add 2n-tx2
Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
caef25a1412689fc0906e024e9b26c547ecfc5bd)
Juraj Linkeš [Fri, 15 Jan 2021 12:09:43 +0000 (13:09 +0100)]
Report: add 2n-tx2 static content
Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit
7f0abbb8f56342fc09b09beb47661f4d55b7eb62)
Vratko Polak [Thu, 14 Jan 2021 12:34:08 +0000 (13:34 +0100)]
PAL: Improve latency graphs
Previously, they used sloped lines connecting reported points.
But HdrHistogram reports only the upper bound of percentile.
Example: If all samples are 10us,
HdrHistogram reports a single value at 100%.
This change attempts to show the whole intervals (0%-100% for the example)
as a series (vertically connected) of horizontal lines.
Hover also shows percentiles as intervals.
Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
826d80373dbd20bc1feac2403e9cade9e5633336)
Vratko Polak [Thu, 14 Jan 2021 15:08:25 +0000 (16:08 +0100)]
Add 3n ip4-rnd tests
+ Rename traffic profiles to avoid mentioning number of nodes.
+ Improve 2n rnd suite documentation slightly.
This is a manual cherry-pick of https://gerrit.fd.io/r/c/csit/+/27679
Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 13 Jan 2021 09:02:51 +0000 (10:02 +0100)]
License: Update block replacer
... so it replaces also long (older) form of GPL license.
This way replacing to apache and back ensures GPL has (newer) short form.
Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
193fc1732fdacf424d36bbb979037ba261457cb4)
Vratko Polak [Tue, 12 Jan 2021 16:22:01 +0000 (17:22 +0100)]
License: Wrap GPL block to 80 characters
The original license block was adapted from
https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts
resulting in a line longer than 80 chars,
but those are reported (although not blocked) by tox verify job.
As the text from wiki was not used in verbatim
(it uses c-style comment block),
minor formatting change like this should not be a big deal.
+ Bump copyright year.
Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
624e580159dc056035d7e962582e86a000f8c3d6)
Jan Gelety [Thu, 3 Dec 2020 15:22:41 +0000 (16:22 +0100)]
perf: GENEVE tunnel test, l3 mode
Jira: CSIT-1768
Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
6962831a1f1905e50a3d663c0cf3ce8c2873ecc9)
Change-Id: I6496ae773b176b2abfedab843110d6f870c62888
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Thu, 14 Jan 2021 06:16:03 +0000 (07:16 +0100)]
2101: Update the stable ver files to rc2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ibec19f45e307af8b6c92d76ed0da126650973c3b
Tibor Frank [Thu, 14 Jan 2021 06:38:16 +0000 (07:38 +0100)]
Report: Add data
Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
ef5c30213bb28824a55f4ebbcade6410ee8d2461)
Juraj Linkeš [Wed, 13 Jan 2021 16:00:58 +0000 (17:00 +0100)]
job_specs: fix 2n-tx2 ip6 iacldst job specs
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit
55eb33d7469ec635755d0942c74ff798f9f3d498)
Tibor Frank [Wed, 13 Jan 2021 15:18:03 +0000 (16:18 +0100)]
Report: Fix plots
Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
81958d4bc5ec4803be0726d94564680e2a0f9a5c)
Juraj Linkeš [Wed, 13 Jan 2021 14:40:55 +0000 (15:40 +0100)]
job_specs: update 2n-tx2 coverage specs
Start out with l2, l3, classifier and acl tests.
Change-Id: I8fc390c77e410e4f4832b4412114253dd34a5fbb
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Wed, 13 Jan 2021 13:47:55 +0000 (14:47 +0100)]
Report: Add data
Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
98a94315dae63bd19c7bc16ce50b3219386aa34c)
Tibor Frank [Wed, 13 Jan 2021 06:50:35 +0000 (07:50 +0100)]
Report: Add data
Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
7a26d43c4f71869695ba19ce58f9afac9a1d176d)
Tibor Frank [Tue, 12 Jan 2021 11:58:01 +0000 (12:58 +0100)]
Report: Add data
Change-Id: I70153753ccc69597dc2c69133b3828cd76174468
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
1899cf849e938512df8bac9ea7cb6479732dda42)
Tibor Frank [Tue, 12 Jan 2021 10:15:56 +0000 (10:15 +0000)]
Add 2n-tx2 job specs
Change-Id: I992c1466b2226337a043b46e1bdba82de2dc2368
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 12 Jan 2021 06:48:31 +0000 (07:48 +0100)]
Report: Add data
Change-Id: I648732e98941b562c31a9db735332bd215d65870
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
1b141f8090e9b067dce9d182a81aa530213d4a66)
Juraj Linkeš [Thu, 7 Jan 2021 15:25:31 +0000 (16:25 +0100)]
tests: add 2n1l l2 acl tests, update 2n-tx2 specs
Modify initialize L2BD ACL keywords to be usable for both 2-node and
3-node topologies and update testsuites accordingly.
Add the missing macip T-rex profile.
Add classifier tests to 2n-tx2 job specs.
Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit
9d510d595f73d26e3f7c6646fa6530e8f252f790)
pmikus [Mon, 11 Jan 2021 08:33:05 +0000 (08:33 +0000)]
Infra: Increase shm-size
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66
(cherry picked from commit
2f4b14bc83437afcc242190a121ba47a6d10bd09)
Tibor Frank [Mon, 11 Jan 2021 14:40:08 +0000 (15:40 +0100)]
Report: Fix plot layout
Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
fa0e6315e4db3d96b281fb7467a9416150c0bc9f)
Tibor Frank [Mon, 11 Jan 2021 14:27:31 +0000 (15:27 +0100)]
Report: Add data
Change-Id: Ic584b2340bbaebf5699213358292159518546334
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
e7c71f5e3de89d0e9f0b6d5d0ee099e1ee97c2db)
pmikus [Fri, 18 Dec 2020 06:38:48 +0000 (06:38 +0000)]
FIX: Backward compatibility include selection
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ieff60a44d42d66acee8ba1680e7e285d6cd01bc9
(cherry picked from commit
e62ade12b7c9918cda2d363387ed0f517aa9840d)
Tibor Frank [Mon, 11 Jan 2021 12:20:13 +0000 (13:20 +0100)]
Report: Add Latency graphs with logaritmic x-axis
Change-Id: Ic41b8761aed4256cb3f8ab9d14831e9d2be1598c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
b370b24ad548c2caba20fcfd1c4796416d829c7a)
Tibor Frank [Mon, 11 Jan 2021 08:49:08 +0000 (09:49 +0100)]
Report: Configuration
Change-Id: Ia1d95d610ede86127797eecd89eb68091d15d54c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
5dd28c508cf6f04dee46580c73272c2cb31f5831)
Tibor Frank [Tue, 5 Jan 2021 13:12:40 +0000 (14:12 +0100)]
Report: Configure report
Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
fc3f7fa58880d2327c3364bbcf8338d2256fb8f0)
Vratko Polak [Tue, 15 Dec 2020 12:39:56 +0000 (13:39 +0100)]
PAPI: Cache connected client instances
Disconnect+connect cycle is expensive and slow.
This change tracks connected client instances
so later "connect" to the same target uses it.
Explicit disconnects are allowed (and executed before VPP ends),
but once again disconnected instances are cached and reused,
as creating a new instance is more expensive than just connect.
+ Add missing checks on interfaces being up to appropriate keyword.
+ Use appropriate keywords.
+ Add a comment explaining why a simpler keyword is not appropriate.
+ Improve VPP checks in containers.
+ Fix the vppctl check to actually work.
+ Add PAPI check to ensure VPP is really ready.
+ Delay/reorder checks to make them faster with multiple containers.
+ Leave some TODOs to improve various lifecycles later.
+ As we do not stop VPP in test/suite teardown:
+ One final disconnect is needed, added to __init__.robot teardowns.
- Import of the final disconnect keyword is ugly, but it works.
- We could use a hashable class for distinguishing node+socket pairs.
- Are we connecting to VPP inside VMs?
Change-Id: I49cd726740c3e8cae1591c7c84b85a447241228f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
a33b52ae0f255021d89307ebc694f6e907906151)
Tibor Frank [Thu, 7 Jan 2021 06:38:15 +0000 (07:38 +0100)]
Set DPDK version to 20.11
Change-Id: I6f95ad79c891def175dcbc778d26ced0ec84f799
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
4e2347f3996290fbc2386938791c2f272d052c63)
pmikus [Tue, 5 Jan 2021 08:56:03 +0000 (08:56 +0000)]
Infra: Ansible sync
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ida73c8acab94ad334fe57bb52f4dab33c40dded6
Jan Gelety [Fri, 18 Dec 2020 22:24:12 +0000 (23:24 +0100)]
fix: geneve
Change-Id: I23541e1c07a42b4baa560c343ffeed3b963fe694
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
d7a3262b58c86868a18c29244f29196203e1eb39)
Tomas Alexy [Mon, 4 Jan 2021 09:15:51 +0000 (10:15 +0100)]
API: deprecated COP APIs
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64
(cherry picked from commit
9446b9bf9c15999feec3c8a48fec428bca094500)
pmikus [Fri, 2 Oct 2020 05:48:34 +0000 (05:48 +0000)]
GSO: TAP/VHOST use case
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibafaaca4438587284d1e255c764f0701002941e8
(cherry picked from commit
44dcb3113c8ade2e44543746abca861a89362c9b)
Tibor Frank [Mon, 4 Jan 2021 07:49:58 +0000 (08:49 +0100)]
2101: Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
21.01-rc1~
3-gf097300c2
- use new vpp ref build - centos8:
21.01-rc1~3_gf097300c2~b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I3c3d62cf1dcfab38075387c496b6849d790f53b1
pmikus [Mon, 4 Jan 2021 08:00:55 +0000 (08:00 +0000)]
FIX: AWK NIC replace in case of x520
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d83ba048e0609d6b8623fab5c2960e48a37c023
(cherry picked from commit
3c3930b9f6f9a40d6b30f6e56e8c40279e34f650)
pmikus [Thu, 17 Dec 2020 08:34:58 +0000 (08:34 +0000)]
Switch include to test
+ Reduce time overhead when parsing --include vs --test
+ Input files will remain the same
+ 3n-hsw 150include ~24min, 150test ~5min
+ 2n-clx 489include ~61min, 489test ~9min
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7e5957c32385aecbc4551bd124da41afa5bc63c9
Juraj Linkeš [Fri, 18 Dec 2020 12:07:16 +0000 (13:07 +0100)]
Framework: add 2n-tx2 perf testbed
Add testbed file and make code changes in common.sh.
Change-Id: I493bb92db3c66358afa81ec81bcd99b296f49c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit
7aa013cf087993ca4546fd7988e177d43cfedfaf)
Jan Gelety [Fri, 11 Dec 2020 05:03:31 +0000 (06:03 +0100)]
API: deprecated bond APIs
Jira: CSIT-1597
Change-Id: I77b746584851331d46eca1caafd4468d18f1e78d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
925b50c85a24b3c91031d09eeca19f17b4e01f2c)
Jan Gelety [Fri, 18 Dec 2020 18:40:24 +0000 (19:40 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
21.01-rc1~
2-gda45810ce
- use new vpp ref build - centos8:
21.01-rc1~2_gda45810ce~b5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Ib9468d5ceb0bee5cf347d2f603536e5fbefb3563
Juraj Linkeš [Fri, 18 Dec 2020 08:47:56 +0000 (09:47 +0100)]
Framework: 3n-tsh topology file update
The TG is now shared, update port and user accordingly.
Change-Id: I8be4f41887498ae42935b7ab22a7f22dc21e6b50
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit
1d6448f6c2eea55ec82694b30d6d5081ff631482)
Jan Gelety [Fri, 11 Dec 2020 16:09:03 +0000 (17:09 +0100)]
Update of VPP_REPO_URL and VPP_STABLE_VER files
- use vpp builds from vpp stable/2101 branch
- use new vpp ref build - ubuntu 18.04:
21.01-rc1~
0-g9dab7b941
- use new vpp ref build - centos8:
21.01-rc1~0_g9dab7b941~b3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Iad5b328871062f1a476c648322132deb6fcc234b
Jan Gelety [Fri, 11 Dec 2020 13:57:28 +0000 (14:57 +0100)]
API: deprecated nsim APIs
Jira: CSIT-1597
Change-Id: Ice342d6cb7cd244d712c42a3d468c851c79739f4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Thu, 26 Nov 2020 14:27:26 +0000 (15:27 +0100)]
API: deprecated IPSEC APIs
Jira: CSIT-1597
+ add ipsec_sa tear down action
Change-Id: I4d1e6f26c14e61e8ddc6f29fbf5528a034c84eb0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Wed, 16 Dec 2020 13:07:42 +0000 (13:07 +0000)]
report: added report static content for new testbed type AMD EPYC Zen2 7532
Change-Id: I9099cce7c4da15a1b3a9aafd37825b284c5ed7fe
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Wed, 16 Dec 2020 06:23:47 +0000 (07:23 +0100)]
Report: Add data
Change-Id: If43441b9e918220a0e16ab5d1fe678e9ee38a89d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Tue, 15 Dec 2020 09:28:01 +0000 (09:28 +0000)]
Terraform: Small fixup in storage templates
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0cefbc62d097b01b1c31739d2049157281e2a671
Tibor Frank [Mon, 14 Dec 2020 07:27:56 +0000 (08:27 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
21.01-rc0~
540-ga8ebb5184
- use new vpp ref build - centos8:
21.01-rc0~540_ga8ebb5184~b437
Change-Id: I1e6d03ec1a01e1586de37015058f9bc70d9a72d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>