csit.git
2 years agoPAL: Fix heatmap graph 22/34422/1
Tibor Frank [Wed, 10 Nov 2021 10:58:53 +0000 (11:58 +0100)]
PAL: Fix heatmap graph

Change-Id: I4992c8f4ae63aa25794cdab98532722c45263e8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 80e8f662317324156f9997e788f7ed2ae46401f8)

2 years agoReport: Fixes in dynamic content 21/34421/1
Tibor Frank [Wed, 10 Nov 2021 10:47:51 +0000 (11:47 +0100)]
Report: Fixes in dynamic content

Change-Id: If90ba8c66427061341888dcfc946450efe66010b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 89eb19f67d91a4aa535fb95ece3f26381dddfc28)

2 years agoreport: update to vpp performance release notes 20/34420/1
Maciek Konstantynowicz [Tue, 9 Nov 2021 19:13:17 +0000 (19:13 +0000)]
report: update to vpp performance release notes

Change-Id: I170d14555b21e91d0ce1f11ea3f2911e8b01341c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7e22de2de8ef461b56d2b76f99601aa63814173b)

2 years agoReport: Add data 19/34419/1
Tibor Frank [Wed, 10 Nov 2021 06:00:32 +0000 (07:00 +0100)]
Report: Add data

Change-Id: Ib00909a62739e488ad809463c08cec14b4b96e91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c5f202b8fa105fa8701fae26d04b808c7529e33a)

2 years agoReport: Add data 18/34418/1
Tibor Frank [Tue, 9 Nov 2021 16:39:38 +0000 (17:39 +0100)]
Report: Add data

Change-Id: I21eedf3ecabe0672daaaf87819960cd986420fa0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c566bbd1d659ed022fea08f7bd38326661779c8c)

2 years agoReport: 2n-icx: disable elements without data 17/34417/1
Tibor Frank [Tue, 9 Nov 2021 16:27:51 +0000 (17:27 +0100)]
Report: 2n-icx: disable elements without data

Change-Id: Id908e094129e6becd70a63667ebe61a6433db07e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b4bea99de7dce5f3fbfbdffdc29958f4d6dc5618)

2 years agoReport: Add 2n-icx, part 2 55/34355/1
Tibor Frank [Tue, 9 Nov 2021 13:42:00 +0000 (14:42 +0100)]
Report: Add 2n-icx, part 2

- packet throughput
- speedup
- latency

Change-Id: If871dcc1888e7a49ac2fd2ba8e3632a87fa035bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 814cbec925be525dc328374fee458d9207d3d5e3)

2 years agoreport: edits in aws methodology section 54/34354/1
Maciek Konstantynowicz [Mon, 8 Nov 2021 21:17:53 +0000 (21:17 +0000)]
report: edits in aws methodology section

Edits include:
- add description of used testbed topologies.
- cleaned up references.
- other editing nits.

Change-Id: I43069541f3da8e844529a00a127fb1a360197647
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 531215332c4b4374a5cd7e1317de506f59a7683a)

2 years agoReport: Hide aws latency 53/34353/1
Tibor Frank [Tue, 9 Nov 2021 07:28:17 +0000 (08:28 +0100)]
Report: Hide aws latency

- it is not measured

Change-Id: I1c3d2f629d8ed07a208c37a20642b0e6b336242e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0ab2529c2725c1475845666d4d6ea53882d1eed1)

2 years agoReport: Add data 52/34352/1
Tibor Frank [Tue, 9 Nov 2021 06:57:38 +0000 (07:57 +0100)]
Report: Add data

Change-Id: Iec138a93b18f02046d7c13b7243463048ff695ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c3fdcd39f617a8dffdd1be77ec9113759beeb008)

2 years agoReport: Add aws latency 51/34351/1
Tibor Frank [Mon, 8 Nov 2021 16:31:21 +0000 (17:31 +0100)]
Report: Add aws latency

Change-Id: I0780ddabce015cf1809ea178bf53ab9fc6e18f2d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 49aad5d3e989a49ed33b8a583306041a3c4802e6)

2 years agoReport: Add 2n-icx, part 1 50/34350/1
Tibor Frank [Mon, 8 Nov 2021 14:45:40 +0000 (15:45 +0100)]
Report: Add 2n-icx, part 1

Change-Id: Idf1e56231afa14648d7c3db661eb9a04ef7a5c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5efcddefdcdb47bb1d71a13a18188e539007cc3f)

2 years agoReport: Remove tests removed by 34207 49/34349/1
Tibor Frank [Fri, 5 Nov 2021 13:48:18 +0000 (14:48 +0100)]
Report: Remove tests removed by 34207

Change-Id: Ibe960b8dd4340c2c5b8a01fc490cab906dc330fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4fd081896e3b2e344772184fbd00ae4a189ea875)

2 years agovpp_device: bind to vfio-pci before running tests 88/34388/1
Juraj Linkeš [Tue, 12 Oct 2021 08:03:04 +0000 (10:03 +0200)]
vpp_device: bind to vfio-pci before running tests

In rare cases, binding the whole /dev/vfio folder will result in
unusable VFs:
notice dpdk EAL: Cannot open /dev/vfio/151: Device or resource busy

[0], section 4.3.1. provides some clues as to what's going on and how to
avoid the failure. Mounting /dev/vfio reset the file descriptors of all
devices under /dev/vfio. Vfio-pci creates a device when an interface is
bound to it. The rare failure then occurs when /dev/vfio is mounted
while a process is using the file descriptors result in that process
using invalid file descriptors (or file descriptors belonging to a
different VF).

Fix the issue by binding i40e and ice VFs to vfio-pci before containers
are created and make sure that the VFs are not unbound later in testing.
Only bind DUT VFs since the TG uses the kernel driver.

[0]: https://connect.redhat.com/sites/default/files/2021-03/Cloud Native Network Function Requirements.pdf

Ticket: CSIT-1794

Change-Id: I83db91b29d16669fb034b141ad247f6f796fdf64
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoReport: Add data 45/34345/1
Tibor Frank [Mon, 8 Nov 2021 08:33:31 +0000 (09:33 +0100)]
Report: Add data

Change-Id: I76a36cb19d6c121b1d668d1ff8f71085baa2ed2e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 03e0de0418452c9904dafe74d86e36cf3c2a7289)

2 years agoReport: Small edits in static content. 43/34343/1
Tibor Frank [Fri, 5 Nov 2021 12:30:45 +0000 (13:30 +0100)]
Report: Small edits in static content.

Change-Id: I621e9818cb929c9558c38d41cb4804a19ed2a468
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9dd388775bc42b334223b3a98909e9ee0e663dc7)

2 years agoReport: Add data 42/34342/1
Tibor Frank [Fri, 5 Nov 2021 09:08:23 +0000 (10:08 +0100)]
Report: Add data

Change-Id: Ia1709ebd3543ac4ee5fa63cefa6b18411c3c58f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5a33af45b4618f62ebc8ae131e550481beee2d21)

2 years agoReport: update tables 41/34341/1
Tibor Frank [Thu, 4 Nov 2021 13:20:25 +0000 (14:20 +0100)]
Report: update tables

- statistics
- latency comparison

Change-Id: I84069c26e07ced08bad92e19e6cdb0953cd24d3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4bc35be955ed767b4c50bf5676e9919fb4110833)

2 years agoReport: Add data 40/34340/1
Tibor Frank [Thu, 4 Nov 2021 10:05:37 +0000 (11:05 +0100)]
Report: Add data

Change-Id: I9fce2c74eb564a80b7b7002538376ec6aefaeac2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 902cea84c1688e998867f50f02f3e058e27467a0)

2 years agofix(Docs): Report section updates 38/34338/1
pmikus [Wed, 3 Nov 2021 15:34:22 +0000 (15:34 +0000)]
fix(Docs): Report section updates

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icd04b75d320f067bd66402d5bb499070ee2768f3
(cherry picked from commit e6b2505e14723eaca82204f1f6ef25af4f3e77e7)

2 years agoReport: Add rls data 37/34337/1
Tibor Frank [Wed, 3 Nov 2021 12:08:47 +0000 (13:08 +0100)]
Report: Add rls data

Change-Id: I7868b419fa47c6130826948bbdfbb288abb8d1e4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c4ef85bfbdcf2c73919d8d23a409f02edacf9973)

2 years agojob_specs: add ipsec 40 tunnel sw tests for 3n-skx testbeds 36/34336/1
Maciek Konstantynowicz [Thu, 28 Oct 2021 17:52:09 +0000 (18:52 +0100)]
job_specs: add ipsec 40 tunnel sw tests for 3n-skx testbeds

Change-Id: I4bb79bf34f64b1096be9e81586d718dbe283b3cd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 8cbfb75d12b87fee16955e0937ea8127e5e1f996)

2 years agoRe-adressing ipsec int tests to fit deployment in AWS 84/34184/7
Maros Mullner [Wed, 19 Feb 2020 14:11:10 +0000 (15:11 +0100)]
Re-adressing ipsec int tests to fit deployment in AWS

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I83b00d56a50d98c36547621cb2f41cb3b2f35741
(cherry picked from commit 41bf12b9700f5fe8d7d1ccdd042705f33b19b064)

2 years agoperf: remove depracted ipsec scale reconf test suites 35/34235/1
Maciek Konstantynowicz [Tue, 2 Nov 2021 14:52:38 +0000 (14:52 +0000)]
perf: remove depracted ipsec scale reconf test suites

Remaining ipsec reconf test suites for 40 tunnels include:
- int-aes128cbc-hmac512sha
- int-aes256gcm

Change-Id: I9c5f549368595bb0cbd0d7e9918b7695184d31c4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 4b567a7fe17895812e1d4ac8327f08b8a1653bbb)

2 years agofix(Tests): Hoststack drivers 34/34234/1
pmikus [Wed, 3 Nov 2021 07:30:41 +0000 (07:30 +0000)]
fix(Tests): Hoststack drivers

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If98f575503a59106fe8b94d5c683881412ea4f1c
(cherry picked from commit f83793575f4d9ac462a70eb505b55463dab849df)

2 years agocrypto: remove deprecated ipsec scale perf test suites 32/34232/1
Maciek Konstantynowicz [Wed, 20 Oct 2021 12:23:56 +0000 (13:23 +0100)]
crypto: remove deprecated ipsec scale perf test suites

Remove following test suites:
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: Ib4915213f6c440c70f9b17cbaac834245e51bd85
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 282240ecada68e8a6811996057cfdae222fe1be2)

2 years agofix(autogen): VSAP testcase naming 31/34231/1
pmikus [Tue, 2 Nov 2021 06:44:27 +0000 (06:44 +0000)]
fix(autogen): VSAP testcase naming

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic6d440ffdf7e27c9e6ce65605178163652758f77
(cherry picked from commit 79f23ad3f92341040762a9b0018557e03b306200)

2 years agofix(Autogen): VSAP driver combinations 29/34229/1
pmikus [Thu, 28 Oct 2021 07:25:41 +0000 (07:25 +0000)]
fix(Autogen): VSAP driver combinations

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ieac8cd32009bebbd1a3324a81becfbf3abb814ab
(cherry picked from commit 585b9d8bbf21b0c5a2d2c28809688563007760db)

2 years agoUpdate VPP_STABLE_VER files 28/34228/2
Tibor Frank [Thu, 28 Oct 2021 03:30:15 +0000 (03:30 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ie6eb285f2047c646953dfd20b87654ddf5d54ee7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: remove nat44ed udp and tcp scale 16m session tests 27/34227/1
Maciek Konstantynowicz [Mon, 18 Oct 2021 13:50:39 +0000 (14:50 +0100)]
job_specs: remove nat44ed udp and tcp scale 16m session tests

Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily
and mlr_weekly performance jobs. Tests are failing due to
slower session setup rate and very long ramp up time, too
long to be accommodated by CSIT resources.

Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a67bec3e62cb239daa3a3991837b5495623fef77)

2 years agofix(docs): AWS job specs 26/34226/1
pmikus [Wed, 27 Oct 2021 13:28:31 +0000 (13:28 +0000)]
fix(docs): AWS job specs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I34b1475f0cabe8a6d9f260c77d5a3b10f7ead61c
(cherry picked from commit 029bd28947704ab76983f48afec5646621a2b0fe)

2 years agoReport: Add data 25/34225/1
Tibor Frank [Wed, 27 Oct 2021 12:42:34 +0000 (14:42 +0200)]
Report: Add data

Change-Id: I51e809322d652e1f410c5674883bdd86e730af41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d4bcfe35de5e9d1f99f8f56d958dc00d615e1a3f)

2 years agofeat(Docs): Add AWS methodology 24/34224/1
pmikus [Mon, 25 Oct 2021 14:42:39 +0000 (14:42 +0000)]
feat(Docs): Add AWS methodology

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I766c1b8ce85e174946503a3d65f8239d8fec1bcd
(cherry picked from commit 6899ba7eda3cbc707c1391affa6c8c2e57f1ba61)

2 years agodocs: TRex static documentation 23/34223/1
Viliam Luc [Fri, 22 Oct 2021 10:17:38 +0000 (12:17 +0200)]
docs: TRex static documentation

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I41233f7044574505f32f7425fd897bb3176ac839
(cherry picked from commit 23fa2a8925d65759bb14177b997b22f8a418e9ef)

2 years agofix(Infra): Move TB24 back into pool 22/34222/1
pmikus [Wed, 27 Oct 2021 06:26:41 +0000 (06:26 +0000)]
fix(Infra): Move TB24 back into pool

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I75e18f898369b8426f465649d7ea2f5996b73881
(cherry picked from commit a3e84f61ed43d570f75eeb36c9cc207a85ee82a2)

2 years agofeat(Docs): DPDK release notes 21/34221/1
pmikus [Tue, 26 Oct 2021 12:49:39 +0000 (12:49 +0000)]
feat(Docs): DPDK release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3ffdf90227ab95a34a31c4e118350782f6bd1dea
(cherry picked from commit 752abf48ea1c4b9c06b0bd11fec1cd5aafb5547c)

2 years agofeat(Terraform): AWS IPv6 support 20/34220/1
pmikus [Mon, 25 Oct 2021 10:34:54 +0000 (10:34 +0000)]
feat(Terraform): AWS IPv6 support

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id439c47c966657bcdf989a597537e4013d57dddf
(cherry picked from commit ba8a0873a58b536b9476b90c578c587e97d6edb5)

2 years agoReport: Modify aws graphs 19/34219/1
Tibor Frank [Tue, 26 Oct 2021 11:07:37 +0000 (13:07 +0200)]
Report: Modify aws graphs

Change-Id: I00e67793b33cd5b643759c93cdabda6c215f4824
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8ff3473d6111784490c5622c52073dd9c749307f)

2 years agoReport: Add data 17/34217/1
Tibor Frank [Mon, 25 Oct 2021 10:54:45 +0000 (12:54 +0200)]
Report: Add data

Change-Id: I8aca9720112cbd75a0a02b7adb4244e6ca3c66a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8d45ae61e3e0a1a6199f0e645e3e66ab67965b67)

2 years agojob-specs: Reduce nr of tests to shorten execution time 16/34216/1
Tibor Frank [Fri, 22 Oct 2021 11:58:32 +0000 (13:58 +0200)]
job-specs: Reduce nr of tests to shorten execution time

Removed tests from iterative job-specs (vpp-mlr-00.md  and vpp-mrr-00.md):
- 2n-clx:
  - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions,
  - IPv6: af-xdp ip6scale-200k,
  - l2: af-xdp,
- 2n-skx:
  - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions,
  - IPv6: af-xdp ip6scale-200k,
  - L2: af-xdp,
- 2n-zn2:
  - ip4scale-(2m,200k),
  - ip6scale-(2m,200k),
  - l2bdscale-1m,
  - all af-xdp
- 3n-skx:
  - container memif - all
  - ip4scale-(2m,200k,20k),
  - ip6scale-(2m,200k,20k),
  - l2bdscale-(1m,100k,10k),
- 3n-tsh:
  - container memif - all
  - ip4scale-(2m,200k,20k),
  - ip6scale-(2m,200k,20k),
  - l2bdscale-(1m,100k,10k)

Suggestion: Keep coverage job-specs as they are now.

Change-Id: I777f2984b9547406c77d588f663891e9120cf594
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 367b37eb0c0c846d21fb21da1c925f0d5762807c)

2 years agoReport: Add data 94/34194/1
Tibor Frank [Fri, 22 Oct 2021 07:56:01 +0000 (09:56 +0200)]
Report: Add data

Change-Id: I58dbbc6020cd695dc8c81155636fb8375ecd78b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 41611cc9e2219eac69ffeb773ff7099f6378c1d2)

2 years agoTrending: Fix spec file 92/34192/1
Tibor Frank [Thu, 21 Oct 2021 12:44:02 +0000 (14:44 +0200)]
Trending: Fix spec file

Change-Id: I1953944d1ab1accdc161855ffbf6039a2b8aa0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 154f6b252a7ad410d59313e483f6a92df5bb32f5)

2 years agoTrending: Add af_xdp 90/34190/1
Tibor Frank [Thu, 21 Oct 2021 12:35:02 +0000 (14:35 +0200)]
Trending: Add af_xdp

Change-Id: Ia9193dbe8a1975b2df42ddb2eeecd845050c9fb8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4a9e9f98e9144d34aa01e95a8338bf23e46549c1)

2 years agoTrending: Fix TRex graphs, remove VTS 88/34188/1
Tibor Frank [Thu, 21 Oct 2021 08:01:24 +0000 (10:01 +0200)]
Trending: Fix TRex graphs, remove VTS

Change-Id: I4c1ed83054d12b83f1a9a6a2d0081e7d037be2df
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a505b3d02cb3dcba44096859287ee2df4ce878ab)

2 years agoReport: Add data 87/34187/1
Tibor Frank [Thu, 21 Oct 2021 07:02:41 +0000 (09:02 +0200)]
Report: Add data

Change-Id: I7e32170c3ac5c22375c8cc885d992a0b221cce04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1f33e8ea73036e1790668b042d731b62de8aa1c3)

2 years agojob-specs: Fix 2n-skx trex coverage job spec 85/34185/1
Tibor Frank [Thu, 21 Oct 2021 04:52:36 +0000 (06:52 +0200)]
job-specs: Fix 2n-skx trex coverage job spec

Change-Id: I84e998b8dc80b1def40b765325956c6c43e1c6b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 48363f5a9fd6ed677b5d30127b68c9177c5bf253)

2 years agofix(Terraform): Change AWS AZ 41/34141/9
pmikus [Mon, 18 Oct 2021 12:44:59 +0000 (12:44 +0000)]
fix(Terraform): Change AWS AZ

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I19c160e40e01bd7f69c08188f61d2bcbc3fd4bcb

2 years agoFix: Do not touch PAPI history on bad DICT__nodes 83/34183/1
Vratko Polak [Tue, 28 Sep 2021 12:59:28 +0000 (14:59 +0200)]
Fix: Do not touch PAPI history on bad DICT__nodes

Usually, DICT__nodes is populated from reserved topology yaml.
But is some cases (doc generation, maybe pylint) there is no yaml.

The proper fix is to never execute any business logic
just when a module is imported.
This is just a quick workaround.

Ticket: CSIT-1793

Change-Id: I6d7250dc75d12baf120758ade8730af89431265a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b61c774897a6cce09bd597af6124831e8aea5e8c)

2 years agoReport: Fix link to src code doc 82/34182/1
Tibor Frank [Wed, 20 Oct 2021 10:12:20 +0000 (12:12 +0200)]
Report: Fix link to src code doc

Change-Id: Ia60ea7623f1d229445fb025f807c5c4fd5209c0b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2f734f4ca633bd875066891caf39a28537321460)

2 years agodoc gen: fix doc generator 81/34181/1
Viliam Luc [Tue, 28 Sep 2021 17:46:36 +0000 (19:46 +0200)]
doc gen: fix doc generator

Change-Id: I75e836ce728fd333764f17d69813093cb947ef4f
Signed-off-by: Viliam Luc <vluc@cisco.com>
(cherry picked from commit 7089e466dfdcc58ebad94ce5fe65ddbbb8b78925)

2 years agoTrendig: Fix processing of trex data 79/34179/1
Tibor Frank [Wed, 20 Oct 2021 08:18:52 +0000 (10:18 +0200)]
Trendig: Fix processing of trex data

Change-Id: I0ee22dc43d670ebea3dad930b79c2cda203083a3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4775366636f137998d7f878cfa0f75f658ae01de)

2 years agoReport: Add data 78/34178/1
Tibor Frank [Wed, 20 Oct 2021 07:38:57 +0000 (09:38 +0200)]
Report: Add data

Change-Id: I1b04eae9bea538e1aada843341d90947ecf89c5a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2dcd81931886e8fea0c724d91f888aab9bfb24a8)

2 years agofix(Packer): AWS images bugs 77/34177/1
pmikus [Tue, 19 Oct 2021 08:40:25 +0000 (08:40 +0000)]
fix(Packer): AWS images bugs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5bd759a71abf965374b2a6c8951eda75232fc9aa
(cherry picked from commit 8f6c947912621fe8b8c870959e8025f0f3de5101)

2 years agofix(job_specs): Remove flow based tests 55/34155/2
pmikus [Mon, 18 Oct 2021 13:48:49 +0000 (13:48 +0000)]
fix(job_specs): Remove flow based tests

+ Random tests starts to fail in vpp per patch jobs.
+ Investigation to take longer, so quick solution.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I4f48c4cdccfcdc81072dcc91af8dc0776cd1312c
(cherry picked from commit 33063b368ff0c1a00db84e2943d44861e3f7e457)

2 years agoReport: Add data, fix aws graphs 76/34176/1
Tibor Frank [Tue, 19 Oct 2021 08:53:52 +0000 (10:53 +0200)]
Report: Add data, fix aws graphs

Change-Id: Ieb3138763541de1958d7e0d34c1f8e19cc6d3195
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 023ce436b2e651b697cd54005fb9c32e4b69e8c0)

2 years agoReport: Add data 43/34143/1
Tibor Frank [Mon, 18 Oct 2021 13:32:29 +0000 (15:32 +0200)]
Report: Add data

Change-Id: I7c8b09c0ee4752f841930479cb8cea4f453fd961
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0938be447f1313ed4632bf1cef70cd54d48a6b64)

2 years agoReport: Fix aws graphs 42/34142/1
Tibor Frank [Mon, 18 Oct 2021 13:08:28 +0000 (15:08 +0200)]
Report: Fix aws graphs

Change-Id: I26cbaa30855d445ed59e17cc565a1afa5e8f3270
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5a1d26f244c974995bdbbe597cfb97ac66e1e902)

2 years agofeat(job-specs): Adjust AWS execution 40/34140/1
pmikus [Mon, 18 Oct 2021 11:12:52 +0000 (11:12 +0000)]
feat(job-specs): Adjust AWS execution

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7cd62b7da0514b23c632a1f319c2ec6fe653bd9a
(cherry picked from commit 880491b8b0799c9003b1a3e77594fddfc8969ad6)

2 years agoReport: Move CSIT Documentation to Introduction 39/34139/1
Tibor Frank [Mon, 18 Oct 2021 10:58:33 +0000 (12:58 +0200)]
Report: Move CSIT Documentation to Introduction

Change-Id: I5454251c33d0187be8a392b4800036388d28597a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 804e38037d6c2c5e216bc50df617627e18b97983)

2 years agoTrending: Add TRex ndrpdr tests 37/34137/1
Tibor Frank [Wed, 6 Oct 2021 09:51:39 +0000 (11:51 +0200)]
Trending: Add TRex ndrpdr tests

Change-Id: I7b968a4747390224d89cdaf7407c10c9a4108deb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3b5495d0943283e96ce5fa23c0b1f31846ca0f6f)

2 years agoReport: Add RC2 data 36/34136/1
Tibor Frank [Mon, 18 Oct 2021 08:50:21 +0000 (10:50 +0200)]
Report: Add RC2 data

Change-Id: I4f3c229030ae26231afec1ea698593f4940e83b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 96734fb1a33eb8dead325461a131f11b36c1bcfc)

2 years agofix(Terraform): 3n-aws typo 75/34075/1
pmikus [Mon, 18 Oct 2021 07:44:26 +0000 (07:44 +0000)]
fix(Terraform): 3n-aws typo

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I30af460b2c735f20ad832fb4563e26500b0efd9d
(cherry picked from commit a9c90fa0d5604c426323e96853034d32ebb6d5cd)

2 years agofix(flow): Move import back to functions 74/34074/1
pmikus [Fri, 15 Oct 2021 13:19:21 +0000 (13:19 +0000)]
fix(flow): Move import back to functions

+ This makes a problem. It would be better to have ENUMS
  in code as everywhere else

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I90f8e7c0177cb6a76eef5d4444f0ec22f57236c4
(cherry picked from commit 240170fea22817e969141f8868b744fdafe54de6)

2 years agofix(Terraform): Bug fixes and lint tweaks 72/34072/1
pmikus [Fri, 15 Oct 2021 12:42:49 +0000 (12:42 +0000)]
fix(Terraform): Bug fixes and lint tweaks

+ Remove few WARN
+ Sort keys in .hcl
+ Fix provisioning
+ Lint tweaks

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6e07cb5ceb7416209185b43342dc19017f1472d8
(cherry picked from commit be8405772f59e38bfc57ff985e459ac9bb0802be)

2 years agofeat(Packer): Introduce AMI packer images 65/34065/1
pmikus [Wed, 6 Oct 2021 12:53:37 +0000 (12:53 +0000)]
feat(Packer): Introduce AMI packer images

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I471069fd4cc10a0627434a60b4627d1bd0e192b8
(cherry picked from commit 6f9f70d7bb1bbed37ff1495c20d11a03b82b9951)

2 years agoReport: Hide vsap, add data 64/34064/1
Tibor Frank [Thu, 14 Oct 2021 09:00:00 +0000 (11:00 +0200)]
Report: Hide vsap, add data

Change-Id: If5a5fea6cc863b6e038c4899cd478c021fe2124f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c8f55980ec9dd4f6376131b4395a833425b86610)

2 years agoReport: Change ref to footnotes in Integration Tests 63/34063/1
Tibor Frank [Thu, 14 Oct 2021 08:40:13 +0000 (10:40 +0200)]
Report: Change ref to footnotes in Integration Tests

Change-Id: I8b1cce73527acbe875ffc59c111d571360bde68e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 90da0436614be09e9ead9738cd9e1208807d2573)

2 years agoUpdate VPP_STABLE_VER files 62/34062/2
Tibor Frank [Thu, 14 Oct 2021 06:13:31 +0000 (06:13 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia02f9735a07dedb5e1ec67c9a2128ea684c4f7fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofeat(Docs): Update few sections 61/34061/1
pmikus [Wed, 13 Oct 2021 09:57:13 +0000 (09:57 +0000)]
feat(Docs): Update few sections

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6bfa76b7b0dd9e6f78164ac07ad32c5efac156b0
(cherry picked from commit 07dc2213e6c0e95147e7025b02e91ed89ea07209)

2 years agojob-spec: Remove 3n TRex job specs 60/34060/1
Tibor Frank [Tue, 12 Oct 2021 05:38:07 +0000 (07:38 +0200)]
job-spec: Remove 3n TRex job specs

- These tests do not work and they are not needed.
- Merge after 34036: CSIT: Remove 3n TRex jobs | https://gerrit.fd.io/r/c/ci-management/+/34036

Change-Id: Id94059626f17f346c92240e6ab29da12d427545a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 857c2ea6e1cfb3c4b214a4ad00d0522792d1b172)

2 years agoReport: Fix formatting in 'Integration Tests' 59/34059/1
Tibor Frank [Wed, 13 Oct 2021 11:03:58 +0000 (13:03 +0200)]
Report: Fix formatting in 'Integration Tests'

Change-Id: I08d66d9171e28cecf18abd82d04d7c7d88a835b5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d105782925ed00efb0019ccef191bb0a781c05ed)

2 years agoPAL: Fix processing of AWS tests 58/34058/1
Tibor Frank [Wed, 13 Oct 2021 09:06:52 +0000 (11:06 +0200)]
PAL: Fix processing of AWS tests

- different structure of NIC name

Change-Id: Iddcbc289e5f23bf5ad171971ad125af43812d466
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2b830298ef5b9b33680f3dc7857365fcaf153938)

2 years agoReport: Add data 57/34057/1
Tibor Frank [Wed, 13 Oct 2021 07:08:06 +0000 (09:08 +0200)]
Report: Add data

Change-Id: Ia9bfde32bb9541c89c19cccf163c60c969732c10
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b3e8aae27d0ed4a4252f9b274b2e5076e8144dd8)

2 years agoReport: Hide icx dynamic content 56/34056/1
Tibor Frank [Tue, 12 Oct 2021 12:09:48 +0000 (14:09 +0200)]
Report: Hide icx dynamic content

Change-Id: Id0fea75616167d3c4f0544b250c6bbe315cff8c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e27b48af01da5bb83ac64b5ff2d8e91724767004)

2 years agoReport: Add data 75/33975/1
Tibor Frank [Tue, 12 Oct 2021 09:05:04 +0000 (11:05 +0200)]
Report: Add data

Change-Id: Ie1a47e02448df367e1e1b42456919ad9fdc08363
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 00ca1927c9c38fb6538e941cc095308d79e5c2a6)

2 years agoPAL: Fix processing of TRex tests 74/33974/1
Tibor Frank [Tue, 12 Oct 2021 11:37:15 +0000 (13:37 +0200)]
PAL: Fix processing of TRex tests

Change-Id: I8357c03cd0bcb89353bf2835a7dd9ba746175400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7bd576415bbc25c00d9f5dd1b4cd19482432718f)

2 years agoReport: Fix bugs and typos in static content 73/33973/1
Tibor Frank [Tue, 12 Oct 2021 11:02:50 +0000 (13:02 +0200)]
Report: Fix bugs and typos in static content

Change-Id: I041ba6e5e61c9c3ded2a8b5efd3bb2b6a7100210
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a456d4eb9e647c9489e24400005cb824c96dac3b)

2 years agoReport: Add data 70/33970/1
Tibor Frank [Tue, 12 Oct 2021 05:32:19 +0000 (07:32 +0200)]
Report: Add data

Change-Id: I7a2b697c5ee259a96c6f16fb07ee26e9ca04c570
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d8322fadccae1648b67630eec7cf1cee49e8d689)

2 years agoReport: Remove 3n TRex tests 69/33969/1
Tibor Frank [Mon, 11 Oct 2021 12:23:51 +0000 (14:23 +0200)]
Report: Remove 3n TRex tests

Change-Id: I4685f50249811726068fbe1cf739e6364f187489
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2f469fe522e694c4b73db397244772e29eb5f9bb)

2 years agoReport: Add data 68/33968/1
Tibor Frank [Mon, 11 Oct 2021 09:50:39 +0000 (11:50 +0200)]
Report: Add data

Change-Id: I71670f860acfcd6195b5cfbad7686dfae0439bb5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b6711ec7cf1f58662cdaa894b5fcc927b0e9e515)

2 years agoReport: Add rc1 and re-test data 67/33967/1
Tibor Frank [Mon, 11 Oct 2021 08:06:28 +0000 (10:06 +0200)]
Report: Add rc1 and re-test data

Change-Id: Ibff3baad0c50bff67090edd62a1b487e68a8b2ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 96a10f34794d3d7e253cbaf6fecb713396e3dc15)

2 years agoReport: Add TRex tests 65/33965/1
Tibor Frank [Fri, 8 Oct 2021 08:35:56 +0000 (10:35 +0200)]
Report: Add TRex tests

Change-Id: Ic221a1e5b6706ea6cca49cc0a3e7637169500d9c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75119f759eb2020bb6fb6543e11877f9c256dc5f)

2 years agofix(Pylint): Small fixes 64/33964/1
pmikus [Fri, 8 Oct 2021 08:54:21 +0000 (08:54 +0000)]
fix(Pylint): Small fixes

+ Just few obvious one

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9bbac293a56d6b2943bef03cb3b8943e967dae6b
(cherry picked from commit bd15bb418bf618ff3055fb25c339778d12c1eaef)

2 years agoDocs: update links by S3 63/33963/1
Tibor Frank [Fri, 8 Oct 2021 11:24:57 +0000 (13:24 +0200)]
Docs: update links by S3

Change-Id: I25342e674ecf05e6b6f183ecceb0aa048e625ea3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 68f8548a9769aa55de77176c58e9e70bd1a88742)

2 years agoAdd flow test suites 62/33962/1
xinfeng zhao [Fri, 3 Sep 2021 07:49:05 +0000 (15:49 +0800)]
Add flow test suites

The comms DDP package needs to be installed to support all flow protocols

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I6ab1bd8beb9edb8c9889a0ed9a999080ca3cef3d
(cherry picked from commit 648fa787d8ed7a045da18cf1a0761f3ca0d5b947)

2 years agoBash: Process job-specs without cores and drivers 60/33960/1
Tibor Frank [Wed, 6 Oct 2021 05:55:36 +0000 (07:55 +0200)]
Bash: Process job-specs without cores and drivers

- job-spec for trex tests modified

Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 78c59bd99bec595acbd24be8fb1c3337e4b41e56)

2 years agoReport: Add data 59/33959/1
Tibor Frank [Tue, 5 Oct 2021 14:30:10 +0000 (16:30 +0200)]
Report: Add data

Change-Id: I0e1a357d73e3d2e9f0ad2a2754f2e35276613842
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b730529695aeea9f030270e208c2317c23b2abc0)

2 years agoGSO: Fix the add workers keyword 58/33958/1
Vratko Polak [Tue, 5 Oct 2021 10:59:00 +0000 (12:59 +0200)]
GSO: Fix the add workers keyword

The old one got deduplicated in https://gerrit.fd.io/r/c/csit/+/32687

Change-Id: Ie82ba36a0805154f17e9fcde0efafb93a686c686
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b551046aa104ea3bfcb9e1866d43c37b13587df8)

2 years agofix(Terraform): Bump AWS API 57/33957/1
pmikus [Tue, 5 Oct 2021 10:05:17 +0000 (10:05 +0000)]
fix(Terraform): Bump AWS API

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I057bd9875a3981245b570e61ff3ba2f478def769
(cherry picked from commit 5015522409d29bdeabb247568ebb0760833b939b)

2 years agoReport: Configure tables 56/33956/1
Tibor Frank [Tue, 5 Oct 2021 08:55:14 +0000 (10:55 +0200)]
Report: Configure tables

Change-Id: Icb841604b59151d30f5d11cf43c5d0ec323d2ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3e9bce7213405a99f2350cc22aee3acb3a8dc7e1)

2 years agofix(Ansible): ca-certificates 15/33915/1
pmikus [Mon, 4 Oct 2021 11:48:02 +0000 (11:48 +0000)]
fix(Ansible): ca-certificates

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I11089abeddf4287193008c28438dc6d8c97408b0
(cherry picked from commit eb1bb637489dad5b9bd7cd2a2cc647d3cdf5215b)

2 years agofix(Infra): Move TB24 out of order 13/33913/1
pmikus [Fri, 1 Oct 2021 06:04:45 +0000 (06:04 +0000)]
fix(Infra): Move TB24 out of order

+ Due to to frequent uncoordinated activity from Vexxhosts
  it is better to have it outside pool rather then rely on
  reverve_dir

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia776896c15b5d0f57e1f20e46bfa4cb8084b0093
(cherry picked from commit ed5709220a92f966e10474cb8b3915503625aae3)

2 years agofeat(Infra): Upgrade Intel NIC's firmware on SUTs 09/33909/1
pmikus [Thu, 30 Sep 2021 07:36:28 +0000 (07:36 +0000)]
feat(Infra): Upgrade Intel NIC's firmware on SUTs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I02e808591fca9a79b65981f2884ff5ebadc3365d
(cherry picked from commit e6d4cc2573b6ed947f16aa75ecdbd15e9085fed0)

2 years agoReport: configure rls2110 08/33908/1
Tibor Frank [Wed, 29 Sep 2021 11:07:03 +0000 (13:07 +0200)]
Report: configure rls2110

Change-Id: I0020d2f11bd027ef80bf77f2e30f9ea19a424aa1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 33eac7ac4d82c96dfac79bfe1bc6f7e06f3e3c47)

2 years agojob_specs: reduce number of ip4scale2m and driver combinations tested weekly 05/33905/1
Maciek Konstantynowicz [Wed, 29 Sep 2021 11:47:55 +0000 (13:47 +0200)]
job_specs: reduce number of ip4scale2m and driver combinations tested weekly

Align with daily MRR executions and remove ip4scale2m weekly ndrpdr
executions for following:
- 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core
- 2n-skx: x710-avf, xxv710-af_xdp
- 3n-skx: x710-avf
- 2n-tx2: xl710-af_xdp
- 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core

Change-Id: Idc863f763751cff58e715da411c4ce215d89e4b5
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit eecc22d8782a562594d776e962a2fa952635bb5a)

2 years agojob_specs: reduce number of ip6scale2m and driver combinations tested daily and weekly 03/33903/1
Maciek Konstantynowicz [Thu, 23 Sep 2021 15:06:54 +0000 (17:06 +0200)]
job_specs: reduce number of ip6scale2m and driver combinations tested daily and weekly

Remove ip6scale2m daily mrr and weekly ndrpdr executions for following:
- 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core
- 2n-skx: x710-avf, xxv710-af_xdp
- 2n-tx2: xl710-af_xdp
- 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core
- 3n-skx: x710-avf

Change-Id: Ie5f335fffafce131e1ecaa6f769f4b110928e0f9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 28a9e068f3d0061232402658a750bde0125b1389)

2 years agofeat(DPDK): Bump payload version to 21.08 02/33902/1
pmikus [Tue, 28 Sep 2021 13:15:36 +0000 (13:15 +0000)]
feat(DPDK): Bump payload version to 21.08

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic249493a39faa8f429ae4fa1de644d74d874151b
(cherry picked from commit e2b3884a9a72de07cb331d5dfc75b2991280432a)

2 years agoMLRsearch: Increase timeout to 20 minutes 52/33852/1
Vratko Polak [Tue, 28 Sep 2021 13:58:53 +0000 (15:58 +0200)]
MLRsearch: Increase timeout to 20 minutes

There are sporadic failures due to timeout.
An earlier edit changed how the timeout is applied
(now it is for the whole search, previously it was for final phase only)
so failures are not unexpected.

Increasing timeout value from 12 minutes to 20 minutes
(both for NDRPDR and for NDR part of RECONF)
as the frequency shows it will not prolong runs much.

The timeout is increased both in Robot call site
and in Python keyword default argument.

Change-Id: I3f07125ba9eeb90ce5819b1450044441b8b3977a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 31df68a76b1f9ce981a4fa28fe79ba9c1af458b4)

2 years agoTrex suites: fix TREX tag 51/33851/1
Vratko Polak [Tue, 28 Sep 2021 08:06:50 +0000 (10:06 +0200)]
Trex suites: fix TREX tag

Change-Id: I2193cc971a827d73965695c251fb00496fe3d2c7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 6d117db97736edd6cfcfe6617775035bd2747ca5)

2 years agofix(DPDK): Increase install timeout 49/33849/1
pmikus [Tue, 28 Sep 2021 11:55:16 +0000 (11:55 +0000)]
fix(DPDK): Increase install timeout

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib87e173daba3315c51794a12e22f7961a5709699
(cherry picked from commit acab4b148ae7ebe6060bd8df0e3a46d8291fc12a)