csit.git
4 months agoAdd source to spec 38/35238/2 rls2110
Tibor Frank [Tue, 8 Feb 2022 11:25:10 +0000 (11:25 +0000)]
Add source to spec

Change-Id: I8a12de4c77218a2189dedde4a9ef39857aa3befc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoRevert "Report: Temporarily change report specs" 40/34940/1
Tibor Frank [Mon, 17 Jan 2022 13:25:29 +0000 (13:25 +0000)]
Revert "Report: Temporarily change report specs"

This reverts commit 1c49a9cbd3c3bda6a0e7b11400ee2b4d1692a1cc.

Reason for revert: Not needed

Change-Id: I1b2e9da49be36f99d844a7affe3971e7cf139585
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoReport: Temporarily change report specs 37/34937/1
Tibor Frank [Mon, 17 Jan 2022 10:20:13 +0000 (10:20 +0000)]
Report: Temporarily change report specs

Change-Id: Ic8724a9676c2b2c37ee4f2de4c056b770a10d5af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cd1f9904e173ecb34836b33cb551ab9b9d378e18)

5 months agoPAL: Fix sh-run 52/34752/1
Tibor Frank [Fri, 14 Jan 2022 08:43:47 +0000 (09:43 +0100)]
PAL: Fix sh-run

- do not post-process telemetry data

Change-Id: I800a99d8e92016d1fa675b18e2b2d30db4a15077
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cc63395c056c520d4e43643a8c5c2a2b18ad6515)

6 months agoReport: Hide empty latency graph(s) for 3n-icx 52/34652/1 oper-rls2110-211223
Tibor Frank [Mon, 13 Dec 2021 07:58:42 +0000 (08:58 +0100)]
Report: Hide empty latency graph(s) for 3n-icx

Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9400b685e04d8a4fbbba2e16d8d1d0fbdbd0400c)

6 months agoReport: Add Latency graphs for 3n-icx 50/34650/1 oper-rls2110-211213
Tibor Frank [Fri, 10 Dec 2021 13:57:00 +0000 (14:57 +0100)]
Report: Add Latency graphs for 3n-icx

Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 99f9f7149889724e95110f5839a0cc426a1305ac)

6 months agoReport: Add 3n-icx - fixes 49/34649/1
Tibor Frank [Fri, 10 Dec 2021 06:54:55 +0000 (07:54 +0100)]
Report: Add 3n-icx - fixes

Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3110a6a982012a90b1b8e02c552894824a2ab568)

6 months agoReport: Add 3n-icx 48/34648/1
Tibor Frank [Wed, 8 Dec 2021 15:52:36 +0000 (16:52 +0100)]
Report: Add 3n-icx

Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a245e007adcb3d6c28a2cb6aa8233038cbbcebd2)

7 months agoPal: Process oper data only from coverage builds 12/34512/1
Tibor Frank [Thu, 25 Nov 2021 09:53:23 +0000 (10:53 +0100)]
Pal: Process oper data only from coverage builds

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I9340f4a34d95320e833c209fdec4bff7649522f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ac75d07fb2a5f5adda7872ad0905fcca5b3e559)

7 months agoReport: Small fixes in static content 11/34511/1
Tibor Frank [Tue, 23 Nov 2021 13:39:30 +0000 (14:39 +0100)]
Report: Small fixes in static content

Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a643037b2b093f3a330e460da15d5dd2edfafa95)

7 months agoReport: Add 2n-icx data 10/34510/1
Tibor Frank [Mon, 22 Nov 2021 13:57:48 +0000 (14:57 +0100)]
Report: Add 2n-icx data

Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b8f989afcced3d43c62eab9e81c5ad70db6e6d54)

7 months agoReport: Hide 2n-icx empty graphs 09/34509/1
Tibor Frank [Mon, 22 Nov 2021 10:42:50 +0000 (11:42 +0100)]
Report: Hide 2n-icx empty graphs

Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f6806362f41354b5ae0149bf5a2329e518ebcd7b)

7 months agoReport: Remove 2n-icx build nr 3 07/34507/1
Tibor Frank [Sat, 20 Nov 2021 09:16:07 +0000 (09:16 +0000)]
Report: Remove 2n-icx build nr 3

- seems to be corrupted

Change-Id: I7f7cb780c0a94601a2c2808d4ef384cb24c3fd99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fad31cfb42946f573ff0184003b8e9d2b204a7ef)

7 months agoPAL: Add boxpoints to all box graphs 05/34505/1
Tibor Frank [Fri, 19 Nov 2021 12:08:01 +0000 (13:08 +0100)]
PAL: Add boxpoints to all box graphs

Change-Id: Ic316149bab15c6fe1efccb53df0afa1cc78b3672
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fb76ee6b1de48b36d2c2170507c4aadd4bc95d85)

7 months agoReport: Improve docs related to TRex 03/34503/1
Vratko Polak [Tue, 16 Nov 2021 16:32:50 +0000 (17:32 +0100)]
Report: Improve docs related to TRex

Change-Id: I0ed346ff30c61d28b5a2232ef2f9d32d26c1ae2c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit cc58afc7de521e571fe4cbaa4c9841a2d3e9be52)

7 months agoReport: Add data 02/34502/1
Tibor Frank [Thu, 18 Nov 2021 06:25:27 +0000 (07:25 +0100)]
Report: Add data

Change-Id: I1dcddef704898cfa4ff9a84934fd11b8cf7b139a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1493f602debb12f1ba152b74c16d1a379a53e50f)

7 months agoPAL: Add box points to all box graphs 01/34501/1
Tibor Frank [Tue, 16 Nov 2021 12:07:39 +0000 (13:07 +0100)]
PAL: Add box points to all box graphs

- enabled only for aws throughput and soak

Change-Id: I3c4266e35d98d8319ef1e5c365734338195a40d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 92a8cc02adf1b8c152685c46a9f0d9413b518115)

7 months agoReport: Add boxpoints to aws tput graphs 98/34498/1
Tibor Frank [Mon, 15 Nov 2021 15:50:47 +0000 (16:50 +0100)]
Report: Add boxpoints to aws tput graphs

Change-Id: Idaeba305747863178a5eebc1d42f389a14d6084e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 84ec89bbb5e870ab72ddbab024eb6e87b909905d)

7 months agoReport: Add data 97/34497/1
Tibor Frank [Mon, 15 Nov 2021 06:32:54 +0000 (07:32 +0100)]
Report: Add data

Change-Id: Ie384ab9db8f3ba909ec0b6eaf39a04c5c7f3157a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 40ece2a4354f2dcc4af2928ab45762ccc22625e7)

7 months agoReport: Show min/avg/max latency for aws - fixes 35/34435/1
Tibor Frank [Fri, 12 Nov 2021 18:04:07 +0000 (19:04 +0100)]
Report: Show min/avg/max latency for aws - fixes

Change-Id: I119fa64da4b178cb6a8abe63fb16e0bc7f18fd70
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7d84c1e92f454ceb2159fcc17dd4338028d41f4d)

7 months agoReport: Show min/avg/max latency for aws 34/34434/1
Tibor Frank [Fri, 12 Nov 2021 12:15:10 +0000 (13:15 +0100)]
Report: Show min/avg/max latency for aws

Change-Id: I4acbe6b20054881f95bf4bab03958ad2dab60629
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7b3cf8085cb05c8a327cecf6fd4cfb83430ee5e3)

7 months agoPAL: Round report comparisons to 1 digit more 33/34433/1
Vratko Polak [Mon, 8 Nov 2021 12:43:29 +0000 (13:43 +0100)]
PAL: Round report comparisons to 1 digit more

Change-Id: Ifc2fdd04270628053646a6b3d8b15bc730325eb6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit e21ca2707937c91f66af9c3309a426aa61be7502)

7 months agoReport: Add data 32/34432/1
Tibor Frank [Fri, 12 Nov 2021 06:06:32 +0000 (07:06 +0100)]
Report: Add data

Change-Id: I2ee6005d499c4d93cca72cffd3373ced16d7c994
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 014efcd0b57f88e70eb4229d241f7e189656c115)

7 months agoReport: Add data 30/34430/1
Tibor Frank [Thu, 11 Nov 2021 11:43:52 +0000 (12:43 +0100)]
Report: Add data

Change-Id: Ifea5d3b84dbc0df4d8365ed1c1b4dfdd4c49f140
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c966e5a64ff3bb428f4ccd5ce7accfa924b1025e)

7 months agoReport: Add DPDK speedup graphs 29/34429/1
Tibor Frank [Thu, 11 Nov 2021 11:36:29 +0000 (12:36 +0100)]
Report: Add DPDK speedup graphs

Change-Id: I0c763ae0371515955037f0aaa867251b5aaec604
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2b6a9cd2d0171013619d11c64c86ecdbb84e1d32)

7 months ago"fix(job_specs): Remove flow based tests" 28/34428/1
Peter Mikus [Thu, 11 Nov 2021 08:52:23 +0000 (08:52 +0000)]
"fix(job_specs): Remove flow based tests"

Reason for revert: Fixed

Change-Id: Idbafdb953964967276f4f5748c78398a33635e2b
Signed-off-by: pmikus <pmikus@cisco.com>
(cherry picked from commit 5c2e3308a3640b8de05249270ecd40173846e48c)

7 months agoReport: Add 4t2c graphs for aws 25/34425/1
Tibor Frank [Thu, 11 Nov 2021 07:36:20 +0000 (08:36 +0100)]
Report: Add 4t2c graphs for aws

Change-Id: I4fd625bc5139ebcb8430a4228986eafe39672532
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit de547dba45bf1154d2bdb23319383a83cafc1abd)

7 months agoReport: Add stats tables, aws tests 24/34424/1
Tibor Frank [Wed, 10 Nov 2021 13:30:08 +0000 (14:30 +0100)]
Report: Add stats tables, aws tests

Change-Id: I212b0e6e70008e15ced0167ab34e613cc0a1aea4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5390d5cedf42ecc0d589d79a0a9d1b346ebb5c11)

7 months agoReport: Update known issues 23/34423/1
Vratko Polak [Wed, 10 Nov 2021 12:36:27 +0000 (13:36 +0100)]
Report: Update known issues

+ Remove MLRsearch comment, it happened a release before.
+ Separated known issues to fixed, old and new.
+ RCA section present, but empty yet.

Change-Id: Ic713319017d6c2eb7ba2750de7c27de5237ee2c7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit f0f6265a54cc65e27daf04329df209c303518f04)

7 months agoPAL: Fix heatmap graph 22/34422/1
Tibor Frank [Wed, 10 Nov 2021 10:58:53 +0000 (11:58 +0100)]
PAL: Fix heatmap graph

Change-Id: I4992c8f4ae63aa25794cdab98532722c45263e8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 80e8f662317324156f9997e788f7ed2ae46401f8)

7 months agoReport: Fixes in dynamic content 21/34421/1
Tibor Frank [Wed, 10 Nov 2021 10:47:51 +0000 (11:47 +0100)]
Report: Fixes in dynamic content

Change-Id: If90ba8c66427061341888dcfc946450efe66010b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 89eb19f67d91a4aa535fb95ece3f26381dddfc28)

7 months agoreport: update to vpp performance release notes 20/34420/1
Maciek Konstantynowicz [Tue, 9 Nov 2021 19:13:17 +0000 (19:13 +0000)]
report: update to vpp performance release notes

Change-Id: I170d14555b21e91d0ce1f11ea3f2911e8b01341c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7e22de2de8ef461b56d2b76f99601aa63814173b)

7 months agoReport: Add data 19/34419/1
Tibor Frank [Wed, 10 Nov 2021 06:00:32 +0000 (07:00 +0100)]
Report: Add data

Change-Id: Ib00909a62739e488ad809463c08cec14b4b96e91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c5f202b8fa105fa8701fae26d04b808c7529e33a)

7 months agoReport: Add data 18/34418/1
Tibor Frank [Tue, 9 Nov 2021 16:39:38 +0000 (17:39 +0100)]
Report: Add data

Change-Id: I21eedf3ecabe0672daaaf87819960cd986420fa0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c566bbd1d659ed022fea08f7bd38326661779c8c)

7 months agoReport: 2n-icx: disable elements without data 17/34417/1
Tibor Frank [Tue, 9 Nov 2021 16:27:51 +0000 (17:27 +0100)]
Report: 2n-icx: disable elements without data

Change-Id: Id908e094129e6becd70a63667ebe61a6433db07e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b4bea99de7dce5f3fbfbdffdc29958f4d6dc5618)

7 months agoReport: Add 2n-icx, part 2 55/34355/1
Tibor Frank [Tue, 9 Nov 2021 13:42:00 +0000 (14:42 +0100)]
Report: Add 2n-icx, part 2

- packet throughput
- speedup
- latency

Change-Id: If871dcc1888e7a49ac2fd2ba8e3632a87fa035bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 814cbec925be525dc328374fee458d9207d3d5e3)

7 months agoreport: edits in aws methodology section 54/34354/1
Maciek Konstantynowicz [Mon, 8 Nov 2021 21:17:53 +0000 (21:17 +0000)]
report: edits in aws methodology section

Edits include:
- add description of used testbed topologies.
- cleaned up references.
- other editing nits.

Change-Id: I43069541f3da8e844529a00a127fb1a360197647
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 531215332c4b4374a5cd7e1317de506f59a7683a)

7 months agoReport: Hide aws latency 53/34353/1
Tibor Frank [Tue, 9 Nov 2021 07:28:17 +0000 (08:28 +0100)]
Report: Hide aws latency

- it is not measured

Change-Id: I1c3d2f629d8ed07a208c37a20642b0e6b336242e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0ab2529c2725c1475845666d4d6ea53882d1eed1)

7 months agoReport: Add data 52/34352/1
Tibor Frank [Tue, 9 Nov 2021 06:57:38 +0000 (07:57 +0100)]
Report: Add data

Change-Id: Iec138a93b18f02046d7c13b7243463048ff695ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c3fdcd39f617a8dffdd1be77ec9113759beeb008)

7 months agoReport: Add aws latency 51/34351/1
Tibor Frank [Mon, 8 Nov 2021 16:31:21 +0000 (17:31 +0100)]
Report: Add aws latency

Change-Id: I0780ddabce015cf1809ea178bf53ab9fc6e18f2d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 49aad5d3e989a49ed33b8a583306041a3c4802e6)

7 months agoReport: Add 2n-icx, part 1 50/34350/1
Tibor Frank [Mon, 8 Nov 2021 14:45:40 +0000 (15:45 +0100)]
Report: Add 2n-icx, part 1

Change-Id: Idf1e56231afa14648d7c3db661eb9a04ef7a5c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5efcddefdcdb47bb1d71a13a18188e539007cc3f)

7 months agoReport: Remove tests removed by 34207 49/34349/1
Tibor Frank [Fri, 5 Nov 2021 13:48:18 +0000 (14:48 +0100)]
Report: Remove tests removed by 34207

Change-Id: Ibe960b8dd4340c2c5b8a01fc490cab906dc330fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4fd081896e3b2e344772184fbd00ae4a189ea875)

7 months agovpp_device: bind to vfio-pci before running tests 88/34388/1
Juraj Linkeš [Tue, 12 Oct 2021 08:03:04 +0000 (10:03 +0200)]
vpp_device: bind to vfio-pci before running tests

In rare cases, binding the whole /dev/vfio folder will result in
unusable VFs:
notice dpdk EAL: Cannot open /dev/vfio/151: Device or resource busy

[0], section 4.3.1. provides some clues as to what's going on and how to
avoid the failure. Mounting /dev/vfio reset the file descriptors of all
devices under /dev/vfio. Vfio-pci creates a device when an interface is
bound to it. The rare failure then occurs when /dev/vfio is mounted
while a process is using the file descriptors result in that process
using invalid file descriptors (or file descriptors belonging to a
different VF).

Fix the issue by binding i40e and ice VFs to vfio-pci before containers
are created and make sure that the VFs are not unbound later in testing.
Only bind DUT VFs since the TG uses the kernel driver.

[0]: https://connect.redhat.com/sites/default/files/2021-03/Cloud Native Network Function Requirements.pdf

Ticket: CSIT-1794

Change-Id: I83db91b29d16669fb034b141ad247f6f796fdf64
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
7 months agoReport: Add data 45/34345/1
Tibor Frank [Mon, 8 Nov 2021 08:33:31 +0000 (09:33 +0100)]
Report: Add data

Change-Id: I76a36cb19d6c121b1d668d1ff8f71085baa2ed2e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 03e0de0418452c9904dafe74d86e36cf3c2a7289)

7 months agoReport: Small edits in static content. 43/34343/1
Tibor Frank [Fri, 5 Nov 2021 12:30:45 +0000 (13:30 +0100)]
Report: Small edits in static content.

Change-Id: I621e9818cb929c9558c38d41cb4804a19ed2a468
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9dd388775bc42b334223b3a98909e9ee0e663dc7)

7 months agoReport: Add data 42/34342/1
Tibor Frank [Fri, 5 Nov 2021 09:08:23 +0000 (10:08 +0100)]
Report: Add data

Change-Id: Ia1709ebd3543ac4ee5fa63cefa6b18411c3c58f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5a33af45b4618f62ebc8ae131e550481beee2d21)

7 months agoReport: update tables 41/34341/1
Tibor Frank [Thu, 4 Nov 2021 13:20:25 +0000 (14:20 +0100)]
Report: update tables

- statistics
- latency comparison

Change-Id: I84069c26e07ced08bad92e19e6cdb0953cd24d3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4bc35be955ed767b4c50bf5676e9919fb4110833)

7 months agoReport: Add data 40/34340/1
Tibor Frank [Thu, 4 Nov 2021 10:05:37 +0000 (11:05 +0100)]
Report: Add data

Change-Id: I9fce2c74eb564a80b7b7002538376ec6aefaeac2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 902cea84c1688e998867f50f02f3e058e27467a0)

7 months agofix(Docs): Report section updates 38/34338/1
pmikus [Wed, 3 Nov 2021 15:34:22 +0000 (15:34 +0000)]
fix(Docs): Report section updates

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icd04b75d320f067bd66402d5bb499070ee2768f3
(cherry picked from commit e6b2505e14723eaca82204f1f6ef25af4f3e77e7)

7 months agoReport: Add rls data 37/34337/1
Tibor Frank [Wed, 3 Nov 2021 12:08:47 +0000 (13:08 +0100)]
Report: Add rls data

Change-Id: I7868b419fa47c6130826948bbdfbb288abb8d1e4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c4ef85bfbdcf2c73919d8d23a409f02edacf9973)

7 months agojob_specs: add ipsec 40 tunnel sw tests for 3n-skx testbeds 36/34336/1
Maciek Konstantynowicz [Thu, 28 Oct 2021 17:52:09 +0000 (18:52 +0100)]
job_specs: add ipsec 40 tunnel sw tests for 3n-skx testbeds

Change-Id: I4bb79bf34f64b1096be9e81586d718dbe283b3cd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 8cbfb75d12b87fee16955e0937ea8127e5e1f996)

7 months agoRe-adressing ipsec int tests to fit deployment in AWS 84/34184/7
Maros Mullner [Wed, 19 Feb 2020 14:11:10 +0000 (15:11 +0100)]
Re-adressing ipsec int tests to fit deployment in AWS

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I83b00d56a50d98c36547621cb2f41cb3b2f35741
(cherry picked from commit 41bf12b9700f5fe8d7d1ccdd042705f33b19b064)

7 months agoperf: remove depracted ipsec scale reconf test suites 35/34235/1
Maciek Konstantynowicz [Tue, 2 Nov 2021 14:52:38 +0000 (14:52 +0000)]
perf: remove depracted ipsec scale reconf test suites

Remaining ipsec reconf test suites for 40 tunnels include:
- int-aes128cbc-hmac512sha
- int-aes256gcm

Change-Id: I9c5f549368595bb0cbd0d7e9918b7695184d31c4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 4b567a7fe17895812e1d4ac8327f08b8a1653bbb)

7 months agofix(Tests): Hoststack drivers 34/34234/1
pmikus [Wed, 3 Nov 2021 07:30:41 +0000 (07:30 +0000)]
fix(Tests): Hoststack drivers

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If98f575503a59106fe8b94d5c683881412ea4f1c
(cherry picked from commit f83793575f4d9ac462a70eb505b55463dab849df)

7 months agocrypto: remove deprecated ipsec scale perf test suites 32/34232/1
Maciek Konstantynowicz [Wed, 20 Oct 2021 12:23:56 +0000 (13:23 +0100)]
crypto: remove deprecated ipsec scale perf test suites

Remove following test suites:
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: Ib4915213f6c440c70f9b17cbaac834245e51bd85
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 282240ecada68e8a6811996057cfdae222fe1be2)

7 months agofix(autogen): VSAP testcase naming 31/34231/1
pmikus [Tue, 2 Nov 2021 06:44:27 +0000 (06:44 +0000)]
fix(autogen): VSAP testcase naming

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic6d440ffdf7e27c9e6ce65605178163652758f77
(cherry picked from commit 79f23ad3f92341040762a9b0018557e03b306200)

8 months agofix(Autogen): VSAP driver combinations 29/34229/1
pmikus [Thu, 28 Oct 2021 07:25:41 +0000 (07:25 +0000)]
fix(Autogen): VSAP driver combinations

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ieac8cd32009bebbd1a3324a81becfbf3abb814ab
(cherry picked from commit 585b9d8bbf21b0c5a2d2c28809688563007760db)

8 months agoUpdate VPP_STABLE_VER files 28/34228/2
Tibor Frank [Thu, 28 Oct 2021 03:30:15 +0000 (03:30 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ie6eb285f2047c646953dfd20b87654ddf5d54ee7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 months agojob_specs: remove nat44ed udp and tcp scale 16m session tests 27/34227/1
Maciek Konstantynowicz [Mon, 18 Oct 2021 13:50:39 +0000 (14:50 +0100)]
job_specs: remove nat44ed udp and tcp scale 16m session tests

Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily
and mlr_weekly performance jobs. Tests are failing due to
slower session setup rate and very long ramp up time, too
long to be accommodated by CSIT resources.

Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a67bec3e62cb239daa3a3991837b5495623fef77)

8 months agofix(docs): AWS job specs 26/34226/1
pmikus [Wed, 27 Oct 2021 13:28:31 +0000 (13:28 +0000)]
fix(docs): AWS job specs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I34b1475f0cabe8a6d9f260c77d5a3b10f7ead61c
(cherry picked from commit 029bd28947704ab76983f48afec5646621a2b0fe)

8 months agoReport: Add data 25/34225/1
Tibor Frank [Wed, 27 Oct 2021 12:42:34 +0000 (14:42 +0200)]
Report: Add data

Change-Id: I51e809322d652e1f410c5674883bdd86e730af41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d4bcfe35de5e9d1f99f8f56d958dc00d615e1a3f)

8 months agofeat(Docs): Add AWS methodology 24/34224/1
pmikus [Mon, 25 Oct 2021 14:42:39 +0000 (14:42 +0000)]
feat(Docs): Add AWS methodology

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I766c1b8ce85e174946503a3d65f8239d8fec1bcd
(cherry picked from commit 6899ba7eda3cbc707c1391affa6c8c2e57f1ba61)

8 months agodocs: TRex static documentation 23/34223/1
Viliam Luc [Fri, 22 Oct 2021 10:17:38 +0000 (12:17 +0200)]
docs: TRex static documentation

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I41233f7044574505f32f7425fd897bb3176ac839
(cherry picked from commit 23fa2a8925d65759bb14177b997b22f8a418e9ef)

8 months agofix(Infra): Move TB24 back into pool 22/34222/1
pmikus [Wed, 27 Oct 2021 06:26:41 +0000 (06:26 +0000)]
fix(Infra): Move TB24 back into pool

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I75e18f898369b8426f465649d7ea2f5996b73881
(cherry picked from commit a3e84f61ed43d570f75eeb36c9cc207a85ee82a2)

8 months agofeat(Docs): DPDK release notes 21/34221/1
pmikus [Tue, 26 Oct 2021 12:49:39 +0000 (12:49 +0000)]
feat(Docs): DPDK release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3ffdf90227ab95a34a31c4e118350782f6bd1dea
(cherry picked from commit 752abf48ea1c4b9c06b0bd11fec1cd5aafb5547c)

8 months agofeat(Terraform): AWS IPv6 support 20/34220/1
pmikus [Mon, 25 Oct 2021 10:34:54 +0000 (10:34 +0000)]
feat(Terraform): AWS IPv6 support

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id439c47c966657bcdf989a597537e4013d57dddf
(cherry picked from commit ba8a0873a58b536b9476b90c578c587e97d6edb5)

8 months agoReport: Modify aws graphs 19/34219/1
Tibor Frank [Tue, 26 Oct 2021 11:07:37 +0000 (13:07 +0200)]
Report: Modify aws graphs

Change-Id: I00e67793b33cd5b643759c93cdabda6c215f4824
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8ff3473d6111784490c5622c52073dd9c749307f)

8 months agoReport: Add data 17/34217/1
Tibor Frank [Mon, 25 Oct 2021 10:54:45 +0000 (12:54 +0200)]
Report: Add data

Change-Id: I8aca9720112cbd75a0a02b7adb4244e6ca3c66a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8d45ae61e3e0a1a6199f0e645e3e66ab67965b67)

8 months agojob-specs: Reduce nr of tests to shorten execution time 16/34216/1
Tibor Frank [Fri, 22 Oct 2021 11:58:32 +0000 (13:58 +0200)]
job-specs: Reduce nr of tests to shorten execution time

Removed tests from iterative job-specs (vpp-mlr-00.md  and vpp-mrr-00.md):
- 2n-clx:
  - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions,
  - IPv6: af-xdp ip6scale-200k,
  - l2: af-xdp,
- 2n-skx:
  - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions,
  - IPv6: af-xdp ip6scale-200k,
  - L2: af-xdp,
- 2n-zn2:
  - ip4scale-(2m,200k),
  - ip6scale-(2m,200k),
  - l2bdscale-1m,
  - all af-xdp
- 3n-skx:
  - container memif - all
  - ip4scale-(2m,200k,20k),
  - ip6scale-(2m,200k,20k),
  - l2bdscale-(1m,100k,10k),
- 3n-tsh:
  - container memif - all
  - ip4scale-(2m,200k,20k),
  - ip6scale-(2m,200k,20k),
  - l2bdscale-(1m,100k,10k)

Suggestion: Keep coverage job-specs as they are now.

Change-Id: I777f2984b9547406c77d588f663891e9120cf594
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 367b37eb0c0c846d21fb21da1c925f0d5762807c)

8 months agoReport: Add data 94/34194/1
Tibor Frank [Fri, 22 Oct 2021 07:56:01 +0000 (09:56 +0200)]
Report: Add data

Change-Id: I58dbbc6020cd695dc8c81155636fb8375ecd78b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 41611cc9e2219eac69ffeb773ff7099f6378c1d2)

8 months agoTrending: Fix spec file 92/34192/1
Tibor Frank [Thu, 21 Oct 2021 12:44:02 +0000 (14:44 +0200)]
Trending: Fix spec file

Change-Id: I1953944d1ab1accdc161855ffbf6039a2b8aa0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 154f6b252a7ad410d59313e483f6a92df5bb32f5)

8 months agoTrending: Add af_xdp 90/34190/1
Tibor Frank [Thu, 21 Oct 2021 12:35:02 +0000 (14:35 +0200)]
Trending: Add af_xdp

Change-Id: Ia9193dbe8a1975b2df42ddb2eeecd845050c9fb8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4a9e9f98e9144d34aa01e95a8338bf23e46549c1)

8 months agoTrending: Fix TRex graphs, remove VTS 88/34188/1
Tibor Frank [Thu, 21 Oct 2021 08:01:24 +0000 (10:01 +0200)]
Trending: Fix TRex graphs, remove VTS

Change-Id: I4c1ed83054d12b83f1a9a6a2d0081e7d037be2df
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a505b3d02cb3dcba44096859287ee2df4ce878ab)

8 months agoReport: Add data 87/34187/1
Tibor Frank [Thu, 21 Oct 2021 07:02:41 +0000 (09:02 +0200)]
Report: Add data

Change-Id: I7e32170c3ac5c22375c8cc885d992a0b221cce04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1f33e8ea73036e1790668b042d731b62de8aa1c3)

8 months agojob-specs: Fix 2n-skx trex coverage job spec 85/34185/1
Tibor Frank [Thu, 21 Oct 2021 04:52:36 +0000 (06:52 +0200)]
job-specs: Fix 2n-skx trex coverage job spec

Change-Id: I84e998b8dc80b1def40b765325956c6c43e1c6b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 48363f5a9fd6ed677b5d30127b68c9177c5bf253)

8 months agofix(Terraform): Change AWS AZ 41/34141/9
pmikus [Mon, 18 Oct 2021 12:44:59 +0000 (12:44 +0000)]
fix(Terraform): Change AWS AZ

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I19c160e40e01bd7f69c08188f61d2bcbc3fd4bcb

8 months agoFix: Do not touch PAPI history on bad DICT__nodes 83/34183/1
Vratko Polak [Tue, 28 Sep 2021 12:59:28 +0000 (14:59 +0200)]
Fix: Do not touch PAPI history on bad DICT__nodes

Usually, DICT__nodes is populated from reserved topology yaml.
But is some cases (doc generation, maybe pylint) there is no yaml.

The proper fix is to never execute any business logic
just when a module is imported.
This is just a quick workaround.

Ticket: CSIT-1793

Change-Id: I6d7250dc75d12baf120758ade8730af89431265a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b61c774897a6cce09bd597af6124831e8aea5e8c)

8 months agoReport: Fix link to src code doc 82/34182/1
Tibor Frank [Wed, 20 Oct 2021 10:12:20 +0000 (12:12 +0200)]
Report: Fix link to src code doc

Change-Id: Ia60ea7623f1d229445fb025f807c5c4fd5209c0b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2f734f4ca633bd875066891caf39a28537321460)

8 months agodoc gen: fix doc generator 81/34181/1
Viliam Luc [Tue, 28 Sep 2021 17:46:36 +0000 (19:46 +0200)]
doc gen: fix doc generator

Change-Id: I75e836ce728fd333764f17d69813093cb947ef4f
Signed-off-by: Viliam Luc <vluc@cisco.com>
(cherry picked from commit 7089e466dfdcc58ebad94ce5fe65ddbbb8b78925)

8 months agoTrendig: Fix processing of trex data 79/34179/1
Tibor Frank [Wed, 20 Oct 2021 08:18:52 +0000 (10:18 +0200)]
Trendig: Fix processing of trex data

Change-Id: I0ee22dc43d670ebea3dad930b79c2cda203083a3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4775366636f137998d7f878cfa0f75f658ae01de)

8 months agoReport: Add data 78/34178/1
Tibor Frank [Wed, 20 Oct 2021 07:38:57 +0000 (09:38 +0200)]
Report: Add data

Change-Id: I1b04eae9bea538e1aada843341d90947ecf89c5a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2dcd81931886e8fea0c724d91f888aab9bfb24a8)

8 months agofix(Packer): AWS images bugs 77/34177/1
pmikus [Tue, 19 Oct 2021 08:40:25 +0000 (08:40 +0000)]
fix(Packer): AWS images bugs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5bd759a71abf965374b2a6c8951eda75232fc9aa
(cherry picked from commit 8f6c947912621fe8b8c870959e8025f0f3de5101)

8 months agofix(job_specs): Remove flow based tests 55/34155/2
pmikus [Mon, 18 Oct 2021 13:48:49 +0000 (13:48 +0000)]
fix(job_specs): Remove flow based tests

+ Random tests starts to fail in vpp per patch jobs.
+ Investigation to take longer, so quick solution.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I4f48c4cdccfcdc81072dcc91af8dc0776cd1312c
(cherry picked from commit 33063b368ff0c1a00db84e2943d44861e3f7e457)

8 months agoReport: Add data, fix aws graphs 76/34176/1
Tibor Frank [Tue, 19 Oct 2021 08:53:52 +0000 (10:53 +0200)]
Report: Add data, fix aws graphs

Change-Id: Ieb3138763541de1958d7e0d34c1f8e19cc6d3195
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 023ce436b2e651b697cd54005fb9c32e4b69e8c0)

8 months agoReport: Add data 43/34143/1
Tibor Frank [Mon, 18 Oct 2021 13:32:29 +0000 (15:32 +0200)]
Report: Add data

Change-Id: I7c8b09c0ee4752f841930479cb8cea4f453fd961
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0938be447f1313ed4632bf1cef70cd54d48a6b64)

8 months agoReport: Fix aws graphs 42/34142/1
Tibor Frank [Mon, 18 Oct 2021 13:08:28 +0000 (15:08 +0200)]
Report: Fix aws graphs

Change-Id: I26cbaa30855d445ed59e17cc565a1afa5e8f3270
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5a1d26f244c974995bdbbe597cfb97ac66e1e902)

8 months agofeat(job-specs): Adjust AWS execution 40/34140/1
pmikus [Mon, 18 Oct 2021 11:12:52 +0000 (11:12 +0000)]
feat(job-specs): Adjust AWS execution

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7cd62b7da0514b23c632a1f319c2ec6fe653bd9a
(cherry picked from commit 880491b8b0799c9003b1a3e77594fddfc8969ad6)

8 months agoReport: Move CSIT Documentation to Introduction 39/34139/1
Tibor Frank [Mon, 18 Oct 2021 10:58:33 +0000 (12:58 +0200)]
Report: Move CSIT Documentation to Introduction

Change-Id: I5454251c33d0187be8a392b4800036388d28597a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 804e38037d6c2c5e216bc50df617627e18b97983)

8 months agoTrending: Add TRex ndrpdr tests 37/34137/1
Tibor Frank [Wed, 6 Oct 2021 09:51:39 +0000 (11:51 +0200)]
Trending: Add TRex ndrpdr tests

Change-Id: I7b968a4747390224d89cdaf7407c10c9a4108deb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3b5495d0943283e96ce5fa23c0b1f31846ca0f6f)

8 months agoReport: Add RC2 data 36/34136/1
Tibor Frank [Mon, 18 Oct 2021 08:50:21 +0000 (10:50 +0200)]
Report: Add RC2 data

Change-Id: I4f3c229030ae26231afec1ea698593f4940e83b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 96734fb1a33eb8dead325461a131f11b36c1bcfc)

8 months agofix(Terraform): 3n-aws typo 75/34075/1
pmikus [Mon, 18 Oct 2021 07:44:26 +0000 (07:44 +0000)]
fix(Terraform): 3n-aws typo

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I30af460b2c735f20ad832fb4563e26500b0efd9d
(cherry picked from commit a9c90fa0d5604c426323e96853034d32ebb6d5cd)

8 months agofix(flow): Move import back to functions 74/34074/1
pmikus [Fri, 15 Oct 2021 13:19:21 +0000 (13:19 +0000)]
fix(flow): Move import back to functions

+ This makes a problem. It would be better to have ENUMS
  in code as everywhere else

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I90f8e7c0177cb6a76eef5d4444f0ec22f57236c4
(cherry picked from commit 240170fea22817e969141f8868b744fdafe54de6)

8 months agofix(Terraform): Bug fixes and lint tweaks 72/34072/1
pmikus [Fri, 15 Oct 2021 12:42:49 +0000 (12:42 +0000)]
fix(Terraform): Bug fixes and lint tweaks

+ Remove few WARN
+ Sort keys in .hcl
+ Fix provisioning
+ Lint tweaks

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6e07cb5ceb7416209185b43342dc19017f1472d8
(cherry picked from commit be8405772f59e38bfc57ff985e459ac9bb0802be)

8 months agofeat(Packer): Introduce AMI packer images 65/34065/1
pmikus [Wed, 6 Oct 2021 12:53:37 +0000 (12:53 +0000)]
feat(Packer): Introduce AMI packer images

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I471069fd4cc10a0627434a60b4627d1bd0e192b8
(cherry picked from commit 6f9f70d7bb1bbed37ff1495c20d11a03b82b9951)

8 months agoReport: Hide vsap, add data 64/34064/1
Tibor Frank [Thu, 14 Oct 2021 09:00:00 +0000 (11:00 +0200)]
Report: Hide vsap, add data

Change-Id: If5a5fea6cc863b6e038c4899cd478c021fe2124f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c8f55980ec9dd4f6376131b4395a833425b86610)

8 months agoReport: Change ref to footnotes in Integration Tests 63/34063/1
Tibor Frank [Thu, 14 Oct 2021 08:40:13 +0000 (10:40 +0200)]
Report: Change ref to footnotes in Integration Tests

Change-Id: I8b1cce73527acbe875ffc59c111d571360bde68e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 90da0436614be09e9ead9738cd9e1208807d2573)

8 months agoUpdate VPP_STABLE_VER files 62/34062/2
Tibor Frank [Thu, 14 Oct 2021 06:13:31 +0000 (06:13 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia02f9735a07dedb5e1ec67c9a2128ea684c4f7fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 months agofeat(Docs): Update few sections 61/34061/1
pmikus [Wed, 13 Oct 2021 09:57:13 +0000 (09:57 +0000)]
feat(Docs): Update few sections

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6bfa76b7b0dd9e6f78164ac07ad32c5efac156b0
(cherry picked from commit 07dc2213e6c0e95147e7025b02e91ed89ea07209)

8 months agojob-spec: Remove 3n TRex job specs 60/34060/1
Tibor Frank [Tue, 12 Oct 2021 05:38:07 +0000 (07:38 +0200)]
job-spec: Remove 3n TRex job specs

- These tests do not work and they are not needed.
- Merge after 34036: CSIT: Remove 3n TRex jobs | https://gerrit.fd.io/r/c/ci-management/+/34036

Change-Id: Id94059626f17f346c92240e6ab29da12d427545a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 857c2ea6e1cfb3c4b214a4ad00d0522792d1b172)

8 months agoReport: Fix formatting in 'Integration Tests' 59/34059/1
Tibor Frank [Wed, 13 Oct 2021 11:03:58 +0000 (13:03 +0200)]
Report: Fix formatting in 'Integration Tests'

Change-Id: I08d66d9171e28cecf18abd82d04d7c7d88a835b5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d105782925ed00efb0019ccef191bb0a781c05ed)