csit.git
3 years agoReport: Add data 58/29258/3
Tibor Frank [Mon, 5 Oct 2020 12:50:31 +0000 (14:50 +0200)]
Report: Add data

- DNV VPP tests
- 3n-tsh MRR 2005-5
- MRR Comparisons for skx, hsw and clx

Change-Id: Ibb73e0f8234d2eb27b6a386675492efc9f050247
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add rls data 34/29234/1
Tibor Frank [Mon, 5 Oct 2020 12:07:16 +0000 (14:07 +0200)]
Report: Add rls data

Change-Id: I104c61ae1aa26fe9d057a16275d8cc2f12abef18
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Fix NAT44 28/29228/1
Tibor Frank [Mon, 5 Oct 2020 08:55:04 +0000 (10:55 +0200)]
Report: Fix NAT44

Change-Id: I9c0b8571673a0fc839430a4dce2ef0e8b9b017e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add NAT44 78/29078/6
Tibor Frank [Thu, 24 Sep 2020 12:16:27 +0000 (14:16 +0200)]
Trending: Add NAT44

Change-Id: I57d4b6f0ffa2ebfffbf95fc030bc8da70e46c8bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add NAT44 12/29112/5
Tibor Frank [Mon, 28 Sep 2020 14:02:01 +0000 (16:02 +0200)]
Report: Add NAT44

Change-Id: I9bb8340e7921bce32b3bd51b8a54f33bc74f41ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add rls data 11/29211/3
Tibor Frank [Fri, 2 Oct 2020 06:46:13 +0000 (08:46 +0200)]
Report: Add rls data

Change-Id: I903075db92a71964f792d2de42a69ca93103e11d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-spec: Add report_iteratve/3n-hsw/hoststack-00.md 97/29197/2
Tibor Frank [Thu, 1 Oct 2020 10:31:09 +0000 (12:31 +0200)]
job-spec: Add report_iteratve/3n-hsw/hoststack-00.md

Change-Id: I98ad76f5e1d1f9b4a7442aa9925ce68869123ac7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojop-spec: Add NAT44 tests 36/29036/6
Tibor Frank [Wed, 23 Sep 2020 11:20:17 +0000 (13:20 +0200)]
jop-spec: Add NAT44 tests

Add all which we want to run and disable those which are not ready.

Change-Id: I649ab290a1deec5d1c7de34a7bbe367d78a1e3ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTest: Add ramp-up phase to nat44ed-udir tests 89/29089/23
Jan Gelety [Fri, 11 Sep 2020 09:08:39 +0000 (11:08 +0200)]
Test: Add ramp-up phase to nat44ed-udir tests

Change-Id: I3aa50ec1ef9b0445014daa31e767323060f4a03f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add 2005 data 74/29174/1
Tibor Frank [Thu, 1 Oct 2020 07:04:19 +0000 (09:04 +0200)]
Report: Add 2005 data

Change-Id: I1a7546d399a7527a46a77629e5f6e2c258c562df
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFramework: Add possibility to send ramp-up traffic 88/29088/25
Jan Gelety [Fri, 11 Sep 2020 07:07:13 +0000 (09:07 +0200)]
Framework: Add possibility to send ramp-up traffic

Change-Id: Ie24184ca4ac2d6c7abc32f0f103e10bc402ad93b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate 1n-tx2 testbed docs for new thx2 servers 47/28047/11
Jieqiang Wang [Tue, 26 May 2020 16:16:58 +0000 (16:16 +0000)]
Update 1n-tx2 testbed docs for new thx2 servers

Change-Id: I64e1161bd6accbb478cec5314710ac4a68beda29
Signed-off-by: Jieqiang Wang <jieqiang.wang@arm.com>
3 years agoReport: Add data 66/29166/1
Tibor Frank [Wed, 30 Sep 2020 12:07:41 +0000 (14:07 +0200)]
Report: Add data

Change-Id: I827efd0850dde4d5d2c2b6e839973278ec8ec0a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 64/29164/2
Tibor Frank [Wed, 30 Sep 2020 10:18:27 +0000 (12:18 +0200)]
Report: Add data

Change-Id: Ice3945d471a5597a3d81152bee38eac1f1d91d1c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agotest: compute max_translations_per_thread based on worker threads number 50/29150/5
Jan Gelety [Fri, 11 Sep 2020 23:25:23 +0000 (01:25 +0200)]
test: compute max_translations_per_thread based on worker threads number

Change-Id: I1c638aef886bf37a9feb4a29e4949c7c8f19b717
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: main heap size value multiplication 77/29077/3
Jan Gelety [Fri, 11 Sep 2020 00:37:25 +0000 (02:37 +0200)]
Framework: main heap size value multiplication

- default value for main heap size set to 2G
- allow allocation of n x 2G in tests that need it

Change-Id: I02dafe6bc61649d2823486a3e983f66f5a213a88
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Fix specification file 62/29162/1
Tibor Frank [Wed, 30 Sep 2020 08:33:38 +0000 (10:33 +0200)]
Report: Fix specification file

Change-Id: I9a2664d73c0bdc99773fb24394aa59a399ae7a54
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 61/29161/2
Tibor Frank [Wed, 30 Sep 2020 08:17:53 +0000 (10:17 +0200)]
Report: Add data

Change-Id: Id55530bb4e9118e73f3630103333b902d07510f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoDowngrade vpp build to version 21.01-rc0~112-g2c714a0ce 60/29160/1
Jan Gelety [Sat, 12 Sep 2020 02:16:16 +0000 (04:16 +0200)]
Downgrade vpp build to version 21.01-rc0~112-g2c714a0ce

- until socket for stats is fixed

Change-Id: Iab63589246bd9b239be746530e270cb64f0cefe7
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAPI: Add collection for 29037/3 47/29147/1
Jan Gelety [Fri, 11 Sep 2020 20:40:49 +0000 (22:40 +0200)]
API: Add collection for 29037/3

Change-Id: I98f85a76e24fc471bee520bdf03e4252e81675d0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 45/29145/2
Jan Gelety [Fri, 11 Sep 2020 18:38:22 +0000 (20:38 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~118-g4537c3092

 - use new vpp ref build - centos7:
   21.01-rc0~118_g4537c30~b21

Change-Id: I8aec51085bb13a32ed5a8627785dbea1b5404342
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Hide DNV in spec 44/29144/1
Tibor Frank [Tue, 29 Sep 2020 08:34:04 +0000 (10:34 +0200)]
Report: Hide DNV in spec

Change-Id: I72a6b07e9785ef6eda05eef43cfee0577ffa7ba6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add vpp 2n-clx-cx556a, add dpdk 3n-tsh 43/29143/1
Tibor Frank [Tue, 29 Sep 2020 07:53:32 +0000 (09:53 +0200)]
Report: Add vpp 2n-clx-cx556a, add dpdk 3n-tsh

Change-Id: Ia5b0a70f430a4a26f07c1fa6b7506b839f3813bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add vpp2005-env5 data 42/29142/1
Tibor Frank [Tue, 29 Sep 2020 07:39:44 +0000 (09:39 +0200)]
Report: Add vpp2005-env5 data

Change-Id: I23241c399411dfc947f2be524dbe25a3094d03e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add RC2 data 39/29139/1
Tibor Frank [Tue, 29 Sep 2020 06:09:18 +0000 (08:09 +0200)]
Report: Add RC2 data

Change-Id: I52666cd0e5c9ebdf8ad12c3b609acf5f58e976ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Edit the configuration 08/29108/2
Tibor Frank [Mon, 28 Sep 2020 12:41:36 +0000 (14:41 +0200)]
Report: Edit the configuration

Change-Id: I3a3317903ee6e22fa0fe7fff9bf7d0208b19c8ae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoConstants: Lower Mellanox pps limit 20/28720/13
Vratko Polak [Thu, 24 Sep 2020 11:11:45 +0000 (13:11 +0200)]
Constants: Lower Mellanox pps limit

The previous 60 Mpps stil leads to ~30% duration stretching.

+ Add comment on why 36 Mpps was chosen as the new limit.

Change-Id: Ic11e8ece03939bdc8680cd7bc4122373583a2f17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoPAL: Fix processing of device tests 03/29103/1
Tibor Frank [Mon, 28 Sep 2020 08:30:46 +0000 (10:30 +0200)]
PAL: Fix processing of device tests

Change-Id: Ia0417eba8853112f405572189a5ef7bc034c10ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add RC2 data 01/29101/1
Tibor Frank [Mon, 28 Sep 2020 07:38:25 +0000 (09:38 +0200)]
Report: Add RC2 data

Change-Id: I6c4ae6b428571a392586f5b817c5392a0de8c727
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: Workaround AVF interface down until VPP-1934 86/29086/6
pmikus [Fri, 25 Sep 2020 07:35:45 +0000 (07:35 +0000)]
FIX: Workaround AVF interface down until VPP-1934

- Follow up https://jira.fd.io/browse/VPP-1934

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id0a26c5f67f229480332530a8531401d954f4422

3 years agotest: nat44det - add session number check 08/28708/43
Jan Gelety [Tue, 8 Sep 2020 10:14:21 +0000 (12:14 +0200)]
test: nat44det - add session number check

- some tests need to reduce rate for ramp-up phase
- some tests need to extend trail duration in ramp-up phase
- removed 2n1l-10ge2p1x710-ethip4udp-nat44det-h1-p63-s63 suite
  as nat out ports are randomly selected from available port range
  so T-Rex stateless is not able to provide required out2in traffic

Change-Id: I1145496610d202f81d911e68aa819844d7600918
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: replace snat by nat 52/29052/1
Tibor Frank [Thu, 24 Sep 2020 07:50:05 +0000 (09:50 +0200)]
Report: replace snat by nat

Change-Id: Ia329059955134c7fe30135a43bb1e1ec72b7bb6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Replace snat by nat 51/29051/3
Tibor Frank [Thu, 24 Sep 2020 07:40:01 +0000 (09:40 +0200)]
Trending: Replace snat by nat

Change-Id: Ifcb1311d46b7134502b142933fd1574eb94cc230
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: Race condition 41/29041/3
pmikus [Wed, 23 Sep 2020 12:44:06 +0000 (12:44 +0000)]
FIX: Race condition

avf tests works, but vfio-pci tests are following, the interfaces must
be in down state (ideally unbind, as vpp cannot pick them).

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I77af85ec4239059a5455ef68683ca129548bd7bd

3 years agoTrending: Fix graph file name 39/29039/1
Tibor Frank [Wed, 23 Sep 2020 11:55:39 +0000 (13:55 +0200)]
Trending: Fix graph file name

2n-clx-xxv710-64b-8t4c-ip4-features-snat44det-avf.html

Change-Id: I93b39f9edf3b0d85b08cec97ad647e398da83207
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix: use nat44 not snat44 26/29026/3
Jan Gelety [Thu, 10 Sep 2020 12:47:09 +0000 (14:47 +0200)]
Fix: use nat44 not snat44

Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFIX: Mellanox handling 31/29031/1
pmikus [Wed, 23 Sep 2020 09:47:02 +0000 (09:47 +0000)]
FIX: Mellanox handling

- From 2n-zn2 testing

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9b1f0916f0f1d90a223918cfe48409d29f2ee773

3 years agoInfra: Add 2n-xn2 24/29024/1
pmikus [Wed, 23 Sep 2020 07:10:28 +0000 (07:10 +0000)]
Infra: Add 2n-xn2

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2ff6526b5209dabf70c6593f60162d9b8c147014

3 years agoFramework: AVF 41/28941/4
pmikus [Fri, 18 Sep 2020 12:33:05 +0000 (12:33 +0000)]
Framework: AVF

Fix 1/3: Explicitly put PF interface up (this patch)
Fix 2/3: Done on TB
Fix 3/3: VPP bug displaying VF up if underlying PF is not up

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I45d66986ec76e6e14eebaad6828ef72724c626ab

3 years agotest: lisp moved to plugin 90/28990/2
Jan Gelety [Thu, 10 Sep 2020 06:14:45 +0000 (08:14 +0200)]
test: lisp moved to plugin

- lisp is moving to plugin: https://gerrit.fd.io/r/c/vpp/+/28972

Jira: CSIT-1597

Change-Id: I362f1931b5fc441da9c8a6dda933a66bfed8c4b8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: Heapsize configuration 36/28936/11
pmikus [Fri, 18 Sep 2020 09:46:31 +0000 (09:46 +0000)]
Framework: Heapsize configuration

- https://gerrit.fd.io/r/c/vpp/+/28829
- https://gerrit.fd.io/r/c/vpp/+/28896
- ip6 to be added later

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7b03b8ace5c5c7582d4a2f66bfd788a3ec80a916

3 years agoTrending: Hide 2n-clx-cx556a 87/28987/1
Tibor Frank [Tue, 22 Sep 2020 04:52:54 +0000 (06:52 +0200)]
Trending: Hide 2n-clx-cx556a

Change-Id: I3616ea486c96534534422057e2f80da486ded2b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTests: nat44ed-uni 75/28975/10
pmikus [Mon, 21 Sep 2020 11:36:21 +0000 (11:36 +0000)]
Tests: nat44ed-uni

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iee488e2244a4e253471310bc7fb9640c69c6b0cb

3 years agoUpdate of VPP_STABLE_VER files 69/28969/2
Jan Gelety [Wed, 9 Sep 2020 18:50:43 +0000 (20:50 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~68-g5cc11b121

 - use new vpp ref build - centos7:
   21.01-rc0~68_g5cc11b1~b9959

Change-Id: I253511da672a39f85450808a5f5feaf1b6c5dac9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: 2n-zn2 topology 74/28974/2
pmikus [Mon, 21 Sep 2020 10:27:37 +0000 (10:27 +0000)]
Framework: 2n-zn2 topology

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8207dc1c6b303b4f6c964126785fb714e74913f0

3 years agoPAL: Fix show runtime 73/28973/1
Tibor Frank [Mon, 21 Sep 2020 08:52:09 +0000 (10:52 +0200)]
PAL: Fix show runtime

Change-Id: Id42f087b2e3874a362f17596740feab6af8029d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data for RC1 detailed test results 64/28964/2
Tibor Frank [Mon, 21 Sep 2020 07:18:38 +0000 (09:18 +0200)]
Report: Add data for RC1 detailed test results

Change-Id: Idb15e437beed058133ca9938d45a80caf94ebd73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: Unknown trigger files 80/28880/4
pmikus [Wed, 16 Sep 2020 09:53:45 +0000 (09:53 +0000)]
FIX: Unknown trigger files

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d6108af943d729fecbcfe4867ea820a69b4eb1e

3 years agoTrending: Fix the name of csit-dpdk-perf-mrr-weekly-master-3n-tsh 63/28963/1
Tibor Frank [Mon, 21 Sep 2020 04:42:14 +0000 (06:42 +0200)]
Trending: Fix the name of csit-dpdk-perf-mrr-weekly-master-3n-tsh

Change-Id: I98731ba17d5fbfc10e1b1b91ff3f4afc52566b8d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Dislpay job name in err msg 62/28962/2
Tibor Frank [Mon, 21 Sep 2020 04:36:34 +0000 (06:36 +0200)]
PAL: Dislpay job name in err msg

Change-Id: I008d14bf1f72bcdc9b6bcb478ae851de03a176e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Dislpay job name in err msg 61/28961/2
Tibor Frank [Mon, 21 Sep 2020 04:30:08 +0000 (06:30 +0200)]
PAL: Dislpay job name in err msg

Change-Id: Id7509bd11ac32cc3f72e71c8826ccacdf1fe95a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Replace 2009.0-4 by 2009.0-5 37/28937/2
Tibor Frank [Fri, 18 Sep 2020 10:40:56 +0000 (12:40 +0200)]
Report: Replace 2009.0-4 by 2009.0-5

Change-Id: I87ed119665094d60b9a5452ea222f63fd45dd52c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdded amd 2n-zen2 testbed specification 79/28179/5
Maciek Konstantynowicz [Wed, 5 Aug 2020 13:53:58 +0000 (14:53 +0100)]
Added amd 2n-zen2 testbed specification

Change-Id: I429c64f89d1c93945da375072f6f9cb702fa687f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Fix plot_perf_box_name 15/28915/1
Tibor Frank [Fri, 18 Sep 2020 08:25:09 +0000 (10:25 +0200)]
Report: Fix plot_perf_box_name

Change-Id: I660819b881b1109f6f6bf250b66ba025e9278f56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add csit-dpdk-perf-mrr-weekly-master-3n-tsh 14/28914/2
Tibor Frank [Fri, 18 Sep 2020 08:15:13 +0000 (10:15 +0200)]
Trending: Add csit-dpdk-perf-mrr-weekly-master-3n-tsh

- alerting only
- todo: Graphs

Change-Id: I369d5c1bbcd634b1b4ebfeb4c08c9ac4a5c058ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: add 3n-tsh dpdk mrr weekly set 13/28913/1
Juraj Linkeš [Fri, 18 Sep 2020 07:55:33 +0000 (09:55 +0200)]
job-specs: add 3n-tsh dpdk mrr weekly set

Change-Id: I0cd41129538b5e4ec47f3876813f7df36da2977a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport: Compare NICs 12/28912/2
Tibor Frank [Fri, 18 Sep 2020 07:07:18 +0000 (09:07 +0200)]
Report: Compare NICs

Change-Id: I4a4dd9f12e0a3904c0e21b434af38f9fa974e361
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Add EPYC 06/28906/2
pmikus [Thu, 17 Sep 2020 15:36:22 +0000 (15:36 +0000)]
Ansible: Add EPYC

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic84b7cbcbcd269a5fe548b59d478cd6dfa57a952

3 years agoReport: Add RC1 data 11/28911/1
Tibor Frank [Fri, 18 Sep 2020 05:19:53 +0000 (07:19 +0200)]
Report: Add RC1 data

Change-Id: Ied3df918c0798df546b447b8ffb8d77938a3b904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add snat44det tests to graphs 81/28881/1
Tibor Frank [Wed, 16 Sep 2020 10:39:30 +0000 (12:39 +0200)]
Report: Add snat44det tests to graphs

Change-Id: I65b6b210d500c0f5aedd39e6c70c3c48b8654dfd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add snat44det tests to trending graphs 78/28878/2
Tibor Frank [Wed, 16 Sep 2020 08:42:39 +0000 (10:42 +0200)]
Trending: Add snat44det tests to trending graphs

Change-Id: I7fe24c05a4f7f17355c3bf5c4f635f412656d52f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Fix units in speedup graphs 77/28877/1
Tibor Frank [Wed, 16 Sep 2020 07:35:40 +0000 (09:35 +0200)]
Report: Fix units in speedup graphs

Change-Id: I6e0dc888d00df03e3fbd8cac62d6db19ef6507cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd ipsec async mode performance test cases 08/28508/8
Yulong Pei [Wed, 19 Aug 2020 10:30:34 +0000 (18:30 +0800)]
Add ipsec async mode performance test cases

In VPP 20.05, vpp added async crypto engine that support to use QAT hardware
to do encryption and decryption, vnet/ipsec enabled async mode to use async
crypto engine.

Current async crypto engine also use dpdk_cryptodev as async handlers, in the
future it may add other native QAT driver as async handlers.

Note that async crypto engine is to support vnet/ipsec, it is different
with current existing dpdk backend which itself has ESP implementation
in plugins/dpdk/ipsec.

Change-Id: I4e6eaa7ca1eddb8b1c45212de0684fb26907119b
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
3 years agoReport: Configure rls2009 Report 38/28738/1
Tibor Frank [Thu, 10 Sep 2020 11:05:27 +0000 (13:05 +0200)]
Report: Configure rls2009 Report

Change-Id: I63c058e5fda100cce8e1b83acb8dfe988f1fd904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: Add NAT44 04/28704/2
Tibor Frank [Tue, 8 Sep 2020 07:45:55 +0000 (09:45 +0200)]
job-specs: Add NAT44

Change-Id: If8fbcf6a7720eb75094966b352495d1435f44148
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoVPP-DEV API COV: Add NAT44-DET tests 97/28697/1
Martin Balaz [Mon, 7 Sep 2020 15:23:02 +0000 (17:23 +0200)]
VPP-DEV API COV: Add NAT44-DET tests

Jira: CSIT-1756

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: Ia6fdc6df91f36ffcabd428326195bb9d8f967e52

3 years agoVPP-DEV API COV: Add NAT44-ED tests 59/28559/7
Jan Gelety [Sat, 8 Aug 2020 10:36:02 +0000 (12:36 +0200)]
VPP-DEV API COV: Add NAT44-ED tests

Jira: CSIT-1755

Change-Id: I34baa22a49f44da3fa80d91fa2f4132c982fe610
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 91/28691/1
Jan Gelety [Thu, 3 Sep 2020 23:18:00 +0000 (01:18 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~386-g5c721baeb

 - use new vpp ref build - centos7:
   20.09-rc0~386_g5c721ba~b9869

Change-Id: I0780c9248025ed384596331fc0ec2b2eec20acbf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFIX: use correct minimal packet length in scapy scripts 77/28677/3
Jan Gelety [Thu, 3 Sep 2020 18:39:03 +0000 (20:39 +0200)]
FIX: use correct minimal packet length in scapy scripts

Change-Id: Icd1b4a3edb203cb0963203bb2e3e765b35c81600
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix local CSIT deployment 98/28598/3
Tomas Alexy [Fri, 28 Aug 2020 13:34:54 +0000 (15:34 +0200)]
Fix local CSIT deployment

Change-Id: I6ccf3cc11b4343ebcf02f30a01eddb9204ba53ee
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
3 years agoTrending, Report: use test tag ethip4udp-snat44det-h1-p1-s1 49/28649/2
Tibor Frank [Thu, 3 Sep 2020 07:26:34 +0000 (09:26 +0200)]
Trending, Report: use test tag ethip4udp-snat44det-h1-p1-s1

- use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44

Change-Id: Ie4897430c3b3074fdf3440d56cc1794a4c3046dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFramework: Code aligments 89/28589/5
pmikus [Thu, 27 Aug 2020 07:47:31 +0000 (07:47 +0000)]
Framework: Code aligments

+ Unifying code structures
  - To easily plug another DUT
+ New PCI PassThrough templates
+ Improved perf stat on cores allocated in test.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I325f17b977314f93cb91818feddfddf3e607eb8a

3 years agoFramework: Bump DPDK 20.08 71/28571/21
pmikus [Tue, 25 Aug 2020 06:57:59 +0000 (06:57 +0000)]
Framework: Bump DPDK 20.08

+ DPDK 20.08
+ Migrate make -> meson
+ Fix all trending issues

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I31dcb22627c0f8d17ec63c5b138a2da958b006f4

3 years agojob_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44 42/28642/1
Jan Gelety [Sun, 9 Aug 2020 05:55:12 +0000 (07:55 +0200)]
job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44

Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 38/28638/1
Jan Gelety [Sat, 8 Aug 2020 23:41:33 +0000 (01:41 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~344-gedc816355

 - use new vpp ref build - centos7:
   20.09-rc0~344_gedc8163~b9827

Change-Id: Iad2130f00098235dda068fd45594dd58cd62b175
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAnsible: fix the wrong module and mode for vpp_device.yaml in cleanup role 46/28046/4
Jieqiang Wang [Tue, 9 Jun 2020 11:29:26 +0000 (11:29 +0000)]
Ansible: fix the wrong module and mode for vpp_device.yaml in cleanup role

The src field for ansible template module used in vpp_device.yaml of cleanup role should be jinja2 format and the mode for script to be transfered to the remote host should be executable for the file owner. Fix this error by replacing the ansible template module with ansible copy module and setting the file permission to be 744.

Change-Id: Ibf80b0c5bec77a13509122795a5b12b6faba2f8e
Signed-off-by: Jieqiang Wang <jieqiang.wang@arm.com>
3 years agoTrending: Add DPDK version to alerts 00/28600/1
Tibor Frank [Fri, 28 Aug 2020 08:37:29 +0000 (10:37 +0200)]
Trending: Add DPDK version to alerts

Change-Id: I2f1a16ecfa0336e9c5a52a2efcbfcb2caddee089
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add identification of DUT to alerting email 99/28599/1
Tibor Frank [Fri, 28 Aug 2020 07:44:06 +0000 (09:44 +0200)]
Trending: Add identification of DUT to alerting email

Change-Id: I2e63f16aef48e68b0e86e913431bed7df01f1b70
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Add arm nomads into pool 97/28597/1
pmikus [Fri, 28 Aug 2020 07:07:07 +0000 (07:07 +0000)]
Ansible: Add arm nomads into pool

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I99a33a15e7e87fe6f56deb1ab0e4ce3091508244

3 years agoTrending: Add DPDK tests to list of failed tests 88/28588/1
Tibor Frank [Thu, 27 Aug 2020 06:29:05 +0000 (08:29 +0200)]
Trending: Add DPDK tests to list of failed tests

Change-Id: I25e805125528d67a5eea277df6d88549f129d137
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending, Report: nat44-deterministc test names change 77/28577/4
Tibor Frank [Tue, 25 Aug 2020 12:58:42 +0000 (14:58 +0200)]
Trending, Report: nat44-deterministc test names change

Change-Id: I1956ccaff625f287995765a4c2b0b46cb00d0d65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: remove ip4-08.md from 3n-hsw and 3n-skx 85/28585/1
Tibor Frank [Wed, 26 Aug 2020 07:49:05 +0000 (09:49 +0200)]
job-specs: remove ip4-08.md from 3n-hsw and 3n-skx

- They duplicate specification which is in ip4-01.md files

Change-Id: I818e1c165415b1f7d53ed28ffb345f07e6ac0576
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoJob-specs: Fix the runs durations 73/28573/1
Tibor Frank [Tue, 25 Aug 2020 09:23:49 +0000 (11:23 +0200)]
Job-specs: Fix the runs durations

Change-Id: Ifeb5455140e911b804df55b4ceeda26575ae9da9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: nat44-deterministc test names change 65/28565/7
Tibor Frank [Mon, 24 Aug 2020 08:50:49 +0000 (10:50 +0200)]
job-specs: nat44-deterministc test names change

Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoT-Rex: 2.82, core pin, 8 workers 84/28184/6
pmikus [Thu, 6 Aug 2020 08:45:49 +0000 (08:45 +0000)]
T-Rex: 2.82, core pin, 8 workers

+ Bump T-Rex version. We need new features for ASTF test.
+ Apply core pining. Results in a more stable performance.
+ Tweak the number of T-Rex workers.
 + We need an even value to achieve ymmetric performance with pinning.
 + Value 8 was selected as a best compromise.

This is a combination of 3 commits.
This is the 1st commit message:

T-Rex: 2.82

This is the commit message #2:

Change Trex to CORE_MASK_PIN mode to improve performance

https://trex-tgn.cisco.com/trex/doc/trex_stateless.html#_core_masking_per_interface
Above link have below explaination,

"When the profile is symmetric, performance can be improved by pinning half of
the cores to port 0, and half of the cores to port 1, thus avoiding cache
trashing and bouncing."

The reason to change this is that to run CSIT with 100G NIC often failed with
"TRex stateless runtime error timeout", it caused by Trex can not send enough
traffic within the fixed duration.

by change to CORE_MASK_PIN mode fix the issue.

Not editing ASTF, as that supports different options.

This is the commit message #3:

Experiment: Vary number of TRex workers

With CORE_MASK_PIN, we can get more predictable time distribution.
Decided to use 8 workers, that gives good results
both for high end (RDMA-core l2patch) and low end (vhost) tests.

Change-Id: I5c61127799e0624464e960fcb980ad1c4058e744
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFramework: Qemu alignments 58/28558/2
pmikus [Fri, 21 Aug 2020 09:53:24 +0000 (09:53 +0000)]
Framework: Qemu alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2781e85f44acffb4f8d7f02326ba2ca668dad0c5

3 years agoFix: NAT44 deterministic moved to separate det44 plugin 29/28529/11
Jan Gelety [Sat, 8 Aug 2020 14:41:24 +0000 (16:41 +0200)]
Fix: NAT44 deterministic moved to separate det44 plugin

- align CSIT code with VPP code changes for NAT44 deterministic
  (DET44) feature

- align test names according to snat44ed tests

- remove obsolete 3-node nat tests

- remove 2n1l-10ge2p1x710-ethip4udp-snat44det-h1048576-p63-s66060288 tests
  (not enough memory for such high number of sessions)

Change-Id: I9a22b99b4cfa56d18e9c7ef9c58296e202567d42
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix: Use new-style interface variables 76/28376/2
Vratko Polak [Thu, 13 Aug 2020 13:13:35 +0000 (15:13 +0200)]
Fix: Use new-style interface variables

The old-style variables contain None in some places,
mainly in SRv6 proxy tests.

Change-Id: If3887a7dba051454c504b345a6a316d5d69d0139
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFramework: use 'stl' in trex stateless profile names 12/28512/3
Jan Gelety [Sat, 8 Aug 2020 05:04:20 +0000 (07:04 +0200)]
Framework: use 'stl' in trex stateless profile names

Change-Id: I74641cc89d2f25d50b67d51bf2567082b420aabb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPAL: Add processing of throughput in Gbps 05/28505/3
Tibor Frank [Wed, 19 Aug 2020 08:00:14 +0000 (10:00 +0200)]
PAL: Add processing of throughput in Gbps

Change-Id: I264e329fa94cddf6a759f14bf567c56a50d1895d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd Intel E810CQ 100G NIC configuration 10/27910/7
Yulong Pei [Tue, 14 Jul 2020 19:44:44 +0000 (12:44 -0700)]
Add Intel E810CQ 100G NIC configuration

for Intel E810CQ 100G NIC, kernel driver of PF is ice, kernel driver of VF
is iavf, its VF hardware support VPP native avf driver.

Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ic8d86e5ee00057bbbcd09df619a38bd1371c8fd7

3 years agoSign off on relicensing of scapy related files for Intel 17/28417/2
Ray Kinsella [Fri, 14 Aug 2020 11:22:04 +0000 (12:22 +0100)]
Sign off on relicensing of scapy related files for Intel

Signed-off-by: Ray Kinsella <mdr@ashroe.eu>
Change-Id: I5f328b702ff7faffd432d08925cf1c247de1d680

3 years agoSign off on relicensing of scapy related files for Cisco. 77/28377/4
Ed Warnicke [Thu, 13 Aug 2020 16:18:14 +0000 (11:18 -0500)]
Sign off on relicensing of scapy related files for Cisco.

Change-Id: Ia27726d8bed649a55ac93ea3464b8bf278fe9d8f
Signed-off-by: Ed Warnicke <hagbard@gmail.com>
3 years agoPerf: NAT44 endpoint-dependent mode - tcp, part I 76/28176/30
Jan Gelety [Tue, 4 Aug 2020 21:48:36 +0000 (23:48 +0200)]
Perf: NAT44 endpoint-dependent mode - tcp, part I

Jira: CSIT-1736

- tcp synthetic profiles w/o data packets
- tcp cps perf tests, phase I (no special "search cps" KW)

Change-Id: I52be34b0fdd51d7a33c8c5de9b46d7064c48f7fa
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPerf: NAT44 endpoint-dependent mode - udp, part I 05/28205/8
Jan Gelety [Thu, 6 Aug 2020 01:34:31 +0000 (03:34 +0200)]
Perf: NAT44 endpoint-dependent mode - udp, part I

- continuation of https://gerrit.fd.io/r/c/csit/+/26898 as there was
reached limit of changes (1000)

Jira: CSIT-1711

- udp synthetic profiles w/o data packets
- udp cps perf tests, phase I (no special "search cps" KW)

Part I means that we are using MRR tests to collect traffic data
until there is ready new CPS test type with corresponding algorithm.

Change-Id: I0d30feb9ecf1d0bff937152656f8eb422f831378
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: Qemu alignments 42/28442/2
pmikus [Tue, 18 Aug 2020 09:57:26 +0000 (09:57 +0000)]
Framework: Qemu alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I20098fca8fb513accef3edc9a72bfd3c56bf9be2

3 years agoFramework: Alignments 39/28439/1
pmikus [Tue, 18 Aug 2020 09:38:28 +0000 (09:38 +0000)]
Framework: Alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b535ea61ab68f6e37989ffc942979cdfd24f55e

3 years agoFramework: Profiles load 36/28036/14
pmikus [Wed, 22 Jul 2020 12:35:54 +0000 (12:35 +0000)]
Framework: Profiles load

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iab84aff31a23bb9d8e1165f5314004803fd8a501

3 years agoMeasure latency only in special cases 38/28038/6
Vratko Polak [Fri, 7 Aug 2020 12:31:42 +0000 (14:31 +0200)]
Measure latency only in special cases

+ Measure latency in 90/50/10/0% PDR loads in ndrpdr tests.
+ Do not measure latency anywhere else.
- Needs manual editing to re-enable in soak tests.

Change-Id: I69fa11bfcf71012f683061c5effea52a1be91620
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 25/28425/2
Jan Gelety [Fri, 7 Aug 2020 10:46:06 +0000 (12:46 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~296-g17ec577f7

 - use new vpp ref build - centos7:
   20.09-rc0~296_g17ec577~b9779

Change-Id: I4b66014a4c39adc3c1e22fb29ef000474e1ac099
Signed-off-by: Jan Gelety <jgelety@cisco.com>