csit.git
3 years agoReport: Add data 42/29242/1
Tibor Frank [Mon, 5 Oct 2020 12:50:31 +0000 (14:50 +0200)]
Report: Add data

- DNV VPP tests
- 3n-tsh MRR 2005-5
- MRR Comparisons for skx, hsw and clx

Change-Id: Ibb73e0f8234d2eb27b6a386675492efc9f050247
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 881f1a4c12fe727274b15551b12c37b364dd32e2)

3 years agoReport: Add rls data 41/29241/1
Tibor Frank [Mon, 5 Oct 2020 12:07:16 +0000 (14:07 +0200)]
Report: Add rls data

Change-Id: I104c61ae1aa26fe9d057a16275d8cc2f12abef18
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 92fe102505f8d10a5133313a976f8a07da1192d1)

3 years agoReport: Fix NAT44 40/29240/1
Tibor Frank [Mon, 5 Oct 2020 08:55:04 +0000 (10:55 +0200)]
Report: Fix NAT44

Change-Id: I9c0b8571673a0fc839430a4dce2ef0e8b9b017e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7dded9c8852d5401d6e69e1a5a9e5c92b6debc51)

3 years agoReport: Add NAT44 38/29238/1
Tibor Frank [Mon, 28 Sep 2020 14:02:01 +0000 (16:02 +0200)]
Report: Add NAT44

Change-Id: I9bb8340e7921bce32b3bd51b8a54f33bc74f41ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3f066fb53b32b82403197291fc1260025be90592)

3 years agoReport: Add rls data 37/29237/1
Tibor Frank [Fri, 2 Oct 2020 06:46:13 +0000 (08:46 +0200)]
Report: Add rls data

Change-Id: I903075db92a71964f792d2de42a69ca93103e11d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6d2573c5cfa89389817eb672e7023c7b3b20d26f)

3 years agojob-spec: Add report_iteratve/3n-hsw/hoststack-00.md 85/29185/1
Tibor Frank [Thu, 1 Oct 2020 10:31:09 +0000 (12:31 +0200)]
job-spec: Add report_iteratve/3n-hsw/hoststack-00.md

Change-Id: I98ad76f5e1d1f9b4a7442aa9925ce68869123ac7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b3ddffc6a3065f78f4b062bf3085ba4f525dff1e)

3 years agojop-spec: Add NAT44 tests 83/29183/1
Tibor Frank [Wed, 23 Sep 2020 11:20:17 +0000 (13:20 +0200)]
jop-spec: Add NAT44 tests

Add all which we want to run and disable those which are not ready.

Change-Id: I649ab290a1deec5d1c7de34a7bbe367d78a1e3ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ceec2475a24c1e252b1f98674276da8513646beb)

3 years agoTest: Add ramp-up phase to nat44ed-udir tests 05/29205/1
Jan Gelety [Fri, 11 Sep 2020 09:08:39 +0000 (11:08 +0200)]
Test: Add ramp-up phase to nat44ed-udir tests

Change-Id: I3aa50ec1ef9b0445014daa31e767323060f4a03f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit d68be735d882bafcb672ebb27a66efbcabbeb02d)

Change-Id: Iad67c8445e18b22eccbea25d75b91827b398775f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoDownload vpp 20.09-release artifacts from release repository 02/29202/1
Jan Gelety [Sat, 12 Sep 2020 18:32:10 +0000 (20:32 +0200)]
Download vpp 20.09-release artifacts from release repository

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: If5e112ee0c0704ffe3d199bc41bb00e80af37183

3 years agoUse vpp 20.09-release packages 75/29175/2
Jan Gelety [Sat, 12 Sep 2020 13:22:44 +0000 (15:22 +0200)]
Use vpp 20.09-release packages

Note: Currently release packages are available in repositary
      https://packagecloud.io/install/repositories/fdio/2009
      not in repositary
      https://packagecloud.io/install/repositories/fdio/release

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I955c3bafbb2adc1eda43efba7eb108c7c0440781

3 years agoReport: Add 2005 data 78/29178/1
Tibor Frank [Thu, 1 Oct 2020 07:04:19 +0000 (09:04 +0200)]
Report: Add 2005 data

Change-Id: I1a7546d399a7527a46a77629e5f6e2c258c562df
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2444fb95f7f1e9b19506c198080317431d4f8739)

3 years agoFramework: Add possibility to send ramp-up traffic 72/29172/1
Jan Gelety [Fri, 11 Sep 2020 07:07:13 +0000 (09:07 +0200)]
Framework: Add possibility to send ramp-up traffic

Change-Id: Ie24184ca4ac2d6c7abc32f0f103e10bc402ad93b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 61044d391d6e8d6b47d0d4f156071bd61cd278df)

Change-Id: I50e2a674784688e6eeea566fc2bc4d45a8ecfb8b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 77/29177/1
Tibor Frank [Wed, 30 Sep 2020 12:07:41 +0000 (14:07 +0200)]
Report: Add data

Change-Id: I827efd0850dde4d5d2c2b6e839973278ec8ec0a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bacb1d9fb56a0c8ea011cafe18d078f89088a8de)

3 years agotest: compute max_translations_per_thread based on worker threads number 65/29165/2
Jan Gelety [Fri, 11 Sep 2020 23:25:23 +0000 (01:25 +0200)]
test: compute max_translations_per_thread based on worker threads number

Change-Id: I1c638aef886bf37a9feb4a29e4949c7c8f19b717
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit d99951620507d354c4803eb1ee26609d992b70b3)

Change-Id: Iaf5b4dffe603b0cf5cf0430fc6ca20acb7a01fda
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 76/29176/1
Tibor Frank [Wed, 30 Sep 2020 10:18:27 +0000 (12:18 +0200)]
Report: Add data

Change-Id: Ice3945d471a5597a3d81152bee38eac1f1d91d1c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 655064008428d185b219fcae8c9065c88be4f0e5)

3 years agoReport: Fix specification file 35/29135/1
Tibor Frank [Wed, 30 Sep 2020 08:33:38 +0000 (10:33 +0200)]
Report: Fix specification file

Change-Id: I9a2664d73c0bdc99773fb24394aa59a399ae7a54
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ba9ef5fc29e02a99ab48acb92f720bcdea43bd97)

3 years agoReport: Add data 34/29134/1
Tibor Frank [Wed, 30 Sep 2020 08:17:53 +0000 (10:17 +0200)]
Report: Add data

Change-Id: Id55530bb4e9118e73f3630103333b902d07510f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e173b080cec3ca8e2be5c485e337c93b36095c31)

3 years agoConstants: Lower Mellanox pps limit 21/29121/2
Vratko Polak [Thu, 24 Sep 2020 11:11:45 +0000 (13:11 +0200)]
Constants: Lower Mellanox pps limit

The previous 60 Mpps stil leads to ~30% duration stretching.

+ Add comment on why 36 Mpps was chosen as the new limit.

Change-Id: Ic11e8ece03939bdc8680cd7bc4122373583a2f17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 34dadfe8d168b72340b497469ee6550349689f1a)

3 years agoReport: Hide DNV in spec 26/29126/1
Tibor Frank [Tue, 29 Sep 2020 08:34:04 +0000 (10:34 +0200)]
Report: Hide DNV in spec

Change-Id: I72a6b07e9785ef6eda05eef43cfee0577ffa7ba6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2f6b6ee9553b9ae0d81e00d225c811e683b01c80)

3 years agoUpdate of VPP_STABLE_VER files 41/29141/2
Jan Gelety [Fri, 11 Sep 2020 17:19:34 +0000 (19:19 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc2~21-g6cb106314

 - use new vpp ref build - centos7:
   20.09-rc2~21_g6cb1063~b9

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Id6a9c229ac1308d594dacb41f435278526e17b81

3 years agoReport: Add vpp 2n-clx-cx556a, add dpdk 3n-tsh 25/29125/1
Tibor Frank [Tue, 29 Sep 2020 07:53:32 +0000 (09:53 +0200)]
Report: Add vpp 2n-clx-cx556a, add dpdk 3n-tsh

Change-Id: Ia5b0a70f430a4a26f07c1fa6b7506b839f3813bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1df0b73ad1ef5dc8d8187142902a67703de93a0a)

3 years agoReport: Add vpp2005-env5 data 24/29124/1
Tibor Frank [Tue, 29 Sep 2020 07:39:44 +0000 (09:39 +0200)]
Report: Add vpp2005-env5 data

Change-Id: I23241c399411dfc947f2be524dbe25a3094d03e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6683da8920bfacf2e360c41dad9aeea65c2a79e8)

3 years agoReport: Add RC2 data 23/29123/1
Tibor Frank [Tue, 29 Sep 2020 06:09:18 +0000 (08:09 +0200)]
Report: Add RC2 data

Change-Id: I52666cd0e5c9ebdf8ad12c3b609acf5f58e976ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit dc373500b723dcdf45559e21f18a639e44da8035)

3 years agoReport: Edit the configuration 22/29122/1
Tibor Frank [Mon, 28 Sep 2020 12:41:36 +0000 (14:41 +0200)]
Report: Edit the configuration

Change-Id: I3a3317903ee6e22fa0fe7fff9bf7d0208b19c8ae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c4229710f97c1cc155a44d0c8d9cc3682900f6e2)

3 years agoPAL: Fix processing of device tests 20/29120/1
Tibor Frank [Mon, 28 Sep 2020 08:30:46 +0000 (10:30 +0200)]
PAL: Fix processing of device tests

Change-Id: Ia0417eba8853112f405572189a5ef7bc034c10ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e15746adc0c6b54dc74ea40fc86e794f90ecabf9)

3 years agoReport: Add RC2 data 19/29119/1
Tibor Frank [Mon, 28 Sep 2020 07:38:25 +0000 (09:38 +0200)]
Report: Add RC2 data

Change-Id: I6c4ae6b428571a392586f5b817c5392a0de8c727
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6f8a69729c108b5efc7f36bc2daf5d71afd25196)

3 years agoFIX: Workaround AVF interface down until VPP-1934 71/29071/5
pmikus [Fri, 25 Sep 2020 07:35:45 +0000 (07:35 +0000)]
FIX: Workaround AVF interface down until VPP-1934

- Follow up https://jira.fd.io/browse/VPP-1934

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id0a26c5f67f229480332530a8531401d954f4422

3 years agotest: nat44det - add session number check 55/29055/1
Jan Gelety [Tue, 8 Sep 2020 10:14:21 +0000 (12:14 +0200)]
test: nat44det - add session number check

- some tests need to reduce rate for ramp-up phase
- some tests need to extend trail duration in ramp-up phase
- removed 2n1l-10ge2p1x710-ethip4udp-nat44det-h1-p63-s63 suite
  as nat out ports are randomly selected from available port range
  so T-Rex stateless is not able to provide required out2in traffic

Change-Id: I1145496610d202f81d911e68aa819844d7600918
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 3b408b7ea702dd3817442186035121fe862cbf7f)

Change-Id: I53da8c086373d06e0842e5563964d9287c0fa403
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 53/29053/1
Jan Gelety [Thu, 10 Sep 2020 20:20:44 +0000 (22:20 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc2~11-gef73a0725

 - use new vpp ref build - centos7:
   20.09-rc2~11_gef73a07~b48

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Id2238a1511ca83ade238b5c1cf21ce13a415fc1f

3 years agoReport: replace snat by nat 65/29065/1
Tibor Frank [Thu, 24 Sep 2020 07:50:05 +0000 (09:50 +0200)]
Report: replace snat by nat

Change-Id: Ia329059955134c7fe30135a43bb1e1ec72b7bb6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2e19aee8db50a90ca11a6d9ca9fb376e84d8897c)

3 years agoTrending: Replace snat by nat 64/29064/1
Tibor Frank [Thu, 24 Sep 2020 07:40:01 +0000 (09:40 +0200)]
Trending: Replace snat by nat

Change-Id: Ifcb1311d46b7134502b142933fd1574eb94cc230
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7bcc61b0ab7fb4dd46fd38e361df6ef8aa8e181b)

3 years agoFIX: Race condition 13/29013/1
pmikus [Wed, 23 Sep 2020 12:44:06 +0000 (12:44 +0000)]
FIX: Race condition

avf tests works, but vfio-pci tests are following, the interfaces must
be in down state (ideally unbind, as vpp cannot pick them).

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I77af85ec4239059a5455ef68683ca129548bd7bd

3 years agoTrending: Fix graph file name 12/29012/1
Tibor Frank [Wed, 23 Sep 2020 11:55:39 +0000 (13:55 +0200)]
Trending: Fix graph file name

2n-clx-xxv710-64b-8t4c-ip4-features-snat44det-avf.html

Change-Id: I93b39f9edf3b0d85b08cec97ad647e398da83207
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 49a7f2b2830d7684f19508afc53f04288aae241e)

3 years agoFix: use nat44 not snat44 34/29034/2
Jan Gelety [Thu, 10 Sep 2020 12:47:09 +0000 (14:47 +0200)]
Fix: use nat44 not snat44

Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit a0362eb00573cda326b7067f020359d5913e76fd)

Change-Id: I6fe01e18ca126800ffba344800b622562894ee05
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: AVF 32/28932/3
pmikus [Fri, 18 Sep 2020 12:33:05 +0000 (12:33 +0000)]
Framework: AVF

Fix 1/3: Explicitly put PF interface up (this patch)
Fix 2/3: Done on TB
Fix 3/3: VPP bug displaying VF up if underlying PF is not up

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I45d66986ec76e6e14eebaad6828ef72724c626ab

3 years agoTests: nat44ed-uni 34/28934/1
pmikus [Mon, 21 Sep 2020 11:36:21 +0000 (11:36 +0000)]
Tests: nat44ed-uni

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iee488e2244a4e253471310bc7fb9640c69c6b0cb
(cherry picked from commit d3f265ab0e44baa9fe223643240253f9d54c1b4c)

3 years agoUpdate of VPP_STABLE_VER files 70/28970/2
Jan Gelety [Wed, 9 Sep 2020 18:56:53 +0000 (20:56 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc2~0-ga87deb77d

 - use new vpp ref build - centos7:
   20.09-rc2~0_ga87deb7~b37

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I7d01df8f15ed7154ad705f06b6981c614e694c1b

3 years agoPAL: Fix show runtime 33/28933/1
Tibor Frank [Mon, 21 Sep 2020 08:52:09 +0000 (10:52 +0200)]
PAL: Fix show runtime

Change-Id: Id42f087b2e3874a362f17596740feab6af8029d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0df92678006f857a1ed051d9077868270ec1f543)

3 years agoReport: Add data for RC1 detailed test results 31/28931/1
Tibor Frank [Mon, 21 Sep 2020 07:18:38 +0000 (09:18 +0200)]
Report: Add data for RC1 detailed test results

Change-Id: Idb15e437beed058133ca9938d45a80caf94ebd73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0e3903c0ebdf1cb8e95b096012539cb7925ea6d0)

3 years agoFIX: Unknown trigger files 74/28874/3
pmikus [Wed, 16 Sep 2020 09:53:45 +0000 (09:53 +0000)]
FIX: Unknown trigger files

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d6108af943d729fecbcfe4867ea820a69b4eb1e

3 years agoPAL: Dislpay job name in err msg 28/28928/1
Tibor Frank [Mon, 21 Sep 2020 04:36:34 +0000 (06:36 +0200)]
PAL: Dislpay job name in err msg

Change-Id: I008d14bf1f72bcdc9b6bcb478ae851de03a176e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 28b09d77b497685553d28ad7b0a98f08e89b7f7f)

3 years agoPAL: Dislpay job name in err msg 26/28926/1
Tibor Frank [Mon, 21 Sep 2020 04:30:08 +0000 (06:30 +0200)]
PAL: Dislpay job name in err msg

Change-Id: Id7509bd11ac32cc3f72e71c8826ccacdf1fe95a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit aec0a24a1a2bfb677a3cda5865e4b9c8e2011b68)

3 years agoReport: Replace 2009.0-4 by 2009.0-5 18/28918/1
Tibor Frank [Fri, 18 Sep 2020 10:40:56 +0000 (12:40 +0200)]
Report: Replace 2009.0-4 by 2009.0-5

Change-Id: I87ed119665094d60b9a5452ea222f63fd45dd52c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a8ac75302d82a69667611ba1c2e654cf545eb277)

3 years agoReport: Fix plot_perf_box_name 17/28917/1
Tibor Frank [Fri, 18 Sep 2020 08:25:09 +0000 (10:25 +0200)]
Report: Fix plot_perf_box_name

Change-Id: I660819b881b1109f6f6bf250b66ba025e9278f56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ee1c6ce7dd157e141b1911dd1332aac754b0ad8f)

3 years agoReport: Compare NICs 16/28916/1
Tibor Frank [Fri, 18 Sep 2020 07:07:18 +0000 (09:07 +0200)]
Report: Compare NICs

Change-Id: I4a4dd9f12e0a3904c0e21b434af38f9fa974e361
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3b0487f89bca5796c1703659f8a4a423e3aa5f86)

3 years agoReport: Add RC1 data 75/28875/1
Tibor Frank [Fri, 18 Sep 2020 05:19:53 +0000 (07:19 +0200)]
Report: Add RC1 data

Change-Id: Ied3df918c0798df546b447b8ffb8d77938a3b904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d1eb688ec2097322842c9be6864dc3538c61752a)

3 years agoReport: Add snat44det tests to graphs 69/28869/1
Tibor Frank [Wed, 16 Sep 2020 10:39:30 +0000 (12:39 +0200)]
Report: Add snat44det tests to graphs

Change-Id: I65b6b210d500c0f5aedd39e6c70c3c48b8654dfd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 00d6027bc4219d7a8c65c202c32c94809303cd5d)

3 years agoTrending: Add snat44det tests to trending graphs 67/28867/1
Tibor Frank [Wed, 16 Sep 2020 08:42:39 +0000 (10:42 +0200)]
Trending: Add snat44det tests to trending graphs

Change-Id: I7fe24c05a4f7f17355c3bf5c4f635f412656d52f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a06adaf1ebfd3297d0f7a3d7beee0e3971de0ca8)

3 years agoReport: Fix units in speedup graphs 65/28865/1
Tibor Frank [Wed, 16 Sep 2020 07:35:40 +0000 (09:35 +0200)]
Report: Fix units in speedup graphs

Change-Id: I6e0dc888d00df03e3fbd8cac62d6db19ef6507cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b61bb756579eaa22c35f54d3b2f8d0dffc682bbe)

3 years agoAdd ipsec async mode performance test cases 00/28800/1
Yulong Pei [Wed, 19 Aug 2020 10:30:34 +0000 (18:30 +0800)]
Add ipsec async mode performance test cases

In VPP 20.05, vpp added async crypto engine that support to use QAT hardware
to do encryption and decryption, vnet/ipsec enabled async mode to use async
crypto engine.

Current async crypto engine also use dpdk_cryptodev as async handlers, in the
future it may add other native QAT driver as async handlers.

Note that async crypto engine is to support vnet/ipsec, it is different
with current existing dpdk backend which itself has ESP implementation
in plugins/dpdk/ipsec.

Change-Id: I4e6eaa7ca1eddb8b1c45212de0684fb26907119b
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
(cherry picked from commit d12f510caf3bb83695488684eb07de79b3e753b9)

3 years agoReport: Configure rls2009 Report 50/28550/1
Tibor Frank [Thu, 10 Sep 2020 11:05:27 +0000 (13:05 +0200)]
Report: Configure rls2009 Report

Change-Id: I63c058e5fda100cce8e1b83acb8dfe988f1fd904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d3763454526d2886ce8d0210b788c1d90540e9aa)

3 years agojob-specs: Add NAT44 48/28548/1
Tibor Frank [Tue, 8 Sep 2020 07:45:55 +0000 (09:45 +0200)]
job-specs: Add NAT44

Change-Id: If8fbcf6a7720eb75094966b352495d1435f44148
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1cc5a7186a5bf3d88ff6a702efa0ae2bf8a10a91)

3 years agoUpdate of VPP_REPO_URL and VPP_STABLE_VER files 26/28726/2
Jan Gelety [Wed, 9 Sep 2020 01:46:47 +0000 (03:46 +0200)]
Update of VPP_REPO_URL and VPP_STABLE_VER files

- use vpp builds from vpp stable/2009 branch

- use new vpp ref build - ubuntu 18.04:
  20.09-rc1~0-gfb6d76841

- use new vpp ref build - centos7:
  20.09-rc1~0_gfb6d768~b2

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I417871bc15d8d522b71c17e2c436d271aa784cc8

3 years agoVPP-DEV API COV: Add NAT44-DET tests 97/28697/1
Martin Balaz [Mon, 7 Sep 2020 15:23:02 +0000 (17:23 +0200)]
VPP-DEV API COV: Add NAT44-DET tests

Jira: CSIT-1756

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: Ia6fdc6df91f36ffcabd428326195bb9d8f967e52

3 years agoVPP-DEV API COV: Add NAT44-ED tests 59/28559/7
Jan Gelety [Sat, 8 Aug 2020 10:36:02 +0000 (12:36 +0200)]
VPP-DEV API COV: Add NAT44-ED tests

Jira: CSIT-1755

Change-Id: I34baa22a49f44da3fa80d91fa2f4132c982fe610
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 91/28691/1
Jan Gelety [Thu, 3 Sep 2020 23:18:00 +0000 (01:18 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~386-g5c721baeb

 - use new vpp ref build - centos7:
   20.09-rc0~386_g5c721ba~b9869

Change-Id: I0780c9248025ed384596331fc0ec2b2eec20acbf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFIX: use correct minimal packet length in scapy scripts 77/28677/3
Jan Gelety [Thu, 3 Sep 2020 18:39:03 +0000 (20:39 +0200)]
FIX: use correct minimal packet length in scapy scripts

Change-Id: Icd1b4a3edb203cb0963203bb2e3e765b35c81600
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix local CSIT deployment 98/28598/3
Tomas Alexy [Fri, 28 Aug 2020 13:34:54 +0000 (15:34 +0200)]
Fix local CSIT deployment

Change-Id: I6ccf3cc11b4343ebcf02f30a01eddb9204ba53ee
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
3 years agoTrending, Report: use test tag ethip4udp-snat44det-h1-p1-s1 49/28649/2
Tibor Frank [Thu, 3 Sep 2020 07:26:34 +0000 (09:26 +0200)]
Trending, Report: use test tag ethip4udp-snat44det-h1-p1-s1

- use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44

Change-Id: Ie4897430c3b3074fdf3440d56cc1794a4c3046dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFramework: Code aligments 89/28589/5
pmikus [Thu, 27 Aug 2020 07:47:31 +0000 (07:47 +0000)]
Framework: Code aligments

+ Unifying code structures
  - To easily plug another DUT
+ New PCI PassThrough templates
+ Improved perf stat on cores allocated in test.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I325f17b977314f93cb91818feddfddf3e607eb8a

3 years agoFramework: Bump DPDK 20.08 71/28571/21
pmikus [Tue, 25 Aug 2020 06:57:59 +0000 (06:57 +0000)]
Framework: Bump DPDK 20.08

+ DPDK 20.08
+ Migrate make -> meson
+ Fix all trending issues

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I31dcb22627c0f8d17ec63c5b138a2da958b006f4

3 years agojob_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44 42/28642/1
Jan Gelety [Sun, 9 Aug 2020 05:55:12 +0000 (07:55 +0200)]
job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44

Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 38/28638/1
Jan Gelety [Sat, 8 Aug 2020 23:41:33 +0000 (01:41 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~344-gedc816355

 - use new vpp ref build - centos7:
   20.09-rc0~344_gedc8163~b9827

Change-Id: Iad2130f00098235dda068fd45594dd58cd62b175
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAnsible: fix the wrong module and mode for vpp_device.yaml in cleanup role 46/28046/4
Jieqiang Wang [Tue, 9 Jun 2020 11:29:26 +0000 (11:29 +0000)]
Ansible: fix the wrong module and mode for vpp_device.yaml in cleanup role

The src field for ansible template module used in vpp_device.yaml of cleanup role should be jinja2 format and the mode for script to be transfered to the remote host should be executable for the file owner. Fix this error by replacing the ansible template module with ansible copy module and setting the file permission to be 744.

Change-Id: Ibf80b0c5bec77a13509122795a5b12b6faba2f8e
Signed-off-by: Jieqiang Wang <jieqiang.wang@arm.com>
3 years agoTrending: Add DPDK version to alerts 00/28600/1
Tibor Frank [Fri, 28 Aug 2020 08:37:29 +0000 (10:37 +0200)]
Trending: Add DPDK version to alerts

Change-Id: I2f1a16ecfa0336e9c5a52a2efcbfcb2caddee089
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add identification of DUT to alerting email 99/28599/1
Tibor Frank [Fri, 28 Aug 2020 07:44:06 +0000 (09:44 +0200)]
Trending: Add identification of DUT to alerting email

Change-Id: I2e63f16aef48e68b0e86e913431bed7df01f1b70
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Add arm nomads into pool 97/28597/1
pmikus [Fri, 28 Aug 2020 07:07:07 +0000 (07:07 +0000)]
Ansible: Add arm nomads into pool

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I99a33a15e7e87fe6f56deb1ab0e4ce3091508244

3 years agoTrending: Add DPDK tests to list of failed tests 88/28588/1
Tibor Frank [Thu, 27 Aug 2020 06:29:05 +0000 (08:29 +0200)]
Trending: Add DPDK tests to list of failed tests

Change-Id: I25e805125528d67a5eea277df6d88549f129d137
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending, Report: nat44-deterministc test names change 77/28577/4
Tibor Frank [Tue, 25 Aug 2020 12:58:42 +0000 (14:58 +0200)]
Trending, Report: nat44-deterministc test names change

Change-Id: I1956ccaff625f287995765a4c2b0b46cb00d0d65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: remove ip4-08.md from 3n-hsw and 3n-skx 85/28585/1
Tibor Frank [Wed, 26 Aug 2020 07:49:05 +0000 (09:49 +0200)]
job-specs: remove ip4-08.md from 3n-hsw and 3n-skx

- They duplicate specification which is in ip4-01.md files

Change-Id: I818e1c165415b1f7d53ed28ffb345f07e6ac0576
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoJob-specs: Fix the runs durations 73/28573/1
Tibor Frank [Tue, 25 Aug 2020 09:23:49 +0000 (11:23 +0200)]
Job-specs: Fix the runs durations

Change-Id: Ifeb5455140e911b804df55b4ceeda26575ae9da9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agojob-specs: nat44-deterministc test names change 65/28565/7
Tibor Frank [Mon, 24 Aug 2020 08:50:49 +0000 (10:50 +0200)]
job-specs: nat44-deterministc test names change

Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoT-Rex: 2.82, core pin, 8 workers 84/28184/6
pmikus [Thu, 6 Aug 2020 08:45:49 +0000 (08:45 +0000)]
T-Rex: 2.82, core pin, 8 workers

+ Bump T-Rex version. We need new features for ASTF test.
+ Apply core pining. Results in a more stable performance.
+ Tweak the number of T-Rex workers.
 + We need an even value to achieve ymmetric performance with pinning.
 + Value 8 was selected as a best compromise.

This is a combination of 3 commits.
This is the 1st commit message:

T-Rex: 2.82

This is the commit message #2:

Change Trex to CORE_MASK_PIN mode to improve performance

https://trex-tgn.cisco.com/trex/doc/trex_stateless.html#_core_masking_per_interface
Above link have below explaination,

"When the profile is symmetric, performance can be improved by pinning half of
the cores to port 0, and half of the cores to port 1, thus avoiding cache
trashing and bouncing."

The reason to change this is that to run CSIT with 100G NIC often failed with
"TRex stateless runtime error timeout", it caused by Trex can not send enough
traffic within the fixed duration.

by change to CORE_MASK_PIN mode fix the issue.

Not editing ASTF, as that supports different options.

This is the commit message #3:

Experiment: Vary number of TRex workers

With CORE_MASK_PIN, we can get more predictable time distribution.
Decided to use 8 workers, that gives good results
both for high end (RDMA-core l2patch) and low end (vhost) tests.

Change-Id: I5c61127799e0624464e960fcb980ad1c4058e744
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFramework: Qemu alignments 58/28558/2
pmikus [Fri, 21 Aug 2020 09:53:24 +0000 (09:53 +0000)]
Framework: Qemu alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2781e85f44acffb4f8d7f02326ba2ca668dad0c5

3 years agoFix: NAT44 deterministic moved to separate det44 plugin 29/28529/11
Jan Gelety [Sat, 8 Aug 2020 14:41:24 +0000 (16:41 +0200)]
Fix: NAT44 deterministic moved to separate det44 plugin

- align CSIT code with VPP code changes for NAT44 deterministic
  (DET44) feature

- align test names according to snat44ed tests

- remove obsolete 3-node nat tests

- remove 2n1l-10ge2p1x710-ethip4udp-snat44det-h1048576-p63-s66060288 tests
  (not enough memory for such high number of sessions)

Change-Id: I9a22b99b4cfa56d18e9c7ef9c58296e202567d42
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix: Use new-style interface variables 76/28376/2
Vratko Polak [Thu, 13 Aug 2020 13:13:35 +0000 (15:13 +0200)]
Fix: Use new-style interface variables

The old-style variables contain None in some places,
mainly in SRv6 proxy tests.

Change-Id: If3887a7dba051454c504b345a6a316d5d69d0139
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFramework: use 'stl' in trex stateless profile names 12/28512/3
Jan Gelety [Sat, 8 Aug 2020 05:04:20 +0000 (07:04 +0200)]
Framework: use 'stl' in trex stateless profile names

Change-Id: I74641cc89d2f25d50b67d51bf2567082b420aabb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPAL: Add processing of throughput in Gbps 05/28505/3
Tibor Frank [Wed, 19 Aug 2020 08:00:14 +0000 (10:00 +0200)]
PAL: Add processing of throughput in Gbps

Change-Id: I264e329fa94cddf6a759f14bf567c56a50d1895d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd Intel E810CQ 100G NIC configuration 10/27910/7
Yulong Pei [Tue, 14 Jul 2020 19:44:44 +0000 (12:44 -0700)]
Add Intel E810CQ 100G NIC configuration

for Intel E810CQ 100G NIC, kernel driver of PF is ice, kernel driver of VF
is iavf, its VF hardware support VPP native avf driver.

Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ic8d86e5ee00057bbbcd09df619a38bd1371c8fd7

3 years agoSign off on relicensing of scapy related files for Intel 17/28417/2
Ray Kinsella [Fri, 14 Aug 2020 11:22:04 +0000 (12:22 +0100)]
Sign off on relicensing of scapy related files for Intel

Signed-off-by: Ray Kinsella <mdr@ashroe.eu>
Change-Id: I5f328b702ff7faffd432d08925cf1c247de1d680

3 years agoSign off on relicensing of scapy related files for Cisco. 77/28377/4
Ed Warnicke [Thu, 13 Aug 2020 16:18:14 +0000 (11:18 -0500)]
Sign off on relicensing of scapy related files for Cisco.

Change-Id: Ia27726d8bed649a55ac93ea3464b8bf278fe9d8f
Signed-off-by: Ed Warnicke <hagbard@gmail.com>
3 years agoPerf: NAT44 endpoint-dependent mode - tcp, part I 76/28176/30
Jan Gelety [Tue, 4 Aug 2020 21:48:36 +0000 (23:48 +0200)]
Perf: NAT44 endpoint-dependent mode - tcp, part I

Jira: CSIT-1736

- tcp synthetic profiles w/o data packets
- tcp cps perf tests, phase I (no special "search cps" KW)

Change-Id: I52be34b0fdd51d7a33c8c5de9b46d7064c48f7fa
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPerf: NAT44 endpoint-dependent mode - udp, part I 05/28205/8
Jan Gelety [Thu, 6 Aug 2020 01:34:31 +0000 (03:34 +0200)]
Perf: NAT44 endpoint-dependent mode - udp, part I

- continuation of https://gerrit.fd.io/r/c/csit/+/26898 as there was
reached limit of changes (1000)

Jira: CSIT-1711

- udp synthetic profiles w/o data packets
- udp cps perf tests, phase I (no special "search cps" KW)

Part I means that we are using MRR tests to collect traffic data
until there is ready new CPS test type with corresponding algorithm.

Change-Id: I0d30feb9ecf1d0bff937152656f8eb422f831378
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFramework: Qemu alignments 42/28442/2
pmikus [Tue, 18 Aug 2020 09:57:26 +0000 (09:57 +0000)]
Framework: Qemu alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I20098fca8fb513accef3edc9a72bfd3c56bf9be2

3 years agoFramework: Alignments 39/28439/1
pmikus [Tue, 18 Aug 2020 09:38:28 +0000 (09:38 +0000)]
Framework: Alignments

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b535ea61ab68f6e37989ffc942979cdfd24f55e

3 years agoFramework: Profiles load 36/28036/14
pmikus [Wed, 22 Jul 2020 12:35:54 +0000 (12:35 +0000)]
Framework: Profiles load

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iab84aff31a23bb9d8e1165f5314004803fd8a501

3 years agoMeasure latency only in special cases 38/28038/6
Vratko Polak [Fri, 7 Aug 2020 12:31:42 +0000 (14:31 +0200)]
Measure latency only in special cases

+ Measure latency in 90/50/10/0% PDR loads in ndrpdr tests.
+ Do not measure latency anywhere else.
- Needs manual editing to re-enable in soak tests.

Change-Id: I69fa11bfcf71012f683061c5effea52a1be91620
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 25/28425/2
Jan Gelety [Fri, 7 Aug 2020 10:46:06 +0000 (12:46 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~296-g17ec577f7

 - use new vpp ref build - centos7:
   20.09-rc0~296_g17ec577~b9779

Change-Id: I4b66014a4c39adc3c1e22fb29ef000474e1ac099
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoTrending: Fixes after review 26/28426/1
Tibor Frank [Mon, 17 Aug 2020 10:16:57 +0000 (12:16 +0200)]
Trending: Fixes after review

Change-Id: Ia2fdd4d222c723c063f267a20e1a4f18b4e03d69
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: NFV Tests 41/28341/11
Tibor Frank [Thu, 13 Aug 2020 06:56:46 +0000 (08:56 +0200)]
Trending: NFV Tests

- 2n-skx
- 2n-clx

Change-Id: I6dd55ed167dc4267b2a4e4c52ec0874ad0e4a4b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: NFV Tests 75/28275/2
Tibor Frank [Wed, 12 Aug 2020 13:15:29 +0000 (15:15 +0200)]
Trending: NFV Tests

Change-Id: I882c0af852a9e556df3c748164360cdbc336d654
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 98/28198/1
Jan Gelety [Wed, 5 Aug 2020 17:53:48 +0000 (19:53 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~277-g6042d2815

 - use new vpp ref build - centos7:
   20.09-rc0~277_g6042d28~b9760

Change-Id: I1da941f54a6338846a3478923dbb5988ffbf842a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoLimit user triggers: no OR 83/28183/1
Vratko Polak [Thu, 6 Aug 2020 08:32:46 +0000 (10:32 +0200)]
Limit user triggers: no OR

To avoid runs such as:
https://jenkins.fd.io/job/vpp-csit-verify-perf-master-3n-hsw/340/

Change-Id: I1b30d5f440ddf8ff32b11265b2ac2176f4b9a665
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agojob-specs: align mrr-weekly NFV tests with report-iter 66/28166/2
Tibor Frank [Tue, 4 Aug 2020 09:10:41 +0000 (11:10 +0200)]
job-specs: align mrr-weekly NFV tests with report-iter

- 2n-skx
- 2n-clx

Change-Id: I8e96d335be2c26ffb03e210f6f658fba1825c597
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd Denverton testbeds BIOS configuration doc 08/28108/2
Yulong Pei [Wed, 29 Jul 2020 20:41:32 +0000 (13:41 -0700)]
Add Denverton testbeds BIOS configuration doc

Signed-off-by: Xinfeng Zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I531b380277a885f45af0749d048f44ba12285dd2

3 years agoReport 2005: Add data, configure rls2005.32 72/28172/1
Tibor Frank [Wed, 5 Aug 2020 04:52:06 +0000 (06:52 +0200)]
Report 2005: Add data, configure rls2005.32

Change-Id: I79129cac48c60a959e4dc1ebfc9d63b9b230e933
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Set longer time period 70/28170/1
Tibor Frank [Tue, 4 Aug 2020 11:17:00 +0000 (13:17 +0200)]
Trending: Set longer time period

- daily: up to 180 sets, max 180 days
- weekly: up to 26 sets, max 180 days

Change-Id: I59c550e5728fcb83f247b0c958f21209d927ee98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Implement the latest changes in job specs 02/28102/11
Tibor Frank [Wed, 29 Jul 2020 13:35:41 +0000 (15:35 +0200)]
Trending: Implement the latest changes in job specs

Graphs:
 - MRR
   - 2n-clx
   - 2n-skx
   - 3n-skx
   - 3n-hsw
   - 3n-tsh
 - NDRPDR
   - 2n-skx
   - 3n-skx
   - 3n-hsw
   - 2n-clx

Change-Id: Ieab26ba1d2ee56e66c5c8598c4dba240a14e53e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 40/28140/1
Jan Gelety [Thu, 23 Jul 2020 21:00:29 +0000 (23:00 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~266-ge6c3e8f0e

 - use new vpp ref build - centos7:
   20.09-rc0~266_ge6c3e8f~b9748

Change-Id: I3d173d9b67657b238f7a65e24d81f0ac8f9d0093
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoT-Rex: Add advanced stateful mode 68/27168/46
Jan Gelety [Thu, 7 May 2020 02:37:19 +0000 (04:37 +0200)]
T-Rex: Add advanced stateful mode

- provide base routines to run T-Rex in advanced stateful mode

Change-Id: Ib0dc5f2919c370753335f6446860683dc4b12d93
Signed-off-by: Jan Gelety <jgelety@cisco.com>