csit.git
21 months agorls1807: updated environment sections for all functional tests. 13/14213/3
Maciek Konstantynowicz [Tue, 14 Aug 2018 14:50:51 +0000 (15:50 +0100)]
rls1807: updated environment sections for all functional tests.

Change-Id: I8f0a2a49ee6e75990ee4638543259c40d1fb5d67
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
21 months ago1807 report: added VTS description in vpp performance overview section. 15/14215/2
Maciek Konstantynowicz [Tue, 14 Aug 2018 15:19:23 +0000 (16:19 +0100)]
1807 report: added VTS description in vpp performance overview section.

Change-Id: I0ba70947d895404723864da2a8477c682741620f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 14/14214/1
Peter Mikus [Tue, 14 Aug 2018 15:09:55 +0000 (15:09 +0000)]
CSIT-1208: Add new data to 1807 report

Change-Id: Iea304ffd65e4ddbac277274b96207a351cf004fc
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months ago1807 report: added HW calibration sections to test_environment plus editing nits. 82/14182/4
Maciek Konstantynowicz [Mon, 13 Aug 2018 20:17:10 +0000 (21:17 +0100)]
1807 report: added HW calibration sections to test_environment plus editing nits.

Change-Id: I66698ae70d1bbbde6992e5663bc64c30249f7f79
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 00/14200/1
Peter Mikus [Tue, 14 Aug 2018 09:34:34 +0000 (09:34 +0000)]
CSIT-1208: Add new data to 1807 report

Change-Id: If575d2dc0e8ddb81afe693c646a911e33559b67e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoRevert "CSIT-1208: Add new data to 1807 report" 97/14197/1
Peter Mikus [Tue, 14 Aug 2018 08:29:38 +0000 (08:29 +0000)]
Revert "CSIT-1208: Add new data to 1807 report"

This reverts commit a0f10dad4aea6c8f8cb0a75c041dce626e39c3d2.

Change-Id: I65785d15436d7032908b675cb085b9471d3d6e71
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 40/14140/4
Tibor Frank [Fri, 10 Aug 2018 13:01:41 +0000 (15:01 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I96260f9d22d19db608b8b119efede60f69897d98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months ago1807 report: removing unused svg files from introduction dir. 79/14179/1
Maciek Konstantynowicz [Mon, 13 Aug 2018 15:24:55 +0000 (16:24 +0100)]
1807 report: removing unused svg files from introduction dir.

Change-Id: I1a4b10bd97e6a0e78aba7f99083f4459f47bfc88
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
21 months agoHC Tests: mark policer tests as EXPECTED_FAILING (HC2VPP-373) 55/14155/1
Marek Gradzki [Mon, 13 Aug 2018 04:47:36 +0000 (06:47 +0200)]
HC Tests: mark policer tests as EXPECTED_FAILING (HC2VPP-373)

Change-Id: I394a024e98d74b468a821040db69c1d6eed820ea
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
21 months agoCSIT-1156 Create container memif tests for 2-node topology 47/13947/23
Peter Mikus [Fri, 3 Aug 2018 14:27:55 +0000 (14:27 +0000)]
CSIT-1156 Create container memif tests for 2-node topology
CSIT-1155 Implement container memif KWs for 2-node topology

Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 33/14133/2
Tibor Frank [Fri, 10 Aug 2018 08:35:57 +0000 (10:35 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I1c51fe8b37e5a849310418c85be3db8053d67cbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1193 De-duplicate bootstrap scripts into one 14/13814/35
Peter Mikus [Mon, 30 Jul 2018 17:28:16 +0000 (17:28 +0000)]
CSIT-1193 De-duplicate bootstrap scripts into one

- DPDK and VPP bootstrap merged into one (ligato will follow).
- Added more error detections
- Added topo-cleanup.py to cleanup TB before and after test.
- Remove installation of VPP

Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 27/14127/2
Tibor Frank [Fri, 10 Aug 2018 06:46:38 +0000 (08:46 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I6f4c03c66a762b129c86a9d751d15f57e62f2ea9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1229: Add DMM to report 15/14015/10
Tibor Frank [Tue, 7 Aug 2018 11:05:06 +0000 (13:05 +0200)]
CSIT-1229: Add DMM to report

Change-Id: Ib3ea8c13371a29ea2b4661a8506190dcb15c8ced
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
21 months agoCSIT-1208: Add new data to 1807 report 99/14099/2
Tibor Frank [Thu, 9 Aug 2018 09:04:59 +0000 (11:04 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I103417283196940db841be2a254d5d6e8537938f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoFIX: Section names in introduction/overview 71/14071/3
Tibor Frank [Wed, 8 Aug 2018 10:54:54 +0000 (12:54 +0200)]
FIX: Section names in introduction/overview

Change-Id: I05e4be8f92625d95bfcb01270453069f498e88b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: remove column doc 75/14075/2
Tibor Frank [Wed, 8 Aug 2018 12:00:27 +0000 (14:00 +0200)]
Report: remove column doc

Change-Id: Icef72f6e248b6489f3fe0dc33435f71fa51723aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1231: Cleanup CSIT RF Tags Descriptions 37/14037/7
Tibor Frank [Wed, 8 Aug 2018 05:08:28 +0000 (07:08 +0200)]
CSIT-1231: Cleanup CSIT RF Tags Descriptions

Change-Id: Ib57014bf2461518eadcd156b16f8ee26eeb86785
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1232: Edit docs/report/nsh_sfc_functional_tests/overview.rst 38/14038/2
Tibor Frank [Wed, 8 Aug 2018 06:04:39 +0000 (08:04 +0200)]
CSIT-1232: Edit docs/report/nsh_sfc_functional_tests/overview.rst

Change-Id: I5c8c81a971e5e2abde59eb144d707eaea0bf1ea2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1233: Edit honeycomb_functional_tests/overview 39/14039/2
Tibor Frank [Wed, 8 Aug 2018 06:24:12 +0000 (08:24 +0200)]
CSIT-1233: Edit honeycomb_functional_tests/overview

Change-Id: Id0bd955be59a95909aab5067965c2cc7e2fee520
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 54/14054/2
Tibor Frank [Wed, 8 Aug 2018 09:23:34 +0000 (11:23 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I90b094efc869f04ece54aadc6e0c26eeb4ef8bdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoUpdate 18.07 release notes 49/14049/1
Peter Mikus [Wed, 8 Aug 2018 08:52:49 +0000 (08:52 +0000)]
Update 18.07 release notes

- Part I

Change-Id: Ic97cfce98c560c9e873935fc72489ff102f201f1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoCSIT-1230: Improve layout of pdf report 41/14041/1
Tibor Frank [Wed, 8 Aug 2018 06:56:27 +0000 (08:56 +0200)]
CSIT-1230: Improve layout of pdf report

Change-Id: I833f3bab2f3729b9f2e64d7e6a7f21efa247c967
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1230: Improve layout of pdf report 33/14033/1
Tibor Frank [Wed, 8 Aug 2018 04:40:12 +0000 (06:40 +0200)]
CSIT-1230: Improve layout of pdf report

Change-Id: I6d89dc4dacd8b60a29662754dd920c5cec9e1efa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1226: Fix bugs in pdf version 23/14023/1
Tibor Frank [Tue, 7 Aug 2018 15:38:53 +0000 (17:38 +0200)]
CSIT-1226: Fix bugs in pdf version

Change-Id: Ibdcc1d79db4079af49167c5696ba1c4edb3a40bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 06/14006/5
Tibor Frank [Tue, 7 Aug 2018 08:14:03 +0000 (10:14 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I242b96ef4fafd53745ea1900ac63b95024dccb0b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1228: Add DMM source code documentation 11/14011/1
Tibor Frank [Tue, 7 Aug 2018 10:39:47 +0000 (12:39 +0200)]
CSIT-1228: Add DMM source code documentation

Change-Id: I2689e2ad5ef4776b9ff4bd652ed7f141d9e55d74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1226: Fix bugs in pdf version 40/13940/10
Tibor Frank [Fri, 3 Aug 2018 12:38:20 +0000 (14:38 +0200)]
CSIT-1226: Fix bugs in pdf version

Change-Id: I9c7abca28f98a581a8efb390c6ccf4f8937a958b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoHC Tests: 18.07 report update 94/13994/2
Marek Gradzki [Tue, 7 Aug 2018 06:10:14 +0000 (08:10 +0200)]
HC Tests: 18.07 report update

Change-Id: I2c3df89532f0e728c58b54c220d4fe8ab1297ba4
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
21 months agoUpdate of VPP_STABLE_VER files 68/13968/2
Jan Gelety [Mon, 6 Aug 2018 08:23:53 +0000 (10:23 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~119-ge7a9b3d~b4782

- use new vpp ref build - centos7:
  18.10-rc0~119_ge7a9b3d~b4692

Change-Id: I1094cf737cf637a7bad3dcf2f72dc31a3401468d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
21 months agohc2vpp-csit-verify: use vpp packages based on vpp-version 87/13987/1
Marek Gradzki [Mon, 6 Aug 2018 15:22:13 +0000 (17:22 +0200)]
hc2vpp-csit-verify: use vpp packages based on vpp-version

The hc2vpp-csit-verify allows to run HC CSIT tests per hc2vpp patch.
The job should not use most recent vpp artifacts
for respective branch ('RELEASE'),
but version specified in the vpp-version file.

The vpp-version file is used by hc2vpp-integration job
to produce honeycomb package.

Change-Id: If2811a01256e8217de50d220082dbc204443b54a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 70/13970/5
Tibor Frank [Mon, 6 Aug 2018 08:51:57 +0000 (10:51 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I15b8ad91c9f64c8fe5170905a8c7566f55dfe5d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT_VIRL phased migration, prio P0 - apply SKIP_VPP_PATCH tag 75/13675/2
Jan Gelety [Wed, 25 Jul 2018 11:31:16 +0000 (13:31 +0200)]
CSIT_VIRL phased migration, prio P0 - apply SKIP_VPP_PATCH tag

Jira: CSIT-1137

Change-Id: I06e00e25060c36a1e7bd5b70bce1f203c1509ef5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
21 months agoAdd unix full-coredump to VPP default config 41/13941/2
Vratko Polak [Fri, 3 Aug 2018 13:27:11 +0000 (15:27 +0200)]
Add unix full-coredump to VPP default config

Change-Id: Iceea1f25749443d3cf091996026f75d8779e8103
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 36/13936/3
Tibor Frank [Fri, 3 Aug 2018 12:05:06 +0000 (14:05 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: Ia28a587409327b266af75477a6dc0c2d6ccb5a7c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoFix ommissions from recent Changes 35/13935/3
Vratko Polak [Fri, 3 Aug 2018 11:30:01 +0000 (13:30 +0200)]
Fix ommissions from recent Changes

+ Insert missing "Add worker threads"... keyword to udpsrcscale15 suite.
+ Add MRR for 40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1 suite.

Change-Id: I467e5469a1421caa25373ab91010bd4d824fb32f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 31/13931/1
Tibor Frank [Fri, 3 Aug 2018 11:05:38 +0000 (13:05 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: Iab06ce9a98aa680b6e947ecbae144e2ac92b84e5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 08/13908/5
Tibor Frank [Thu, 2 Aug 2018 13:34:44 +0000 (15:34 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I93c6625d537bfef3e955e171db92e5a639ffc22e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoFIX: Increase Ligato MTU for Jumbo frame testing 93/13893/2
Peter Mikus [Thu, 2 Aug 2018 10:49:40 +0000 (10:49 +0000)]
FIX: Increase Ligato MTU for Jumbo frame testing

Change-Id: I6d2cb7a10b5245cbf81c88a0503dd14632a5acf3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoFIX: Report TSA 90/13890/5
Tibor Frank [Thu, 2 Aug 2018 08:03:43 +0000 (10:03 +0200)]
FIX: Report TSA

Change-Id: Ieb29a1e213a5f8aa74054da57ceb15925fe4dee3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 89/13889/2
Tibor Frank [Thu, 2 Aug 2018 07:54:19 +0000 (09:54 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: Id9a3dbc4dfa5213d527ecbea35a4a6a66b25c723
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport 1807 - Functional overview 94/13894/1
Peter Mikus [Thu, 2 Aug 2018 11:45:05 +0000 (11:45 +0000)]
Report 1807 - Functional overview

Change-Id: I1c3254c10dd699f1288fc753cbfb09bbb1bc24f7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoPAL: Remove unused code 73/13873/2
Tibor Frank [Wed, 1 Aug 2018 13:26:25 +0000 (15:26 +0200)]
PAL: Remove unused code

Change-Id: I14f8f4ed12071f1c6b2c57c55b1add24c56619cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoCSIT-1208: Add new data to 1807 report 65/13865/7
Tibor Frank [Wed, 1 Aug 2018 11:07:39 +0000 (13:07 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I514de6e4ac321900090a7f7ce9af60d23acd43ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoFIX: check IF up state after setting MTU, not before 69/13869/1
Jan Gelety [Wed, 1 Aug 2018 12:39:35 +0000 (14:39 +0200)]
FIX: check IF up state after setting MTU, not before

Change-Id: Ic7a78af96a371e49993f6cbac01267e4bbe0dc46
Signed-off-by: Jan Gelety <jgelety@cisco.com>
21 months agorls1807 report: functional test static content 55/13855/2
Jan Gelety [Wed, 1 Aug 2018 07:41:01 +0000 (09:41 +0200)]
rls1807 report: functional test static content

Change-Id: Iac120c650b8667c589e387666c28732aa14872b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
21 months agoFIX: Set MTU before configuring l2patch 43/13843/2
Vratko Polak [Tue, 31 Jul 2018 12:45:32 +0000 (14:45 +0200)]
FIX: Set MTU before configuring l2patch

This should reduce number of "link down" failures dramatically.
The exact mechanism is not clear, but l2xc suites do not fail that much.

Change-Id: Ie102d90a58561121695c9938679ce0d3ee6a874f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agoFIX: Report - DPDK static content 58/13858/1
Tibor Frank [Wed, 1 Aug 2018 08:36:43 +0000 (10:36 +0200)]
FIX: Report - DPDK static content

Change-Id: If233133bfaf01cb46979ee83b4704b2645a8b7e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoFIX: Report - plots 35/13835/3
Tibor Frank [Tue, 31 Jul 2018 07:18:27 +0000 (09:18 +0200)]
FIX: Report - plots

Change-Id: Ia791d310e5942e10d62011cb879101828dfe7454
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoFIX: Revert l3fwd patching 33/13833/1
Peter Mikus [Mon, 30 Jul 2018 12:23:13 +0000 (12:23 +0000)]
FIX: Revert l3fwd patching

For now this solution does not work on Haswells, need to find permanent
fix.

Change-Id: Id5323a078db3a8f14c009d6f66ee393c89d851ef
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 5f634b8c486f7a404c9cd33b60cc92a6907e7c64)

21 months agoUpdate report doc for rls1807 92/13792/6
Peter Mikus [Sat, 28 Jul 2018 15:34:25 +0000 (15:34 +0000)]
Update report doc for rls1807

Change-Id: I713fe9b4a1a2830d6267c1dfc9b0442bf08b8ab4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoCSIT-1197: Add Comparison Across Testbeds to the Report 01/13801/14
Tibor Frank [Mon, 30 Jul 2018 07:49:06 +0000 (09:49 +0200)]
CSIT-1197: Add Comparison Across Testbeds to the Report

Change-Id: Ibf0c880926b87e781830d7b39438b5145144ef5b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoUpdate of VPP_STABLE_VER files 02/13802/2
Jan Gelety [Mon, 30 Jul 2018 07:52:30 +0000 (09:52 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~85-gcd2190e~b4747

- use new vpp ref build - centos7:
  18.10-rc0~85_gcd2190e~b4656

Change-Id: Ia46f7d3aafd1c398d8a0ec5153566a289fed1db6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
21 months agoHC Tests: remove trusty from download_hc_*.sh scripts 86/13686/3
Marek Gradzki [Wed, 25 Jul 2018 14:41:10 +0000 (16:41 +0200)]
HC Tests: remove trusty from download_hc_*.sh scripts

Ubuntu 14.04 packages are not being published since 1710.

Change-Id: I1372fe0eb4eab3c6c3e0f3a7ee435104f3c6f0fb
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
21 months agoHC Tests: do not use vpp-dbg in CSIT tests 84/13684/3
Marek Gradzki [Wed, 25 Jul 2018 14:10:22 +0000 (16:10 +0200)]
HC Tests: do not use vpp-dbg in CSIT tests

Honeycomb package does not require VPP debug symbols
and typical HC user does not have them installed.

Change-Id: I2cae502cad3216304d6f7ee44913f30c97fb5a20
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
21 months agoCSIT-1219: Update job definitions in conf.py 97/13797/2
Tibor Frank [Mon, 30 Jul 2018 06:27:24 +0000 (08:27 +0200)]
CSIT-1219: Update job definitions in conf.py

Change-Id: Ib7e76f43a8ef2d4729962ff5856c987747b0b953
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoFIX: LXC container creation on Ubuntu Bionic 93/13793/2
Peter Mikus [Sat, 28 Jul 2018 19:43:48 +0000 (19:43 +0000)]
FIX: LXC container creation on Ubuntu Bionic

Do not mount whole /dev into container as it can steal the PTS (tty).
Currently mounting only /dev/bus for pci devices and /dev/vfio

Change-Id: Ie829d35db81317bcd081257453ede7cbec2a302e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
21 months agoRevert MTU sequence to apply oafter interface UP 90/13790/1
Peter Mikus [Sat, 28 Jul 2018 11:14:23 +0000 (11:14 +0000)]
Revert MTU sequence to apply oafter interface UP

Change-Id: I8820350809ab63787a9e4a48b2db2c85320e7b11
Signed-off-by: Peter Mikus <pmikus@cisco.com>
22 months agoFIX: Interface up handling 84/13784/1
Peter Mikus [Wed, 25 Jul 2018 06:47:34 +0000 (06:47 +0000)]
FIX: Interface up handling

- Increase timeout when trying to check interface (this is useful if
there are multiple interfaces and dump command take more than
TIMEOUT/NR_IF which is happening quite often).
- Reverse the order of applying MTU and interface UP to try to prevent
API overload during interface initialization phase.

Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)

22 months agoCSIT-1213: Add 2n/3n-skx to Test Oper Data 74/13774/5
Tibor Frank [Fri, 27 Jul 2018 11:59:21 +0000 (13:59 +0200)]
CSIT-1213: Add 2n/3n-skx to Test Oper Data

Change-Id: I217cc8dc6691c2a443460bd4e51ea96c4ec82806
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoCSIT-1212: Add 2n/3n-skx to Test Configuration 70/13770/3
Tibor Frank [Fri, 27 Jul 2018 11:02:36 +0000 (13:02 +0200)]
CSIT-1212: Add 2n/3n-skx to Test Configuration

Change-Id: I4be3e2072dbc1f1f27b840de1c04a2374944f724
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoCSIT-1211: Add 2n/3n-skx to detailed results 17/13717/16
Tibor Frank [Thu, 26 Jul 2018 11:12:02 +0000 (13:12 +0200)]
CSIT-1211: Add 2n/3n-skx to detailed results

Change-Id: Ibfe838b355fa15d0f89ea3122f2d042af989b51d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agorls1807 report: fixing cross-references to tested_logical_ and tested_physical_topolo... 87/13687/2
Maciek Konstantynowicz [Wed, 25 Jul 2018 15:55:45 +0000 (16:55 +0100)]
rls1807 report: fixing cross-references to tested_logical_ and tested_physical_topologies.

Change-Id: I3273d9867abad193da361513791da2a915b9d76d
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
22 months agoCSIT-1203: Add parsing of NDRPDR test 18/13618/46
Tibor Frank [Mon, 23 Jul 2018 12:29:11 +0000 (14:29 +0200)]
CSIT-1203: Add parsing of NDRPDR test

Change-Id: I55be02df7f8979ad4c10b79d87f5065452a3e6e6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agorls1807 report: added section physical_testbeds.rst. 41/13541/9
Maciek Konstantynowicz [Wed, 18 Jul 2018 21:43:17 +0000 (22:43 +0100)]
rls1807 report: added section physical_testbeds.rst.

Change-Id: Ic3a5a598b27614dda8f464d3fdfddb2ad0e6a163
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
22 months agoCSIT-1065 High failure rate with K8s/Ligato orchestration 07/13507/17
Peter Mikus [Tue, 17 Jul 2018 10:31:55 +0000 (10:31 +0000)]
CSIT-1065 High failure rate with K8s/Ligato orchestration

- Update Ligato Bootstrap for latest changes
- Update Ligato Test cases for latest vpp-agent changes
- Convert TC to new format
- Add Hyperthreading support

Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
22 months agoHC Tests: do not install vpp-dev in hc2vpp-csit-verify 64/13664/2
Marek Gradzki [Wed, 25 Jul 2018 07:02:57 +0000 (09:02 +0200)]
HC Tests: do not install vpp-dev in hc2vpp-csit-verify

The download_hc_build_pkgs.sh is used by
hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs.
These jobs download latest VPP packages
and unlike other HC CSIT jobs, build hc2vpp.

This patch removes vpp-dev/vpp-devel packages
from the list of installed VPP packages
to unify the environment with the other HC CSIT jobs.

Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
22 months agorls1807 report: moved and updated performance methodology section. 55/13655/6
Maciek Konstantynowicz [Tue, 24 Jul 2018 14:21:21 +0000 (15:21 +0100)]
rls1807 report: moved and updated performance methodology section.

Change-Id: Ie67822c6c26cd42f548de542ef8a96d0a2d97f1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
22 months agorls1807 report: moved and renamed s/mdr_search/mlr_search/. 56/13656/3
Maciek Konstantynowicz [Tue, 24 Jul 2018 14:38:55 +0000 (15:38 +0100)]
rls1807 report: moved and renamed s/mdr_search/mlr_search/.

Change-Id: Ifb97cb74c7f16592aa82dc2b1601407720985bc8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
22 months agoAdd MTU handling into perf tests 34/13534/22
Peter Mikus [Wed, 18 Jul 2018 12:34:19 +0000 (12:34 +0000)]
Add MTU handling into perf tests

- Add ability to configure MTU on interfaces. Put the MTU into configuration
keywors for all perf testcases.

Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682
Signed-off-by: Peter Mikus <pmikus@cisco.com>
22 months agorls1807 report: added section logical topologies in ../vpp_performance_tests/overview... 65/13565/6
Maciek Konstantynowicz [Thu, 19 Jul 2018 20:46:38 +0000 (21:46 +0100)]
rls1807 report: added section logical topologies in ../vpp_performance_tests/overview.rst.

Change-Id: Ied5a5caf95baddf8210b773002a8a3e5dc971a2d
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
22 months agoFail bootstrap immediately if no topology found 69/13669/1
Vratko Polak [Wed, 25 Jul 2018 10:32:40 +0000 (12:32 +0200)]
Fail bootstrap immediately if no topology found

Zero topologies might be found
if testbeds of some type are all unavailable,
or when purposedly restricted Change
is verified with a wrong trigger incantation.

The previous behavior enters an infinite cycle instead.

Change-Id: I9764a79ed4df57c6c99746438431bf1162b7f7ea
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1097: Migrate L2 to NDRPDR and edit MRR 90/13590/13
Vratko Polak [Fri, 20 Jul 2018 17:06:49 +0000 (19:06 +0200)]
CSIT-1097: Migrate L2 to NDRPDR and edit MRR

Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1202: Unify min_rate 45/13645/1
Vratko Polak [Tue, 24 Jul 2018 12:15:15 +0000 (14:15 +0200)]
CSIT-1202: Unify min_rate

20000 is the bi-directional value,
suites should use 10000.

Change-Id: I61d6e83f4f6b8f1f9b3dc9457896997f686a2b66
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1097: Unify max NIC bandwidth in ip4 41/13641/4
Peter Mikus [Tue, 24 Jul 2018 08:55:53 +0000 (08:55 +0000)]
CSIT-1097: Unify max NIC bandwidth in ip4

Also, minor fix in ip6.

Change-Id: I3a23e49d2162e34a1d2a8671ae9f7e74b832315c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoWORKAROUND: Remove broken SKX-TB out of pool 38/13638/2
Peter Mikus [Tue, 24 Jul 2018 08:55:53 +0000 (08:55 +0000)]
WORKAROUND: Remove broken SKX-TB out of pool

Currently T22 and T23 are faulty
Tracked in [FD.io Helpdesk #58059]

Change-Id: Ib8d474400a7e109a87573e33ca73946208bbb5de
Signed-off-by: Peter Mikus <pmikus@cisco.com>
22 months agoinitial CSIT-DMM test scripts 86/11286/76
sharath reddy [Thu, 22 Mar 2018 07:12:51 +0000 (12:42 +0530)]
initial CSIT-DMM test scripts

Change-Id: I77a965751010b85d21335932baa5345a095dc4f3
Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com>
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
22 months agoCSIT-1097: Migrate Vts suite to NDRPDR 31/13531/12
Vratko Polak [Fri, 20 Jul 2018 11:13:06 +0000 (13:13 +0200)]
CSIT-1097: Migrate Vts suite to NDRPDR

Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1097: Migrate ip4 to NDRPDR and edit MRR 62/13562/10
Vratko Polak [Thu, 19 Jul 2018 17:14:26 +0000 (19:14 +0200)]
CSIT-1097: Migrate ip4 to NDRPDR and edit MRR

Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoUpdate of VPP_STABLE_VER files 01/13601/2
Jan Gelety [Mon, 23 Jul 2018 07:04:42 +0000 (09:04 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~50-g2a03efe~b4710

- use new vpp ref build - centos7:
  18.10-rc0~50_g2a03efe~b4619

Change-Id: I1effbb587c6d1bf2566501f70b8342b1b5260e8a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
22 months agoCSIT-1097: Edit dpdk suites for new rate and jumbo 48/13548/9
Vratko Polak [Thu, 19 Jul 2018 10:38:53 +0000 (12:38 +0200)]
CSIT-1097: Edit dpdk suites for new rate and jumbo

Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1097: Migrate vm_vhost to NDRPDR and edit MRR 37/13537/6
Vratko Polak [Wed, 18 Jul 2018 17:09:24 +0000 (19:09 +0200)]
CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRR

Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoHC Tests: remove vpp-dpdk-dkms dependency 04/13604/2
Marek Gradzki [Mon, 23 Jul 2018 07:04:20 +0000 (09:04 +0200)]
HC Tests: remove vpp-dpdk-dkms dependency

The vpp-dpdk-dkms is not needed for current VPP versions.

Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
22 months agoHC Tests: disable NSH plugin 91/13591/3
Marek Gradzki [Fri, 20 Jul 2018 06:10:24 +0000 (08:10 +0200)]
HC Tests: disable NSH plugin

Change-Id: Ic382b625e5e7201ecc2a2937c15646806c594c61
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
22 months agoCSIT-1204: Make new TC names backward compatible (trending) 05/13605/5
Tibor Frank [Mon, 23 Jul 2018 07:12:34 +0000 (09:12 +0200)]
CSIT-1204: Make new TC names backward compatible (trending)

Change-Id: I48976a21ed022f0f8d840903db4d2415be9365cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoCSIT-1097: Migrate ip4_tun to NDRPDR and edit MRR 33/13533/3
Vratko Polak [Wed, 18 Jul 2018 12:16:31 +0000 (14:16 +0200)]
CSIT-1097: Migrate ip4_tun to NDRPDR and edit MRR

Change-Id: I20fe137cfbbcea1e337fe6295818ea105953d006
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1097: Migrate memif to NDRPDR and edit MRR 32/13532/2
Vratko Polak [Wed, 18 Jul 2018 11:54:27 +0000 (13:54 +0200)]
CSIT-1097: Migrate memif to NDRPDR and edit MRR

Change-Id: I22db20ec688f1a879e82549aa7aa68dafdc71b6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1196: Add hsw/skx and 2n/3n to the report structure 89/13489/53
Tibor Frank [Mon, 16 Jul 2018 13:32:57 +0000 (15:32 +0200)]
CSIT-1196: Add hsw/skx and 2n/3n to the report structure

Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoFIX: Increase timeout for VAT for longer API calls. 80/13480/6
Peter Mikus [Mon, 16 Jul 2018 12:19:06 +0000 (12:19 +0000)]
FIX: Increase timeout for VAT for longer API calls.

Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625
Signed-off-by: Peter Mikus <pmikus@cisco.com>
22 months agoDRAFT: FD.io CSIT high-level development plan in .txt format. 06/13206/7
Maciek Konstantynowicz [Mon, 25 Jun 2018 13:42:49 +0000 (14:42 +0100)]
DRAFT: FD.io CSIT high-level development plan in .txt format.
Provided for reviews and reference, not for tracking.
Jira continuous to be used for CSIT work tracking.

Change-Id: I0945f0ab910f85f41d16ae402368430ef8351ee3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
22 months agoCSIT-1097: Crypto NDRPDR and missing MRR suites 20/13520/2
Vratko Polak [Tue, 17 Jul 2018 16:46:18 +0000 (18:46 +0200)]
CSIT-1097: Crypto NDRPDR and missing MRR suites

Change-Id: If40f9283ee889f85e85fad74a490252e812bbe02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1097: Ip6 NDRPDR and edited MRR suites 13/13513/7
Vratko Polak [Tue, 17 Jul 2018 15:21:52 +0000 (17:21 +0200)]
CSIT-1097: Ip6 NDRPDR and edited MRR suites

Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1201 Create L2patch perf tests 05/13505/10
Peter Mikus [Tue, 17 Jul 2018 10:14:44 +0000 (10:14 +0000)]
CSIT-1201 Create L2patch perf tests

- XL710, XXV710, X710
- 2n, 3n
- all pkt.size groups
- ndrpdr, mrr

Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
22 months agoCSIT-1186: Add MRR and NDRPDR ip6_tunnels tests 84/13484/8
Vratko Polak [Tue, 17 Jul 2018 12:24:32 +0000 (14:24 +0200)]
CSIT-1186: Add MRR and NDRPDR ip6_tunnels tests

Remove the corresponding NDRPDRdisc tests.

Change-Id: Ib46f53e97f703db19bcbcb82c3db0a7f5bb61dbf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoCSIT-1165 Create DPDK tests for 2-node topology 87/13487/7
Peter Mikus [Mon, 16 Jul 2018 13:23:22 +0000 (13:23 +0000)]
CSIT-1165 Create DPDK tests for 2-node topology

Create DPDK tests for 2-node topology
- x710, xxv710 only
- l3fwd, testpmd
- standard pkt.size group

Change-Id: I2fbf6c38a427775da9b289faaa8fe1b8c03d5527
Signed-off-by: Peter Mikus <pmikus@cisco.com>
22 months agoCSIT-1186: Add srv6 NDRPDR suites 11/13411/35
Vratko Polak [Mon, 16 Jul 2018 10:33:10 +0000 (12:33 +0200)]
CSIT-1186: Add srv6 NDRPDR suites

Delete the corresponding ndrpdrdisc suites.

MRR suites are also edited,
to make them less different from NDRPDR suites.

Now, there is a script to re-generate testcases of selected suites.
For that, resources/libraries/python/autogen is created,
with Regenerator holding the most of script logic.

The script looks at files matching a glob expression,
reuses a "prolog", but overwites test cases with the default template
and hardcoded set of testcase arguments.

Also, handling of overhead size has been simplified,
using new keyword Get Max Rate And Jumbo And Handle Multi Seg.

Default value for search timeout is increased to 12 minutes
to make timeout failures less frequent.

Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 00/13500/2
Jan Gelety [Tue, 17 Jul 2018 07:19:50 +0000 (09:19 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~517-g635ec3b~b4653

- use new vpp ref build - centos7:
  18.07-rc0~517_g635ec3b~b4569

- use new dpdk version:
  18.05-vpp2

Change-Id: I5fe34ea3603de136f8fe28fb8313533349257801
Signed-off-by: Jan Gelety <jgelety@cisco.com>
22 months agoRefactor DPDK testcases to new structure 63/13463/10
Peter Mikus [Fri, 13 Jul 2018 11:44:29 +0000 (11:44 +0000)]
Refactor DPDK testcases to new structure

+ RXQ refactor

Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
22 months agoCSIT-1094: Change menu style 26/13426/20
Tibor Frank [Wed, 11 Jul 2018 13:11:11 +0000 (15:11 +0200)]
CSIT-1094: Change menu style

Change-Id: Idff59bc73d3444700937fc473681760a947f0f41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoCSIT-1190: Update report configuration for 18.07 41/13441/2
Tibor Frank [Thu, 12 Jul 2018 06:29:33 +0000 (08:29 +0200)]
CSIT-1190: Update report configuration for 18.07

Change-Id: Ie7644fe3069ad37c15754a07e049f479903ca59a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.