csit.git
7 years agoVIRL test: Replace IP probe for VXLAN test 23/4723/2
Matej Klotton [Tue, 17 Jan 2017 11:14:23 +0000 (12:14 +0100)]
VIRL test: Replace IP probe for VXLAN test

Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoVIRL test: VXLAN-L2BD-vhos_user test (CSIT-500) 03/4603/20
Jan Gelety [Mon, 9 Jan 2017 08:18:15 +0000 (09:18 +0100)]
VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)

- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6
  scenarios

Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoTags for tests with IPSec. 71/4671/1
Tibor Frank [Fri, 13 Jan 2017 08:58:06 +0000 (09:58 +0100)]
Tags for tests with IPSec.

Change-Id: Ic06bd15de44303f99133fa0df83319b5568b64dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoUpdate: plot script for new tags 55/4655/1
pmikus [Thu, 12 Jan 2017 11:55:05 +0000 (12:55 +0100)]
Update: plot script for new tags

Update plot script based on the change in TC TAGS

Change-Id: I9412e38d4306b69c75b16943b64b987c2553c167
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-501: Perf tests re-tagging 45/4645/3
Tibor Frank [Wed, 11 Jan 2017 14:02:13 +0000 (15:02 +0100)]
CSIT-501: Perf tests re-tagging

 - Implement tags introduced by https://gerrit.fd.io/r/#/c/3856/

Change-Id: I59313f43f338e2b4a1ad5caf9521b1a0da84d1d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoClean up bootstrap-verify-perf file 25/4625/2
pmikus [Tue, 10 Jan 2017 14:07:57 +0000 (15:07 +0100)]
Clean up bootstrap-verify-perf file

Remove obsolete code from performance bootstrap file

Change-Id: I8486c000ee4049b390017a1bf96459ec9fc828ea
Signed-off-by: pmikus <pmikus@cisco.com>
7 years ago Add the DPDK l2fwd performance test cases. 61/3961/23
Fangyin Hu [Fri, 25 Nov 2016 11:52:22 +0000 (03:52 -0800)]
Add the DPDK l2fwd performance test cases.

Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
7 years agoFix: Crypto-dev TB3 topology changes 34/4634/2
pmikus [Wed, 11 Jan 2017 08:32:52 +0000 (09:32 +0100)]
Fix: Crypto-dev TB3 topology changes

- Add crypto device into TB3 topology file
- Change the @PCI after new device insertion

Change-Id: I7fabe3173506c473982490fe24976b68ab45430c
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-482: HC Test - NAT 67/4367/5
selias [Fri, 16 Dec 2016 14:28:39 +0000 (15:28 +0100)]
CSIT-482: HC Test - NAT

 - add NAT test suite
 - add keywords and methods for configuring and reading NAT settings
 - add test data used in NAT suite

Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-469 Rename performance suites 56/3856/16
pmikus [Wed, 16 Nov 2016 15:45:05 +0000 (16:45 +0100)]
CSIT-469 Rename performance suites

Rename performance suites and add more TAGS

Change-Id: I6a5251bb6e380fe2a47a6ec1c1aeb4a9f70c5ce3
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: Fix log archiving in honeycomb tests 08/4608/2
selias [Mon, 9 Jan 2017 15:10:17 +0000 (16:10 +0100)]
HC Test: Fix log archiving in honeycomb tests

Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced
Signed-off-by: selias <samelias@cisco.com>
7 years agoFix: Add prefix to elements of output-perf-xml 15/4615/2
pmikus [Tue, 10 Jan 2017 07:06:23 +0000 (08:06 +0100)]
Fix: Add prefix to elements of output-perf-xml

Robot results parser is using names of suites to create XML with
performance data. This patch is supposed to fix the situation when
the name of suite starts with digit. This leads to issue that
final XML is not valid.

Change-Id: I0046da4ff62f661de07f8e659ae511610c8c61f8
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-499: Perf Tests - VXLAN + L2BD + vhost 70/4570/5
Tibor Frank [Thu, 5 Jan 2017 08:16:14 +0000 (09:16 +0100)]
CSIT-499: Perf Tests - VXLAN + L2BD + vhost

 - Packet throughput L2BD test cases with VXLANoIPv4 and vhost

Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 99/4599/1
Jan Gelety [Mon, 9 Jan 2017 08:36:35 +0000 (09:36 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~64-gf952692~b1689_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1072/

Change-Id: I6e760f4145ee5c31f34f725c9d9d923575688410
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoFix pylint messages 08/4508/7
Peter Mikus [Mon, 2 Jan 2017 12:49:22 +0000 (12:49 +0000)]
Fix pylint messages

Change-Id: I78ca27169f7f0fd6d786f222684e4c482ae54a43
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-498: Packet throughput L2BD with VXLANoIPv4 10/4510/2
Tibor Frank [Mon, 2 Jan 2017 13:58:34 +0000 (14:58 +0100)]
CSIT-498: Packet throughput L2BD with VXLANoIPv4

 - Add performance tests for packet throughput L2BD with VXLANoIPv4

Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoAdd Centos 7 image to CSIT. 60/3860/6
Thomas F Herbert [Tue, 15 Nov 2016 23:59:48 +0000 (18:59 -0500)]
Add Centos 7 image to CSIT.

JIRA: CSIT-256
JIRA: CSIT-490

libpcap and Qemu version 2.3.0
Centos 7.3 support added from 7.3.1611 base image.

Change-Id: Ia4ebe22980206cade4beb87760a455ca18f9fbfc
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
7 years agoUpdate of VPP_STABLE_VER 02/4502/1
Jan Gelety [Mon, 2 Jan 2017 11:03:38 +0000 (12:03 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~25-gfdc62ab~b1650_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1070/

Change-Id: I7eadc339053cfeff99103308660933eb3362f046
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-488 TLDK jbb validation jobs need cmake installed 03/4403/2
pmikus [Tue, 20 Dec 2016 07:17:16 +0000 (08:17 +0100)]
CSIT-488 TLDK jbb validation jobs need cmake installed

Add cmake into VIRL Ubuntu image

Change-Id: I2cd33a58c0043a2c3e04809d1f73068520767929
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoFix: Qemu wait_until_vm_boot 40/4440/1
pmikus [Wed, 21 Dec 2016 08:51:47 +0000 (09:51 +0100)]
Fix: Qemu wait_until_vm_boot

There is an issue that booting Nested VM is successful but
QGA guest-ping or flush returns partial response. This fix suppose
to do checking until an error or timeout occurs. In case of QGA
returns correct response it is success. In case of partial
response it will log an error and continue in checking.

Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 78/4378/1
Jan Gelety [Mon, 19 Dec 2016 08:54:08 +0000 (09:54 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.01-rc0~256-gbd6462e~b1592_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1065/

Change-Id: I70019095a41c5e8bc8a15c472c608b77124cbe7f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoPylint fixes 75/4375/2
Peter Mikus [Sat, 17 Dec 2016 07:13:45 +0000 (07:13 +0000)]
Pylint fixes

- fix Map.py

Change-Id: I0241e655df12f8135884e48d14c8eea43c501323
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoFix: CSIT documentation auto generation 71/4371/2
Peter Mikus [Fri, 16 Dec 2016 19:36:01 +0000 (19:36 +0000)]
Fix: CSIT documentation auto generation

- fix the path error

Change-Id: Ia1e491bd9a9f7f803571e8e7309c97fc7f388efc
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: Add EXPECTED_FAILING tag to expected test falures 65/4365/4
selias [Fri, 16 Dec 2016 12:52:48 +0000 (13:52 +0100)]
HC Test: Add EXPECTED_FAILING tag to expected test falures

Change-Id: Ic197001f2bb5ad5be9246025502d49e90e0c44aa
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT Documentation auto generation 62/4362/3
Tibor Frank [Fri, 16 Dec 2016 11:22:54 +0000 (12:22 +0100)]
CSIT Documentation auto generation

 - remove all *.rst files in env from build
 - add ignore list for directories which will not be included in build

Change-Id: Ifef18255d366094704041b526d707fdb6fc4567d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoCSIT-484: HC Test: Lisp 00/4200/7
selias [Fri, 9 Dec 2016 17:35:11 +0000 (18:35 +0100)]
CSIT-484: HC Test: Lisp

 - add Lisp test suite
 - add Lisp test data
 - add keywords and methods used in Lisp tests

Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-424: HC Test: JSON comparison function rework 99/4199/4
selias [Fri, 9 Dec 2016 17:11:53 +0000 (18:11 +0100)]
CSIT-424: HC Test: JSON comparison function rework

When comparing multi-level JSON trees, the exceptions raised
carry more useful information.

Keys and values not present in reference data are ignored.

No longer puts chunks of honeycomb's log file into robot report. The
entire log file will be archived after https://gerrit.fd.io/r/4171

Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7
Signed-off-by: selias <samelias@cisco.com>
7 years agoPylint fixes 30/4330/8
Tibor Frank [Thu, 15 Dec 2016 09:52:33 +0000 (10:52 +0100)]
Pylint fixes

 - Fix PyLint errors
 - Fix comments in touched python modules

Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoHC Test: fix archiving artifacts in csit-hc2vpp jobs 35/4335/2
selias [Thu, 15 Dec 2016 12:51:57 +0000 (13:51 +0100)]
HC Test: fix archiving artifacts in csit-hc2vpp jobs

Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d
Signed-off-by: selias <samelias@cisco.com>
7 years ago check the return value 59/3959/4
Fangyin Hu [Fri, 25 Nov 2016 11:31:16 +0000 (03:31 -0800)]
check the return value

Change-Id: Id507ba1a139415b395f99cd3fcbe2581e1fe3f54
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
7 years ago download and install DPDK in the robot file. 60/3960/5
Fangyin Hu [Fri, 25 Nov 2016 11:45:16 +0000 (03:45 -0800)]
download and install DPDK in the robot file.

Change-Id: I6bb80331fb0b61dd276a9f23f906c3fdd615c569
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
7 years agoFix: Qemu wait_until_vm_boot 76/4276/4
Peter Mikus [Wed, 14 Dec 2016 10:31:46 +0000 (10:31 +0000)]
Fix: Qemu wait_until_vm_boot

There is an issue that booting Nested VM is successful but
QGA guest-ping returns partial response. This fix suppose to
do checking until an error or timeout occurs. In case of QGA
returns correct response it is success. In case of partial
response it will log an error and continue in checking.

Change-Id: I8a2469287abaa9398a9206988e579912840f20c4
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agovhost perf testing with Qemu 5t5pc 19/4219/10
pmikus [Mon, 12 Dec 2016 13:25:06 +0000 (14:25 +0100)]
vhost perf testing with Qemu 5t5pc

Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is
not enough anymore as we are testing VPP with 4t4pc. This patch
is supposed to increase the number of core used by testpmd.

Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agofix of stop-testcase script 73/4273/2
Jan Gelety [Wed, 14 Dec 2016 09:36:17 +0000 (10:36 +0100)]
fix of stop-testcase script

- use if statement to avoid deletion of /nfs/scratch directory
  in case that session-id is not provided

Change-Id: Iffca231755ebef71babdd74447a0712bc21265ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: fix artifact archiving in csit-hc2vpp jobs 63/4263/6
selias [Tue, 13 Dec 2016 09:43:38 +0000 (10:43 +0100)]
HC Test: fix artifact archiving in csit-hc2vpp jobs

 - scp the honeycomb log from virl DUT

 - remove unused bootstrap file left over from the old job

Change-Id: I863436bb8865d2003812e21f01854855059665f6
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-470 Add option to configure CFS scheduler priority for VPP 47/3847/23
pmikus [Wed, 16 Nov 2016 13:34:05 +0000 (14:34 +0100)]
CSIT-470 Add option to configure CFS scheduler priority for VPP

Add option to configure CFS scheduler priority for VPP

Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 12/4212/2
Jan Gelety [Mon, 12 Dec 2016 09:24:48 +0000 (10:24 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.01-rc0~226-gd7cb1b5~b1562_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1063/

Change-Id: I8e11c750dff6d54fe4e21b9686e464a7e6e1c312
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoFix: Nested VM performance optimizations 48/4148/7
pmikus [Wed, 7 Dec 2016 12:19:59 +0000 (13:19 +0100)]
Fix: Nested VM performance optimizations

- Fix he issue with packet loss by workaround
- Fix the isolcpu patch

Change-Id: Ia9945963a63fceef5ce00d9cbcd0228c81783a47
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-484: HC Test: Add scripts for new hc2vpp jobs 70/4170/7
selias [Thu, 8 Dec 2016 10:18:52 +0000 (11:18 +0100)]
CSIT-484: HC Test: Add scripts for new hc2vpp jobs

 - add package download script that also installs jvpp .jar
   to maven local repo
 - add bootstrap scripts for the new jobs

 Related ci-management commit: https://gerrit.fd.io/r/4171

Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-474: CSIT documentation auto generation 75/4175/2
Tibor Frank [Thu, 8 Dec 2016 12:05:26 +0000 (13:05 +0100)]
CSIT-474: CSIT documentation auto generation

- Remove env dirs from built doc
- Create tar.gz file from built doc

Change-Id: Ic5e5eb339058783b0e88296f332988a70ab6189e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoCorrect the checking of return values. 77/4177/2
Tibor Frank [Thu, 8 Dec 2016 12:58:32 +0000 (13:58 +0100)]
Correct the checking of return values.

Change-Id: Icf9f37e0ab0ce4eef3532d3b18f82e9dc5f8f999
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoCSIT-494 Add multi-queue support for Qemu 78/4178/2
pmikus [Thu, 8 Dec 2016 13:28:52 +0000 (14:28 +0100)]
CSIT-494 Add multi-queue support for Qemu

Add multi-queue support when starting qemu. Full implementation
will be following in near future.

Change-Id: I743bbde67254b26a4e4e98072bad57dde728845a
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoFix map-e variable set generator 55/4155/1
Matej Klotton [Wed, 7 Dec 2016 16:44:02 +0000 (17:44 +0100)]
Fix map-e variable set generator

- a first octet can not be 127.

Change-Id: I003a00b4aed61f46d4ae6a4bace561bba9ee5a28
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoAdd system optimization on physical testbed I 35/4135/1
pmikus [Wed, 7 Dec 2016 07:23:21 +0000 (08:23 +0100)]
Add system optimization on physical testbed I

This patch is adding kernel and vm optimizations for physical testbeds.

Change-Id: I7b54bf528f7d2cee788d8047d259877b7e362872
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 05/4105/1
Jan Gelety [Mon, 5 Dec 2016 15:10:13 +0000 (16:10 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.01-rc0~163-g00dad12~b1499_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1061/

Change-Id: If9f3d34dce5398d23947300999ae1c38381b6d50
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-425: HC Test: Fix package download script 92/4092/1
selias [Mon, 5 Dec 2016 09:04:00 +0000 (10:04 +0100)]
CSIT-425: HC Test: Fix package download script

Change-Id: I2fefae2cea5fadec8c0096571397c71f26b86263
Signed-off-by: selias <samelias@cisco.com>
7 years agoFix: Reading huge pages information during Qemu start 65/4065/3
pmikus [Fri, 2 Dec 2016 07:15:22 +0000 (08:15 +0100)]
Fix: Reading huge pages information during Qemu start

Reading information from sysfs or proc files is randomly failing
returning empty string without any error.
This fix suppose to add the retries to read the hugepages
information multiple times and raise exception if reading failed.

Change-Id: I7c88504765c39b11c81f7a8e77e5b0e32b7225fe
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoFix dpdk16.11 hashsum 64/4064/1
pmikus [Fri, 2 Dec 2016 05:24:02 +0000 (06:24 +0100)]
Fix dpdk16.11 hashsum

Due to rebuild of DPDK 16.11 package by DPDK-dev there is a changed hash sum.
This fix is supposed to correct hash sum.

Change-Id: I68fc81bcf848abca07e902a0b8754d56a3d2733c
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-486: Remove interface stats check from ipv4 untagged TC05 55/4055/2
Dave Wallace [Thu, 1 Dec 2016 17:07:25 +0000 (12:07 -0500)]
CSIT-486: Remove interface stats check from ipv4 untagged TC05

Change-Id: I72c7cac30e899962516636f550e36a8cd04ffa59
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
7 years agoCSIT-481: HC Test: Port mirroring (SPAN) 83/3983/5
selias [Fri, 25 Nov 2016 09:50:29 +0000 (10:50 +0100)]
CSIT-481: HC Test: Port mirroring (SPAN)

 - add port mirroring test suite
 - add relevant keywords

Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252
Signed-off-by: selias <samelias@cisco.com>
7 years agoAdd list of packages for ubuntu VIRL image 1.5 43/4043/1
pmikus [Thu, 1 Dec 2016 06:44:25 +0000 (07:44 +0100)]
Add list of packages for ubuntu VIRL image 1.5

Change-Id: I94db829471f40b4499d7cb434d03f672e1b68d8e
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-467 Add libpcap-dev packages to VIRL image 72/3772/5
pmikus [Fri, 11 Nov 2016 08:37:54 +0000 (09:37 +0100)]
CSIT-467 Add libpcap-dev packages to VIRL image

- Add libpcap-dev packages to VIRL image
- Small fixes

Change-Id: I111b0d7e89180ffb7efa76c6503e687f715367f8
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-454: HC Test: Update module feature names 84/3984/2
selias [Tue, 29 Nov 2016 08:39:00 +0000 (09:39 +0100)]
CSIT-454: HC Test: Update module feature names

 - outdated due to HC project change - split to honeycomb and hc2vpp

Change-Id: If9e3c9baf7787067eff6a759be1ad9aa386c6e0f
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 74/3974/1
Jan Gelety [Mon, 28 Nov 2016 12:05:16 +0000 (13:05 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.01-rc0~115-gdc5252b~b1449_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1059/

Change-Id: I9db5a7a5de06a31f4d65ed1256039328d9f692a7
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-460: HC Test: Rework existing PBB tests 22/3922/3
selias [Tue, 22 Nov 2016 14:05:19 +0000 (15:05 +0100)]
CSIT-460: HC Test: Rework existing PBB tests

Rework PBB tests to account for changes in:
https://gerrit.fd.io/r/2520
https://gerrit.fd.io/r/1833

Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-474: CSIT doc auto-generation 30/3930/4
Tibor Frank [Wed, 23 Nov 2016 08:42:29 +0000 (09:42 +0100)]
CSIT-474: CSIT doc auto-generation

- See resources/tools/doc_gen/README.rst for details

Change-Id: Ie5704c93a41e456d65fcd6df2d9d8c96987deebb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoCSIT-425: HC Test: NSH-SFC test suite 12/3712/9
selias [Mon, 7 Nov 2016 15:04:26 +0000 (16:04 +0100)]
CSIT-425: HC Test: NSH-SFC test suite

 - add keyword to enable optional modules in Honeycomb (including NSH)
 - update honeycomb __init__.robot with the new keyword
 - add python and robot libraries for NSH tests
 - add NSH test suite (CRUD operations)

Change-Id: I869069a138a51d56d25522163c3a6deefb316f46
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-457: HC Test: Document expected test failures 49/3949/3
selias [Thu, 24 Nov 2016 13:32:18 +0000 (14:32 +0100)]
CSIT-457: HC Test: Document expected test failures

 - add EXPECTED_FAILING tag to all known test failures
 - document every use of EXPECTED_FAILING tag ,include Jira issue ID
 - minor fixes to interface, sub-interface and ACL test suites

Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2
Signed-off-by: selias <samelias@cisco.com>
7 years agoFix documentation and pylint errors 61/3861/10
pmikus [Thu, 17 Nov 2016 07:38:06 +0000 (08:38 +0100)]
Fix documentation and pylint errors

- Fix documentation to be comliant with sphinx
- Fix pylint errors

Change-Id: I64acaa6c330c5a3b2975efc4120260813a2b3a92
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-426: HC Test: Netconf transaction revert 23/3923/2
selias [Tue, 22 Nov 2016 16:26:05 +0000 (17:26 +0100)]
CSIT-426: HC Test: Netconf transaction revert

 - add test cases for reverting Netconf transactions
 - minor fixes to existing Netconf test case

Change-Id: Id6e5d26f815b14da29194181bf333e845f5b623c
Signed-off-by: selias <samelias@cisco.com>
7 years agoFIX: Increase ip6 heapsize 29/3929/2
pmikus [Wed, 23 Nov 2016 05:50:59 +0000 (06:50 +0100)]
FIX: Increase ip6 heapsize

Change-Id: I6ea568e15e5c5b3ec6d3fd1977fb5d4a5ce17484
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoRemove workaround for ip_address_dump 08/3908/2
selias [Mon, 21 Nov 2016 16:15:38 +0000 (17:15 +0100)]
Remove workaround for ip_address_dump

As of change https://gerrit.fd.io/r/3816, ip_address_dump returns
IP addresses properly.

Change-Id: If3b4a32e5166bd517beaa2ddb35262c406b1dcea
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 01/3901/2
Jan Gelety [Mon, 21 Nov 2016 13:08:33 +0000 (14:08 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.01-rc0~81-g7dc4146~b1415_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1057/

Change-Id: Ica77c384f434c892bd403459c19f791379571b5f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT:454 - HC Test: Increase timeout for Honeycomb startup 96/3896/2
selias [Mon, 21 Nov 2016 12:18:31 +0000 (13:18 +0100)]
CSIT:454 - HC Test: Increase timeout for Honeycomb startup

Change-Id: I44288ecd8664e75b9acfbd2d0e03d9712f4010b1
Signed-off-by: selias <samelias@cisco.com>
7 years agoAdd performance optimization to Nested VM 88/3888/2
Peter Mikus [Mon, 21 Nov 2016 08:33:33 +0000 (08:33 +0000)]
Add performance optimization to Nested VM

- Add isolcpu to grub
- Add SMP affinity pinning into testpmd startup script

Change-Id: I027635f9c27f565e2be10656663463a1b7274afc
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoAdd IRQ pinning to ansible host-setup 58/3858/2
pmikus [Wed, 16 Nov 2016 20:24:28 +0000 (21:24 +0100)]
Add IRQ pinning to ansible host-setup

Change-Id: I4eb46763213cc9e8723a6ff1cf380a5498aae7d6
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-470 Add option to configure CFS scheduler priority for QEMU 31/3831/4
pmikus [Tue, 15 Nov 2016 13:47:38 +0000 (14:47 +0100)]
CSIT-470 Add option to configure CFS scheduler priority for QEMU

Add option to configure CFS scheduler priority for QEMU

Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-454: HC Test: Improve logging on test failure 11/3811/4
selias [Mon, 14 Nov 2016 12:57:40 +0000 (13:57 +0100)]
CSIT-454: HC Test: Improve logging on test failure

 - set Honeycomb log level to TRACE before running Honeycomb tests
 - on a failed restconf request, print the last few lines of the log
 - show saved configuration during persistence suite restarts

Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-403 Data-Driven Performance Test Suite II 35/3535/14
pmikus [Mon, 24 Oct 2016 07:21:09 +0000 (09:21 +0200)]
CSIT-403 Data-Driven Performance Test Suite II

- L2BD XL710

Change-Id: Ie8c0f0db6d8e10da194da9b0b8cc61388d50604c
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoSwitch to nested image 1.5 in perf 14/3814/2
pmikus [Mon, 14 Nov 2016 13:35:27 +0000 (14:35 +0100)]
Switch to nested image 1.5 in perf

Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 06/3806/2
Jan Gelety [Mon, 14 Nov 2016 09:21:24 +0000 (10:21 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.01-rc0~45-ge5af88c~b1379_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1055/

Change-Id: If85b3d6e2b3d0ce1fbecc746e51a9e779360a28c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-472: Update of DPDK to 16.11 in Nested VM 32/3632/3
pmikus [Mon, 31 Oct 2016 06:07:49 +0000 (07:07 +0100)]
CSIT-472: Update of DPDK to 16.11 in Nested VM

Update of DPDK to 16.11 in Nested VM.

Change-Id: I9296e4d197aa57516cbd6fd4eed26ce6179d0f8e
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-471: Fix check of DHCPv6 message types. 80/3780/3
Jan Gelety [Fri, 11 Nov 2016 11:51:01 +0000 (12:51 +0100)]
CSIT-471: Fix check of DHCPv6 message types.

 - use message typoe check for every DHCPv6 message
 - remove EXPECTED_FAILING tag from TC01: VPP proxies valid DHCPv6 request
   to DHCPv6 server

Change-Id: Idf1d3feb0f445bb5b0acc03671344ca63acbf4f3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-454: HC Test: add Honeycomb section to topology file 79/3779/1
selias [Fri, 11 Nov 2016 11:24:35 +0000 (12:24 +0100)]
CSIT-454: HC Test: add Honeycomb section to topology file

 - modified to match xenial topology file

Change-Id: Ic160a6162e6fab7c0232a80ce08cf6d0479717c7
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-454: HC Test: fix package installation in csit-honeycomb job 74/3774/1
selias [Fri, 11 Nov 2016 09:15:13 +0000 (10:15 +0100)]
CSIT-454: HC Test: fix package installation in csit-honeycomb job

Change-Id: I7614f7a48c989442cb52dd65fb5fe3740f19c603
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-454: HC Test: fix package installation in csit-honeycomb job 73/3773/2
selias [Fri, 11 Nov 2016 08:54:54 +0000 (09:54 +0100)]
CSIT-454: HC Test: fix package installation in csit-honeycomb job

Change-Id: Iaba98bcd5970396c822544d78256a0fa2a62fc8a
Signed-off-by: selias <samelias@cisco.com>
7 years agoDHCPv6 messages - increase log info 61/3761/3
Jan Gelety [Thu, 10 Nov 2016 13:07:44 +0000 (14:07 +0100)]
DHCPv6 messages - increase log info

- log content of variable in case it doesn't match expected value

Change-Id: Ie0718923b347589a85897c6bc7b4f252b724f083
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-454: HC Test: fix package installation in csit-honeycomb job 60/3760/2
selias [Thu, 10 Nov 2016 12:27:26 +0000 (13:27 +0100)]
CSIT-454: HC Test: fix package installation in csit-honeycomb job

Change-Id: Ie8ef408d87f2bd0327489179507076c6ea619e1e
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 45/3745/1
Jan Gelety [Wed, 9 Nov 2016 13:57:59 +0000 (14:57 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.01-rc0~16-g80e8816~b1350_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1054/

Change-Id: I0db9dcd618c5d081579e05f3770909a4dce335b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-347: Remove EXPECTED_FAILING tag from TC 74/3374/10
Matej Klotton [Wed, 12 Oct 2016 12:05:13 +0000 (14:05 +0200)]
CSIT-347: Remove EXPECTED_FAILING tag from TC

Change-Id: Ic6780fc33ecbfaed12ed30e665ad3ab0a67d04fe
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoCSIT-423: HC Test: delete VxLAN interface 55/3655/5
selias [Tue, 4 Oct 2016 12:41:16 +0000 (14:41 +0200)]
CSIT-423: HC Test: delete VxLAN interface

Modify VxLAN test cases to account for changes in Honeycomb.

Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-465: Common test setup and teardown 85/3685/10
Tibor Frank [Thu, 27 Oct 2016 13:33:42 +0000 (15:33 +0200)]
CSIT-465: Common test setup and teardown

This test setup and teardown is aimed to be used with all functional
tests.
It does not include functionality to manipulate VMs (qemu).

Test setup includes:
- Setup all DUTs before test
- Save VPP PIDs
- Setup all TGs before traffic script
- Update All Interface Data On All Nodes

Test teardown includes:
- Show Packet Trace on All DUTs
- Show vpp trace dump on all DUTs
- Vpp Show Errors On All DUTs
- Check VPP PID in Teardown

Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoCSIT-456: IPv4 - ip4-ipsec-lispgpe-ip6 - main fib, vrf, phy2lisp, virt2lisp 66/3566/2
Zdeno Olsovsky [Tue, 25 Oct 2016 11:25:24 +0000 (13:25 +0200)]
CSIT-456: IPv4 - ip4-ipsec-lispgpe-ip6 - main fib, vrf, phy2lisp, virt2lisp

Change-Id: I844d7ef39f4c107ef1d363d8110ef6194b98dfe6
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
7 years agoCSIT-393 ip4-ipsec-lispgpe-ip4 virt2lisp 80/3480/20
Patrik Hrnciar [Wed, 19 Oct 2016 08:20:36 +0000 (10:20 +0200)]
CSIT-393 ip4-ipsec-lispgpe-ip4 virt2lisp

Change-Id: I22f0e238c8b0cddbddca7f86bc18a0a916f7e3d3
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
7 years agoCSIT-468 Issue retrieving numa node of NIC 03/3703/4
pmikus [Sat, 5 Nov 2016 16:30:45 +0000 (17:30 +0100)]
CSIT-468 Issue retrieving numa node of NIC

Issue retrieving numa node of NIC

Change-Id: Ia6f826c100a012b23e046e48fe1e505ed0c4c8e8
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-458 Use node aware config in all perf TCs 59/3559/10
pmikus [Tue, 25 Oct 2016 08:26:47 +0000 (10:26 +0200)]
CSIT-458 Use node aware config in all perf TCs

- Use node aware config in all perf TCs

Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-454: Add topology and virl params to csit-honeycomb job 77/3677/4
selias [Thu, 3 Nov 2016 08:35:49 +0000 (09:35 +0100)]
CSIT-454: Add topology and virl params to csit-honeycomb job

Change-Id: Ifdf04cad9e04cdc3f28b0382c43e6f7192e58858
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-451 LISP vrf tests rework 98/3498/9
Zdeno Olsovsky [Wed, 19 Oct 2016 07:16:31 +0000 (09:16 +0200)]
CSIT-451 LISP vrf tests rework

Change-Id: I2dac2eaff828672c2d921e889356b70baed5f4da
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
7 years agoCSIT-457: Address Honeycomb test failures 45/3545/4
selias [Mon, 24 Oct 2016 16:15:52 +0000 (18:15 +0200)]
CSIT-457: Address Honeycomb test failures

 - tag all not-implemented features with EXPECTED_FAILING
 - add workarounds for known issues with VAT dump commands
 - replace hardcoded test data with parametrized
 - separate IP neighbor and IP address into two test cases
 - support unordered lists with compare_data_structures keyword

Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-466 Remove dpdk-vhost tests 93/3693/1
pmikus [Fri, 4 Nov 2016 07:25:54 +0000 (08:25 +0100)]
CSIT-466 Remove dpdk-vhost tests

Remove dpdk-vhost tests

Change-Id: Ia4dc0f1b6756475bd69857cb2a01870a24431df3
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-461 Fix VPP version variable in perf bootstrap 61/3661/9
pmikus [Wed, 2 Nov 2016 13:57:52 +0000 (14:57 +0100)]
CSIT-461 Fix VPP version variable in perf bootstrap

Fix VPP_STABLE_VER variable in performance bootstrap

Change-Id: I5d27e870d8c1383a054125a82cc5d5be6e2fa9c4
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-245: IPv6 - ip4-lispgpe-ip6 95/3595/4
Zdeno Olsovsky [Wed, 26 Oct 2016 12:57:42 +0000 (14:57 +0200)]
CSIT-245: IPv6 - ip4-lispgpe-ip6

Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 67/3667/1
Jan Gelety [Wed, 2 Nov 2016 15:27:18 +0000 (16:27 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 16.12-rc0~285-gd5c9d6f~b1311_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1052/

Change-Id: I7e52b22850f8b152e71d27012e50efcbc80efc43
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-385 CSIT-386 IPv4/IPv6 IPsec tests 73/3373/8
Patrik Hrnciar [Wed, 12 Oct 2016 12:01:16 +0000 (14:01 +0200)]
CSIT-385 CSIT-386 IPv4/IPv6 IPsec tests

  - encryption/integrity key update tests

Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agotopo_installation -c shouldn't fail if rmdir fails 85/3585/2
Miroslav Miklus [Wed, 26 Oct 2016 09:48:10 +0000 (11:48 +0200)]
topo_installation -c shouldn't fail if rmdir fails

Change-Id: Ie24a1d4f9b8ef698b8dba9d1fcbb32476a1df2bb
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoDHCPv6 Proxy test update 08/3608/3
Patrik Hrnciar [Thu, 27 Oct 2016 11:02:05 +0000 (13:02 +0200)]
DHCPv6 Proxy test update

Change-Id: I8206a652bfa31cda0f7120741a0479a10ad4b1a1
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
7 years agoTB3 Cisco-VIC-1227 78/3578/4
Miroslav Miklus [Tue, 25 Oct 2016 21:39:59 +0000 (23:39 +0200)]
TB3 Cisco-VIC-1227

Change-Id: I77455f720fb691038b1c539a9d4fa5c590f2b420
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoTB2 Cisco-VIC-1227 76/3576/4
Miroslav Miklus [Tue, 25 Oct 2016 19:49:27 +0000 (21:49 +0200)]
TB2 Cisco-VIC-1227

Change-Id: I82372448363406aa8c562f4a98216793ad309a93
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoTB1 Cisco-VIC-1227 topology file 94/3594/3
Miroslav Miklus [Wed, 26 Oct 2016 11:54:58 +0000 (13:54 +0200)]
TB1 Cisco-VIC-1227 topology file

Change-Id: I23bb0fd4511b4a21bcf57e4fc010084c48bb1008
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoIncrease timeout for 'vpp restart' operations 99/3599/3
Miroslav Miklus [Wed, 26 Oct 2016 14:49:26 +0000 (16:49 +0200)]
Increase timeout for 'vpp restart' operations

Systemd first send SIGTERM and wait 90s (default value)
to send SIGKILL to terminate the vpp service.

Change-Id: Ia582cfdc4bebc5d3530e82692856fe733d0b001e
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>