csit.git
4 years agoSuite: cop. 89/1589/3
Maciek Konstantynowicz [Wed, 15 Jun 2016 20:52:05 +0000 (21:52 +0100)]
Suite: cop.
Files: cop_whitelist_blacklist.robot, cop_whitelist_blacklist_IPv6.robot.
Updated test cases names and test cases documentation.

Change-Id: I70c415d85521c27b9ec209fb65b60afcb938846d
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoModify tests for Honeycomb sub-interfaces 38/1538/9
Tibor Frank [Tue, 14 Jun 2016 09:48:54 +0000 (11:48 +0200)]
Modify tests for Honeycomb sub-interfaces

JIRA: CSIT-139

- modify tests for Honeycomb sub-interfaces to reflect the last changes
  in the model
- modify existing keywords to work with latest changes in Honyecomb and VPP

Change-Id: Idc88fbac7e743e6125d5c865d9d144448657dd20
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-154: Fetch superseded Ubuntu packages using Launchpad API 08/1508/3
Carsten Koester [Sat, 11 Jun 2016 20:12:05 +0000 (16:12 -0400)]
CSIT-154: Fetch superseded Ubuntu packages using Launchpad API

Change-Id: I0db121d7f2b227e62240941b026b58fcd233a129
Signed-off-by: Carsten Koester <ckoester@cisco.com>
4 years agoCSIT-155: Create empty Nested VM build directory if needed 09/1509/2
Carsten Koester [Sat, 11 Jun 2016 20:21:10 +0000 (16:21 -0400)]
CSIT-155: Create empty Nested VM build directory if needed

Change-Id: I760fee3ce1c86ae443930b7763727328fecd8250
Signed-off-by: Carsten Koester <ckoester@cisco.com>
4 years agoSmall changes in semiweekly job 00/1600/4
Jan Gelety [Thu, 16 Jun 2016 14:42:39 +0000 (16:42 +0200)]
Small changes in semiweekly job

- rename the job
- small corrections in the job

Change-Id: I46c3920dfa1b8b0d220b1a6a507a944f3346db05
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoLisp enable/disable test 16/1416/8
Andrej Kozemcak [Thu, 26 May 2016 13:35:02 +0000 (15:35 +0200)]
Lisp enable/disable test

Test lisp enable/disable API.
Test disable lisp, re-enable it and check if everthing is still working.
Enable lisp before every lisp API test
Reformat source data

Change-Id: I7bace01535562814d85d7b5f6035436d583abf53
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
4 years agoFix VPP sends ARP requests for unknown destinations TC destination MAC address 83/1483/10
Matej Klotton [Thu, 9 Jun 2016 18:02:17 +0000 (20:02 +0200)]
Fix VPP sends ARP requests for unknown destinations TC destination MAC address

-JIRA: CSIT-142
The ICMP packet was send to wrong destination.
Don't use resolve-attemts in add route.
Fix testcase.
Add testcase Sends ARP to GW with EXPECTED_FAILING.
Variable naming fix.
Documentation update.

Change-Id: I71a7a274c154c525b176c87884d089155d7ae61b
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoChange VPP repo URL 14/1614/2
pmikus [Fri, 17 Jun 2016 07:27:45 +0000 (08:27 +0100)]
Change VPP repo URL

- Change VPP repo URL

Change-Id: I1ee06a809f15475e7871ec2840d90495b0054cc5
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoUse common file names to store VPP stable build data in branches 06/1506/3
Jan Gelety [Fri, 10 Jun 2016 21:40:43 +0000 (23:40 +0200)]
Use common file names to store VPP stable build data in branches

- use the same file names VPP_REPO_URL and VPP_STABLE_VER acrross
  branches to store the current branch repo url and stable vpp
  build version

Change-Id: Ie7c020d5b3722bfe3eb34a374b98a29cc76676f2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoRouter Advertisement Tests 30/1430/7
Zdeno Olsovsky [Wed, 1 Jun 2016 11:41:09 +0000 (13:41 +0200)]
Router Advertisement Tests

-JIRA: CSIT-30

Change-Id: Iedb403d555284d36a81cc490a79e56b019ebeed0
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
4 years agoIACL MAC filtering tests 52/1352/13
Patrik Hrnciar [Thu, 2 Jun 2016 11:59:35 +0000 (13:59 +0200)]
IACL MAC filtering tests

 - CSIT-133 VPP drops packets based on MAC src addr.
 - CSIT-134 VPP can drop packets based on src MAC + IPv6 UDP src+dst port.

Change-Id: I57d041bc5f3311946679128e556ceef8c4d55264
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
4 years agoCSIT-163: Add show vpp version verbose 20/1520/2
pmikus [Mon, 13 Jun 2016 11:36:54 +0000 (12:36 +0100)]
CSIT-163: Add show vpp version verbose

- Add output of vpp version verbose

Change-Id: Ia74b97be4636d55b115246d495a5d6eea0a94bb7
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoAdjust short test treshold based on latest results 85/1485/3
pmikus [Fri, 10 Jun 2016 06:05:38 +0000 (07:05 +0100)]
Adjust short test treshold based on latest results

Change-Id: Iad121a9f047e85f6e8cd8539af1aff829c10c875
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoCSIT-152: Detect if the T-rex is responding to API after start 92/1492/3
pmikus [Fri, 10 Jun 2016 11:13:15 +0000 (12:13 +0100)]
CSIT-152: Detect if the T-rex is responding to API after start

Change-Id: I99c8dcbd210175fa5d1af193371249e525dc0102
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoProcess output of robot to XML file for Plot plugin 13/1413/4
pmikus [Mon, 6 Jun 2016 10:09:24 +0000 (11:09 +0100)]
Process output of robot to XML file for Plot plugin

- JIRA: CSIT-135
- Process output of robot output.xml to XML file for Plot plugin

Change-Id: I5e077d81f4c93f66eb208ecc2a38a9f6ca2fe307
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoVPP startup config change (rss->txqueues) 33/1433/8
Miroslav Miklus [Tue, 7 Jun 2016 15:01:24 +0000 (17:01 +0200)]
VPP startup config change (rss->txqueues)

JIRA: CSIT-153

Change-Id: I6908670003e02e8dc2971c0308c27baffaf19b66
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoUse files to store VPP stable build data 32/1432/6
Jan Gelety [Tue, 7 Jun 2016 14:38:47 +0000 (16:38 +0200)]
Use files to store VPP stable build data

- add VPP_REPO_URL file to store path to VPP build repository
- add VPP_STABLE_VER file to store VPP stable build version
- adapt bootstrap*.sh files to read VPP build repository path
  and VPP stable build version from files

Change-Id: I2997320ec3df68eaf092795e5d553fb3f024d366
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-138: Cleanup of vpp packages. 46/1446/8
Miroslav Miklus [Wed, 8 Jun 2016 07:56:12 +0000 (09:56 +0200)]
CSIT-138: Cleanup of vpp packages.

Change-Id: I489762a156f5860f40809c9e62b0603353adf934
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoFix Vagrant config for multi-user environment 26/1426/2
Aurélien Degeorges [Mon, 6 Jun 2016 11:49:52 +0000 (13:49 +0200)]
Fix Vagrant config for multi-user environment

Add support for an environment variable "VPP_VAGRANT_NET_PREFIX" to add a prefix
before the name of vbox internal networks.
Otherwise two users trying to do "vargrant up" on the same server will face
conflicts with the name of vbox internal networks.

Change-Id: I5ba7c06fe111944fcac3da25276d018d281aef4f
Signed-off-by: Aurélien Degeorges <aurelien.degeorges@6wind.com>
4 years agoAdd Tests for Honeycomb VxLAN GPE support 11/1411/6
Tibor Frank [Mon, 6 Jun 2016 09:01:03 +0000 (11:01 +0200)]
Add Tests for Honeycomb VxLAN GPE support

JIRA: CSIT-131

- add tests for Honeycomb VxLAN GPE support
- add keywords needed for tests

Change-Id: I460ecd30835bb95140958b20946b1d41ac6d9abc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate T-rex to v2.03 part II 08/1408/7
pmikus [Mon, 6 Jun 2016 05:48:06 +0000 (06:48 +0100)]
Update T-rex to v2.03 part II

- JIRA: CSIT-132
- Update Trex via autoinstall script

Change-Id: I65753b35287d9322ef230642ea0dd3596f1da5c9
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoAdd Honeycomb persistence tests 63/1263/9
selias [Wed, 25 May 2016 15:16:11 +0000 (17:16 +0200)]
Add Honeycomb persistence tests

JIRA: CSIT-121

 - add honeycomb persistence test suite
 - add keywords used by persistence tests
 - add methods for working with Honeycomb persistence files
 - make suite setup clear persisted data before Honeycomb startup

Change-Id: Ief61c12b730d58a456566c4683c0091e08a09b56
Signed-off-by: selias <samelias@cisco.com>
4 years ago4 Vhosts setup test 51/1051/33
Zdeno Olsovsky [Tue, 10 May 2016 13:08:07 +0000 (15:08 +0200)]
4 Vhosts setup test

-JIRA: CSIT-64

Change-Id: I0d6fc522f3214d1b4887e65d5639a323efdf7dd7
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
4 years agoiACL TCP/UDP tests 27/1227/14
Patrik Hrnciar [Wed, 18 May 2016 09:53:52 +0000 (11:53 +0200)]
iACL TCP/UDP tests

 - IPv4 CSIT-92
 - IPv6 CSIT-107

Change-Id: Ia93e96f624ce73ef08b89d4b22334a67ebb69e13
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
4 years agoAdd test VPP honors DHCPv4 lease time 61/1361/3
Matej Klotton [Thu, 2 Jun 2016 15:41:24 +0000 (17:41 +0200)]
Add test VPP honors DHCPv4 lease time

-JIRA: CSIT-130

Change-Id: I1d0a92e8865021ac5c85e63256e1b75a839d4ce9
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoAdd test VPP sends DHCP REQUEST after OFFER 08/1208/12
Matej Klotton [Fri, 20 May 2016 08:29:41 +0000 (10:29 +0200)]
Add test VPP sends DHCP REQUEST after OFFER

 -JIRA: CSIT-101

Change-Id: I9b92920f8ce324c447cb44ed4cd8d7f8c9c9ed88
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoPATCH: Revert to T-rex version to v2.00 88/1388/1
pmikus [Fri, 3 Jun 2016 07:00:59 +0000 (08:00 +0100)]
PATCH: Revert to T-rex version to v2.00

- Revert T-rex version to v2.00 without installation from robot

Change-Id: I8d0c5fb57f01febc970d9fc9363965acd2e57ed4
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoUpdate T-rex version to v2.03 with installation from robot 79/1379/6
pmikus [Fri, 3 Jun 2016 07:00:59 +0000 (08:00 +0100)]
Update T-rex version to v2.03 with installation from robot

- JIRA: CSIT-132

- Update T-rex version to v2.03 with installation from robot

Change-Id: I7e222a61f88b1313273e6866dfc78d62b4d8ac93
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoCSIT-128: Remove EXPECTED_FAILING tag from VXLAN over IPv6 test cases 67/1367/1
Jan Gelety [Thu, 2 Jun 2016 21:05:45 +0000 (23:05 +0200)]
CSIT-128: Remove EXPECTED_FAILING tag from VXLAN over IPv6 test cases

- update vpp build to version 16.09-rc0~47-g3419d0b~b214_amd64
in bootstrap.sh and bootstrap-vpp-verify-weekly.sh

- remove tag EXPECTED_FAILING from VXLAN over IPv6 test cases as
the VPP-98 is closed

Change-Id: I377f7ee931424e6d38e918aeb9fc7ab450875631
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFinal result must be combination of all test runs in vpp-verify-weekly job. 63/1363/2
Jan Gelety [Thu, 2 Jun 2016 19:18:54 +0000 (21:18 +0200)]
Final result must be combination of all test runs in vpp-verify-weekly job.

- log clear final result based on results of all runs
- exit script with return code corresponding to  final result

Change-Id: If504b4c45a947502806011db9290ff41e4299490
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAdd documentation and files related to initial host setup 28/1028/4
Carsten Koester [Sun, 8 May 2016 05:27:47 +0000 (01:27 -0400)]
Add documentation and files related to initial host setup

Change-Id: I73deeb79e57ac7eca208faa49d04be37c7034163
Signed-off-by: Carsten Koester <ckoester@cisco.com>
4 years agoIPv6 COP - performance 62/1262/5
Peter Mikus [Wed, 25 May 2016 13:51:32 +0000 (15:51 +0200)]
IPv6 COP - performance

- JIRA: CSIT-109
- create topology with COP white-list applied on interfaces using IPv6
  in 3-node topology
- create necessary keywords to be used in test cases
- create ipv6_cop test cases (78B, 1518B, 9000B)

Change-Id: I2618971610f066b847c00e1ea18dc396555a9923
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoIPv4 COP - performance 54/1254/8
Peter Mikus [Wed, 25 May 2016 11:30:21 +0000 (13:30 +0200)]
IPv4 COP - performance

- JIRA: CSIT-105
- create topology with COP white-list applied on interfaces using IPv4
  in 3-node topology
- create necessary keywords to be used in test cases
- create ipv4_cop test cases (64B, 1518B, 9000B)

Change-Id: I0aeaaf3c295e9691f99fc2e03c57f67e7d568ed4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoUpdate T-rex version to v2.02 07/1207/11
Peter Mikus [Fri, 20 May 2016 07:31:07 +0000 (09:31 +0200)]
Update T-rex version to v2.02

- JIRA: CSIT-99
- Update T-rex version to v2.02 with stability fixed and
  to be able to measure latency

Change-Id: Ic014c81c5889dbb738f1f3f279138a73dffb01f3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-114: Eliminate repeated download of PIP packages 68/1268/2
Carsten Koester [Wed, 25 May 2016 21:52:01 +0000 (17:52 -0400)]
CSIT-114: Eliminate repeated download of PIP packages

Allow VirtualEnv to use existing system-wide packages if they already exist.

Change-Id: I6f39178d56e81affea0bee7b9065bef66712ddaa
Signed-off-by: Carsten Koester <ckoester@cisco.com>
4 years agoCSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on Ubuntu 49/1349/2
Dave Wallace [Thu, 2 Jun 2016 07:11:35 +0000 (03:11 -0400)]
CSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on Ubuntu

Change-Id: I10d7a1cb194e8116324524e2ce6dff909620d077
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoCSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on Ubuntu 69/1269/2
Dave Wallace [Wed, 25 May 2016 22:15:00 +0000 (18:15 -0400)]
CSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on Ubuntu

Change-Id: I05ea675a2eb6d0b240008efa0d27166616c6e741
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoUpdate of vpp build in bootstrap-vpp-verify-weekly.sh 57/1357/1
Jan Gelety [Thu, 2 Jun 2016 13:29:08 +0000 (15:29 +0200)]
Update of vpp build in bootstrap-vpp-verify-weekly.sh

- correction of REPO path

Change-Id: Iff6012046c3d749692dcd63d30d9797f45fc64bc
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoUpdate of vpp build in bootstrap-vpp-verify-weekly.sh 53/1353/2
Jan Gelety [Thu, 2 Jun 2016 12:48:30 +0000 (14:48 +0200)]
Update of vpp build in bootstrap-vpp-verify-weekly.sh

- vpp build updated to version 16.09-rc0~33-g4b46c84~b200_amd64

Change-Id: I0efce483c804c51403e2d9c195cf48a931193fae
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoRemove EXPECTED_FAILING tag from TC 30/1330/2
Matej Klotton [Tue, 31 May 2016 17:46:15 +0000 (19:46 +0200)]
Remove EXPECTED_FAILING tag from TC

- JIRA: CSIT-120

Change-Id: Icec1119cdd2aff0937db5e2e2fea8ea2fb31b0fa
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoCSIT-111: Add Packer based framework to auto-generate disk images 53/1253/7
Carsten Koester [Wed, 25 May 2016 09:58:29 +0000 (05:58 -0400)]
CSIT-111: Add Packer based framework to auto-generate disk images

Change-Id: Ia18ea34a6288aec0f12f176f4cc264d0f215d1fd
Signed-off-by: Carsten Koester <ckoester@cisco.com>
4 years agoAdd Honeycomb sub-interface and VLAN tests 73/1273/6
Tibor Frank [Thu, 26 May 2016 12:11:09 +0000 (14:11 +0200)]
Add Honeycomb sub-interface and VLAN tests

JIRA: CSIT-94
JIRA: CSIT-48

- add Honeycomb sub-interface tests
- add Honeycomb VLAN tests
- add keywords for sub-interface tests
- add keywords for VLAN tests

Change-Id: I89cd3b41dd9c60bfd946e24567d0ff93e5ea9fff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-125: Add test for lisp remote static mapping 13/1213/9
Andrej Kozemcak [Wed, 4 May 2016 13:39:38 +0000 (15:39 +0200)]
CSIT-125: Add test for lisp remote static mapping

Test Lisp functionality and rename lisp file
Testing this topology:
- IPv4 lisp topology
- IPv6 lisp topology
- IPv4 over IPv6
- IPv6 over IPv4

Change-Id: Ie3439ca802f1c8ae82a1dfcfdebe579f9dc47089
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
4 years agoCSIT-23 Add ARP request test. 36/1136/12
Patrik Hrnciar [Mon, 16 May 2016 10:51:50 +0000 (12:51 +0200)]
CSIT-23 Add ARP request test.

Change-Id: Ibb48e6d84efc55f7fb656283a954fbaefc7154e7
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
4 years agoCIMANAGE-7: Bootstrap for csit-vpp-master-verify-semiweekly job 48/1248/11
Jan Gelety [Tue, 24 May 2016 16:45:09 +0000 (18:45 +0200)]
CIMANAGE-7: Bootstrap for csit-vpp-master-verify-semiweekly job

- run func and perf_long tests in three test loops
- updated REPO in /resources/tools/download_install_vpp_pkgs.sh

Change-Id: Iff459b7719380404a242c80821806a9450271adf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoSample test suite for vpp sample plugin (macswap) 92/1292/6
Miroslav Miklus [Fri, 27 May 2016 19:47:57 +0000 (21:47 +0200)]
Sample test suite for vpp sample plugin (macswap)

JIRA: CSIT-123

Change-Id: I4774ddf3a2f67c322fe27e5f9d366f508156e70f
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoCSIT-98: MAC split-horizon group, part II 01/1201/21
Jan Gelety [Thu, 19 May 2016 14:36:48 +0000 (16:36 +0200)]
CSIT-98: MAC split-horizon group, part II

- test cases to test MAC split-horizon group functionality together
with VXLAN tunnel over IPv4 and over IPv6
- two IPv6 tests tagged EXPECTED_FAILING until VPP-98 is closed

- added update of bootstrap.sh - vpp build updated to version
  16.09-rc0~33-g4b46c84~b200_amd64

Change-Id: I1da6a98b11f5c39cd114abb35bb8f398cbbebf63
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPATCH: Return pybot exit code in bootstrap-verify-perf 03/1303/2
Peter Mikus [Mon, 30 May 2016 09:19:52 +0000 (11:19 +0200)]
PATCH: Return pybot exit code in bootstrap-verify-perf

- Return exit code from pybot instead of last command in bootstrap file.

Change-Id: If8430426d7259c832c0ea78d2d165d09f8c4eda7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRemove obsolete boostrap-hw-tb2 04/1304/2
Peter Mikus [Mon, 30 May 2016 09:35:04 +0000 (11:35 +0200)]
Remove obsolete boostrap-hw-tb2

- Remove obsolete bootstrap-hw-tb2 as it was replaced by
  bootstrap-verify-perf and ci-management is updated.

Change-Id: I23cfb5bcc4b3c1bede456936c978ec5428bba373
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd DHCP Client libs and VPP sends DHCPv4 Discover test 72/1172/8
Matej Klotton [Tue, 17 May 2016 12:21:18 +0000 (14:21 +0200)]
Add DHCP Client libs and VPP sends DHCPv4 Discover test

 -JIRA: CSIT-100

Change-Id: I4b6fc5d974ebe500d6c6bc74c14e1db7b3d10c3a
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoUpdate Honeycomb tests 22/1222/4
selias [Fri, 20 May 2016 11:51:48 +0000 (13:51 +0200)]
Update Honeycomb tests

 - add new test cases based on reported bugs
 - minor fixes

Change-Id: I8b7464bc1f4e786e3a0ef67ba64d81e1c25ae5cf
Signed-off-by: selias <samelias@cisco.com>
4 years agoFind PDR using binary search 92/1092/21
Peter Mikus [Fri, 13 May 2016 07:57:03 +0000 (09:57 +0200)]
Find PDR using binary search

- JIRA: CSIT-72
- modify libraries for PDR search evaluation
- write robot framework keywords for PDR search
- write Performance Test Cases using PDR

Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRename topology files with correct NIC names 58/1258/3
Miroslav Miklus [Wed, 25 May 2016 12:37:08 +0000 (14:37 +0200)]
Rename topology files with correct NIC names

JIRA: CSIT-106

Change-Id: I3bb33d0025c99f1cf0defe542a86f0d620b80730
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoPatch: Remove show stats keyword from teardown phase 57/1257/3
Peter Mikus [Wed, 25 May 2016 12:32:07 +0000 (14:32 +0200)]
Patch: Remove show stats keyword from teardown phase

- JIRA: CSIT-104
- Remove duplicity of showing stats
- Remove "Show statistics on all DUTs" from "Test Teardown"

Change-Id: Ic8e913396144c1ee50e878d9b0f85dffceee5287
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoPatch: Set duration of performance long tests to 10s 97/1097/4
Peter Mikus [Fri, 13 May 2016 11:57:00 +0000 (13:57 +0200)]
Patch: Set duration of performance long tests to 10s

- JIRA: CSIT-77
Decrease duration time from 60 second to 10 second for all long
performance tests. This patch is preparation for replacement of linear
search for binary search.

Change-Id: I61fbec1dcaca73ba383690e695c3030d182a90f9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReplace linear search with binary search 89/1189/5
Peter Mikus [Wed, 18 May 2016 16:45:30 +0000 (18:45 +0200)]
Replace linear search with binary search

- JIRA: CSIT-97
- Replace linear search with binary search for long performance testing

Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd test cases with "dpdk no-multi-seg" in vpp startup config 71/1071/19
Peter Mikus [Wed, 11 May 2016 13:07:06 +0000 (15:07 +0200)]
Add test cases with "dpdk no-multi-seg" in vpp startup config

- JIRA: CSIT-73
- Add ability to configure no-multi-seg parameter in VPP startup
  configuration
- Add keywords to selectively configure parameters in startup
  configuration
- Modify testcases

Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd temporary fix for CSIT-90 by flushing QGA's input buffer 30/1230/2
Carsten Koester [Mon, 23 May 2016 17:02:00 +0000 (13:02 -0400)]
Add temporary fix for CSIT-90 by flushing QGA's input buffer

This is not a final fix. The final fix SHOULD send a "guest-sync"
request as per"
http://wiki.qemu.org/Features/QAPI/GuestAgent#QEMU_Guest_Agent_Protocol

However, this temporary fix will eliminate the nested VM startup
failures triggered by the nested VM's guest-agent receiving a partial
guest-ping request.

Change-Id: Ice409b7c966a527b03cb71c042b476e1771676d0
Signed-off-by: Carsten Koester <ckoester@cisco.com>
4 years agoCapture VPP stats for Long and Short tests 95/1195/6
Miroslav Miklus [Thu, 19 May 2016 11:59:30 +0000 (13:59 +0200)]
Capture VPP stats for Long and Short tests

JIRA: CSIT-71
- remove warmup for short runs
- clear and collect stats for short run
- run short test with no failure for long test with NDR/PDR rate

Change-Id: I1b8879c3b891165072822207d0781687d8159336
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoPatch: Start binary search from max range rate 83/1183/5
Peter Mikus [Wed, 18 May 2016 12:53:41 +0000 (14:53 +0200)]
Patch: Start binary search from max range rate

- JIRA: CSIT-96
- Add option to start binary search with max range rate value first and
  then continue the binary search of half interval.

Change-Id: Ia6d2f4aa6fc20ca2ee4d43d0ddb3966422b28144
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoPerformance l2-vlan-dot1q library and short/long test cases 73/973/17
pmikus [Tue, 3 May 2016 13:45:09 +0000 (15:45 +0200)]
Performance l2-vlan-dot1q library and short/long test cases

- JIRA: CSIT-59
- create topology with VLAN dot1q sub-interfaces inter-connected using
  L2 cross connect in 3-node topology
- create keywords to be used in test cases
- create l2-vlan-dot1q test cases (64B, 1518B, 9000B)

Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoTB3 topology file with X520-DA2 NICs 02/1202/3
Miroslav Miklus [Thu, 19 May 2016 15:43:24 +0000 (17:43 +0200)]
TB3 topology file with X520-DA2 NICs

JIRA: CSIT-8

Change-Id: I95baf116cfcde85fdbaaaac079f27c898a959f58
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoVPP in host user-mode, part II 87/987/24
Zdeno Olsovsky [Wed, 4 May 2016 11:48:36 +0000 (13:48 +0200)]
VPP in host user-mode, part II

- JIRA: CSIT-61

Change-Id: I688b1013a78a1fa3ecdb44c2072f8bd1b46364fb
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
4 years agoAdd Honeycomb TAP interface test 37/1137/7
selias [Fri, 13 May 2016 11:33:45 +0000 (13:33 +0200)]
Add Honeycomb TAP interface test

JIRA: CSIT-75

 - add test suite for TAP interface management through Honeycomb
 - add keywords required for TAP interface tests
 - move Honeycomb suite setup and teardown to new __init__ file
 - cleanup unused imports in Honeycomb test case files
 - modify "...should be empty" keywords to allow more reuse

Change-Id: Ie3dc9069678b60c359f69c5a216e452e856a0107
Signed-off-by: selias <samelias@cisco.com>
4 years agoTests for vhost-user interface configuration 51/1151/7
Tibor Frank [Mon, 16 May 2016 16:20:30 +0000 (18:20 +0200)]
Tests for vhost-user interface configuration

JIRA: CSIT-76

- add tests for vhost-user interface manipulation:
  - create, modify, delete
- add negative tests:
  - wrong interface type
  - wrong configuration

Change-Id: I09239ef099a6f9672895f9540762e5044123f7ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTB1 topology file with X520-DA2 NICs only 42/1042/7
Miroslav Miklus [Mon, 9 May 2016 16:23:43 +0000 (18:23 +0200)]
TB1 topology file with X520-DA2 NICs only

JIRA: CSIT-8

Change-Id: I9c4d5d5502ed6e387a93e545c30278618a14a7fc
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoParse robot output.xml for performance reporting 68/968/9
pmikus [Tue, 3 May 2016 05:21:15 +0000 (07:21 +0200)]
Parse robot output.xml for performance reporting

- JIRA: CSIT-58
- parse robot framework output.xml file
- find performance related data
- write formatted json to specified file
- copy archive artifact to directory

Change-Id: I47e45bcb68c06044a23192cb1fca46f43782941e
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoT-REX stl traffic send improvement for async calls 90/1090/10
Miroslav Miklus [Thu, 12 May 2016 22:35:53 +0000 (00:35 +0200)]
T-REX stl traffic send improvement for async calls

JIRA: CSIT-68
- show runtime statistics with running traffic
- T-REX driver async. driver

Change-Id: Ie5eb7021f610fb58383b033dda5b1b867f7d3d2c
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoPERF bootstrap, apply global PYBOT args to all test types 98/998/5
Miroslav Miklus [Thu, 5 May 2016 12:06:11 +0000 (14:06 +0200)]
PERF bootstrap, apply global PYBOT args to all test types

Change-Id: Ia51a437d03e33df8e27da0afc099f808e255937c
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoExplicitly list the NIC type for perf tests 99/999/9
Miroslav Miklus [Thu, 5 May 2016 12:34:17 +0000 (14:34 +0200)]
Explicitly list the NIC type for perf tests

JIRA: CSIT-74
- FIX test names
- list NICs

Change-Id: Ic5dba9381b7bf7129cb0944deb33a86ccdbf2c7b
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoPatch: Detection of running t-rex instance before initializing 32/1132/4
Peter Mikus [Mon, 16 May 2016 07:55:39 +0000 (09:55 +0200)]
Patch: Detection of running t-rex instance before initializing

- JIRA: CSIT-89
- Add detection of running t-rex traffic generator before new instance
  is initialized.

Change-Id: I77009b0c5e83bb6e162b9800d02b4e5a2abd541f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoUpdate vpp stable build used in csit-vpp-verify-weekly jenkins job 44/1144/1
Jan Gelety [Mon, 16 May 2016 13:35:29 +0000 (15:35 +0200)]
Update vpp stable build used in csit-vpp-verify-weekly jenkins job

- vpp build version updated to release 1.0.0-451~g686a5a5_amd64

Change-Id: Ic7d177d72a6d50c083d5b9733c8f63298eebd7c6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAdd IPsec traffic script 98/1098/3
Matus Fabian [Fri, 13 May 2016 12:42:44 +0000 (05:42 -0700)]
Add IPsec traffic script

JIRA: CSIT-28

Change-Id: Iaebea917ade85965b0dbaf35d58ea1ee14d76e3f
Signed-off-by: Matus Fabian <matfabia@cisco.com>
4 years agoCIMANAGE-5: update bootstrap for csit-vpp-verify-weekly job 58/1058/2
Jan Gelety [Tue, 10 May 2016 21:34:15 +0000 (23:34 +0200)]
CIMANAGE-5: update bootstrap for csit-vpp-verify-weekly job

- file rename
- usage of vpp-verified build

Change-Id: I61b7ef4121d02149cf5b24514176b375e660b2ae
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAdd VIRL host selection mechanism to bootstrap 29/1029/3
Carsten Koester [Sun, 8 May 2016 05:46:13 +0000 (01:46 -0400)]
Add VIRL host selection mechanism to bootstrap

Add a mechanism to the bootstrap script that allows it to select
one out of multiple candidate VIRL hosts. In addition, fix a few
cosmetic issues wrt. connecting to the VIRL host:
* Use consistent set of SSH options
* Consistently use constant instead of hardcoded key filename
* Use relative path names for start-/stop-testcase scripts

Change-Id: I0d2972f170de82dd5d98da88656f5f962fca2415
Signed-off-by: Carsten Koester <ckoester@cisco.com>
4 years agoAdd Honeycomb VxLAN test suite 96/1096/5
selias [Fri, 13 May 2016 09:51:32 +0000 (11:51 +0200)]
Add Honeycomb VxLAN test suite

JIRA: CSIT-47

 - add test suite for VxLAN management through Honeycomb
 - add keywords required for VxLAN management tests
 - add resource file with additional variables for testing
 - increment bridge domain test suite index

Change-Id: Ica0d7ae15f5b7058832a944d5ca0c72026ba299c
Signed-off-by: selias <samelias@cisco.com>
4 years agoCSIT-18: Add GRE tunnel libraries and tests. 17/917/17
Matej Klotton [Thu, 28 Apr 2016 16:15:49 +0000 (18:15 +0200)]
CSIT-18: Add GRE tunnel libraries and tests.

Change-Id: I91ccd65a26ea1782611bccc3badd91e64366a162
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoUpdate Honeycomb bridge domain tests 72/1072/2
selias [Wed, 11 May 2016 13:44:13 +0000 (15:44 +0200)]
Update Honeycomb bridge domain tests

 - fix interface assignment verification through VAT
 - add verification of split horizon group setting through VAT
 - clean up documentation of high level bridge domain keywords

Change-Id: I7552494d68c6bbc86d3e5ddea4e29c6a7444d50c
Signed-off-by: selias <samelias@cisco.com>
4 years agoAdd keyword to manipulate vhost-user parameters 86/1086/5
Tibor Frank [Thu, 12 May 2016 12:30:39 +0000 (14:30 +0200)]
Add keyword to manipulate vhost-user parameters

JIRA: CSIT-70

- add a keyword to be able to:
  - configure all vhost-user parameters at once
  - configure vhost-user parameters one by one
  - remove a vhost-user parameter
  - remove all vhost-user parameters at once
- add a keyword which adds a new vhost-user interface

Change-Id: I144bc035b959a1e4eb37c6a3d554e6843ddab4a7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-65: Add new test for LISP API 00/800/22
Andrej Kozemcak [Fri, 8 Apr 2016 08:26:53 +0000 (10:26 +0200)]
CSIT-65: Add new test for LISP API

Test set and unset this API:
lisp_add_del_locator_set
lisp_add_del_locator
lisp_add_del_local_eid
lisp_add_del_map_resolver
lisp_gpe_add_del_iface

Change-Id: I9c701fc421d4106147891a7e75e5d68885b9ba59
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
4 years agoAdd keyword to manipulate interface TAP parameters 85/1085/4
Tibor Frank [Thu, 12 May 2016 12:23:29 +0000 (14:23 +0200)]
Add keyword to manipulate interface TAP parameters

JIRA: CSIT-69

- add a keyword to be able to:
  - configure all TAP parameters at once
  - configure TAP parameters one by one
  - remove a TAP parameter
  - remove all TAP parameters at once
- add a keyword which adds a new TAP interface

Change-Id: I5620adc3f777f7a337bbd737e685891b425d4e09
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd possibility to create a VxLAN interface. 94/1094/3
Tibor Frank [Fri, 13 May 2016 08:25:16 +0000 (10:25 +0200)]
Add possibility to create a VxLAN interface.

JIRA: CSIT-51

- add a keyword which adds a new VxLAN interface
- change InterfaceUtil.vxlan_dump to be able to return info about all VxLAN
  interfaces.

Change-Id: I8ad3dc1d414924e74ea1ecea1f316ca5c648e2d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd possibility to change VxLAN parameters at once 83/1083/2
Tibor Frank [Thu, 12 May 2016 09:49:48 +0000 (11:49 +0200)]
Add possibility to change VxLAN parameters at once

JIRA: CSIT-51

- modify existing keyword "configure_interface_vxlan" to be able to:
  - configure all VxLAN parameters at once
  - configure VxLAN parameters one by one
  - remove a parameter
  - remove all parameters at once

Change-Id: I50551fbc3ae5c6aa147d531fc66b583af36bb541
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate of vpp build for perf tests 31/931/6
Miroslav Miklus [Fri, 29 Apr 2016 11:55:40 +0000 (13:55 +0200)]
Update of vpp build for perf tests

build: 1.0.0-437~g8f15e92_amd64

Change-Id: Ie0d0f693bcae0d0e56472c25b6353890d07e85d9
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoUpdate Honeycomb interface IPv4 test 63/1063/7
selias [Wed, 11 May 2016 09:42:54 +0000 (11:42 +0200)]
Update Honeycomb interface IPv4 test

 - add verification of ipv4 subnet prefix support
 - modify keywords to allow setting ipv4 address with network prefix
 - fix variable definitions to evaluate numbers as ints, not strings
 - add exception to ipv4 netmask/prefix conversion method

Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc
Signed-off-by: selias <samelias@cisco.com>
4 years agoAdd functions to get interface name or index from JSON interface dump. 16/916/10
Matej Klotton [Thu, 28 Apr 2016 16:10:05 +0000 (18:10 +0200)]
Add functions to get interface name or index from JSON interface dump.

Change-Id: I4778c9fa72e418f6fea427f88fd9aa1ea579ac99
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoAdd library for set path variables for testing. 15/915/22
Matej Klotton [Thu, 28 Apr 2016 14:39:18 +0000 (16:39 +0200)]
Add library for set path variables for testing.

Change-Id: Icb243bacc9329c4bf3bc28098fced473b4e3c991
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoPerformance IPv6 library and short/long test cases 24/824/17
pmikus [Wed, 20 Apr 2016 11:24:11 +0000 (13:24 +0200)]
Performance IPv6 library and short/long test cases

- JIRA: CSIT-2
- Create IPv6 test cases for long/short/singlethread/multithread performance testing
- Create robot KWs for IPv6 performance testing
- Add T-Rex IPv6 profile

Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoExtend ranges of binary search in ipv4 perf testing 18/1018/5
Peter Mikus [Fri, 6 May 2016 13:18:28 +0000 (15:18 +0200)]
Extend ranges of binary search in ipv4 perf testing

- Extend ranges of binary search in Long IPv4 testing to reflect the
  performance variability

Change-Id: I7632bbda361cb278be0776ec31461554297fe852
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoMove Honeycomb libraries to honeycomb subdirectory. 50/1050/2
Tibor Frank [Tue, 10 May 2016 12:50:41 +0000 (14:50 +0200)]
Move Honeycomb libraries to honeycomb subdirectory.

- move all Honeycomb related libraries written in python to new
  directory resources/libraries/python/honeycomb
- update all related includes in all source files

Change-Id: Ifa96b8f670b456b14421929d6020ddf8e02d9cbc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd iACL IPv4/IPv6 tests. 72/972/14
Patrik Hrnciar [Tue, 3 May 2016 12:40:52 +0000 (14:40 +0200)]
Add iACL IPv4/IPv6 tests.

 - IPv4: CSIT-15
 - IPv6: CSIT-16

Change-Id: I6e66aa853dfaebf1388f1191dbb63f5216820325
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
4 years agoAdd Max TX Queues configuration to VppConfigGenerator 84/984/3
pmikus [Wed, 4 May 2016 05:40:18 +0000 (07:40 +0200)]
Add Max TX Queues configuration to VppConfigGenerator

- Add ability to configure max-tx-queus parameter in VPP startup
  configuration

Change-Id: Iaf857ed037c934fbda46eda6bfe1be4ef7faba15
Signed-off-by: pmikus <pmikus@cisco.com>
4 years agoCSIT-9: COP Whitelist/blacklist 04/804/15
Zdeno [Mon, 18 Apr 2016 14:17:26 +0000 (16:17 +0200)]
CSIT-9: COP Whitelist/blacklist

- Included are also IPv6 tests
- JIRA: CSIT-17

Change-Id: I89ae6c38cdc6742a597c0dc24ed1c033c1b5d155
Signed-off-by: Zdeno <zolsovsk@cisco.com>
4 years agoCSIT-19: MAC split-horizon group 19/919/6
Jan Gelety [Thu, 28 Apr 2016 20:54:59 +0000 (22:54 +0200)]
CSIT-19: MAC split-horizon group

- test case to test MAC split-horizon group functionality

Change-Id: Iadee707f3670e5fc9c209bd8b072a65ea1af27cd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAdd Honeycomb bridge domain management tests 69/969/7
selias [Fri, 29 Apr 2016 11:35:25 +0000 (13:35 +0200)]
Add Honeycomb bridge domain management tests

JIRA: CSIT-41, CSIT-42, CSIT-43

 - add test cases for Honecomb bridge domain management
 - add keywords used by these tests
 - prefix the names of Honeycomb test suites with numbers, so that they
   execute in a specific order
 - moved suite teardown with "Stop Honeycomb service" to bridge domain
   suite

Note: Due to time constraints, the Honeycomb service cannot be restarted
between executions of individual Honeycomb test suites. Therefore
Honeycomb will be setup in the first test suite and shut down after the
last one.

Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b
Signed-off-by: selias <samelias@cisco.com>
4 years agoQEMU VM guest-ping fix 34/1034/2
Matus Fabian [Mon, 9 May 2016 07:17:44 +0000 (00:17 -0700)]
QEMU VM guest-ping fix

JIRA: CSIT-62

Change-Id: I0affda16af8f983895c50fbc306f45f30fbb69cd
Signed-off-by: Matus Fabian <matfabia@cisco.com>
4 years agoInterface VxLAN test 57/957/8
Tibor Frank [Mon, 2 May 2016 16:19:04 +0000 (18:19 +0200)]
Interface VxLAN test

JIRA: CSIT-45

- add test: Honeycomb modifies interface configuration - VxLAN
- add keywords used in these tests to set and verify configuration
- add method and vat template for dumping an interface's configured VxLAN
- fixed requirements.txt

Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
4 years agoLF2 testbed topology file 54/954/5
Miroslav Miklus [Mon, 2 May 2016 15:25:46 +0000 (17:25 +0200)]
LF2 testbed topology file

Change-Id: I7c465a057640782219a8eb3b4c131d2d8edfcadc
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
4 years agoAdd Honeycomb interface management tests (ipv4, ipv6, ethernet, routing) 30/930/13
selias [Fri, 29 Apr 2016 10:50:33 +0000 (12:50 +0200)]
Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)

 - add test cases for managing ipv4, ipv6, ethernet and routing
 configuration on VPP interface
 - add keywords used in these tests to set and verify configuration
 - add method and vat template for dumping an interface's
configured IP addresses
 - add method for converting between ipv4 netmasks and
   network prefixes
 - clean up documentation of older Honeycomb keywords

Note: Test cases are tagged with a placeholder tag to allow manual
test runs locally. It should be replaced with the appropriate
environment tags once Honeycomb service is deployed on virl.

Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78
Signed-off-by: selias <samelias@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>
4 years agoHoneycomb API keywords - interface, bridge domain 13/913/6
Tibor Frank [Thu, 28 Apr 2016 13:44:25 +0000 (15:44 +0200)]
Honeycomb API keywords - interface, bridge domain

- add keywords to manipulate data  using Honeycomb REST API to configure
  interfaces and bridge domains
- remove "add_vpp_to_honeycomb_network_topology" method from
  HoneycombSetup.py
- remove "parse_json_response" from HoneycombUtil.py
- add methods to manipulate data from Honeycomb REST API

Change-Id: I5e6f87097fe9bfccffa3d4aae21f63281353cf29
Signed-off-by: Tibor Frank <tifrank@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.