csit.git
7 years agoVatExecutor update 42/842/2
Matus Fabian [Fri, 22 Apr 2016 11:58:22 +0000 (13:58 +0200)]
VatExecutor update

Strip non-JSON data from VAT terminal output
Add method for VAT command retval verification

Change-Id: Ibe68020393cb1a700ad048dc78078f71064707b4
Signed-off-by: Matus Fabian <matfabia@cisco.com>
7 years agoPerformance test cases 26/826/5
pmikus [Wed, 20 Apr 2016 13:49:44 +0000 (15:49 +0200)]
Performance test cases

- JIRA: CSIT-10
- Add 1518B and 9000B test for multicore tests
- Fine tune threshold for short tests based on previous benchmarks
- Fix SI units

Change-Id: I5c4657dfd881a24b2e40c91ea80a979003754258
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoTopology schema 93/793/5
Tibor Frank [Fri, 15 Apr 2016 12:46:21 +0000 (14:46 +0200)]
Topology schema

- fix Honeycomb part of the topology schema
- add topology file checking using pykwalify before tests are started

Change-Id: I907d41b66f5660a2ab4de8857312e9277052bae6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoRemove horizontal whitespace (a line) before [Command_start_exec] tag. 16/816/2
mkonstan [Tue, 19 Apr 2016 16:17:42 +0000 (17:17 +0100)]
Remove horizontal whitespace (a line) before [Command_start_exec] tag.

Change-Id: I51e5616cb45b3c67e82153cc4c0f42ec9c5d75d7
Signed-off-by: mackonstan <mkonstan@cisco.com>
7 years agoInclude tags to CSIT performance boostrap script 91/791/2
pmikus [Fri, 15 Apr 2016 10:08:51 +0000 (12:08 +0200)]
Include tags to CSIT performance boostrap script

- include tags to CSIT performance boostrap script
- allows future expansion of selective test execution

Change-Id: I3870f52d86ff39234eb724500d3871fed0cbdb30
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoMake VXLAN test dot1Q as noncritical for now. 19/819/1
Stefan Kobza [Tue, 19 Apr 2016 20:53:23 +0000 (22:53 +0200)]
Make VXLAN test dot1Q as noncritical for now.

Change-Id: I0d41aad3fc1f96b58b83c6f0aa5a0e7606868ee4
Signed-off-by: Stefan Kobza <skobza@cisco.com>
7 years agoMake dut_setup.sh verbose; add sleep after vpp restart. 14/814/5
Stefan Kobza [Tue, 19 Apr 2016 12:37:20 +0000 (14:37 +0200)]
Make dut_setup.sh verbose; add sleep after vpp restart.

 - there's a race condition between VPP service restart and vpp_api_test
 execution; this patch addresses it with (for now) sleep after service
 vpp restart
 - above is just a workaround until VPP provides us with a notification
 of readiness..

Change-Id: I1f92c1d86e4f90c9432ea57c1747629f619f003e
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoMulticore VPP setup for performance testing 10/710/12
pmikus [Thu, 7 Apr 2016 14:36:31 +0000 (16:36 +0200)]
Multicore VPP setup for performance testing

- add multithread TAGS documentation
- add methods to VppConfigGenerator for RSS configuration
- create KW for multithread setup
- create sample test case using multithread vpp setup
- add Documentation into TCs

Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoUpdate Qemu library 77/677/9
Matus Fabian [Mon, 4 Apr 2016 14:11:46 +0000 (16:11 +0200)]
Update Qemu library

Incorporated changes from nested VM on VIRL.

Change-Id: I76ceeb2dde635c2cf0d3a53d29bf24fed72a5437
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoChange the performance result message 84/784/3
pmikus [Thu, 14 Apr 2016 11:30:12 +0000 (13:30 +0200)]
Change the performance result message

- change the result message of performance search to more verbose level
  (rate per stream, rate total, throughput in Gbps)

Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoUpdate of bootstrap.sh file. 37/737/4
Jan Gelety [Mon, 11 Apr 2016 16:08:13 +0000 (18:08 +0200)]
Update of bootstrap.sh file.

- updated vpp build version
- VIRL image switched to double-ring-nested topology
- removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases
- included test cases with tags:
  - VM_ENV and 3_NODE_SINGLE_LINK_TOPO
  - VM_ENV and 3_NODE_DOUBLE_LINK_TOPO
- added missing tags to TC VPP reports interfaces in Bridge
  Domain test suite

Change-Id: Ia6a7a54ef9ad6245835b2762c303935fe39f4079
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoVXLAN test with dot1q tagging. 21/521/35
Matej Klotton [Fri, 11 Mar 2016 12:56:39 +0000 (13:56 +0100)]
VXLAN test with dot1q tagging.

Change-Id: I3dbd12983736e338d757c580570d91680aedd83f
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoMove methods from topology.py to more appropriate place. 99/599/18
Matej Klotton [Wed, 23 Mar 2016 14:01:30 +0000 (15:01 +0100)]
Move methods from topology.py to more appropriate place.

Change-Id: I2612a9466095b3d79a4a9d938fcdbf9f93133f69
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoHoneycomb setup and utils 89/689/9
Tibor [Wed, 6 Apr 2016 11:33:42 +0000 (13:33 +0200)]
Honeycomb setup and utils

- re-implement HTTPCodes as IntEnum rather then dictionary
- add methods to manipulate data using honeycomb - get, set, delete
- change the name of url file from vpp_version.url to oper_vpp_version.url
- improve checking of startup and shutdown state of honeycomb
- PEP8 fixes
- add docstrings in all modules and classes
- move logging to the lowest possible level
- improve logging in exceptions
- add method exec_command_sudo_log to resources.libraries.python.ssh module

Change-Id: I54e0c6b45313e3a3c11bafa475488ae2b1e605c2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 years agodocumentation: long_xconnect test suite documentation 51/751/2
Miroslav Miklus [Tue, 12 Apr 2016 12:54:12 +0000 (14:54 +0200)]
documentation: long_xconnect test suite documentation

Generate testdoc by using:
 python -m robot.testdoc long_xconnect.robot perf_long_xconnect.html

Change-Id: I12d83de4abb1af4d94e6fd78d05c46018ee5d7d7
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd keywords for Honeycomb tests 94/694/12
selias [Wed, 6 Apr 2016 14:49:15 +0000 (16:49 +0200)]
Add keywords for Honeycomb tests

 -add interface dump and bridge-domain dump to Vat command templates
 -add low level keywords to implement vat dump commands

The resulting data dumps will be used in Honeycomb testing,
to verify data retrieved through Honeycomb API.

Change-Id: I2a913eaf23aa13d7223576220681821007672812
Signed-off-by: selias <samuel.elias@pantheon.tech>
8 years agoBoostrap verify installation directory removal 50/750/1
pmikus [Tue, 12 Apr 2016 11:38:20 +0000 (13:38 +0200)]
Boostrap verify installation directory removal

- Boostrap verify installation directory removal

Change-Id: I091240f8a3f7e5074cdc2f069837963e4c8bd192
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap verify performance fix 49/749/1
pmikus [Tue, 12 Apr 2016 10:34:02 +0000 (12:34 +0200)]
Bootstrap verify performance fix

- Bootstrap verify performance fix

Change-Id: I8f77c26aef805f5223d03e2a0bc4a97f88195ed8
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap verify performance fix 48/748/1
pmikus [Tue, 12 Apr 2016 10:21:53 +0000 (12:21 +0200)]
Bootstrap verify performance fix

- fix installation directory create and remove

Change-Id: I0acd47b886e869958a2075889af3bbe166d7808e
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap verify perfomance fix 45/745/2
pmikus [Tue, 12 Apr 2016 07:58:59 +0000 (09:58 +0200)]
Bootstrap verify perfomance fix

- fix test tags to lowercase

Change-Id: I6e01a677f15843105106300097b4d0b23e2cba5d
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoUpdate of topo_installation file 42/742/2
pmikus [Tue, 12 Apr 2016 05:27:27 +0000 (07:27 +0200)]
Update of topo_installation file

- deb package path fix

Change-Id: I94065581886c4d5b9f15ced18857ddfcde442153
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoFix cosmetic issues in VIRL topologies 23/723/3
Carsten Koester [Sun, 10 Apr 2016 15:51:18 +0000 (11:51 -0400)]
Fix cosmetic issues in VIRL topologies

Fix cosmetic issues in VIRL topologies:
- Replace double whitespace by single whitespace in XML
- Remove reserved but unused IP address allocations from VIRL config
- Modify "start-testcase" script to handle links without IP address

Change-Id: Ie447bd91172df61b30ebb8650b56bdfca0f25fd4
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoAdd VIRL double-ring (load-balancing) topology with nested VM support 24/724/2
Carsten Koester [Sun, 10 Apr 2016 15:54:47 +0000 (11:54 -0400)]
Add VIRL double-ring (load-balancing) topology with nested VM support

Change-Id: Idcf173b1711076a5d7e4af8fe46e302b9eae4ff6
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoCombined DropRateSearch 71/671/7
pmikus [Mon, 4 Apr 2016 09:10:12 +0000 (11:10 +0200)]
Combined DropRateSearch

- combined search algorithm using linear and binary search
- add KWs into performance library for binary and combined search
- remove short_bridge_domain_binary.robot as binary and combined search
  KWs are in library for optional use
- PEP8 fixes

Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoAdd Vagrantfile for local testing. 23/523/11
Stefan Kobza [Sat, 5 Mar 2016 09:19:16 +0000 (10:19 +0100)]
Add Vagrantfile for local testing.

Vagrantfile contains 3 VMs as of now, 2 DUTs 1 TG, with these notes:
 - login is csit/csit
 - by default provision script installs all deb packages from the dir
    where Vagrantfile is
 - developed for, and only tested on vbox (someone can pick up vmware)
 - All nodes have 1 shared mgmt network: 192.168.255.0/24
 - hosts have these IP addresses in host-only network
    TG : 192.168.255.100
    DUT1 : 192.168.255.101
    DUT2 : 192.168.255.102
 - script created to download MAC address information
 - PCI addresses are always the same for vbox (not sure about vmware)

HOWTO (will create a wiki page once one is created for CSIT project):
 - copy Vagrantfile to separate dir on host
 - vagrant up --parallel
    sit-back-and-relax
 - from VM that has access to the same host-only network (192.168.255.0 above)
    - copy your ssh-key to csit@192.168.255.{101,102,250} using
        ssh-copy-id
    - cd ${csit_dir}
    - virtualenv & pip as in README
    - export PYTHONPATH=${csit_dir}
    - resources/tools/topology/update_topology.py -v -f
        -o topologies/available/vagrant_pci.yaml \
        topologies/available/vagrant.yaml
    - pybot -L TRACE \
        -v TOPOLOGY_PATH:topologies/available/vagrant_pci.yaml -s \
        "ipv4" tests
    - see tests results

Change-Id: Ic27626605a9c820bca977b38f4e8ca37d1504ff5
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoAdd tag support to boostrap-verify-perf 76/676/5
pmikus [Mon, 4 Apr 2016 13:26:41 +0000 (15:26 +0200)]
Add tag support to boostrap-verify-perf

- support tags in vpp-verify-perfomance-* jenkins jobs

Change-Id: I7e3abfe9e552a3f2fa9ebf95df9b48bcbae3561a
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoAdd "Stop and Clear QEMU" KW 73/673/3
Matus Fabian [Mon, 4 Apr 2016 10:07:51 +0000 (12:07 +0200)]
Add "Stop and Clear QEMU" KW

Change-Id: Ib1b3907cd30c20c89283bd20e84ed8b829540ca4
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoSetup and check honeycomb on all DUTs 75/575/11
selias [Mon, 21 Mar 2016 12:06:49 +0000 (13:06 +0100)]
Setup and check honeycomb on all DUTs

- methods implementing HTTP requests (PUT,GET,POST,DELETE)
- methods for parsing HTTP responses
- methods for honeycomb setup on DUT
- updated constants.py
- keywords for honeycomb setup and communication
- simple honeycomb sanity test (not enabled for jenkins job runs)

Change-Id: I589f0ca56cc01072b92fe9363aed16a4098aee40
Signed-off-by: selias <samuel.elias@pantheon.tech>
8 years agoAdd new tag for VPP-VM testing enviroment 69/669/3
Matus Fabian [Mon, 4 Apr 2016 07:40:52 +0000 (09:40 +0200)]
Add new tag for VPP-VM testing enviroment

Change-Id: I2bdca4d8451bec8215b2d8f637809f8781e2e9d2
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd VIRL topology files and template for nested virtualisation 65/665/2
Carsten Koester [Fri, 1 Apr 2016 23:14:37 +0000 (19:14 -0400)]
Add VIRL topology files and template for nested virtualisation

Change-Id: I57dbe4f179b3cfd3f51c9dec503ca45a5c0521fd
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoChange send_ip_icmp recv timeout to 2sec 47/647/2
Matus Fabian [Wed, 30 Mar 2016 11:39:36 +0000 (13:39 +0200)]
Change send_ip_icmp recv timeout to 2sec

Traffic script send_ip_icmp recv timeout 10 sec is too long and execution
rather end with ssh timeout.

Change-Id: Id4df679799191fd03e2987f068f3ea9e7bf12fdf
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd get_vhost_user_if_name_by_sock 52/652/2
Matus Fabian [Thu, 31 Mar 2016 07:46:39 +0000 (09:46 +0200)]
Add get_vhost_user_if_name_by_sock

Change-Id: I1d7f2cdfcf29763ce94417c98d363021f1fb27a1
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoLong perf tests 74/574/7
pmikus [Mon, 21 Mar 2016 09:29:17 +0000 (10:29 +0100)]
Long perf tests

- added new long tests for ipv4 and xconnect
- modified long bridge domain test
- added 64B, 1518B and 9000B frame sizes

Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap to test perf of proposed patch vpp-csit-hw-perf 31/631/4
pmikus [Tue, 29 Mar 2016 10:56:12 +0000 (12:56 +0200)]
Bootstrap to test perf of proposed patch vpp-csit-hw-perf

- Based on #570 Lab reservation tool
- Get the latest build of VPP
- Make reservation on testbed by using existing topology files
- Copy and install VPP image on all DUTs
- Run performance tests

Change-Id: I8034fd9c284cbe9a68e0c9116d0826965464b5f9
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoAdd linux_add/del_bridge and modify vpp_add_l2fib_entry 84/584/3
Matus Fabian [Tue, 22 Mar 2016 08:04:07 +0000 (09:04 +0100)]
Add linux_add/del_bridge and modify vpp_add_l2fib_entry

linux_add_bridge - bridge two interfaces on linux node
linux_del_bridge - delete bridge from linux node
vpp_add_l2fib_entry - param interface should be interface name or sw_if_index

Change-Id: Ia8030e24a0afe088df0dcb6c65a85ed341224206
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoBestN/WorstN DropRateSearch 03/603/3
pmikus [Thu, 24 Mar 2016 12:50:19 +0000 (13:50 +0100)]
BestN/WorstN DropRateSearch

- implementation of Best-of-N/Worst-of-N result evaluation with max
  attempts per one rate step

Change-Id: Ice1d6e93807d90761462c4df601cbe068011159a
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap to test csit-master against VPP release. 38/538/9
Jan Gelety [Tue, 15 Mar 2016 12:45:55 +0000 (13:45 +0100)]
Bootstrap to test csit-master against VPP release.

- get the version of the latest VPP build
- download and install the latest VPP build on nodes
- run three times all test suites to check if the VPP build
  can be used for csit development and current csit master
  can be pushed to master-verified branch
  (see patch https://gerrit.fd.io/r/590)

Change-Id: I0ad2e9fe1620cc18ccc11dce2d107177cf97ff27
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoFix of bootstrap.sh for vpp-csit-verify-virl job 29/629/1
Jan Gelety [Tue, 29 Mar 2016 10:25:16 +0000 (12:25 +0200)]
Fix of bootstrap.sh for vpp-csit-verify-virl job

- moved rm -f *.deb to else statement to avoid
  deletion of deb packages when boostrap.sh is
  called from include-raw-vpp-csit-functional.sh

Change-Id: I4a224a1fc332d50a27347e77dbeacbfbc98677c9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoSetup and run QEMU VM 41/541/4
Matus Fabian [Wed, 16 Mar 2016 11:42:28 +0000 (12:42 +0100)]
Setup and run QEMU VM

Change-Id: I22640caa9f13be09d2a837c6332d7b86cef77efc
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd node type VM to set_interface_state 83/583/2
Matus Fabian [Tue, 22 Mar 2016 07:49:58 +0000 (08:49 +0100)]
Add node type VM to set_interface_state

Change-Id: Ib70de73eec7c015f328f877fa34ead15e27eb254
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoBinary DropRateSearch 64/564/6
pmikus [Fri, 18 Mar 2016 11:44:57 +0000 (12:44 +0100)]
Binary DropRateSearch

- binary search
- short perf bridge_domain with binary

Change-Id: I50538738b356cc8fef4cfcb4974c43c5123827d1
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoLab reservation tool 70/570/6
Miroslav Miklus [Fri, 18 Mar 2016 17:28:26 +0000 (18:28 +0100)]
Lab reservation tool

This tool provide client-based reservation system of tesbeds
by using existing topology files.

Change-Id: Ic0be944c77c9d6aa28e3fa7fa69e31d19861416f
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoRemove apt-get call to install dependencies. 39/539/2
Carsten Koester [Wed, 16 Mar 2016 08:47:47 +0000 (04:47 -0400)]
Remove apt-get call to install dependencies.

Change-Id: I309a13bc857b89f1f342d659ab80b70d7a5fc686
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoAdd SSH disconnect 52/552/2
Matus Fabian [Thu, 17 Mar 2016 13:14:22 +0000 (14:14 +0100)]
Add SSH disconnect

Change-Id: Ib0efec083aa9ee33b7d15680e5a15989827b8e57
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoFixed SSH exec_command timeout 37/537/2
Matus Fabian [Tue, 15 Mar 2016 11:28:09 +0000 (12:28 +0100)]
Fixed SSH exec_command timeout

Change-Id: I8cd2fcfbe774bd651ed57be0129c32d6ba68adcc
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoDropRateSearch library 15/515/9
Miroslav Miklus [Wed, 9 Mar 2016 14:48:59 +0000 (15:48 +0100)]
DropRateSearch library

- linear search
- t-rex DropRateSearch implementation
- long perf bridge_domain test
- introduced PERFORMANCE_SHORT, PERFORMANCE_LONG test tags

Change-Id: I497b72f3e6d58a67ca5a386403d1e84dcf433ec4
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agotools: vpp download and installation script 33/533/1
Miroslav Miklus [Mon, 14 Mar 2016 16:54:58 +0000 (17:54 +0100)]
tools: vpp download and installation script

Download and install 'RELEASE' version of vpp packages
Dependecies: curl, dpkg, md5sum

Change-Id: I894c8181125b84df3057afc092ed01c0a837321a
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd vxlan tests using xconnect 05/505/10
Patrik Hrnciar [Tue, 8 Mar 2016 16:34:18 +0000 (17:34 +0100)]
Add vxlan tests using xconnect

Change-Id: I190689d5a624f1c876df90ce29b05a2b0b8a2df4
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
8 years agoAdd VM to NodeType 28/528/2
Matus Fabian [Mon, 14 Mar 2016 10:45:44 +0000 (11:45 +0100)]
Add VM to NodeType

Change-Id: Ic3a313837f48a1c7bd1c70876c82799ac1994f2f
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoSSH connect use port specified in node dict 26/526/1
Matus Fabian [Mon, 14 Mar 2016 09:22:58 +0000 (10:22 +0100)]
SSH connect use port specified in node dict

Change-Id: I4ed7d58466724e68dc7ad22f85f6e7703a6c7a64
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd Vhost-user interfaces library 14/514/3
Matus Fabian [Wed, 9 Mar 2016 13:52:29 +0000 (14:52 +0100)]
Add Vhost-user interfaces library

Change-Id: I295e67b4a5622b1fff4fbe5d4a7e5753f3c4af57
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd KW to build QEMU 2.2.1 on node 02/502/6
Matus Fabian [Tue, 8 Mar 2016 13:01:32 +0000 (14:01 +0100)]
Add KW to build QEMU 2.2.1 on node

Change-Id: I58271aff1ef558752f00593bbad5c3317d08288d
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoUpdate VPP version downloaded from Nexus. 70/470/24
Matej Klotton [Thu, 3 Mar 2016 16:49:13 +0000 (17:49 +0100)]
Update VPP version downloaded from Nexus.

Change-Id: Iae2ee6d576347262d9f3f9a9e9b9cc65dbc5bf5e
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoAdd library to generate VPP configuration file 74/474/5
Carsten Koester [Thu, 3 Mar 2016 20:56:46 +0000 (15:56 -0500)]
Add library to generate VPP configuration file

Change-Id: Icc202c82b238a30735ffa3d0017c61e2dd8bd532
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoAdd VIRL server-side framework and topology templates. 01/401/3
Carsten Koester [Wed, 24 Feb 2016 00:27:01 +0000 (19:27 -0500)]
Add VIRL server-side framework and topology templates.

Change-Id: I02e7f85e3259dc0a5b2c7d0098747921a75fa5ea
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoModify sweep ping test cases 86/386/15
Juraj Sloboda [Tue, 23 Feb 2016 14:03:13 +0000 (15:03 +0100)]
Modify sweep ping test cases

- Write separate sweep ping test cases for jumbo frames
- Compute sweep ping end size from reported MTU on DUT interface
- Set MTU on TG according to MTU on DUT interface
- Log VPP packet traces on IPv4 and IPv6 tests failure
- Remove VM_ENV tag from sweep ping test cases for jumbo frames

Change-Id: I47aa7977bcff9c4366c67578aef542924a1d055b
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agochange interface up calls to explicit keywords 81/481/6
selias [Tue, 1 Mar 2016 09:56:40 +0000 (10:56 +0100)]
change interface up calls to explicit keywords

Remove implicit "set interface state" calls from ipv4 and ipv6 test keywords.
Use robot keyword instead.

Change-Id: I535a7a967910e77dded39eb167fb9c164187566e
Signed-off-by: selias <samuel.elias@pantheon.tech>
8 years agoMove Send and receive L2 traffic KWs to standalone file. 58/458/6
Matej Klotton [Wed, 2 Mar 2016 12:05:13 +0000 (13:05 +0100)]
Move Send and receive L2 traffic KWs to standalone file.

Change-Id: I3c919a15d5fdbf91ff493d64b768fb69b8c21b65
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoAdd with-statment support to VatTerminal. 61/461/11
Matej Klotton [Wed, 2 Mar 2016 15:51:30 +0000 (16:51 +0100)]
Add with-statment support to VatTerminal.

Change-Id: I7b4b32ce07b9247ccf80bf6b5d3339d00bc0999f
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoPerformance suite reorg, v4 tests 51/451/9
Miroslav Miklus [Tue, 1 Mar 2016 15:11:34 +0000 (16:11 +0100)]
Performance suite reorg, v4 tests

- perf suite splitted to
1.xconnect
2.bridge-domain
3.IPv4
- IPv4 perf tests implemented
- renamed perf tests prefix 2core -> 1core

Change-Id: I9ef2dbdfcfdcb36e8865989e6255d69ced33269c
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd more IP networks to IPV4_NETWORKS and IPV6_NETWORKS 54/454/4
Matej Klotton [Tue, 1 Mar 2016 15:34:52 +0000 (16:34 +0100)]
Add more IP networks to IPV4_NETWORKS and IPV6_NETWORKS

Change-Id: If340a21aac02f94aaf8a282f7b689c0f5d9aa438
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoTransfer l2_xconnect setup to L2Util 42/442/6
Patrik Hrnciar [Mon, 29 Feb 2016 13:28:41 +0000 (14:28 +0100)]
Transfer l2_xconnect setup to L2Util

Change-Id: I7a661c9ce8b5f9ca8fbd36858f7a9cd6f1da8ffd
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
8 years agoInstall dependencies prior test execution. 55/455/11
Stefan Kobza [Tue, 1 Mar 2016 19:47:28 +0000 (20:47 +0100)]
Install dependencies prior test execution.

Until verify_merge nodes have proper dependencies update, install the
dependencies manually prior to test execution.

Change-Id: I94b09b48b1b272f2bdedbb87ea35665707c581fd
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoAdd VXLAN test 75/375/11
Matej Klotton [Mon, 22 Feb 2016 17:12:15 +0000 (18:12 +0100)]
Add VXLAN test

Change-Id: Id1d37fda2697fbfb7aa7a79318f8316b80e96963
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoFix checksum comparison in latest code 41/441/1
Juraj Sloboda [Mon, 29 Feb 2016 08:40:27 +0000 (09:40 +0100)]
Fix checksum comparison in latest code

Change-Id: I8aa53ce64f8f9e0553702f8a586fac3824a876f4
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoFix checksum comparison in traffic scripts 33/433/3
Juraj Sloboda [Thu, 25 Feb 2016 15:03:51 +0000 (16:03 +0100)]
Fix checksum comparison in traffic scripts

Change-Id: Ibeff7c790ed4aba8b3a0534681912d0d5b826dbb
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoTest both traffic directions for bidirectional topology 17/417/2
Jan Gelety [Thu, 25 Feb 2016 16:54:12 +0000 (17:54 +0100)]
Test both traffic directions for bidirectional topology

- l2 bridge domain
- l2 cross connects

Change-Id: I45b4c1e5aa72e55ff05ed84f4748a0ea41c99a18
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoMinor change in virtual env creation 14/414/2
Jan Gelety [Thu, 25 Feb 2016 16:12:19 +0000 (17:12 +0100)]
Minor change in virtual env creation

- increase timeout for virtualenv creation
- confirm successful virtualenv creation

Change-Id: Ic973f97e23ccf35c677849f31251637bf8551fef
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoCheck ipv4 ping response 84/384/3
Juraj Sloboda [Mon, 22 Feb 2016 16:20:45 +0000 (17:20 +0100)]
Check ipv4 ping response

Change-Id: I47ef2d59bdcbbb470550a037906bf8ba2a1bc66c
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoT-REX: startup config generation 36/436/1
Miroslav Miklus [Fri, 26 Feb 2016 17:35:27 +0000 (18:35 +0100)]
T-REX: startup config generation

- T-rex startup config generated based on computed path
- move t-rex tooling to t-rex directory

Change-Id: I3ac698f41f98934bcce4af35dc3a755a8948e887
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoSome changes in pylint configuration 85/385/2
Matus Fabian [Tue, 23 Feb 2016 11:33:59 +0000 (12:33 +0100)]
Some changes in pylint configuration

method name length changed from 30 to 40
max-args changed from 5 to 7

Change-Id: Iea3efc7c545236f97d230e6f99fce814d3598925
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoPerformance suite: introduced suite variables 97/397/3
Miroslav Miklus [Tue, 23 Feb 2016 21:02:06 +0000 (22:02 +0100)]
Performance suite: introduced suite variables

- perf suite variables
- T-REX setup fix

Change-Id: I608581e45d0e5f80e8f75c2a07c994bf0e0d0df3
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agovpp_ra_supress_link_layer run VAT tempalte 04/404/1
Matus Fabian [Wed, 24 Feb 2016 14:49:15 +0000 (15:49 +0100)]
vpp_ra_supress_link_layer run VAT tempalte

Change-Id: I7385650a1c9502b430c9f8022f8c298be52deba8
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoMove script code to main function 83/383/3
Juraj Sloboda [Mon, 22 Feb 2016 12:40:21 +0000 (13:40 +0100)]
Move script code to main function

Change-Id: I84db0d569dad8b8b56a95a967ddd80ffc54d6aaf
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoAutomate VIRL simulation life cycle. 80/380/16
Stefan Kobza [Mon, 22 Feb 2016 20:49:27 +0000 (21:49 +0100)]
Automate VIRL simulation life cycle.

Change-Id: I126c42b994c1356acc202f4ec1b153c790c43d46
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoBootstrap for performance suite 55/355/7
Miroslav Miklus [Fri, 19 Feb 2016 08:36:58 +0000 (09:36 +0100)]
Bootstrap for performance suite

Change-Id: I9ac58cd12b439c95b2c6aeb0efdcbd6f97d4c1ab
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoRemove Interface.close, rename script argument 82/382/2
Juraj Sloboda [Mon, 22 Feb 2016 12:22:23 +0000 (13:22 +0100)]
Remove Interface.close, rename script argument

Change-Id: I5da20a12f801264821890e6516899344456576a8
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoFixed strings with format splitting 81/381/2
Matus Fabian [Tue, 23 Feb 2016 07:56:29 +0000 (08:56 +0100)]
Fixed strings with format splitting

Change-Id: Iaded6b2ba46df86dd89afb2e2dc411d9972fb7d7
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoInstead of Sleep loop verification of interfaces 72/372/4
Matus Fabian [Mon, 22 Feb 2016 14:21:57 +0000 (15:21 +0100)]
Instead of Sleep loop verification of interfaces

Change-Id: I29a974182082f0e5c84a9dd21a539d21ef75b41b
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoperformance tests: 2core, test teardown, remove UDP header 71/371/2
Miroslav Miklus [Mon, 22 Feb 2016 13:17:13 +0000 (14:17 +0100)]
performance tests: 2core, test teardown, remove UDP header

- testing on 2 core VPP
- show statistics only if test fails
- remove UDP header from packet

Change-Id: I5b47330a0bbc4602e8e8eb19fcc481a7635bd2a5
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd hw/vm tags, add single link tag. 49/349/5
Stefan Kobza [Thu, 18 Feb 2016 13:24:57 +0000 (14:24 +0100)]
Add hw/vm tags, add single link tag.

Add HW_EVN and VM_ENV tags to specify limitations on where the given
test could be run. For tests that should be run only on bare metal,
author of the test should add tag HW_ENV to it.

Add 3_NODE_SINGLE_LINK_TOPO tag, to specify requirement on topology,
where only one link is required in between any two nodes in the
topology.

Change-Id: I38c9a9732cad608bb6a9e4a2c5f1997236cd48b9
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoPerformance suite: xconnect fix, show commands 64/364/2
Miroslav Miklus [Fri, 19 Feb 2016 14:11:36 +0000 (15:11 +0100)]
Performance suite: xconnect fix, show commands

- adjust L2 xconnect to changed xconnect library
- show [interface stats, hardware, errors, runtime]

Change-Id: I9dffebdd0abbde5107c6dc926210ba725e1e039c
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoRemove duplicate code 42/342/3
Juraj Sloboda [Wed, 17 Feb 2016 17:23:32 +0000 (18:23 +0100)]
Remove duplicate code

Change-Id: I2382c3a418966f2f5c585e872889667945850fe0
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoRemoved unused BD vat templates 57/357/3
Matus Fabian [Fri, 19 Feb 2016 10:41:07 +0000 (11:41 +0100)]
Removed unused BD vat templates

Change-Id: Id9e219e508239eab9f2f1245b6ae8eef5d0a1ff3
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoRemoved link-up/link-down from if state setup 59/359/2
Matus Fabian [Fri, 19 Feb 2016 10:58:27 +0000 (11:58 +0100)]
Removed link-up/link-down from if state setup

Change-Id: Ic30102159dc53c2dfc8827bb3a78d040cc336166
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoConvert ipv4 to use node_path 41/341/6
Juraj Sloboda [Wed, 17 Feb 2016 15:59:09 +0000 (16:59 +0100)]
Convert ipv4 to use node_path

Change-Id: Ie5587d4de9accb852e8f7634c42b9ccd9292830b
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoT-REX: change relative rate values to absolute units 53/353/4
Miroslav Miklus [Thu, 18 Feb 2016 21:59:16 +0000 (22:59 +0100)]
T-REX: change relative rate values to absolute units

Instead of using realative values expressed in percentage
of linerate rather use absolute values to assure consistency
of results across NICs with various speeds (10G, 40G, 100G, ...)

Change-Id: Ifd455d823e80002c277deaf8cb8295c81b59bf4a
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoIPv6 VPP setup changed to VAT templates 47/347/7
Matus Fabian [Thu, 18 Feb 2016 12:54:18 +0000 (13:54 +0100)]
IPv6 VPP setup changed to VAT templates

Change-Id: I54c79ab1b76af93d46f6ee6f391ba2807a3be772
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoCleanup bootstrap.sh. 48/348/1
Stefan Kobza [Thu, 18 Feb 2016 12:58:15 +0000 (13:58 +0100)]
Cleanup bootstrap.sh.

Change-Id: I172e7062301067db00a321ad7be40c27f31d92c1
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoUpdate l2_xconnect test to use NodePath 46/346/3
Patrik Hrnciar [Thu, 18 Feb 2016 09:05:05 +0000 (10:05 +0100)]
Update l2_xconnect test to use NodePath

Change-Id: I9951a7e9a36dbc78c44f6bd868b4f6531ecb3349
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
8 years agoBridge Domain tests update 36/336/3
Matus Fabian [Wed, 17 Feb 2016 11:03:48 +0000 (12:03 +0100)]
Bridge Domain tests update

Change-Id: I4ad1566fd23746c0a85d7abce2bbffd085ee397c
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoT-REX fixes 43/343/2
Miroslav Miklus [Wed, 17 Feb 2016 22:46:01 +0000 (23:46 +0100)]
T-REX fixes

- ssh session hang with bash as /bin/sh
- trex-cfg to handle initial configuration

Change-Id: Ibcbde2d17f0e10ce126dc5db6bf9654185b0bb75
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoTest VIRL connection. 90/290/76
Stefan Kobza [Wed, 10 Feb 2016 18:41:09 +0000 (19:41 +0100)]
Test VIRL connection.

Change-Id: I812ff9c8c9669b63907469c643c839e8bd3b419a
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoRefactor IPv4 utils 40/340/1
Filip Tehlar [Wed, 17 Feb 2016 14:59:08 +0000 (06:59 -0800)]
Refactor IPv4 utils

Change-Id: Iae12444efba33e2d37b5d7beb1620e859abd84d7
Signed-off-by: Filip Tehlar <ftehlar@cisco.com>
8 years agoLF testbed2 topology, T-REX upgrade, vpe->vpp rename 96/296/21
Miroslav Miklus [Thu, 11 Feb 2016 14:18:12 +0000 (15:18 +0100)]
LF testbed2 topology, T-REX upgrade, vpe->vpp rename

Testing testbed2 infrastructure
T-REX upgrade 1.88 -> 1.91
Rename "vpe" to "vpp"

Change-Id: Ia03c363e2b3c77a4e469509460b25028e5e1814f
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoRemove padding from raw network layer 37/337/2
Juraj Sloboda [Wed, 17 Feb 2016 12:19:42 +0000 (13:19 +0100)]
Remove padding from raw network layer

Change-Id: Iee63baf142b7af586ecf8cd75c217bf624aa413d
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoVppCounters: DBG CLI: show commands 33/333/1
Miroslav Miklus [Tue, 16 Feb 2016 17:09:46 +0000 (18:09 +0100)]
VppCounters: DBG CLI: show commands

show commands usefull for further debugging of FAILED tests

Change-Id: I225a2e251e2ee7a1037255dd39a833d7ca1c94ed
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd ingress/egress packet tracing to all PacketVerifier packets.o 24/324/2
Stefan Kobza [Sat, 13 Feb 2016 23:04:20 +0000 (00:04 +0100)]
Add ingress/egress packet tracing to all PacketVerifier packets.o

Whenever user of PacketVerifier uses send or recv, the script will print
out the packet in it's entirety.

Change-Id: Ib1968df76c87b288ce04341bc110481621cbf79a
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoRemove multiprocessing from PacketVerifier, tune tests. 17/317/2
Stefan Kobza [Fri, 12 Feb 2016 23:25:23 +0000 (00:25 +0100)]
Remove multiprocessing from PacketVerifier, tune tests.

Change-Id: I37b171c50bad97255a42d6f9426f749055357380
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoFixed vat_terminal_exec_cmd_from_template 25/325/1
Matus Fabian [Mon, 15 Feb 2016 08:45:01 +0000 (09:45 +0100)]
Fixed vat_terminal_exec_cmd_from_template

Change-Id: I6ecabd5c66b30f74f9efea24f94139f089c579bf
Signed-off-by: Matus Fabian <matfabia@cisco.com>