csit.git
7 years agoAdd Honeycomb interface management tests (ipv4, ipv6, ethernet, routing) 30/930/13
selias [Fri, 29 Apr 2016 10:50:33 +0000 (12:50 +0200)]
Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)

 - add test cases for managing ipv4, ipv6, ethernet and routing
 configuration on VPP interface
 - add keywords used in these tests to set and verify configuration
 - add method and vat template for dumping an interface's
configured IP addresses
 - add method for converting between ipv4 netmasks and
   network prefixes
 - clean up documentation of older Honeycomb keywords

Note: Test cases are tagged with a placeholder tag to allow manual
test runs locally. It should be replaced with the appropriate
environment tags once Honeycomb service is deployed on virl.

Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78
Signed-off-by: selias <samelias@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoHoneycomb API keywords - interface, bridge domain 13/913/6
Tibor Frank [Thu, 28 Apr 2016 13:44:25 +0000 (15:44 +0200)]
Honeycomb API keywords - interface, bridge domain

- add keywords to manipulate data  using Honeycomb REST API to configure
  interfaces and bridge domains
- remove "add_vpp_to_honeycomb_network_topology" method from
  HoneycombSetup.py
- remove "parse_json_response" from HoneycombUtil.py
- add methods to manipulate data from Honeycomb REST API

Change-Id: I5e6f87097fe9bfccffa3d4aae21f63281353cf29
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoAdd "show error" output into vpp stats 02/1002/2
Peter Mikus [Thu, 5 May 2016 13:27:08 +0000 (15:27 +0200)]
Add "show error" output into vpp stats

- Add "show error" debug output into VPP show stats as verbose
  subcommand is not parsed correctly in output of vpp_api_test

Change-Id: I924c54bb86375e43770fd449b8d6aaa7a3413bcb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoExtend testbed reservation wait time 90/990/2
Miroslav Miklus [Wed, 4 May 2016 15:07:53 +0000 (17:07 +0200)]
Extend testbed reservation wait time

Change-Id: If35705c1934dfb10f117f03ebbba111854f34360
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoVPP build update for lisp tests 04/1004/2
Jan Gelety [Thu, 5 May 2016 16:41:35 +0000 (18:41 +0200)]
VPP build update for lisp tests

- vpp build 437

Change-Id: I75cd51aaa721ada40e7e206a3d4637d238849ae6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoUpdate T-rex version to v2.00 62/862/17
pmikus [Mon, 25 Apr 2016 13:58:04 +0000 (15:58 +0200)]
Update T-rex version to v2.00

- JIRA: CSIT-14
- Update T-rex version to v2.00 with latest API
- Compatibility fixes of affected libraries and robot files
- T-rex performance tuning

Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoPatch to reset default VPP configuration in perf. 45/945/5
pmikus [Sun, 1 May 2016 16:28:59 +0000 (18:28 +0200)]
Patch to reset default VPP configuration in perf.

- JIRA: CSIT-57
- fix situation when vpp startup configuration is replaced by default
  with no interface configuration

Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoTopo installation script fix 01/901/10
Miroslav Miklus [Wed, 27 Apr 2016 15:38:41 +0000 (17:38 +0200)]
Topo installation script fix

-more logging
-use single SSH instance
-dpkg --force-all
-update referece vpp version and reference short test threshold

Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoAdd vpp_create_loopback 10/910/3
Matus Fabian [Thu, 28 Apr 2016 12:41:32 +0000 (14:41 +0200)]
Add vpp_create_loopback

Change-Id: If934d7ec28f86b070a0cafa0ee56d0bcf4e2ac6d
Signed-off-by: Matus Fabian <matfabia@cisco.com>
7 years agoInstallation of stable vpp version for csit-vpp-perf-hw-all jenkins job 32/832/8
Miroslav Miklus [Thu, 21 Apr 2016 13:09:55 +0000 (15:09 +0200)]
Installation of stable vpp version for csit-vpp-perf-hw-all jenkins job

JIRA: CSIT-5
- vpp installation for csit-vpp-verify-* jobs
- use single bootstrap for all verify-perf jobs

Change-Id: Ifb30a360daecc90446f53d20440e2723b01c6050
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoUpdate vpp version in bootstrap.sh 98/898/1
Jan Gelety [Wed, 27 Apr 2016 11:17:02 +0000 (13:17 +0200)]
Update vpp version in bootstrap.sh

- vpp version changed to 1.0.0-377

Change-Id: I776fc49a1af15824a4c55071eecfc80fb4824295
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoAdd qinq through xconnect tests. 74/674/15
Patrik Hrnciar [Mon, 4 Apr 2016 11:09:09 +0000 (13:09 +0200)]
Add qinq through xconnect tests.

Change-Id: Ia20f5959dab41290bf60490ead830f0e37ecff0d
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
7 years agoAdd BD vpp-vm-vpp tests 23/823/7
Matus Fabian [Wed, 20 Apr 2016 09:49:36 +0000 (11:49 +0200)]
Add BD vpp-vm-vpp tests

JIRA: CSIT-20

Change-Id: Id22102519cdc8afef63c0e727fb47e2a2f1d769b
Signed-off-by: Matus Fabian <matfabia@cisco.com>
7 years agoExtend host topology with NIC type filtering 08/808/12
Miroslav Miklus [Mon, 18 Apr 2016 15:15:40 +0000 (17:15 +0200)]
Extend host topology with NIC type filtering

JIRA: CSIT-1
Changes to allow filtering based on NIC model.
Switched xconnect perf test to use filtered topology.

Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoHoneycomb interface state management test 09/809/11
selias [Mon, 18 Apr 2016 16:21:20 +0000 (18:21 +0200)]
Honeycomb interface state management test

 - add simple test for interface management through Honeycomb API
 - add status code 500 to honeycomb startup check whitelist,
   due to Honeycomb changes in https://gerrit.fd.io/r/772
 - increase timeout value for Honeycomb startup check
 - modify Honeycomb setup keywords to allow starting Honeycomb
   on individual nodes
 - remove sanity test suite, tests now sorted by functional areas
   such as interfaces, bridge domains, VXlan,...

Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6
Signed-off-by: selias <samuel.elias@pantheon.tech>
7 years agoAdd optional args to traffic script arg parser 80/880/2
Matus Fabian [Tue, 26 Apr 2016 08:58:52 +0000 (10:58 +0200)]
Add optional args to traffic script arg parser

Change-Id: I92e890e0c42da34e1e72a442f7a3bbe12fe9aef1
Signed-off-by: Matus Fabian <matfabia@cisco.com>
7 years agoAdd IPsec utilities python library 83/783/6
Matus Fabian [Thu, 14 Apr 2016 11:04:55 +0000 (13:04 +0200)]
Add IPsec utilities python library

JIRA: CSIT-28

Change-Id: I9513f14a9920bfbdaf34c5cc5d4619d16a383ca2
Signed-off-by: Matus Fabian <matfabia@cisco.com>
7 years agoUpdate of bootstrap-verify-master.sh file. 63/863/1
Jan Gelety [Mon, 25 Apr 2016 15:41:57 +0000 (17:41 +0200)]
Update of bootstrap-verify-master.sh file.

- VIRL image switched to double-ring-nested topology
- removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases
- included test cases with tags:
  - VM_ENV and 3_NODE_SINGLE_LINK_TOPO
  - VM_ENV and 3_NODE_DOUBLE_LINK_TOPO

Change-Id: I99084b57c1fdd4aefb028cb144822a645baf9321
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHoneycomb API keywords 82/782/5
Tibor Frank [Thu, 14 Apr 2016 10:46:22 +0000 (12:46 +0200)]
Honeycomb API keywords

- add keywords to get, put post and delete configuration data using Honeycomb
  REST API
- add keywords to get operational data using Honeycomb REST API

Change-Id: If75221777e0e83a809c834addf82e95bbd540e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoReformat python libraries. 07/607/11
Matej Klotton [Thu, 24 Mar 2016 15:14:20 +0000 (16:14 +0100)]
Reformat python libraries.

PEP8 reformat
fix typos
docstrings reformat

Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoBridge domain tests and user keywords refactor. 11/811/6
Jan Gelety [Mon, 18 Apr 2016 22:07:13 +0000 (00:07 +0200)]
Bridge domain tests and user keywords refactor.

- BD tests changed to behavior-driven-test style
- added documentation to BD tests
- added documentation and examples to BD user KWs

Change-Id: Ifad45df3ef0bb55f5295363a264fe5f4e54f5762
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoVatExecutor update 42/842/2
Matus Fabian [Fri, 22 Apr 2016 11:58:22 +0000 (13:58 +0200)]
VatExecutor update

Strip non-JSON data from VAT terminal output
Add method for VAT command retval verification

Change-Id: Ibe68020393cb1a700ad048dc78078f71064707b4
Signed-off-by: Matus Fabian <matfabia@cisco.com>
7 years agoPerformance test cases 26/826/5
pmikus [Wed, 20 Apr 2016 13:49:44 +0000 (15:49 +0200)]
Performance test cases

- JIRA: CSIT-10
- Add 1518B and 9000B test for multicore tests
- Fine tune threshold for short tests based on previous benchmarks
- Fix SI units

Change-Id: I5c4657dfd881a24b2e40c91ea80a979003754258
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoTopology schema 93/793/5
Tibor Frank [Fri, 15 Apr 2016 12:46:21 +0000 (14:46 +0200)]
Topology schema

- fix Honeycomb part of the topology schema
- add topology file checking using pykwalify before tests are started

Change-Id: I907d41b66f5660a2ab4de8857312e9277052bae6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 years agoRemove horizontal whitespace (a line) before [Command_start_exec] tag. 16/816/2
mkonstan [Tue, 19 Apr 2016 16:17:42 +0000 (17:17 +0100)]
Remove horizontal whitespace (a line) before [Command_start_exec] tag.

Change-Id: I51e5616cb45b3c67e82153cc4c0f42ec9c5d75d7
Signed-off-by: mackonstan <mkonstan@cisco.com>
8 years agoInclude tags to CSIT performance boostrap script 91/791/2
pmikus [Fri, 15 Apr 2016 10:08:51 +0000 (12:08 +0200)]
Include tags to CSIT performance boostrap script

- include tags to CSIT performance boostrap script
- allows future expansion of selective test execution

Change-Id: I3870f52d86ff39234eb724500d3871fed0cbdb30
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoMake VXLAN test dot1Q as noncritical for now. 19/819/1
Stefan Kobza [Tue, 19 Apr 2016 20:53:23 +0000 (22:53 +0200)]
Make VXLAN test dot1Q as noncritical for now.

Change-Id: I0d41aad3fc1f96b58b83c6f0aa5a0e7606868ee4
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoMake dut_setup.sh verbose; add sleep after vpp restart. 14/814/5
Stefan Kobza [Tue, 19 Apr 2016 12:37:20 +0000 (14:37 +0200)]
Make dut_setup.sh verbose; add sleep after vpp restart.

 - there's a race condition between VPP service restart and vpp_api_test
 execution; this patch addresses it with (for now) sleep after service
 vpp restart
 - above is just a workaround until VPP provides us with a notification
 of readiness..

Change-Id: I1f92c1d86e4f90c9432ea57c1747629f619f003e
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoMulticore VPP setup for performance testing 10/710/12
pmikus [Thu, 7 Apr 2016 14:36:31 +0000 (16:36 +0200)]
Multicore VPP setup for performance testing

- add multithread TAGS documentation
- add methods to VppConfigGenerator for RSS configuration
- create KW for multithread setup
- create sample test case using multithread vpp setup
- add Documentation into TCs

Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoUpdate Qemu library 77/677/9
Matus Fabian [Mon, 4 Apr 2016 14:11:46 +0000 (16:11 +0200)]
Update Qemu library

Incorporated changes from nested VM on VIRL.

Change-Id: I76ceeb2dde635c2cf0d3a53d29bf24fed72a5437
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoChange the performance result message 84/784/3
pmikus [Thu, 14 Apr 2016 11:30:12 +0000 (13:30 +0200)]
Change the performance result message

- change the result message of performance search to more verbose level
  (rate per stream, rate total, throughput in Gbps)

Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoUpdate of bootstrap.sh file. 37/737/4
Jan Gelety [Mon, 11 Apr 2016 16:08:13 +0000 (18:08 +0200)]
Update of bootstrap.sh file.

- updated vpp build version
- VIRL image switched to double-ring-nested topology
- removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases
- included test cases with tags:
  - VM_ENV and 3_NODE_SINGLE_LINK_TOPO
  - VM_ENV and 3_NODE_DOUBLE_LINK_TOPO
- added missing tags to TC VPP reports interfaces in Bridge
  Domain test suite

Change-Id: Ia6a7a54ef9ad6245835b2762c303935fe39f4079
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoVXLAN test with dot1q tagging. 21/521/35
Matej Klotton [Fri, 11 Mar 2016 12:56:39 +0000 (13:56 +0100)]
VXLAN test with dot1q tagging.

Change-Id: I3dbd12983736e338d757c580570d91680aedd83f
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoMove methods from topology.py to more appropriate place. 99/599/18
Matej Klotton [Wed, 23 Mar 2016 14:01:30 +0000 (15:01 +0100)]
Move methods from topology.py to more appropriate place.

Change-Id: I2612a9466095b3d79a4a9d938fcdbf9f93133f69
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoHoneycomb setup and utils 89/689/9
Tibor [Wed, 6 Apr 2016 11:33:42 +0000 (13:33 +0200)]
Honeycomb setup and utils

- re-implement HTTPCodes as IntEnum rather then dictionary
- add methods to manipulate data using honeycomb - get, set, delete
- change the name of url file from vpp_version.url to oper_vpp_version.url
- improve checking of startup and shutdown state of honeycomb
- PEP8 fixes
- add docstrings in all modules and classes
- move logging to the lowest possible level
- improve logging in exceptions
- add method exec_command_sudo_log to resources.libraries.python.ssh module

Change-Id: I54e0c6b45313e3a3c11bafa475488ae2b1e605c2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 years agodocumentation: long_xconnect test suite documentation 51/751/2
Miroslav Miklus [Tue, 12 Apr 2016 12:54:12 +0000 (14:54 +0200)]
documentation: long_xconnect test suite documentation

Generate testdoc by using:
 python -m robot.testdoc long_xconnect.robot perf_long_xconnect.html

Change-Id: I12d83de4abb1af4d94e6fd78d05c46018ee5d7d7
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd keywords for Honeycomb tests 94/694/12
selias [Wed, 6 Apr 2016 14:49:15 +0000 (16:49 +0200)]
Add keywords for Honeycomb tests

 -add interface dump and bridge-domain dump to Vat command templates
 -add low level keywords to implement vat dump commands

The resulting data dumps will be used in Honeycomb testing,
to verify data retrieved through Honeycomb API.

Change-Id: I2a913eaf23aa13d7223576220681821007672812
Signed-off-by: selias <samuel.elias@pantheon.tech>
8 years agoBoostrap verify installation directory removal 50/750/1
pmikus [Tue, 12 Apr 2016 11:38:20 +0000 (13:38 +0200)]
Boostrap verify installation directory removal

- Boostrap verify installation directory removal

Change-Id: I091240f8a3f7e5074cdc2f069837963e4c8bd192
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap verify performance fix 49/749/1
pmikus [Tue, 12 Apr 2016 10:34:02 +0000 (12:34 +0200)]
Bootstrap verify performance fix

- Bootstrap verify performance fix

Change-Id: I8f77c26aef805f5223d03e2a0bc4a97f88195ed8
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap verify performance fix 48/748/1
pmikus [Tue, 12 Apr 2016 10:21:53 +0000 (12:21 +0200)]
Bootstrap verify performance fix

- fix installation directory create and remove

Change-Id: I0acd47b886e869958a2075889af3bbe166d7808e
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap verify perfomance fix 45/745/2
pmikus [Tue, 12 Apr 2016 07:58:59 +0000 (09:58 +0200)]
Bootstrap verify perfomance fix

- fix test tags to lowercase

Change-Id: I6e01a677f15843105106300097b4d0b23e2cba5d
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoUpdate of topo_installation file 42/742/2
pmikus [Tue, 12 Apr 2016 05:27:27 +0000 (07:27 +0200)]
Update of topo_installation file

- deb package path fix

Change-Id: I94065581886c4d5b9f15ced18857ddfcde442153
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoFix cosmetic issues in VIRL topologies 23/723/3
Carsten Koester [Sun, 10 Apr 2016 15:51:18 +0000 (11:51 -0400)]
Fix cosmetic issues in VIRL topologies

Fix cosmetic issues in VIRL topologies:
- Replace double whitespace by single whitespace in XML
- Remove reserved but unused IP address allocations from VIRL config
- Modify "start-testcase" script to handle links without IP address

Change-Id: Ie447bd91172df61b30ebb8650b56bdfca0f25fd4
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoAdd VIRL double-ring (load-balancing) topology with nested VM support 24/724/2
Carsten Koester [Sun, 10 Apr 2016 15:54:47 +0000 (11:54 -0400)]
Add VIRL double-ring (load-balancing) topology with nested VM support

Change-Id: Idcf173b1711076a5d7e4af8fe46e302b9eae4ff6
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoCombined DropRateSearch 71/671/7
pmikus [Mon, 4 Apr 2016 09:10:12 +0000 (11:10 +0200)]
Combined DropRateSearch

- combined search algorithm using linear and binary search
- add KWs into performance library for binary and combined search
- remove short_bridge_domain_binary.robot as binary and combined search
  KWs are in library for optional use
- PEP8 fixes

Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoAdd Vagrantfile for local testing. 23/523/11
Stefan Kobza [Sat, 5 Mar 2016 09:19:16 +0000 (10:19 +0100)]
Add Vagrantfile for local testing.

Vagrantfile contains 3 VMs as of now, 2 DUTs 1 TG, with these notes:
 - login is csit/csit
 - by default provision script installs all deb packages from the dir
    where Vagrantfile is
 - developed for, and only tested on vbox (someone can pick up vmware)
 - All nodes have 1 shared mgmt network: 192.168.255.0/24
 - hosts have these IP addresses in host-only network
    TG : 192.168.255.100
    DUT1 : 192.168.255.101
    DUT2 : 192.168.255.102
 - script created to download MAC address information
 - PCI addresses are always the same for vbox (not sure about vmware)

HOWTO (will create a wiki page once one is created for CSIT project):
 - copy Vagrantfile to separate dir on host
 - vagrant up --parallel
    sit-back-and-relax
 - from VM that has access to the same host-only network (192.168.255.0 above)
    - copy your ssh-key to csit@192.168.255.{101,102,250} using
        ssh-copy-id
    - cd ${csit_dir}
    - virtualenv & pip as in README
    - export PYTHONPATH=${csit_dir}
    - resources/tools/topology/update_topology.py -v -f
        -o topologies/available/vagrant_pci.yaml \
        topologies/available/vagrant.yaml
    - pybot -L TRACE \
        -v TOPOLOGY_PATH:topologies/available/vagrant_pci.yaml -s \
        "ipv4" tests
    - see tests results

Change-Id: Ic27626605a9c820bca977b38f4e8ca37d1504ff5
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoAdd tag support to boostrap-verify-perf 76/676/5
pmikus [Mon, 4 Apr 2016 13:26:41 +0000 (15:26 +0200)]
Add tag support to boostrap-verify-perf

- support tags in vpp-verify-perfomance-* jenkins jobs

Change-Id: I7e3abfe9e552a3f2fa9ebf95df9b48bcbae3561a
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoAdd "Stop and Clear QEMU" KW 73/673/3
Matus Fabian [Mon, 4 Apr 2016 10:07:51 +0000 (12:07 +0200)]
Add "Stop and Clear QEMU" KW

Change-Id: Ib1b3907cd30c20c89283bd20e84ed8b829540ca4
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoSetup and check honeycomb on all DUTs 75/575/11
selias [Mon, 21 Mar 2016 12:06:49 +0000 (13:06 +0100)]
Setup and check honeycomb on all DUTs

- methods implementing HTTP requests (PUT,GET,POST,DELETE)
- methods for parsing HTTP responses
- methods for honeycomb setup on DUT
- updated constants.py
- keywords for honeycomb setup and communication
- simple honeycomb sanity test (not enabled for jenkins job runs)

Change-Id: I589f0ca56cc01072b92fe9363aed16a4098aee40
Signed-off-by: selias <samuel.elias@pantheon.tech>
8 years agoAdd new tag for VPP-VM testing enviroment 69/669/3
Matus Fabian [Mon, 4 Apr 2016 07:40:52 +0000 (09:40 +0200)]
Add new tag for VPP-VM testing enviroment

Change-Id: I2bdca4d8451bec8215b2d8f637809f8781e2e9d2
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd VIRL topology files and template for nested virtualisation 65/665/2
Carsten Koester [Fri, 1 Apr 2016 23:14:37 +0000 (19:14 -0400)]
Add VIRL topology files and template for nested virtualisation

Change-Id: I57dbe4f179b3cfd3f51c9dec503ca45a5c0521fd
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoChange send_ip_icmp recv timeout to 2sec 47/647/2
Matus Fabian [Wed, 30 Mar 2016 11:39:36 +0000 (13:39 +0200)]
Change send_ip_icmp recv timeout to 2sec

Traffic script send_ip_icmp recv timeout 10 sec is too long and execution
rather end with ssh timeout.

Change-Id: Id4df679799191fd03e2987f068f3ea9e7bf12fdf
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd get_vhost_user_if_name_by_sock 52/652/2
Matus Fabian [Thu, 31 Mar 2016 07:46:39 +0000 (09:46 +0200)]
Add get_vhost_user_if_name_by_sock

Change-Id: I1d7f2cdfcf29763ce94417c98d363021f1fb27a1
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoLong perf tests 74/574/7
pmikus [Mon, 21 Mar 2016 09:29:17 +0000 (10:29 +0100)]
Long perf tests

- added new long tests for ipv4 and xconnect
- modified long bridge domain test
- added 64B, 1518B and 9000B frame sizes

Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap to test perf of proposed patch vpp-csit-hw-perf 31/631/4
pmikus [Tue, 29 Mar 2016 10:56:12 +0000 (12:56 +0200)]
Bootstrap to test perf of proposed patch vpp-csit-hw-perf

- Based on #570 Lab reservation tool
- Get the latest build of VPP
- Make reservation on testbed by using existing topology files
- Copy and install VPP image on all DUTs
- Run performance tests

Change-Id: I8034fd9c284cbe9a68e0c9116d0826965464b5f9
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoAdd linux_add/del_bridge and modify vpp_add_l2fib_entry 84/584/3
Matus Fabian [Tue, 22 Mar 2016 08:04:07 +0000 (09:04 +0100)]
Add linux_add/del_bridge and modify vpp_add_l2fib_entry

linux_add_bridge - bridge two interfaces on linux node
linux_del_bridge - delete bridge from linux node
vpp_add_l2fib_entry - param interface should be interface name or sw_if_index

Change-Id: Ia8030e24a0afe088df0dcb6c65a85ed341224206
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoBestN/WorstN DropRateSearch 03/603/3
pmikus [Thu, 24 Mar 2016 12:50:19 +0000 (13:50 +0100)]
BestN/WorstN DropRateSearch

- implementation of Best-of-N/Worst-of-N result evaluation with max
  attempts per one rate step

Change-Id: Ice1d6e93807d90761462c4df601cbe068011159a
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoBootstrap to test csit-master against VPP release. 38/538/9
Jan Gelety [Tue, 15 Mar 2016 12:45:55 +0000 (13:45 +0100)]
Bootstrap to test csit-master against VPP release.

- get the version of the latest VPP build
- download and install the latest VPP build on nodes
- run three times all test suites to check if the VPP build
  can be used for csit development and current csit master
  can be pushed to master-verified branch
  (see patch https://gerrit.fd.io/r/590)

Change-Id: I0ad2e9fe1620cc18ccc11dce2d107177cf97ff27
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoFix of bootstrap.sh for vpp-csit-verify-virl job 29/629/1
Jan Gelety [Tue, 29 Mar 2016 10:25:16 +0000 (12:25 +0200)]
Fix of bootstrap.sh for vpp-csit-verify-virl job

- moved rm -f *.deb to else statement to avoid
  deletion of deb packages when boostrap.sh is
  called from include-raw-vpp-csit-functional.sh

Change-Id: I4a224a1fc332d50a27347e77dbeacbfbc98677c9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoSetup and run QEMU VM 41/541/4
Matus Fabian [Wed, 16 Mar 2016 11:42:28 +0000 (12:42 +0100)]
Setup and run QEMU VM

Change-Id: I22640caa9f13be09d2a837c6332d7b86cef77efc
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd node type VM to set_interface_state 83/583/2
Matus Fabian [Tue, 22 Mar 2016 07:49:58 +0000 (08:49 +0100)]
Add node type VM to set_interface_state

Change-Id: Ib70de73eec7c015f328f877fa34ead15e27eb254
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoBinary DropRateSearch 64/564/6
pmikus [Fri, 18 Mar 2016 11:44:57 +0000 (12:44 +0100)]
Binary DropRateSearch

- binary search
- short perf bridge_domain with binary

Change-Id: I50538738b356cc8fef4cfcb4974c43c5123827d1
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoLab reservation tool 70/570/6
Miroslav Miklus [Fri, 18 Mar 2016 17:28:26 +0000 (18:28 +0100)]
Lab reservation tool

This tool provide client-based reservation system of tesbeds
by using existing topology files.

Change-Id: Ic0be944c77c9d6aa28e3fa7fa69e31d19861416f
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoRemove apt-get call to install dependencies. 39/539/2
Carsten Koester [Wed, 16 Mar 2016 08:47:47 +0000 (04:47 -0400)]
Remove apt-get call to install dependencies.

Change-Id: I309a13bc857b89f1f342d659ab80b70d7a5fc686
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoAdd SSH disconnect 52/552/2
Matus Fabian [Thu, 17 Mar 2016 13:14:22 +0000 (14:14 +0100)]
Add SSH disconnect

Change-Id: Ib0efec083aa9ee33b7d15680e5a15989827b8e57
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoFixed SSH exec_command timeout 37/537/2
Matus Fabian [Tue, 15 Mar 2016 11:28:09 +0000 (12:28 +0100)]
Fixed SSH exec_command timeout

Change-Id: I8cd2fcfbe774bd651ed57be0129c32d6ba68adcc
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoDropRateSearch library 15/515/9
Miroslav Miklus [Wed, 9 Mar 2016 14:48:59 +0000 (15:48 +0100)]
DropRateSearch library

- linear search
- t-rex DropRateSearch implementation
- long perf bridge_domain test
- introduced PERFORMANCE_SHORT, PERFORMANCE_LONG test tags

Change-Id: I497b72f3e6d58a67ca5a386403d1e84dcf433ec4
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agotools: vpp download and installation script 33/533/1
Miroslav Miklus [Mon, 14 Mar 2016 16:54:58 +0000 (17:54 +0100)]
tools: vpp download and installation script

Download and install 'RELEASE' version of vpp packages
Dependecies: curl, dpkg, md5sum

Change-Id: I894c8181125b84df3057afc092ed01c0a837321a
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd vxlan tests using xconnect 05/505/10
Patrik Hrnciar [Tue, 8 Mar 2016 16:34:18 +0000 (17:34 +0100)]
Add vxlan tests using xconnect

Change-Id: I190689d5a624f1c876df90ce29b05a2b0b8a2df4
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
8 years agoAdd VM to NodeType 28/528/2
Matus Fabian [Mon, 14 Mar 2016 10:45:44 +0000 (11:45 +0100)]
Add VM to NodeType

Change-Id: Ic3a313837f48a1c7bd1c70876c82799ac1994f2f
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoSSH connect use port specified in node dict 26/526/1
Matus Fabian [Mon, 14 Mar 2016 09:22:58 +0000 (10:22 +0100)]
SSH connect use port specified in node dict

Change-Id: I4ed7d58466724e68dc7ad22f85f6e7703a6c7a64
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd Vhost-user interfaces library 14/514/3
Matus Fabian [Wed, 9 Mar 2016 13:52:29 +0000 (14:52 +0100)]
Add Vhost-user interfaces library

Change-Id: I295e67b4a5622b1fff4fbe5d4a7e5753f3c4af57
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoAdd KW to build QEMU 2.2.1 on node 02/502/6
Matus Fabian [Tue, 8 Mar 2016 13:01:32 +0000 (14:01 +0100)]
Add KW to build QEMU 2.2.1 on node

Change-Id: I58271aff1ef558752f00593bbad5c3317d08288d
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoUpdate VPP version downloaded from Nexus. 70/470/24
Matej Klotton [Thu, 3 Mar 2016 16:49:13 +0000 (17:49 +0100)]
Update VPP version downloaded from Nexus.

Change-Id: Iae2ee6d576347262d9f3f9a9e9b9cc65dbc5bf5e
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoAdd library to generate VPP configuration file 74/474/5
Carsten Koester [Thu, 3 Mar 2016 20:56:46 +0000 (15:56 -0500)]
Add library to generate VPP configuration file

Change-Id: Icc202c82b238a30735ffa3d0017c61e2dd8bd532
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoAdd VIRL server-side framework and topology templates. 01/401/3
Carsten Koester [Wed, 24 Feb 2016 00:27:01 +0000 (19:27 -0500)]
Add VIRL server-side framework and topology templates.

Change-Id: I02e7f85e3259dc0a5b2c7d0098747921a75fa5ea
Signed-off-by: Carsten Koester <ckoester@cisco.com>
8 years agoModify sweep ping test cases 86/386/15
Juraj Sloboda [Tue, 23 Feb 2016 14:03:13 +0000 (15:03 +0100)]
Modify sweep ping test cases

- Write separate sweep ping test cases for jumbo frames
- Compute sweep ping end size from reported MTU on DUT interface
- Set MTU on TG according to MTU on DUT interface
- Log VPP packet traces on IPv4 and IPv6 tests failure
- Remove VM_ENV tag from sweep ping test cases for jumbo frames

Change-Id: I47aa7977bcff9c4366c67578aef542924a1d055b
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agochange interface up calls to explicit keywords 81/481/6
selias [Tue, 1 Mar 2016 09:56:40 +0000 (10:56 +0100)]
change interface up calls to explicit keywords

Remove implicit "set interface state" calls from ipv4 and ipv6 test keywords.
Use robot keyword instead.

Change-Id: I535a7a967910e77dded39eb167fb9c164187566e
Signed-off-by: selias <samuel.elias@pantheon.tech>
8 years agoMove Send and receive L2 traffic KWs to standalone file. 58/458/6
Matej Klotton [Wed, 2 Mar 2016 12:05:13 +0000 (13:05 +0100)]
Move Send and receive L2 traffic KWs to standalone file.

Change-Id: I3c919a15d5fdbf91ff493d64b768fb69b8c21b65
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoAdd with-statment support to VatTerminal. 61/461/11
Matej Klotton [Wed, 2 Mar 2016 15:51:30 +0000 (16:51 +0100)]
Add with-statment support to VatTerminal.

Change-Id: I7b4b32ce07b9247ccf80bf6b5d3339d00bc0999f
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoPerformance suite reorg, v4 tests 51/451/9
Miroslav Miklus [Tue, 1 Mar 2016 15:11:34 +0000 (16:11 +0100)]
Performance suite reorg, v4 tests

- perf suite splitted to
1.xconnect
2.bridge-domain
3.IPv4
- IPv4 perf tests implemented
- renamed perf tests prefix 2core -> 1core

Change-Id: I9ef2dbdfcfdcb36e8865989e6255d69ced33269c
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd more IP networks to IPV4_NETWORKS and IPV6_NETWORKS 54/454/4
Matej Klotton [Tue, 1 Mar 2016 15:34:52 +0000 (16:34 +0100)]
Add more IP networks to IPV4_NETWORKS and IPV6_NETWORKS

Change-Id: If340a21aac02f94aaf8a282f7b689c0f5d9aa438
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoTransfer l2_xconnect setup to L2Util 42/442/6
Patrik Hrnciar [Mon, 29 Feb 2016 13:28:41 +0000 (14:28 +0100)]
Transfer l2_xconnect setup to L2Util

Change-Id: I7a661c9ce8b5f9ca8fbd36858f7a9cd6f1da8ffd
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
8 years agoInstall dependencies prior test execution. 55/455/11
Stefan Kobza [Tue, 1 Mar 2016 19:47:28 +0000 (20:47 +0100)]
Install dependencies prior test execution.

Until verify_merge nodes have proper dependencies update, install the
dependencies manually prior to test execution.

Change-Id: I94b09b48b1b272f2bdedbb87ea35665707c581fd
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoAdd VXLAN test 75/375/11
Matej Klotton [Mon, 22 Feb 2016 17:12:15 +0000 (18:12 +0100)]
Add VXLAN test

Change-Id: Id1d37fda2697fbfb7aa7a79318f8316b80e96963
Signed-off-by: Matej Klotton <mklotton@cisco.com>
8 years agoFix checksum comparison in latest code 41/441/1
Juraj Sloboda [Mon, 29 Feb 2016 08:40:27 +0000 (09:40 +0100)]
Fix checksum comparison in latest code

Change-Id: I8aa53ce64f8f9e0553702f8a586fac3824a876f4
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoFix checksum comparison in traffic scripts 33/433/3
Juraj Sloboda [Thu, 25 Feb 2016 15:03:51 +0000 (16:03 +0100)]
Fix checksum comparison in traffic scripts

Change-Id: Ibeff7c790ed4aba8b3a0534681912d0d5b826dbb
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoTest both traffic directions for bidirectional topology 17/417/2
Jan Gelety [Thu, 25 Feb 2016 16:54:12 +0000 (17:54 +0100)]
Test both traffic directions for bidirectional topology

- l2 bridge domain
- l2 cross connects

Change-Id: I45b4c1e5aa72e55ff05ed84f4748a0ea41c99a18
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoMinor change in virtual env creation 14/414/2
Jan Gelety [Thu, 25 Feb 2016 16:12:19 +0000 (17:12 +0100)]
Minor change in virtual env creation

- increase timeout for virtualenv creation
- confirm successful virtualenv creation

Change-Id: Ic973f97e23ccf35c677849f31251637bf8551fef
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoCheck ipv4 ping response 84/384/3
Juraj Sloboda [Mon, 22 Feb 2016 16:20:45 +0000 (17:20 +0100)]
Check ipv4 ping response

Change-Id: I47ef2d59bdcbbb470550a037906bf8ba2a1bc66c
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoT-REX: startup config generation 36/436/1
Miroslav Miklus [Fri, 26 Feb 2016 17:35:27 +0000 (18:35 +0100)]
T-REX: startup config generation

- T-rex startup config generated based on computed path
- move t-rex tooling to t-rex directory

Change-Id: I3ac698f41f98934bcce4af35dc3a755a8948e887
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoSome changes in pylint configuration 85/385/2
Matus Fabian [Tue, 23 Feb 2016 11:33:59 +0000 (12:33 +0100)]
Some changes in pylint configuration

method name length changed from 30 to 40
max-args changed from 5 to 7

Change-Id: Iea3efc7c545236f97d230e6f99fce814d3598925
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoPerformance suite: introduced suite variables 97/397/3
Miroslav Miklus [Tue, 23 Feb 2016 21:02:06 +0000 (22:02 +0100)]
Performance suite: introduced suite variables

- perf suite variables
- T-REX setup fix

Change-Id: I608581e45d0e5f80e8f75c2a07c994bf0e0d0df3
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agovpp_ra_supress_link_layer run VAT tempalte 04/404/1
Matus Fabian [Wed, 24 Feb 2016 14:49:15 +0000 (15:49 +0100)]
vpp_ra_supress_link_layer run VAT tempalte

Change-Id: I7385650a1c9502b430c9f8022f8c298be52deba8
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoMove script code to main function 83/383/3
Juraj Sloboda [Mon, 22 Feb 2016 12:40:21 +0000 (13:40 +0100)]
Move script code to main function

Change-Id: I84db0d569dad8b8b56a95a967ddd80ffc54d6aaf
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoAutomate VIRL simulation life cycle. 80/380/16
Stefan Kobza [Mon, 22 Feb 2016 20:49:27 +0000 (21:49 +0100)]
Automate VIRL simulation life cycle.

Change-Id: I126c42b994c1356acc202f4ec1b153c790c43d46
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoBootstrap for performance suite 55/355/7
Miroslav Miklus [Fri, 19 Feb 2016 08:36:58 +0000 (09:36 +0100)]
Bootstrap for performance suite

Change-Id: I9ac58cd12b439c95b2c6aeb0efdcbd6f97d4c1ab
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoRemove Interface.close, rename script argument 82/382/2
Juraj Sloboda [Mon, 22 Feb 2016 12:22:23 +0000 (13:22 +0100)]
Remove Interface.close, rename script argument

Change-Id: I5da20a12f801264821890e6516899344456576a8
Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
8 years agoFixed strings with format splitting 81/381/2
Matus Fabian [Tue, 23 Feb 2016 07:56:29 +0000 (08:56 +0100)]
Fixed strings with format splitting

Change-Id: Iaded6b2ba46df86dd89afb2e2dc411d9972fb7d7
Signed-off-by: Matus Fabian <matfabia@cisco.com>
8 years agoInstead of Sleep loop verification of interfaces 72/372/4
Matus Fabian [Mon, 22 Feb 2016 14:21:57 +0000 (15:21 +0100)]
Instead of Sleep loop verification of interfaces

Change-Id: I29a974182082f0e5c84a9dd21a539d21ef75b41b
Signed-off-by: Matus Fabian <matfabia@cisco.com>