csit.git
6 years agoFix run_report.sh 49/6349/1
Peter Mikus [Sat, 22 Apr 2017 05:00:28 +0000 (07:00 +0200)]
Fix run_report.sh

- fix sed delimiter to eliminate /

Change-Id: I4d6253d7845937ee452da342819d1c390ca28054
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoReport generation script updates 05/6205/14
pmikus [Thu, 13 Apr 2017 20:06:17 +0000 (22:06 +0200)]
Report generation script updates

- Add new type of throughput plots
- Update Sphinx, Sphinx-rtd-theme and Plotly packages
- Add auto generation of detailed test results
- Small fixes

Change-Id: I706777160a7f166e0a335c64428d10cb546fa854
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoAdded Ethernet frame size tags for performance tests: 27/6327/4
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:04:40 +0000 (12:04 +0100)]
Added Ethernet frame size tags for performance tests:
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B.

Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agotag_documentation.rst - added: 29/6329/3
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:15:15 +0000 (12:15 +0100)]
tag_documentation.rst - added:
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B.

Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoCSIT rls1704 report - update to handcraftec sections: 07/6307/2
Maciek Konstantynowicz [Thu, 20 Apr 2017 21:42:01 +0000 (22:42 +0100)]
CSIT rls1704 report - update to handcraftec sections:

- introduction /overview /general_notes /csit_test_naming
- vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs
- vpp_functional_tests /overview /csit_release_notes /documentation
- testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs

Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agotag_documentation.rst - added: Ethernet frame size tags for performance tests 22/6322/2
Maciek Konstantynowicz [Fri, 21 Apr 2017 09:25:35 +0000 (10:25 +0100)]
tag_documentation.rst - added: Ethernet frame size tags for performance tests

Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoCSIT-561: Add release and version to the header 12/6312/2
Tibor Frank [Fri, 21 Apr 2017 07:54:07 +0000 (09:54 +0200)]
CSIT-561: Add release and version to the header

Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: update plugin-ACL test suite 42/6242/5
selias [Thu, 13 Apr 2017 10:28:43 +0000 (12:28 +0200)]
HC Test: update plugin-ACL test suite

 - fix variables in routed icmpv6 test case
 - remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases
 - create and use keywords for test teardown

Change-Id: I91792b5900015827bc2bcfd138192f972f92df28
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-561: Add filtering of testsuits to report generation 63/6263/2
Tibor Frank [Wed, 19 Apr 2017 12:13:24 +0000 (14:13 +0200)]
CSIT-561: Add filtering of testsuits to report generation

Change-Id: I751600f7ea9937bc8bfde7d6062eeaadf3ee68dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoUse QEMU virtio queue size 1024 for perf tests 97/6197/21
Jan Gelety [Thu, 13 Apr 2017 15:01:13 +0000 (17:01 +0200)]
Use QEMU virtio queue size 1024 for perf tests

- use Build QEMU KW to apply patch to increase default virtio queue size
- remove Set Scheduler Policy

Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-559: Performance jobs reorganisation, part 3 24/6224/4
Tibor Frank [Tue, 18 Apr 2017 10:56:31 +0000 (12:56 +0200)]
CSIT-559: Performance jobs reorganisation, part 3

Add:
 - csit-vpp-perf-ndrchk-daily

Change-Id: I4edfa86810744168307d9cbeb979d40dc5e21eb0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoCSIT-558: Performance jobs reorganization, part 2 67/6167/5
Tibor Frank [Wed, 12 Apr 2017 14:10:45 +0000 (16:10 +0200)]
CSIT-558: Performance jobs reorganization, part 2

Add:
 - csit-vpp-perf-check

Change-Id: I31e40d37e38d27d3be15a40f6044ce5d907067be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoFix: IPSec+Lisp suite naming 51/6251/1
Peter Mikus [Wed, 19 Apr 2017 06:05:50 +0000 (08:05 +0200)]
Fix: IPSec+Lisp suite naming

Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoCSIT-560: csit src code doc generation for 1704 32/6232/2
Tibor Frank [Tue, 18 Apr 2017 12:54:10 +0000 (14:54 +0200)]
CSIT-560: csit src code doc generation for 1704

Change-Id: I9f07f326e12942404d670004bb9463039967f954
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoHC Test: update persistence suite 21/6221/4
selias [Tue, 18 Apr 2017 10:01:27 +0000 (12:01 +0200)]
HC Test: update persistence suite

 - fix "enable persistence" is suite setup
 - update Jira links to persistence bug
 - log content of persistence file before each restart

Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-531: Performance jobs reorganization, part 1 33/6133/4
Tibor Frank [Tue, 11 Apr 2017 09:26:17 +0000 (11:26 +0200)]
CSIT-531: Performance jobs reorganization, part 1

Add:
 - csit-vpp-perf-trend-daily
 - csit-vpp-perf-trend-semiweekly

Change-Id: I59ed581f9fb2457cf1e3a58bac625f3b807d653f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoRemove the tag THIS from SNAT perf tests 27/6227/1
Tibor Frank [Tue, 18 Apr 2017 11:24:57 +0000 (13:24 +0200)]
Remove the tag THIS from SNAT perf tests

Change-Id: I54ac114b72763bbf1d2dd57956c0a6f99af82da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoCSIT-545: Performance tests for SNAT 28/5728/71
Tibor Frank [Mon, 13 Mar 2017 12:22:08 +0000 (13:22 +0100)]
CSIT-545: Performance tests for SNAT

- High level definition (HLD)
- Low level definition (LLD)
- Add keywords to set SNAT
- Add tests according to HLD, LLD

Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoUpdate ansible script 03/6203/3
pmikus [Thu, 13 Apr 2017 18:56:56 +0000 (20:56 +0200)]
Update ansible script

- Add more inter steps
- Add alternative way to host files via Apache server (due to VIRL
  collisions)

Change-Id: Ibb206fa630013e9cdff9cda145e993b033ec7138
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: update honeycomb package download scripts 74/6174/7
selias [Wed, 12 Apr 2017 16:40:11 +0000 (18:40 +0200)]
HC Test: update honeycomb package download scripts

 - add "_amd64" to version parameter for .deb packages
 - install only vpp-api-java on maven build slave

Change-Id: Ie61974c3c2806d1d3e0281bd0b5149f1b0d1443d
Signed-off-by: selias <samelias@cisco.com>
7 years agoFix slow ssh login to Centos VIRL hosts. 80/6080/2
Matej Klotton [Fri, 7 Apr 2017 08:26:37 +0000 (10:26 +0200)]
Fix slow ssh login to Centos VIRL hosts.

Change-Id: I36478bcae679d8e30ad00d97d7fc680130808670
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoIPsectptLispGpe performance test suite 09/6109/15
pmikus [Mon, 10 Apr 2017 06:48:19 +0000 (08:48 +0200)]
IPsectptLispGpe performance test suite

*[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
with single links between nodes.
*[Enc] Packet Encapsulations:* IPv4-IPSec-LISPGPE-IPv4.
*[Cfg] DUT configuration:* Each DUT is configured with LISP and IPsec.
IPsec is in transport mode. Tests cases are for IPsec configured both on
RLOC interface.

Change-Id: I7a95baf0305caac3d9f0702bbedb3feec27f1668
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-544 HC Test: adapt package download script to changes in hc2vpp 48/6048/7
selias [Wed, 5 Apr 2017 09:54:06 +0000 (11:54 +0200)]
CSIT-544 HC Test: adapt package download script to changes in hc2vpp

Required after https://gerrit.fd.io/r/5908
hc2vpp packages to be published with a specific VPP version dependency.

Change-Id: I9a31a83ec033a01556b4afd8575d8ccae4139b7f
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: update URL paths with ODL mountpoint 57/6157/1
selias [Wed, 12 Apr 2017 09:08:47 +0000 (11:08 +0200)]
HC Test: update URL paths with ODL mountpoint

other minor fixes:
- update teardown keyword in proxyARP suite
- increase timeout for SLAAC traffic test

Change-Id: Ia16d096c54ceac501a24d5d910dd18e33d900d2a
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-529 HC Test: SLAAC 43/6043/13
jan.hradil [Thu, 30 Mar 2017 07:55:30 +0000 (09:55 +0200)]
CSIT-529 HC Test: SLAAC

Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
7 years agoDon't use dpdk dev packages - weekly, func and perf jobs 10/6110/2
Jan Gelety [Mon, 10 Apr 2017 07:44:49 +0000 (09:44 +0200)]
Don't use dpdk dev packages - weekly, func and perf jobs

 - remove donwload and installation of DPDK development packages

 - keep download and installation of vpp-dpdk-dkms deb package
   that contains igb_uio driver needed for e.g. cryptodev tests

Change-Id: I3d87fa1cd1efaad522f47df0e71a4885466a14c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: Fix proxyARP test teardown 72/6072/2
selias [Thu, 6 Apr 2017 14:14:39 +0000 (16:14 +0200)]
HC Test: Fix proxyARP test teardown

 - interface assignment is removed automatically with proxyARP settings

Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER_UBUNTU 11/6111/1
Jan Gelety [Mon, 10 Apr 2017 07:49:31 +0000 (09:49 +0200)]
Update of VPP_STABLE_VER_UBUNTU

- use new vpp ref build: 17.07-rc0~81-gd927834~b2184_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/26/

Change-Id: I96684c6b17a4bb64b4070e440150ff4cac9a57a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoIPsec Multi-Tunnel performance test suite 54/4454/96
Kirill Rybalchenko [Wed, 21 Dec 2016 12:16:29 +0000 (12:16 +0000)]
IPsec Multi-Tunnel performance test suite

Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566
Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
7 years agoCSIT-441 vhost - Parametrized qemu install 16/5916/7
pmikus [Wed, 29 Mar 2017 14:51:34 +0000 (16:51 +0200)]
CSIT-441 vhost - Parametrized qemu install

Update the current QEMU installation script with option to override QEMU
installation and to apply additional patches. Additional patches are
applied from qemu_patches directory and subdir for specific QEMU version by
run-parts. This means that all patches for particular version are
applied.
All keywords for build QEMU are updated.

Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-553 Make QEMU bin configurable 40/6040/3
pmikus [Wed, 5 Apr 2017 07:35:05 +0000 (09:35 +0200)]
CSIT-553 Make QEMU bin configurable

Add option to set path for QEMU binary and make it configurable in perf
testaces as global variable.

Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: update ACL-plugil test suite 61/6061/2
selias [Wed, 5 Apr 2017 15:47:13 +0000 (17:47 +0200)]
HC Test: update ACL-plugil test suite

 - add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not
 hit the classify node
 - fix MAC address mixup in reflexive cases

Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-552: Add xl710 perf test with 2 VMs per DUT 94/5894/8
Jan Gelety [Tue, 28 Mar 2017 14:17:53 +0000 (16:17 +0200)]
CSIT-552: Add xl710 perf test with 2 VMs per DUT

    - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc
    - 40ge2p1xl710-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc
    - 40ge2p1xl710-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I2d2f8e9b8966bd6e19014cf7a234c3c02bb9251c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoUpdate topology files after HW changes 66/6066/2
pmikus [Thu, 6 Apr 2017 04:56:09 +0000 (06:56 +0200)]
Update topology files after HW changes

Adding Intel QAT crypto card caused changes in PCI adresses

Change-Id: Ifeaa0dba87d0c1b3436d303e63dd2ff284526dd1
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoApply performance options for testpmd 06/6006/6
pmikus [Mon, 3 Apr 2017 10:34:32 +0000 (12:34 +0200)]
Apply performance options for testpmd

- Add parameters to increase the performance of SUTs

Change-Id: Ia9c5d76639bd931d8113c26e18861648de395322
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER_CENTOS 95/5995/3
Jan Gelety [Mon, 3 Apr 2017 07:26:22 +0000 (09:26 +0200)]
Update of VPP_STABLE_VER_CENTOS

- use new vpp ref build: 17.07-rc0~43_g8db1de8~b2144.x86_64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/24/

Change-Id: I6d84f139f3d513010481a7cf7d287836f779dfd4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoAdd x710 and xl710 tests for testpmd 98/5098/22
Tibor Frank [Fri, 10 Feb 2017 08:24:00 +0000 (09:24 +0100)]
Add x710 and xl710 tests for testpmd

10ge2p1x710-eth-l2xcbase-ndrdisc
40ge2p1xl710-eth-l2xcbase-ndrdisc

Change-Id: Iea411182fd41e1ae9ed9b5a17f540befc247adb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoHC Test: fix restconf binding configuration 02/6002/2
selias [Mon, 3 Apr 2017 09:03:24 +0000 (11:03 +0200)]
HC Test: fix restconf binding configuration

Change-Id: I7f0872cee5b49e64912b97cee99c859d921b68e1
Signed-off-by: selias <samelias@cisco.com>
7 years agoMake testpmd txd/rxd/txq/rxq configurable in guest 53/5953/5
pmikus [Thu, 30 Mar 2017 12:19:34 +0000 (14:19 +0200)]
Make testpmd txd/rxd/txq/rxq configurable in guest

- Add option to configure vring qsz for testpmd when
  running in guest [make 256 as default]
- Add option to configure number of queues for testpmd when
  running in guest [make 1 as default]

Change-Id: I4ecd24ba4a24d6d212b10cd6d24f5b016fb63fd9
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 94/5994/2
Jan Gelety [Mon, 3 Apr 2017 07:22:23 +0000 (09:22 +0200)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.07-rc0~43-g8db1de8~b2146_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/24/

Change-Id: I7adc74b684fda2a16fb1edc673fb83c9c0ec13bf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoInstall screen on Phy DUTs 93/5993/2
pmikus [Mon, 3 Apr 2017 06:50:50 +0000 (08:50 +0200)]
Install screen on Phy DUTs

DPDK-perf testing requires screen to installed on Phy DUTs.

Change-Id: I68edf5e1d7d75f40d34161b4e394a1e229d9f1fd
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUT 53/5853/10
Jan Gelety [Fri, 24 Mar 2017 12:10:03 +0000 (13:10 +0100)]
CSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUT

 - 10ge2p1x520-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I9dc6888d5b94922835fa0fcae2b0763b3a1fa9a3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: revert to using restconf over http 85/5985/2
selias [Fri, 31 Mar 2017 09:47:53 +0000 (11:47 +0200)]
HC Test: revert to using restconf over http

 - use http instead of https for restconf connection
 - add missing import to proxyARP robot library
 - use VAT interface dump to identify interfaces in VAT ip address dump

Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpgrade T-rex to v2.22 46/5946/2
pmikus [Thu, 30 Mar 2017 09:22:38 +0000 (11:22 +0200)]
Upgrade T-rex to v2.22

Change-Id: I2029ba77a1c3c9ba6e128f816a353769a2cd5c8e
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: SPAN Port Mirroring Suite 39/5839/7
jan.hradil [Thu, 23 Mar 2017 12:16:18 +0000 (13:16 +0100)]
HC Test: SPAN Port Mirroring Suite

Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
7 years agoHC Test: address and cleanup test failures 88/5888/5
selias [Fri, 24 Mar 2017 16:35:30 +0000 (17:35 +0100)]
HC Test: address and cleanup test failures

Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-532 HC Test: IPv6 Neighbor Discovery proxy 54/5854/4
selias [Thu, 16 Mar 2017 14:28:59 +0000 (15:28 +0100)]
CSIT-532 HC Test: IPv6 Neighbor Discovery proxy

Change-Id: I6495726a814e116191f7a183be71c661466e7053
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: support testing using ipv6 management interface and https 69/5769/5
selias [Tue, 14 Mar 2017 11:00:01 +0000 (12:00 +0100)]
HC Test: support testing using ipv6 management interface and https

Change-Id: Ia38388a87171ad3bec7307f9ca74eaa99adc2624
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-526 HC test: DHCP relay 06/5806/5
selias [Fri, 17 Mar 2017 13:44:27 +0000 (14:44 +0100)]
CSIT-526 HC test: DHCP relay

Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate: NDRCHK rate values and typos 44/5944/2
pmikus [Thu, 30 Mar 2017 07:33:34 +0000 (09:33 +0200)]
Update: NDRCHK rate values and typos

Change-Id: I6c8c4f73cb69f53e0ad3ac96a566c4a6272b6d17
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoFix: Naming of perf suites following conventions 41/5941/2
pmikus [Thu, 30 Mar 2017 05:42:40 +0000 (07:42 +0200)]
Fix: Naming of perf suites following conventions

Change-Id: I39c3b6b1555a165f2103068a5296d92e0210f221
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-548: Add x520 IP4base perf test with 2 VMs per DUT 10/5810/21
Jan Gelety [Tue, 21 Mar 2017 12:46:05 +0000 (13:46 +0100)]
CSIT-548: Add x520 IP4base perf test with 2 VMs per DUT

 - 10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I3f978914e11308898f3281183687b1a0f6c74ed2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoVirl test: dot1q ip4base 57/4957/18
Matej Klotton [Tue, 31 Jan 2017 13:56:40 +0000 (14:56 +0100)]
Virl test: dot1q ip4base

Change-Id: I070bdbb0ea9cb609cb367ad744f7ad569b7115b9
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoUse "No VPP PID found on node X" when vpp pid is not returned 97/5897/1
Jan Gelety [Tue, 28 Mar 2017 16:20:52 +0000 (18:20 +0200)]
Use "No VPP PID found on node X" when vpp pid is not returned

Change-Id: Idfe6d674355bf57fdc24219cdaf8664ec23dfce9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-547: Add x520 L2BD perf test with 2 VMs per DUT 33/5733/32
Jan Gelety [Mon, 13 Mar 2017 08:08:56 +0000 (09:08 +0100)]
CSIT-547: Add x520 L2BD perf test with 2 VMs per DUT

 - 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc

Change-Id: If65a7cf21d1dbff88f39f319877d9ac1fc5d959e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: Update VIRL image version used 51/5851/1
selias [Fri, 24 Mar 2017 12:15:42 +0000 (13:15 +0100)]
HC Test: Update VIRL image version used

Change-Id: I984a4ce0f8eb49dd3d8d076944e106db4564d467
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 36/5836/1
Jan Gelety [Thu, 23 Mar 2017 08:21:14 +0000 (09:21 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~473-g1bfb0dd~b2099_amd64

- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/21/

Change-Id: I7e128372a9014b5a5e0e432b79fef3dffd409094
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: update URL paths 84/5784/5
selias [Tue, 14 Mar 2017 16:47:07 +0000 (17:47 +0100)]
HC Test: update URL paths

 - needed due to model split https://gerrit.fd.io/r/5706

Change-Id: I6179eae7c5cb5d13fbec6510821556c1ed424c3a
Signed-off-by: selias <samelias@cisco.com>
7 years agoDon't use dpdk dev packages - semiweekly job 72/5772/8
Jan Gelety [Thu, 16 Mar 2017 12:55:25 +0000 (13:55 +0100)]
Don't use dpdk dev packages - semiweekly job

 - remove donwload and installation of DPDK development packages

 - keep download and installation of vpp-dpdk-dkms deb package
   that contains igb_uio driver needed for e.g. cryptodev tests

Change-Id: Ic31a998fe7338c897570c121e04eaf9f9b6de980
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-536 HC Test: support testing with ODL client 88/5688/10
selias [Tue, 7 Mar 2017 14:42:02 +0000 (15:42 +0100)]
CSIT-536 HC Test: support testing with ODL client

Reuses existing restconf test cases to test Honeycomb's netconf interface.
When seding the requests to ODL's Honeycomb mountpoint, ODL translates these
requests to netconf RPCs.

Add new tag "honeycomb_odl" that excludes incompatible test cases.

Change-Id: Ie293449da0129b02db85e30aa4f3266928d7d9f6
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-528 HC Test: proxyARP test suite 10/5710/3
selias [Fri, 10 Mar 2017 17:14:48 +0000 (18:14 +0100)]
CSIT-528 HC Test: proxyARP test suite

Change-Id: I1f99d38aadee22a7354a1f89e9d7f395a401c96c
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 66/5766/2
Jan Gelety [Thu, 16 Mar 2017 08:19:43 +0000 (09:19 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~432-g1c82cd4~b2058_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/17/

Change-Id: I42075d0619eb6007d6e2550b5a42b2a2a985534e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agofix typo in VAT template interface_vrf_dump 29/5729/2
selias [Mon, 13 Mar 2017 12:44:00 +0000 (13:44 +0100)]
fix typo in VAT template interface_vrf_dump

Change-Id: I6ca224a664a8e00f91f7b7d826036c74def8fac9
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: update URL paths for vpp-acl 73/5673/3
selias [Tue, 7 Mar 2017 16:45:16 +0000 (17:45 +0100)]
HC Test: update URL paths for vpp-acl

 - needed due to v3po model split https://gerrit.fd.io/r/5530

Change-Id: I8a82c22f1999e81e3bb19b287be3cf3c01b50333
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-523 HC Test: routing 96/5496/8
selias [Wed, 8 Feb 2017 10:17:16 +0000 (11:17 +0100)]
CSIT-523 HC Test: routing

 - add routing test suite, variables and keywords

Change-Id: I57e180350c30221befe8d1fc4e3b146d394c4f5d
Signed-off-by: selias <samelias@cisco.com>
7 years agoFix: Perf-bootstrap delete install_dir if exists 37/5737/4
pmikus [Tue, 14 Mar 2017 08:35:00 +0000 (09:35 +0100)]
Fix: Perf-bootstrap delete install_dir if exists

Change-Id: Ib34c6144c0c97265a490bc6703b62cee670759c7
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: add test for vlan sub-interface ipv6 address 04/5704/4
selias [Fri, 10 Mar 2017 12:06:19 +0000 (13:06 +0100)]
HC Test: add test for vlan sub-interface ipv6 address

Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: add test for vlan sub-interface exact tag match 65/5665/2
selias [Wed, 8 Mar 2017 09:15:52 +0000 (10:15 +0100)]
HC Test: add test for vlan sub-interface exact tag match

Change-Id: Ie5feb1ac6c46f447a20d388680fc19854f2c7ef6
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 26/5726/1
Jan Gelety [Mon, 13 Mar 2017 08:10:34 +0000 (09:10 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~418-g374e2c5~b2044_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-weekly/6/

Change-Id: I33d7846534f28e91979b20ddff117cb41c1e1394
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: create Vlan sub-interface using netconf 35/5535/2
selias [Mon, 27 Feb 2017 12:56:22 +0000 (13:56 +0100)]
HC Test: create Vlan sub-interface using netconf

 - add netconf test for specific issue HC2VPP-60

Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232
Signed-off-by: selias <samelias@cisco.com>
7 years agoSPAN test - improvement of packet check 07/4807/13
Jan Gelety [Fri, 20 Jan 2017 16:17:43 +0000 (17:17 +0100)]
SPAN test - improvement of packet check

Change-Id: Ic95fbe288495ee4cd75178d74c220f6af5d2b11a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-530: Add common setup and teardown to perf tests 74/5474/14
Tibor Frank [Wed, 22 Feb 2017 08:06:27 +0000 (09:06 +0100)]
CSIT-530: Add common setup and teardown to perf tests

Change-Id: I2e76de710b4b758eac1d24d447a9c5938f937385
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 26/5626/1
Jan Gelety [Mon, 6 Mar 2017 09:29:20 +0000 (10:29 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~353-g6f6f52a~b1979_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/5/

Change-Id: I0b3a2be26a263f61f150e85d3b484984fa6539b3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoChange DPDK Stable version 69/5569/1
Matej Klotton [Wed, 1 Mar 2017 14:34:37 +0000 (15:34 +0100)]
Change DPDK Stable version

Change-Id: I5e0f0e40226d059c65b084886e37c68d56ea271f
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoUse common files to store distro related data for VIRL 37/5537/4
Jan Gelety [Mon, 27 Feb 2017 14:05:42 +0000 (15:05 +0100)]
Use common files to store distro related data for VIRL

- use separate files to store VIRL topology file and VIRL image file
  version information per distro

- read content of appropriate files in all affected bootstrap files

Change-Id: I5297ddd610af6a719efaf5792ced12efab35fc7a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoRemove unused VRF paramter from IP neighbour Add/del 23/5523/6
Neale Ranns [Sat, 25 Feb 2017 14:23:37 +0000 (14:23 +0000)]
Remove unused VRF paramter from IP neighbour Add/del

Change-Id: I4a348c696e4cacbf5aa0723f2b8070bbcce7666c
Signed-off-by: Neale Ranns <nranns@cisco.com>
7 years agoHC Test: Add missing VAT template - interface vrf dump 55/5555/1
selias [Tue, 28 Feb 2017 15:28:25 +0000 (16:28 +0100)]
HC Test: Add missing VAT template - interface vrf dump

Change-Id: I5bf26d4091b86cb8e4f4efa4eb4a4793c758ebbb
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: update plugin-ACL tests 47/5447/4
selias [Tue, 21 Feb 2017 10:51:01 +0000 (11:51 +0100)]
HC Test: update plugin-ACL tests

 - improve packet trace logging after each test
 - suppress IPv6RA on VPP because it interfered with ipv6 test cases
 - do not use fictional destination MAC address, doesn't work in VIRL
 - ignore errors when logging configuration - should not fail the test

Change-Id: I16a3321670d4c2fa8f6434dc4badd243b7e4f9fc
Signed-off-by: selias <samelias@cisco.com>
7 years agoAdd libpcap-dev package as dependency on physical TB 07/5507/2
pmikus [Fri, 24 Feb 2017 06:54:59 +0000 (07:54 +0100)]
Add libpcap-dev package as dependency on physical TB

Due to adding pypcap into pip requirement for VIRL we need to add
libpcap-dev package on physical TB

Change-Id: I5a86f7104111d016f1fa941b382de13383dbd064
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-339: Add Keywords for SMT 22/5122/7
Tibor Frank [Tue, 14 Feb 2017 13:09:11 +0000 (14:09 +0100)]
CSIT-339: Add Keywords for SMT

- modify keywords in CpuUtils.py
- add RF keywords

Change-Id: I57230b3948254e8f149b2563a8e24e948bc2ec27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoAdd symlink to nodes on Virl 47/5147/5
Matej Klotton [Wed, 15 Feb 2017 16:01:59 +0000 (17:01 +0100)]
Add symlink to nodes on Virl

Change-Id: I3351787787419ef97897ad436cfb71c812af79ba
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoVIRL test: Dot1Q-L2BD-vhost_user test (CSIT-502) 52/4952/13
Matej Klotton [Mon, 30 Jan 2017 18:31:41 +0000 (19:31 +0100)]
VIRL test: Dot1Q-L2BD-vhost_user test (CSIT-502)

- Create test cases to test Dot1Q+L2BD+vhost_user IPv4 and IPv6
  scenarios

Change-Id: I0823e2d22a36fce236c037cfda27d588ebcd1cc5
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoCSIT-522 HC Test: tests for secondary IP address 14/5414/4
selias [Fri, 17 Feb 2017 10:59:15 +0000 (11:59 +0100)]
CSIT-522 HC Test: tests for secondary IP address

 - fix and update ipv4 and ipv6 tests
 - add tests for ipv6 neighbor and vrf-id
 - add tests for secondary IP address on ipv4, ipv6

Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f
Signed-off-by: selias <samelias@cisco.com>
7 years agoVIRL test: eth2p-ethip4-ip4base-eth-2vhost-1vm 91/4691/17
Matej Klotton [Mon, 16 Jan 2017 07:55:05 +0000 (08:55 +0100)]
VIRL test: eth2p-ethip4-ip4base-eth-2vhost-1vm

Change-Id: Icd21df2568df78f83f67d6ce36491afecb91d8f9
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoAdd pypcap python requirement 30/4930/27
Matej Klotton [Mon, 30 Jan 2017 11:36:34 +0000 (12:36 +0100)]
Add pypcap python requirement

Using pypcap's L2listen instead of standard AF_PACKET scapy can
see received Dot1Q tag.

Change-Id: Icb3dcb272a9611158a26a83fede7550bba3f367e
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoQemuUtil lib change to work with ubuntu and centos 11/5411/12
Matej Klotton [Fri, 17 Feb 2017 12:18:43 +0000 (13:18 +0100)]
QemuUtil lib change to work with ubuntu and centos

 - replace nc to socat for comunicating with qemu QGA
 - change disk type to use virtio driver
 - add check to bind only network interface for testpmd

Change-Id: I19ab16cbd8fec1ec78263ccfb1309a144e5af845
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoThe interface must be assigned to the VRF and then given a prefix 16/5416/3
Neale Ranns [Fri, 17 Feb 2017 21:09:54 +0000 (21:09 +0000)]
The interface must be assigned to the VRF and then given a prefix

Change-Id: I6a2fc503989576f806413ae98845e3e3676889b8
Signed-off-by: Neale Ranns <nranns@cisco.com>
7 years agoFix of centos bootstrap and dut_setup.sh 92/5092/18
Jan Gelety [Mon, 20 Feb 2017 18:25:30 +0000 (19:25 +0100)]
Fix of centos bootstrap and dut_setup.sh

Change-Id: I9fc3a74bf6356bdccee16c977df86567e91b4acf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoFix VPP install packages paths for semiweekly job 41/5441/2
Jan Gelety [Mon, 20 Feb 2017 18:25:30 +0000 (19:25 +0100)]
Fix VPP install packages paths for semiweekly job

Change-Id: Ifabd7dd00b53007202b593ac492c5f869aa8dab5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 25/5425/2
Jan Gelety [Mon, 20 Feb 2017 09:27:50 +0000 (10:27 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~270-g6e9cf3b~b1891_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/3/

Change-Id: I961c512a0e5b380c3e7d1dec52ba25e45432fa2d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: hc2vpp bootstrap script fix 26/5426/2
selias [Mon, 20 Feb 2017 09:49:01 +0000 (10:49 +0100)]
HC Test: hc2vpp bootstrap script fix

Trying to scp both *.deb and *.rpm packages in one command will
not work if only one of them exists.

Change-Id: I9692efff309eb7eac64dd45873ee455fbbb48a86
Signed-off-by: selias <samelias@cisco.com>
7 years agoImplement support of Centos7 for semiweekly job 41/5141/3
Jan Gelety [Wed, 15 Feb 2017 11:23:51 +0000 (12:23 +0100)]
Implement support of Centos7 for semiweekly job

- adapt bootstrap-vpp-verify-semiweekly.sh script to be able to
  run with Centos7 distro

- adapt script to download vpp pkgs to be able to download
  Centos7 release packages

- changes are needed for Jenkins job
  csit-vpp-verify-{branch}-centos7-semiweekly

Change-Id: Iddb5d2867b83615eeaaa1f08359138c31a3e5607
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: reorder commands in HC package download script 09/5409/1
selias [Fri, 17 Feb 2017 11:00:12 +0000 (12:00 +0100)]
HC Test: reorder commands in HC package download script

Change-Id: I5e1ca7619704758f44b51154be62e40dd27e3117
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: address job failures 39/5139/3
selias [Wed, 15 Feb 2017 09:36:14 +0000 (10:36 +0100)]
HC Test: address job failures

 - make HC package download script correctly use the OS variable
 - force HC restart after netconf suite, to clean up leftover interfaces
 - remove EXPECTED_FAILING tag from vhost-user suite, VPP bug was fixed
 - add EXPECTED_FAILING tag to reflexive test case of plugin-acl suite

Change-Id: Id56eb52a5e22718de31aa5bef27159a5a531b244
Signed-off-by: selias <samelias@cisco.com>
7 years agoFix ssh prompts for centos 55/5155/6
Matej Klotton [Thu, 16 Feb 2017 07:18:00 +0000 (08:18 +0100)]
Fix ssh prompts for centos

Change-Id: I864f97b4559fc1d692bfba80266150a3d06dd6bb
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoCSIT-514: Kill Qemu when it does not respond 27/4927/11
Tibor Frank [Mon, 30 Jan 2017 10:38:17 +0000 (11:38 +0100)]
CSIT-514: Kill Qemu when it does not respond

Change-Id: Id13c7fd51e693a273637c80cb35a159434be4826
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoFix Centos Virl deployment and image build want list 19/5119/3
Matej Klotton [Tue, 14 Feb 2017 06:45:01 +0000 (07:45 +0100)]
Fix Centos Virl deployment and image build want list

Change-Id: I65d54fff4f936444bed3382ee21a260cf718bafd
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoHC Test: ACL updates 13/4913/8
selias [Thu, 1 Dec 2016 09:11:53 +0000 (10:11 +0100)]
HC Test: ACL updates

 - update low level ACL based on yang model changes
 - remove ietf-ACL test suite and test data and keywords
 - add ACL-plugin test suite, test data and keywords

The ietf model of ACLs is no longer supported in Honeycomb. It has
been replaced by the ACL plugin.

Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: Update sNAT tests due to API changes 55/5055/2
selias [Tue, 7 Feb 2017 12:49:03 +0000 (13:49 +0100)]
HC Test: Update sNAT tests due to API changes

 - add protocol value to expected VAT data
 - add protocol value to snat_static_mapping_dump parser
 - add temp workaround for returned "error:misc" on Ubuntu14.04

Change-Id: I42776b62b04eac65d03dcae1ec6a386a765b2e52
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: Add temporary workaround for VAT issues on Ubuntu14.04 53/5053/4
selias [Tue, 7 Feb 2017 12:39:31 +0000 (13:39 +0100)]
HC Test: Add temporary workaround for VAT issues on Ubuntu14.04

Some VAT commands return "error:misc" in addition to their normal
JSON output. This causes the JSON parser to complain about extra data.

Change-Id: I0da9739f371998dd6e2e6d6f70c1e8a3d82b6350
Signed-off-by: selias <samelias@cisco.com>