csit.git
7 years agoUpdate run_report.sh script for generating report 55/6455/1
Peter Mikus [Wed, 26 Apr 2017 11:32:53 +0000 (13:32 +0200)]
Update run_report.sh script for generating report

Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoVhost tests 24/6424/2
Matej Klotton [Mon, 20 Mar 2017 08:38:02 +0000 (09:38 +0100)]
Vhost tests

Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1
Signed-off-by: Matej Klotton <mklotton@cisco.com>
(cherry picked from commit 0fc813b1694a6ae70b759e7ca96741f21f81b051)

7 years agoCSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rst 42/6442/1
Jan Gelety [Tue, 25 Apr 2017 19:42:03 +0000 (21:42 +0200)]
CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rst

Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agorls1704 report - updated sections: 40/6440/1
Maciek Konstantynowicz [Tue, 25 Apr 2017 18:39:35 +0000 (19:39 +0100)]
rls1704 report - updated sections:
- vpp_performance_tests/overview.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/test_environment
- honeycomb_functional_tests/csit_release_notes

Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 years agoFix: CSIT report gen for policer 29/6429/1
Jan Gelety [Tue, 25 Apr 2017 16:17:41 +0000 (18:17 +0200)]
Fix: CSIT report gen for policer

Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT rls1704 report - update to handcrafted sections: 27/6427/1
Maciek Konstantynowicz [Fri, 21 Apr 2017 19:42:05 +0000 (20:42 +0100)]
CSIT rls1704 report - update to handcrafted sections:
- index.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/overview.rst
- vpp_performance_tests/packet_throughput_graphs/...
- testpmd_performance_tests/csit_release_notes.rst
- vpp_functional_tests/csit_release_notes.rst
- testpmd_performance_tests/packet_latency_graphs/...
- testpmd_performance_tests/packet_throughput_graphs/...

Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 02f2a2176ec92efdf63399fb7dba1eb586465f38)

7 years agoImprove doc in data driven perf tests 21/6421/1
Tibor Frank [Tue, 25 Apr 2017 08:44:33 +0000 (10:44 +0200)]
Improve doc in data driven perf tests

Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f496b8dd088f9ba89710b8b6f8d0fb380740458f)

7 years agoFix: CSIT report gen - teardown data + run_report.sh 20/6420/1
Jan Gelety [Tue, 25 Apr 2017 12:59:17 +0000 (14:59 +0200)]
Fix: CSIT report gen - teardown data + run_report.sh

Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT doc gen: Add configurations and operational data. 13/6413/1
Jan Gelety [Tue, 25 Apr 2017 07:53:19 +0000 (09:53 +0200)]
CSIT doc gen: Add configurations and operational data.

- vpp perf configurations and operational data
- vpp func configurations

Change-Id: I634682e55a2862b927546e2657aabb242c730be1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT doc gen: Script to get data from teardown. 11/6411/1
Jan Gelety [Thu, 20 Apr 2017 14:22:30 +0000 (16:22 +0200)]
CSIT doc gen: Script to get data from teardown.

- generate rst/html/md/wiki file with required data from teardown per TC
- implemented:
- VAT command history of all DUTs per TC
- ouptup of CLI command "Show Runtime" (VPP operational data)

Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 589601a406783d90ba0668428f1a96da1ec9fecb)

7 years ago1704 report - fix mistake in honeycomb section 09/6409/1
selias [Tue, 25 Apr 2017 10:23:09 +0000 (12:23 +0200)]
1704 report - fix mistake in honeycomb section

Change-Id: I6517ea48a6df95cc855596843d736658471486ea
Signed-off-by: selias <samelias@cisco.com>
7 years ago1704 Report - Honeycomb section 01/6401/1
selias [Tue, 25 Apr 2017 07:22:58 +0000 (09:22 +0200)]
1704 Report - Honeycomb section

Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: add expected_failing tag to "disable_lisp" case 97/6397/1
selias [Tue, 25 Apr 2017 07:42:41 +0000 (09:42 +0200)]
HC Test: add expected_failing tag to "disable_lisp" case

Change-Id: I614dea8d830e8bf97ac4b4ad24d21d3b707fae8a
Signed-off-by: selias <samelias@cisco.com>
7 years agoDownload the latest VPP build for *NIGHTLY and *DAILY jobs 78/6378/1
Tibor Frank [Mon, 24 Apr 2017 06:38:08 +0000 (08:38 +0200)]
Download the latest VPP build for *NIGHTLY and *DAILY jobs

Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e96838cfbc9a742a7c543a1b88a2d4d2eaf5d08b)

7 years agoFix: Report vhost and testpmd plots 73/6373/1
Peter Mikus [Mon, 24 Apr 2017 11:05:12 +0000 (13:05 +0200)]
Fix: Report vhost and testpmd plots

Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 77053a6017391491dcd3a41ca7a9451ab3d5944a)

7 years agoFix: Report generation 71/6371/1
Peter Mikus [Mon, 24 Apr 2017 08:56:32 +0000 (10:56 +0200)]
Fix: Report generation

- Add IPsec plots
- Fix plots rendering

Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoCSIT-554: Performance jobs reorganisation, part 4 64/6364/1
Tibor Frank [Thu, 20 Apr 2017 13:10:52 +0000 (15:10 +0200)]
CSIT-554: Performance jobs reorganisation, part 4

Add:
 - vpp-csit-verify-hw-perf

Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bc26996dcd0e92af29e5208cbcecd8d347cf1210)

7 years agoCSIT-557: Performance jobs reorganisation, part 3 63/6363/1
Tibor Frank [Wed, 19 Apr 2017 13:29:51 +0000 (15:29 +0200)]
CSIT-557: Performance jobs reorganisation, part 3

Add:
 - csit-vpp-perf-verify

Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7a52c16bc35b6abfd0cfacbc6be79b38ee467367)

7 years agoFix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdisc 61/6361/1
Peter Mikus [Mon, 24 Apr 2017 05:21:43 +0000 (07:21 +0200)]
Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdisc

- Fix missing keyword

Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 3305d93551d0cc861558da09a26c8103453d9d6c)

7 years agoFix typo in run_report 56/6356/1
Peter Mikus [Sat, 22 Apr 2017 05:21:28 +0000 (07:21 +0200)]
Fix typo in run_report

Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 4f569f553c9cd30922292b644f4c2bab40e9dd5c)

7 years agoFix LISPGPE+IPSEC after cherry picks 55/6355/2
Peter Mikus [Sun, 23 Apr 2017 14:01:30 +0000 (14:01 +0000)]
Fix LISPGPE+IPSEC after cherry picks

Change-Id: Iacf4412f97092faf791854afb7fb726838febb2b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoFix run_report.sh 52/6352/1
Peter Mikus [Sat, 22 Apr 2017 05:00:28 +0000 (07:00 +0200)]
Fix run_report.sh

- fix sed delimiter to eliminate /

Change-Id: I4d6253d7845937ee452da342819d1c390ca28054
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 00a0cdaeb8cd186f5bd0f7ead5b60c6d49a4929f)

7 years agoReport generation script updates 50/6350/1
pmikus [Thu, 13 Apr 2017 20:06:17 +0000 (22:06 +0200)]
Report generation script updates

- Add new type of throughput plots
- Update Sphinx, Sphinx-rtd-theme and Plotly packages
- Add auto generation of detailed test results
- Small fixes

Change-Id: I706777160a7f166e0a335c64428d10cb546fa854
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 5b702673375a2a098311c23ab83487d3e1e02e72)

7 years agoAdded Ethernet frame size tags for performance tests: 44/6344/1
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:04:40 +0000 (12:04 +0100)]
Added Ethernet frame size tags for performance tests:
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B.

Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 years agotag_documentation.rst - added: 43/6343/1
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:15:15 +0000 (12:15 +0100)]
tag_documentation.rst - added:
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B.

Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 60ea1ed962e27f0043509747407a61ec817d4760)

7 years agotag_documentation.rst - added: Ethernet frame size tags for performance tests 42/6342/1
Maciek Konstantynowicz [Fri, 21 Apr 2017 09:25:35 +0000 (10:25 +0100)]
tag_documentation.rst - added: Ethernet frame size tags for performance tests

Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2c1706d69455d8479b0b0318d4c2fa8b4ab806cb)

7 years agoCSIT rls1704 report - update to handcraftec sections: 36/6336/1
Maciek Konstantynowicz [Thu, 20 Apr 2017 21:42:01 +0000 (22:42 +0100)]
CSIT rls1704 report - update to handcraftec sections:

- introduction /overview /general_notes /csit_test_naming
- vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs
- vpp_functional_tests /overview /csit_release_notes /documentation
- testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs

Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 5d294b7d4c501d971d67c4e3fe192a9dc504d76e)

7 years agoCSIT-561: Add release and version to the header 20/6320/1
Tibor Frank [Fri, 21 Apr 2017 07:54:07 +0000 (09:54 +0200)]
CSIT-561: Add release and version to the header

Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bc2036f4ce9b8aa705161ee1c8566b134fc6570c)

7 years agoHC Test: update persistence suite 99/6299/1
selias [Tue, 18 Apr 2017 10:01:27 +0000 (12:01 +0200)]
HC Test: update persistence suite

 - fix "enable persistence" is suite setup
 - update Jira links to persistence bug
 - log content of persistence file before each restart

Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7
Signed-off-by: selias <samelias@cisco.com>
(cherry picked from commit 6a4018c9d8b356bc55af135d68803a08729d0ae1)

7 years agoCSIT-561: Add filtering of testsuits to report generation 70/6270/1
Tibor Frank [Wed, 19 Apr 2017 12:13:24 +0000 (14:13 +0200)]
CSIT-561: Add filtering of testsuits to report generation

Change-Id: I751600f7ea9937bc8bfde7d6062eeaadf3ee68dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c46911d3ee7b11af9b88cf235ce06f8fb24554fc)

7 years agoCSIT-559: Performance jobs reorganisation, part 3 69/6269/1
Tibor Frank [Tue, 18 Apr 2017 10:56:31 +0000 (12:56 +0200)]
CSIT-559: Performance jobs reorganisation, part 3

Add:
 - csit-vpp-perf-ndrchk-daily

Change-Id: I4edfa86810744168307d9cbeb979d40dc5e21eb0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 25b577d61445aa0607725a0172b72b5c01582b73)

7 years agoCSIT-558: Performance jobs reorganization, part 2 68/6268/1
Tibor Frank [Wed, 12 Apr 2017 14:10:45 +0000 (16:10 +0200)]
CSIT-558: Performance jobs reorganization, part 2

Add:
 - csit-vpp-perf-check

Change-Id: I31e40d37e38d27d3be15a40f6044ce5d907067be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 47a843ce28984d752dff064afb78c91f18741611)

7 years agoUse QEMU virtio queue size 1024 for perf tests 59/6259/1
Jan Gelety [Thu, 13 Apr 2017 15:01:13 +0000 (17:01 +0200)]
Use QEMU virtio queue size 1024 for perf tests

- use Build QEMU KW to apply patch to increase default virtio queue size
- remove Set Scheduler Policy

Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoFix: IPSec+Lisp suite naming 52/6252/1
Peter Mikus [Wed, 19 Apr 2017 06:05:50 +0000 (08:05 +0200)]
Fix: IPSec+Lisp suite naming

Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 0284cfd6ae5dbd98e94d457b444746ed828b3901)

7 years agoCSIT-531: Performance jobs reorganization, part 1 50/6250/2
Tibor Frank [Tue, 11 Apr 2017 09:26:17 +0000 (11:26 +0200)]
CSIT-531: Performance jobs reorganization, part 1

Add:
 - csit-vpp-perf-trend-daily
 - csit-vpp-perf-trend-semiweekly

Change-Id: I59ed581f9fb2457cf1e3a58bac625f3b807d653f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 65765ab9f038aed6729fd436e6af6d3ca339e0d8)

7 years agoCSIT-560: csit src code doc generation for 1704 49/6249/1
Tibor Frank [Tue, 18 Apr 2017 12:54:10 +0000 (14:54 +0200)]
CSIT-560: csit src code doc generation for 1704

Change-Id: I9f07f326e12942404d670004bb9463039967f954
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 38ac6262bcd8dcf2d9a600188c7adb5989ff86b8)

7 years agoRemove the tag THIS from SNAT perf tests 28/6228/1
Tibor Frank [Tue, 18 Apr 2017 11:24:57 +0000 (13:24 +0200)]
Remove the tag THIS from SNAT perf tests

Change-Id: I54ac114b72763bbf1d2dd57956c0a6f99af82da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 928c10f757eeb9df8eb78c6c4ad026b62f792962)

7 years agoCSIT-545: Performance tests for SNAT 26/6226/1
Tibor Frank [Mon, 13 Mar 2017 12:22:08 +0000 (13:22 +0100)]
CSIT-545: Performance tests for SNAT

- High level definition (HLD)
- Low level definition (LLD)
- Add keywords to set SNAT
- Add tests according to HLD, LLD

Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoHC Test: update honeycomb package download scripts 92/6192/1
selias [Wed, 12 Apr 2017 16:40:11 +0000 (18:40 +0200)]
HC Test: update honeycomb package download scripts

 - add "_amd64" to version parameter for .deb packages
 - install only vpp-api-java on maven build slave

Change-Id: Ie61974c3c2806d1d3e0281bd0b5149f1b0d1443d
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdated of DPDK stable version. 73/6173/1
Jan Gelety [Wed, 12 Apr 2017 16:03:10 +0000 (18:03 +0200)]
Updated of DPDK stable version.

Change-Id: Id122bda1489dab763d58cf0b31f222af16ee2651
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoSettings of URLs and VPP builds for branch rls1704 71/6171/1
Jan Gelety [Wed, 12 Apr 2017 15:41:07 +0000 (17:41 +0200)]
Settings of URLs and VPP builds for branch rls1704

Change-Id: I6b3dc77c1a064f015e934e537728d6678ae1cfc0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-544 HC Test: adapt package download script to changes in hc2vpp 48/6048/7
selias [Wed, 5 Apr 2017 09:54:06 +0000 (11:54 +0200)]
CSIT-544 HC Test: adapt package download script to changes in hc2vpp

Required after https://gerrit.fd.io/r/5908
hc2vpp packages to be published with a specific VPP version dependency.

Change-Id: I9a31a83ec033a01556b4afd8575d8ccae4139b7f
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: update URL paths with ODL mountpoint 57/6157/1
selias [Wed, 12 Apr 2017 09:08:47 +0000 (11:08 +0200)]
HC Test: update URL paths with ODL mountpoint

other minor fixes:
- update teardown keyword in proxyARP suite
- increase timeout for SLAAC traffic test

Change-Id: Ia16d096c54ceac501a24d5d910dd18e33d900d2a
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-529 HC Test: SLAAC 43/6043/13
jan.hradil [Thu, 30 Mar 2017 07:55:30 +0000 (09:55 +0200)]
CSIT-529 HC Test: SLAAC

Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
7 years agoDon't use dpdk dev packages - weekly, func and perf jobs 10/6110/2
Jan Gelety [Mon, 10 Apr 2017 07:44:49 +0000 (09:44 +0200)]
Don't use dpdk dev packages - weekly, func and perf jobs

 - remove donwload and installation of DPDK development packages

 - keep download and installation of vpp-dpdk-dkms deb package
   that contains igb_uio driver needed for e.g. cryptodev tests

Change-Id: I3d87fa1cd1efaad522f47df0e71a4885466a14c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: Fix proxyARP test teardown 72/6072/2
selias [Thu, 6 Apr 2017 14:14:39 +0000 (16:14 +0200)]
HC Test: Fix proxyARP test teardown

 - interface assignment is removed automatically with proxyARP settings

Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER_UBUNTU 11/6111/1
Jan Gelety [Mon, 10 Apr 2017 07:49:31 +0000 (09:49 +0200)]
Update of VPP_STABLE_VER_UBUNTU

- use new vpp ref build: 17.07-rc0~81-gd927834~b2184_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/26/

Change-Id: I96684c6b17a4bb64b4070e440150ff4cac9a57a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoIPsec Multi-Tunnel performance test suite 54/4454/96
Kirill Rybalchenko [Wed, 21 Dec 2016 12:16:29 +0000 (12:16 +0000)]
IPsec Multi-Tunnel performance test suite

Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566
Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
7 years agoCSIT-441 vhost - Parametrized qemu install 16/5916/7
pmikus [Wed, 29 Mar 2017 14:51:34 +0000 (16:51 +0200)]
CSIT-441 vhost - Parametrized qemu install

Update the current QEMU installation script with option to override QEMU
installation and to apply additional patches. Additional patches are
applied from qemu_patches directory and subdir for specific QEMU version by
run-parts. This means that all patches for particular version are
applied.
All keywords for build QEMU are updated.

Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-553 Make QEMU bin configurable 40/6040/3
pmikus [Wed, 5 Apr 2017 07:35:05 +0000 (09:35 +0200)]
CSIT-553 Make QEMU bin configurable

Add option to set path for QEMU binary and make it configurable in perf
testaces as global variable.

Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: update ACL-plugil test suite 61/6061/2
selias [Wed, 5 Apr 2017 15:47:13 +0000 (17:47 +0200)]
HC Test: update ACL-plugil test suite

 - add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not
 hit the classify node
 - fix MAC address mixup in reflexive cases

Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-552: Add xl710 perf test with 2 VMs per DUT 94/5894/8
Jan Gelety [Tue, 28 Mar 2017 14:17:53 +0000 (16:17 +0200)]
CSIT-552: Add xl710 perf test with 2 VMs per DUT

    - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc
    - 40ge2p1xl710-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc
    - 40ge2p1xl710-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I2d2f8e9b8966bd6e19014cf7a234c3c02bb9251c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoUpdate topology files after HW changes 66/6066/2
pmikus [Thu, 6 Apr 2017 04:56:09 +0000 (06:56 +0200)]
Update topology files after HW changes

Adding Intel QAT crypto card caused changes in PCI adresses

Change-Id: Ifeaa0dba87d0c1b3436d303e63dd2ff284526dd1
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoApply performance options for testpmd 06/6006/6
pmikus [Mon, 3 Apr 2017 10:34:32 +0000 (12:34 +0200)]
Apply performance options for testpmd

- Add parameters to increase the performance of SUTs

Change-Id: Ia9c5d76639bd931d8113c26e18861648de395322
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER_CENTOS 95/5995/3
Jan Gelety [Mon, 3 Apr 2017 07:26:22 +0000 (09:26 +0200)]
Update of VPP_STABLE_VER_CENTOS

- use new vpp ref build: 17.07-rc0~43_g8db1de8~b2144.x86_64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/24/

Change-Id: I6d84f139f3d513010481a7cf7d287836f779dfd4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoAdd x710 and xl710 tests for testpmd 98/5098/22
Tibor Frank [Fri, 10 Feb 2017 08:24:00 +0000 (09:24 +0100)]
Add x710 and xl710 tests for testpmd

10ge2p1x710-eth-l2xcbase-ndrdisc
40ge2p1xl710-eth-l2xcbase-ndrdisc

Change-Id: Iea411182fd41e1ae9ed9b5a17f540befc247adb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoHC Test: fix restconf binding configuration 02/6002/2
selias [Mon, 3 Apr 2017 09:03:24 +0000 (11:03 +0200)]
HC Test: fix restconf binding configuration

Change-Id: I7f0872cee5b49e64912b97cee99c859d921b68e1
Signed-off-by: selias <samelias@cisco.com>
7 years agoMake testpmd txd/rxd/txq/rxq configurable in guest 53/5953/5
pmikus [Thu, 30 Mar 2017 12:19:34 +0000 (14:19 +0200)]
Make testpmd txd/rxd/txq/rxq configurable in guest

- Add option to configure vring qsz for testpmd when
  running in guest [make 256 as default]
- Add option to configure number of queues for testpmd when
  running in guest [make 1 as default]

Change-Id: I4ecd24ba4a24d6d212b10cd6d24f5b016fb63fd9
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 94/5994/2
Jan Gelety [Mon, 3 Apr 2017 07:22:23 +0000 (09:22 +0200)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.07-rc0~43-g8db1de8~b2146_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/24/

Change-Id: I7adc74b684fda2a16fb1edc673fb83c9c0ec13bf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoInstall screen on Phy DUTs 93/5993/2
pmikus [Mon, 3 Apr 2017 06:50:50 +0000 (08:50 +0200)]
Install screen on Phy DUTs

DPDK-perf testing requires screen to installed on Phy DUTs.

Change-Id: I68edf5e1d7d75f40d34161b4e394a1e229d9f1fd
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUT 53/5853/10
Jan Gelety [Fri, 24 Mar 2017 12:10:03 +0000 (13:10 +0100)]
CSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUT

 - 10ge2p1x520-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I9dc6888d5b94922835fa0fcae2b0763b3a1fa9a3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: revert to using restconf over http 85/5985/2
selias [Fri, 31 Mar 2017 09:47:53 +0000 (11:47 +0200)]
HC Test: revert to using restconf over http

 - use http instead of https for restconf connection
 - add missing import to proxyARP robot library
 - use VAT interface dump to identify interfaces in VAT ip address dump

Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpgrade T-rex to v2.22 46/5946/2
pmikus [Thu, 30 Mar 2017 09:22:38 +0000 (11:22 +0200)]
Upgrade T-rex to v2.22

Change-Id: I2029ba77a1c3c9ba6e128f816a353769a2cd5c8e
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: SPAN Port Mirroring Suite 39/5839/7
jan.hradil [Thu, 23 Mar 2017 12:16:18 +0000 (13:16 +0100)]
HC Test: SPAN Port Mirroring Suite

Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
7 years agoHC Test: address and cleanup test failures 88/5888/5
selias [Fri, 24 Mar 2017 16:35:30 +0000 (17:35 +0100)]
HC Test: address and cleanup test failures

Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-532 HC Test: IPv6 Neighbor Discovery proxy 54/5854/4
selias [Thu, 16 Mar 2017 14:28:59 +0000 (15:28 +0100)]
CSIT-532 HC Test: IPv6 Neighbor Discovery proxy

Change-Id: I6495726a814e116191f7a183be71c661466e7053
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: support testing using ipv6 management interface and https 69/5769/5
selias [Tue, 14 Mar 2017 11:00:01 +0000 (12:00 +0100)]
HC Test: support testing using ipv6 management interface and https

Change-Id: Ia38388a87171ad3bec7307f9ca74eaa99adc2624
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-526 HC test: DHCP relay 06/5806/5
selias [Fri, 17 Mar 2017 13:44:27 +0000 (14:44 +0100)]
CSIT-526 HC test: DHCP relay

Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate: NDRCHK rate values and typos 44/5944/2
pmikus [Thu, 30 Mar 2017 07:33:34 +0000 (09:33 +0200)]
Update: NDRCHK rate values and typos

Change-Id: I6c8c4f73cb69f53e0ad3ac96a566c4a6272b6d17
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoFix: Naming of perf suites following conventions 41/5941/2
pmikus [Thu, 30 Mar 2017 05:42:40 +0000 (07:42 +0200)]
Fix: Naming of perf suites following conventions

Change-Id: I39c3b6b1555a165f2103068a5296d92e0210f221
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-548: Add x520 IP4base perf test with 2 VMs per DUT 10/5810/21
Jan Gelety [Tue, 21 Mar 2017 12:46:05 +0000 (13:46 +0100)]
CSIT-548: Add x520 IP4base perf test with 2 VMs per DUT

 - 10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I3f978914e11308898f3281183687b1a0f6c74ed2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoVirl test: dot1q ip4base 57/4957/18
Matej Klotton [Tue, 31 Jan 2017 13:56:40 +0000 (14:56 +0100)]
Virl test: dot1q ip4base

Change-Id: I070bdbb0ea9cb609cb367ad744f7ad569b7115b9
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoUse "No VPP PID found on node X" when vpp pid is not returned 97/5897/1
Jan Gelety [Tue, 28 Mar 2017 16:20:52 +0000 (18:20 +0200)]
Use "No VPP PID found on node X" when vpp pid is not returned

Change-Id: Idfe6d674355bf57fdc24219cdaf8664ec23dfce9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-547: Add x520 L2BD perf test with 2 VMs per DUT 33/5733/32
Jan Gelety [Mon, 13 Mar 2017 08:08:56 +0000 (09:08 +0100)]
CSIT-547: Add x520 L2BD perf test with 2 VMs per DUT

 - 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc

Change-Id: If65a7cf21d1dbff88f39f319877d9ac1fc5d959e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: Update VIRL image version used 51/5851/1
selias [Fri, 24 Mar 2017 12:15:42 +0000 (13:15 +0100)]
HC Test: Update VIRL image version used

Change-Id: I984a4ce0f8eb49dd3d8d076944e106db4564d467
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 36/5836/1
Jan Gelety [Thu, 23 Mar 2017 08:21:14 +0000 (09:21 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~473-g1bfb0dd~b2099_amd64

- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/21/

Change-Id: I7e128372a9014b5a5e0e432b79fef3dffd409094
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: update URL paths 84/5784/5
selias [Tue, 14 Mar 2017 16:47:07 +0000 (17:47 +0100)]
HC Test: update URL paths

 - needed due to model split https://gerrit.fd.io/r/5706

Change-Id: I6179eae7c5cb5d13fbec6510821556c1ed424c3a
Signed-off-by: selias <samelias@cisco.com>
7 years agoDon't use dpdk dev packages - semiweekly job 72/5772/8
Jan Gelety [Thu, 16 Mar 2017 12:55:25 +0000 (13:55 +0100)]
Don't use dpdk dev packages - semiweekly job

 - remove donwload and installation of DPDK development packages

 - keep download and installation of vpp-dpdk-dkms deb package
   that contains igb_uio driver needed for e.g. cryptodev tests

Change-Id: Ic31a998fe7338c897570c121e04eaf9f9b6de980
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-536 HC Test: support testing with ODL client 88/5688/10
selias [Tue, 7 Mar 2017 14:42:02 +0000 (15:42 +0100)]
CSIT-536 HC Test: support testing with ODL client

Reuses existing restconf test cases to test Honeycomb's netconf interface.
When seding the requests to ODL's Honeycomb mountpoint, ODL translates these
requests to netconf RPCs.

Add new tag "honeycomb_odl" that excludes incompatible test cases.

Change-Id: Ie293449da0129b02db85e30aa4f3266928d7d9f6
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-528 HC Test: proxyARP test suite 10/5710/3
selias [Fri, 10 Mar 2017 17:14:48 +0000 (18:14 +0100)]
CSIT-528 HC Test: proxyARP test suite

Change-Id: I1f99d38aadee22a7354a1f89e9d7f395a401c96c
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 66/5766/2
Jan Gelety [Thu, 16 Mar 2017 08:19:43 +0000 (09:19 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~432-g1c82cd4~b2058_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/17/

Change-Id: I42075d0619eb6007d6e2550b5a42b2a2a985534e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agofix typo in VAT template interface_vrf_dump 29/5729/2
selias [Mon, 13 Mar 2017 12:44:00 +0000 (13:44 +0100)]
fix typo in VAT template interface_vrf_dump

Change-Id: I6ca224a664a8e00f91f7b7d826036c74def8fac9
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: update URL paths for vpp-acl 73/5673/3
selias [Tue, 7 Mar 2017 16:45:16 +0000 (17:45 +0100)]
HC Test: update URL paths for vpp-acl

 - needed due to v3po model split https://gerrit.fd.io/r/5530

Change-Id: I8a82c22f1999e81e3bb19b287be3cf3c01b50333
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-523 HC Test: routing 96/5496/8
selias [Wed, 8 Feb 2017 10:17:16 +0000 (11:17 +0100)]
CSIT-523 HC Test: routing

 - add routing test suite, variables and keywords

Change-Id: I57e180350c30221befe8d1fc4e3b146d394c4f5d
Signed-off-by: selias <samelias@cisco.com>
7 years agoFix: Perf-bootstrap delete install_dir if exists 37/5737/4
pmikus [Tue, 14 Mar 2017 08:35:00 +0000 (09:35 +0100)]
Fix: Perf-bootstrap delete install_dir if exists

Change-Id: Ib34c6144c0c97265a490bc6703b62cee670759c7
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: add test for vlan sub-interface ipv6 address 04/5704/4
selias [Fri, 10 Mar 2017 12:06:19 +0000 (13:06 +0100)]
HC Test: add test for vlan sub-interface ipv6 address

Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: add test for vlan sub-interface exact tag match 65/5665/2
selias [Wed, 8 Mar 2017 09:15:52 +0000 (10:15 +0100)]
HC Test: add test for vlan sub-interface exact tag match

Change-Id: Ie5feb1ac6c46f447a20d388680fc19854f2c7ef6
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 26/5726/1
Jan Gelety [Mon, 13 Mar 2017 08:10:34 +0000 (09:10 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~418-g374e2c5~b2044_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-weekly/6/

Change-Id: I33d7846534f28e91979b20ddff117cb41c1e1394
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: create Vlan sub-interface using netconf 35/5535/2
selias [Mon, 27 Feb 2017 12:56:22 +0000 (13:56 +0100)]
HC Test: create Vlan sub-interface using netconf

 - add netconf test for specific issue HC2VPP-60

Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232
Signed-off-by: selias <samelias@cisco.com>
7 years agoSPAN test - improvement of packet check 07/4807/13
Jan Gelety [Fri, 20 Jan 2017 16:17:43 +0000 (17:17 +0100)]
SPAN test - improvement of packet check

Change-Id: Ic95fbe288495ee4cd75178d74c220f6af5d2b11a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-530: Add common setup and teardown to perf tests 74/5474/14
Tibor Frank [Wed, 22 Feb 2017 08:06:27 +0000 (09:06 +0100)]
CSIT-530: Add common setup and teardown to perf tests

Change-Id: I2e76de710b4b758eac1d24d447a9c5938f937385
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 26/5626/1
Jan Gelety [Mon, 6 Mar 2017 09:29:20 +0000 (10:29 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~353-g6f6f52a~b1979_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/5/

Change-Id: I0b3a2be26a263f61f150e85d3b484984fa6539b3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoChange DPDK Stable version 69/5569/1
Matej Klotton [Wed, 1 Mar 2017 14:34:37 +0000 (15:34 +0100)]
Change DPDK Stable version

Change-Id: I5e0f0e40226d059c65b084886e37c68d56ea271f
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoUse common files to store distro related data for VIRL 37/5537/4
Jan Gelety [Mon, 27 Feb 2017 14:05:42 +0000 (15:05 +0100)]
Use common files to store distro related data for VIRL

- use separate files to store VIRL topology file and VIRL image file
  version information per distro

- read content of appropriate files in all affected bootstrap files

Change-Id: I5297ddd610af6a719efaf5792ced12efab35fc7a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoRemove unused VRF paramter from IP neighbour Add/del 23/5523/6
Neale Ranns [Sat, 25 Feb 2017 14:23:37 +0000 (14:23 +0000)]
Remove unused VRF paramter from IP neighbour Add/del

Change-Id: I4a348c696e4cacbf5aa0723f2b8070bbcce7666c
Signed-off-by: Neale Ranns <nranns@cisco.com>
7 years agoHC Test: Add missing VAT template - interface vrf dump 55/5555/1
selias [Tue, 28 Feb 2017 15:28:25 +0000 (16:28 +0100)]
HC Test: Add missing VAT template - interface vrf dump

Change-Id: I5bf26d4091b86cb8e4f4efa4eb4a4793c758ebbb
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: update plugin-ACL tests 47/5447/4
selias [Tue, 21 Feb 2017 10:51:01 +0000 (11:51 +0100)]
HC Test: update plugin-ACL tests

 - improve packet trace logging after each test
 - suppress IPv6RA on VPP because it interfered with ipv6 test cases
 - do not use fictional destination MAC address, doesn't work in VIRL
 - ignore errors when logging configuration - should not fail the test

Change-Id: I16a3321670d4c2fa8f6434dc4badd243b7e4f9fc
Signed-off-by: selias <samelias@cisco.com>
7 years agoAdd libpcap-dev package as dependency on physical TB 07/5507/2
pmikus [Fri, 24 Feb 2017 06:54:59 +0000 (07:54 +0100)]
Add libpcap-dev package as dependency on physical TB

Due to adding pypcap into pip requirement for VIRL we need to add
libpcap-dev package on physical TB

Change-Id: I5a86f7104111d016f1fa941b382de13383dbd064
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-339: Add Keywords for SMT 22/5122/7
Tibor Frank [Tue, 14 Feb 2017 13:09:11 +0000 (14:09 +0100)]
CSIT-339: Add Keywords for SMT

- modify keywords in CpuUtils.py
- add RF keywords

Change-Id: I57230b3948254e8f149b2563a8e24e948bc2ec27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoAdd symlink to nodes on Virl 47/5147/5
Matej Klotton [Wed, 15 Feb 2017 16:01:59 +0000 (17:01 +0100)]
Add symlink to nodes on Virl

Change-Id: I3351787787419ef97897ad436cfb71c812af79ba
Signed-off-by: Matej Klotton <mklotton@cisco.com>