csit.git
6 years agoAdd RA suppress to IPv6 Equal-cost multipath routing test case 59/6859/2 rls1704
Jan Gelety [Tue, 16 May 2017 14:03:52 +0000 (16:03 +0200)]
Add RA suppress to IPv6 Equal-cost multipath routing test case

Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 2900b5ab54b4c10e400369ef80f115f42baaa3da)

6 years agoCSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test cases 55/6855/1
Jan Gelety [Thu, 27 Apr 2017 12:12:10 +0000 (14:12 +0200)]
CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test cases

Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 631b366985355cbe41a243a87b06eda75cdd2c42)

6 years agoCSIT-577 HC Test: Scripts for test jobs using ODL client 57/6757/2
selias [Thu, 18 May 2017 09:56:52 +0000 (11:56 +0200)]
CSIT-577 HC Test: Scripts for test jobs using ODL client

ODL client can be used to translate Restconf requests into Netconf. This
way Honeycomb's Netconf interface can be tested using existing test cases.

 - add bootstrap scripts for verify and integration job
 - update __init__.robot to handle new {HC_ODL} variable

Change-Id: I410d3e56b8d4f18e672b4886f4f025456bf00655
Signed-off-by: selias <samelias@cisco.com>
6 years agocsit report - fixed table format in vpp_performance_tests/csit_release_notes.rst 33/6633/1
Maciek Konstantynowicz [Tue, 9 May 2017 15:49:12 +0000 (16:49 +0100)]
csit report - fixed table format in vpp_performance_tests/csit_release_notes.rst

Change-Id: Ie9d4a9ba373c0e6131f0a2d3e49f20a315da3b9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 49197759c5107700ce470202b3650e9eabde53c9)

7 years agoFunc vhost tests with needed changes in perf tests 16/6516/8
Jan Gelety [Fri, 28 Apr 2017 12:09:18 +0000 (14:09 +0200)]
Func vhost tests with needed changes in perf tests

Change-Id: I8c44448ca77f0fbd7ce074b8eef10b5ba491747d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoUpdate to csit rls1704 report - perf changes tables - based on increased number of... 84/6584/1
Maciek Konstantynowicz [Wed, 3 May 2017 13:20:43 +0000 (14:20 +0100)]
Update to csit rls1704 report - perf changes tables - based on increased number of test job executions.

Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit ab519403ae4b7c2db19d7199b4b7bee4df682f78)

7 years agoUpdates to csit rls1704 report related to increased number of test job executions. 81/6581/1
Maciek Konstantynowicz [Wed, 3 May 2017 12:17:42 +0000 (13:17 +0100)]
Updates to csit rls1704 report related to increased number of test job executions.

Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a6644da0fb0bcd9513995c5d2aecdefb4bbdaf25)

7 years agoFix Honeycomb source data path for report. 78/6578/1
Peter Mikus [Wed, 3 May 2017 07:23:00 +0000 (07:23 +0000)]
Fix Honeycomb source data path for report.

Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 56e9f4c10d975cf68972a1110d2fdf5b202acb9a)

7 years agoUpdate links with source data for rls report 74/6574/1
Peter Mikus [Wed, 3 May 2017 06:33:30 +0000 (08:33 +0200)]
Update links with source data for rls report

Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit ce400b20b0f95dd017060793ba26ff6cf66c13d5)

7 years agoUpdate data points for rls1704 report 70/6570/1
Peter Mikus [Wed, 3 May 2017 05:19:41 +0000 (07:19 +0200)]
Update data points for rls1704 report

Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoRevert "Vhost tests" 15/6515/2
Peter Mikus [Fri, 28 Apr 2017 10:22:31 +0000 (10:22 +0000)]
Revert "Vhost tests"

This reverts commit 955047a8483e6c795a561ecfb7f78d01885b1aa3.

Change-Id: I7b02bb249822b59dd47035700e02fc5f122ffac9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER_UBUNTU 12/6512/1
Peter Mikus [Fri, 28 Apr 2017 06:21:20 +0000 (08:21 +0200)]
Update of VPP_STABLE_VER_UBUNTU

Update of VPP_STABLE_VER_UBUNTU in rls1704

Change-Id: I0f2201463e28693d378a9e2c4f8d8243c8f3463c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agocsit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files. 11/6511/1
Maciek Konstantynowicz [Thu, 27 Apr 2017 12:35:33 +0000 (13:35 +0100)]
csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.

Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 years agocsit rls1704 report: final update to csit_release_notes.rst, packet_*_graphs.rst... 03/6503/2
Maciek Konstantynowicz [Thu, 27 Apr 2017 11:11:56 +0000 (12:11 +0100)]
csit rls1704 report: final update to csit_release_notes.rst, packet_*_graphs.rst files.

Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 years agoReport-gen update 02/6502/1
Peter Mikus [Thu, 27 Apr 2017 08:14:36 +0000 (10:14 +0200)]
Report-gen update

- fix header in IPsec sections
- fix IP4 regexp to include SNAT
- update source data for perf trending
- fix rendering of Trex section

Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agocsit rls1704 report: updates to csit_release_notes.rst files. 88/6488/1
Maciek Konstantynowicz [Thu, 27 Apr 2017 09:03:31 +0000 (10:03 +0100)]
csit rls1704 report: updates to csit_release_notes.rst files.

Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 38850b1710c99c2d981cd9ccd6a474c0a017b91f)

7 years agoupdate to csit rls1704 report: vpp_unittest_results.rst 78/6478/1
Maciek Konstantynowicz [Wed, 26 Apr 2017 20:43:00 +0000 (21:43 +0100)]
update to csit rls1704 report: vpp_unittest_results.rst

Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 43c34a7ba751495f2bc5f9d6eb9740dedd689f2b)

7 years agoCSIT rls1704 report - small updates 73/6473/1
Jan Gelety [Wed, 26 Apr 2017 15:17:02 +0000 (17:17 +0200)]
CSIT rls1704 report - small updates

Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 years agoEdits to csit rls1704 report: vpp_unit_tests sections. 70/6470/1
Maciek Konstantynowicz [Wed, 26 Apr 2017 13:25:06 +0000 (14:25 +0100)]
Edits to csit rls1704 report: vpp_unit_tests sections.

Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 647afd5d647dcc69d0cb04aa61d2a4d964f6bc6a)

7 years agoEdits to csit rls1704 report: csit_tag_description.rst. 69/6469/1
Maciek Konstantynowicz [Wed, 26 Apr 2017 13:42:41 +0000 (14:42 +0100)]
Edits to csit rls1704 report: csit_tag_description.rst.

Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 075acff52cbcb84456f93aad9e58aa3a82a9011b)

7 years agoCSIT rls1704 report - update of functional csit_release_notes.rst 68/6468/2
Jan Gelety [Wed, 26 Apr 2017 10:47:51 +0000 (12:47 +0200)]
CSIT rls1704 report - update of functional csit_release_notes.rst

Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT doc gen: Use html <pre> tag for data from teardown. 64/6464/2
Jan Gelety [Wed, 26 Apr 2017 12:49:17 +0000 (14:49 +0200)]
CSIT doc gen: Use html <pre> tag for data from teardown.

Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 66435e950bb418da98c4371a259fc4a19addda7e)

7 years agocsit rls1704 report - updated csit_release_notes.rst and overview.rst files. 67/6467/1
Maciek Konstantynowicz [Wed, 26 Apr 2017 11:37:26 +0000 (12:37 +0100)]
csit rls1704 report - updated csit_release_notes.rst and overview.rst files.

Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 years agoUpdate run_report.sh script for generating report 55/6455/1
Peter Mikus [Wed, 26 Apr 2017 11:32:53 +0000 (13:32 +0200)]
Update run_report.sh script for generating report

Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoVhost tests 24/6424/2
Matej Klotton [Mon, 20 Mar 2017 08:38:02 +0000 (09:38 +0100)]
Vhost tests

Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1
Signed-off-by: Matej Klotton <mklotton@cisco.com>
(cherry picked from commit 0fc813b1694a6ae70b759e7ca96741f21f81b051)

7 years agoCSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rst 42/6442/1
Jan Gelety [Tue, 25 Apr 2017 19:42:03 +0000 (21:42 +0200)]
CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rst

Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agorls1704 report - updated sections: 40/6440/1
Maciek Konstantynowicz [Tue, 25 Apr 2017 18:39:35 +0000 (19:39 +0100)]
rls1704 report - updated sections:
- vpp_performance_tests/overview.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/test_environment
- honeycomb_functional_tests/csit_release_notes

Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 years agoFix: CSIT report gen for policer 29/6429/1
Jan Gelety [Tue, 25 Apr 2017 16:17:41 +0000 (18:17 +0200)]
Fix: CSIT report gen for policer

Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT rls1704 report - update to handcrafted sections: 27/6427/1
Maciek Konstantynowicz [Fri, 21 Apr 2017 19:42:05 +0000 (20:42 +0100)]
CSIT rls1704 report - update to handcrafted sections:
- index.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/overview.rst
- vpp_performance_tests/packet_throughput_graphs/...
- testpmd_performance_tests/csit_release_notes.rst
- vpp_functional_tests/csit_release_notes.rst
- testpmd_performance_tests/packet_latency_graphs/...
- testpmd_performance_tests/packet_throughput_graphs/...

Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 02f2a2176ec92efdf63399fb7dba1eb586465f38)

7 years agoImprove doc in data driven perf tests 21/6421/1
Tibor Frank [Tue, 25 Apr 2017 08:44:33 +0000 (10:44 +0200)]
Improve doc in data driven perf tests

Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f496b8dd088f9ba89710b8b6f8d0fb380740458f)

7 years agoFix: CSIT report gen - teardown data + run_report.sh 20/6420/1
Jan Gelety [Tue, 25 Apr 2017 12:59:17 +0000 (14:59 +0200)]
Fix: CSIT report gen - teardown data + run_report.sh

Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT doc gen: Add configurations and operational data. 13/6413/1
Jan Gelety [Tue, 25 Apr 2017 07:53:19 +0000 (09:53 +0200)]
CSIT doc gen: Add configurations and operational data.

- vpp perf configurations and operational data
- vpp func configurations

Change-Id: I634682e55a2862b927546e2657aabb242c730be1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT doc gen: Script to get data from teardown. 11/6411/1
Jan Gelety [Thu, 20 Apr 2017 14:22:30 +0000 (16:22 +0200)]
CSIT doc gen: Script to get data from teardown.

- generate rst/html/md/wiki file with required data from teardown per TC
- implemented:
- VAT command history of all DUTs per TC
- ouptup of CLI command "Show Runtime" (VPP operational data)

Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 589601a406783d90ba0668428f1a96da1ec9fecb)

7 years ago1704 report - fix mistake in honeycomb section 09/6409/1
selias [Tue, 25 Apr 2017 10:23:09 +0000 (12:23 +0200)]
1704 report - fix mistake in honeycomb section

Change-Id: I6517ea48a6df95cc855596843d736658471486ea
Signed-off-by: selias <samelias@cisco.com>
7 years ago1704 Report - Honeycomb section 01/6401/1
selias [Tue, 25 Apr 2017 07:22:58 +0000 (09:22 +0200)]
1704 Report - Honeycomb section

Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: add expected_failing tag to "disable_lisp" case 97/6397/1
selias [Tue, 25 Apr 2017 07:42:41 +0000 (09:42 +0200)]
HC Test: add expected_failing tag to "disable_lisp" case

Change-Id: I614dea8d830e8bf97ac4b4ad24d21d3b707fae8a
Signed-off-by: selias <samelias@cisco.com>
7 years agoDownload the latest VPP build for *NIGHTLY and *DAILY jobs 78/6378/1
Tibor Frank [Mon, 24 Apr 2017 06:38:08 +0000 (08:38 +0200)]
Download the latest VPP build for *NIGHTLY and *DAILY jobs

Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e96838cfbc9a742a7c543a1b88a2d4d2eaf5d08b)

7 years agoFix: Report vhost and testpmd plots 73/6373/1
Peter Mikus [Mon, 24 Apr 2017 11:05:12 +0000 (13:05 +0200)]
Fix: Report vhost and testpmd plots

Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 77053a6017391491dcd3a41ca7a9451ab3d5944a)

7 years agoFix: Report generation 71/6371/1
Peter Mikus [Mon, 24 Apr 2017 08:56:32 +0000 (10:56 +0200)]
Fix: Report generation

- Add IPsec plots
- Fix plots rendering

Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoCSIT-554: Performance jobs reorganisation, part 4 64/6364/1
Tibor Frank [Thu, 20 Apr 2017 13:10:52 +0000 (15:10 +0200)]
CSIT-554: Performance jobs reorganisation, part 4

Add:
 - vpp-csit-verify-hw-perf

Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bc26996dcd0e92af29e5208cbcecd8d347cf1210)

7 years agoCSIT-557: Performance jobs reorganisation, part 3 63/6363/1
Tibor Frank [Wed, 19 Apr 2017 13:29:51 +0000 (15:29 +0200)]
CSIT-557: Performance jobs reorganisation, part 3

Add:
 - csit-vpp-perf-verify

Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7a52c16bc35b6abfd0cfacbc6be79b38ee467367)

7 years agoFix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdisc 61/6361/1
Peter Mikus [Mon, 24 Apr 2017 05:21:43 +0000 (07:21 +0200)]
Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdisc

- Fix missing keyword

Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 3305d93551d0cc861558da09a26c8103453d9d6c)

7 years agoFix typo in run_report 56/6356/1
Peter Mikus [Sat, 22 Apr 2017 05:21:28 +0000 (07:21 +0200)]
Fix typo in run_report

Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 4f569f553c9cd30922292b644f4c2bab40e9dd5c)

7 years agoFix LISPGPE+IPSEC after cherry picks 55/6355/2
Peter Mikus [Sun, 23 Apr 2017 14:01:30 +0000 (14:01 +0000)]
Fix LISPGPE+IPSEC after cherry picks

Change-Id: Iacf4412f97092faf791854afb7fb726838febb2b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 years agoFix run_report.sh 52/6352/1
Peter Mikus [Sat, 22 Apr 2017 05:00:28 +0000 (07:00 +0200)]
Fix run_report.sh

- fix sed delimiter to eliminate /

Change-Id: I4d6253d7845937ee452da342819d1c390ca28054
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 00a0cdaeb8cd186f5bd0f7ead5b60c6d49a4929f)

7 years agoReport generation script updates 50/6350/1
pmikus [Thu, 13 Apr 2017 20:06:17 +0000 (22:06 +0200)]
Report generation script updates

- Add new type of throughput plots
- Update Sphinx, Sphinx-rtd-theme and Plotly packages
- Add auto generation of detailed test results
- Small fixes

Change-Id: I706777160a7f166e0a335c64428d10cb546fa854
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 5b702673375a2a098311c23ab83487d3e1e02e72)

7 years agoAdded Ethernet frame size tags for performance tests: 44/6344/1
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:04:40 +0000 (12:04 +0100)]
Added Ethernet frame size tags for performance tests:
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B.

Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 years agotag_documentation.rst - added: 43/6343/1
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:15:15 +0000 (12:15 +0100)]
tag_documentation.rst - added:
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B.

Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 60ea1ed962e27f0043509747407a61ec817d4760)

7 years agotag_documentation.rst - added: Ethernet frame size tags for performance tests 42/6342/1
Maciek Konstantynowicz [Fri, 21 Apr 2017 09:25:35 +0000 (10:25 +0100)]
tag_documentation.rst - added: Ethernet frame size tags for performance tests

Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2c1706d69455d8479b0b0318d4c2fa8b4ab806cb)

7 years agoCSIT rls1704 report - update to handcraftec sections: 36/6336/1
Maciek Konstantynowicz [Thu, 20 Apr 2017 21:42:01 +0000 (22:42 +0100)]
CSIT rls1704 report - update to handcraftec sections:

- introduction /overview /general_notes /csit_test_naming
- vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs
- vpp_functional_tests /overview /csit_release_notes /documentation
- testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs

Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 5d294b7d4c501d971d67c4e3fe192a9dc504d76e)

7 years agoCSIT-561: Add release and version to the header 20/6320/1
Tibor Frank [Fri, 21 Apr 2017 07:54:07 +0000 (09:54 +0200)]
CSIT-561: Add release and version to the header

Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bc2036f4ce9b8aa705161ee1c8566b134fc6570c)

7 years agoHC Test: update persistence suite 99/6299/1
selias [Tue, 18 Apr 2017 10:01:27 +0000 (12:01 +0200)]
HC Test: update persistence suite

 - fix "enable persistence" is suite setup
 - update Jira links to persistence bug
 - log content of persistence file before each restart

Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7
Signed-off-by: selias <samelias@cisco.com>
(cherry picked from commit 6a4018c9d8b356bc55af135d68803a08729d0ae1)

7 years agoCSIT-561: Add filtering of testsuits to report generation 70/6270/1
Tibor Frank [Wed, 19 Apr 2017 12:13:24 +0000 (14:13 +0200)]
CSIT-561: Add filtering of testsuits to report generation

Change-Id: I751600f7ea9937bc8bfde7d6062eeaadf3ee68dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c46911d3ee7b11af9b88cf235ce06f8fb24554fc)

7 years agoCSIT-559: Performance jobs reorganisation, part 3 69/6269/1
Tibor Frank [Tue, 18 Apr 2017 10:56:31 +0000 (12:56 +0200)]
CSIT-559: Performance jobs reorganisation, part 3

Add:
 - csit-vpp-perf-ndrchk-daily

Change-Id: I4edfa86810744168307d9cbeb979d40dc5e21eb0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 25b577d61445aa0607725a0172b72b5c01582b73)

7 years agoCSIT-558: Performance jobs reorganization, part 2 68/6268/1
Tibor Frank [Wed, 12 Apr 2017 14:10:45 +0000 (16:10 +0200)]
CSIT-558: Performance jobs reorganization, part 2

Add:
 - csit-vpp-perf-check

Change-Id: I31e40d37e38d27d3be15a40f6044ce5d907067be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 47a843ce28984d752dff064afb78c91f18741611)

7 years agoUse QEMU virtio queue size 1024 for perf tests 59/6259/1
Jan Gelety [Thu, 13 Apr 2017 15:01:13 +0000 (17:01 +0200)]
Use QEMU virtio queue size 1024 for perf tests

- use Build QEMU KW to apply patch to increase default virtio queue size
- remove Set Scheduler Policy

Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoFix: IPSec+Lisp suite naming 52/6252/1
Peter Mikus [Wed, 19 Apr 2017 06:05:50 +0000 (08:05 +0200)]
Fix: IPSec+Lisp suite naming

Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 0284cfd6ae5dbd98e94d457b444746ed828b3901)

7 years agoCSIT-531: Performance jobs reorganization, part 1 50/6250/2
Tibor Frank [Tue, 11 Apr 2017 09:26:17 +0000 (11:26 +0200)]
CSIT-531: Performance jobs reorganization, part 1

Add:
 - csit-vpp-perf-trend-daily
 - csit-vpp-perf-trend-semiweekly

Change-Id: I59ed581f9fb2457cf1e3a58bac625f3b807d653f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 65765ab9f038aed6729fd436e6af6d3ca339e0d8)

7 years agoCSIT-560: csit src code doc generation for 1704 49/6249/1
Tibor Frank [Tue, 18 Apr 2017 12:54:10 +0000 (14:54 +0200)]
CSIT-560: csit src code doc generation for 1704

Change-Id: I9f07f326e12942404d670004bb9463039967f954
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 38ac6262bcd8dcf2d9a600188c7adb5989ff86b8)

7 years agoRemove the tag THIS from SNAT perf tests 28/6228/1
Tibor Frank [Tue, 18 Apr 2017 11:24:57 +0000 (13:24 +0200)]
Remove the tag THIS from SNAT perf tests

Change-Id: I54ac114b72763bbf1d2dd57956c0a6f99af82da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 928c10f757eeb9df8eb78c6c4ad026b62f792962)

7 years agoCSIT-545: Performance tests for SNAT 26/6226/1
Tibor Frank [Mon, 13 Mar 2017 12:22:08 +0000 (13:22 +0100)]
CSIT-545: Performance tests for SNAT

- High level definition (HLD)
- Low level definition (LLD)
- Add keywords to set SNAT
- Add tests according to HLD, LLD

Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoHC Test: update honeycomb package download scripts 92/6192/1
selias [Wed, 12 Apr 2017 16:40:11 +0000 (18:40 +0200)]
HC Test: update honeycomb package download scripts

 - add "_amd64" to version parameter for .deb packages
 - install only vpp-api-java on maven build slave

Change-Id: Ie61974c3c2806d1d3e0281bd0b5149f1b0d1443d
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdated of DPDK stable version. 73/6173/1
Jan Gelety [Wed, 12 Apr 2017 16:03:10 +0000 (18:03 +0200)]
Updated of DPDK stable version.

Change-Id: Id122bda1489dab763d58cf0b31f222af16ee2651
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoSettings of URLs and VPP builds for branch rls1704 71/6171/1
Jan Gelety [Wed, 12 Apr 2017 15:41:07 +0000 (17:41 +0200)]
Settings of URLs and VPP builds for branch rls1704

Change-Id: I6b3dc77c1a064f015e934e537728d6678ae1cfc0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-544 HC Test: adapt package download script to changes in hc2vpp 48/6048/7
selias [Wed, 5 Apr 2017 09:54:06 +0000 (11:54 +0200)]
CSIT-544 HC Test: adapt package download script to changes in hc2vpp

Required after https://gerrit.fd.io/r/5908
hc2vpp packages to be published with a specific VPP version dependency.

Change-Id: I9a31a83ec033a01556b4afd8575d8ccae4139b7f
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: update URL paths with ODL mountpoint 57/6157/1
selias [Wed, 12 Apr 2017 09:08:47 +0000 (11:08 +0200)]
HC Test: update URL paths with ODL mountpoint

other minor fixes:
- update teardown keyword in proxyARP suite
- increase timeout for SLAAC traffic test

Change-Id: Ia16d096c54ceac501a24d5d910dd18e33d900d2a
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-529 HC Test: SLAAC 43/6043/13
jan.hradil [Thu, 30 Mar 2017 07:55:30 +0000 (09:55 +0200)]
CSIT-529 HC Test: SLAAC

Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
7 years agoDon't use dpdk dev packages - weekly, func and perf jobs 10/6110/2
Jan Gelety [Mon, 10 Apr 2017 07:44:49 +0000 (09:44 +0200)]
Don't use dpdk dev packages - weekly, func and perf jobs

 - remove donwload and installation of DPDK development packages

 - keep download and installation of vpp-dpdk-dkms deb package
   that contains igb_uio driver needed for e.g. cryptodev tests

Change-Id: I3d87fa1cd1efaad522f47df0e71a4885466a14c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: Fix proxyARP test teardown 72/6072/2
selias [Thu, 6 Apr 2017 14:14:39 +0000 (16:14 +0200)]
HC Test: Fix proxyARP test teardown

 - interface assignment is removed automatically with proxyARP settings

Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER_UBUNTU 11/6111/1
Jan Gelety [Mon, 10 Apr 2017 07:49:31 +0000 (09:49 +0200)]
Update of VPP_STABLE_VER_UBUNTU

- use new vpp ref build: 17.07-rc0~81-gd927834~b2184_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/26/

Change-Id: I96684c6b17a4bb64b4070e440150ff4cac9a57a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoIPsec Multi-Tunnel performance test suite 54/4454/96
Kirill Rybalchenko [Wed, 21 Dec 2016 12:16:29 +0000 (12:16 +0000)]
IPsec Multi-Tunnel performance test suite

Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566
Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
7 years agoCSIT-441 vhost - Parametrized qemu install 16/5916/7
pmikus [Wed, 29 Mar 2017 14:51:34 +0000 (16:51 +0200)]
CSIT-441 vhost - Parametrized qemu install

Update the current QEMU installation script with option to override QEMU
installation and to apply additional patches. Additional patches are
applied from qemu_patches directory and subdir for specific QEMU version by
run-parts. This means that all patches for particular version are
applied.
All keywords for build QEMU are updated.

Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-553 Make QEMU bin configurable 40/6040/3
pmikus [Wed, 5 Apr 2017 07:35:05 +0000 (09:35 +0200)]
CSIT-553 Make QEMU bin configurable

Add option to set path for QEMU binary and make it configurable in perf
testaces as global variable.

Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: update ACL-plugil test suite 61/6061/2
selias [Wed, 5 Apr 2017 15:47:13 +0000 (17:47 +0200)]
HC Test: update ACL-plugil test suite

 - add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not
 hit the classify node
 - fix MAC address mixup in reflexive cases

Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-552: Add xl710 perf test with 2 VMs per DUT 94/5894/8
Jan Gelety [Tue, 28 Mar 2017 14:17:53 +0000 (16:17 +0200)]
CSIT-552: Add xl710 perf test with 2 VMs per DUT

    - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc
    - 40ge2p1xl710-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc
    - 40ge2p1xl710-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I2d2f8e9b8966bd6e19014cf7a234c3c02bb9251c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoUpdate topology files after HW changes 66/6066/2
pmikus [Thu, 6 Apr 2017 04:56:09 +0000 (06:56 +0200)]
Update topology files after HW changes

Adding Intel QAT crypto card caused changes in PCI adresses

Change-Id: Ifeaa0dba87d0c1b3436d303e63dd2ff284526dd1
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoApply performance options for testpmd 06/6006/6
pmikus [Mon, 3 Apr 2017 10:34:32 +0000 (12:34 +0200)]
Apply performance options for testpmd

- Add parameters to increase the performance of SUTs

Change-Id: Ia9c5d76639bd931d8113c26e18861648de395322
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER_CENTOS 95/5995/3
Jan Gelety [Mon, 3 Apr 2017 07:26:22 +0000 (09:26 +0200)]
Update of VPP_STABLE_VER_CENTOS

- use new vpp ref build: 17.07-rc0~43_g8db1de8~b2144.x86_64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/24/

Change-Id: I6d84f139f3d513010481a7cf7d287836f779dfd4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoAdd x710 and xl710 tests for testpmd 98/5098/22
Tibor Frank [Fri, 10 Feb 2017 08:24:00 +0000 (09:24 +0100)]
Add x710 and xl710 tests for testpmd

10ge2p1x710-eth-l2xcbase-ndrdisc
40ge2p1xl710-eth-l2xcbase-ndrdisc

Change-Id: Iea411182fd41e1ae9ed9b5a17f540befc247adb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoHC Test: fix restconf binding configuration 02/6002/2
selias [Mon, 3 Apr 2017 09:03:24 +0000 (11:03 +0200)]
HC Test: fix restconf binding configuration

Change-Id: I7f0872cee5b49e64912b97cee99c859d921b68e1
Signed-off-by: selias <samelias@cisco.com>
7 years agoMake testpmd txd/rxd/txq/rxq configurable in guest 53/5953/5
pmikus [Thu, 30 Mar 2017 12:19:34 +0000 (14:19 +0200)]
Make testpmd txd/rxd/txq/rxq configurable in guest

- Add option to configure vring qsz for testpmd when
  running in guest [make 256 as default]
- Add option to configure number of queues for testpmd when
  running in guest [make 1 as default]

Change-Id: I4ecd24ba4a24d6d212b10cd6d24f5b016fb63fd9
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 94/5994/2
Jan Gelety [Mon, 3 Apr 2017 07:22:23 +0000 (09:22 +0200)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.07-rc0~43-g8db1de8~b2146_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/24/

Change-Id: I7adc74b684fda2a16fb1edc673fb83c9c0ec13bf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoInstall screen on Phy DUTs 93/5993/2
pmikus [Mon, 3 Apr 2017 06:50:50 +0000 (08:50 +0200)]
Install screen on Phy DUTs

DPDK-perf testing requires screen to installed on Phy DUTs.

Change-Id: I68edf5e1d7d75f40d34161b4e394a1e229d9f1fd
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUT 53/5853/10
Jan Gelety [Fri, 24 Mar 2017 12:10:03 +0000 (13:10 +0100)]
CSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUT

 - 10ge2p1x520-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I9dc6888d5b94922835fa0fcae2b0763b3a1fa9a3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: revert to using restconf over http 85/5985/2
selias [Fri, 31 Mar 2017 09:47:53 +0000 (11:47 +0200)]
HC Test: revert to using restconf over http

 - use http instead of https for restconf connection
 - add missing import to proxyARP robot library
 - use VAT interface dump to identify interfaces in VAT ip address dump

Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpgrade T-rex to v2.22 46/5946/2
pmikus [Thu, 30 Mar 2017 09:22:38 +0000 (11:22 +0200)]
Upgrade T-rex to v2.22

Change-Id: I2029ba77a1c3c9ba6e128f816a353769a2cd5c8e
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoHC Test: SPAN Port Mirroring Suite 39/5839/7
jan.hradil [Thu, 23 Mar 2017 12:16:18 +0000 (13:16 +0100)]
HC Test: SPAN Port Mirroring Suite

Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
7 years agoHC Test: address and cleanup test failures 88/5888/5
selias [Fri, 24 Mar 2017 16:35:30 +0000 (17:35 +0100)]
HC Test: address and cleanup test failures

Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-532 HC Test: IPv6 Neighbor Discovery proxy 54/5854/4
selias [Thu, 16 Mar 2017 14:28:59 +0000 (15:28 +0100)]
CSIT-532 HC Test: IPv6 Neighbor Discovery proxy

Change-Id: I6495726a814e116191f7a183be71c661466e7053
Signed-off-by: selias <samelias@cisco.com>
7 years agoHC Test: support testing using ipv6 management interface and https 69/5769/5
selias [Tue, 14 Mar 2017 11:00:01 +0000 (12:00 +0100)]
HC Test: support testing using ipv6 management interface and https

Change-Id: Ia38388a87171ad3bec7307f9ca74eaa99adc2624
Signed-off-by: selias <samelias@cisco.com>
7 years agoCSIT-526 HC test: DHCP relay 06/5806/5
selias [Fri, 17 Mar 2017 13:44:27 +0000 (14:44 +0100)]
CSIT-526 HC test: DHCP relay

Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate: NDRCHK rate values and typos 44/5944/2
pmikus [Thu, 30 Mar 2017 07:33:34 +0000 (09:33 +0200)]
Update: NDRCHK rate values and typos

Change-Id: I6c8c4f73cb69f53e0ad3ac96a566c4a6272b6d17
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoFix: Naming of perf suites following conventions 41/5941/2
pmikus [Thu, 30 Mar 2017 05:42:40 +0000 (07:42 +0200)]
Fix: Naming of perf suites following conventions

Change-Id: I39c3b6b1555a165f2103068a5296d92e0210f221
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoCSIT-548: Add x520 IP4base perf test with 2 VMs per DUT 10/5810/21
Jan Gelety [Tue, 21 Mar 2017 12:46:05 +0000 (13:46 +0100)]
CSIT-548: Add x520 IP4base perf test with 2 VMs per DUT

 - 10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I3f978914e11308898f3281183687b1a0f6c74ed2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoVirl test: dot1q ip4base 57/4957/18
Matej Klotton [Tue, 31 Jan 2017 13:56:40 +0000 (14:56 +0100)]
Virl test: dot1q ip4base

Change-Id: I070bdbb0ea9cb609cb367ad744f7ad569b7115b9
Signed-off-by: Matej Klotton <mklotton@cisco.com>
7 years agoUse "No VPP PID found on node X" when vpp pid is not returned 97/5897/1
Jan Gelety [Tue, 28 Mar 2017 16:20:52 +0000 (18:20 +0200)]
Use "No VPP PID found on node X" when vpp pid is not returned

Change-Id: Idfe6d674355bf57fdc24219cdaf8664ec23dfce9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoCSIT-547: Add x520 L2BD perf test with 2 VMs per DUT 33/5733/32
Jan Gelety [Mon, 13 Mar 2017 08:08:56 +0000 (09:08 +0100)]
CSIT-547: Add x520 L2BD perf test with 2 VMs per DUT

 - 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc

Change-Id: If65a7cf21d1dbff88f39f319877d9ac1fc5d959e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: Update VIRL image version used 51/5851/1
selias [Fri, 24 Mar 2017 12:15:42 +0000 (13:15 +0100)]
HC Test: Update VIRL image version used

Change-Id: I984a4ce0f8eb49dd3d8d076944e106db4564d467
Signed-off-by: selias <samelias@cisco.com>
7 years agoUpdate of VPP_STABLE_VER 36/5836/1
Jan Gelety [Thu, 23 Mar 2017 08:21:14 +0000 (09:21 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build: 17.04-rc0~473-g1bfb0dd~b2099_amd64

- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/21/

Change-Id: I7e128372a9014b5a5e0e432b79fef3dffd409094
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoHC Test: update URL paths 84/5784/5
selias [Tue, 14 Mar 2017 16:47:07 +0000 (17:47 +0100)]
HC Test: update URL paths

 - needed due to model split https://gerrit.fd.io/r/5706

Change-Id: I6179eae7c5cb5d13fbec6510821556c1ed424c3a
Signed-off-by: selias <samelias@cisco.com>