Peter Mikus [Fri, 12 May 2017 06:38:51 +0000 (08:38 +0200)]
Fix start-testcase script on VIRL
- Fix pylint errors
- Add expiry option to set expiration of simulation
- Add more sanitization of exceptions
- Fix printing of debug messages to stderr
Change-Id: Iecc1fe042b6da104a164fb5701e665b6f3aa298b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Fri, 5 May 2017 14:26:41 +0000 (16:26 +0200)]
Func test reorg - decrease exec time per vpp patch
- remove tests covered by make test
- remove some negative tests
Change-Id: I35d641562ee85888f7d1dd60dd892689b1e9c52d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
selias [Thu, 11 May 2017 16:02:03 +0000 (18:02 +0200)]
CSIT-576 HC Test: Improve SPAN test coverage
- add test for multiple destination interfaces using one source interface
- duplicate all existing cases using a sub-interface as the destination
Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3
Signed-off-by: selias <samelias@cisco.com>
selias [Wed, 10 May 2017 15:41:11 +0000 (17:41 +0200)]
CSIT-577 HC Test: Scripts for test jobs using ODL client
ODL client can be used to translate Restconf requests into Netconf. This
way Honeycomb's Netconf interface can be tested using existing test cases.
- add bootstrap scripts for verify and integration job
- update __init__.robot to handle new {HC_ODL} variable
Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86
Signed-off-by: selias <samelias@cisco.com>
selias [Tue, 9 May 2017 10:38:35 +0000 (12:38 +0200)]
CSIT-562 HC Test: Persistence suite rework, part1
- rename keywords that check operational data, to distinguish from keywords
that check configuration data
- modify existing persistence cases so that they don't affect each other
- add feature-specific persistence tests for: Interface Management, L2 bridge
- move Interface Management variables to separate file so they can be reused
- add new tag HC_PERSIST to execute persistence tests separately
- update existing Honeycomb tags to comply with CSIT conventions
More feature-specific tests to be added in part2.
Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef
Signed-off-by: selias <samelias@cisco.com>
jan.hradil [Thu, 27 Apr 2017 10:07:59 +0000 (12:07 +0200)]
CSIT-563: HC Test: improved Lisp test coverage
added TC09-TC14 with following features:
Map Resolver
Map Server
PETR configuration
RLOC Probing
Map Register
Map Request mode
Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Tue, 16 May 2017 08:21:51 +0000 (10:21 +0200)]
Fix: use pci/rescan to avoid occasional bind issue on Centos7
- rarelly binding of one of TG interfaces fails with "No such
device" error; usage of rescan should avoid such situations
Change-Id: Icbeb48ea6f8adb863e6517d4a35d6aca4238309a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 16 May 2017 14:03:52 +0000 (16:03 +0200)]
Add RA suppress to IPv6 Equal-cost multipath routing test case
Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 16 May 2017 12:48:47 +0000 (14:48 +0200)]
Fix typo in weekly bootstrap file
Change-Id: I2dc221c433ba87d0f98082c0c3aef2df838cd750
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 16 May 2017 09:48:43 +0000 (11:48 +0200)]
Add Garbage Cleanning to VIRL
- add cleaning of old VPP builds (deb|rpm)
- add cleaning of old session dirs
- add cleaning of old QEMU logs
Change-Id: Ib2849cc3969de75525f13d80dc87b32fb82865af
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Neale Ranns [Mon, 15 May 2017 10:44:00 +0000 (03:44 -0700)]
Bump to DPDK 1705 vpp2
Change-Id: I6cc48962433e105c10384faa192d91a2c390011c
Signed-off-by: Neale Ranns <nranns@cisco.com>
Neale Ranns [Sun, 14 May 2017 17:39:44 +0000 (10:39 -0700)]
DPDK version bump
Change-Id: Ia89d64a2c985ff949969c406f0e6cea03cc8c170
Signed-off-by: Neale Ranns <nranns@cisco.com>
Peter Mikus [Fri, 12 May 2017 07:47:07 +0000 (09:47 +0200)]
Fix: SetupFramework sparse file handling
- Fix the issue during packing of the framework when source
directory contains sparse files. By default tar is throwing
warning resulting in return code other then 0.
Change-Id: I39a9c1956685158e2e0fd9ef9545f90e3ef2a89f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
jan.hradil [Thu, 4 May 2017 11:20:51 +0000 (13:20 +0200)]
CSIT-574: IPSec Scale File Splits
split file into two separate files based on number of tunnels
values 1 or 1000
corrected name errors - scale -> base
Change-Id: I7114c777f3cc3d7f4951a1f59e54f3a7bbe404ec
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
jan.hradil [Thu, 4 May 2017 08:28:43 +0000 (10:28 +0200)]
CSIT-573: Split SNAT scale tests to multiple files
split file with many test cases into mutliple files based on
users and ports
added SRC_USER tags
removed empty lines at EOF
Change-Id: I19c79cdf8d7de4147c98bc061559af1fde10ab8c
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Maciek Konstantynowicz [Tue, 9 May 2017 15:49:12 +0000 (16:49 +0100)]
csit report - fixed table format in vpp_performance_tests/csit_release_notes.rst
Change-Id: Ie9d4a9ba373c0e6131f0a2d3e49f20a315da3b9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
selias [Fri, 5 May 2017 11:43:05 +0000 (13:43 +0200)]
HC Test: update routing test keyword due to namespace changes
- changed in https://gerrit.fd.io/r/6303
Change-Id: If5fdfcf21c757f9199f168bfd044c7fefce87bef
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Tue, 2 May 2017 11:51:55 +0000 (13:51 +0200)]
Use 'Qemu Kill All' in perf test teardown
- replace 'Qemu Kill' KW by 'Qemu Kill All'
- use self.qemu_kill_all() in case of qemu_start(self) failure
Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Tue, 2 May 2017 07:54:02 +0000 (09:54 +0200)]
HC Test: Update honeycomb suite setup
- remove workaround for jVPP version mismatch
- increase Java API command timeout
Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Thu, 27 Apr 2017 12:12:10 +0000 (14:12 +0200)]
CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test cases
Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Wed, 3 May 2017 13:20:43 +0000 (14:20 +0100)]
Update to csit rls1704 report - perf changes tables - based on increased number of test job executions.
Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 3 May 2017 12:17:42 +0000 (13:17 +0100)]
Updates to csit rls1704 report related to increased number of test job executions.
Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Wed, 3 May 2017 07:23:00 +0000 (07:23 +0000)]
Fix Honeycomb source data path for report.
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 3 May 2017 06:33:30 +0000 (08:33 +0200)]
Update links with source data for rls report
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 3 May 2017 05:19:41 +0000 (07:19 +0200)]
Update data points for rls1704 report
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
jan.hradil [Thu, 27 Apr 2017 12:47:16 +0000 (14:47 +0200)]
csit-validate-pylint-master/3731 for build 3731
pylint repairs
deleted duplicated method from HcPersistence.py
Change-Id: I426e6c15957c995ea10bd11ae2deac75b1cab922
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Peter Mikus [Fri, 28 Apr 2017 06:43:25 +0000 (08:43 +0200)]
Fix: VAT timeout in IPv6 scale 2M
- Fix VAT timeout issue in IPv6 scale testing with 2M FIB entries
by increasing heapsize to 3G
Change-Id: Ie81619085fbd5a2a86848513d139932a12babf67
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Matej Klotton [Thu, 27 Apr 2017 13:35:10 +0000 (15:35 +0200)]
Update ansible playbooks VIRL setup
Change-Id: I704991c65dc5fc9ce40ade932cab104fa468696c
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Maciek Konstantynowicz [Thu, 27 Apr 2017 12:35:33 +0000 (13:35 +0100)]
csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Jan Gelety [Thu, 27 Apr 2017 07:40:39 +0000 (09:40 +0200)]
Update of VPP_STABLE_VER_UBUNTU
- use new vpp ref build: 17.07-rc0~
144-g36c1308~b2247_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/31/
Change-Id: Ie1541da709828aebfcbb1068427d9b3f7e97ffc6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Thu, 27 Apr 2017 11:11:56 +0000 (12:11 +0100)]
csit rls1704 report: final update to csit_release_notes.rst, packet_*_graphs.rst files.
Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Thu, 27 Apr 2017 08:14:36 +0000 (10:14 +0200)]
Report-gen update
- fix header in IPsec sections
- fix IP4 regexp to include SNAT
- update source data for perf trending
- fix rendering of Trex section
Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Thu, 27 Apr 2017 09:03:31 +0000 (10:03 +0100)]
csit rls1704 report: updates to csit_release_notes.rst files.
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 26 Apr 2017 20:43:00 +0000 (21:43 +0100)]
update to csti rls1704 report: vpp_unittest_results.rst
Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Wed, 26 Apr 2017 18:02:44 +0000 (20:02 +0200)]
Fix: Report table layout in RTD Sphinx
Change-Id: Ibdac46c7ec6d8381da89ea9bb7e407b91c5029df
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Wed, 26 Apr 2017 15:17:02 +0000 (17:17 +0200)]
CSIT rls1704 report - small updates
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 26 Apr 2017 13:25:06 +0000 (14:25 +0100)]
Edits to csit rls1704 report: vpp_unit_tests sections.
Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 26 Apr 2017 13:42:41 +0000 (14:42 +0100)]
Edits to csit rls1704 report: csit_tag_description.rst.
Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 26 Apr 2017 11:37:26 +0000 (12:37 +0100)]
csit rls1704 report - updated csit_release_notes.rst and overview.rst files.
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Jan Gelety [Wed, 26 Apr 2017 10:47:51 +0000 (12:47 +0200)]
CSIT rls1704 report - update of functional csit_release_notes.rst
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 26 Apr 2017 12:49:17 +0000 (14:49 +0200)]
CSIT doc gen: Use html <pre> tag for data from teardown.
Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 26 Apr 2017 11:32:53 +0000 (13:32 +0200)]
Update run_report.sh script for generating report
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 26 Apr 2017 07:03:19 +0000 (09:03 +0200)]
Update: report source data links
Change-Id: I74b9b1070380dcc5f721d695989f3bd676b6df91
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 19:42:03 +0000 (21:42 +0200)]
CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rst
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 15:35:00 +0000 (17:35 +0200)]
CSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rst
Change-Id: I400f49ab5399a83b925fbbe2b52e37fd97f464f0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Tue, 25 Apr 2017 18:39:35 +0000 (19:39 +0100)]
rls1704 report - updated sections:
- vpp_performance_tests/overview.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/test_environment
- honeycomb_functional_tests/csit_release_notes
Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 16:17:41 +0000 (18:17 +0200)]
Fix: CSIT report gen for policer
Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Fri, 21 Apr 2017 19:42:05 +0000 (20:42 +0100)]
CSIT rls1704 report - update to handcrafted sections:
- index.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/overview.rst
- vpp_performance_tests/packet_throughput_graphs/...
- testpmd_performance_tests/csit_release_notes.rst
- vpp_functional_tests/csit_release_notes.rst
- testpmd_performance_tests/packet_latency_graphs/...
- testpmd_performance_tests/packet_throughput_graphs/...
Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Matej Klotton [Mon, 20 Mar 2017 08:38:02 +0000 (09:38 +0100)]
Vhost tests
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Tibor Frank [Tue, 25 Apr 2017 08:44:33 +0000 (10:44 +0200)]
Improve doc in data driven perf tests
Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 12:59:17 +0000 (14:59 +0200)]
Fix: CSIT report gen - teardonw data + run_report.sh
Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 25 Apr 2017 11:21:40 +0000 (13:21 +0200)]
Update report links to source data
Change-Id: Ifd5689eac5251316e24283fb94526ad52567d1ac
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 07:53:19 +0000 (09:53 +0200)]
CSIT doc gen: Add configurations and operational data.
- vpp perf configurations and operational data
- vpp func configurations
Change-Id: I634682e55a2862b927546e2657aabb242c730be1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Thu, 20 Apr 2017 14:22:30 +0000 (16:22 +0200)]
CSIT doc gen: Script to get data from teardown.
- generate rst/html/md/wiki file with required data from teardown per TC
- implemented:
- VAT command history of all DUTs per TC
- ouptup of CLI command "Show Runtime" (VPP operational data)
Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Tue, 25 Apr 2017 10:23:09 +0000 (12:23 +0200)]
1704 report - fix mistake in honeycomb section
Change-Id: I6517ea48a6df95cc855596843d736658471486ea
Signed-off-by: selias <samelias@cisco.com>
jan.hradil [Tue, 11 Apr 2017 07:28:07 +0000 (09:28 +0200)]
CSIT-534 HC Test: policer tests
Added empty lines where needed
Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot
Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation
Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
selias [Tue, 25 Apr 2017 07:22:58 +0000 (09:22 +0200)]
1704 Report - Honeycomb section
Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c
Signed-off-by: selias <samelias@cisco.com>
Tibor Frank [Mon, 24 Apr 2017 06:38:08 +0000 (08:38 +0200)]
Download the latest VPP build for *NIGHTLY and *DAILY jobs
Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 24 Apr 2017 11:05:12 +0000 (13:05 +0200)]
Fix: Report vhost and testpmd plots
Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Mon, 24 Apr 2017 08:56:32 +0000 (10:56 +0200)]
Fix: Report generation
- Add IPsec plots
- Fix plots rendering
Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Thu, 20 Apr 2017 13:10:52 +0000 (15:10 +0200)]
CSIT-554: Performance jobs reorganisation, part 4
Add:
- vpp-csit-verify-hw-perf
Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 19 Apr 2017 13:29:51 +0000 (15:29 +0200)]
CSIT-557: Performance jobs reorganisation, part 3
Add:
- csit-vpp-perf-verify
Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 24 Apr 2017 05:21:43 +0000 (07:21 +0200)]
Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdisc
- Fix missing keyword
Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sat, 22 Apr 2017 19:09:31 +0000 (21:09 +0200)]
Update data source for release report
Change-Id: Ifccd3fd895ae52c78b1ae7a6d0d30d9334d30a05
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sat, 22 Apr 2017 05:21:28 +0000 (07:21 +0200)]
Fix typo in run_report
Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sat, 22 Apr 2017 05:00:28 +0000 (07:00 +0200)]
Fix run_report.sh
- fix sed delimiter to eliminate /
Change-Id: I4d6253d7845937ee452da342819d1c390ca28054
Signed-off-by: Peter Mikus <pmikus@cisco.com>
pmikus [Thu, 13 Apr 2017 20:06:17 +0000 (22:06 +0200)]
Report generation script updates
- Add new type of throughput plots
- Update Sphinx, Sphinx-rtd-theme and Plotly packages
- Add auto generation of detailed test results
- Small fixes
Change-Id: I706777160a7f166e0a335c64428d10cb546fa854
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:04:40 +0000 (12:04 +0100)]
Added Ethernet frame size tags for performance tests:
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B.
Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:15:15 +0000 (12:15 +0100)]
tag_documentation.rst - added:
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B.
Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Thu, 20 Apr 2017 21:42:01 +0000 (22:42 +0100)]
CSIT rls1704 report - update to handcraftec sections:
- introduction /overview /general_notes /csit_test_naming
- vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs
- vpp_functional_tests /overview /csit_release_notes /documentation
- testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs
Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 21 Apr 2017 09:25:35 +0000 (10:25 +0100)]
tag_documentation.rst - added: Ethernet frame size tags for performance tests
Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Fri, 21 Apr 2017 07:54:07 +0000 (09:54 +0200)]
CSIT-561: Add release and version to the header
Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43
Signed-off-by: Tibor Frank <tifrank@cisco.com>
selias [Thu, 13 Apr 2017 10:28:43 +0000 (12:28 +0200)]
HC Test: update plugin-ACL test suite
- fix variables in routed icmpv6 test case
- remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases
- create and use keywords for test teardown
Change-Id: I91792b5900015827bc2bcfd138192f972f92df28
Signed-off-by: selias <samelias@cisco.com>
Tibor Frank [Wed, 19 Apr 2017 12:13:24 +0000 (14:13 +0200)]
CSIT-561: Add filtering of testsuits to report generation
Change-Id: I751600f7ea9937bc8bfde7d6062eeaadf3ee68dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 13 Apr 2017 15:01:13 +0000 (17:01 +0200)]
Use QEMU virtio queue size 1024 for perf tests
- use Build QEMU KW to apply patch to increase default virtio queue size
- remove Set Scheduler Policy
Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Tue, 18 Apr 2017 10:56:31 +0000 (12:56 +0200)]
CSIT-559: Performance jobs reorganisation, part 3
Add:
- csit-vpp-perf-ndrchk-daily
Change-Id: I4edfa86810744168307d9cbeb979d40dc5e21eb0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 12 Apr 2017 14:10:45 +0000 (16:10 +0200)]
CSIT-558: Performance jobs reorganization, part 2
Add:
- csit-vpp-perf-check
Change-Id: I31e40d37e38d27d3be15a40f6044ce5d907067be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 19 Apr 2017 06:05:50 +0000 (08:05 +0200)]
Fix: IPSec+Lisp suite naming
Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Tue, 18 Apr 2017 12:54:10 +0000 (14:54 +0200)]
CSIT-560: csit src code doc generation for 1704
Change-Id: I9f07f326e12942404d670004bb9463039967f954
Signed-off-by: Tibor Frank <tifrank@cisco.com>
selias [Tue, 18 Apr 2017 10:01:27 +0000 (12:01 +0200)]
HC Test: update persistence suite
- fix "enable persistence" is suite setup
- update Jira links to persistence bug
- log content of persistence file before each restart
Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7
Signed-off-by: selias <samelias@cisco.com>
Tibor Frank [Tue, 11 Apr 2017 09:26:17 +0000 (11:26 +0200)]
CSIT-531: Performance jobs reorganization, part 1
Add:
- csit-vpp-perf-trend-daily
- csit-vpp-perf-trend-semiweekly
Change-Id: I59ed581f9fb2457cf1e3a58bac625f3b807d653f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 18 Apr 2017 11:24:57 +0000 (13:24 +0200)]
Remove the tag THIS from SNAT perf tests
Change-Id: I54ac114b72763bbf1d2dd57956c0a6f99af82da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 13 Mar 2017 12:22:08 +0000 (13:22 +0100)]
CSIT-545: Performance tests for SNAT
- High level definition (HLD)
- Low level definition (LLD)
- Add keywords to set SNAT
- Add tests according to HLD, LLD
Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 13 Apr 2017 18:56:56 +0000 (20:56 +0200)]
Update ansible script
- Add more inter steps
- Add alternative way to host files via Apache server (due to VIRL
collisions)
Change-Id: Ibb206fa630013e9cdff9cda145e993b033ec7138
Signed-off-by: pmikus <pmikus@cisco.com>
selias [Wed, 12 Apr 2017 16:40:11 +0000 (18:40 +0200)]
HC Test: update honeycomb package download scripts
- add "_amd64" to version parameter for .deb packages
- install only vpp-api-java on maven build slave
Change-Id: Ie61974c3c2806d1d3e0281bd0b5149f1b0d1443d
Signed-off-by: selias <samelias@cisco.com>
Matej Klotton [Fri, 7 Apr 2017 08:26:37 +0000 (10:26 +0200)]
Fix slow ssh login to Centos VIRL hosts.
Change-Id: I36478bcae679d8e30ad00d97d7fc680130808670
Signed-off-by: Matej Klotton <mklotton@cisco.com>
pmikus [Mon, 10 Apr 2017 06:48:19 +0000 (08:48 +0200)]
IPsectptLispGpe performance test suite
*[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
with single links between nodes.
*[Enc] Packet Encapsulations:* IPv4-IPSec-LISPGPE-IPv4.
*[Cfg] DUT configuration:* Each DUT is configured with LISP and IPsec.
IPsec is in transport mode. Tests cases are for IPsec configured both on
RLOC interface.
Change-Id: I7a95baf0305caac3d9f0702bbedb3feec27f1668
Signed-off-by: pmikus <pmikus@cisco.com>
selias [Wed, 5 Apr 2017 09:54:06 +0000 (11:54 +0200)]
CSIT-544 HC Test: adapt package download script to changes in hc2vpp
Required after https://gerrit.fd.io/r/5908
hc2vpp packages to be published with a specific VPP version dependency.
Change-Id: I9a31a83ec033a01556b4afd8575d8ccae4139b7f
Signed-off-by: selias <samelias@cisco.com>
selias [Wed, 12 Apr 2017 09:08:47 +0000 (11:08 +0200)]
HC Test: update URL paths with ODL mountpoint
other minor fixes:
- update teardown keyword in proxyARP suite
- increase timeout for SLAAC traffic test
Change-Id: Ia16d096c54ceac501a24d5d910dd18e33d900d2a
Signed-off-by: selias <samelias@cisco.com>
jan.hradil [Thu, 30 Mar 2017 07:55:30 +0000 (09:55 +0200)]
CSIT-529 HC Test: SLAAC
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Jan Gelety [Mon, 10 Apr 2017 07:44:49 +0000 (09:44 +0200)]
Don't use dpdk dev packages - weekly, func and perf jobs
- remove donwload and installation of DPDK development packages
- keep download and installation of vpp-dpdk-dkms deb package
that contains igb_uio driver needed for e.g. cryptodev tests
Change-Id: I3d87fa1cd1efaad522f47df0e71a4885466a14c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Thu, 6 Apr 2017 14:14:39 +0000 (16:14 +0200)]
HC Test: Fix proxyARP test teardown
- interface assignment is removed automatically with proxyARP settings
Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Mon, 10 Apr 2017 07:49:31 +0000 (09:49 +0200)]
Update of VPP_STABLE_VER_UBUNTU
- use new vpp ref build: 17.07-rc0~
81-gd927834~b2184_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/26/
Change-Id: I96684c6b17a4bb64b4070e440150ff4cac9a57a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Kirill Rybalchenko [Wed, 21 Dec 2016 12:16:29 +0000 (12:16 +0000)]
IPsec Multi-Tunnel performance test suite
Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566
Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
pmikus [Wed, 29 Mar 2017 14:51:34 +0000 (16:51 +0200)]
CSIT-441 vhost - Parametrized qemu install
Update the current QEMU installation script with option to override QEMU
installation and to apply additional patches. Additional patches are
applied from qemu_patches directory and subdir for specific QEMU version by
run-parts. This means that all patches for particular version are
applied.
All keywords for build QEMU are updated.
Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad
Signed-off-by: pmikus <pmikus@cisco.com>
pmikus [Wed, 5 Apr 2017 07:35:05 +0000 (09:35 +0200)]
CSIT-553 Make QEMU bin configurable
Add option to set path for QEMU binary and make it configurable in perf
testaces as global variable.
Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630
Signed-off-by: pmikus <pmikus@cisco.com>
selias [Wed, 5 Apr 2017 15:47:13 +0000 (17:47 +0200)]
HC Test: update ACL-plugil test suite
- add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not
hit the classify node
- fix MAC address mixup in reflexive cases
Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Tue, 28 Mar 2017 14:17:53 +0000 (16:17 +0200)]
CSIT-552: Add xl710 perf test with 2 VMs per DUT
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc
- 40ge2p1xl710-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc
- 40ge2p1xl710-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc
Change-Id: I2d2f8e9b8966bd6e19014cf7a234c3c02bb9251c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
pmikus [Thu, 6 Apr 2017 04:56:09 +0000 (06:56 +0200)]
Update topology files after HW changes
Adding Intel QAT crypto card caused changes in PCI adresses
Change-Id: Ifeaa0dba87d0c1b3436d303e63dd2ff284526dd1
Signed-off-by: pmikus <pmikus@cisco.com>
pmikus [Mon, 3 Apr 2017 10:34:32 +0000 (12:34 +0200)]
Apply performance options for testpmd
- Add parameters to increase the performance of SUTs
Change-Id: Ia9c5d76639bd931d8113c26e18861648de395322
Signed-off-by: pmikus <pmikus@cisco.com>