Peter Mikus [Tue, 30 May 2017 06:24:20 +0000 (08:24 +0200)]
CSIT-648 Installation of lxc on physical hosts
Add lxc package to ansible 01-host-setup file to install package
and its dependencies on all SUTs
Change-Id: I3a7cef1a5acec16f603ffad7ee6ca7c85969e385
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 29 May 2017 10:07:58 +0000 (12:07 +0200)]
Do not fail test case when no vpp pid detected in the tear down
- currently when no pid (or more pids) detected in the test case
tear down of successfully run test case not only the WARN message
is logged but the whole test case is failed
- to change this behaviour but keep test case failure if no vpp pid
(or more vpp pids) detected in test case setup the low level KW
"Get VPP PID" behaviour has been changed to return one or more
pids or None w/o raising an error and check has been moved to
higher level KW "Save VPP PIDs"
- there was added suite name and test case name to WARN message when
no pid or more pids detected in the test case tear down
Change-Id: I04f8d81c1ca48a1e4a45bd0e58f00d36d51c6933
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Mon, 29 May 2017 12:18:56 +0000 (14:18 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
17.07-rc0~
305-g6af1c04~b2410_amd64
- use new vpp ref build - centos7:
17.07-rc0~305_g6af1c04~b2408.x86_64
- builds tested by semiweekly jobs:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/41/
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/41/
Change-Id: I187a49d922a5aa916d52d820350e9631f174221d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Fangyin Hu [Fri, 23 Dec 2016 10:30:04 +0000 (02:30 -0800)]
Add the DPDK l3fwd performance test case.
fix some code style issue and rebase the code.
change the DPDK l3fwd test case name and rebase the code.
fix the pylint errors.
change the DPDK version to 17.05
Rebase the code.
Fix the l3fwd test code like the l2fwd.
Fix the run l3fwd script issues.
Rebase the code and review.
Fix the l3fwd script issues.
verify-perf-dpdk-long
Change-Id: I5c5625ebcd5ff16f47fbee361789be3fece1ddbc
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
Ed Kern [Thu, 25 May 2017 13:25:13 +0000 (07:25 -0600)]
CSIT-597: added additional variables needed for virl host construction.
Also converted ansible_hosts file to utf-8 because the dos format it was in
was pissing me off.
Change-Id: Ie436f5abc6b397d406efec6e49e0845d915f2310
Signed-off-by: Ed Kern <ejk@cisco.com>
Peter Mikus [Mon, 22 May 2017 07:35:17 +0000 (09:35 +0200)]
CSIT-612 Report: Minimization of hand-crafted content.
- replace dynamic text content and links by variables.
Change-Id: I1a7ec371fc80af3c9dd416bf91dd2c639097cf1e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
selias [Mon, 22 May 2017 16:33:04 +0000 (18:33 +0200)]
CSIT-613 Update VIRL ansible files
Update VIRL ansible files
Change-Id: Ie64ddb1238888518e9384711669a028097d816af
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Ed Kern [Wed, 24 May 2017 23:34:31 +0000 (17:34 -0600)]
CSIT-597: quotas to default user, use command crudini over ini for : vs = sep and alternate salt master
altered virl.ini for eth0 being on flat port
Change-Id: I12dacc32ca3f542f18d4569947123e49d07d74ef
Signed-off-by: Ed Kern <ejk@cisco.com>
Ed Kern [Wed, 24 May 2017 23:55:27 +0000 (17:55 -0600)]
CSIT-597: revert to old style interface naming
Change-Id: I0ae5295fe0bd046e643df2d2abf2b88f76f3179f
Signed-off-by: Ed Kern <ejk@cisco.com>
selias [Mon, 22 May 2017 16:33:04 +0000 (18:33 +0200)]
HC Test: update proxyARP test case
- update to better reflect test in CSIT-functional
Change-Id: I7412bfea34c867cd14ee95b857f30d6923998ff2
Signed-off-by: selias <samelias@cisco.com>
Peter Mikus [Tue, 23 May 2017 07:40:41 +0000 (07:40 +0000)]
Modify garbage cleaning on VIRL
Decrease the threshold of old session directories and add cleaning of non-empty directories
Change-Id: I77950065e5e09aaaf38cf2d9cb3f4c3f8cdcf58c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Mon, 22 May 2017 13:16:24 +0000 (15:16 +0200)]
Upgrade T-rex to version 2.25
- Upgrade T-rex to v2.25 with multiple bug fixes.
Change-Id: Idc422172ce98c37ace7bbbf054a2b024c313bbf7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 22 May 2017 13:47:53 +0000 (15:47 +0200)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file
- use new vpp ref build - ubuntu 16.04:
17.07-rc0~
144-g36c1308~b2247_amd64
- use new vpp ref build - centos7:
17.07-rc0~
268-gc7409dc~b2371_amd64
- use new DPDK version:
17.05-vpp3
- builds tested by semiweekly jobs:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/39/
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/39/
Change-Id: I7ed3e1011ae6b1e9fa9a6a3fd98fc5ebcb8bfdf9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Thu, 18 May 2017 11:10:33 +0000 (13:10 +0200)]
HC Test: Improve logging of Honeycomb and VPP restart
Change-Id: I69d73ba3f672af88563715d17c94c73d8d5e7ff2
Signed-off-by: selias <samelias@cisco.com>
Peter Mikus [Fri, 19 May 2017 09:12:45 +0000 (11:12 +0200)]
Update: Topology file for TB1
- Update topology file for TB1 after card replacement
Change-Id: Id346b747bb600b6796a447a23b1a4e37961a8c7e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
qun wan [Thu, 4 May 2017 20:28:23 +0000 (16:28 -0400)]
TLDK Bootstrap.sh file to support the jenkins job scheduling.
Change-Id: Ia89e5a32fdc963a1c20345da1310b7958cd34c48
Signed-off-by: qun wan <qun.wan@intel.com>
Tibor Frank [Tue, 16 May 2017 07:12:16 +0000 (09:12 +0200)]
CSIT-580: IPSec tests - modifications related to the latest changes
- The startup option 'enable-cryptodev' has been removed and unless
not enough cryptodevs are found, DPDK cryptodev will be enabled by default.
Change-Id: I19a483435256d8cf4101dc9f10a7c95ed5594e75
Signed-off-by: Tibor Frank <tifrank@cisco.com>
selias [Wed, 17 May 2017 11:24:09 +0000 (13:24 +0200)]
CSIT-557 HC Test: Fix ODL setup in Honeycomb-odl jobs
Change-Id: I917f3bfd9cea043e1bc820536db07697e0d41040
Signed-off-by: selias <samelias@cisco.com>
Peter Mikus [Fri, 12 May 2017 06:38:51 +0000 (08:38 +0200)]
Fix start-testcase script on VIRL
- Fix pylint errors
- Add expiry option to set expiration of simulation
- Add more sanitization of exceptions
- Fix printing of debug messages to stderr
Change-Id: Iecc1fe042b6da104a164fb5701e665b6f3aa298b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Fri, 5 May 2017 14:26:41 +0000 (16:26 +0200)]
Func test reorg - decrease exec time per vpp patch
- remove tests covered by make test
- remove some negative tests
Change-Id: I35d641562ee85888f7d1dd60dd892689b1e9c52d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
selias [Thu, 11 May 2017 16:02:03 +0000 (18:02 +0200)]
CSIT-576 HC Test: Improve SPAN test coverage
- add test for multiple destination interfaces using one source interface
- duplicate all existing cases using a sub-interface as the destination
Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3
Signed-off-by: selias <samelias@cisco.com>
selias [Wed, 10 May 2017 15:41:11 +0000 (17:41 +0200)]
CSIT-577 HC Test: Scripts for test jobs using ODL client
ODL client can be used to translate Restconf requests into Netconf. This
way Honeycomb's Netconf interface can be tested using existing test cases.
- add bootstrap scripts for verify and integration job
- update __init__.robot to handle new {HC_ODL} variable
Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86
Signed-off-by: selias <samelias@cisco.com>
selias [Tue, 9 May 2017 10:38:35 +0000 (12:38 +0200)]
CSIT-562 HC Test: Persistence suite rework, part1
- rename keywords that check operational data, to distinguish from keywords
that check configuration data
- modify existing persistence cases so that they don't affect each other
- add feature-specific persistence tests for: Interface Management, L2 bridge
- move Interface Management variables to separate file so they can be reused
- add new tag HC_PERSIST to execute persistence tests separately
- update existing Honeycomb tags to comply with CSIT conventions
More feature-specific tests to be added in part2.
Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef
Signed-off-by: selias <samelias@cisco.com>
jan.hradil [Thu, 27 Apr 2017 10:07:59 +0000 (12:07 +0200)]
CSIT-563: HC Test: improved Lisp test coverage
added TC09-TC14 with following features:
Map Resolver
Map Server
PETR configuration
RLOC Probing
Map Register
Map Request mode
Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Tue, 16 May 2017 08:21:51 +0000 (10:21 +0200)]
Fix: use pci/rescan to avoid occasional bind issue on Centos7
- rarelly binding of one of TG interfaces fails with "No such
device" error; usage of rescan should avoid such situations
Change-Id: Icbeb48ea6f8adb863e6517d4a35d6aca4238309a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 16 May 2017 14:03:52 +0000 (16:03 +0200)]
Add RA suppress to IPv6 Equal-cost multipath routing test case
Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 16 May 2017 12:48:47 +0000 (14:48 +0200)]
Fix typo in weekly bootstrap file
Change-Id: I2dc221c433ba87d0f98082c0c3aef2df838cd750
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 16 May 2017 09:48:43 +0000 (11:48 +0200)]
Add Garbage Cleanning to VIRL
- add cleaning of old VPP builds (deb|rpm)
- add cleaning of old session dirs
- add cleaning of old QEMU logs
Change-Id: Ib2849cc3969de75525f13d80dc87b32fb82865af
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Neale Ranns [Mon, 15 May 2017 10:44:00 +0000 (03:44 -0700)]
Bump to DPDK 1705 vpp2
Change-Id: I6cc48962433e105c10384faa192d91a2c390011c
Signed-off-by: Neale Ranns <nranns@cisco.com>
Neale Ranns [Sun, 14 May 2017 17:39:44 +0000 (10:39 -0700)]
DPDK version bump
Change-Id: Ia89d64a2c985ff949969c406f0e6cea03cc8c170
Signed-off-by: Neale Ranns <nranns@cisco.com>
Peter Mikus [Fri, 12 May 2017 07:47:07 +0000 (09:47 +0200)]
Fix: SetupFramework sparse file handling
- Fix the issue during packing of the framework when source
directory contains sparse files. By default tar is throwing
warning resulting in return code other then 0.
Change-Id: I39a9c1956685158e2e0fd9ef9545f90e3ef2a89f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
jan.hradil [Thu, 4 May 2017 11:20:51 +0000 (13:20 +0200)]
CSIT-574: IPSec Scale File Splits
split file into two separate files based on number of tunnels
values 1 or 1000
corrected name errors - scale -> base
Change-Id: I7114c777f3cc3d7f4951a1f59e54f3a7bbe404ec
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
jan.hradil [Thu, 4 May 2017 08:28:43 +0000 (10:28 +0200)]
CSIT-573: Split SNAT scale tests to multiple files
split file with many test cases into mutliple files based on
users and ports
added SRC_USER tags
removed empty lines at EOF
Change-Id: I19c79cdf8d7de4147c98bc061559af1fde10ab8c
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Maciek Konstantynowicz [Tue, 9 May 2017 15:49:12 +0000 (16:49 +0100)]
csit report - fixed table format in vpp_performance_tests/csit_release_notes.rst
Change-Id: Ie9d4a9ba373c0e6131f0a2d3e49f20a315da3b9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
selias [Fri, 5 May 2017 11:43:05 +0000 (13:43 +0200)]
HC Test: update routing test keyword due to namespace changes
- changed in https://gerrit.fd.io/r/6303
Change-Id: If5fdfcf21c757f9199f168bfd044c7fefce87bef
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Tue, 2 May 2017 11:51:55 +0000 (13:51 +0200)]
Use 'Qemu Kill All' in perf test teardown
- replace 'Qemu Kill' KW by 'Qemu Kill All'
- use self.qemu_kill_all() in case of qemu_start(self) failure
Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Tue, 2 May 2017 07:54:02 +0000 (09:54 +0200)]
HC Test: Update honeycomb suite setup
- remove workaround for jVPP version mismatch
- increase Java API command timeout
Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Thu, 27 Apr 2017 12:12:10 +0000 (14:12 +0200)]
CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test cases
Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Wed, 3 May 2017 13:20:43 +0000 (14:20 +0100)]
Update to csit rls1704 report - perf changes tables - based on increased number of test job executions.
Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 3 May 2017 12:17:42 +0000 (13:17 +0100)]
Updates to csit rls1704 report related to increased number of test job executions.
Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Wed, 3 May 2017 07:23:00 +0000 (07:23 +0000)]
Fix Honeycomb source data path for report.
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 3 May 2017 06:33:30 +0000 (08:33 +0200)]
Update links with source data for rls report
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 3 May 2017 05:19:41 +0000 (07:19 +0200)]
Update data points for rls1704 report
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
jan.hradil [Thu, 27 Apr 2017 12:47:16 +0000 (14:47 +0200)]
csit-validate-pylint-master/3731 for build 3731
pylint repairs
deleted duplicated method from HcPersistence.py
Change-Id: I426e6c15957c995ea10bd11ae2deac75b1cab922
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Peter Mikus [Fri, 28 Apr 2017 06:43:25 +0000 (08:43 +0200)]
Fix: VAT timeout in IPv6 scale 2M
- Fix VAT timeout issue in IPv6 scale testing with 2M FIB entries
by increasing heapsize to 3G
Change-Id: Ie81619085fbd5a2a86848513d139932a12babf67
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Matej Klotton [Thu, 27 Apr 2017 13:35:10 +0000 (15:35 +0200)]
Update ansible playbooks VIRL setup
Change-Id: I704991c65dc5fc9ce40ade932cab104fa468696c
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Maciek Konstantynowicz [Thu, 27 Apr 2017 12:35:33 +0000 (13:35 +0100)]
csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Jan Gelety [Thu, 27 Apr 2017 07:40:39 +0000 (09:40 +0200)]
Update of VPP_STABLE_VER_UBUNTU
- use new vpp ref build: 17.07-rc0~
144-g36c1308~b2247_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/31/
Change-Id: Ie1541da709828aebfcbb1068427d9b3f7e97ffc6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Thu, 27 Apr 2017 11:11:56 +0000 (12:11 +0100)]
csit rls1704 report: final update to csit_release_notes.rst, packet_*_graphs.rst files.
Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Thu, 27 Apr 2017 08:14:36 +0000 (10:14 +0200)]
Report-gen update
- fix header in IPsec sections
- fix IP4 regexp to include SNAT
- update source data for perf trending
- fix rendering of Trex section
Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Thu, 27 Apr 2017 09:03:31 +0000 (10:03 +0100)]
csit rls1704 report: updates to csit_release_notes.rst files.
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 26 Apr 2017 20:43:00 +0000 (21:43 +0100)]
update to csti rls1704 report: vpp_unittest_results.rst
Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Wed, 26 Apr 2017 18:02:44 +0000 (20:02 +0200)]
Fix: Report table layout in RTD Sphinx
Change-Id: Ibdac46c7ec6d8381da89ea9bb7e407b91c5029df
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Wed, 26 Apr 2017 15:17:02 +0000 (17:17 +0200)]
CSIT rls1704 report - small updates
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 26 Apr 2017 13:25:06 +0000 (14:25 +0100)]
Edits to csit rls1704 report: vpp_unit_tests sections.
Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 26 Apr 2017 13:42:41 +0000 (14:42 +0100)]
Edits to csit rls1704 report: csit_tag_description.rst.
Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 26 Apr 2017 11:37:26 +0000 (12:37 +0100)]
csit rls1704 report - updated csit_release_notes.rst and overview.rst files.
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Jan Gelety [Wed, 26 Apr 2017 10:47:51 +0000 (12:47 +0200)]
CSIT rls1704 report - update of functional csit_release_notes.rst
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 26 Apr 2017 12:49:17 +0000 (14:49 +0200)]
CSIT doc gen: Use html <pre> tag for data from teardown.
Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 26 Apr 2017 11:32:53 +0000 (13:32 +0200)]
Update run_report.sh script for generating report
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 26 Apr 2017 07:03:19 +0000 (09:03 +0200)]
Update: report source data links
Change-Id: I74b9b1070380dcc5f721d695989f3bd676b6df91
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 19:42:03 +0000 (21:42 +0200)]
CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rst
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 15:35:00 +0000 (17:35 +0200)]
CSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rst
Change-Id: I400f49ab5399a83b925fbbe2b52e37fd97f464f0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Tue, 25 Apr 2017 18:39:35 +0000 (19:39 +0100)]
rls1704 report - updated sections:
- vpp_performance_tests/overview.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/test_environment
- honeycomb_functional_tests/csit_release_notes
Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 16:17:41 +0000 (18:17 +0200)]
Fix: CSIT report gen for policer
Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Fri, 21 Apr 2017 19:42:05 +0000 (20:42 +0100)]
CSIT rls1704 report - update to handcrafted sections:
- index.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/overview.rst
- vpp_performance_tests/packet_throughput_graphs/...
- testpmd_performance_tests/csit_release_notes.rst
- vpp_functional_tests/csit_release_notes.rst
- testpmd_performance_tests/packet_latency_graphs/...
- testpmd_performance_tests/packet_throughput_graphs/...
Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Matej Klotton [Mon, 20 Mar 2017 08:38:02 +0000 (09:38 +0100)]
Vhost tests
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Tibor Frank [Tue, 25 Apr 2017 08:44:33 +0000 (10:44 +0200)]
Improve doc in data driven perf tests
Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 12:59:17 +0000 (14:59 +0200)]
Fix: CSIT report gen - teardonw data + run_report.sh
Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 25 Apr 2017 11:21:40 +0000 (13:21 +0200)]
Update report links to source data
Change-Id: Ifd5689eac5251316e24283fb94526ad52567d1ac
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Tue, 25 Apr 2017 07:53:19 +0000 (09:53 +0200)]
CSIT doc gen: Add configurations and operational data.
- vpp perf configurations and operational data
- vpp func configurations
Change-Id: I634682e55a2862b927546e2657aabb242c730be1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Thu, 20 Apr 2017 14:22:30 +0000 (16:22 +0200)]
CSIT doc gen: Script to get data from teardown.
- generate rst/html/md/wiki file with required data from teardown per TC
- implemented:
- VAT command history of all DUTs per TC
- ouptup of CLI command "Show Runtime" (VPP operational data)
Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Tue, 25 Apr 2017 10:23:09 +0000 (12:23 +0200)]
1704 report - fix mistake in honeycomb section
Change-Id: I6517ea48a6df95cc855596843d736658471486ea
Signed-off-by: selias <samelias@cisco.com>
jan.hradil [Tue, 11 Apr 2017 07:28:07 +0000 (09:28 +0200)]
CSIT-534 HC Test: policer tests
Added empty lines where needed
Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot
Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation
Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
selias [Tue, 25 Apr 2017 07:22:58 +0000 (09:22 +0200)]
1704 Report - Honeycomb section
Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c
Signed-off-by: selias <samelias@cisco.com>
Tibor Frank [Mon, 24 Apr 2017 06:38:08 +0000 (08:38 +0200)]
Download the latest VPP build for *NIGHTLY and *DAILY jobs
Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 24 Apr 2017 11:05:12 +0000 (13:05 +0200)]
Fix: Report vhost and testpmd plots
Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Mon, 24 Apr 2017 08:56:32 +0000 (10:56 +0200)]
Fix: Report generation
- Add IPsec plots
- Fix plots rendering
Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Thu, 20 Apr 2017 13:10:52 +0000 (15:10 +0200)]
CSIT-554: Performance jobs reorganisation, part 4
Add:
- vpp-csit-verify-hw-perf
Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 19 Apr 2017 13:29:51 +0000 (15:29 +0200)]
CSIT-557: Performance jobs reorganisation, part 3
Add:
- csit-vpp-perf-verify
Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 24 Apr 2017 05:21:43 +0000 (07:21 +0200)]
Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdisc
- Fix missing keyword
Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sat, 22 Apr 2017 19:09:31 +0000 (21:09 +0200)]
Update data source for release report
Change-Id: Ifccd3fd895ae52c78b1ae7a6d0d30d9334d30a05
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sat, 22 Apr 2017 05:21:28 +0000 (07:21 +0200)]
Fix typo in run_report
Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sat, 22 Apr 2017 05:00:28 +0000 (07:00 +0200)]
Fix run_report.sh
- fix sed delimiter to eliminate /
Change-Id: I4d6253d7845937ee452da342819d1c390ca28054
Signed-off-by: Peter Mikus <pmikus@cisco.com>
pmikus [Thu, 13 Apr 2017 20:06:17 +0000 (22:06 +0200)]
Report generation script updates
- Add new type of throughput plots
- Update Sphinx, Sphinx-rtd-theme and Plotly packages
- Add auto generation of detailed test results
- Small fixes
Change-Id: I706777160a7f166e0a335c64428d10cb546fa854
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:04:40 +0000 (12:04 +0100)]
Added Ethernet frame size tags for performance tests:
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B.
Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:15:15 +0000 (12:15 +0100)]
tag_documentation.rst - added:
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B.
Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Thu, 20 Apr 2017 21:42:01 +0000 (22:42 +0100)]
CSIT rls1704 report - update to handcraftec sections:
- introduction /overview /general_notes /csit_test_naming
- vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs
- vpp_functional_tests /overview /csit_release_notes /documentation
- testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs
Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 21 Apr 2017 09:25:35 +0000 (10:25 +0100)]
tag_documentation.rst - added: Ethernet frame size tags for performance tests
Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Fri, 21 Apr 2017 07:54:07 +0000 (09:54 +0200)]
CSIT-561: Add release and version to the header
Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43
Signed-off-by: Tibor Frank <tifrank@cisco.com>
selias [Thu, 13 Apr 2017 10:28:43 +0000 (12:28 +0200)]
HC Test: update plugin-ACL test suite
- fix variables in routed icmpv6 test case
- remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases
- create and use keywords for test teardown
Change-Id: I91792b5900015827bc2bcfd138192f972f92df28
Signed-off-by: selias <samelias@cisco.com>
Tibor Frank [Wed, 19 Apr 2017 12:13:24 +0000 (14:13 +0200)]
CSIT-561: Add filtering of testsuits to report generation
Change-Id: I751600f7ea9937bc8bfde7d6062eeaadf3ee68dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 13 Apr 2017 15:01:13 +0000 (17:01 +0200)]
Use QEMU virtio queue size 1024 for perf tests
- use Build QEMU KW to apply patch to increase default virtio queue size
- remove Set Scheduler Policy
Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Tue, 18 Apr 2017 10:56:31 +0000 (12:56 +0200)]
CSIT-559: Performance jobs reorganisation, part 3
Add:
- csit-vpp-perf-ndrchk-daily
Change-Id: I4edfa86810744168307d9cbeb979d40dc5e21eb0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 12 Apr 2017 14:10:45 +0000 (16:10 +0200)]
CSIT-558: Performance jobs reorganization, part 2
Add:
- csit-vpp-perf-check
Change-Id: I31e40d37e38d27d3be15a40f6044ce5d907067be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 19 Apr 2017 06:05:50 +0000 (08:05 +0200)]
Fix: IPSec+Lisp suite naming
Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Tue, 18 Apr 2017 12:54:10 +0000 (14:54 +0200)]
CSIT-560: csit src code doc generation for 1704
Change-Id: I9f07f326e12942404d670004bb9463039967f954
Signed-off-by: Tibor Frank <tifrank@cisco.com>
selias [Tue, 18 Apr 2017 10:01:27 +0000 (12:01 +0200)]
HC Test: update persistence suite
- fix "enable persistence" is suite setup
- update Jira links to persistence bug
- log content of persistence file before each restart
Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7
Signed-off-by: selias <samelias@cisco.com>
Tibor Frank [Tue, 11 Apr 2017 09:26:17 +0000 (11:26 +0200)]
CSIT-531: Performance jobs reorganization, part 1
Add:
- csit-vpp-perf-trend-daily
- csit-vpp-perf-trend-semiweekly
Change-Id: I59ed581f9fb2457cf1e3a58bac625f3b807d653f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 18 Apr 2017 11:24:57 +0000 (13:24 +0200)]
Remove the tag THIS from SNAT perf tests
Change-Id: I54ac114b72763bbf1d2dd57956c0a6f99af82da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Code Review / csit.git / log