csit.git
3 years ago Bootstrap file for the nsh_sfc functional test cases to 72/6872/4
qun wan [Thu, 25 May 2017 00:33:04 +0000 (20:33 -0400)]
Bootstrap file for the nsh_sfc functional test cases to
    support the jenkins job scheduling.

Change-Id: I8969c563ae712a82c9ff875ea4c55c6504acd44e
Signed-off-by: qun wan <qun.wan@intel.com>
3 years agoCSIT-648 Installation of lxc on physical hosts 13/6913/3
Peter Mikus [Tue, 30 May 2017 06:24:20 +0000 (08:24 +0200)]
CSIT-648 Installation of lxc on physical hosts

Add lxc package to ansible 01-host-setup file to install package
and its dependencies on all SUTs

Change-Id: I3a7cef1a5acec16f603ffad7ee6ca7c85969e385
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoDo not fail test case when no vpp pid detected in the tear down 96/6896/5
Jan Gelety [Mon, 29 May 2017 10:07:58 +0000 (12:07 +0200)]
Do not fail test case when no vpp pid detected in the tear down

- currently when no pid (or more pids) detected in the test case
  tear down of successfully run test case not only the WARN message
  is logged but the whole test case is failed

- to change this behaviour but keep test case failure if no vpp pid
  (or more vpp pids) detected in test case setup the low level KW
  "Get VPP PID" behaviour has been changed to return one or more
  pids or None w/o raising an error and check has been moved to
  higher level KW "Save VPP PIDs"

- there was added suite name and test case name to WARN message when
  no pid or more pids detected in the test case tear down

Change-Id: I04f8d81c1ca48a1e4a45bd0e58f00d36d51c6933
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 04/6904/1
Jan Gelety [Mon, 29 May 2017 12:18:56 +0000 (14:18 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.07-rc0~305-g6af1c04~b2410_amd64

- use new vpp ref build - centos7:
  17.07-rc0~305_g6af1c04~b2408.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/41/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/41/

Change-Id: I187a49d922a5aa916d52d820350e9631f174221d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years ago Add the DPDK l3fwd performance test case. 74/4474/21
Fangyin Hu [Fri, 23 Dec 2016 10:30:04 +0000 (02:30 -0800)]
Add the DPDK l3fwd performance test case.
fix some code style issue and rebase the code.
change the DPDK l3fwd test case name and rebase the code.
fix the pylint errors.
change the DPDK version to 17.05
Rebase the code.
Fix the l3fwd test code like the l2fwd.
Fix the run l3fwd script issues.
Rebase the code and review.
Fix the l3fwd script issues.
verify-perf-dpdk-long

Change-Id: I5c5625ebcd5ff16f47fbee361789be3fece1ddbc
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
3 years agoCSIT-597: added additional variables needed for virl host construction. 78/6878/1
Ed Kern [Thu, 25 May 2017 13:25:13 +0000 (07:25 -0600)]
CSIT-597: added additional variables needed for virl host construction.
Also converted ansible_hosts file to utf-8 because the dos format it was in
was pissing me off.

Change-Id: Ie436f5abc6b397d406efec6e49e0845d915f2310
Signed-off-by: Ed Kern <ejk@cisco.com>
3 years agoCSIT-612 Report: Minimization of hand-crafted content. 19/6819/5
Peter Mikus [Mon, 22 May 2017 07:35:17 +0000 (09:35 +0200)]
CSIT-612 Report: Minimization of hand-crafted content.

- replace dynamic text content and links by variables.

Change-Id: I1a7ec371fc80af3c9dd416bf91dd2c639097cf1e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-613 Update VIRL ansible files 42/6842/3
selias [Mon, 22 May 2017 16:33:04 +0000 (18:33 +0200)]
CSIT-613 Update VIRL ansible files

Update VIRL ansible files

Change-Id: Ie64ddb1238888518e9384711669a028097d816af
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-597: quotas to default user, use command crudini over ini for : vs = sep and... 69/6869/3
Ed Kern [Wed, 24 May 2017 23:34:31 +0000 (17:34 -0600)]
CSIT-597: quotas to default user, use command crudini over ini for : vs = sep and alternate salt master
altered virl.ini for eth0 being on flat port
Change-Id: I12dacc32ca3f542f18d4569947123e49d07d74ef
Signed-off-by: Ed Kern <ejk@cisco.com>
3 years agoCSIT-597: revert to old style interface naming 70/6870/1
Ed Kern [Wed, 24 May 2017 23:55:27 +0000 (17:55 -0600)]
CSIT-597: revert to old style interface naming

Change-Id: I0ae5295fe0bd046e643df2d2abf2b88f76f3179f
Signed-off-by: Ed Kern <ejk@cisco.com>
3 years agoHC Test: update proxyARP test case 29/6829/4
selias [Mon, 22 May 2017 16:33:04 +0000 (18:33 +0200)]
HC Test: update proxyARP test case

 - update to better reflect test in CSIT-functional

Change-Id: I7412bfea34c867cd14ee95b857f30d6923998ff2
Signed-off-by: selias <samelias@cisco.com>
3 years agoModify garbage cleaning on VIRL 35/6835/2
Peter Mikus [Tue, 23 May 2017 07:40:41 +0000 (07:40 +0000)]
Modify garbage cleaning on VIRL

Decrease the threshold of old session directories and add cleaning of non-empty directories

Change-Id: I77950065e5e09aaaf38cf2d9cb3f4c3f8cdcf58c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpgrade T-rex to version 2.25 24/6824/4
Peter Mikus [Mon, 22 May 2017 13:16:24 +0000 (15:16 +0200)]
Upgrade T-rex to version 2.25

- Upgrade T-rex to v2.25 with multiple bug fixes.

Change-Id: Idc422172ce98c37ace7bbbf054a2b024c313bbf7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files and DPDK_STABLE_VER file 26/6826/1
Jan Gelety [Mon, 22 May 2017 13:47:53 +0000 (15:47 +0200)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file

- use new vpp ref build - ubuntu 16.04:
  17.07-rc0~144-g36c1308~b2247_amd64

- use new vpp ref build - centos7:
  17.07-rc0~268-gc7409dc~b2371_amd64

- use new DPDK version:
  17.05-vpp3

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/39/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/39/

Change-Id: I7ed3e1011ae6b1e9fa9a6a3fd98fc5ebcb8bfdf9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoHC Test: Improve logging of Honeycomb and VPP restart 59/6759/5
selias [Thu, 18 May 2017 11:10:33 +0000 (13:10 +0200)]
HC Test: Improve logging of Honeycomb and VPP restart

Change-Id: I69d73ba3f672af88563715d17c94c73d8d5e7ff2
Signed-off-by: selias <samelias@cisco.com>
3 years agoUpdate: Topology file for TB1 82/6782/1
Peter Mikus [Fri, 19 May 2017 09:12:45 +0000 (11:12 +0200)]
Update: Topology file for TB1

- Update topology file for TB1 after card replacement

Change-Id: Id346b747bb600b6796a447a23b1a4e37961a8c7e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years ago TLDK Bootstrap.sh file to support the jenkins job scheduling. 02/6602/4
qun wan [Thu, 4 May 2017 20:28:23 +0000 (16:28 -0400)]
TLDK Bootstrap.sh file to support the jenkins job scheduling.

Change-Id: Ia89e5a32fdc963a1c20345da1310b7958cd34c48
Signed-off-by: qun wan <qun.wan@intel.com>
3 years agoCSIT-580: IPSec tests - modifications related to the latest changes 15/6715/18
Tibor Frank [Tue, 16 May 2017 07:12:16 +0000 (09:12 +0200)]
CSIT-580: IPSec tests - modifications related to the latest changes

- The startup option 'enable-cryptodev' has been removed and unless
  not enough cryptodevs are found, DPDK cryptodev will be enabled by default.

Change-Id: I19a483435256d8cf4101dc9f10a7c95ed5594e75
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-557 HC Test: Fix ODL setup in Honeycomb-odl jobs 41/6741/2
selias [Wed, 17 May 2017 11:24:09 +0000 (13:24 +0200)]
CSIT-557 HC Test: Fix ODL setup in Honeycomb-odl jobs

Change-Id: I917f3bfd9cea043e1bc820536db07697e0d41040
Signed-off-by: selias <samelias@cisco.com>
3 years agoFix start-testcase script on VIRL 56/6656/10
Peter Mikus [Fri, 12 May 2017 06:38:51 +0000 (08:38 +0200)]
Fix start-testcase script on VIRL

- Fix pylint errors
- Add expiry option to set expiration of simulation
- Add more sanitization of exceptions
- Fix printing of debug messages to stderr

Change-Id: Iecc1fe042b6da104a164fb5701e665b6f3aa298b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoFunc test reorg - decrease exec time per vpp patch 11/6611/8
Jan Gelety [Fri, 5 May 2017 14:26:41 +0000 (16:26 +0200)]
Func test reorg - decrease exec time per vpp patch

- remove tests covered by make test
- remove some negative tests

Change-Id: I35d641562ee85888f7d1dd60dd892689b1e9c52d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoCSIT-576 HC Test: Improve SPAN test coverage 54/6654/4
selias [Thu, 11 May 2017 16:02:03 +0000 (18:02 +0200)]
CSIT-576 HC Test: Improve SPAN test coverage

 - add test for multiple destination interfaces using one source interface
 - duplicate all existing cases using a sub-interface as the destination

Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3
Signed-off-by: selias <samelias@cisco.com>
3 years agoCSIT-577 HC Test: Scripts for test jobs using ODL client 63/6663/4
selias [Wed, 10 May 2017 15:41:11 +0000 (17:41 +0200)]
CSIT-577 HC Test: Scripts for test jobs using ODL client

ODL client can be used to translate Restconf requests into Netconf. This
way Honeycomb's Netconf interface can be tested using existing test cases.

 - add bootstrap scripts for verify and integration job
 - update __init__.robot to handle new {HC_ODL} variable

Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86
Signed-off-by: selias <samelias@cisco.com>
3 years agoCSIT-562 HC Test: Persistence suite rework, part1 22/6622/4
selias [Tue, 9 May 2017 10:38:35 +0000 (12:38 +0200)]
CSIT-562 HC Test: Persistence suite rework, part1

 - rename keywords that check operational data, to distinguish from keywords
that check configuration data
 - modify existing persistence cases so that they don't affect each other
 - add feature-specific persistence tests for: Interface Management, L2 bridge
 - move Interface Management variables to separate file so they can be reused
 - add new tag HC_PERSIST to execute persistence tests separately
 - update existing Honeycomb tags to comply with CSIT conventions

More feature-specific tests to be added in part2.

Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef
Signed-off-by: selias <samelias@cisco.com>
3 years agoCSIT-563: HC Test: improved Lisp test coverage 92/6492/9
jan.hradil [Thu, 27 Apr 2017 10:07:59 +0000 (12:07 +0200)]
CSIT-563: HC Test: improved Lisp test coverage

added TC09-TC14 with following features:
Map Resolver
Map Server
PETR configuration
RLOC Probing
Map Register
Map Request mode

Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Signed-off-by: selias <samelias@cisco.com>
3 years agoFix: use pci/rescan to avoid occasional bind issue on Centos7 17/6717/3
Jan Gelety [Tue, 16 May 2017 08:21:51 +0000 (10:21 +0200)]
Fix: use pci/rescan to avoid occasional bind issue on Centos7

- rarelly binding of one of TG interfaces fails with "No such
  device" error; usage of rescan should avoid such situations

Change-Id: Icbeb48ea6f8adb863e6517d4a35d6aca4238309a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAdd RA suppress to IPv6 Equal-cost multipath routing test case 24/6724/2
Jan Gelety [Tue, 16 May 2017 14:03:52 +0000 (16:03 +0200)]
Add RA suppress to IPv6 Equal-cost multipath routing test case

Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix typo in weekly bootstrap file 20/6720/2
Jan Gelety [Tue, 16 May 2017 12:48:47 +0000 (14:48 +0200)]
Fix typo in weekly bootstrap file

Change-Id: I2dc221c433ba87d0f98082c0c3aef2df838cd750
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAdd Garbage Cleanning to VIRL 18/6718/2
Peter Mikus [Tue, 16 May 2017 09:48:43 +0000 (11:48 +0200)]
Add Garbage Cleanning to VIRL

- add cleaning of old VPP builds (deb|rpm)
- add cleaning of old session dirs
- add cleaning of old QEMU logs

Change-Id: Ib2849cc3969de75525f13d80dc87b32fb82865af
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoBump to DPDK 1705 vpp2 92/6692/1
Neale Ranns [Mon, 15 May 2017 10:44:00 +0000 (03:44 -0700)]
Bump to DPDK 1705 vpp2

Change-Id: I6cc48962433e105c10384faa192d91a2c390011c
Signed-off-by: Neale Ranns <nranns@cisco.com>
3 years agoDPDK version bump 81/6681/1
Neale Ranns [Sun, 14 May 2017 17:39:44 +0000 (10:39 -0700)]
DPDK version bump

Change-Id: Ia89d64a2c985ff949969c406f0e6cea03cc8c170
Signed-off-by: Neale Ranns <nranns@cisco.com>
3 years agoFix: SetupFramework sparse file handling 57/6657/1
Peter Mikus [Fri, 12 May 2017 07:47:07 +0000 (09:47 +0200)]
Fix: SetupFramework sparse file handling

- Fix the issue during packing of the framework when source
directory contains sparse files. By default tar is throwing
warning resulting in return code other then 0.

Change-Id: I39a9c1956685158e2e0fd9ef9545f90e3ef2a89f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-574: IPSec Scale File Splits 93/6593/10
jan.hradil [Thu, 4 May 2017 11:20:51 +0000 (13:20 +0200)]
CSIT-574: IPSec Scale File Splits

split file into two separate files based on number of tunnels
values 1 or 1000
corrected name errors - scale -> base

Change-Id: I7114c777f3cc3d7f4951a1f59e54f3a7bbe404ec
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
3 years agoCSIT-573: Split SNAT scale tests to multiple files 92/6592/10
jan.hradil [Thu, 4 May 2017 08:28:43 +0000 (10:28 +0200)]
CSIT-573: Split SNAT scale tests to multiple files

split file with many test cases into mutliple files based on
users and ports
added SRC_USER tags
removed empty lines at EOF

Change-Id: I19c79cdf8d7de4147c98bc061559af1fde10ab8c
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
3 years agocsit report - fixed table format in vpp_performance_tests/csit_release_notes.rst 24/6624/1
Maciek Konstantynowicz [Tue, 9 May 2017 15:49:12 +0000 (16:49 +0100)]
csit report - fixed table format in vpp_performance_tests/csit_release_notes.rst

Change-Id: Ie9d4a9ba373c0e6131f0a2d3e49f20a315da3b9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoHC Test: update routing test keyword due to namespace changes 09/6609/1
selias [Fri, 5 May 2017 11:43:05 +0000 (13:43 +0200)]
HC Test: update routing test keyword due to namespace changes

 - changed in https://gerrit.fd.io/r/6303

Change-Id: If5fdfcf21c757f9199f168bfd044c7fefce87bef
Signed-off-by: selias <samelias@cisco.com>
3 years agoUse 'Qemu Kill All' in perf test teardown 56/6556/5
Jan Gelety [Tue, 2 May 2017 11:51:55 +0000 (13:51 +0200)]
Use 'Qemu Kill All' in perf test teardown

- replace 'Qemu Kill' KW by 'Qemu Kill All'
- use self.qemu_kill_all() in case of qemu_start(self) failure

Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoHC Test: Update honeycomb suite setup 57/6557/6
selias [Tue, 2 May 2017 07:54:02 +0000 (09:54 +0200)]
HC Test: Update honeycomb suite setup

 - remove workaround for jVPP version mismatch
 - increase Java API command timeout

Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019
Signed-off-by: selias <samelias@cisco.com>
3 years agoCSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test cases 96/6496/6
Jan Gelety [Thu, 27 Apr 2017 12:12:10 +0000 (14:12 +0200)]
CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test cases

Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate to csit rls1704 report - perf changes tables - based on increased number of... 82/6582/2
Maciek Konstantynowicz [Wed, 3 May 2017 13:20:43 +0000 (14:20 +0100)]
Update to csit rls1704 report - perf changes tables - based on increased number of test job executions.

Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoUpdates to csit rls1704 report related to increased number of test job executions. 80/6580/2
Maciek Konstantynowicz [Wed, 3 May 2017 12:17:42 +0000 (13:17 +0100)]
Updates to csit rls1704 report related to increased number of test job executions.

Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoFix Honeycomb source data path for report. 75/6575/2
Peter Mikus [Wed, 3 May 2017 07:23:00 +0000 (07:23 +0000)]
Fix Honeycomb source data path for report.

Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpdate links with source data for rls report 73/6573/1
Peter Mikus [Wed, 3 May 2017 06:33:30 +0000 (08:33 +0200)]
Update links with source data for rls report

Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpdate data points for rls1704 report 69/6569/1
Peter Mikus [Wed, 3 May 2017 05:19:41 +0000 (07:19 +0200)]
Update data points for rls1704 report

Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agocsit-validate-pylint-master/3731 for build 3731 04/6504/5
jan.hradil [Thu, 27 Apr 2017 12:47:16 +0000 (14:47 +0200)]
csit-validate-pylint-master/3731 for build 3731

pylint repairs
deleted duplicated method from HcPersistence.py

Change-Id: I426e6c15957c995ea10bd11ae2deac75b1cab922
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
3 years agoFix: VAT timeout in IPv6 scale 2M 13/6513/5
Peter Mikus [Fri, 28 Apr 2017 06:43:25 +0000 (08:43 +0200)]
Fix: VAT timeout in IPv6 scale 2M

- Fix VAT timeout issue in IPv6 scale testing with 2M FIB entries
by increasing heapsize to 3G

Change-Id: Ie81619085fbd5a2a86848513d139932a12babf67
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpdate ansible playbooks VIRL setup 05/6505/2
Matej Klotton [Thu, 27 Apr 2017 13:35:10 +0000 (15:35 +0200)]
Update ansible playbooks VIRL setup

Change-Id: I704991c65dc5fc9ce40ade932cab104fa468696c
Signed-off-by: Matej Klotton <mklotton@cisco.com>
3 years agocsit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files. 00/6500/4
Maciek Konstantynowicz [Thu, 27 Apr 2017 12:35:33 +0000 (13:35 +0100)]
csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.

Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoUpdate of VPP_STABLE_VER_UBUNTU 81/6481/2
Jan Gelety [Thu, 27 Apr 2017 07:40:39 +0000 (09:40 +0200)]
Update of VPP_STABLE_VER_UBUNTU

- use new vpp ref build: 17.07-rc0~144-g36c1308~b2247_amd64
- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/31/

Change-Id: Ie1541da709828aebfcbb1068427d9b3f7e97ffc6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agocsit rls1704 report: final update to csit_release_notes.rst, packet_*_graphs.rst... 95/6495/2
Maciek Konstantynowicz [Thu, 27 Apr 2017 11:11:56 +0000 (12:11 +0100)]
csit rls1704 report: final update to csit_release_notes.rst, packet_*_graphs.rst files.

Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport-gen update 82/6482/2
Peter Mikus [Thu, 27 Apr 2017 08:14:36 +0000 (10:14 +0200)]
Report-gen update

- fix header in IPsec sections
- fix IP4 regexp to include SNAT
- update source data for perf trending
- fix rendering of Trex section

Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agocsit rls1704 report: updates to csit_release_notes.rst files. 86/6486/1
Maciek Konstantynowicz [Thu, 27 Apr 2017 09:03:31 +0000 (10:03 +0100)]
csit rls1704 report: updates to csit_release_notes.rst files.

Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoupdate to csti rls1704 report: vpp_unittest_results.rst 76/6476/3
Maciek Konstantynowicz [Wed, 26 Apr 2017 20:43:00 +0000 (21:43 +0100)]
update to csti rls1704 report: vpp_unittest_results.rst

Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoFix: Report table layout in RTD Sphinx 74/6474/2
Peter Mikus [Wed, 26 Apr 2017 18:02:44 +0000 (20:02 +0200)]
Fix: Report table layout in RTD Sphinx

Change-Id: Ibdac46c7ec6d8381da89ea9bb7e407b91c5029df
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT rls1704 report - small updates 72/6472/2
Jan Gelety [Wed, 26 Apr 2017 15:17:02 +0000 (17:17 +0200)]
CSIT rls1704 report - small updates

Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoEdits to csit rls1704 report: vpp_unit_tests sections. 63/6463/2
Maciek Konstantynowicz [Wed, 26 Apr 2017 13:25:06 +0000 (14:25 +0100)]
Edits to csit rls1704 report: vpp_unit_tests sections.

Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoEdits to csit rls1704 report: csit_tag_description.rst. 66/6466/2
Maciek Konstantynowicz [Wed, 26 Apr 2017 13:42:41 +0000 (14:42 +0100)]
Edits to csit rls1704 report: csit_tag_description.rst.

Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agocsit rls1704 report - updated csit_release_notes.rst and overview.rst files. 54/6454/6
Maciek Konstantynowicz [Wed, 26 Apr 2017 11:37:26 +0000 (12:37 +0100)]
csit rls1704 report - updated csit_release_notes.rst and overview.rst files.

Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoCSIT rls1704 report - update of functional csit_release_notes.rst 49/6449/2
Jan Gelety [Wed, 26 Apr 2017 10:47:51 +0000 (12:47 +0200)]
CSIT rls1704 report - update of functional csit_release_notes.rst

Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT doc gen: Use html <pre> tag for data from teardown. 61/6461/2
Jan Gelety [Wed, 26 Apr 2017 12:49:17 +0000 (14:49 +0200)]
CSIT doc gen: Use html <pre> tag for data from teardown.

Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate run_report.sh script for generating report 53/6453/1
Peter Mikus [Wed, 26 Apr 2017 11:32:53 +0000 (13:32 +0200)]
Update run_report.sh script for generating report

Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpdate: report source data links 43/6443/1
Peter Mikus [Wed, 26 Apr 2017 07:03:19 +0000 (09:03 +0200)]
Update: report source data links

Change-Id: I74b9b1070380dcc5f721d695989f3bd676b6df91
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rst 35/6435/1
Jan Gelety [Tue, 25 Apr 2017 19:42:03 +0000 (21:42 +0200)]
CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rst

Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rst 26/6426/3
Jan Gelety [Tue, 25 Apr 2017 15:35:00 +0000 (17:35 +0200)]
CSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rst

Change-Id: I400f49ab5399a83b925fbbe2b52e37fd97f464f0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agorls1704 report - updated sections: 32/6432/3
Maciek Konstantynowicz [Tue, 25 Apr 2017 18:39:35 +0000 (19:39 +0100)]
rls1704 report - updated sections:
- vpp_performance_tests/overview.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/test_environment
- honeycomb_functional_tests/csit_release_notes

Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoFix: CSIT report gen for policer 28/6428/1
Jan Gelety [Tue, 25 Apr 2017 16:17:41 +0000 (18:17 +0200)]
Fix: CSIT report gen for policer

Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT rls1704 report - update to handcrafted sections: 46/6346/11
Maciek Konstantynowicz [Fri, 21 Apr 2017 19:42:05 +0000 (20:42 +0100)]
CSIT rls1704 report - update to handcrafted sections:
- index.rst
- vpp_performance_tests/csit_release_notes
- vpp_performance_tests/overview.rst
- vpp_performance_tests/packet_throughput_graphs/...
- testpmd_performance_tests/csit_release_notes.rst
- vpp_functional_tests/csit_release_notes.rst
- testpmd_performance_tests/packet_latency_graphs/...
- testpmd_performance_tests/packet_throughput_graphs/...

Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoVhost tests 94/5794/15
Matej Klotton [Mon, 20 Mar 2017 08:38:02 +0000 (09:38 +0100)]
Vhost tests

Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1
Signed-off-by: Matej Klotton <mklotton@cisco.com>
3 years agoImprove doc in data driven perf tests 02/6402/3
Tibor Frank [Tue, 25 Apr 2017 08:44:33 +0000 (10:44 +0200)]
Improve doc in data driven perf tests

Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix: CSIT report gen - teardonw data + run_report.sh 18/6418/1
Jan Gelety [Tue, 25 Apr 2017 12:59:17 +0000 (14:59 +0200)]
Fix: CSIT report gen - teardonw data + run_report.sh

Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate report links to source data 12/6412/1
Peter Mikus [Tue, 25 Apr 2017 11:21:40 +0000 (13:21 +0200)]
Update report links to source data

Change-Id: Ifd5689eac5251316e24283fb94526ad52567d1ac
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT doc gen: Add configurations and operational data. 98/6398/5
Jan Gelety [Tue, 25 Apr 2017 07:53:19 +0000 (09:53 +0200)]
CSIT doc gen: Add configurations and operational data.

- vpp perf configurations and operational data
- vpp func configurations

Change-Id: I634682e55a2862b927546e2657aabb242c730be1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT doc gen: Script to get data from teardown. 68/6368/7
Jan Gelety [Thu, 20 Apr 2017 14:22:30 +0000 (16:22 +0200)]
CSIT doc gen: Script to get data from teardown.

- generate rst/html/md/wiki file with required data from teardown per TC
- implemented:
- VAT command history of all DUTs per TC
- ouptup of CLI command "Show Runtime" (VPP operational data)

Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years ago1704 report - fix mistake in honeycomb section 08/6408/1
selias [Tue, 25 Apr 2017 10:23:09 +0000 (12:23 +0200)]
1704 report - fix mistake in honeycomb section

Change-Id: I6517ea48a6df95cc855596843d736658471486ea
Signed-off-by: selias <samelias@cisco.com>
3 years agoCSIT-534 HC Test: policer tests 18/6218/9
jan.hradil [Tue, 11 Apr 2017 07:28:07 +0000 (09:28 +0200)]
CSIT-534 HC Test: policer tests

Added empty lines where needed
Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot
Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation

Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
3 years ago1704 Report - Honeycomb section 00/6400/2
selias [Tue, 25 Apr 2017 07:22:58 +0000 (09:22 +0200)]
1704 Report - Honeycomb section

Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c
Signed-off-by: selias <samelias@cisco.com>
3 years agoDownload the latest VPP build for *NIGHTLY and *DAILY jobs 67/6367/2
Tibor Frank [Mon, 24 Apr 2017 06:38:08 +0000 (08:38 +0200)]
Download the latest VPP build for *NIGHTLY and *DAILY jobs

Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix: Report vhost and testpmd plots 72/6372/1
Peter Mikus [Mon, 24 Apr 2017 11:05:12 +0000 (13:05 +0200)]
Fix: Report vhost and testpmd plots

Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoFix: Report generation 69/6369/3
Peter Mikus [Mon, 24 Apr 2017 08:56:32 +0000 (10:56 +0200)]
Fix: Report generation

- Add IPsec plots
- Fix plots rendering

Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-554: Performance jobs reorganisation, part 4 97/6297/3
Tibor Frank [Thu, 20 Apr 2017 13:10:52 +0000 (15:10 +0200)]
CSIT-554: Performance jobs reorganisation, part 4

Add:
 - vpp-csit-verify-hw-perf

Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-557: Performance jobs reorganisation, part 3 71/6271/5
Tibor Frank [Wed, 19 Apr 2017 13:29:51 +0000 (15:29 +0200)]
CSIT-557: Performance jobs reorganisation, part 3

Add:
 - csit-vpp-perf-verify

Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdisc 60/6360/1
Peter Mikus [Mon, 24 Apr 2017 05:21:43 +0000 (07:21 +0200)]
Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdisc

- Fix missing keyword

Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpdate data source for release report 54/6354/1
Peter Mikus [Sat, 22 Apr 2017 19:09:31 +0000 (21:09 +0200)]
Update data source for release report

Change-Id: Ifccd3fd895ae52c78b1ae7a6d0d30d9334d30a05
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoFix typo in run_report 51/6351/2
Peter Mikus [Sat, 22 Apr 2017 05:21:28 +0000 (07:21 +0200)]
Fix typo in run_report

Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoFix run_report.sh 49/6349/1
Peter Mikus [Sat, 22 Apr 2017 05:00:28 +0000 (07:00 +0200)]
Fix run_report.sh

- fix sed delimiter to eliminate /

Change-Id: I4d6253d7845937ee452da342819d1c390ca28054
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoReport generation script updates 05/6205/14
pmikus [Thu, 13 Apr 2017 20:06:17 +0000 (22:06 +0200)]
Report generation script updates

- Add new type of throughput plots
- Update Sphinx, Sphinx-rtd-theme and Plotly packages
- Add auto generation of detailed test results
- Small fixes

Change-Id: I706777160a7f166e0a335c64428d10cb546fa854
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoAdded Ethernet frame size tags for performance tests: 27/6327/4
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:04:40 +0000 (12:04 +0100)]
Added Ethernet frame size tags for performance tests:
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B.

Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agotag_documentation.rst - added: 29/6329/3
Maciek Konstantynowicz [Fri, 21 Apr 2017 11:15:15 +0000 (12:15 +0100)]
tag_documentation.rst - added:
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B.

Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoCSIT rls1704 report - update to handcraftec sections: 07/6307/2
Maciek Konstantynowicz [Thu, 20 Apr 2017 21:42:01 +0000 (22:42 +0100)]
CSIT rls1704 report - update to handcraftec sections:

- introduction /overview /general_notes /csit_test_naming
- vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs
- vpp_functional_tests /overview /csit_release_notes /documentation
- testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs

Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agotag_documentation.rst - added: Ethernet frame size tags for performance tests 22/6322/2
Maciek Konstantynowicz [Fri, 21 Apr 2017 09:25:35 +0000 (10:25 +0100)]
tag_documentation.rst - added: Ethernet frame size tags for performance tests

Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoCSIT-561: Add release and version to the header 12/6312/2
Tibor Frank [Fri, 21 Apr 2017 07:54:07 +0000 (09:54 +0200)]
CSIT-561: Add release and version to the header

Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoHC Test: update plugin-ACL test suite 42/6242/5
selias [Thu, 13 Apr 2017 10:28:43 +0000 (12:28 +0200)]
HC Test: update plugin-ACL test suite

 - fix variables in routed icmpv6 test case
 - remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases
 - create and use keywords for test teardown

Change-Id: I91792b5900015827bc2bcfd138192f972f92df28
Signed-off-by: selias <samelias@cisco.com>
3 years agoCSIT-561: Add filtering of testsuits to report generation 63/6263/2
Tibor Frank [Wed, 19 Apr 2017 12:13:24 +0000 (14:13 +0200)]
CSIT-561: Add filtering of testsuits to report generation

Change-Id: I751600f7ea9937bc8bfde7d6062eeaadf3ee68dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUse QEMU virtio queue size 1024 for perf tests 97/6197/21
Jan Gelety [Thu, 13 Apr 2017 15:01:13 +0000 (17:01 +0200)]
Use QEMU virtio queue size 1024 for perf tests

- use Build QEMU KW to apply patch to increase default virtio queue size
- remove Set Scheduler Policy

Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT-559: Performance jobs reorganisation, part 3 24/6224/4
Tibor Frank [Tue, 18 Apr 2017 10:56:31 +0000 (12:56 +0200)]
CSIT-559: Performance jobs reorganisation, part 3

Add:
 - csit-vpp-perf-ndrchk-daily

Change-Id: I4edfa86810744168307d9cbeb979d40dc5e21eb0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-558: Performance jobs reorganization, part 2 67/6167/5
Tibor Frank [Wed, 12 Apr 2017 14:10:45 +0000 (16:10 +0200)]
CSIT-558: Performance jobs reorganization, part 2

Add:
 - csit-vpp-perf-check

Change-Id: I31e40d37e38d27d3be15a40f6044ce5d907067be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix: IPSec+Lisp suite naming 51/6251/1
Peter Mikus [Wed, 19 Apr 2017 06:05:50 +0000 (08:05 +0200)]
Fix: IPSec+Lisp suite naming

Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-560: csit src code doc generation for 1704 32/6232/2
Tibor Frank [Tue, 18 Apr 2017 12:54:10 +0000 (14:54 +0200)]
CSIT-560: csit src code doc generation for 1704

Change-Id: I9f07f326e12942404d670004bb9463039967f954
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoHC Test: update persistence suite 21/6221/4
selias [Tue, 18 Apr 2017 10:01:27 +0000 (12:01 +0200)]
HC Test: update persistence suite

 - fix "enable persistence" is suite setup
 - update Jira links to persistence bug
 - log content of persistence file before each restart

Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7
Signed-off-by: selias <samelias@cisco.com>
3 years agoCSIT-531: Performance jobs reorganization, part 1 33/6133/4
Tibor Frank [Tue, 11 Apr 2017 09:26:17 +0000 (11:26 +0200)]
CSIT-531: Performance jobs reorganization, part 1

Add:
 - csit-vpp-perf-trend-daily
 - csit-vpp-perf-trend-semiweekly

Change-Id: I59ed581f9fb2457cf1e3a58bac625f3b807d653f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.