csit.git
5 years agoConvert existing nf_density testpmd-mac into KernelVM 42/18742/12
Peter Mikus [Mon, 8 Apr 2019 12:31:25 +0000 (12:31 +0000)]
Convert existing nf_density testpmd-mac into KernelVM

Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd notes for traffic_type argument 15/18815/1
Vratko Polak [Thu, 11 Apr 2019 12:45:32 +0000 (14:45 +0200)]
Add notes for traffic_type argument

To make this gerrit comment permanently visible in code:
https://gerrit.fd.io/r/#/c/17811/50/resources/libraries/python/InterfaceUtil.py@1335

Change-Id: I2b763d88fcc8186c9479a0f0c3336d8eeb8aed95
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoTrending: Reduce input data 84/18784/8
Tibor Frank [Wed, 10 Apr 2019 07:42:13 +0000 (09:42 +0200)]
Trending: Reduce input data

Change-Id: Ia787036e4a717b9693df09fc75738369d6d39b57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agofix auth for newer ODL versions 66/18766/2
Michal Cmarada [Tue, 9 Apr 2019 14:53:46 +0000 (16:53 +0200)]
fix auth for newer ODL versions

Since oxygen we need to add also "-p karaf" argument when
starting karaf and because we are not using older versions
anymore we can remove the if condition and use new authentication
by default.

Change-Id: I458fa35b7f26222dd5562349e6859844bfb7d05f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoAdd vagrant setup for testing VPP device locally 43/17343/3
Ludovit Mikula [Wed, 6 Feb 2019 14:47:23 +0000 (15:47 +0100)]
Add vagrant setup for testing VPP device locally
Fixed trailing whitespaces
Fixed tabs vs. spaces
Removed dead code
Changed network interface naming
Changed default number of retries for VPP startup to 120
Updated number of hugepages during provisioning
Externalized CSIT related sysctl settings to 90-csit.conf
Removed hardcoded local docker image name.
Added new interface required for honeycomb device testing.

Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
5 years agoAdd support DHCP Server Support for DNV 49/18749/4
Ray Kinsella [Mon, 8 Apr 2019 15:29:59 +0000 (16:29 +0100)]
Add support DHCP Server Support for DNV

Adding DHCP Server support for 2-node and 3-node DNV setups

Change-Id: If3d3517fd91ab46308c368910c1e79f5c25cc904
Signed-off-by: Ray Kinsella <ray.kinsella@intel.com>
5 years agoUpdate of ubuntu VPP_STABLE_VER 30/18730/2
Jan Gelety [Wed, 3 Apr 2019 01:39:11 +0000 (03:39 +0200)]
Update of ubuntu VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.04-rc0~640-g05f7ca1~b6800

- use new vpp ref build - ubuntu 18.04:
  19.04-rc0~640-g05f7ca110

Change-Id: I940b044210d3a552fb2af75359f62795230cd2ad
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoupdate tests after ODL bump to Neon 16/18616/14
Michal Cmarada [Tue, 9 Apr 2019 06:12:05 +0000 (08:12 +0200)]
update tests after ODL bump to Neon

Change-Id: Ia733ad304c51b28f2a945e570120821254077189
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoFix l2 Honeycomb tests 37/18737/3
Michal Cmarada [Mon, 8 Apr 2019 10:27:32 +0000 (12:27 +0200)]
Fix l2 Honeycomb tests

Change-Id: Ic75a9279fffe3a5d11211f4e57fc635d7d33ee5f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoUpgrade autogen to NICs and search types 11/17811/84
Vratko Polak [Thu, 4 Apr 2019 11:45:11 +0000 (13:45 +0200)]
Upgrade autogen to NICs and search types

+ All perf suites updated, as autogen change is backward incompatible.
+ Only x710 -ndrpdr suites remain in git repository.
+ Removed retry feature of run_tests.
+ Renamed topology_type and traffic_type to traffic_profile.
+ Renamed framesize to frame_size; nic_model to nic_name.
+ Reordered Variables table to start with nic_name and overhead.
+ Fixed wrong overhead value in some cbc-sha1 suites.
+ Fixed some suite tags.
++ Introduced tags to distinguish suites, such as IPSECINT.
+ Bound crypto hardware to NIC name.
+ Implemented NIC limit hiding.
+ Also search and teardown related arguments are now hidden.
+ Main measurement keywords updated to new arg handling.
+ Max rate related keywords moved to performance_limits.robot
+ Teardowns unified.
+ Generated tests are archived.
++ Generated directory is .gitignore-d.
+ Regenerator raises an exception on seeing non-compatible suite.
++ Relatively helpful message should be seen in exception.
+ Suite and template Documentation has generated parts.
+- With short NIC names only.
+ Autogen checker also upgraded.
+ Tag expressions replaced with long files to ensure analogous tests.

Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoRemove lbdpdk perf tests 23/18723/2
Peter Mikus [Sun, 7 Apr 2019 16:38:32 +0000 (16:38 +0000)]
Remove lbdpdk perf tests

- They are not used anywhere and failing all the time.

Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoRemove obsolete FDS tests 28/18728/1
Jan Gelety [Wed, 3 Apr 2019 01:28:13 +0000 (03:28 +0200)]
Remove obsolete FDS tests

Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: Qemu set affinity bug 22/18722/4
Peter Mikus [Sun, 7 Apr 2019 12:55:51 +0000 (12:55 +0000)]
FIX: Qemu set affinity bug

Change-Id: If1df58628b2150b1ea3f2f56b1e3d442176b0750
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: Operational issues 18/18718/3
Peter Mikus [Fri, 5 Apr 2019 21:47:48 +0000 (21:47 +0000)]
FIX: Operational issues

- FIX MSR package installation
- FIX VTS
- FIX sockets by removing from TCs

Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFixes for Taishan testbed 15/18115/9
juraj.linkes [Thu, 7 Mar 2019 13:03:36 +0000 (14:03 +0100)]
Fixes for Taishan testbed

* rename NICs in Taishan testbed to Intel-X520-DA2
* fix testbed NIC selection
* remove unnecessary 82599es tests
* blacklist unsupported tests on Taishan testbed
* lowercase previously created bash local variables

Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoAdd vpp-api-python for honeycomb tests 27/18627/3
Michal Cmarada [Tue, 2 Apr 2019 06:51:16 +0000 (08:51 +0200)]
Add vpp-api-python for honeycomb tests

 - Csit is migrating VAT scripts to PAPI, therefore
   python package for vpp is needed in honeycomb tests.

Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoTrending: Remove NF tests from alerts 82/18682/1
Tibor Frank [Thu, 4 Apr 2019 11:50:31 +0000 (13:50 +0200)]
Trending: Remove NF tests from alerts

Change-Id: Id8074a30f578af7df5bb15e9c127838d27cae8b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Alerts 18/18618/29
Tibor Frank [Mon, 1 Apr 2019 14:31:38 +0000 (16:31 +0200)]
Trending: Alerts

Change-Id: I1c744f4eeefe3082be02daa681bfc032d6db4d15
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoChange 2 node Denverton testbed description 13/18613/2
Yulong Pei [Mon, 1 Apr 2019 13:06:41 +0000 (21:06 +0800)]
Change 2 node Denverton testbed description

Change-Id: I09c5ac3c4fe90b1fff46c4211b401daefe40ac31
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agoUpdate draft-vpolak-mkonstan-bmwg-mlrsearch-00->01. 47/18647/1
Maciek Konstantynowicz [Tue, 2 Apr 2019 17:52:33 +0000 (18:52 +0100)]
Update draft-vpolak-mkonstan-bmwg-mlrsearch-00->01.

Change-Id: I7345fdf63a1e7355812e5089e16e14f47cd6e890
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoTrending: Remove invalid builds (3n-skx 356-372) 28/18628/2
Tibor Frank [Tue, 2 Apr 2019 07:10:05 +0000 (09:10 +0200)]
Trending: Remove invalid builds (3n-skx 356-372)

Change-Id: I8de833a87536b60382c54fa9be2f443ff8a7d900
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1412: Create trending graphs for svc density 35/17335/52
Tibor Frank [Wed, 6 Feb 2019 07:22:32 +0000 (08:22 +0100)]
CSIT-1412: Create trending graphs for svc density

 - static content
 - plots

Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1337: Migrate L2Util library from VAT to PAPI 10/18110/30
Jan Gelety [Wed, 6 Mar 2019 20:47:28 +0000 (21:47 +0100)]
CSIT-1337: Migrate L2Util library from VAT to PAPI

Change-Id: I22879c7bdd100d00216b9528663bf17406169826
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: change socket location for vhost-user interface 69/18569/2
Jan Gelety [Tue, 26 Mar 2019 17:57:06 +0000 (18:57 +0100)]
FIX: change socket location for vhost-user interface

Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoAdd ipsec crypto test for Denverton platform 46/18446/3
Yulong Pei [Thu, 21 Mar 2019 10:24:46 +0000 (18:24 +0800)]
Add ipsec crypto test for Denverton platform

add ipsec cryto test to support Denverton hardware crypto device C3xxx.
replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other
hardware crypto device type support in the future.

Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agoRe-enabling Honeycomb two IPs same subnet tests 71/17371/3
Michal Cmarada [Thu, 7 Feb 2019 08:47:13 +0000 (09:47 +0100)]
Re-enabling Honeycomb two IPs same subnet tests

 - reordering tests so unnumbered interface tests
   don't break following tests
 - removing EXPECTED_FAILING for fixed tests

Change-Id: Ic24d878849ab4f451e2fb59856c222167cb35d8f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoReport: Configure 1901.1.13 62/18562/1
Tibor Frank [Thu, 28 Mar 2019 09:26:32 +0000 (10:26 +0100)]
Report: Configure 1901.1.13

Change-Id: I17c72ddb8bc5df364761c9e0453aeb128d7951e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFix Tap failing tests 34/18534/5
Michal Cmarada [Thu, 28 Mar 2019 07:38:32 +0000 (08:38 +0100)]
Fix Tap failing tests

Due to migration to Tap-v2 the old Tap API was removed.
This fixes failing tests where Tap interface was used.

Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoCSIT-1460: Add VPP-stats to PAPI Provider 19/18419/13
Tibor Frank [Wed, 20 Mar 2019 12:15:40 +0000 (13:15 +0100)]
CSIT-1460: Add VPP-stats to PAPI Provider

Change-Id: I2665700a4948c481585d66c987f94af748f102c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFix virl ubuntu image + update ubuntu vpp builds 46/18546/3
Jan Gelety [Tue, 26 Mar 2019 06:39:15 +0000 (07:39 +0100)]
Fix virl ubuntu image + update ubuntu vpp builds

Change-Id: Ifcb38f09a9a84c8dbae879ad34af11fe9be4a450
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Update vpp perf tests release notes 44/18544/1
Jan Gelety [Tue, 26 Mar 2019 03:29:55 +0000 (04:29 +0100)]
Report: Update vpp perf tests release notes

Change-Id: I00bf6cf1d1c38a125be03a82853426e7980e088a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: Do not restart VPP immediately after VPP installation 33/18533/5
Jan Gelety [Mon, 25 Mar 2019 23:49:45 +0000 (00:49 +0100)]
FIX: Do not restart VPP immediately after VPP installation

Change-Id: Ib3ee517c850953fe87f3036702d2924cf41a9998
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoTrending: Set the last build for dpdk-3n-skx 15/18515/1
Tibor Frank [Mon, 25 Mar 2019 15:35:51 +0000 (16:35 +0100)]
Trending: Set the last build for dpdk-3n-skx

 - presentation_new

Change-Id: I2764f6dd90b360ad778510e32d592a6295eb3236
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Set the last build for dpdk-3n-skx 13/18513/1
Tibor Frank [Mon, 25 Mar 2019 15:31:18 +0000 (16:31 +0100)]
Trending: Set the last build for dpdk-3n-skx

Change-Id: Ic38ad46547c9a007cc8d59e44fcf5955956e663e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix vpp-ref 07/18507/1
Tibor Frank [Mon, 25 Mar 2019 13:48:26 +0000 (14:48 +0100)]
Trending: Fix vpp-ref

Change-Id: Ie2da87f9afbe22229a35abcf8598923c888ab7ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Reduce the amount of downloaded data 05/18505/1
Tibor Frank [Mon, 25 Mar 2019 12:43:33 +0000 (13:43 +0100)]
Trending: Reduce the amount of downloaded data

Change-Id: I13aeccc993bbdd98c29845554da714ce10add5c0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix vpp-ref 03/18503/1
Tibor Frank [Mon, 25 Mar 2019 12:32:52 +0000 (13:32 +0100)]
Trending: Fix vpp-ref

Change-Id: I3179175f681a99709445e6603711060e46fa8885
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoRemove main.py as it is confusing 21/18421/2
Peter Mikus [Wed, 20 Mar 2019 13:16:14 +0000 (13:16 +0000)]
Remove main.py as it is confusing

People try to run main.py instead of Robot

Change-Id: Ieff219c9df7586842f796c5fb17500327d71a7d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate and reorder tox.ini TODOs 27/18427/3
Vratko Polak [Wed, 20 Mar 2019 14:15:35 +0000 (15:15 +0100)]
Update and reorder tox.ini TODOs

Change-Id: Ieeb54f3e3cb413f15dfbf6595211fd7158aa1e1a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoConvert functional tests to statefull QemuUtils 22/18422/8
Peter Mikus [Wed, 20 Mar 2019 13:21:26 +0000 (13:21 +0000)]
Convert functional tests to statefull QemuUtils

Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Add note about nr of test runs 51/18451/1
Tibor Frank [Thu, 21 Mar 2019 08:23:34 +0000 (09:23 +0100)]
Report: Add note about nr of test runs

Change-Id: If7a29bb268c422f788b418c597af8305e04847cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1386 KernelVM - Part II 57/18157/42
Peter Mikus [Sat, 9 Mar 2019 08:00:54 +0000 (08:00 +0000)]
CSIT-1386 KernelVM - Part II

- Implementation of KernelVM (ThinVM)
- nf_density tests for KernelVM with VPP as VNF.

Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoietf draft: nfv service density rev. -00 31/17131/10
Maciek Konstantynowicz [Mon, 28 Jan 2019 21:52:02 +0000 (21:52 +0000)]
ietf draft: nfv service density rev. -00

Change-Id: I0490db919b4da198545f4a332fd722855bac84a8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoAdd tox checker for lengths of new lines only 20/18420/1
Vratko Polak [Wed, 20 Mar 2019 12:23:30 +0000 (13:23 +0100)]
Add tox checker for lengths of new lines only

- Still non-voting, but useful.

Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 07/18407/1
Jan Gelety [Tue, 19 Mar 2019 16:54:31 +0000 (17:54 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.04-rc0~214-gcae98b7~b6361

- use new vpp ref build - centos7:
  19.04-rc0~214_gcae98b7~b6184

- use new vpp ref build - ubuntu 18.04:
  19.04-rc0~214-gcae98b72c

Change-Id: I5f8288278576fb28f5bf3754ac18b60cc21e3e6e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Remove VNF 82/18382/4
Tibor Frank [Tue, 19 Mar 2019 14:35:30 +0000 (15:35 +0100)]
Report: Remove VNF

- add comparisons for dnv

Change-Id: I123a925a3c91fba782f152b3cd73f1b63fe50c59
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Configure 1901.1 80/18380/1
Tibor Frank [Tue, 19 Mar 2019 14:05:35 +0000 (15:05 +0100)]
Report: Configure 1901.1

Change-Id: Ica2483bdaebe70b9d6668a36a1b855c52e4d7c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1386 KernelVM - Part I 48/18148/37
Peter Mikus [Fri, 8 Mar 2019 15:23:48 +0000 (15:23 +0000)]
CSIT-1386 KernelVM - Part I

- Refactor QemuUtils

Full refactor of QemuUtils to prepare for thinner VMs.

Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoPAPI Executor: Add more desciptive error message 22/18322/3
Tibor Frank [Fri, 15 Mar 2019 11:44:44 +0000 (12:44 +0100)]
PAPI Executor: Add more desciptive error message

- Add more desciptive error message to the processing of replies.

Change-Id: Ie43651370d5754aedf2515438c02ff4aa21bdc46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoPrepare image for KernelVM on machines. 51/18351/1
Peter Mikus [Sun, 17 Mar 2019 18:15:30 +0000 (18:15 +0000)]
Prepare image for KernelVM on machines.

TASK [sut : Get kernel-kvm version] ***************************************
changed: [10.30.51.52]

TASK [sut : Download kernel-kvm] ******************************************
changed: [10.30.51.52]

TASK [sut : Unpack kernel-kvm] ********************************************
changed: [10.30.51.52]

PLAY RECAP ****************************************************************
10.30.51.52                : ok=4    changed=3    unreachable=0    failed=0

Change-Id: I452f35e12c94fc58374679de21e87e36b145f987
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: Ansible warnings of deprecation 46/18346/1
Peter Mikus [Sat, 16 Mar 2019 07:41:07 +0000 (07:41 +0000)]
FIX: Ansible warnings of deprecation

[DEPRECATION WARNING]: Invoking "apt" only once while using a
loop via squash_actions is deprecated.

+ aenum pip fix version
+ crypto dependencies

Change-Id: I7ca4de48d68ec4d8a8f57fedf204fa6710a3e75f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Fix the information about 2-Node Atom Denverton 12/18312/2
Tibor Frank [Fri, 15 Mar 2019 08:38:24 +0000 (09:38 +0100)]
Report: Fix the information about 2-Node Atom Denverton

Change-Id: I137af7fd34d352c9ed2fba1ac5eca5a409c0ab92
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoPAPI: Add verification of the response 17/18117/18
Tibor Frank [Thu, 7 Mar 2019 13:43:13 +0000 (14:43 +0100)]
PAPI: Add verification of the response

Change-Id: I86afcaeae865f0af076b8dd974386a83de07bf44
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdding pip and apt packages - ubuntu16.04 98/18298/1
Jan Gelety [Thu, 14 Mar 2019 16:44:52 +0000 (17:44 +0100)]
Adding pip and apt packages - ubuntu16.04

- add python3-cffi to apt list
- add aenum to pip requirements

Change-Id: Iac0f4f69752db7d34693e83dd14bf68ad8cdc8ee
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoPapi: Back to python2, add aenum 87/18287/3
Tibor Frank [Thu, 14 Mar 2019 11:59:01 +0000 (12:59 +0100)]
Papi: Back to python2, add aenum

Change-Id: I3939af7dc29edb58dab7febff400007d91961081
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1461: Edit VPP Release notes 08/18208/4
Tibor Frank [Tue, 12 Mar 2019 11:33:18 +0000 (12:33 +0100)]
CSIT-1461: Edit VPP Release notes

Change-Id: I794fe95df97834b889bf24fc142c5478ce7c0623
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add Denverton static content 85/18285/1
Tibor Frank [Thu, 14 Mar 2019 11:51:55 +0000 (12:51 +0100)]
Report: Add Denverton static content

Change-Id: I0ba254c00f7aacb425034721fcaed73bfd4dbc01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add Denverton data 83/18283/1
Tibor Frank [Thu, 14 Mar 2019 11:37:24 +0000 (12:37 +0100)]
Report: Add Denverton data

Change-Id: I18054949ca135f204a068ad1d4db1b7a7fa413d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Reduce the amount of downloaded data 76/18276/1
Tibor Frank [Thu, 14 Mar 2019 09:12:47 +0000 (10:12 +0100)]
Trending: Reduce the amount of downloaded data

Change-Id: Ifa3fd25c018731c156d3864845dfb2d001e6ceb2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd PAPI dependencies 75/18275/3
Peter Mikus [Thu, 14 Mar 2019 08:02:56 +0000 (08:02 +0000)]
Add PAPI dependencies

+ Various small structure optmizations

Change-Id: I1aac9353f72436de53797fc734bef498905c8189
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdated IETF draft: draft-vpolak-bmwg-plrsearch-01. 81/15481/5
Maciek Konstantynowicz [Tue, 23 Oct 2018 16:55:05 +0000 (09:55 -0700)]
Updated IETF draft: draft-vpolak-bmwg-plrsearch-01.

Change-Id: I507d44f75383046b01def750af51a911b8ec5aa3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoPAPI: Use Python3 for PapiProvider 03/18203/9
Tibor Frank [Tue, 12 Mar 2019 07:22:21 +0000 (08:22 +0100)]
PAPI: Use Python3 for PapiProvider

Change-Id: I39e237db5cba8311ae11fd709b10a17297f3a729
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1457: Report 1901.1 Add data 75/18175/5
Tibor Frank [Mon, 11 Mar 2019 09:42:20 +0000 (10:42 +0100)]
CSIT-1457: Report 1901.1 Add data

Change-Id: Ic9a5361394f0648816b4745bbfb4d3338e3f7e9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1456: Report 1901.1 Configuration 73/18173/4
Tibor Frank [Mon, 11 Mar 2019 08:23:38 +0000 (09:23 +0100)]
CSIT-1456: Report 1901.1 Configuration

Change-Id: Ic629722527e6db6c0594d9499a123b29dc8cf258
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoadd support for using custom jvpp commit 11/18111/9
Michal Cmarada [Thu, 7 Mar 2019 10:31:15 +0000 (11:31 +0100)]
add support for using custom jvpp commit

Change-Id: I492541a0a0d6cdc08f03e4c47fc86f22716cf065
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoFIX: Use correct MRR tag 78/18178/1
Jan Gelety [Thu, 7 Mar 2019 11:40:21 +0000 (12:40 +0100)]
FIX: Use correct MRR tag

Change-Id: I2ccb081dd99e13f94fe6e2bfc9cce068a555e12e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoConvert clear [run|interfaces] command to PAPI 50/18050/21
Peter Mikus [Wed, 6 Mar 2019 08:33:57 +0000 (08:33 +0000)]
Convert clear [run|interfaces] command to PAPI

Change-Id: I9aa9eed74a75c132f9e34ce50e9895db59f855c7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: Do not set sriov_numvfs of QAT card to 0 in case of SW crypto tests 36/18136/6
Jan Gelety [Thu, 7 Mar 2019 02:57:32 +0000 (03:57 +0100)]
FIX: Do not set sriov_numvfs of QAT card to 0 in case of SW crypto tests

- when sriov_numvfs of QAT card is set to 0 for SW crypto tests and then
  back to 32 for subsequent HW crypto the dpdk backend is not running

Change-Id: I9bc6b2549823e3318c31bda55a976199266e3535
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1452: Make PAL use PapiHistory instead of VatHistory 13/18113/8
Tibor Frank [Thu, 7 Mar 2019 12:32:21 +0000 (13:32 +0100)]
CSIT-1452: Make PAL use PapiHistory instead of VatHistory

- First step: Add PapiHistory

Change-Id: I499d64f951f17f04557a7ba793dcc1593f37a1bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoSimplify show_papi_history 57/18057/3
Vratko Polak [Thu, 7 Mar 2019 12:00:22 +0000 (13:00 +0100)]
Simplify show_papi_history

Change-Id: Id86f8630ff37e958d90011f421aeb8a75b3e4783
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoFix PYTHONPATH in activate_environment 05/18105/1
Vratko Polak [Thu, 7 Mar 2019 09:43:40 +0000 (10:43 +0100)]
Fix PYTHONPATH in activate_environment

This affects jobs which install the virtual environment
to a directory other than ${CSIT_DIR}.

Change-Id: I1546043112f7504feb0452883b2ff57530dd2c9d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoPapi: Rename methods argument 00/18100/1
Tibor Frank [Thu, 7 Mar 2019 08:27:46 +0000 (09:27 +0100)]
Papi: Rename methods argument

The argument name 'csit_papi_command' must be unique enough as it cannot
be repeated in kwargs.
  - PapiExecutor.add(self, csit_papi_command, **kwargs)
  - PapiHistory.add_to_papi_history(node, csit_papi_command, papi=True, **kwargs)

Change-Id: I243a20d6f03befb149891c37a88e0e6359ea2940
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agodocs/lab: re-fixed TOC hyperlinks and editing nits 75/18075/1
Maciek Konstantynowicz [Wed, 6 Mar 2019 17:27:26 +0000 (17:27 +0000)]
docs/lab: re-fixed TOC hyperlinks and editing nits

Change-Id: If42f52a249df70a96fd4fe4aedafad14f8ad03c1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agodoc/lab: fixed TOC hyperlinks 71/18071/1
Maciek Konstantynowicz [Wed, 6 Mar 2019 16:24:22 +0000 (16:24 +0000)]
doc/lab: fixed TOC hyperlinks

Change-Id: Id0de47f08b0f2ca3c60bbcae44b413a94af7afd7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoCSIT-1451: PapiHistory 15/18015/13
Tibor Frank [Tue, 5 Mar 2019 09:08:30 +0000 (10:08 +0100)]
CSIT-1451: PapiHistory

Change-Id: Idb51f377fe0c196fbe24aab21c294dad595adcd2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1450: PAPI executor 01/17901/22
Vratko Polak [Wed, 27 Feb 2019 11:55:56 +0000 (12:55 +0100)]
CSIT-1450: PAPI executor

Change-Id: I4c756cc4b29901184594a728f6184c30cadd9c1a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agodocs/lab: merged testbed specifications, separated out detailed HW and BIOS configs. 18/17918/4
Maciek Konstantynowicz [Wed, 27 Feb 2019 21:27:04 +0000 (21:27 +0000)]
docs/lab: merged testbed specifications, separated out detailed HW and BIOS configs.

Change-Id: I5945723676361fdbe180a3bd5a6a366102ee6c67
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoFIX: Selecting VPP packages 62/18062/2
Peter Mikus [Wed, 6 Mar 2019 13:05:58 +0000 (13:05 +0000)]
FIX: Selecting VPP packages

Change-Id: Id6e093eaf62835606cd6bf7e9157d79c8c33c83a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoadd vxlan perf test cases for Intel-X553 of Denverton platform 47/18047/2
Yulong Pei [Wed, 6 Mar 2019 13:54:32 +0000 (21:54 +0800)]
add vxlan perf test cases for Intel-X553 of Denverton platform

add below vxlan perf test cases for Intel-X553 of Denverton platform,
10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-mrr.robot
10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-ndrpdr.robot

Change-Id: Ia0bbdd5d465bd1ac8d9930ac67099c63773a6cef
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agoadd dpdk-plugin for honeycomb download artifacts 51/18051/2
Michal Cmarada [Wed, 6 Mar 2019 08:51:13 +0000 (09:51 +0100)]
add dpdk-plugin for honeycomb download artifacts

Change-Id: I90c491e8039b20bbb0ef23bb1912e275030bef0b
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoFIX: Selecting VPP packages 52/18052/2
Peter Mikus [Wed, 6 Mar 2019 09:31:19 +0000 (09:31 +0000)]
FIX: Selecting VPP packages

There is an issue when multiple VPP versions of same commit
but different build is in repository. Artifacts.sh will find
multiple version and cennot properly download only one.

00:00:46.522 ++ apt-get -y download libvppinfra=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 libvppinfra-dev=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 <truncated...//pm>

This patch will select latest as the behavior is result of
re-merge effect.

Change-Id: I8ce21244e2b05e60af0ea51107f9138173844330
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1362: migrate package download scripts for hc2vpp jobs 79/17779/19
Michal Cmarada [Tue, 5 Mar 2019 13:41:35 +0000 (14:41 +0100)]
CSIT-1362: migrate package download scripts for hc2vpp jobs

As part of Bionic update for honeycomb (HC2VPP-372)
scripts need to be updated. Switching to Packagecloud instead
of nexus simplifies this process.

Change-Id: I243367e8c1d7c3de5890d6846c199563cef457bf
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoReport: Add LB Data 27/18027/1
Tibor Frank [Tue, 5 Mar 2019 14:05:58 +0000 (15:05 +0100)]
Report: Add LB Data

- Change the version to 1901.10

Change-Id: I4a976a55b375a00fe3498ef26e676ce9410ff7f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoRename to Constants.py 75/17875/5
Vratko Polak [Tue, 26 Feb 2019 14:46:02 +0000 (15:46 +0100)]
Rename to Constants.py

Motivation: Make the constants available also for Robot.
Restraint: Robotframework user guide says:
  Because variable files are always imported using a file system path,
  creating them as classes has some restrictions:
    Python classes must have the same name as the module they are located.

Change-Id: I638ef3fe045db132e366de2e2699638b8637e45e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoAdd ARM Taishan testbed33 perftest 50/16850/39
Stanislav Chlebec [Thu, 17 Jan 2019 11:15:54 +0000 (03:15 -0800)]
Add ARM Taishan testbed33 perftest

Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0
Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech>
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoFIX: ipsec + vpp stable version update 47/17647/15
Jan Gelety [Mon, 18 Feb 2019 13:55:23 +0000 (14:55 +0100)]
FIX: ipsec + vpp stable version update

- use exec ipsec sa add
- use exec ipsec spd add
- use exec set ipsec sa

Change-Id: I69d59dd230b99d8efc9bcb5e3fbab79a8b11b18a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Remove disabled models from specification 94/17894/3
Tibor Frank [Wed, 27 Feb 2019 06:37:43 +0000 (07:37 +0100)]
Report: Remove disabled models from specification

Change-Id: Ief23b6c9a2f94af2473772c29bb3c4636ea5a1d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1449 Ansible: Adding calibration support 52/17852/17
Peter Mikus [Tue, 26 Feb 2019 10:24:41 +0000 (10:24 +0000)]
CSIT-1449 Ansible: Adding calibration support

- Remove obsolete bootstrap_setup.sh.
- Add calibration support into ansible.
- Inject Ansible run with calibration to every job.

Change-Id: Ib2d6cd0c04d3bce700b205bef34c3c88edb26e28
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1418 Switch performance jobs to VPP-bionic build 96/17296/7
Peter Mikus [Mon, 4 Feb 2019 14:21:51 +0000 (14:21 +0000)]
CSIT-1418 Switch performance jobs to VPP-bionic build

Change-Id: Ia38e70a418570d168bf330ce1b3c91351b326181
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Add data 06/17906/2
Tibor Frank [Wed, 27 Feb 2019 13:53:50 +0000 (14:53 +0100)]
Report: Add data

- Link Bonding, 3n-hsw, 3n-skx

Change-Id: Ie10319357d0917baf11f70c5de3ed3deb6c1850b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoBash style: Add rules for handling working dir 87/17687/2
Vratko Polak [Tue, 19 Feb 2019 14:01:34 +0000 (15:01 +0100)]
Bash style: Add rules for handling working dir

+ Also added details related to "set -e" and exit codes.

Change-Id: I731151efd7facc1def3c8cbba4e466e793c93689
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoAdd tox.ini and few checker scripts 50/13450/42
Vratko Polak [Fri, 14 Sep 2018 15:09:35 +0000 (17:09 +0200)]
Add tox.ini and few checker scripts

The plan is to change csit-validate-pylint-master job
to fail if (and only if) tox fails.

This will allow us to easily add checks,
with or without the voting power.

Each check produces log (ignored in .gitignore)
the voting job can archive.

+ Made autogen quiet by default, to avoid spam in autogen checker.
+ Unified the way direct csit subdirectories are git-ignored.

Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Enable pdf version 92/17892/1
Tibor Frank [Wed, 27 Feb 2019 06:23:07 +0000 (07:23 +0100)]
Report: Enable pdf version

Change-Id: I166926bc85d4c7cb708633203e58f68abb6f4e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1440: Re-organize graphs in report 81/17881/1
Tibor Frank [Tue, 26 Feb 2019 18:10:24 +0000 (19:10 +0100)]
CSIT-1440: Re-organize graphs in report

- fixes

Change-Id: I4b960651570c9c1174637a8c043f5ced3ce79538
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Hardware sections - report 69/17869/3
Peter Mikus [Tue, 26 Feb 2019 12:53:41 +0000 (12:53 +0000)]
FIX: Hardware sections - report

Change-Id: I4a64f87fe43eb94841c55d63a7befff0d2c2a477
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Remove TCP/IP 64/17864/2
Tibor Frank [Tue, 26 Feb 2019 11:47:29 +0000 (12:47 +0100)]
Report: Remove TCP/IP

Change-Id: I9d3c8272654bb5c4c8ebe1a07e9a1d8d9d173407
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1440: Re-organize graphs in report 62/17862/2
Tibor Frank [Tue, 26 Feb 2019 11:35:42 +0000 (12:35 +0100)]
CSIT-1440: Re-organize graphs in report

- fixes

Change-Id: I5e4c1f96ab12b7732f29083ff070861eae984ca6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoDe-duplicate unidirection support 25/17625/13
Vratko Polak [Mon, 25 Feb 2019 12:00:43 +0000 (13:00 +0100)]
De-duplicate unidirection support

- Latency is now reported in both directions.
-- For unidirection that means additional -1/-1/-1.
+ Changed function argument wrapping to save vertical space.
+ Changed trex command synthesys to save vertical space.
+ Fixed handling of command line arguments to avoid superfluous spaces.
+ More care distinguishing (0, 1) from (port_0, port_1).
- Not renaming the original port arguments.

Change-Id: I7b1736b594f6edea52eb07e5bc76ef52d0af92f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1440: Re-organize graphs in report 43/17843/2
Tibor Frank [Tue, 26 Feb 2019 07:17:30 +0000 (08:17 +0100)]
CSIT-1440: Re-organize graphs in report

- latency
- multi-core

Change-Id: I8a0f51d51eb451f3c57c15579b4e775e0bffddab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1448 Ansible: Clean hugepage configuration 09/17809/5
Peter Mikus [Mon, 25 Feb 2019 16:03:21 +0000 (16:03 +0000)]
CSIT-1448 Ansible: Clean hugepage configuration

Change-Id: I1e91d63bb5cd671d2d1d94f8711233bec0fe6505
Signed-off-by: Peter Mikus <pmikus@cisco.com>