csit.git
5 years agoTrending: Set the last build for dpdk-3n-skx 13/18513/1
Tibor Frank [Mon, 25 Mar 2019 15:31:18 +0000 (16:31 +0100)]
Trending: Set the last build for dpdk-3n-skx

Change-Id: Ic38ad46547c9a007cc8d59e44fcf5955956e663e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix vpp-ref 07/18507/1
Tibor Frank [Mon, 25 Mar 2019 13:48:26 +0000 (14:48 +0100)]
Trending: Fix vpp-ref

Change-Id: Ie2da87f9afbe22229a35abcf8598923c888ab7ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Reduce the amount of downloaded data 05/18505/1
Tibor Frank [Mon, 25 Mar 2019 12:43:33 +0000 (13:43 +0100)]
Trending: Reduce the amount of downloaded data

Change-Id: I13aeccc993bbdd98c29845554da714ce10add5c0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix vpp-ref 03/18503/1
Tibor Frank [Mon, 25 Mar 2019 12:32:52 +0000 (13:32 +0100)]
Trending: Fix vpp-ref

Change-Id: I3179175f681a99709445e6603711060e46fa8885
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoRemove main.py as it is confusing 21/18421/2
Peter Mikus [Wed, 20 Mar 2019 13:16:14 +0000 (13:16 +0000)]
Remove main.py as it is confusing

People try to run main.py instead of Robot

Change-Id: Ieff219c9df7586842f796c5fb17500327d71a7d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate and reorder tox.ini TODOs 27/18427/3
Vratko Polak [Wed, 20 Mar 2019 14:15:35 +0000 (15:15 +0100)]
Update and reorder tox.ini TODOs

Change-Id: Ieeb54f3e3cb413f15dfbf6595211fd7158aa1e1a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoConvert functional tests to statefull QemuUtils 22/18422/8
Peter Mikus [Wed, 20 Mar 2019 13:21:26 +0000 (13:21 +0000)]
Convert functional tests to statefull QemuUtils

Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Add note about nr of test runs 51/18451/1
Tibor Frank [Thu, 21 Mar 2019 08:23:34 +0000 (09:23 +0100)]
Report: Add note about nr of test runs

Change-Id: If7a29bb268c422f788b418c597af8305e04847cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1386 KernelVM - Part II 57/18157/42
Peter Mikus [Sat, 9 Mar 2019 08:00:54 +0000 (08:00 +0000)]
CSIT-1386 KernelVM - Part II

- Implementation of KernelVM (ThinVM)
- nf_density tests for KernelVM with VPP as VNF.

Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoietf draft: nfv service density rev. -00 31/17131/10
Maciek Konstantynowicz [Mon, 28 Jan 2019 21:52:02 +0000 (21:52 +0000)]
ietf draft: nfv service density rev. -00

Change-Id: I0490db919b4da198545f4a332fd722855bac84a8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoAdd tox checker for lengths of new lines only 20/18420/1
Vratko Polak [Wed, 20 Mar 2019 12:23:30 +0000 (13:23 +0100)]
Add tox checker for lengths of new lines only

- Still non-voting, but useful.

Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 07/18407/1
Jan Gelety [Tue, 19 Mar 2019 16:54:31 +0000 (17:54 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.04-rc0~214-gcae98b7~b6361

- use new vpp ref build - centos7:
  19.04-rc0~214_gcae98b7~b6184

- use new vpp ref build - ubuntu 18.04:
  19.04-rc0~214-gcae98b72c

Change-Id: I5f8288278576fb28f5bf3754ac18b60cc21e3e6e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Remove VNF 82/18382/4
Tibor Frank [Tue, 19 Mar 2019 14:35:30 +0000 (15:35 +0100)]
Report: Remove VNF

- add comparisons for dnv

Change-Id: I123a925a3c91fba782f152b3cd73f1b63fe50c59
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Configure 1901.1 80/18380/1
Tibor Frank [Tue, 19 Mar 2019 14:05:35 +0000 (15:05 +0100)]
Report: Configure 1901.1

Change-Id: Ica2483bdaebe70b9d6668a36a1b855c52e4d7c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1386 KernelVM - Part I 48/18148/37
Peter Mikus [Fri, 8 Mar 2019 15:23:48 +0000 (15:23 +0000)]
CSIT-1386 KernelVM - Part I

- Refactor QemuUtils

Full refactor of QemuUtils to prepare for thinner VMs.

Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoPAPI Executor: Add more desciptive error message 22/18322/3
Tibor Frank [Fri, 15 Mar 2019 11:44:44 +0000 (12:44 +0100)]
PAPI Executor: Add more desciptive error message

- Add more desciptive error message to the processing of replies.

Change-Id: Ie43651370d5754aedf2515438c02ff4aa21bdc46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoPrepare image for KernelVM on machines. 51/18351/1
Peter Mikus [Sun, 17 Mar 2019 18:15:30 +0000 (18:15 +0000)]
Prepare image for KernelVM on machines.

TASK [sut : Get kernel-kvm version] ***************************************
changed: [10.30.51.52]

TASK [sut : Download kernel-kvm] ******************************************
changed: [10.30.51.52]

TASK [sut : Unpack kernel-kvm] ********************************************
changed: [10.30.51.52]

PLAY RECAP ****************************************************************
10.30.51.52                : ok=4    changed=3    unreachable=0    failed=0

Change-Id: I452f35e12c94fc58374679de21e87e36b145f987
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: Ansible warnings of deprecation 46/18346/1
Peter Mikus [Sat, 16 Mar 2019 07:41:07 +0000 (07:41 +0000)]
FIX: Ansible warnings of deprecation

[DEPRECATION WARNING]: Invoking "apt" only once while using a
loop via squash_actions is deprecated.

+ aenum pip fix version
+ crypto dependencies

Change-Id: I7ca4de48d68ec4d8a8f57fedf204fa6710a3e75f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Fix the information about 2-Node Atom Denverton 12/18312/2
Tibor Frank [Fri, 15 Mar 2019 08:38:24 +0000 (09:38 +0100)]
Report: Fix the information about 2-Node Atom Denverton

Change-Id: I137af7fd34d352c9ed2fba1ac5eca5a409c0ab92
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoPAPI: Add verification of the response 17/18117/18
Tibor Frank [Thu, 7 Mar 2019 13:43:13 +0000 (14:43 +0100)]
PAPI: Add verification of the response

Change-Id: I86afcaeae865f0af076b8dd974386a83de07bf44
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdding pip and apt packages - ubuntu16.04 98/18298/1
Jan Gelety [Thu, 14 Mar 2019 16:44:52 +0000 (17:44 +0100)]
Adding pip and apt packages - ubuntu16.04

- add python3-cffi to apt list
- add aenum to pip requirements

Change-Id: Iac0f4f69752db7d34693e83dd14bf68ad8cdc8ee
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoPapi: Back to python2, add aenum 87/18287/3
Tibor Frank [Thu, 14 Mar 2019 11:59:01 +0000 (12:59 +0100)]
Papi: Back to python2, add aenum

Change-Id: I3939af7dc29edb58dab7febff400007d91961081
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1461: Edit VPP Release notes 08/18208/4
Tibor Frank [Tue, 12 Mar 2019 11:33:18 +0000 (12:33 +0100)]
CSIT-1461: Edit VPP Release notes

Change-Id: I794fe95df97834b889bf24fc142c5478ce7c0623
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add Denverton static content 85/18285/1
Tibor Frank [Thu, 14 Mar 2019 11:51:55 +0000 (12:51 +0100)]
Report: Add Denverton static content

Change-Id: I0ba254c00f7aacb425034721fcaed73bfd4dbc01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add Denverton data 83/18283/1
Tibor Frank [Thu, 14 Mar 2019 11:37:24 +0000 (12:37 +0100)]
Report: Add Denverton data

Change-Id: I18054949ca135f204a068ad1d4db1b7a7fa413d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Reduce the amount of downloaded data 76/18276/1
Tibor Frank [Thu, 14 Mar 2019 09:12:47 +0000 (10:12 +0100)]
Trending: Reduce the amount of downloaded data

Change-Id: Ifa3fd25c018731c156d3864845dfb2d001e6ceb2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd PAPI dependencies 75/18275/3
Peter Mikus [Thu, 14 Mar 2019 08:02:56 +0000 (08:02 +0000)]
Add PAPI dependencies

+ Various small structure optmizations

Change-Id: I1aac9353f72436de53797fc734bef498905c8189
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdated IETF draft: draft-vpolak-bmwg-plrsearch-01. 81/15481/5
Maciek Konstantynowicz [Tue, 23 Oct 2018 16:55:05 +0000 (09:55 -0700)]
Updated IETF draft: draft-vpolak-bmwg-plrsearch-01.

Change-Id: I507d44f75383046b01def750af51a911b8ec5aa3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoPAPI: Use Python3 for PapiProvider 03/18203/9
Tibor Frank [Tue, 12 Mar 2019 07:22:21 +0000 (08:22 +0100)]
PAPI: Use Python3 for PapiProvider

Change-Id: I39e237db5cba8311ae11fd709b10a17297f3a729
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1457: Report 1901.1 Add data 75/18175/5
Tibor Frank [Mon, 11 Mar 2019 09:42:20 +0000 (10:42 +0100)]
CSIT-1457: Report 1901.1 Add data

Change-Id: Ic9a5361394f0648816b4745bbfb4d3338e3f7e9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1456: Report 1901.1 Configuration 73/18173/4
Tibor Frank [Mon, 11 Mar 2019 08:23:38 +0000 (09:23 +0100)]
CSIT-1456: Report 1901.1 Configuration

Change-Id: Ic629722527e6db6c0594d9499a123b29dc8cf258
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoadd support for using custom jvpp commit 11/18111/9
Michal Cmarada [Thu, 7 Mar 2019 10:31:15 +0000 (11:31 +0100)]
add support for using custom jvpp commit

Change-Id: I492541a0a0d6cdc08f03e4c47fc86f22716cf065
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoFIX: Use correct MRR tag 78/18178/1
Jan Gelety [Thu, 7 Mar 2019 11:40:21 +0000 (12:40 +0100)]
FIX: Use correct MRR tag

Change-Id: I2ccb081dd99e13f94fe6e2bfc9cce068a555e12e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoConvert clear [run|interfaces] command to PAPI 50/18050/21
Peter Mikus [Wed, 6 Mar 2019 08:33:57 +0000 (08:33 +0000)]
Convert clear [run|interfaces] command to PAPI

Change-Id: I9aa9eed74a75c132f9e34ce50e9895db59f855c7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: Do not set sriov_numvfs of QAT card to 0 in case of SW crypto tests 36/18136/6
Jan Gelety [Thu, 7 Mar 2019 02:57:32 +0000 (03:57 +0100)]
FIX: Do not set sriov_numvfs of QAT card to 0 in case of SW crypto tests

- when sriov_numvfs of QAT card is set to 0 for SW crypto tests and then
  back to 32 for subsequent HW crypto the dpdk backend is not running

Change-Id: I9bc6b2549823e3318c31bda55a976199266e3535
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1452: Make PAL use PapiHistory instead of VatHistory 13/18113/8
Tibor Frank [Thu, 7 Mar 2019 12:32:21 +0000 (13:32 +0100)]
CSIT-1452: Make PAL use PapiHistory instead of VatHistory

- First step: Add PapiHistory

Change-Id: I499d64f951f17f04557a7ba793dcc1593f37a1bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoSimplify show_papi_history 57/18057/3
Vratko Polak [Thu, 7 Mar 2019 12:00:22 +0000 (13:00 +0100)]
Simplify show_papi_history

Change-Id: Id86f8630ff37e958d90011f421aeb8a75b3e4783
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoFix PYTHONPATH in activate_environment 05/18105/1
Vratko Polak [Thu, 7 Mar 2019 09:43:40 +0000 (10:43 +0100)]
Fix PYTHONPATH in activate_environment

This affects jobs which install the virtual environment
to a directory other than ${CSIT_DIR}.

Change-Id: I1546043112f7504feb0452883b2ff57530dd2c9d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoPapi: Rename methods argument 00/18100/1
Tibor Frank [Thu, 7 Mar 2019 08:27:46 +0000 (09:27 +0100)]
Papi: Rename methods argument

The argument name 'csit_papi_command' must be unique enough as it cannot
be repeated in kwargs.
  - PapiExecutor.add(self, csit_papi_command, **kwargs)
  - PapiHistory.add_to_papi_history(node, csit_papi_command, papi=True, **kwargs)

Change-Id: I243a20d6f03befb149891c37a88e0e6359ea2940
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agodocs/lab: re-fixed TOC hyperlinks and editing nits 75/18075/1
Maciek Konstantynowicz [Wed, 6 Mar 2019 17:27:26 +0000 (17:27 +0000)]
docs/lab: re-fixed TOC hyperlinks and editing nits

Change-Id: If42f52a249df70a96fd4fe4aedafad14f8ad03c1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agodoc/lab: fixed TOC hyperlinks 71/18071/1
Maciek Konstantynowicz [Wed, 6 Mar 2019 16:24:22 +0000 (16:24 +0000)]
doc/lab: fixed TOC hyperlinks

Change-Id: Id0de47f08b0f2ca3c60bbcae44b413a94af7afd7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoCSIT-1451: PapiHistory 15/18015/13
Tibor Frank [Tue, 5 Mar 2019 09:08:30 +0000 (10:08 +0100)]
CSIT-1451: PapiHistory

Change-Id: Idb51f377fe0c196fbe24aab21c294dad595adcd2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1450: PAPI executor 01/17901/22
Vratko Polak [Wed, 27 Feb 2019 11:55:56 +0000 (12:55 +0100)]
CSIT-1450: PAPI executor

Change-Id: I4c756cc4b29901184594a728f6184c30cadd9c1a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agodocs/lab: merged testbed specifications, separated out detailed HW and BIOS configs. 18/17918/4
Maciek Konstantynowicz [Wed, 27 Feb 2019 21:27:04 +0000 (21:27 +0000)]
docs/lab: merged testbed specifications, separated out detailed HW and BIOS configs.

Change-Id: I5945723676361fdbe180a3bd5a6a366102ee6c67
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoFIX: Selecting VPP packages 62/18062/2
Peter Mikus [Wed, 6 Mar 2019 13:05:58 +0000 (13:05 +0000)]
FIX: Selecting VPP packages

Change-Id: Id6e093eaf62835606cd6bf7e9157d79c8c33c83a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoadd vxlan perf test cases for Intel-X553 of Denverton platform 47/18047/2
Yulong Pei [Wed, 6 Mar 2019 13:54:32 +0000 (21:54 +0800)]
add vxlan perf test cases for Intel-X553 of Denverton platform

add below vxlan perf test cases for Intel-X553 of Denverton platform,
10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-mrr.robot
10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-ndrpdr.robot

Change-Id: Ia0bbdd5d465bd1ac8d9930ac67099c63773a6cef
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agoadd dpdk-plugin for honeycomb download artifacts 51/18051/2
Michal Cmarada [Wed, 6 Mar 2019 08:51:13 +0000 (09:51 +0100)]
add dpdk-plugin for honeycomb download artifacts

Change-Id: I90c491e8039b20bbb0ef23bb1912e275030bef0b
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoFIX: Selecting VPP packages 52/18052/2
Peter Mikus [Wed, 6 Mar 2019 09:31:19 +0000 (09:31 +0000)]
FIX: Selecting VPP packages

There is an issue when multiple VPP versions of same commit
but different build is in repository. Artifacts.sh will find
multiple version and cennot properly download only one.

00:00:46.522 ++ apt-get -y download libvppinfra=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 libvppinfra-dev=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 <truncated...//pm>

This patch will select latest as the behavior is result of
re-merge effect.

Change-Id: I8ce21244e2b05e60af0ea51107f9138173844330
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1362: migrate package download scripts for hc2vpp jobs 79/17779/19
Michal Cmarada [Tue, 5 Mar 2019 13:41:35 +0000 (14:41 +0100)]
CSIT-1362: migrate package download scripts for hc2vpp jobs

As part of Bionic update for honeycomb (HC2VPP-372)
scripts need to be updated. Switching to Packagecloud instead
of nexus simplifies this process.

Change-Id: I243367e8c1d7c3de5890d6846c199563cef457bf
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoReport: Add LB Data 27/18027/1
Tibor Frank [Tue, 5 Mar 2019 14:05:58 +0000 (15:05 +0100)]
Report: Add LB Data

- Change the version to 1901.10

Change-Id: I4a976a55b375a00fe3498ef26e676ce9410ff7f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoRename to Constants.py 75/17875/5
Vratko Polak [Tue, 26 Feb 2019 14:46:02 +0000 (15:46 +0100)]
Rename to Constants.py

Motivation: Make the constants available also for Robot.
Restraint: Robotframework user guide says:
  Because variable files are always imported using a file system path,
  creating them as classes has some restrictions:
    Python classes must have the same name as the module they are located.

Change-Id: I638ef3fe045db132e366de2e2699638b8637e45e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoAdd ARM Taishan testbed33 perftest 50/16850/39
Stanislav Chlebec [Thu, 17 Jan 2019 11:15:54 +0000 (03:15 -0800)]
Add ARM Taishan testbed33 perftest

Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0
Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech>
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoFIX: ipsec + vpp stable version update 47/17647/15
Jan Gelety [Mon, 18 Feb 2019 13:55:23 +0000 (14:55 +0100)]
FIX: ipsec + vpp stable version update

- use exec ipsec sa add
- use exec ipsec spd add
- use exec set ipsec sa

Change-Id: I69d59dd230b99d8efc9bcb5e3fbab79a8b11b18a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Remove disabled models from specification 94/17894/3
Tibor Frank [Wed, 27 Feb 2019 06:37:43 +0000 (07:37 +0100)]
Report: Remove disabled models from specification

Change-Id: Ief23b6c9a2f94af2473772c29bb3c4636ea5a1d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1449 Ansible: Adding calibration support 52/17852/17
Peter Mikus [Tue, 26 Feb 2019 10:24:41 +0000 (10:24 +0000)]
CSIT-1449 Ansible: Adding calibration support

- Remove obsolete bootstrap_setup.sh.
- Add calibration support into ansible.
- Inject Ansible run with calibration to every job.

Change-Id: Ib2d6cd0c04d3bce700b205bef34c3c88edb26e28
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1418 Switch performance jobs to VPP-bionic build 96/17296/7
Peter Mikus [Mon, 4 Feb 2019 14:21:51 +0000 (14:21 +0000)]
CSIT-1418 Switch performance jobs to VPP-bionic build

Change-Id: Ia38e70a418570d168bf330ce1b3c91351b326181
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Add data 06/17906/2
Tibor Frank [Wed, 27 Feb 2019 13:53:50 +0000 (14:53 +0100)]
Report: Add data

- Link Bonding, 3n-hsw, 3n-skx

Change-Id: Ie10319357d0917baf11f70c5de3ed3deb6c1850b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoBash style: Add rules for handling working dir 87/17687/2
Vratko Polak [Tue, 19 Feb 2019 14:01:34 +0000 (15:01 +0100)]
Bash style: Add rules for handling working dir

+ Also added details related to "set -e" and exit codes.

Change-Id: I731151efd7facc1def3c8cbba4e466e793c93689
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoAdd tox.ini and few checker scripts 50/13450/42
Vratko Polak [Fri, 14 Sep 2018 15:09:35 +0000 (17:09 +0200)]
Add tox.ini and few checker scripts

The plan is to change csit-validate-pylint-master job
to fail if (and only if) tox fails.

This will allow us to easily add checks,
with or without the voting power.

Each check produces log (ignored in .gitignore)
the voting job can archive.

+ Made autogen quiet by default, to avoid spam in autogen checker.
+ Unified the way direct csit subdirectories are git-ignored.

Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Enable pdf version 92/17892/1
Tibor Frank [Wed, 27 Feb 2019 06:23:07 +0000 (07:23 +0100)]
Report: Enable pdf version

Change-Id: I166926bc85d4c7cb708633203e58f68abb6f4e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1440: Re-organize graphs in report 81/17881/1
Tibor Frank [Tue, 26 Feb 2019 18:10:24 +0000 (19:10 +0100)]
CSIT-1440: Re-organize graphs in report

- fixes

Change-Id: I4b960651570c9c1174637a8c043f5ced3ce79538
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Hardware sections - report 69/17869/3
Peter Mikus [Tue, 26 Feb 2019 12:53:41 +0000 (12:53 +0000)]
FIX: Hardware sections - report

Change-Id: I4a64f87fe43eb94841c55d63a7befff0d2c2a477
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Remove TCP/IP 64/17864/2
Tibor Frank [Tue, 26 Feb 2019 11:47:29 +0000 (12:47 +0100)]
Report: Remove TCP/IP

Change-Id: I9d3c8272654bb5c4c8ebe1a07e9a1d8d9d173407
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1440: Re-organize graphs in report 62/17862/2
Tibor Frank [Tue, 26 Feb 2019 11:35:42 +0000 (12:35 +0100)]
CSIT-1440: Re-organize graphs in report

- fixes

Change-Id: I5e4c1f96ab12b7732f29083ff070861eae984ca6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoDe-duplicate unidirection support 25/17625/13
Vratko Polak [Mon, 25 Feb 2019 12:00:43 +0000 (13:00 +0100)]
De-duplicate unidirection support

- Latency is now reported in both directions.
-- For unidirection that means additional -1/-1/-1.
+ Changed function argument wrapping to save vertical space.
+ Changed trex command synthesys to save vertical space.
+ Fixed handling of command line arguments to avoid superfluous spaces.
+ More care distinguishing (0, 1) from (port_0, port_1).
- Not renaming the original port arguments.

Change-Id: I7b1736b594f6edea52eb07e5bc76ef52d0af92f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1440: Re-organize graphs in report 43/17843/2
Tibor Frank [Tue, 26 Feb 2019 07:17:30 +0000 (08:17 +0100)]
CSIT-1440: Re-organize graphs in report

- latency
- multi-core

Change-Id: I8a0f51d51eb451f3c57c15579b4e775e0bffddab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1448 Ansible: Clean hugepage configuration 09/17809/5
Peter Mikus [Mon, 25 Feb 2019 16:03:21 +0000 (16:03 +0000)]
CSIT-1448 Ansible: Clean hugepage configuration

Change-Id: I1e91d63bb5cd671d2d1d94f8711233bec0fe6505
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1440: Re-organize graphs in report 84/17784/6
Tibor Frank [Fri, 22 Feb 2019 13:49:58 +0000 (14:49 +0100)]
CSIT-1440: Re-organize graphs in report

- Throughput

Change-Id: Iab94a7c66d3483707ed99e49489ebf71947a4fca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: VPP PIDs can also be separated by spaces not only by line breaks 04/17804/3
Jan Gelety [Mon, 25 Feb 2019 11:21:41 +0000 (12:21 +0100)]
FIX: VPP PIDs can also be separated by spaces not only by line breaks

Change-Id: I6a5e8732be224927aa965cdf6b93998aa8699639
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1437 Create portable host-setup document 21/17721/5
Peter Mikus [Wed, 20 Feb 2019 12:19:07 +0000 (12:19 +0000)]
CSIT-1437 Create portable host-setup document

- Ansible simplified and optimalized
- Porting global variables into single file
- Rework the README.md
- Tested outside LF environemnt

Change-Id: I124cffa5c4510edf365e8b558da0c8c498f55d50
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Configure for 1901.09 41/17741/1
Tibor Frank [Thu, 21 Feb 2019 08:35:12 +0000 (09:35 +0100)]
Report: Configure for 1901.09

Change-Id: Ief796f52c15a5c62962a82eea8f740ae17277638
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add data 39/17739/1
Tibor Frank [Thu, 21 Feb 2019 08:15:42 +0000 (09:15 +0100)]
Report: Add data

Change-Id: I9c03434f3f6b7acf22e9a4f58fe32b43a092f237
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: add data 25/17725/2
Tibor Frank [Wed, 20 Feb 2019 13:57:51 +0000 (14:57 +0100)]
Report: add data

Change-Id: I7387bdea66f8ddc58740908b2c69fc6b27b2b01c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Remove NSH_SFC 10/17710/2
Tibor Frank [Wed, 20 Feb 2019 07:56:51 +0000 (08:56 +0100)]
Report: Remove NSH_SFC

Change-Id: I639eb5bfbff9a088b0d6b096bd10e82fd0824265
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1438: Remove Denverton from Report 09/17709/4
Tibor Frank [Wed, 20 Feb 2019 07:34:25 +0000 (08:34 +0100)]
CSIT-1438: Remove Denverton from Report

 - The files are kept, what if ...

Change-Id: I7533e46e41e3e0a43e3b8e36b07b2f2536002712
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add data 12/17712/1
Tibor Frank [Wed, 20 Feb 2019 08:39:40 +0000 (09:39 +0100)]
Report: Add data

 - ligato

Change-Id: I813ccf2528a542d772eccf658f2983af0ce7c303
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1436: Add titles to plots in Trending 85/17685/8
Tibor Frank [Tue, 19 Feb 2019 12:00:54 +0000 (13:00 +0100)]
CSIT-1436: Add titles to plots in Trending

CSIT-1435: Remove index from Trending

Change-Id: I616b055d7ad12f241df5fa43fb121d20ef7d7e23
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Static variables all over the place for per patch 05/17705/1
Peter Mikus [Wed, 20 Feb 2019 06:26:05 +0000 (06:26 +0000)]
FIX: Static variables all over the place for per patch

- Incredible why is it so hard to write scripts not hardcoding
anything.

Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1419 Convert vpp-virl job to vpp-device 87/17287/14
Peter Mikus [Mon, 4 Feb 2019 10:16:48 +0000 (10:16 +0000)]
CSIT-1419 Convert vpp-virl job to vpp-device

Change-Id: I5af6de4b96775a72855e1644ca4d8d9b4b2f9e25
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAllow more perftest strings in get_test_tag_string 55/17655/2
Vratko Polak [Mon, 18 Feb 2019 15:53:17 +0000 (16:53 +0100)]
Allow more perftest strings in get_test_tag_string

This is needed to support other TBs in perpatch job.

Change-Id: I9de70e818a32fa9990d90cb14498a26570b774a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoAnsible testbed setup for Taishan testbed 37/16837/6
Stanislav Chlebec [Wed, 16 Jan 2019 14:42:36 +0000 (15:42 +0100)]
Ansible testbed setup for Taishan testbed

Change-Id: I4b42aa5bf7635ade95f81c0c92a6ff1bf43d3fa0
Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech>
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoAdapt autogen for SFd tests 46/17646/3
Vratko Polak [Mon, 18 Feb 2019 13:53:28 +0000 (14:53 +0100)]
Adapt autogen for SFd tests

+ Make the skipping logic in autogen more flexible.
+ Do not emit 4c cases when there is too much VMs/containers.
+ Peter says the second -eth- should be renamed away from suites.
+ Regenerate suites so test case names match (new) suite names.

Change-Id: I95ecc47ca07b8bae6693d5d4330811ff55672fc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoExpose DPDK version into separate Variable file 76/17676/3
Peter Mikus [Tue, 19 Feb 2019 12:18:39 +0000 (12:18 +0000)]
Expose DPDK version into separate Variable file

Change-Id: If9707297a430285a242c3dae49c216d952a9be12
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Add data 70/17670/5
Tibor Frank [Tue, 19 Feb 2019 09:45:26 +0000 (10:45 +0100)]
Report: Add data

- ligato

Change-Id: I52109c8a3a3b94d841f8b3eb12246e17761385ca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Configure 1901.08 45/17645/3
Tibor Frank [Mon, 18 Feb 2019 13:49:58 +0000 (14:49 +0100)]
Report: Configure 1901.08

Change-Id: I00dfd25a369c8b9d86a0ac4eba7ad2efa570b1a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoBash style: Explain some rules for entry and libs 42/17642/5
Vratko Polak [Mon, 18 Feb 2019 13:29:06 +0000 (14:29 +0100)]
Bash style: Explain some rules for entry and libs

Change-Id: I694ef0c45dfa342651f078d13cc0f7eaaeff82e9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoRemove unused performance util keywords 24/17624/4
Vratko Polak [Fri, 15 Feb 2019 15:33:57 +0000 (16:33 +0100)]
Remove unused performance util keywords

+ Added some TODOs.
+ Get Frame Size updates:
++ Renamed to Get Average Frame Size.
++ Called by Get Max Rate And Jumbo.
++ Moved to the top.

Change-Id: I149831b630d4c0ae098f7189f2231b72c6fb7668
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add data 44/17644/1
Tibor Frank [Mon, 18 Feb 2019 13:33:06 +0000 (14:33 +0100)]
Report: Add data

Change-Id: I0879377a00ce11b092566717408886d82c5de847
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1433: Add data sets to all tables 38/17638/6
Tibor Frank [Mon, 18 Feb 2019 08:37:20 +0000 (09:37 +0100)]
CSIT-1433: Add data sets to all tables

- Improving and simplifying the process of adding new data.

Change-Id: I778af0274584b881de4e1f90f63cdc04d1b796bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoDoc: Methodology update for /new/ trending 91/16691/6
Vratko Polak [Fri, 4 Jan 2019 15:06:27 +0000 (16:06 +0100)]
Doc: Methodology update for /new/ trending

Change-Id: Ibaf4594589cb7bcf1ad236c99f03a9f18b579a74
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1135: Add bash code style guide document 20/14320/25
Vratko Polak [Thu, 14 Feb 2019 15:47:45 +0000 (16:47 +0100)]
CSIT-1135: Add bash code style guide document

- The document is currently an orphan.

Change-Id: I37377e2f7b5e928351336bd18ef037da4d3513fa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoImprove PLRsearch graphical example 19/17619/4
Vratko Polak [Fri, 15 Feb 2019 12:03:23 +0000 (13:03 +0100)]
Improve PLRsearch graphical example

+ Two graphs now.
+ Larger font in graphs.
+ More descriptions within graphs.
+ Text before graphs explaining what is shown.

Change-Id: I1da6b55abe7380b61988e03d83f34f7f991085d6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add data 17/17617/2
Tibor Frank [Fri, 15 Feb 2019 08:56:02 +0000 (09:56 +0100)]
Report: Add data

Change-Id: I8b611488f5ff4395513b33c5f917c4f922f240c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate soak results page 11/17611/1
Vratko Polak [Thu, 14 Feb 2019 13:56:44 +0000 (14:56 +0100)]
Update soak results page

+ Link to methodology (instead telling readers to search there).
+ Explain low amount of test results shown.
+ Clarify that y-axis shows an estimated interval (not direct measurement).

Change-Id: I4d9132fa102624a38d52f0e52dd12e834bd1350f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add data 02/17602/4
Tibor Frank [Thu, 14 Feb 2019 10:09:24 +0000 (11:09 +0100)]
Report: Add data

Change-Id: I08d4773dadb702179f2ac9cb1a5151476878c261
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate PLRsearch methodology. 06/17606/1
Vratko Polak [Thu, 14 Feb 2019 12:09:17 +0000 (13:09 +0100)]
Update PLRsearch methodology.

+ Add a graphical example.
+ Change title underlying characters.
+ Fix incorrect formulations in Caveats.

Change-Id: I3409f539973601433e6b8630f7ed10a4dd9d6154
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Fix vpp-device pictures 95/17595/1
Tibor Frank [Thu, 14 Feb 2019 09:03:08 +0000 (10:03 +0100)]
Report: Fix vpp-device pictures

Change-Id: I1ec9c1c70f639a8a5d616aa2381c4398e55d59d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1426 Update main repo README 39/17439/5
Peter Mikus [Sat, 9 Feb 2019 07:14:16 +0000 (07:14 +0000)]
CSIT-1426 Update main repo README

Change-Id: Ibd10baca840c42cc6f27f0452a7162559a2b34ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd 1-node ThuderX2 arm testbed 77/16877/5
juraj.linkes [Fri, 18 Jan 2019 15:45:19 +0000 (16:45 +0100)]
Add 1-node ThuderX2 arm testbed

Change-Id: I5c7ad4ab7b8eff58ac25562852b8cccbfb28077b
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoReport: VPP_Device and VPP_func update 31/17531/5
Jan Gelety [Tue, 12 Feb 2019 15:52:20 +0000 (16:52 +0100)]
Report: VPP_Device and VPP_func update

Change-Id: Ied18cef4519aff5ce56cb7548e3f97d89856de27
Signed-off-by: Jan Gelety <jgelety@cisco.com>