csit.git
10 months agoTrending: Send alerts when regression occurs 17/22517/10 ipsec-191009
Tibor Frank [Fri, 4 Oct 2019 08:41:00 +0000 (10:41 +0200)]
Trending: Send alerts when regression occurs

Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoFIX: LXC tmpfs mount 81/22581/2
Peter Mikus [Mon, 7 Oct 2019 13:37:06 +0000 (13:37 +0000)]
FIX: LXC tmpfs mount

- Should fix the read/write to socket for LXC

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98

10 months agoFIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant 72/22572/1
Jan Gelety [Fri, 4 Oct 2019 03:06:06 +0000 (05:06 +0200)]
FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant

Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoUpdate of VPP_STABLE_VER files 93/22393/12
Jan Gelety [Thu, 26 Sep 2019 07:23:57 +0000 (09:23 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~324-g66a332c~b8122

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~324-g66a332cf1

 - use new vpp ref build - centos7:
   20.01-rc0~324_g66a332c~b7936

Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Set the backgroud of graphs 61/22561/1
Tibor Frank [Mon, 7 Oct 2019 07:17:59 +0000 (09:17 +0200)]
Report: Set the backgroud of graphs

Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoFIX: Add SRIOV cleanup 24/22524/2
Peter Mikus [Fri, 4 Oct 2019 10:15:18 +0000 (10:15 +0000)]
FIX: Add SRIOV cleanup

If Jenkins interrupt pybot during AVF tests (that is happening
more frequently as coverage increased) the interfaces remains
in link UP state. Next run VPP cannot grab interfaces as they
are in UP state in and kernel driver. This results in testcase
failing.

Patch is supposed to do put interfaces in topology down so VPP
can bind them back to vfio-pci.

Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
10 months agoFIX: use int of sw_if_index in call of sw_interface_set_flags api 18/22518/2
Jan Gelety [Thu, 3 Oct 2019 17:42:34 +0000 (19:42 +0200)]
FIX: use int of sw_if_index in call of sw_interface_set_flags api

- it will avoid situation that corresponding port is not up and
  its sw_if_index value in topology file is None that is interpreted
  as 0 in vpp api so it set flag for local0 interface

Change-Id: I9145077d787ddde50a29bcd4091035e95077f946
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoFIX: IPv6 AVF dot1q 16/22516/2
Peter Mikus [Fri, 4 Oct 2019 08:24:53 +0000 (08:24 +0000)]
FIX: IPv6 AVF dot1q

Change-Id: Id199eb774850153fb225434d4a3d194706fdfdb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
10 months agoTrending: Report also nr of passed tests in email 78/22478/5
Tibor Frank [Wed, 2 Oct 2019 12:03:57 +0000 (14:03 +0200)]
Trending: Report also nr of passed tests in email

Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoPAL: Set plot.ly version to 4.1.1 38/22338/6
Tibor Frank [Fri, 27 Sep 2019 08:35:51 +0000 (10:35 +0200)]
PAL: Set plot.ly version to 4.1.1

Change-Id: I137ee807a2802fa1f7b5b635e1162bf7fff07a57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoPAL: Accept reconf time in scientific notation 87/22487/1
Vratko Polak [Wed, 2 Oct 2019 15:08:39 +0000 (17:08 +0200)]
PAL: Accept reconf time in scientific notation

+ Otherwise "9.58828205237e-05" is understood as "9.58828205237".
+ Replace "[0-9]" with "\d".

Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agosw_interface_details api updated 37/22437/2
Jan Gelety [Thu, 26 Sep 2019 17:29:02 +0000 (19:29 +0200)]
sw_interface_details api updated

- based on pending vpp api change: https://gerrit.fd.io/r/c/vpp/+/21490

Change-Id: I7d7425e8db3bf60ea3d9d7936ed3109c76247457
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoCSIT-1471: Policer - VAT API to PAPI 26/20826/58
premkumarv [Wed, 24 Jul 2019 12:43:23 +0000 (08:43 -0400)]
CSIT-1471: Policer - VAT API to PAPI

Change-Id: I6c7eff8d9cbb196ccb684a45579ac59942351cfe
Signed-off-by: premkumarv <preym17@gmail.com>
10 months agoUpdate flag day document 02/22202/4
Vratko Polak [Wed, 25 Sep 2019 14:52:35 +0000 (16:52 +0200)]
Update flag day document

Prevent false -1 from api-crc job.
Add more details on CSIT side of things.
Minimize the breakage of trending jobs.

Also: Add motivation section explaining
why earlier solutions are not good enough.

- Needs more polishing.
- VPP/CSIT, Committer/Developer can be defined in a separate section.
- VPP/CSIT trending and verify jobs can be defined in a separate section.
- The main process section should list only steps.
 - Comments on which jobs are broken/fixed can be moved to a separate section.
 - Name phases, so progress can be described better than "step 9".
- Emphasize that only one API change can be in the process.
  All other changes need to be rebased (to clear any previous +1)
  before next cycle starts.

Change-Id: Ie64a20db3f4abad3c8cddbf13705ff006e5a6382
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoProposal to automate VPP-API "Flag Day" 56/18356/9
Dave Wallace [Mon, 18 Mar 2019 02:05:11 +0000 (22:05 -0400)]
Proposal to automate VPP-API "Flag Day"

Change-Id: I7bfce00762017b1aa8fd91ce1c8e4c0b810ee7b7
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
10 months agoReport: Fix: Legend in reconf tests 32/22332/1
Tibor Frank [Fri, 27 Sep 2019 07:20:27 +0000 (09:20 +0200)]
Report: Fix: Legend in reconf tests

Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Reconf tests: set autorange for y axis 21/22321/1
Tibor Frank [Thu, 26 Sep 2019 11:37:16 +0000 (13:37 +0200)]
Report: Reconf tests: set autorange for y axis

Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoAdd support for HDRhistogram 40/20540/17
Vratko Polak [Fri, 13 Sep 2019 08:22:11 +0000 (10:22 +0200)]
Add support for HDRhistogram

+ Enable hdrh in trex server.
+ Append hdrh coded output after min/avg/max/.
+ Read (not show nor decode) hdrh value in PAL.
+ Also, remove old ndrpdrdisc code.

Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReconf tests: Fix async measurements 20/22120/19
Vratko Polak [Mon, 23 Sep 2019 13:00:00 +0000 (15:00 +0200)]
Reconf tests: Fix async measurements

TRex does not zero the server counters.
It copies the values to use as reference,
and subtracts them when asked for results.

But the reference is stored in the client (not the server).
And CSIT uses different scripts to start and stop async traffic,
which means different clients.

This patch introduces a workaround.
Async start will return xstats objects to use as reference,
and async stop will use the objects to compute the correct results.
The xstats objects are stored in TrafficGenerator instance.
Sync measurement does not export the counters, to shorten logs.

Other improvements:
+ Make stop_traffic_on_tg return measurement results directly.
+ Rename --async to --async_start as "async" is reserved in Python 3.7
+ Minor pylint, docstring and typo fixes.

Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoPAL: Fix unit for packets lost 14/22114/4
Vratko Polak [Wed, 18 Sep 2019 09:42:08 +0000 (11:42 +0200)]
PAL: Fix unit for packets lost

+ update the static content

Change-Id: I8c4852195e09d7b00555ebb4a7378743c3df45f2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoFixing typo tag_documentation for LISP 55/22155/4
Nidhy [Thu, 19 Sep 2019 17:35:33 +0000 (10:35 -0700)]
Fixing typo tag_documentation for LISP

Change-Id: Idd715cb0d3e6b60c660b95ac618e8e114419491b
Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
10 months agoBump stable_vpp and fix CRC list 74/22174/2
Vratko Polak [Fri, 20 Sep 2019 10:32:02 +0000 (12:32 +0200)]
Bump stable_vpp and fix CRC list

+ Two API merges happened on VPP side, CSIT list was prepared wrong.
+ Removed the secondary collection, as no open change is supported.

Change-Id: I2e2472c8a2fe50190c11c7441982aa2881e9b8a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoLISP: 3-node (func) to 2-node (dev) converstion 89/21689/10
Nidhy [Sat, 31 Aug 2019 12:53:12 +0000 (12:53 +0000)]
LISP: 3-node (func) to 2-node (dev) converstion

Change-Id: I0fbe4d9ef1b30a1ac1382ea43b5b52aeb8a7d39f
Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
10 months agoCSIT-1597 API cleanup: cop 92/22092/5
Jan Gelety [Thu, 12 Sep 2019 21:55:37 +0000 (23:55 +0200)]
CSIT-1597 API cleanup: cop

cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458

Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Fix formating of static content for reconf tests 26/22126/1
Tibor Frank [Wed, 18 Sep 2019 14:42:22 +0000 (16:42 +0200)]
Report: Fix formating of static content for reconf tests

Change-Id: I5b93749b13af870955c1cf9eb8053c446356c329
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoFix errors found by pylint 53/22053/2
Vratko Polak [Fri, 13 Sep 2019 13:40:54 +0000 (15:40 +0200)]
Fix errors found by pylint

Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add disclaimer for reconf tests 12/22112/6
Tibor Frank [Wed, 18 Sep 2019 08:40:17 +0000 (10:40 +0200)]
Report: Add disclaimer for reconf tests

+ Improve description for reconf tests

Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Enable pdf version 85/22085/3
Tibor Frank [Tue, 17 Sep 2019 07:23:07 +0000 (09:23 +0200)]
Report: Enable pdf version

Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoUpdate CRC list and support 21997/7 91/21991/28
Vratko Polak [Tue, 17 Sep 2019 11:00:39 +0000 (13:00 +0200)]
Update CRC list and support 21997/7

- Attempt to repair IPsec LispGpe perf suite.
+ Collection name to reflect the current stable vpp.
+ Add messages found in CSIT L1 keywords.
- Uncommented (instead of deleted) untestable messages. Reasons:
 - Honeycomb.
 - Messages used by unused keywords.
 + Listed reasons. Honeycomb not mentioned if both reasons apply.
+ Delete CRC items for commands not found in keywords anymore.
+ Add CRCs from .json.api files (as teardown is hard to execute).
+ Define and restore alphabetical order.
+ Add hints to find used API commands (not entirely reliable).
+ Move used commands to "cmd = " form so hints find them.
+ Argument to run_cli_command changed from "cmd" to "cli_cmd".
+ Except also struct.error where IOError is excepted.

Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Fix Report History 87/22087/1
Tibor Frank [Tue, 17 Sep 2019 09:15:03 +0000 (11:15 +0200)]
Report: Fix Report History

Change-Id: I654677ca9252e592e635eab28577bb3bb3b8bf85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Update Report History 81/22081/1
Tibor Frank [Tue, 17 Sep 2019 07:07:06 +0000 (09:07 +0200)]
Report: Update Report History

Change-Id: Ie16a2f2298eeaf0793171c7268a95abb6986246a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add methodology for reconf tests 73/22073/1
Vratko Polak [Mon, 16 Sep 2019 16:34:29 +0000 (18:34 +0200)]
Report: Add methodology for reconf tests

Change-Id: I833d63f4e305ba60c94aa16cbb3a31a52ee3b3bb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoTrending: Fix removing of old input files 71/22071/3
Tibor Frank [Mon, 16 Sep 2019 14:54:43 +0000 (16:54 +0200)]
Trending: Fix removing of old input files

Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTrending: Reduce input data 66/22066/1
Tibor Frank [Mon, 16 Sep 2019 10:03:52 +0000 (12:03 +0200)]
Trending: Reduce input data

Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 40/22040/3
Tibor Frank [Fri, 13 Sep 2019 08:17:08 +0000 (10:17 +0200)]
Report: Add data

Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoAdd: AVF IPv6 41/22041/3
Peter Mikus [Fri, 13 Sep 2019 08:22:29 +0000 (08:22 +0000)]
Add: AVF IPv6

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6cb4ef356047bdc341a70a4e7b8d0b3f54eb7f9d

10 months agoFIX: Pylint + Container mount 39/22039/2
Peter Mikus [Fri, 13 Sep 2019 08:13:09 +0000 (08:13 +0000)]
FIX: Pylint + Container mount

- Mount is affecting only LXC container

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84

10 months agoReport: Fixes 48/22048/1
Tibor Frank [Fri, 13 Sep 2019 11:53:23 +0000 (13:53 +0200)]
Report: Fixes

Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoCRC checker: Sort and indent dict output 26/22026/4
Vratko Polak [Thu, 12 Sep 2019 13:45:31 +0000 (15:45 +0200)]
CRC checker: Sort and indent dict output

Also, use double quotes, so the dict is shown
not only as a valid Python code, but also a valid JSON.
This should make it easier to handle big CRC changes such as:
https://logs.fd.io/production/vex-yul-rot-jenkins-1
/vpp-csit-verify-api-crc-master/646/console.log.gz

+ Log indented message about CRC conflict to console even on failure,
  as in the exception, endlines are escaped.

Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add data 35/22035/2
Tibor Frank [Fri, 13 Sep 2019 06:56:08 +0000 (08:56 +0200)]
Report: Add data

Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoSupport unidirection in all searches 30/21830/12
Vratko Polak [Fri, 6 Sep 2019 08:14:45 +0000 (10:14 +0200)]
Support unidirection in all searches

+ Rename bool unidirection to int traffic_directions.
+ Rename "untagged" to "initial" for bandwidth calculation.
+ Fix latency measurement for unidirectional traffic.
+ Remove duplicate colon in soak test message.
 + Edit PAL to accept both forms.
+ Fix minor documentation issues.

Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoCRC list: Compatible collection for 21997 20/22020/2
Vratko Polak [Thu, 12 Sep 2019 13:11:13 +0000 (15:11 +0200)]
CRC list: Compatible collection for 21997

Change-Id: I749d0164e9397769fc178f20eefe88b952e295d4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoReport: Add nfv reconf 21/22021/2
Tibor Frank [Thu, 12 Sep 2019 13:16:35 +0000 (15:16 +0200)]
Report: Add nfv reconf

Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoSkip CRC checking by default 92/21992/3
Vratko Polak [Wed, 11 Sep 2019 13:40:41 +0000 (15:40 +0200)]
Skip CRC checking by default

During https://gerrit.fd.io/r/c/ci-management/+/21955
we decided this new default is more convenient for development.

Change-Id: I07f10cbb586e79f6ac714ad635dda35561c07125
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoPAL: Add NFV reconf tests 82/21982/9
Tibor Frank [Wed, 11 Sep 2019 09:55:13 +0000 (11:55 +0200)]
PAL: Add NFV reconf tests

Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Temporarily remove pdf version 10/22010/1
Tibor Frank [Thu, 12 Sep 2019 07:53:49 +0000 (09:53 +0200)]
Report: Temporarily remove pdf version

Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTRex: 2.61 87/21987/5
Peter Mikus [Wed, 11 Sep 2019 11:19:27 +0000 (11:19 +0000)]
TRex: 2.61

- HDRhistogram can be rebased and used in separate patch.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680

10 months agoTopology: Cascadelake 80/21980/4
Peter Mikus [Wed, 11 Sep 2019 09:33:21 +0000 (09:33 +0000)]
Topology: Cascadelake

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb

10 months agoReport: Configure 1908.38 06/22006/1
Tibor Frank [Thu, 12 Sep 2019 06:53:21 +0000 (08:53 +0200)]
Report: Configure 1908.38

Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoRevert "API cleanup: tap" and bump stable_vpp 99/21999/1
Vratko Polak [Wed, 11 Sep 2019 16:21:56 +0000 (18:21 +0200)]
Revert "API cleanup: tap" and bump stable_vpp

The VPP change got a temporary -1,
as other change has higher priority.

Bumping stable VPP version, so this passes verify right away.

This reverts commit ae62a4348f7de53cfb91a5ae25a10723d5f9b398.

Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoCSIT-1597 API cleanup: tap 53/21953/5
Jan Gelety [Tue, 3 Sep 2019 20:18:17 +0000 (22:18 +0200)]
CSIT-1597 API cleanup: tap

cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706

Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoCSIT-1597: API cleanup: bond 59/21959/5
Jan Gelety [Wed, 4 Sep 2019 13:42:08 +0000 (15:42 +0200)]
CSIT-1597: API cleanup: bond

Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoAnsible: Cascadelake include 57/21957/10
Peter Mikus [Tue, 10 Sep 2019 11:27:11 +0000 (11:27 +0000)]
Ansible: Cascadelake include

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3

10 months agoReport: Remove NFV full data 83/21983/1
Tibor Frank [Wed, 11 Sep 2019 11:14:40 +0000 (13:14 +0200)]
Report: Remove NFV full data

Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoAnsible: Trex installation 49/21949/3
Peter Mikus [Tue, 10 Sep 2019 08:09:43 +0000 (08:09 +0000)]
Ansible: Trex installation

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0

10 months agoReport: Add data 75/21975/1
Tibor Frank [Wed, 11 Sep 2019 08:18:49 +0000 (10:18 +0200)]
Report: Add data

Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add pdf version 58/21958/1
Tibor Frank [Tue, 10 Sep 2019 11:50:24 +0000 (13:50 +0200)]
Report: Add pdf version

Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoPAL: Add replacing of data in tables 62/21862/9
Tibor Frank [Fri, 6 Sep 2019 11:54:11 +0000 (13:54 +0200)]
PAL: Add replacing of data in tables

+ vhost data

Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoRefactor getting telemetry 38/21638/21
Peter Mikus [Fri, 30 Aug 2019 13:20:14 +0000 (13:20 +0000)]
Refactor getting telemetry

+ Ability to get stats from CNF via SocketPAPI
- Remove obsolete functions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4d1b32a7279244592be96644e4f8a530c4f29a15

11 months agoUpdate of VPP_STABLE_VER files 27/21927/1
Jan Gelety [Wed, 4 Sep 2019 06:31:13 +0000 (08:31 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~163-g546f955~b7955

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~163-g546f955b3

 - use new vpp ref build - centos7:
   20.01-rc0~163_g546f955~b7763

Change-Id: I69ed9d37d2786de923c93d1de8d78e0a5e248954
Signed-off-by: Jan Gelety <jgelety@cisco.com>
11 months agoFIX: correct crc for sw_interface_slave_details 22/21922/1
Jan Gelety [Wed, 4 Sep 2019 04:40:31 +0000 (06:40 +0200)]
FIX: correct crc for sw_interface_slave_details

Change-Id: I4baae7da6f8fef8bd65f08e28fa1b55fb81857ce
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Report history 18/21918/1
Tibor Frank [Mon, 9 Sep 2019 12:55:26 +0000 (14:55 +0200)]
Report: Report history

Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoAPI cleanup: memif 22/21822/5
Jan Gelety [Tue, 3 Sep 2019 11:52:44 +0000 (13:52 +0200)]
API cleanup: memif

Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoUpdate of VPP_STABLE_VER files 10/21910/3
Jan Gelety [Wed, 4 Sep 2019 01:56:26 +0000 (03:56 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   20.01-rc0~159-gb736e75~b7951

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~159-gb736e75d5

 - use new vpp ref build - centos7:
   20.01-rc0~159_gb736e75~b7759

Change-Id: I4def341aad97cb039c11ec45be2846d0fb691435
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 months agoReport: Add dnv mrr data 11/21911/2
Tibor Frank [Mon, 9 Sep 2019 10:58:25 +0000 (12:58 +0200)]
Report: Add dnv mrr data

Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Fix tsh and dnv plots 06/21906/1
Tibor Frank [Mon, 9 Sep 2019 10:16:36 +0000 (12:16 +0200)]
Report: Fix tsh and dnv plots

Change-Id: I1d40849bc15f4433117af91f71e951a61924d732
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Add soak tests 99/21899/1
Tibor Frank [Mon, 9 Sep 2019 07:01:18 +0000 (09:01 +0200)]
Report: Add soak tests

Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Fix2 - Add 3n-dnv plots and tables 78/21878/2
Tibor Frank [Fri, 6 Sep 2019 17:41:15 +0000 (17:41 +0000)]
Report: Fix2 - Add 3n-dnv plots and tables

Change-Id: Ia182e6e52a37f9b3248eab60ffe4dd4746ed7fa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agodocs: add select list of tests for report - tsh and dnv 65/21865/1
Jan Gelety [Tue, 3 Sep 2019 20:33:45 +0000 (22:33 +0200)]
docs: add select list of tests for report - tsh and dnv

Change-Id: I63a69d998c80029422bae9f90e186eb2286196d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
11 months agoSupport new sw_interface_slave_details CRC 80/21780/3
Vratko Polak [Thu, 5 Sep 2019 08:33:12 +0000 (10:33 +0200)]
Support new sw_interface_slave_details CRC

Change-Id: I2f72a741ac7353ad36f6a2dada26eabb1a76cb2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoRead environment variables in Constants.py 24/21824/6
Vratko Polak [Thu, 5 Sep 2019 14:15:19 +0000 (16:15 +0200)]
Read environment variables in Constants.py

Instead of using EnsureGlobalVariable,
which is clunky to use from Python.

As a consequence, all caps variables from Constants.py are used directly
and tests/__init__.robot and robot_enhancements.robot are deleted.

+ Rename the CRC global kill switch based on ci-man review.

Change-Id: I10723792475bc83352bf8c3b7f7946ecf885a194
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoReport: Fix - Add 3n-dnv plots and tables 42/21842/1
Tibor Frank [Fri, 6 Sep 2019 07:43:53 +0000 (09:43 +0200)]
Report: Fix - Add 3n-dnv plots and tables

Change-Id: I5f09f1f20e532e71d6abde02111a90f5868035f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Add 3n-dnv plots and tables 38/21838/2
Tibor Frank [Fri, 6 Sep 2019 06:13:09 +0000 (08:13 +0200)]
Report: Add 3n-dnv plots and tables

Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Add 2n-dnv plots and tables 25/21825/1
Tibor Frank [Thu, 5 Sep 2019 12:01:09 +0000 (14:01 +0200)]
Report: Add 2n-dnv plots and tables

Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Add DNV data 13/21813/4
Tibor Frank [Thu, 5 Sep 2019 08:49:33 +0000 (10:49 +0200)]
Report: Add DNV data

Change-Id: I020373b1553300459654ded31d940b0a5562eb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoAllow CRC checking to be controlled via env var 18/21718/5
Vratko Polak [Wed, 4 Sep 2019 11:13:08 +0000 (13:13 +0200)]
Allow CRC checking to be controlled via env var

The plan is to override the default in some (but not all) jobs.
The csit-vpp jobs shall do the checking, but vpp-csit jobs shall not
(except api-crc job of course) in order to confirm benign changes.

Change-Id: If59d17991de3fb0e847113a87e0533a8ee62af7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoReport: Fix listing order of new vs. see footnote 09/21809/1
Tibor Frank [Thu, 5 Sep 2019 07:54:39 +0000 (09:54 +0200)]
Report: Fix listing order of new vs. see footnote

Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Fix hsw vs. skx comparison table 05/21805/1
Tibor Frank [Thu, 5 Sep 2019 06:40:20 +0000 (08:40 +0200)]
Report: Fix hsw vs. skx comparison table

Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Fix fonts in release notes table 01/21801/1
Tibor Frank [Thu, 5 Sep 2019 06:27:10 +0000 (08:27 +0200)]
Report: Fix fonts in release notes table

Change-Id: I4a3486c313c4aa4754c455389b8ebb363ead469a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Configure Report 1908.37 97/21797/2
Tibor Frank [Thu, 5 Sep 2019 06:20:32 +0000 (08:20 +0200)]
Report: Configure Report 1908.37

Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoFIX: Use vhost macs when testpmd_mac forwarding used in VM 17/21717/8
Jan Gelety [Mon, 2 Sep 2019 21:28:30 +0000 (23:28 +0200)]
FIX: Use vhost macs when testpmd_mac forwarding used in VM

Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682
Signed-off-by: Jan Gelety <jgelety@cisco.com>
11 months agoClarify why 9000B tests are skipped for IPsec 67/21667/2
Vratko Polak [Mon, 2 Sep 2019 12:13:19 +0000 (14:13 +0200)]
Clarify why 9000B tests are skipped for IPsec

Ticket: VPP-1207

Change-Id: I506b4a24dfa6b10578407b261926f37215a714f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoReport methodology: PLRsearch update with graphs 11/21711/4
Vratko Polak [Wed, 4 Sep 2019 10:51:50 +0000 (12:51 +0200)]
Report methodology: PLRsearch update with graphs

Change-Id: Ib73a64c93bdba3945b8237783a24134b47d4eb99
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agodocs: report vpp performance rls notes update. 81/21781/3
Maciek Konstantynowicz [Wed, 4 Sep 2019 11:56:55 +0000 (12:56 +0100)]
docs: report vpp performance rls notes update.

Change-Id: Ie4a7a80cad9ff92b9f30953096cca8a029edc687
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
11 months agodocs: report packet_throughput_graphs text formatting fixes. 73/21773/2
Maciek Konstantynowicz [Wed, 4 Sep 2019 11:11:54 +0000 (12:11 +0100)]
docs: report packet_throughput_graphs text formatting fixes.

Change-Id: Ibea6e70e2fcf9cfeb7627ee1cbcfa6e177c0b2c6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
11 months agoHotfix: Bump version and CRCs 57/21757/2
Vratko Polak [Wed, 4 Sep 2019 08:33:49 +0000 (10:33 +0200)]
Hotfix: Bump version and CRCs

Naginator caused a false Verified+1,
so a benign API change had been merged prematurely.

Change-Id: I8852ca684cba4876d46049ca34204ebbccf96b2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoDoc: Report release notes (perf) 63/21763/2
Peter Mikus [Wed, 4 Sep 2019 09:04:40 +0000 (09:04 +0000)]
Doc: Report release notes (perf)

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c1667efec67febd375818bc1dfe1d9bebc70708

11 months agodocs: added methodology terminology section to report. 88/21588/5
Maciek Konstantynowicz [Wed, 28 Aug 2019 13:41:07 +0000 (14:41 +0100)]
docs: added methodology terminology section to report.

Change-Id: Id787d12b577165a1081dba84b610c32df57a7c44
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
11 months agodocs: report updates in physical_testbeds section. 90/21690/6
Maciek Konstantynowicz [Mon, 2 Sep 2019 18:29:05 +0000 (19:29 +0100)]
docs: report updates in physical_testbeds section.

Change-Id: Id31e6ed294dc80619a108296be580925509bb7d7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
11 months agodocs: updated report intro in packet_throughput_graphs 38/21738/3
Maciek Konstantynowicz [Tue, 3 Sep 2019 21:16:30 +0000 (22:16 +0100)]
docs: updated report intro in packet_throughput_graphs

Change-Id: I3bf70cc7e48ef2134841bc4bf9300cda6a118cb3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
11 months agodocs: added 3n-tsh testbed tests to report_test_groups.txt 39/21739/2
Maciek Konstantynowicz [Tue, 3 Sep 2019 21:37:45 +0000 (22:37 +0100)]
docs: added 3n-tsh testbed tests to report_test_groups.txt

Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
11 months agoReport: ixgbe for tsh 46/21746/1
Tibor Frank [Wed, 4 Sep 2019 07:21:26 +0000 (09:21 +0200)]
Report: ixgbe for tsh

Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Add data 42/21742/1
Tibor Frank [Wed, 4 Sep 2019 06:47:28 +0000 (08:47 +0200)]
Report: Add data

Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Comparison tables 33/21733/3
Tibor Frank [Tue, 3 Sep 2019 20:26:25 +0000 (20:26 +0000)]
Report: Comparison tables

Change-Id: I108e1292c5de8024060c220b877b668b8843c68f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Comparison tables 24/21724/3
Tibor Frank [Tue, 3 Sep 2019 17:52:02 +0000 (17:52 +0000)]
Report: Comparison tables

Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: Comparison tables 12/21712/1
Tibor Frank [Tue, 3 Sep 2019 12:08:37 +0000 (14:08 +0200)]
Report: Comparison tables

Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoReport: add data 07/21707/1
Tibor Frank [Tue, 3 Sep 2019 09:07:36 +0000 (11:07 +0200)]
Report: add data

Change-Id: I51fd0b9e07d09224452f842689925d1166246f19
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoCSIT-1590: Performance comparison analysis 01/21701/1
Tibor Frank [Tue, 3 Sep 2019 06:56:27 +0000 (08:56 +0200)]
CSIT-1590: Performance comparison analysis

Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoCSIT-1590: Performance comparison analysis 97/21697/1
Tibor Frank [Tue, 3 Sep 2019 06:45:31 +0000 (08:45 +0200)]
CSIT-1590: Performance comparison analysis

Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoPAL: list all sel tests in table_performance_comparison 84/21684/1
Tibor Frank [Mon, 2 Sep 2019 16:48:37 +0000 (18:48 +0200)]
PAL: list all sel tests in table_performance_comparison

Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348
Signed-off-by: Tibor Frank <tifrank@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.