csit.git
3 years agoCSIT-1131: Alerting 79/14779/17
Tibor Frank [Wed, 12 Sep 2018 07:01:54 +0000 (09:01 +0200)]
CSIT-1131: Alerting

- CSIT-1132: Send e-mail with a list of failed tests
- CSIT-1288: Prepare data to be sent by Jenkins

Change-Id: I7ac720dca44d7c13b22218abbca7a00d36d459cb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd dot1q-l2[bd|xc]base-[ndrpdr|mrr] perf tests for 2-node topology 20/14820/6
Jan Gelety [Fri, 14 Sep 2018 09:00:33 +0000 (11:00 +0200)]
Add dot1q-l2[bd|xc]base-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1284

Change-Id: I8ce4ffc76adf55bf9a8423077b8639601c560c87
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 49/14849/1
Jan Gelety [Mon, 17 Sep 2018 07:47:15 +0000 (09:47 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~422-geeadc14~b5124

- use new vpp ref build - centos7:
  18.10-rc0~424_gef90ed0~b5050

- use new dpdk version:
  18.08-vpp3

NOTE: Centos7 and Ubuntu16.04 builds are litle bit different
      because of availability of builds on repo.

Change-Id: I6cefd91351848fb075935ae9b41354d3432eacf3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAdd dot1q-ip4base-[ndrpdr|mrr] perf tests for 2-node topology 61/14761/13
Jan Gelety [Tue, 11 Sep 2018 12:12:54 +0000 (14:12 +0200)]
Add dot1q-ip4base-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1278

Change-Id: I3cc929222d7fd58f38e33917e84675e9c0b55bbd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAdd coding guidelines document 19/14219/10
Vratko Polak [Wed, 15 Aug 2018 17:17:42 +0000 (19:17 +0200)]
Add coding guidelines document

Started as a quite verbatim paste from:
https://wiki.fd.io/view/CSIT/Documentation#CSIT_Test_Code_Guidelines
then re-formatted, and new ideas added.

Change-Id: I13fc3d267f07d88cf22402051480613e55123d44
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoCSIT-1282 Migrate from Nexus.fd.io to packagecloud.io 86/14786/8
Peter Mikus [Wed, 12 Sep 2018 14:59:04 +0000 (14:59 +0000)]
CSIT-1282 Migrate from Nexus.fd.io to packagecloud.io

Change-Id: Ib4e72dc8e3c0fedfcd702f4f97bc4f26cbc642e9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-1280 Single memif container test failing 71/14771/3
Peter Mikus [Wed, 12 Sep 2018 09:59:19 +0000 (09:59 +0000)]
CSIT-1280 Single memif container test failing

- FIX

Change-Id: I4b62d08b140dc73eb950d21bc85dc41ad638bbd2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoFix: L2 scale tests are not baseline 84/14784/1
Vratko Polak [Wed, 12 Sep 2018 14:33:58 +0000 (16:33 +0200)]
Fix: L2 scale tests are not baseline

This fixes select_tags function in common.sh
to not include scale l2bd tests in default tag list.

This is needed because "L2BDBASE" tag selects also scale tests
(contrary to similar IP4BASE and IP6BASE tags).

(Line length over 80 characters is left there
as an indirect TODO to improve the tags.)

Change-Id: Ic1d4a046f327fdd1b8b08eb20f1cdb4b12f337c9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFix: trap for unreserve before cleanup 72/14772/2
Vratko Polak [Wed, 12 Sep 2018 11:16:22 +0000 (13:16 +0200)]
Fix: trap for unreserve before cleanup

Change-Id: I978a056ffdfd6daa00a0a1c587774b4a7204b434
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoCSIT-1269: Add VTS tests to trending 26/14726/3
Tibor Frank [Fri, 7 Sep 2018 12:19:35 +0000 (14:19 +0200)]
CSIT-1269: Add VTS tests to trending

Change-Id: I9ddbad8e4c3f64553c72f77f93eb9d6c21602eca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCreate l2bdscale tests for 2-node topology 97/14697/5
Jan Gelety [Thu, 6 Sep 2018 12:15:26 +0000 (14:15 +0200)]
Create l2bdscale tests for 2-node topology

Jira: CSIT-1268

Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT-1179: Switch MRR to multiple trials 96/14596/2
Vratko Polak [Fri, 31 Aug 2018 11:18:52 +0000 (13:18 +0200)]
CSIT-1179: Switch MRR to multiple trials

But keep the detection in PAL using only average, not size nor stdev.

Change-Id: I07092bdeb892c871550265757fd2846a36fbb352
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoCSIT-1270: Split feature tests in trending 23/14723/2
Tibor Frank [Fri, 7 Sep 2018 11:19:08 +0000 (13:19 +0200)]
CSIT-1270: Split feature tests in trending

Change-Id: Iecc841737552fea07b7fcf297c478479f7872ae7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-1271: Add VTS tests to MRR jobs 95/14695/3
Tibor Frank [Thu, 6 Sep 2018 12:06:12 +0000 (14:06 +0200)]
CSIT-1271: Add VTS tests to MRR jobs

Change-Id: I5c0be60a1819c5c46225b4468ba9c88068231f08
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-1272: Fix VTS tests 96/14696/4
Tibor Frank [Thu, 6 Sep 2018 12:12:49 +0000 (14:12 +0200)]
CSIT-1272: Fix VTS tests

Change-Id: Ibc4ae346032b2b711e4dcd1dbc9c0873e8464b19
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-1262: Add 2n/3n-skx to trending 40/14640/21
Tibor Frank [Tue, 4 Sep 2018 07:37:39 +0000 (09:37 +0200)]
CSIT-1262: Add 2n/3n-skx to trending

CSIT-1263: Edit Trending static content

Change-Id: Ief60f3bea75fb9fd153f7abb0a5933f1a3e317aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCreate ip6scale tests for 2-node topology 77/14677/5
Jan Gelety [Wed, 5 Sep 2018 13:27:06 +0000 (15:27 +0200)]
Create ip6scale tests for 2-node topology

Jira: CSIT-1176

Change-Id: I78f4e9cb24a7de0bde24a78d1ca26607598a62b2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAdd INFO.yaml file 18/14518/3
Vanessa Rene Valderrama [Mon, 27 Aug 2018 16:04:26 +0000 (11:04 -0500)]
Add INFO.yaml file

Add INFO.yaml to list:
- Project description
- Properties
- Issue Tracking
- Contacts
- PTL information
- Meeting information
- Committer information

Change-Id: I02ef3fca1bef20ab5497b632c1995019bd7d1074
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
3 years agoFix autogen violations 90/14690/2
Vratko Polak [Thu, 6 Sep 2018 10:57:32 +0000 (12:57 +0200)]
Fix autogen violations

Four AVF suites had test cases in different order.

Change-Id: I12fbe3508016a79a2153cc004c654a21ee4279bf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoCSIT-1264: Add oper branch wrapper entry script 35/14635/6
Vratko Polak [Thu, 6 Sep 2018 10:17:11 +0000 (12:17 +0200)]
CSIT-1264: Add oper branch wrapper entry script

Change-Id: I569b089b711f89fecca8dd31d6906ef311982877
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agofix CSIT broken issue when numa_node value is -1 on single Socket platform 63/14663/3
Yulong Pei [Wed, 5 Sep 2018 15:19:42 +0000 (23:19 +0800)]
fix CSIT broken issue when numa_node value is -1 on single Socket platform

Single Socket platform e.g. Intel Atom cpu based SOC platform with
Ubuntu 16.04.4(kernel 4.13.0-36-generic) or Centos 7.5 (kernel 3.10.0-862.el7),
value of /sys/bus/pci/devices/<pci_device_id>/numa_node is -1, this will
break CSIT performance test running, but for this kind of SOC platform,
it can consider that is not NUMA based platform, numa_node=-1 is reasonable,
so fix it at CSIT side, when numa_node=1 and the system's NUMA node count
is 1, set numa_node=0. DPDK also did it as this way.

Change-Id: I9ac23d3cece2f1489e38f05b50a462bb2ad9f661
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
3 years agoCreate ip4scale tests for 2-node topology 48/14648/6
Jan Gelety [Tue, 4 Sep 2018 13:14:29 +0000 (15:14 +0200)]
Create ip4scale tests for 2-node topology

Jira: CSIT-1174

Change-Id: I46944a3bc0f508d80c8c944dab0190925ebe21f5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT-1205 Create AVF driver test 87/13587/47
Peter Mikus [Fri, 20 Jul 2018 13:07:12 +0000 (13:07 +0000)]
CSIT-1205 Create AVF driver test

- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...)
- Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/...
- Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface
- Add sample L2patch test fox x710, xxv710

Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoAdd Report history 74/14674/1
Tibor Frank [Wed, 5 Sep 2018 13:39:06 +0000 (15:39 +0200)]
Add Report history

Change-Id: I5c7e594bcce266d765d2a517adcbec8e88da7c48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd known issues to report 18.07 66/14666/1
Tibor Frank [Wed, 5 Sep 2018 11:21:19 +0000 (13:21 +0200)]
Add known issues to report 18.07

Change-Id: Ide101c80e2ef13021f25096da6afd9e4364ee263
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFix various pylint violations 20/14620/5
Vratko Polak [Tue, 4 Sep 2018 17:19:11 +0000 (19:19 +0200)]
Fix various pylint violations

+ SchedUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ VatHistory.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ VppCounters.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ Memif.py:
++ Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Either all return statements in a function should return an expression,
   or none of them should.
++ Update :return: on possible None.
+ Classify.py: Unnecessary "else" after "return"
+ ContainerUtils.py: Useless super delegation in method '__init__'
+ CpuUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ DropRateSearch.py: Either all return statements in a function
  should return an expression, or none of them should.
+ IPv4NodeAddress.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also improve docstrings.
+ IPv4Setup.py: Useless super delegation in method '__init__'
+ IPv6Setup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also improve docstrings.
+ IPv6Setup.py: standard import "from ipaddress import IPv6Network"
  should be placed before "from robot.api import logger"
+ MacSwap.py: Trailing newlines
+ NATUtil.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ NodePath.py: Unnecessary "else" after "return"
+ Tap.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ topology.py: Either all return statements in a function
  should return an expression, or none of them should.
+ topology.py: Unnecessary "else" after "return"
++ Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Improve docstrings
+ DUTSetup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also do not compare int(ret_code) just to access zero-ness.
+ ssh.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ InterfaceUtil.py: Unnecessary "else" after "return"

Change-Id: Iba4244aa79661ee7df15fed5c7c6dbf04dfa88b2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoAdd eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topology 01/14601/15
Jan Gelety [Fri, 31 Aug 2018 13:51:08 +0000 (15:51 +0200)]
Add eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topology

- added also 3-node test cases for comparison

Jira: CSIT-1261

Change-Id: I1bfcc184e925e969d4a610920c4e49af23047507
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix pylint part 1 10/14610/3
Peter Mikus [Sat, 1 Sep 2018 15:29:37 +0000 (15:29 +0000)]
Fix pylint part 1

- Decrease pylint errors. Part: easy

Change-Id: I452e5b5a11e9b78c03cd173a3848babe21b93c73
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-1135: Scripts for VPP per-patch testing 81/13981/99
Vratko Polak [Fri, 10 Aug 2018 08:20:30 +0000 (10:20 +0200)]
CSIT-1135: Scripts for VPP per-patch testing

+ Scripts do not rely on (other) bootstraps.
+ Perf verify bootstrap is also the new style sript now.
+ Scripts are divided to functions for better re-use.
+ Functions are sourced from small number of large "library" files.
- Still using jumpavg from pipy.
- Perpatch has specific simplified parsing (instead of the PAL one).
- Bash style document is in a separate Change.

Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoCreate ip4-feature perf tests for 2-node topology 40/14440/16
Jan Gelety [Thu, 23 Aug 2018 14:12:13 +0000 (16:12 +0200)]
Create ip4-feature perf tests for 2-node topology

- ACL tests
- NAT44 tests
- iPoliceMarker tests

Jira: CSIT-1175, CSIT-1154

Change-Id: Ife7e7df50f7c1c8033bacdb7512e78be6bcdf4eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 91/14491/2
Jan Gelety [Mon, 27 Aug 2018 06:42:31 +0000 (08:42 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~242-g0219b8d~b4906

- use new vpp ref build - centos7:
  18.10-rc0~242_g0219b8d~b4824

- use new dpdk version:
  18.08-vpp1

Change-Id: I1c8a12d3481108ceff8da1f4e31431fbdd9a7f1f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInsert warning against editing in requirements.txt 47/13147/8
Vratko Polak [Fri, 24 Aug 2018 16:20:38 +0000 (18:20 +0200)]
Insert warning against editing in requirements.txt

Change-Id: Ifed10692e122c3a42d75282c92476e508cec597d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFIX: Correction of ACL perf test suite documentation 98/14498/1
Jan Gelety [Mon, 27 Aug 2018 11:13:27 +0000 (13:13 +0200)]
FIX: Correction of ACL perf test suite documentation

Change-Id: I01cc87f5f5409346566ded52da9d384fdd3fa2c4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoadd the expected prompt for ubuntu root user 92/13992/2
Yulong Pei [Tue, 7 Aug 2018 10:37:18 +0000 (18:37 +0800)]
add the expected prompt for ubuntu root user

if ssh use root account to login ubuntu os, its prompt is ":~# ",
so add it to let csit test can run with root account.

Change-Id: I21f5380245324c8e48099433e3d374188e9001d9
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
3 years agoAdjust TEST_TAGs for timed jobs 60/14460/2
Peter Mikus [Fri, 24 Aug 2018 12:36:06 +0000 (12:36 +0000)]
Adjust TEST_TAGs for timed jobs

+ remove obsolete bootstraps

Change-Id: Iee1fe404106f2fa0c438ff30526e756f037ce676
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoVPP link bonding perf tests with two links between DUTs 99/14399/14
Jan Gelety [Tue, 21 Aug 2018 13:04:01 +0000 (15:04 +0200)]
VPP link bonding perf tests with two links between DUTs

Jira: CSIT-1247

Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoreport 18.07: added 2 known issues identified in CSIT-18.07 for vpp performance. 37/14437/2
Maciek Konstantynowicz [Thu, 23 Aug 2018 13:17:53 +0000 (14:17 +0100)]
report 18.07: added 2 known issues identified in CSIT-18.07 for vpp performance.

Change-Id: I220084bb5b5fd4909c8f1e2bef60e98594958e45
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoCSIT-1222: Edit MLRsearch readme for 0.2.0 release 12/14412/2
Vratko Polak [Wed, 22 Aug 2018 10:29:03 +0000 (12:29 +0200)]
CSIT-1222: Edit MLRsearch readme for 0.2.0 release

Change-Id: Ib2349f574720c61040f824f87bce01b5d68a2598
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoCSIT-944: PAL Extensions: Mapping table 60/14360/24
Tibor Frank [Mon, 20 Aug 2018 12:23:46 +0000 (14:23 +0200)]
CSIT-944: PAL Extensions: Mapping table

Change-Id: I3bebf9ad849c056d2bbac476d22ef5e077af05b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-1164 Create VM vhost tests for 2-node topology 81/14381/6
Peter Mikus [Tue, 21 Aug 2018 08:24:00 +0000 (08:24 +0000)]
CSIT-1164 Create VM vhost tests for 2-node topology

Change-Id: I955d3170da94cf35a2fda03259bcdc020ac2b652
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-1222: Do two doublings in external MLRsearch 11/13811/8
Vratko Polak [Mon, 30 Jul 2018 15:48:50 +0000 (17:48 +0200)]
CSIT-1222: Do two doublings in external MLRsearch

Make number of doublings configurable,
keep Python default at 1, set Robot default to 2.

Also make docstring types unique
(pylint was complaining about classes and modules having the same name).

Increase MLRsearch version to 0.2.0.

Change-Id: Ib846032e79ff52994503c0cfef2f86655502c275
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoHC Report: update list of known issues 90/14390/2
Marek Gradzki [Tue, 21 Aug 2018 11:28:44 +0000 (13:28 +0200)]
HC Report: update list of known issues

Current list was based on Jira,
which turned out to be outdated.

Change-Id: I216616cda766075b8b78f7c3f2f7a6775a622e23
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
3 years agoHC Tests: reenable VxLaN GPE ipv6 tests 76/14376/3
Marek Gradzki [Tue, 21 Aug 2018 06:03:46 +0000 (08:03 +0200)]
HC Tests: reenable VxLaN GPE ipv6 tests

The issue is no longer present in VPP master branch (1810).

Change-Id: I64f4fa8544ace8dc3686db9a1a3f3897ba333c61
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
3 years agoFIX: Use correct interface type in x710_1lbvpplacp perf tests 95/14395/1
Jan Gelety [Tue, 21 Aug 2018 13:10:27 +0000 (15:10 +0200)]
FIX: Use correct interface type in x710_1lbvpplacp perf tests

Change-Id: I68db0b0441ffc7d9b5e04048688711915ab24726
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAdd MRR tests for kubernetes 15/13715/6
Vratko Polak [Thu, 26 Jul 2018 11:56:51 +0000 (13:56 +0200)]
Add MRR tests for kubernetes

Fix number of flows in Documentation.

Change-Id: I0db62ab79c44db0ea55e000f8ef9cb8ee28a07fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFIX: Boostrap-perf array assignment 82/14382/2
Peter Mikus [Tue, 21 Aug 2018 08:27:55 +0000 (08:27 +0000)]
FIX: Boostrap-perf array assignment

Change-Id: I4d7c27dd182ae8e7b68b5f6342c163ac3615cad2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoHC Tests: mark BGP v6 tests as critical 67/14367/1
Marek Gradzki [Mon, 20 Aug 2018 14:51:33 +0000 (16:51 +0200)]
HC Tests: mark BGP v6 tests as critical

TC13 of BGP tests was marked as EXPECTED_FAILING
due to HONEYCOMB-403,
but the error does not occur on 1807 nor master for some time.

Change-Id: I3d8f4ee78fed699927fed05e8fa070cfa95b2166
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
3 years agoRefactor VHOST code 07/14007/30
Peter Mikus [Tue, 7 Aug 2018 08:17:12 +0000 (08:17 +0000)]
Refactor VHOST code

CSIT-1164 Create VM vhost tests for 2-node topology
CSIT-1173 Implement VM vhost KWs for 2-node topology

- Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue,
ring size, qemu version detection)
- Cleanup VHOST KWs perf (Unify running QEMU on N-node topology)
- Add ability to configure Queues, Hyperthreading, automatically compute
number of CPU for VM/Testpmd and RXQ for Testpmd workload.
- Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node
- Create IPv4 2-node KW

Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 50/14350/2
Jan Gelety [Mon, 20 Aug 2018 07:41:38 +0000 (09:41 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~193-g612dd6a~b4857

- use new vpp ref build - centos7:
  18.10-rc0~193_g612dd6a~b4774

Change-Id: I2bb408d0299d8e6bad0ad8e6b37eccf27d3f6de9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPAL improvement: Log repr() of PresentationError 95/14195/5
Vratko Polak [Tue, 14 Aug 2018 08:23:21 +0000 (10:23 +0200)]
PAL improvement: Log repr() of PresentationError

Change-Id: I491e3a77dda06e6a1caa34f70baaef9751674fbd
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFIX: PAL: Keep increasing index on error 53/14253/4
Vratko Polak [Wed, 15 Aug 2018 10:25:14 +0000 (12:25 +0200)]
FIX: PAL: Keep increasing index on error

The previous fix has added KeyError reporting and recovery,
but the reported index got stuck on value 15.

Change-Id: I2cec0f678a79ba3e5ca425c92c605e00cf551a35
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoreport 18.07: fixed link mapping for generated report pdf file. 44/14344/1
Maciek Konstantynowicz [Sat, 18 Aug 2018 15:05:40 +0000 (16:05 +0100)]
report 18.07: fixed link mapping for generated report  pdf file.

Change-Id: I2e23fe3b6f03055beab536e6534dd43d229b7024
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agorelease 1807: fixed directory nesting for perf comparison files. 42/14342/1
Maciek Konstantynowicz [Sat, 18 Aug 2018 14:17:08 +0000 (15:17 +0100)]
release 1807: fixed directory nesting for perf comparison files.

Change-Id: I14e1a53543ab3b03b3136920a67ab594a22167cf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 18.07: bump report version to v1.0. 38/14338/1
Maciek Konstantynowicz [Sat, 18 Aug 2018 08:20:14 +0000 (09:20 +0100)]
report 18.07: bump report version to v1.0.

Change-Id: Id8d17666bd6cff45641f5d44c63db59603680a54
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 18.07: final final editorial nit picking in v0.9. 36/14336/1
Maciek Konstantynowicz [Sat, 18 Aug 2018 08:17:16 +0000 (09:17 +0100)]
report 18.07: final final editorial nit picking in v0.9.
Formatting and removing excessive white space in static content.

Change-Id: I7400f4ba6386b85b59b667db026558685ec0d1a1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 18.07: Bump report version to v0.9. 29/14329/1
Maciek Konstantynowicz [Fri, 17 Aug 2018 22:04:51 +0000 (23:04 +0100)]
report 18.07: Bump report version to v0.9.

Change-Id: Ic4f5520f69d0a97afe54aa8fed269812993d66f7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 18.07: draft v0.9 editorial nit-picking, take-2. 27/14327/1
Maciek Konstantynowicz [Fri, 17 Aug 2018 22:00:26 +0000 (23:00 +0100)]
report 18.07: draft v0.9 editorial nit-picking, take-2.

Change-Id: Id2a627b1e48275f505a3ea50004285516a47897e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 18.07: draft v0.9 editorial nit-picking. 25/14325/2
Maciek Konstantynowicz [Fri, 17 Aug 2018 21:40:16 +0000 (22:40 +0100)]
report 18.07: draft v0.9 editorial nit-picking.

Change-Id: I7fb9dff8f5ebce0ac03ef99c74b14b02638042ac
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 18.07: Bump report version to 0.8. 22/14322/1
Maciek Konstantynowicz [Fri, 17 Aug 2018 18:47:24 +0000 (19:47 +0100)]
report 18.07: Bump report version to 0.8.

Change-Id: Ic5ac9733534fc0f67467c6ea47a4123e246a793a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 18.07: moved performance change/compare sections out of rls notes to separate... 13/14313/8
Maciek Konstantynowicz [Fri, 17 Aug 2018 14:31:08 +0000 (15:31 +0100)]
report 18.07: moved performance change/compare sections out of rls notes to separate sections for vpp and dpdk.

Change-Id: If620cd894ea906baf0391617e5440e34f7136c37
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 18.07: updated known issues perf changes based on latest test data in report. 17/14317/1
Maciek Konstantynowicz [Fri, 17 Aug 2018 17:03:59 +0000 (18:03 +0100)]
report 18.07: updated known issues perf changes based on latest test data in report.

Change-Id: I070cdecb936f294da4798712c197795aa0a85d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoAdd NIC exclusion for all jobs in perf bootstrap 14/14314/3
Peter Mikus [Fri, 17 Aug 2018 14:56:16 +0000 (14:56 +0000)]
Add NIC exclusion for all jobs in perf bootstrap

This patch is suppose to move the processing logic for all job
types, including timed trigger perf jobs. This should eliminate MRR job
to run NIC tests not in topology file.

Change-Id: I9add5073266bd37fd3ef2c6efe7244b41e85f2a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoreport 18.07: reformatted known issues tables in rls notes sections. 11/14311/3
Maciek Konstantynowicz [Fri, 17 Aug 2018 12:22:02 +0000 (13:22 +0100)]
report 18.07: reformatted known issues tables in rls notes sections.

Change-Id: I2e6c6910542ec06ffd68a95d66c427fe2589c833
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agocopying all .so[newly added] into app directory 77/14177/14
sharath [Mon, 13 Aug 2018 14:46:56 +0000 (20:16 +0530)]
copying all .so[newly added] into app directory

Change-Id: I5b89732c5dd1a4b74ffbafbd78803721dbf9c61c
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
3 years agoRemove DPDK MRR changes section from report 09/14309/2
Peter Mikus [Fri, 17 Aug 2018 11:27:37 +0000 (11:27 +0000)]
Remove DPDK MRR changes section from report
Bump report version to 0.7

Change-Id: I77478e3b58daab25bdece1e67795cc911f470136
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoreport 1807: updated known issues in vpp perf rls notes. 96/14296/4
Maciek Konstantynowicz [Thu, 16 Aug 2018 19:31:53 +0000 (20:31 +0100)]
report 1807: updated known issues in vpp perf rls notes.

Change-Id: I340548173018d234f699b1125c886fcd9ae75347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoCSIT-1245 - Wrong configuration of srv6proxy-ndrpdr-stat and srv6proxy-masq-ndrpdr TCs 07/14307/1
Peter Mikus [Fri, 17 Aug 2018 10:55:59 +0000 (10:55 +0000)]
CSIT-1245 - Wrong configuration of srv6proxy-ndrpdr-stat and srv6proxy-masq-ndrpdr TCs

Change-Id: If5a45b97c90f85f2f193d796adbddd329f2728cd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoAdd new data to 1807 report 02/14302/1
pmikus [Fri, 17 Aug 2018 07:55:32 +0000 (07:55 +0000)]
Add new data to 1807 report

Change-Id: Ic03c55a198f6deb0cae5c920d7937696dfa19c9e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoBump report version to 0.6 88/14288/2
Peter Mikus [Thu, 16 Aug 2018 15:32:40 +0000 (15:32 +0000)]
Bump report version to 0.6

Change-Id: I820288a7209b6c0017ee42f5087f0687679ab078
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoreport 1807: dpdk and vpp rls notes update, known issues. 83/14283/2
Maciek Konstantynowicz [Thu, 16 Aug 2018 09:50:23 +0000 (10:50 +0100)]
report 1807: dpdk and vpp rls notes update, known issues.

Change-Id: I15372226eaac6d505793b1c87e2ff16c8e5e8928
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoChange report version to 0.5 84/14284/2
Peter Mikus [Thu, 16 Aug 2018 10:01:08 +0000 (10:01 +0000)]
Change report version to 0.5

Change-Id: I556a8e98d1725ed9465eca2721886869a3a1a39b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoAdd new data set into report 79/14279/2
Peter Mikus [Thu, 16 Aug 2018 09:09:11 +0000 (09:09 +0000)]
Add new data set into report

Change-Id: Ic280eed9e888524805e019679c8549c75c5981c0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoreport 1807: list and table formatting fixes. 77/14277/2
Maciek Konstantynowicz [Thu, 16 Aug 2018 09:05:51 +0000 (10:05 +0100)]
report 1807: list and table formatting fixes.

Change-Id: I1233e903a9590d12ae0cf0032e33a017fea07b3e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 1807: fixed index.html for introduction section. 76/14276/1
Maciek Konstantynowicz [Thu, 16 Aug 2018 08:45:55 +0000 (09:45 +0100)]
report 1807: fixed index.html for introduction section.

Change-Id: Ie733827e20083b78ed75f1e70f7762dd8a963404
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 1807: editorial nit-picking in all graph sections. 64/14264/4
Maciek Konstantynowicz [Wed, 15 Aug 2018 15:23:37 +0000 (16:23 +0100)]
report 1807: editorial nit-picking in all graph sections.

Change-Id: Ib366f57fbe590faae3b13f96ab68fb528046f619
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 1807: editorial nit-picking in all performance changes and comparison sections. 65/14265/1
Maciek Konstantynowicz [Wed, 15 Aug 2018 15:55:25 +0000 (16:55 +0100)]
report 1807: editorial nit-picking in all performance changes and comparison sections.

Change-Id: Ib0ea94894df1bd70cef83a97453662f0074e640f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 1807: editorial nit-picking and formatting all release_notes sections. 58/14258/4
Maciek Konstantynowicz [Wed, 15 Aug 2018 12:02:56 +0000 (13:02 +0100)]
report 1807: editorial nit-picking and formatting all release_notes sections.

Change-Id: If4678dca08139febfbbcad929dfde322a7008ff9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoreport 1807: introduction section editorial nit-picking. 51/14251/7
Maciek Konstantynowicz [Wed, 15 Aug 2018 09:57:58 +0000 (10:57 +0100)]
report 1807: introduction section editorial nit-picking.

Change-Id: I15ebef40034ff9637e549b95c4d6e7f35bf2ad09
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoBump report version to final 59/14259/1
Peter Mikus [Wed, 15 Aug 2018 12:25:09 +0000 (12:25 +0000)]
Bump report version to final

Change-Id: Ie424687a126b2ee5ffcbc5a0774474a67cc0cf50
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoFIX: Set default values for VTS teardown arguments 07/14107/8
Vratko Polak [Thu, 9 Aug 2018 12:52:13 +0000 (14:52 +0200)]
FIX: Set default values for VTS teardown arguments

Change-Id: Ic45b23073307cd2174415cf3b406a9bb4be56004
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years ago1807 report: updated dpdk performance overview section. 25/14225/2
Maciek Konstantynowicz [Tue, 14 Aug 2018 18:38:08 +0000 (19:38 +0100)]
1807 report: updated dpdk performance overview section.

Change-Id: I48e6e5b5750bcb4b3b7b6eb82c351bed1de08c73
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years ago1807 report: updated virtual topologies for all functional tests. 20/14220/5
Maciek Konstantynowicz [Tue, 14 Aug 2018 16:30:45 +0000 (17:30 +0100)]
1807 report: updated virtual topologies for all functional tests.

Change-Id: I3053c7a9733ca7c03df993698472ad8d031dba96
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoGeneral report fixes 41/14241/2
Peter Mikus [Wed, 15 Aug 2018 06:47:49 +0000 (06:47 +0000)]
General report fixes

- Fix few typos, and other corrections

Change-Id: I03679231c01ad34c3b2773b52f1327d8c871b750
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoPAL: Log and continue when out of colors 75/14175/11
Vratko Polak [Wed, 15 Aug 2018 07:51:40 +0000 (09:51 +0200)]
PAL: Log and continue when out of colors

Previously, IndexError happened in worker, getting the job stuck.

Graphs should not need that many colors, so there is a bug to fix still.

Change-Id: I1af415119cf06004be5febbd03636f847a7001be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoHC Tests: remove EXPECTED_FAILING tag from policer tests (HC2VPP-375) 12/14212/2
Marek Gradzki [Tue, 14 Aug 2018 14:17:17 +0000 (16:17 +0200)]
HC Tests: remove EXPECTED_FAILING tag from policer tests (HC2VPP-375)

Translation of classify sessions was fixed in hc2vpp by
https://gerrit.fd.io/r/#/c/14180/

This patch reverts https://gerrit.fd.io/r/#/c/14155/

Change-Id: Ia669fa051019585c494dacd10b9585bfff485364
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
3 years agorls1807: updated environment sections for all functional tests. 13/14213/3
Maciek Konstantynowicz [Tue, 14 Aug 2018 14:50:51 +0000 (15:50 +0100)]
rls1807: updated environment sections for all functional tests.

Change-Id: I8f0a2a49ee6e75990ee4638543259c40d1fb5d67
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years ago1807 report: added VTS description in vpp performance overview section. 15/14215/2
Maciek Konstantynowicz [Tue, 14 Aug 2018 15:19:23 +0000 (16:19 +0100)]
1807 report: added VTS description in vpp performance overview section.

Change-Id: I0ba70947d895404723864da2a8477c682741620f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoCSIT-1208: Add new data to 1807 report 14/14214/1
Peter Mikus [Tue, 14 Aug 2018 15:09:55 +0000 (15:09 +0000)]
CSIT-1208: Add new data to 1807 report

Change-Id: Iea304ffd65e4ddbac277274b96207a351cf004fc
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years ago1807 report: added HW calibration sections to test_environment plus editing nits. 82/14182/4
Maciek Konstantynowicz [Mon, 13 Aug 2018 20:17:10 +0000 (21:17 +0100)]
1807 report: added HW calibration sections to test_environment plus editing nits.

Change-Id: I66698ae70d1bbbde6992e5663bc64c30249f7f79
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoCSIT-1208: Add new data to 1807 report 00/14200/1
Peter Mikus [Tue, 14 Aug 2018 09:34:34 +0000 (09:34 +0000)]
CSIT-1208: Add new data to 1807 report

Change-Id: If575d2dc0e8ddb81afe693c646a911e33559b67e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoRevert "CSIT-1208: Add new data to 1807 report" 97/14197/1
Peter Mikus [Tue, 14 Aug 2018 08:29:38 +0000 (08:29 +0000)]
Revert "CSIT-1208: Add new data to 1807 report"

This reverts commit a0f10dad4aea6c8f8cb0a75c041dce626e39c3d2.

Change-Id: I65785d15436d7032908b675cb085b9471d3d6e71
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-1208: Add new data to 1807 report 40/14140/4
Tibor Frank [Fri, 10 Aug 2018 13:01:41 +0000 (15:01 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I96260f9d22d19db608b8b119efede60f69897d98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years ago1807 report: removing unused svg files from introduction dir. 79/14179/1
Maciek Konstantynowicz [Mon, 13 Aug 2018 15:24:55 +0000 (16:24 +0100)]
1807 report: removing unused svg files from introduction dir.

Change-Id: I1a4b10bd97e6a0e78aba7f99083f4459f47bfc88
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoHC Tests: mark policer tests as EXPECTED_FAILING (HC2VPP-373) 55/14155/1
Marek Gradzki [Mon, 13 Aug 2018 04:47:36 +0000 (06:47 +0200)]
HC Tests: mark policer tests as EXPECTED_FAILING (HC2VPP-373)

Change-Id: I394a024e98d74b468a821040db69c1d6eed820ea
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
4 years agoCSIT-1156 Create container memif tests for 2-node topology 47/13947/23
Peter Mikus [Fri, 3 Aug 2018 14:27:55 +0000 (14:27 +0000)]
CSIT-1156 Create container memif tests for 2-node topology
CSIT-1155 Implement container memif KWs for 2-node topology

Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1208: Add new data to 1807 report 33/14133/2
Tibor Frank [Fri, 10 Aug 2018 08:35:57 +0000 (10:35 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I1c51fe8b37e5a849310418c85be3db8053d67cbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1193 De-duplicate bootstrap scripts into one 14/13814/35
Peter Mikus [Mon, 30 Jul 2018 17:28:16 +0000 (17:28 +0000)]
CSIT-1193 De-duplicate bootstrap scripts into one

- DPDK and VPP bootstrap merged into one (ligato will follow).
- Added more error detections
- Added topo-cleanup.py to cleanup TB before and after test.
- Remove installation of VPP

Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1208: Add new data to 1807 report 27/14127/2
Tibor Frank [Fri, 10 Aug 2018 06:46:38 +0000 (08:46 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I6f4c03c66a762b129c86a9d751d15f57e62f2ea9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1229: Add DMM to report 15/14015/10
Tibor Frank [Tue, 7 Aug 2018 11:05:06 +0000 (13:05 +0200)]
CSIT-1229: Add DMM to report

Change-Id: Ib3ea8c13371a29ea2b4661a8506190dcb15c8ced
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
4 years agoCSIT-1208: Add new data to 1807 report 99/14099/2
Tibor Frank [Thu, 9 Aug 2018 09:04:59 +0000 (11:04 +0200)]
CSIT-1208: Add new data to 1807 report

Change-Id: I103417283196940db841be2a254d5d6e8537938f
Signed-off-by: Tibor Frank <tifrank@cisco.com>