Peter Mikus [Wed, 19 Sep 2018 15:05:48 +0000 (15:05 +0000)]
CSIT-1292 Update Ansible playbooks with vpp_device tasks
Change-Id: I22d1fe2fc27d6adb39eba2578e68d06992a3f976
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Fri, 21 Sep 2018 12:24:24 +0000 (14:24 +0200)]
Fix autogen regenerator and few suites
+ "elif" instead of "else if".
+ Some suites had test cases reordered.
+ Some suites contained 9000B cases for avf.
Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 20 Sep 2018 07:23:05 +0000 (07:23 +0000)]
Add example of 2-node topology file
Change-Id: I3e72c568f09e0b7e20b4ea395f1b2d5efce77f40
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 20 Sep 2018 07:18:36 +0000 (07:18 +0000)]
FIX: Do not run double link tests on 3n-hsw
Change-Id: I9dfb4bfba4d0650a42e34d0e1f97b60b031f0750
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 20 Sep 2018 07:07:16 +0000 (07:07 +0000)]
FIX: 40Ge2P1Vic1385-Eth-L2Bdbasemaclrn-Mrr typo
- Per trending.
Change-Id: I1e24b20bc774dae91df6fb81e3a9132ff79e3beb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 17 Sep 2018 10:58:46 +0000 (12:58 +0200)]
Add dot1q-l2bdbase-2memif-[ndrpdr|mrr] perf tests for 2-node topology
Jira: CSIT-1289
Change-Id: I9e3f1f4a03e3cac9d8831f3a87e0b1bce27a109e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Fri, 14 Sep 2018 13:26:48 +0000 (15:26 +0200)]
Add dot1q-l2bdbase-2vhost-[ndrpdr|mrr] perf tests for 2-node topology
Jira: CSIT-1286
Change-Id: Id51c7dbf15d846f1286e6efbc5240a2556ec9652
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Thu, 6 Sep 2018 07:35:36 +0000 (07:35 +0000)]
CSIT-1205 Create AVF driver test - Add Tests L2BD L2XC
Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Yulong Pei [Thu, 6 Sep 2018 09:13:44 +0000 (17:13 +0800)]
Create basic 2-node topology performance tests for Intel-X553 NIC
Intel-X553 is Denverton (Intel Atom cpu based SOC) integrated NIC, add below
basic 2-node topology performance test suites for it, the test suites were
changed from the existing Intel-x710 test suites,
- eth-l2patch-mrr
- eth-l2patch-ndrpdr
- eth-l2xcbase-mrr
- eth-l2xcbase-ndrpdr
- eth-l2bdbasemaclrn-mrr
- eth-l2bdbasemaclrn-ndrpdr
- ethip4-ip4base-mrr
- ethip4-ip4base-ndrpdr
- ethip6-ip6base-mrr
- ethip6-ip6base-ndrpdr
Change-Id: Ib6d3655a6e14ae275c197fd7b39d59e17a233326
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Peter Mikus [Wed, 19 Sep 2018 07:58:08 +0000 (07:58 +0000)]
CSIT-1291 Improve service handling with container detection
Change-Id: Iaeac10676f46e0267041afee927bc6e3201146b2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 19 Sep 2018 08:55:53 +0000 (10:55 +0200)]
CSIT-1288: Prepare data to be sent by Jenkins
Change-Id: I0840883d52180d09f7de2bd9b0391a0db24105f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 18 Sep 2018 10:50:16 +0000 (12:50 +0200)]
CSIT-1288: Prepare data to be sent by Jenkins
- Add creation of tar.gz file
Change-Id: I525c713bb3e157cd94337222781066252c3fa517
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 13 Sep 2018 13:25:39 +0000 (15:25 +0200)]
Add dot1q-ip6base-[ndrpdr|mrr] perf tests for 2-node topology
Jira: CSIT-1283
Change-Id: I0f6841bafdb47bdbc3efe29801fe66a0d4c388ca
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 12 Sep 2018 07:01:54 +0000 (09:01 +0200)]
CSIT-1131: Alerting
- CSIT-1132: Send e-mail with a list of failed tests
- CSIT-1288: Prepare data to be sent by Jenkins
Change-Id: I7ac720dca44d7c13b22218abbca7a00d36d459cb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Fri, 14 Sep 2018 09:00:33 +0000 (11:00 +0200)]
Add dot1q-l2[bd|xc]base-[ndrpdr|mrr] perf tests for 2-node topology
Jira: CSIT-1284
Change-Id: I8ce4ffc76adf55bf9a8423077b8639601c560c87
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Mon, 17 Sep 2018 07:47:15 +0000 (09:47 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
18.10-rc0~
422-geeadc14~b5124
- use new vpp ref build - centos7:
18.10-rc0~424_gef90ed0~b5050
- use new dpdk version:
18.08-vpp3
NOTE: Centos7 and Ubuntu16.04 builds are litle bit different
because of availability of builds on repo.
Change-Id: I6cefd91351848fb075935ae9b41354d3432eacf3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 11 Sep 2018 12:12:54 +0000 (14:12 +0200)]
Add dot1q-ip4base-[ndrpdr|mrr] perf tests for 2-node topology
Jira: CSIT-1278
Change-Id: I3cc929222d7fd58f38e33917e84675e9c0b55bbd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Wed, 15 Aug 2018 17:17:42 +0000 (19:17 +0200)]
Add coding guidelines document
Started as a quite verbatim paste from:
https://wiki.fd.io/view/CSIT/Documentation#CSIT_Test_Code_Guidelines
then re-formatted, and new ideas added.
Change-Id: I13fc3d267f07d88cf22402051480613e55123d44
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Wed, 12 Sep 2018 14:59:04 +0000 (14:59 +0000)]
CSIT-1282 Migrate from Nexus.fd.io to packagecloud.io
Change-Id: Ib4e72dc8e3c0fedfcd702f4f97bc4f26cbc642e9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 12 Sep 2018 09:59:19 +0000 (09:59 +0000)]
CSIT-1280 Single memif container test failing
- FIX
Change-Id: I4b62d08b140dc73eb950d21bc85dc41ad638bbd2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Wed, 12 Sep 2018 14:33:58 +0000 (16:33 +0200)]
Fix: L2 scale tests are not baseline
This fixes select_tags function in common.sh
to not include scale l2bd tests in default tag list.
This is needed because "L2BDBASE" tag selects also scale tests
(contrary to similar IP4BASE and IP6BASE tags).
(Line length over 80 characters is left there
as an indirect TODO to improve the tags.)
Change-Id: Ic1d4a046f327fdd1b8b08eb20f1cdb4b12f337c9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 12 Sep 2018 11:16:22 +0000 (13:16 +0200)]
Fix: trap for unreserve before cleanup
Change-Id: I978a056ffdfd6daa00a0a1c587774b4a7204b434
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 7 Sep 2018 12:19:35 +0000 (14:19 +0200)]
CSIT-1269: Add VTS tests to trending
Change-Id: I9ddbad8e4c3f64553c72f77f93eb9d6c21602eca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 6 Sep 2018 12:15:26 +0000 (14:15 +0200)]
Create l2bdscale tests for 2-node topology
Jira: CSIT-1268
Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Fri, 31 Aug 2018 11:18:52 +0000 (13:18 +0200)]
CSIT-1179: Switch MRR to multiple trials
But keep the detection in PAL using only average, not size nor stdev.
Change-Id: I07092bdeb892c871550265757fd2846a36fbb352
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 7 Sep 2018 11:19:08 +0000 (13:19 +0200)]
CSIT-1270: Split feature tests in trending
Change-Id: Iecc841737552fea07b7fcf297c478479f7872ae7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 6 Sep 2018 12:06:12 +0000 (14:06 +0200)]
CSIT-1271: Add VTS tests to MRR jobs
Change-Id: I5c0be60a1819c5c46225b4468ba9c88068231f08
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 6 Sep 2018 12:12:49 +0000 (14:12 +0200)]
CSIT-1272: Fix VTS tests
Change-Id: Ibc4ae346032b2b711e4dcd1dbc9c0873e8464b19
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 4 Sep 2018 07:37:39 +0000 (09:37 +0200)]
CSIT-1262: Add 2n/3n-skx to trending
CSIT-1263: Edit Trending static content
Change-Id: Ief60f3bea75fb9fd153f7abb0a5933f1a3e317aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 5 Sep 2018 13:27:06 +0000 (15:27 +0200)]
Create ip6scale tests for 2-node topology
Jira: CSIT-1176
Change-Id: I78f4e9cb24a7de0bde24a78d1ca26607598a62b2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vanessa Rene Valderrama [Mon, 27 Aug 2018 16:04:26 +0000 (11:04 -0500)]
Add INFO.yaml file
Add INFO.yaml to list:
- Project description
- Properties
- Issue Tracking
- Contacts
- PTL information
- Meeting information
- Committer information
Change-Id: I02ef3fca1bef20ab5497b632c1995019bd7d1074
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Vratko Polak [Thu, 6 Sep 2018 10:57:32 +0000 (12:57 +0200)]
Fix autogen violations
Four AVF suites had test cases in different order.
Change-Id: I12fbe3508016a79a2153cc004c654a21ee4279bf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 6 Sep 2018 10:17:11 +0000 (12:17 +0200)]
CSIT-1264: Add oper branch wrapper entry script
Change-Id: I569b089b711f89fecca8dd31d6906ef311982877
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Yulong Pei [Wed, 5 Sep 2018 15:19:42 +0000 (23:19 +0800)]
fix CSIT broken issue when numa_node value is -1 on single Socket platform
Single Socket platform e.g. Intel Atom cpu based SOC platform with
Ubuntu 16.04.4(kernel 4.13.0-36-generic) or Centos 7.5 (kernel 3.10.0-862.el7),
value of /sys/bus/pci/devices/<pci_device_id>/numa_node is -1, this will
break CSIT performance test running, but for this kind of SOC platform,
it can consider that is not NUMA based platform, numa_node=-1 is reasonable,
so fix it at CSIT side, when numa_node=1 and the system's NUMA node count
is 1, set numa_node=0. DPDK also did it as this way.
Change-Id: I9ac23d3cece2f1489e38f05b50a462bb2ad9f661
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Jan Gelety [Tue, 4 Sep 2018 13:14:29 +0000 (15:14 +0200)]
Create ip4scale tests for 2-node topology
Jira: CSIT-1174
Change-Id: I46944a3bc0f508d80c8c944dab0190925ebe21f5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 20 Jul 2018 13:07:12 +0000 (13:07 +0000)]
CSIT-1205 Create AVF driver test
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...)
- Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/...
- Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface
- Add sample L2patch test fox x710, xxv710
Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 5 Sep 2018 13:39:06 +0000 (15:39 +0200)]
Add Report history
Change-Id: I5c7e594bcce266d765d2a517adcbec8e88da7c48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 5 Sep 2018 11:21:19 +0000 (13:21 +0200)]
Add known issues to report 18.07
Change-Id: Ide101c80e2ef13021f25096da6afd9e4364ee263
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 4 Sep 2018 17:19:11 +0000 (19:19 +0200)]
Fix various pylint violations
+ SchedUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ VatHistory.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ VppCounters.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ Memif.py:
++ Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Either all return statements in a function should return an expression,
or none of them should.
++ Update :return: on possible None.
+ Classify.py: Unnecessary "else" after "return"
+ ContainerUtils.py: Useless super delegation in method '__init__'
+ CpuUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ DropRateSearch.py: Either all return statements in a function
should return an expression, or none of them should.
+ IPv4NodeAddress.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also improve docstrings.
+ IPv4Setup.py: Useless super delegation in method '__init__'
+ IPv6Setup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also improve docstrings.
+ IPv6Setup.py: standard import "from ipaddress import IPv6Network"
should be placed before "from robot.api import logger"
+ MacSwap.py: Trailing newlines
+ NATUtil.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ NodePath.py: Unnecessary "else" after "return"
+ Tap.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ topology.py: Either all return statements in a function
should return an expression, or none of them should.
+ topology.py: Unnecessary "else" after "return"
++ Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Improve docstrings
+ DUTSetup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also do not compare int(ret_code) just to access zero-ness.
+ ssh.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ InterfaceUtil.py: Unnecessary "else" after "return"
Change-Id: Iba4244aa79661ee7df15fed5c7c6dbf04dfa88b2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 31 Aug 2018 13:51:08 +0000 (15:51 +0200)]
Add eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topology
- added also 3-node test cases for comparison
Jira: CSIT-1261
Change-Id: I1bfcc184e925e969d4a610920c4e49af23047507
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Sat, 1 Sep 2018 15:29:37 +0000 (15:29 +0000)]
Fix pylint part 1
- Decrease pylint errors. Part: easy
Change-Id: I452e5b5a11e9b78c03cd173a3848babe21b93c73
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Fri, 10 Aug 2018 08:20:30 +0000 (10:20 +0200)]
CSIT-1135: Scripts for VPP per-patch testing
+ Scripts do not rely on (other) bootstraps.
+ Perf verify bootstrap is also the new style sript now.
+ Scripts are divided to functions for better re-use.
+ Functions are sourced from small number of large "library" files.
- Still using jumpavg from pipy.
- Perpatch has specific simplified parsing (instead of the PAL one).
- Bash style document is in a separate Change.
Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Thu, 23 Aug 2018 14:12:13 +0000 (16:12 +0200)]
Create ip4-feature perf tests for 2-node topology
- ACL tests
- NAT44 tests
- iPoliceMarker tests
Jira: CSIT-1175, CSIT-1154
Change-Id: Ife7e7df50f7c1c8033bacdb7512e78be6bcdf4eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Mon, 27 Aug 2018 06:42:31 +0000 (08:42 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
18.10-rc0~
242-g0219b8d~b4906
- use new vpp ref build - centos7:
18.10-rc0~242_g0219b8d~b4824
- use new dpdk version:
18.08-vpp1
Change-Id: I1c8a12d3481108ceff8da1f4e31431fbdd9a7f1f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Fri, 24 Aug 2018 16:20:38 +0000 (18:20 +0200)]
Insert warning against editing in requirements.txt
Change-Id: Ifed10692e122c3a42d75282c92476e508cec597d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Mon, 27 Aug 2018 11:13:27 +0000 (13:13 +0200)]
FIX: Correction of ACL perf test suite documentation
Change-Id: I01cc87f5f5409346566ded52da9d384fdd3fa2c4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Yulong Pei [Tue, 7 Aug 2018 10:37:18 +0000 (18:37 +0800)]
add the expected prompt for ubuntu root user
if ssh use root account to login ubuntu os, its prompt is ":~# ",
so add it to let csit test can run with root account.
Change-Id: I21f5380245324c8e48099433e3d374188e9001d9
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Peter Mikus [Fri, 24 Aug 2018 12:36:06 +0000 (12:36 +0000)]
Adjust TEST_TAGs for timed jobs
+ remove obsolete bootstraps
Change-Id: Iee1fe404106f2fa0c438ff30526e756f037ce676
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Tue, 21 Aug 2018 13:04:01 +0000 (15:04 +0200)]
VPP link bonding perf tests with two links between DUTs
Jira: CSIT-1247
Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Thu, 23 Aug 2018 13:17:53 +0000 (14:17 +0100)]
report 18.07: added 2 known issues identified in CSIT-18.07 for vpp performance.
Change-Id: I220084bb5b5fd4909c8f1e2bef60e98594958e45
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Wed, 22 Aug 2018 10:29:03 +0000 (12:29 +0200)]
CSIT-1222: Edit MLRsearch readme for 0.2.0 release
Change-Id: Ib2349f574720c61040f824f87bce01b5d68a2598
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 20 Aug 2018 12:23:46 +0000 (14:23 +0200)]
CSIT-944: PAL Extensions: Mapping table
Change-Id: I3bebf9ad849c056d2bbac476d22ef5e077af05b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 21 Aug 2018 08:24:00 +0000 (08:24 +0000)]
CSIT-1164 Create VM vhost tests for 2-node topology
Change-Id: I955d3170da94cf35a2fda03259bcdc020ac2b652
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Mon, 30 Jul 2018 15:48:50 +0000 (17:48 +0200)]
CSIT-1222: Do two doublings in external MLRsearch
Make number of doublings configurable,
keep Python default at 1, set Robot default to 2.
Also make docstring types unique
(pylint was complaining about classes and modules having the same name).
Increase MLRsearch version to 0.2.0.
Change-Id: Ib846032e79ff52994503c0cfef2f86655502c275
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Marek Gradzki [Tue, 21 Aug 2018 11:28:44 +0000 (13:28 +0200)]
HC Report: update list of known issues
Current list was based on Jira,
which turned out to be outdated.
Change-Id: I216616cda766075b8b78f7c3f2f7a6775a622e23
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Marek Gradzki [Tue, 21 Aug 2018 06:03:46 +0000 (08:03 +0200)]
HC Tests: reenable VxLaN GPE ipv6 tests
The issue is no longer present in VPP master branch (1810).
Change-Id: I64f4fa8544ace8dc3686db9a1a3f3897ba333c61
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Jan Gelety [Tue, 21 Aug 2018 13:10:27 +0000 (15:10 +0200)]
FIX: Use correct interface type in x710_1lbvpplacp perf tests
Change-Id: I68db0b0441ffc7d9b5e04048688711915ab24726
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Thu, 26 Jul 2018 11:56:51 +0000 (13:56 +0200)]
Add MRR tests for kubernetes
Fix number of flows in Documentation.
Change-Id: I0db62ab79c44db0ea55e000f8ef9cb8ee28a07fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Tue, 21 Aug 2018 08:27:55 +0000 (08:27 +0000)]
FIX: Boostrap-perf array assignment
Change-Id: I4d7c27dd182ae8e7b68b5f6342c163ac3615cad2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Marek Gradzki [Mon, 20 Aug 2018 14:51:33 +0000 (16:51 +0200)]
HC Tests: mark BGP v6 tests as critical
TC13 of BGP tests was marked as EXPECTED_FAILING
due to HONEYCOMB-403,
but the error does not occur on 1807 nor master for some time.
Change-Id: I3d8f4ee78fed699927fed05e8fa070cfa95b2166
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Peter Mikus [Tue, 7 Aug 2018 08:17:12 +0000 (08:17 +0000)]
Refactor VHOST code
CSIT-1164 Create VM vhost tests for 2-node topology
CSIT-1173 Implement VM vhost KWs for 2-node topology
- Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue,
ring size, qemu version detection)
- Cleanup VHOST KWs perf (Unify running QEMU on N-node topology)
- Add ability to configure Queues, Hyperthreading, automatically compute
number of CPU for VM/Testpmd and RXQ for Testpmd workload.
- Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node
- Create IPv4 2-node KW
Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 20 Aug 2018 07:41:38 +0000 (09:41 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
18.10-rc0~
193-g612dd6a~b4857
- use new vpp ref build - centos7:
18.10-rc0~193_g612dd6a~b4774
Change-Id: I2bb408d0299d8e6bad0ad8e6b37eccf27d3f6de9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Tue, 14 Aug 2018 08:23:21 +0000 (10:23 +0200)]
PAL improvement: Log repr() of PresentationError
Change-Id: I491e3a77dda06e6a1caa34f70baaef9751674fbd
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 15 Aug 2018 10:25:14 +0000 (12:25 +0200)]
FIX: PAL: Keep increasing index on error
The previous fix has added KeyError reporting and recovery,
but the reported index got stuck on value 15.
Change-Id: I2cec0f678a79ba3e5ca425c92c605e00cf551a35
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Sat, 18 Aug 2018 15:05:40 +0000 (16:05 +0100)]
report 18.07: fixed link mapping for generated report pdf file.
Change-Id: I2e23fe3b6f03055beab536e6534dd43d229b7024
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 18 Aug 2018 14:17:08 +0000 (15:17 +0100)]
release 1807: fixed directory nesting for perf comparison files.
Change-Id: I14e1a53543ab3b03b3136920a67ab594a22167cf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 18 Aug 2018 08:20:14 +0000 (09:20 +0100)]
report 18.07: bump report version to v1.0.
Change-Id: Id8d17666bd6cff45641f5d44c63db59603680a54
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 18 Aug 2018 08:17:16 +0000 (09:17 +0100)]
report 18.07: final final editorial nit picking in v0.9.
Formatting and removing excessive white space in static content.
Change-Id: I7400f4ba6386b85b59b667db026558685ec0d1a1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 17 Aug 2018 22:04:51 +0000 (23:04 +0100)]
report 18.07: Bump report version to v0.9.
Change-Id: Ic4f5520f69d0a97afe54aa8fed269812993d66f7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 17 Aug 2018 22:00:26 +0000 (23:00 +0100)]
report 18.07: draft v0.9 editorial nit-picking, take-2.
Change-Id: Id2a627b1e48275f505a3ea50004285516a47897e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 17 Aug 2018 21:40:16 +0000 (22:40 +0100)]
report 18.07: draft v0.9 editorial nit-picking.
Change-Id: I7fb9dff8f5ebce0ac03ef99c74b14b02638042ac
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 17 Aug 2018 18:47:24 +0000 (19:47 +0100)]
report 18.07: Bump report version to 0.8.
Change-Id: Ic5ac9733534fc0f67467c6ea47a4123e246a793a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 17 Aug 2018 14:31:08 +0000 (15:31 +0100)]
report 18.07: moved performance change/compare sections out of rls notes to separate sections for vpp and dpdk.
Change-Id: If620cd894ea906baf0391617e5440e34f7136c37
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 17 Aug 2018 17:03:59 +0000 (18:03 +0100)]
report 18.07: updated known issues perf changes based on latest test data in report.
Change-Id: I070cdecb936f294da4798712c197795aa0a85d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Fri, 17 Aug 2018 14:56:16 +0000 (14:56 +0000)]
Add NIC exclusion for all jobs in perf bootstrap
This patch is suppose to move the processing logic for all job
types, including timed trigger perf jobs. This should eliminate MRR job
to run NIC tests not in topology file.
Change-Id: I9add5073266bd37fd3ef2c6efe7244b41e85f2a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Fri, 17 Aug 2018 12:22:02 +0000 (13:22 +0100)]
report 18.07: reformatted known issues tables in rls notes sections.
Change-Id: I2e6c6910542ec06ffd68a95d66c427fe2589c833
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
sharath [Mon, 13 Aug 2018 14:46:56 +0000 (20:16 +0530)]
copying all .so[newly added] into app directory
Change-Id: I5b89732c5dd1a4b74ffbafbd78803721dbf9c61c
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
Peter Mikus [Fri, 17 Aug 2018 11:27:37 +0000 (11:27 +0000)]
Remove DPDK MRR changes section from report
Bump report version to 0.7
Change-Id: I77478e3b58daab25bdece1e67795cc911f470136
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Thu, 16 Aug 2018 19:31:53 +0000 (20:31 +0100)]
report 1807: updated known issues in vpp perf rls notes.
Change-Id: I340548173018d234f699b1125c886fcd9ae75347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Fri, 17 Aug 2018 10:55:59 +0000 (10:55 +0000)]
CSIT-1245 - Wrong configuration of srv6proxy-ndrpdr-stat and srv6proxy-masq-ndrpdr TCs
Change-Id: If5a45b97c90f85f2f193d796adbddd329f2728cd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
pmikus [Fri, 17 Aug 2018 07:55:32 +0000 (07:55 +0000)]
Add new data to 1807 report
Change-Id: Ic03c55a198f6deb0cae5c920d7937696dfa19c9e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 16 Aug 2018 15:32:40 +0000 (15:32 +0000)]
Bump report version to 0.6
Change-Id: I820288a7209b6c0017ee42f5087f0687679ab078
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Thu, 16 Aug 2018 09:50:23 +0000 (10:50 +0100)]
report 1807: dpdk and vpp rls notes update, known issues.
Change-Id: I15372226eaac6d505793b1c87e2ff16c8e5e8928
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Thu, 16 Aug 2018 10:01:08 +0000 (10:01 +0000)]
Change report version to 0.5
Change-Id: I556a8e98d1725ed9465eca2721886869a3a1a39b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 16 Aug 2018 09:09:11 +0000 (09:09 +0000)]
Add new data set into report
Change-Id: Ic280eed9e888524805e019679c8549c75c5981c0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Thu, 16 Aug 2018 09:05:51 +0000 (10:05 +0100)]
report 1807: list and table formatting fixes.
Change-Id: I1233e903a9590d12ae0cf0032e33a017fea07b3e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Thu, 16 Aug 2018 08:45:55 +0000 (09:45 +0100)]
report 1807: fixed index.html for introduction section.
Change-Id: Ie733827e20083b78ed75f1e70f7762dd8a963404
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 15 Aug 2018 15:23:37 +0000 (16:23 +0100)]
report 1807: editorial nit-picking in all graph sections.
Change-Id: Ib366f57fbe590faae3b13f96ab68fb528046f619
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 15 Aug 2018 15:55:25 +0000 (16:55 +0100)]
report 1807: editorial nit-picking in all performance changes and comparison sections.
Change-Id: Ib0ea94894df1bd70cef83a97453662f0074e640f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 15 Aug 2018 12:02:56 +0000 (13:02 +0100)]
report 1807: editorial nit-picking and formatting all release_notes sections.
Change-Id: If4678dca08139febfbbcad929dfde322a7008ff9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 15 Aug 2018 09:57:58 +0000 (10:57 +0100)]
report 1807: introduction section editorial nit-picking.
Change-Id: I15ebef40034ff9637e549b95c4d6e7f35bf2ad09
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Wed, 15 Aug 2018 12:25:09 +0000 (12:25 +0000)]
Bump report version to final
Change-Id: Ie424687a126b2ee5ffcbc5a0774474a67cc0cf50
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Thu, 9 Aug 2018 12:52:13 +0000 (14:52 +0200)]
FIX: Set default values for VTS teardown arguments
Change-Id: Ic45b23073307cd2174415cf3b406a9bb4be56004
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Tue, 14 Aug 2018 18:38:08 +0000 (19:38 +0100)]
1807 report: updated dpdk performance overview section.
Change-Id: I48e6e5b5750bcb4b3b7b6eb82c351bed1de08c73
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 14 Aug 2018 16:30:45 +0000 (17:30 +0100)]
1807 report: updated virtual topologies for all functional tests.
Change-Id: I3053c7a9733ca7c03df993698472ad8d031dba96
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Wed, 15 Aug 2018 06:47:49 +0000 (06:47 +0000)]
General report fixes
- Fix few typos, and other corrections
Change-Id: I03679231c01ad34c3b2773b52f1327d8c871b750
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Wed, 15 Aug 2018 07:51:40 +0000 (09:51 +0200)]
PAL: Log and continue when out of colors
Previously, IndexError happened in worker, getting the job stuck.
Graphs should not need that many colors, so there is a bug to fix still.
Change-Id: I1af415119cf06004be5febbd03636f847a7001be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Marek Gradzki [Tue, 14 Aug 2018 14:17:17 +0000 (16:17 +0200)]
HC Tests: remove EXPECTED_FAILING tag from policer tests (HC2VPP-375)
Translation of classify sessions was fixed in hc2vpp by
https://gerrit.fd.io/r/#/c/14180/
This patch reverts https://gerrit.fd.io/r/#/c/14155/
Change-Id: Ia669fa051019585c494dacd10b9585bfff485364
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Maciek Konstantynowicz [Tue, 14 Aug 2018 14:50:51 +0000 (15:50 +0100)]
rls1807: updated environment sections for all functional tests.
Change-Id: I8f0a2a49ee6e75990ee4638543259c40d1fb5d67
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 14 Aug 2018 15:19:23 +0000 (16:19 +0100)]
1807 report: added VTS description in vpp performance overview section.
Change-Id: I0ba70947d895404723864da2a8477c682741620f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>