csit.git
4 years agoAdd support for aarch64 container images 97/20697/4
juraj.linkes [Wed, 17 Jul 2019 12:28:30 +0000 (14:28 +0200)]
Add support for aarch64 container images

Change-Id: I84f13d7139a6e5f7004426018c2d27425c5fa97e
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoTrending: Reduce the number of input files 67/20767/2
Vratko Polak [Mon, 22 Jul 2019 11:10:53 +0000 (13:10 +0200)]
Trending: Reduce the number of input files

Another attempt to avoid memory error.
Dailies trimmed to ~2 months.
Not removed last "skip" item to simplify future editing.

Change-Id: Id411eeed109079c4c3f8994d5d6cc296ffe621fc
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files ubuntu18 84/20784/2
Peter Mikus [Tue, 23 Jul 2019 05:59:22 +0000 (05:59 +0000)]
Update of VPP_STABLE_VER files ubuntu18

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc0~705-gc75423981

   csit-vpp-device-master-ubuntu1804-1n-skx-semiweekly/74/

Change-Id: Iba9eb224f0d0cfb79f8eaec2007a88855d233b9a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRemove selected VIRL tests 71/20771/1
Peter Mikus [Mon, 22 Jul 2019 12:30:08 +0000 (12:30 +0000)]
Remove selected VIRL tests

- These are not going to be converted to vpp_device

Change-Id: I0148be014fee476f3dc1a72c51316aace0f2350f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1471: Migrate Dhcp library from VAT to PAPI 58/20758/4
Jan Gelety [Fri, 12 Jul 2019 15:31:25 +0000 (17:31 +0200)]
CSIT-1471: Migrate Dhcp library from VAT to PAPI

Change-Id: Ibc9b9b736532cce31994537e632daa4d4e62459c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: naming convention fixes for TOX 57/20757/4
Peter Mikus [Fri, 19 Jul 2019 16:42:27 +0000 (16:42 +0000)]
FIX: naming convention fixes for TOX

Change-Id: I0644fbd0e136dee3a91fd9406155f971b3c726eb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoVAT API to PAPI CONVERSION 00/20500/14
premkumarv [Thu, 4 Jul 2019 00:14:57 +0000 (05:44 +0530)]
VAT API to PAPI CONVERSION

Change-Id: I9c87cdfb99780f398da5cd90351b303caa89bda9
Signed-off-by: premkumarv <preym17@gmail.com>
4 years agoTOX: Naming conventions 30/20630/13
Peter Mikus [Fri, 12 Jul 2019 15:02:28 +0000 (15:02 +0000)]
TOX: Naming conventions

Change-Id: I038d90fc481e5f74085d0fe6165b12769d98e8a1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoPAL: Skip daily-master-3n-skx/540 52/20752/2
Vratko Polak [Fri, 19 Jul 2019 14:51:44 +0000 (16:51 +0200)]
PAL: Skip daily-master-3n-skx/540

Frequently, reconnect is needed to finish the download,
that can lead to IOError.
But, MemoryError has also been seen, so perhaps this is a wrong fix.
Worth a try, though.

Change-Id: Icac17757a1a0ae361faddfa24a818496f14d7340
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoCSIT-1469: Migrate SRv6 library from VAT to PAPI 16/20716/10
Jan Gelety [Thu, 11 Jul 2019 16:38:54 +0000 (18:38 +0200)]
CSIT-1469: Migrate SRv6 library from VAT to PAPI

Change-Id: Ibbec3d1bbda2af9fcab3230fd1747406a89f0cc5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoRemove un-interested VIRL tests and related resources 46/20746/2
Jan Gelety [Fri, 12 Jul 2019 11:13:00 +0000 (13:13 +0200)]
Remove un-interested VIRL tests and related resources

Change-Id: I712f5dc238fdf480c7c35250148c12d03ed96d74
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPLRsearch methodology: Add more comments to graphs 21/19621/13
Vratko Polak [Wed, 22 May 2019 10:33:05 +0000 (12:33 +0200)]
PLRsearch methodology: Add more comments to graphs

Change-Id: I2d4743c6bb7dc91eca22b01298e4529f6b2e559d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: COP ipv6 missing FIB 43/20743/3
Peter Mikus [Fri, 19 Jul 2019 12:10:11 +0000 (12:10 +0000)]
FIX: COP ipv6 missing FIB

- From unknown reason VAT was more tolerant

Change-Id: Ia740843c67604a18de40d14cc448138b9f079b41
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd support for default_nic in mrr tag lists 40/20740/2
juraj.linkes [Fri, 19 Jul 2019 09:37:18 +0000 (11:37 +0200)]
Add support for default_nic in mrr tag lists

Change-Id: I1fdc6f3019af6d46b985164c573d44b0e440febd
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoBump VPP stable version 38/20738/1
Vratko Polak [Fri, 19 Jul 2019 08:51:18 +0000 (10:51 +0200)]
Bump VPP stable version

The main goal is to have a build with https://gerrit.fd.io/r/20726
to enable detection of missing API messages.

A later build was used, the one just before https://gerrit.fd.io/r/20711
as that looks risky.

Change-Id: Id65066389a7ed70dca54acc085272a632859d42c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 27/20727/1
Jan Gelety [Fri, 12 Jul 2019 03:27:54 +0000 (05:27 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc0~681-ga0cb32c~b7576

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc0~681-ga0cb32cb9

 - use new vpp ref build - centos7:
   19.08-rc0~681_ga0cb32c~b7430

Change-Id: I21baa8090962c2a6fdc3d03f8fbcd86a8e82126c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPapi socket: except more errors to insert err_msg 25/20725/2
Vratko Polak [Thu, 18 Jul 2019 12:35:17 +0000 (14:35 +0200)]
Papi socket: except more errors to insert err_msg

Change-Id: Ided91ee2b47dafb6aad83091126294d79f67aeac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 19/20719/2
Jan Gelety [Fri, 12 Jul 2019 00:20:05 +0000 (02:20 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc0~680-g456d2f9~b7573

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc0~680-g456d2f9c2

 - use new vpp ref build - centos7:
   19.08-rc0~680_g456d2f9~b7428

Change-Id: I12656e3809c7fc385029449030672b4792f28491
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoVAT-to-PAPI: LISPUtil 21/20421/25
Andrej Marcinek [Mon, 1 Jul 2019 09:35:38 +0000 (11:35 +0200)]
VAT-to-PAPI: LISPUtil

Change-Id: I57328dbc33eaf62935a1a14e23f57ebab21c24f5
Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>
4 years agoTrending: Delete presentation_new 18/20718/2
Vratko Polak [Thu, 18 Jul 2019 10:09:10 +0000 (12:09 +0200)]
Trending: Delete presentation_new

It is outdated an unmaintained.

Change-Id: I9b48391906a233cbdf736a3b2d12da80d3a2d77d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoTrending: Reduce the number of input files 17/20717/1
Vratko Polak [Thu, 18 Jul 2019 10:07:24 +0000 (12:07 +0200)]
Trending: Reduce the number of input files

Change-Id: Ie449aa820bc05d9fed285c04445a5cf715b8ebdf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoRemove obsolete DPDK bonding 03/20703/2
Peter Mikus [Wed, 17 Jul 2019 14:06:56 +0000 (14:06 +0000)]
Remove obsolete DPDK bonding

- Code not used

Change-Id: I312635f8038c6d4d4db21d93e43df6b3636feb34
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: Tags in ansible 05/20705/2
Peter Mikus [Wed, 17 Jul 2019 14:34:26 +0000 (14:34 +0000)]
FIX: Tags in ansible

Change-Id: I6772734b68bc2c09ee550f1a6369e3668f613d92
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: Put VM interface pinning back 02/20702/1
Peter Mikus [Wed, 17 Jul 2019 13:41:09 +0000 (13:41 +0000)]
FIX: Put VM interface pinning back

- Must be there for DPDK NFs

Change-Id: Icda8069beab4ce8ced17a372c84524c4824abd9d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRevert "Avoid ci-management archiving files twice" 99/20699/2
Peter Mikus [Wed, 17 Jul 2019 13:30:53 +0000 (13:30 +0000)]
Revert "Avoid ci-management archiving files twice"

This reverts commit ccfe499e2a27f2caf234ecbb2ec948120810eab6.

Change-Id: I076bdaf255f6fa5cc6b0f25926850d62f450fd94
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1469: Migrate IPsecUtil library from VAT to PAPI 13/20213/24
Jan Gelety [Fri, 14 Jun 2019 02:42:57 +0000 (04:42 +0200)]
CSIT-1469: Migrate IPsecUtil library from VAT to PAPI

Change-Id: Iac790bf5755a70697e4c4eff32242b04f8e7f789
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoUse PapiSocketProvider for most PAPI calls 72/19272/298
Vratko Polak [Wed, 17 Jul 2019 10:40:49 +0000 (12:40 +0200)]
Use PapiSocketProvider for most PAPI calls

Ticket: CSIT-1541
Ticket: VPP-1722
Ticket: CSIT-1546

+ Increase timeout to hide x520 slownes of show hardware detail.
- Install sshpass and update ssh client in virl bootstrap.
 + Added TODOs to remove when CSIT-1546 is fixed.
+ Enable default socksvr on any startup conf.
+ Improve OptionString init and repr.
- The non-socket executor still kept for stats.
 + Remove everything unrelated to stats from non-socket executor.
- Remove some debug-loooking calls to avoid failures.
  TODO: Introduce proper parsing to the affected keywords.
+ Reduce logging from PAPI code to level INFO.
 - Needs https://gerrit.fd.io/r/20660 to fully work.
+ Change default values for LocalExecution.run()
 + Return code check enabled by default.
   Code is more readable when rc!=0 is allowed explicitly,
   and the test code will now detect unexpected failures.
 + Logging disabled by default.
   Output XML is large already. Important logging can be enabled explicitly.
+ Restore alphabetical order in common.sh functions.

Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoRefactor VPP Device VM vhost tests 79/20579/7
juraj.linkes [Wed, 10 Jul 2019 09:32:47 +0000 (11:32 +0200)]
Refactor VPP Device VM vhost tests

* replace the current VM image with kernel img
* rework keyword usage to make it consistent with performance tests
* remove resources/libraries/robot/shared/qemu.robot as it's not used
  anywhere anymore

Change-Id: Ia5bc19e9e6ed9af031e4d9b5c0c89431fb49fd33
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoFIX: Move per-patch building mechanics 66/20666/6
Peter Mikus [Mon, 15 Jul 2019 14:58:08 +0000 (14:58 +0000)]
FIX: Move per-patch building mechanics

- Use make pkg-verify

Change-Id: Id0f95c9261f1a1b5fa017b0823f87aeb5d6bb6d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agofix invalid variable name issue of ipsechw test suites 74/20674/1
Yulong Pei [Tue, 16 Jul 2019 09:09:04 +0000 (17:09 +0800)]
fix invalid variable name issue of ipsechw test suites

Change-Id: Ie7bfaaaa2e4cab4b52dab42f71780f581306659b
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoUpdate of VPP_STABLE_VER files 62/20662/1
Jan Gelety [Wed, 10 Jul 2019 22:52:59 +0000 (00:52 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc0~663-g692b949~b7537

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc0~663-g692b9498e

 - use new vpp ref build - centos7:
   19.08-rc0~663_g692b949~b7410

Change-Id: Ia80895a0a679b23ac5cbcd540ba9fda02d1868e9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoVPPD: Cop, iACL, Policer 04/20604/22
Peter Mikus [Thu, 11 Jul 2019 09:36:44 +0000 (09:36 +0000)]
VPPD: Cop, iACL, Policer

- Alignment with PERF

Change-Id: Id7b2cb91c88e44cf9265c3376330f6aa579abf7a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoPapiExecutor always verifies 70/20170/50
Vratko Polak [Tue, 9 Jul 2019 10:17:09 +0000 (12:17 +0200)]
PapiExecutor always verifies

Do not support returning unverified replies anymore.
Basically, ".get_replies().verify_replies()" is now just ".get_replies()".
This allows fairly large simplifications both at call sites
and in PapiExecutor.py

+ Rename get_dumps to get_details.
+ Introduce get_reply and get_sw_if_index.
+ Rename variables holding get_*() value,
  + e.g. get_stats() value is stored to variable named "stats".
  + Rename "item" of subsequent loop to hint the type instead.
  + Rename "details" function argument to "verbose".
+ Process reply details in place, instead of building new list.
  - Except hybrid blocks which can return both list or single item.
  - Except human readable text building blocks.
+ Rename most similar names to sw_if_index.
  - Except "vpp_sw_index" and some function names.
+ Use single run_cli_cmd from PapiExecutor.
+ Do not chain methods over multiple lines.
  + Small space gain is not worth readability loss.
+ Include minor code and docstrings improvement.
+ Add some TODOs.

Change-Id: Ib2110a3d2101a74d5837baab3a58dc46aafc6ce3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAvoid ci-management archiving files twice 94/20394/9
Vratko Polak [Tue, 2 Jul 2019 14:37:12 +0000 (16:37 +0200)]
Avoid ci-management archiving files twice

https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).

The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directories,
usually archives/ and archives/archive/.

This change simply removes copy_archives,
relying on the new recursive search.

A solution with changing ARCHIVE_DIR and moving if needed
would be better, but looking at amout of jobs
and various func bootstraps, it is not worth the effort.

Change-Id: Iad2bc09455944307e59eecafa64d1db6dc8befe8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoVPPD: Merge IPv4/IPv6 21/20621/2
Peter Mikus [Fri, 12 Jul 2019 08:10:58 +0000 (08:10 +0000)]
VPPD: Merge IPv4/IPv6

- Preparation for coverage.sh

Change-Id: Id299df9cd57ee69116686c8bc85eaba1cc353122
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd per arch mrr daily test for denverton platform 49/20449/3
Yulong Pei [Tue, 2 Jul 2019 14:24:51 +0000 (22:24 +0800)]
Add per arch mrr daily test for denverton platform

Change-Id: Ica7d6bf0dbdfde3de70eabd131c79cadd8af3a16
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoCSIT-1477: add 1n_tx2 VPP Device 88/18588/10
juraj.linkes [Thu, 31 Jan 2019 14:32:24 +0000 (15:32 +0100)]
CSIT-1477: add 1n_tx2 VPP Device

- add 1n_tx2 testbed
- update VF reservation to meet 1n_tx2 testbed needs
- update ansible with 1n_tx2

Change-Id: Ia075a913d4859f537fd0e6bff731ea88aff01dd9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoFIX: Various naming convention typos 10/20610/1
Peter Mikus [Thu, 11 Jul 2019 15:05:11 +0000 (15:05 +0000)]
FIX: Various naming convention typos

Change-Id: Ib55d9f3993cb63d3130a6bd338d612bde0235d5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAligning FUNC/PERF keywords - Data driven 65/20565/11
Peter Mikus [Tue, 9 Jul 2019 14:28:27 +0000 (14:28 +0000)]
Aligning FUNC/PERF keywords - Data driven

Change-Id: I233c8908c724556db09c60de6efa9237068fb4c3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFix few pylint violations 86/20586/2
Vratko Polak [Wed, 10 Jul 2019 14:18:26 +0000 (16:18 +0200)]
Fix few pylint violations

+ Stop attempting to check test/ as module inits are not there.

Change-Id: Ia4e498061be3e3118b07e98c9c2f761f2454653e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoTolerate failures when setting MTU 55/20555/4
Vratko Polak [Wed, 10 Jul 2019 14:45:31 +0000 (16:45 +0200)]
Tolerate failures when setting MTU

Because some NICs are known to not allow jumbo frames.

Change-Id: I45fe636e3a880c6640922468c170f50e85dd2ba2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: use correct slicing of classify mask/match string 57/20557/7
Jan Gelety [Tue, 9 Jul 2019 10:41:23 +0000 (12:41 +0200)]
FIX: use correct slicing of classify mask/match string

Change-Id: I11cc8ddc6925b44a596aa03d71318efd76232d6d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoBash functions style cleanup 81/20581/3
Vratko Polak [Wed, 10 Jul 2019 11:59:50 +0000 (13:59 +0200)]
Bash functions style cleanup

+ Update rst documentation for bash style
 + Command substitution:
  + Clarify when to use backticks.
  + Recommend avoiding nested command substitution.
  + Do not recommend putting command substitution results into quotes.
 + Function definition content:
  + Move "set -exuo pipefail" after comment only blocks.
  + Other set flags allowed for functions with good reasons.
+ Apply the new recommendations.
 - Blank lines unified in code but no written recommendation in rst.
+ Add missing references to functions called, variables read or set.
 + Add TODOs to where lists would be long.
+ Minor improvements to function descriptions.
+ Make "if" expressions more python-like.
+ Add missing "|| die" (or "|| true") where spotted.
+ Downgrade DEFAULT_NIC to a local variable.
+ Add TODO to list reasons for blacklisted tags.

Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoModify kernel VM download to custom build 77/20577/2
juraj.linkes [Wed, 10 Jul 2019 09:10:34 +0000 (11:10 +0200)]
Modify kernel VM download to custom build

Instead of downloading linux-image-kvm, build custom initrd from
currently used kernel on perf sut or vpp device host.

Change-Id: I836f9c5264695c44566b7d52f3ec03e26a474524
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoAdd scale ipsec tunnel tests 20K 35/20235/20
Peter Mikus [Wed, 19 Jun 2019 12:37:05 +0000 (12:37 +0000)]
Add scale ipsec tunnel tests 20K

Change-Id: Ib52e1735b6b82ea9fea44c06c379f117068e94c1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1539 Aligning FUNC/PERF keywords - Phase III 24/20324/38
Peter Mikus [Tue, 25 Jun 2019 12:44:32 +0000 (12:44 +0000)]
CSIT-1539 Aligning FUNC/PERF keywords - Phase III

Change-Id: Ibd3e99390bf004173d3d126946b95ffe9ba8f196
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 54/20554/1
Jan Gelety [Tue, 9 Jul 2019 07:49:01 +0000 (09:49 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc0~603-g69a85b5~b7459

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc0~603-g69a85b505

 - use new vpp ref build - centos7:
   19.08-rc0~603_g69a85b5~b7350

Change-Id: I753e3ddd3a5e3f02ecdf11a600ea1b43e9e86d9c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoNext IETF draft version for PLRsearch 01/20501/6
Vratko Polak [Thu, 4 Jul 2019 12:27:27 +0000 (14:27 +0200)]
Next IETF draft version for PLRsearch

+ Finished the rewrite left in progress last time.
+ Described current logic (load selection) changed since last time.
+ Fixed fitting function formulas, normalization was wrong.
+ Other minor improvements.

Change-Id: I3d762db98b6f8789207bc58db1f171faa6e753bd
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoUpdate of draft-vpolak-mkonstan-bmwg-mlrsearch-01->02. 48/18648/5
Maciek Konstantynowicz [Tue, 2 Apr 2019 18:05:07 +0000 (19:05 +0100)]
Update of draft-vpolak-mkonstan-bmwg-mlrsearch-01->02.

Change-Id: Iba2d5369298f8615aacb1ff0f73b4832d359b433
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoUpdate draft-mkonstan-nf-service-density-00->01 50/18650/6
Maciek Konstantynowicz [Tue, 2 Apr 2019 18:35:34 +0000 (19:35 +0100)]
Update draft-mkonstan-nf-service-density-00->01

Change-Id: Ic63aa09bfff98d358b770e378c5571f1114839b8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoRemove import of removed qemu.robot 44/20544/2
Vratko Polak [Mon, 8 Jul 2019 16:12:56 +0000 (18:12 +0200)]
Remove import of removed qemu.robot

The library got removed in https://gerrit.fd.io/r/20219
but the tests are passing in spite of import error.

Change-Id: Ide1b896415bbd84d5980d9308272ce57318173bf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: VXLAN scale tests 07/20507/9
Jan Gelety [Tue, 18 Jun 2019 11:17:31 +0000 (13:17 +0200)]
FIX: VXLAN scale tests

Change-Id: I9287d5ed6d7876b98add3fb3d523e9764094843b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: ip scale needs sw_if_index in VAT command 09/20509/3
Jan Gelety [Tue, 18 Jun 2019 18:38:55 +0000 (20:38 +0200)]
FIX: ip scale needs sw_if_index in VAT command

Change-Id: Icb3e22a84af10b98edf83084991b8f2607c95798
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoRemove redundant VIRL test 16/20516/1
Peter Mikus [Fri, 5 Jul 2019 06:30:14 +0000 (06:30 +0000)]
Remove redundant VIRL test

Change-Id: I368f4e07d578802973a1c5f6b15e170038d63238
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRemove pkt_trace as global variable 14/20514/3
Peter Mikus [Fri, 5 Jul 2019 05:08:13 +0000 (05:08 +0000)]
Remove pkt_trace as global variable

- Use explicit parameters

Change-Id: I21cbc8cf13ec5e455b20c685c4427a53a655f71f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd Additional Setup action for scapy 15/20515/1
Peter Mikus [Fri, 5 Jul 2019 05:15:06 +0000 (05:15 +0000)]
Add Additional Setup action for scapy

Change-Id: I82f70d7c80b921da03553f6c1351a9a2f786ff0e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoUpdate draft-vpolak-bmwg-plrsearch-01->02 49/18649/3
Maciek Konstantynowicz [Tue, 2 Apr 2019 18:28:27 +0000 (19:28 +0100)]
Update draft-vpolak-bmwg-plrsearch-01->02

Change-Id: Ida23a50c9148570a6510f93a2bb731ea8b0b2b94
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoBump stable VPP version to get VPP-1716 fix 90/20490/1
Vratko Polak [Thu, 4 Jul 2019 08:22:52 +0000 (10:22 +0200)]
Bump stable VPP version to get VPP-1716 fix

Change-Id: I1438fd56f0271dc78967389df452d31b2c8da32d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: use len parameter name in prefix structure in ip_route_add_del 32/20432/16
Jan Gelety [Mon, 17 Jun 2019 14:22:39 +0000 (16:22 +0200)]
FIX: use len parameter name in prefix structure in ip_route_add_del

 + new vpp stabel build with fixed ipv6 address incrementation

Change-Id: Id3f4104a48e45b6fd70ccbd47ad9e3c6925220fd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFix typos in IPsec suites 77/20477/2
Vratko Polak [Wed, 3 Jul 2019 12:39:27 +0000 (14:39 +0200)]
Fix typos in IPsec suites

Change-Id: I566e5e9ded9efb7b8d391fd77c567047f8a017ca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReplace license checker with global notices 54/20454/1
Vratko Polak [Tue, 2 Jul 2019 10:56:10 +0000 (12:56 +0200)]
Replace license checker with global notices

Caring about per-file notices is too distracting.

Change-Id: I3f07a9fd1d3a4350135dd3d14f4944647af39a0b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agofix missing separator issue of crypto ipsec test suites 48/20448/1
Yulong Pei [Tue, 2 Jul 2019 13:46:15 +0000 (21:46 +0800)]
fix missing separator issue of crypto ipsec test suites

Change-Id: Iaec8b496cfd40e9a24c2226c1f7c6f7dde6a3d82
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoFIX: re-introduce VAT for IP scale tests 22/20422/7
Jan Gelety [Mon, 17 Jun 2019 10:36:09 +0000 (12:36 +0200)]
FIX: re-introduce VAT for IP scale tests

Change-Id: I864118ee67628ea81f2f89dab5890df8fe15c4bc
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAdd packet trace to teardown of all vpp-device func tests 29/20429/1
Jan Gelety [Mon, 17 Jun 2019 13:13:53 +0000 (15:13 +0200)]
Add packet trace to teardown of all vpp-device func tests

Change-Id: I26ad1f9a481d3d7ecdb0ad4e85d521756302e09b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFix missing pipe in ip6 suite 02/20402/2
Vratko Polak [Fri, 28 Jun 2019 16:21:08 +0000 (18:21 +0200)]
Fix missing pipe in ip6 suite

Change-Id: I905e6e744519bcdd07360376f9552c5cf895c976
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAdd copyright checker to tox 18/20318/3
Vratko Polak [Tue, 25 Jun 2019 10:46:12 +0000 (12:46 +0200)]
Add copyright checker to tox

+ Only looks at files edited since HEAD~.
+ Only checks files of whitelisted extensions.
+ Distinguishes missing and outdated copyrights.
+ Any line with "Copyright" substring can work.
+ Many copyright lines are tolerated, if at least one has correct year.
+ Voting.

Change-Id: I2cda0459cb191eeec7aada69c508973568039d87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoPAPI-to-VAT: MACSwap 97/20397/1
Tibor Frank [Fri, 28 Jun 2019 07:20:56 +0000 (09:20 +0200)]
PAPI-to-VAT: MACSwap

- not used, not needed, deleted

Change-Id: I9b4c78b7ba3fbac3805d06a65f2799ed212770b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: Classify 24/20124/75
Tibor Frank [Fri, 14 Jun 2019 07:26:38 +0000 (09:26 +0200)]
VAT-to-PAPI: Classify

Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: IPFIX and SPAN 55/20355/4
Tibor Frank [Wed, 26 Jun 2019 10:56:04 +0000 (12:56 +0200)]
VAT-to-PAPI: IPFIX and SPAN

Change-Id: I34bdc17d6350e5a441dabd9154620627780f4c12
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: Trace 57/20357/3
Tibor Frank [Wed, 26 Jun 2019 11:30:18 +0000 (13:30 +0200)]
VAT-to-PAPI: Trace

Change-Id: Id0b6943eec7e8a15cb2db5c89f93a38f21d686c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: Remove unused VAT files. 56/20356/2
Tibor Frank [Wed, 26 Jun 2019 11:05:18 +0000 (13:05 +0200)]
VAT-to-PAPI: Remove unused VAT files.

Change-Id: I1563db488e9dd690aa7e732691e306a9e51ececa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: IPUtil after vpp api changes 78/20278/27
Jan Gelety [Thu, 20 Jun 2019 17:49:35 +0000 (19:49 +0200)]
FIX: IPUtil after vpp api changes

 + do not log all ip_route_add_del api calls to PAPI history
   in case of scale tests

 + fix for SRv6 proxy tests

 + support of more complex structures in api calls/replies
   in PapiExecutor

 + update of vpp stable build to version 19.08-rc0~487-gb98dbb1

Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoIntroduce EXPECTED_FAILING 44/20344/1
Peter Mikus [Wed, 26 Jun 2019 05:40:21 +0000 (05:40 +0000)]
Introduce EXPECTED_FAILING

Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd support for more complex structures in PAPI calls/replies 27/20327/1
Jan Gelety [Sun, 16 Jun 2019 05:01:52 +0000 (07:01 +0200)]
Add support for more complex structures in PAPI calls/replies

Change-Id: I3f83d1209a08dcf342cc2031191bb82cebc53e4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAlign suite/test teardown/setup 80/20280/30
Peter Mikus [Fri, 21 Jun 2019 12:15:56 +0000 (12:15 +0000)]
Align suite/test teardown/setup

+ Phase II - aligning FUNC/PERF setup.
  + 2n/3n compatibility of suite setup.
  + Same structure of testcase for DEV/PERF.
  + DEVICE tests are now running VPP startup config in same
    way as PERF.
  + DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
  compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
  setup phase.

Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoStore "tag" and "url" in files in reservation dir 09/20209/14
Vratko Polak [Mon, 24 Jun 2019 15:53:55 +0000 (17:53 +0200)]
Store "tag" and "url" in files in reservation dir

String "Unknown" is used if test run tag or url is not supplied,
so this change should be backward compatible.

+ Used "runtag", as both "test" and "tag" start with taken "-t".
+ Fixed some pylint violations.
+ Docstring explaining the steps taken and reasoning behind two files.
+ Other minor improvements.

Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAllow 9000b tests for AVF 59/20259/2
Vratko Polak [Fri, 21 Jun 2019 16:26:26 +0000 (18:26 +0200)]
Allow 9000b tests for AVF

See https://gerrit.fd.io/r/20148

Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAlign suite/test teardown/setup 19/20219/22
Peter Mikus [Tue, 18 Jun 2019 20:31:48 +0000 (20:31 +0000)]
Align suite/test teardown/setup

+ Phase I - aligning FUNC/PERF

Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: IPsec TNL test should load plugins 79/20279/1
Peter Mikus [Fri, 21 Jun 2019 12:07:03 +0000 (12:07 +0000)]
FIX: IPsec TNL test should load plugins

Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoSetupFramework: log thread error to console 75/19875/30
Vratko Polak [Thu, 13 Jun 2019 14:58:30 +0000 (16:58 +0200)]
SetupFramework: log thread error to console

Because logger.error from a non-main thread is lost.

+ Increase verbosity of virtualenv exception.
+ Introduce LocalExecution.py library.
+ Include multiple other style improvements.
+ Add some ssh.py improvements:
  + Accept also commands of OptionString type.
  + Introduce a limited form of raise_from for exception chaining.
  + Add include_reason argument to exec_cmd_no_error.

Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoperf ipsec: test renaming 61/20261/1
Maciek Konstantynowicz [Thu, 20 Jun 2019 12:39:09 +0000 (13:39 +0100)]
perf ipsec: test renaming

Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoAdd 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh 27/20227/3
Yulong Pei [Wed, 19 Jun 2019 14:47:46 +0000 (22:47 +0800)]
Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh

Change-Id: I90427de5b611e432e5e46ab8758a31e376215914
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoAdd continue/fail option for enable traces 33/20233/3
Tibor Frank [Wed, 19 Jun 2019 12:14:10 +0000 (14:14 +0200)]
Add continue/fail option for enable traces

Change-Id: I675f9664391c9f18f312773812f765f345983cc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: Reduce the number of input files 38/20238/1
Tibor Frank [Wed, 19 Jun 2019 14:31:43 +0000 (16:31 +0200)]
Trending: Reduce the number of input files

Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: VPPCounters 24/19924/41
Tibor Frank [Mon, 3 Jun 2019 10:55:55 +0000 (12:55 +0200)]
VAT-to-PAPI: VPPCounters

Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: NATUtil 73/20073/22
Tibor Frank [Tue, 11 Jun 2019 12:38:06 +0000 (14:38 +0200)]
VAT-to-PAPI: NATUtil

Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1459: Migrate IP libraries from VAT to PAPI 13/19913/28
Jan Gelety [Thu, 30 May 2019 14:13:25 +0000 (16:13 +0200)]
CSIT-1459: Migrate IP libraries from VAT to PAPI

Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoVAT-to-PAPI: VPPUtils 57/20057/12
Tibor Frank [Mon, 10 Jun 2019 10:49:51 +0000 (12:49 +0200)]
VAT-to-PAPI: VPPUtils

Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd 2-node and 3-node denverton to specifications 03/20203/2
Yulong Pei [Tue, 18 Jun 2019 10:18:10 +0000 (18:18 +0800)]
Add 2-node and 3-node denverton to specifications

Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoAdd scale ipsec tunnel tests 24/20024/12
Peter Mikus [Fri, 7 Jun 2019 09:45:41 +0000 (09:45 +0000)]
Add scale ipsec tunnel tests

- 5K
- 10K

Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd denverton servers to ansible lf_inventory hosts 21/20221/1
Yulong Pei [Wed, 19 Jun 2019 09:30:59 +0000 (17:30 +0800)]
Add denverton servers to ansible lf_inventory hosts

Change-Id: Iac3ed425caa8f7c28546f04a6c4adc1f834bffd6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoFix exit from reservation loop 12/20212/1
Vratko Polak [Tue, 18 Jun 2019 13:04:07 +0000 (15:04 +0200)]
Fix exit from reservation loop

Break from the while loop is on both success and no testbeds.

Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoContinue reservation when cleanup fails 37/18637/8
Vratko Polak [Tue, 18 Jun 2019 12:17:07 +0000 (14:17 +0200)]
Continue reservation when cleanup fails

+ Only on not-failed-yet testbeds.
+ If any, else give up.

Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 05/20205/2
Jan Gelety [Fri, 14 Jun 2019 04:51:59 +0000 (06:51 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~446-g3860a77~b7297

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~446-g3860a77e9

- use new vpp ref build - centos7:
  19.08-rc0~446_g3860a77~b7181

Change-Id: I7a99f98c6805fb5ddc17d2f858a4af91ea700d25
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPAPI: Reduce the amount of logged information 51/20051/7
Tibor Frank [Mon, 10 Jun 2019 08:40:12 +0000 (10:40 +0200)]
PAPI: Reduce the amount of logged information

Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd more tests to daily jobs 13/20113/5
Vratko Polak [Thu, 13 Jun 2019 12:29:14 +0000 (14:29 +0200)]
Add more tests to daily jobs

+ Add baseline tests for all NICs, only min size.
+ Add scale tests for x710 NIC, only min size and without 4c.

New test counts:
csit-vpp-perf-mrr-daily-master-2n-skx: 96
csit-vpp-perf-mrr-daily-master-3n-skx: 211
csit-vpp-perf-mrr-daily-master: 223

Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 65/20165/1
Tibor Frank [Mon, 17 Jun 2019 07:42:43 +0000 (09:42 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport 1904: Configure rls 1904.25 63/20163/1
Tibor Frank [Mon, 17 Jun 2019 07:37:30 +0000 (09:37 +0200)]
Report 1904: Configure rls 1904.25

Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: IPsec TNL mode func 51/20151/3
Peter Mikus [Fri, 14 Jun 2019 20:36:41 +0000 (20:36 +0000)]
FIX: IPsec TNL mode func

Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd hsw drivers to topology and check against AVF 18/20118/4
Vratko Polak [Fri, 14 Jun 2019 08:30:40 +0000 (10:30 +0200)]
Add hsw drivers to topology and check against AVF

Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>