Report: Add data

- Dry runs

Change-Id: Ib6e50853b5b4638dc0f4bc93a98b3818f5079658
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 72614c322675f63958ca668404f081d738660e42)

FIX: Vhost teardown

If test failed before vnf_manager is created then teardown
does fail as well due to missing variable.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0b23648bce78738cf4c377979d7a06fb488d990d
(cherry picked from commit 8f41f1d040453d963440d8cc99fb2b957521120b)

PAL: Archiving of input data

Change-Id: I0902613047d7543378a4b7d46811fc67776c6ad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9e476b274acf41b5ac358bc4dba3a0f1e16f04b2)

Report: Download first from logs.fd.io

Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cd2a57aba61553f36c638dc6e8d949e1739fb6bf)

PAL: Get DPDK Version

- Needed for trending

Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9e1bb28404a23f6d4c62fb945a3ee6dba42f1c47)

PAL: Get TG IP address from output_info.xml

Change-Id: I566c0e436fbe50e5e72da35be6a2afc81e8a33b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b763901692e207a8f07386bb3bcba254cdeaa790)

Add testbed info to output_info.xml

- Needed for trending

Change-Id: I59fc115ce62d1ad839e7c8a39c74af0497b9012d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5dea7e63a012cdbf4fba60e4fdcb5c6acce2fca4)

FIX: Remove TB31 from pool

- SSD failure on t31-dut2

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I82bec2f78341f3e8ea5647d9781910e89461c327
(cherry picked from commit aa69c5cf674ae8bfbfd69aae9358f617c53a1fc5)

Clean: Various libraries

- Remove translate TC as they have no perf opposite
- Remove unused keywords
- Merge similar keywords / rename
- Move keywords from perf library to categories

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6433006136e2497ad8fb17193aa20c578d836999
(cherry picked from commit 9c75b7bf5af74aa13cfa3aeeaf726cd965850fce)

FIX: if MAC address must be updated after AVF interface creation

Change-Id: I9fc26a7d1bf8d9eed620173a73febe3d874a1351
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 3e664d4a46aecf847659df2fe3d2572697b582a7)

FIX: Various typos in nf_density + missing KW

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I73878542672ab2dcfa1db046fbca4b7d931e744c

Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc1~9-g28d8621~b14

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc1~9-g28d86217b

 - use new vpp ref build - centos7:
   19.08-rc1~9_g28d8621~b14

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Id9b87e14d806ff8c4ae67ad16695aa4834ccacde

Report: data

Change-Id: Id51e073d23d7bb54864eb5fd1c3c320077e6abb8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f187d0b4f9cfa3b980a94b1f56e828b183367c15)

Report: Data

Change-Id: Ibd1a5dc6e451d992eb85b223973734c876e37fe7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f7037acce33b11dbbbb87ad079750525e6b95eb4)

Clean: L2 bridge domain

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca

FIX: macip_acl_rule needs binary mac data

Change-Id: I0d26b2b31f0ce7497c91b4ae965f9cc45a66ef0c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 5b28bc8c52a5f7ef72f03d03806f61ba45ecc623)

Clean: L2_xconnect keywords

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic15a15c426db04defc15840883a772a0eb8e4885
(cherry picked from commit 181e882d5c939cc6620545e5fde411e46fd59559)

Trending: Fix ipsec

Change-Id: I0f35098047bc1137cbf2a1ae39107698b1e9bf79
Signed-off-by: Tibor Frank <tifrank@cisco.com>

DOC: rls1908 static content

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382
(cherry picked from commit ce1c52b1fd27d3e2b6c4909219fa98418565ba61)

Report: Configuration

Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d6c832b02ac7d3073dd8651b089a72ec8240b183)

Trending: Set 90 days period

Change-Id: I56403c30142876501602fe06c0ad2665fa73cb7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: TSH ipsec tests

Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Clean: L2_patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib3620689acb3641b2ec9a49e2ce552bab3f00eef
(cherry picked from commit 016fb5988a63c3086b0b5b9f5ad7155c6ebef291)

Clean: Interface Keywords

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ideddcea56120cf770aec78ca24813baf7d05ba11
(cherry picked from commit 484cb0bddf8ad75129ac20b955a72f36f4241ad2)

Update of VPP_REPO_URL and VPP_STABLE_VER files

- use vpp builds from vpp stable/1908 branch

- use new vpp ref build - ubuntu 16.04:
  19.08-rc1~b5

- use new vpp ref build - ubuntu 18.04:
  19.08-rc1

- use new vpp ref build - centos7:
  19.08-rc1~b5

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I8173e5342e9b6934608cd44c5581f33cba9552ec

Trending: Add dnv mrr tests

Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3n-tsh trending docs fixes

Change-Id: Icf4babf8f7924be864520a0ecf8f7e718de51c32
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

Update DPDK ver

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifc0b47d0849d34f5c4ddf9fea393e7c249720359

Clean: IPv6 keywords

+ Move all base ipv6 related KW to library
+ Remove useless KW to save space in output.xml
+ Remove cross dependency in ip6.robot

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c5f72e9852c1017356ab6034c4d271cf7b53265

Clean: IPv4 keywords

+ Move all base ipv4 related KW to library
+ Remove useless KW to save space in output.xml
+ Remove cross dependency in ip4.robot

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If1e3a6370d36caf4ce7411fb956a0b7d0f939b6b

FIX: Pylint

- my bad

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c1f57f6b648b99338f3f6a6ff9ec943082e9bc4

FIX: IPsecUtil - create IP object separately in ever iteration

- if we are trying to update ip field of already existing IP object
  in more iterations of e.g. ip_route_add_del the PapiExecutor uses
  value from last iteration for all iterations so it ends up in
  creation of ip route only for one IP not for all required IPs

Change-Id: I5ffa622e2a06d0c5c71720d2cf743a4c2104ab79
Signed-off-by: Jan Gelety <jgelety@cisco.com>

FIX: Remove PAPI_MAX_API_BULK

- it's not needed anymore as PapiSocketExecutor is used

Change-Id: Ia9fad1d18991821d14e9261d27f7f26fca03c14a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1473: Migrate Tap library from VAT to PAPI

Change-Id: Ibf4a4839c2e8b799b03eebd9dffae891d8f00dd4
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Update trending vpp ref

Nexus to Packagecloud
Xenial to Bionic

Change-Id: Id702076b9a5c37e84719bae66bcd87c9ab5ed2b7
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

Expand comment on API covering triggers

GBP tests were added, they are only covered by 2n perf test.
Several tags used in the tag expression to proof against future suites.

Change-Id: I9facd8c72b41284b6b838e99ce9d38047aa68f40
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add: AVF ip4scale

+ Few corrections
+ Aligning 3n/2n

Change-Id: If0918c0df38c5532899bec9ae7a7019117fff477
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add: Dot1Q + L2BD + GBP

Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Change show hardware detail to show hardware verbose

After https://gerrit.fd.io/r/#/c/vpp/+/21071/, show hardware verbose
doesn't output slowly processed module info which is not needed for
debugging purposes.

Change-Id: I2f91a0ce1bfc082b46f2fe43df968750bcd1cf3a
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

VPPD: Dot1Q

Change-Id: I0d3c925ea4a6896a0df98db6ddaf4238e6291bf1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

PapiHistory: Use repr strings for argument values

Composite arguments frequently do not have valid __str__ method
so the values were not visible.

Change-Id: If302934cb227f212580bb2f5c277a755ace51bcf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

FIX: Layer dot1q logic

Bug found by vrpolak

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibf61f14a838d0b49220ab8079a2d999f860a18e7

Fix CRCs, bump stable VPP version

+ Migrate the data to a separate yaml file.
+ Improve some argument names.
+ Unify handling of unicode (to always utf-8 encode to str).

Change-Id: Id0622b24202be796c1cd33ad52c3b8dca81cff50
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Trending: Reduce input data

Change-Id: Iab9e6686ef163eda04d836e4f355a310058e846e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: Freeze Vagrant version

- config.vm.box_version = "20190724.1.0"

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56d70d62f38a10365e447346a619652e33392cbb

Add 3n-tsh mrr data to trending docs

Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

Trending: Add 8 big input files

Change-Id: I9891c9589014be04fa69973e092fdf8b9926a56f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Implement retries to requests

Change-Id: Ief9ab61a54cffb529ae3539096121d1f77ee0167
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Remove multiprocessing from cpta

Change-Id: If53c5a72abed11fda9b15d043b24027d2eb9d86e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: Disable API checker during runtime

Change-Id: Id530710aaedc30472d8bcd33d24b7fbcaa7c011b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Trending: Fix ignore list processing

Change-Id: I27c2ae25cc9cf6996f3c22417479b300faa73994
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Fix static content in dashboard

Change-Id: Idffb3ec30d402326e5962209872afb613df68970
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Improve log output

Change-Id: I37464dc15749d0f59a3ee67651483d6bc1388316
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: remove multitasking

Change-Id: Id331fb5bb1d2e5a4da9665b330b991010e5a11e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Add multiprocessing, remove archiving

Change-Id: I67cfde7dfc9b81fca3ae102b43f6defafe88f689
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Disable CRC checking at runtime

Temporarily, will be re-enabled once VPP and CSIT are in sync again.

Change-Id: I0d3bb5b70ea04155972093102a26a81f86119c37
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Trending: Memory consumption

Change-Id: I26a7d9e7ee0b1a64666c3ffbcfc424f04a52d046
Signed-off-by: Tibor Frank <tifrank@cisco.com>

TOX: Coverage check

Change-Id: Ib4585729f7b84bbcf1db62db801a6b2f24337803
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add: Prerequisites checker

Change-Id: Ida54722ee5c73a0b3e0a8e22692795daf5bb09f3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Trending: Reduce input data

Change-Id: I8917e72717c672c44494a34aefce4039ac5efcc9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Set packages versions

Change-Id: I272b7c4a5f9d2f446a0f91214d6052196690cdcd
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Set packages versions

Change-Id: I8d9298733652f16dbfa0c183602060eb4f727dfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I6760f39e9438d1af97217f2fc28b933226b9cb2d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I8dc4fb23c07b1ab9cc0ecad852cc594ec9922055
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Remove multiprocessing, part 1

Change-Id: Idcca9b3b933d5524d2ba5905050480796d8a81aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Multiprocessing

Change-Id: I6dedd6d201f46f0b996e75a3cba12713d9c32251
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Multiprocessing

Change-Id: I41ef5c0de337e1aa13cd44b94c4e8e15413872ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Add VPP API CRC checking

+ Include both checking at runtime and standalone static quick check.
+ Runtime checking does not look for missing messages,
  as messages belonging to disabled plugins are not visible.
+ Standalone check script has nice loud output.

Change-Id: I1dfc3846d1bcdad0b09017d4ce8edd5028e17e0c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Trending: Reduce input data

Change-Id: I25c74c00f95aa2e3c2f7c1780e39e3f6262afc0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Idd87da996f25c7fd94cef828dee6967737b73ba8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Ibc2c1f02c80189045a63cf07e89c6a409d785047
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Ifddbdc1f357a192af558079a92f4e4d1d2693efd
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I31d4d7ceaf8969e28d86deac2995cd38cbff9fca
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Id0569dc7d882ad6b631b41c2e55ee12dc9d4b5ea
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Ice96d11d802dbc3d502b038ee8e328281551bc9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc0~765-gd56550c~b7706

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc0~765-gd56550c2b

 - use new vpp ref build - centos7:
   19.08-rc0~765_gd56550c~b7517

Change-Id: I69fe1120759330d9ee2219a55c8cb6a06cdcc5ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Revert "PAL: Skip daily-master-3n-skx/540"

This reverts commit fc7fbe37baaaa82f751757f75491e2a29db5176e.

Change-Id: I2b7710f5d41006cfd2a39a55c86c81c3ae43f90e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Revert "Trending: Reduce the number of input files"

This reverts commit 6e1de92cec9a0687ca82bcefaae3ef7dad5104b0.

Change-Id: I04130c449905f93bdd82da36d2ff4de26005dfe4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Fix logic error in AVF compatibility check

Change-Id: I7f1b47725648c8c26e21f42c305395ad620beea6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add: Missing Trex profile

- IPv4 400 destinations IPs

Change-Id: I007a588375bfa5be572a183ac6d2372801bea99d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Remove obsolete L2 KW

Change-Id: I9a8aa6f5ccf95d632f4e677c8bf14f50b982d930
Signed-off-by: Peter Mikus <pmikus@cisco.com>

make sudo to preserve user existing environment variables

Change-Id: I83470b059b9ca59bb3725f1ebef6718adf8f91ae
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

Change: Move few KW

Change-Id: I8c8ae1d7eed8cf28fc63ce42b2dc36dd16a5c0da
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Move: 100tnl tests to 400tnl

- Just bcause they wanted.

Change-Id: I46a83924d61e9191bb02cf9dcfb761156686d545
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add: AVF into trace group

Change-Id: I3399d5fb2754eb67734e8f76a5743283fe9c074c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Change: AVF can run also on i40evf

Change-Id: I375b7c9f8fe81428cb16fea35128bddec089da1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: IPsec Util

Because:

>>> for i in xrange(4):
...     if i > 0 and i % 250 / 3 == 0:
...         i
...
1
2

Change-Id: Ia4eba227ea1e4c6222f32ac598f254428d95adc9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

docs: fixed TOC and list indexes in testbed specification

Change-Id: I262b4a2b8c0afae4fd49e4edee8f12b2dbc0ed60
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

docs: updated testbed specification with clx build

Change-Id: Idaea4ac8ba04bea591ade511f55a5e421d04b8f5
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

VPPD: VXLAN

Change-Id: Iac518341e6a0fff4a31ad3692ccc5697690db8be
Signed-off-by: Peter Mikus <pmikus@cisco.com>

VAT-to-PAPI: LISPSetup

Removed CRUD parts from tests

Change-Id: Iaca36e62be5144ea3f2831457113959b65489db8
Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>

NF_density dot1qip4udpvxlan

+ NF_density compatible
+ Baseline VM tests compatible
+ Scalability NxM
- 3n variant is missing in VXLAN and DOT1Q due to requests to have it
  asymmetrical - TODO

Change-Id: Ia817d7be00622b594b451bc07756240d1a379e04
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update initramfs build

Initram image was being built with remote resume config. Remove the
config while building to avoid possible 30s delays when booting VMs.

Change-Id: I988838290dde3d6fae83676937d86f4f12bdb769
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

Fix arm sut docker image name

Change-Id: I548b176baeec39362b9c0a4e02a664d1e95574a3
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

vppdevice: fix install-dep failure when component install is required

Change-Id: Ibc4379ef25c1bf536da68eb6d0b035993e907c7a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

Add scale ipsec tunnel tests 40K, 60K

Change-Id: Iecfd7e69a72c8d5893a703fa93439cde0a3edf5f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: Vhost optimization

- Testpmd 9000B
- Disable fsck
- Remove redundant init mounts

Change-Id: Ia063520d0a206e9eee831a5cc692e32baf5a92c8
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update of VPP_STABLE_VER files

 - use new vpp ref build - centos
   19.08-rc0~707_g545866b~b7459

 - use new vpp ref build - ubuntu
   19.08-rc0~707-g545866b~b7629

Change-Id: Ib90849caf93872c658273fbad57d0eba6348dc28
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update documentation of select_arch_os

Change-Id: I619a18918b0710a59a3b36283aa79da06d640fae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Fix typo openssh-client -> openssh-clients

Change-Id: I3834f2cf2341be15351435eed277810a5a2218c9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>