Re-enabling Honeycomb two IPs same subnet tests

 - reordering tests so unnumbered interface tests
   don't break following tests
 - removing EXPECTED_FAILING for fixed tests

Change-Id: Ic24d878849ab4f451e2fb59856c222167cb35d8f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

Report: methodology section, added nfv service density.

Change-Id: Ia5f3a8befd5a9cc6c4b644ddd785e21f11b1c156
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 1eb5821ae2975d69d1c655049db02348bb79a5ca)

FIX: Set ipsec backend to dpdk backend when aes-gcm cipher used

Change-Id: I008b9e0fd62cdc8e29136930762bd7412bd50181
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1420: Split methodology section to more files

Change-Id: I861e578434abdf72244d684fca8cfd66e1db9c28
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 124101d22151239b0411a73ae4d2bf8d70970937)

FIX: Cleanup docker images per job

Change-Id: Ib14d989d5f44a2aeeec122e2f63a9832a213f920
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit a221ffe6144eb0f372521fbbc828b8a225af12cd)

Improve 1n-skx vpp_device mapping function

Improve mapping function for 1n-skx vpp_device to pickup
available DUT1 net_dev and replace the name with TG net_dev prefix.
This way we can eliminate situation, when pair with not equal VLANs
are picked.

Change-Id: If78329e730bfb4df34fb8d8924c8715d69a15e0c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1c108d51c08631548dc2b2ba1b7652e0b577d82c)
(cherry picked from commit 44bc8611bca15c49663a89cfb29cf0ec1a5ed17e)

CSIT-1416 Remove installation of vpp from containers

Use parent system (Host, Container) installation of VPP. This will save
the internet bandwith by skip installing of prerequisites packages.
It will also skip dpkg install and simplify the process of initializing
VPP inside container.

Previosly initialization of VPP in container takes about 55s. With this
patch it is reduced to 2-3s.

This patch removes the bloated VOLUME creation between container
sidecars (a.k.a nested container) and fixes the hugepage allocation.

Change-Id: Ifa2be532edb77354657e1b84568bdc34993b00d0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1417: Prepare data sets for Report 1901

Change-Id: If0553ac84d1414e7fd3c82d4a7a9511fbbc0986a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8e144056d6aaf83315df1dc4e2ea12f5f0c1e0ec)

CSIT-1411 Implement manual rx-placement override for bug in VPP

Change-Id: Ie3d2b1f40a607ce5190ccfea6a372bc072d0a3b9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1634e19d9adb70b634c80b760aabac81fd4bfdd1)

CSIT-1397: Create Heatmap graphs

 - colorscales

Change-Id: I86e72432ffa850e76aed6d061461519c5f095a1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9510e2ca6dbca1ab16b9db8054e9968facf4b699)

Trending: Remove NF_DENSITY tests from trending

 - also memif tests removed from graphs where they must not be.

Change-Id: I1cbb02ba2dcdcd3a286c9ac4489c946993ac4790
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit de778ee617ed29443bdd8dfa393a2ec4b811b1b9)

Report: Add NF service density and soak tests to static content.

Change-Id: I8f81fc906245e6f5afd4f24ff034f28b95a2ad46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit d3a748d5088d0023f8a96404d4c84deab588a3b1)

FIX: Single memif configuration profile

Change-Id: I44f22a07b6ecaffcce68bfedde1ea3e8a8274fa6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit e091fac49b4ef6260be5b7ce6c1d02e9e750e6c6)
(cherry picked from commit 4422211c9181c6a2108bd172c2c6e63f725ed419)

Use release repo to download 19.01-release artifacts

Change-Id: I30d86b5179cc97aaaed6cb695db6c0a1d82a1e3c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

report: Methodology section, added forwarded modes, tunnel encaps and features.

Change-Id: Idfc575be1549a1ae41a2c384ca582e5a891ff899
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit d90c2c87f2738cab2e9a4eca4058b379dd8d4dc8)

Use VPP 19.01 release builds

Change-Id: I36a80e17cb4f2112a86e187dc9053393dfd07b35
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Add TB23 back into production pool

Change-Id: I69a16b1baa5147f22b7c5742c2ccf6e030474937
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 65908ee392865911ad1b69610a7f3d43e6bf3bf3)

FIX: SRv6 container tests

Change-Id: I9ec04608a9b6cf6a99c938b06261e23e58d290be
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit ed1a7af88e74bdc2b22a58d2129dac498dfcf95a)
(cherry picked from commit 174799890403fcbec2f1dc933518211586807f0a)

FIX: Hardcode nf_density RXQ count to 1

Change-Id: I7ca3b2ce4f4c9d8b452d9de63e7466482d15aa50
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit c17a7406971d2ef28dbfcceb989b545588854e6a)

FIX: Cleanup mechanics for vpp_device

Change-Id: Ice975127f8ecdd4cead418151cf37d61dfb218a0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 956989a5ad8966c06cf3300c2e5edf3f46466edb)

FIX: Put back sleep to wait for container to boot.

Change-Id: Id63fc8670c7816cc71d8d6d8704ff7f1adf3db65
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 509a1092965c674c581e4080e2e2dc4dec5371c7)

Remove non-runable nf_density tests

Remove tests that cannot run on target machines

Change-Id: I2417d491e36afc9164c6981a9f5a3134529df251
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 644d2d68041079d604c5055e41da78150ea04e89)

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc2~3-g9124874~b20

- use new vpp ref build - centos7:
  19.01-rc2~3_g9124874~b20

- use new vpp ref build - ubuntu 18.04:
  19.01-rc2~3-g9124874e~b19

Change-Id: I4fcbead4af6936d91f878613ccb7fc8cbd88409c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1409 Implement pipeline configuration for l2bd with memif/ip4.

Change-Id: I7463d47a9d65069332eb2a288ff44f4499a8a467
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 11bd03f27a53fa6060bfa72bc98c52532cb6e404)

Add 2n1l-10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-soak

Change-Id: I6a045225b0ff3cc4cd9880ee05861fd7bf36c61a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e4293ce7243c222d0eb65b46bac2c3ba59dc7e5e)

PLRsearch: Initial implementation and suites

Missing bits:
- Add up-to-date .rst document (in child Change).
- Prepare for releasing to PyPI.org (in child Change):
-- Either copy dependencies from MLRsearch, or list in requirements.
-- Perhaps move common dependencies to separate package
   for both search to depend on.
-- All the other metadata stuff.

Jira: CSIT-1276

Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 27a56cad3679e4decbcca90acfb22c55a22153e0)

CSIT-1403 Implement multichain configuration for l2bd with memif/ip4.

Change-Id: Ia87156b2ba826eb0a9a93d756b9765c7373ca6ce
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: CPU util for NF

- Fix detecting total allocable CPUs for NFs

Change-Id: If3345518befb887655d3e162551c49df3163ed92
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 15648d7c4f98cc90a406519362b0d7f548893859)

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc2~2-gb296271~b19

- use new vpp ref build - centos7:
  19.01-rc2~2_gb296271~b19

- use new vpp ref build - ubuntu 18.04:
  19.01-rc2~2-gb2962715~b18

Change-Id: I543fb6229a0166ca889db5f946ea7b669f6ec286
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc2~1-g38befb3~b18

- use new vpp ref build - centos7:
  19.01-rc2~1_g38befb3~b18

- use new vpp ref build - ubuntu 18.04:
  19.01-rc2~1-g38befb3a~b16

Change-Id: Ie7146aac6054427490cd0ef3f89074d200f35e07
Signed-off-by: Jan Gelety <jgelety@cisco.com>

FIX: correct call of vpp_add_route

Change-Id: I63a2b5f484ac627c020e30c9f01a868c57aacf42
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 552491e8bcff9745b04fbdd92609351ec9597cdc)

Fix tag in 2n-10ge2p1x710-eth-l2bd-8vhost-1chain-4vm-l3fwdip4-mrr

Change-Id: Iaa268043c04a994647c5dcd704e4e61f4f83050c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4ecbd6dc1e6dd07efa58f2bc001e838aad0457f4)

Report: Add VSC data

Change-Id: I6cd99129ba41fc34f46714c9540299d0b954c965
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a618779453752b80a07e842d52f0808d843348ef)

Fix PyLint errors

Change-Id: I5a369f4b9f9b478375fda4a634bf57cc9623e972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8bac97fb07e863573f5a2914058e1d23229d279b)

Updated RF tag documentation file with svc density tags, other minor edits.

Change-Id: Iece74d5e7e380db344005a6035252bbe18925646
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 12b5c1d2de914e8aabb62587028e4e92fd298173)

Report: fix specification file

Change-Id: Iae93d648b8d146ee363f5dbb3514edd90c74460a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 495294fef7fe03f0797573bf700adbfb516ed573)

NF density: added new TAGs, renamed test suites and test cases per final agreed scheme.

Change-Id: Ia7bbfe5f7027c18a68408cc71445a2839b6b19a8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 8acda639fca422c07701d0be0c9254d8be129a66)

VPP_Device - add baseline tests - part IIb)

CSIT-1372

Add following baseline tests to VPP_Device:
- ip4
  eth2p-ethip4-ip4base-eth-2memif-1dcr-dev

- ip6
  eth2p-ethip6-ip6base-eth-2memif-1dcr-dev

- l2bd
  eth2p-eth-l2bdbasemaclrn-eth-2memif-1dcr-dev

- l2xc
  eth2p-eth-l2xcbase-eth-2memif-1dcr-dev

Change-Id: Ic4a3a01b62d800c528a9c9371891dcc26b875220
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 5a53823d8a6e99072152654ac632bb06a6b467ac)

Report: Add CSC and VSC data

Change-Id: Ia2ebe3d0b96d0012361082d1f45b5c3853db3640
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3532ea7e201971b463e6d72ae799a7871c5b3c9f)

CSIT-1404: Add data pre-processing for "service density" graphs

Change-Id: If9c1a9ee3cf21640e2153b52693903c29791c7ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fcbcfb9aa1bd57fbf187b92a6b1de80899209640)

CSIT-1404: Add data pre-processing for "service density" graphs

Change-Id: Icd5709cd627999bc3ecc101abffb2ace3afdb246
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4434a78fce29d19044b29f60af1882c0fa850128)

Report: Compare NICs tables

 - Change logging level from warning to debug.

Change-Id: I644bdf3a5d13a45a7835c8181ca95d63ff762233
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4c2c9a6d24ee27fc27427ba3b3c8f1c320c91cca)

Report: Reset the Report History to the initial version

Change-Id: I9bf1647de0b4f42c5ef0e80cf3b5dc2e968cc605
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fe92deb7c2707d4a96a894a0efe2391c962f1147)

CSIT-1406: Configure PAL to generate 1901 Report

Change-Id: I2faf542970d9be54945a2f9fdaf0577bdfbd6d24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4fba3998e586334ea0663ff401e36971249b191c)

CSIT-1397: Create Heatmap graphs

 - Heatmap is used

Change-Id: I33a8619ea4a346bde92d85da0bbb63f3d916cbc5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7f83ed570d3cd7ec18f2a7ea3c8c3badd0368099)

Bar graph for Soak tests results

CSIT-1401: Create bar graph for Soak tests results
CSIT-1405: Add data pre-processing for "soak tests" graphs

Change-Id: I158c54e713cb904eb1780190153413929c7bab6d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 339d55392405b435fea92f62c3372b7940c46515)

CSIT-1395: Create comparison tables for NICs

Change-Id: Ib8583041a0d16a6242160b4f51eae973ef33504f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bec963c7d97302d7a0e41d38a5eec1ff5e518067)

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc1~2-gcbb4565~b10

- use new vpp ref build - centos7:
  19.01-rc1~2_gcbb4565~b10

- use new vpp ref build - ubuntu 18.04:
  19.01-rc1~2-gcbb4565c~b8

Change-Id: Icda8a0e7c357ce7e6de48732a0fe3e287924708e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1390 Implement multichain configuration for l2bd with vhost/l3fwd.

Change-Id: I36ab0bc7c9eada4c3f7bb5cb8f53de7d267ff910
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 88e6c1f979f530397a0743e4300d42faf9b538f5)

FIX SRv6 container tests after refactor

Change-Id: I6b7961c9103587b752c6ffc2a56eb98ed1529edb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 0e1682e5580ea16597558f2c8ae5892072e1bd22)
(cherry picked from commit 87830a03b39d4ce3306b05693f0e15979d955425)

Increase default number of hugepages to allow full box testing

Change-Id: I1dc6f54e8371992e8c4a323bbad557e6c1fa435b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 8c7ec6061718ef3e2cc22ca7e13d865b800563c3)

Update csit-sut-dcr

Change-Id: I79907a92c658f1a53c49272b65ea29a5162e5e6a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit cdd110ccd1329793eca6fb489d995d7b4324f73d)

Update VPP_STABLE_VER files to use vpp 19.01 release build

Change-Id: I1221c4f8749c0200acf92f6c2784d0f83767c2d3
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fix failing tests after namespace updates in HC

Change-Id: Idf7cbcf285ff130f771eb3878065e6daa869ac71
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~634-gb5e55a2~b6114

- use new vpp ref build - centos7:
  19.01-rc0~634_gb5e55a2~b5929

- use new vpp ref build - ubuntu 18.04:
  19.01-rc0~634-gb5e55a27~b1870

Change-Id: I50dd39ec37e1a005c5b15a81219a879a428e9dfe
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1402: Add VICs to trending

Change-Id: Ia854d9888130cf7b3df81644bc953e5524976dbc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1400: Prepare and publish 1810.03 Report

Change-Id: I63d989921e6dd2604adfbb93dc95a6de95c2f25d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1393: Check and correct all existing graphs in the Report

Change-Id: Ie6a63c91dfa7d0a7c688062b3a16663d84fcadc9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Markdown doc with FD.io CSIT physical lab design for Hsw.

Change-Id: Icf3eabe120a7d3c8ba93b347fca20c05fc360f5e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Markdown doc with FD.io CSIT physical lab design for Skx, Arm, Atom.

Change-Id: Ib93c3320d213e74f67984c90a0e30bd7b2d63181
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Improve host-setup ansible scripts

Change-Id: I5b44be94e6c4ce5e19797d590cbd7f5de82698d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1394: Modify existing comparison tables

Change-Id: I3096bb2faeb61dc5715334cf19fe0e532fe4c68e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1362: migrate to package cloud for HC performance tests

Change-Id: I43f62ea97e432504eb4ece85744d7fd6ff426113
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

VPP_Device - add baseline tests - part IIa)

CSIT-1372

Add following baseline tests to VPP_Device:
- ip4
  eth2p-ethip4-ip4base-eth-2vhost-1vm-dev

- ip6
  eth2p-ethip6-ip6base-eth-2vhost-1vm-dev

- l2bd
  eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-dev

- l2xc
  eth2p-eth-l2xcbase-eth-2vhost-1vm-dev

+ fix doc strings in all vpp_device tests

Change-Id: Icc5ed801f3e8f6dedaa611779bd86fc20102fa74
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1389 Refactor current keywords for multichaining - CNF (II)

Change-Id: Ic6af8ebf59589bea66322fc87a33218c7dc0c132
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fix permissions for dut_setup.sh

Change-Id: Ia11125e889a981a762c54281375a4e78159d8c69
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

performance tests update

Change-Id: If199757123974cf0889c2284ffc5c37ea9b18e7c
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

CSIT-1389 Refactor current keywords for multichaining - CNF

- Add ability to create matrix of containers (chains x nodeness)
- Change default Docker image to csit-dut
- Use new resource mapping function

Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

[V4] Add sending unidirectional traffic support for TG in CSIT

Extend TG in CSIT to support to send unidirectional traffic, and then
it can be used by unidirectional test cases e.g. Load balancer.

Change-Id: Ie25bcdf7d4525a6d88d8ecd11a1b6d98275fa4d6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

CSIT-1387 Implement mapping function

Implement universal mapping function for placing the NF
threads to cpu cores/threads.

- Must be SMT aware.
- Must work with N-core NF.
- Must be DUT (vswtich) aware.
- Must be deterministic.
- Must use DTCR and MTCR parameters.

Change-Id: I98b61861f85c5af7ecd856719b4adf2ba95c262f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Trending: Add latest changes to the "new" dir

Change-Id: Ib5d1c9561c5d21f2d72b5c1b643c114f37bacd1a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Updated trending methodology doc.

Change-Id: Iecb4c0799ae9c156e054d209e5eaba5972a3f556
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~597-g03afb6d~b6077

- use new vpp ref build - centos7:
  19.01-rc0~597_g03afb6d~b5892

Change-Id: I50a4fd324370f8dd9f17273e3f1ed8d4b36acd43
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Adding pip requirements

- add pexpect - needed for vpp_device vhost tests
- add dill, numpy, scipy - needed for PLRSearch

Change-Id: Ib53f19e954f440773103b7913603a0c86ed81039
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Trending: Remove unneeded tests from Dashboard

Change-Id: I0f57735bcc578b42994721ca88dc1bb60af475de
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1382 Create weekly/semiweekly job for vpp-device

- Update gather function

Change-Id: If130b93fd8c9752bb804a8ecc53c1598e8669031
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~580-g22af447~b6060

- use new vpp ref build - centos7:
  19.01-rc0~580_g22af447~b5875

Change-Id: I939224ad47d684b7ab5f19198086f537e0699a32
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Trending: Align the content of old and new dirs

Change-Id: I39d1f71adac0bad3dbe18a987909904ea5c1e6cb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VHOST vectors.

Change-Id: I5e17c5ab5cb99af0ac3d063ffc911bf95457d3e4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: Avoid duplicated KW names in perf and func tests

Change-Id: I66c68edf6e26fa7baa7bdc5f5d60d4d4aa3af6b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~501-gbef3619~b5981

- use new vpp ref build - centos7:
  19.01-rc0~501_gbef3619~b5796

Change-Id: Idb9468bc1c328952b7c60f22be26f04b8d473781
Signed-off-by: Jan Gelety <jgelety@cisco.com>

FIX: do not use dump stats in IPv6 base tests

Change-Id: I9983b4aa1d6575f017bdfd69b6ab3b26206d9605
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Adding DMM build artifacts

Change-Id: Ia5153d8e716d506c85ec8b723331438efd66ab6a
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>

FIX: Update PAPI to work with string changes in Python API

Change-Id: I3b5f0568b5928cf12aaf2a555f52dd9809348579
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Trending: Reduce input data

Change-Id: Ic49d52b924cbb468ed32fc8561a1101168b15614
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1377: Implement systematic solution using defined time period

Change-Id: I03d8a5fcf9e6392e238e04a06c0463c17b5a4a47
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: New sensitive detection

This enables PAL to consider burst size and stdev
when detecting anomalies.

Currently added as a separate presentation_new directory,
so the previous detection is still available by default.

TODO: If the state with two detections persists for some time,
create a script for generating presentation_new/
(from presentation/) to simplify maintenance.

Change-Id: Ic118aaf5ff036bf244c5820c86fa3766547fa938
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~457-g11312ef~b5933

- use new vpp ref build - centos7:
  19.01-rc0~457_g11312ef~b5746

Change-Id: Ie15c5bdfb433c2320a833f4c5d272c65d4cb1491
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Delete old NDR/PDR keywords

Change-Id: I932d46646408a030ffdeb78b3a3e19c39455750d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add missing = to all suite Variables

Use the following if we ever decide '} =' is better than '}='.
$ cd csit/tests
$ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g'

FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450

Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Reduce the input data for trending

Change-Id: I88ecdcf2ae4229318ea4b4f775d85597aef531c2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VPP_Device - add baseline tests - part I

CSIT-1370

Add following baseline tests to VPP_Device:
- ip4
  eth2p-ethip4-ip4base-dev
- ip6
  eth2p-ethip6-ip6base-dev
- l2bd
  eth2p-eth-l2bdbasemaclrn-dev

Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report: we use IMIX also for ip6

Change-Id: Ic3aa4325357186bc9c23a9fbe4f8ac4278ddbea9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1374: Split the files with graphs int he Report

 - Packet Latency
 - Throughput Speedup Analysis
 - Packet Throughput

Change-Id: If0df9fe8940eae08734f95c5150e10f2317c4927
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Change the Report version to .49

Change-Id: I14a371bcfb043ccb0a5cffc48f6f6f18d61f1942
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~394-g6b4a32d~b5870

- use new vpp ref build - centos7:
  19.01-rc0~394_g6b4a32d~b5683

Change-Id: Idf497fc7348bb8e6987025d8b56488b7282f5cda
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Fix: CSIT-1299: Revise the graphs in Trending

 - Graph: l2-feature-1t1c-x520-3n-hsw-oacl

Change-Id: Id724d98adc2b5bc5c1779df8b903215e8cf507f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1299: Revise the graphs in Trending

Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: VPP_Device - use vpp bionic packages

Because there is already used ubuntu bionic on VPP device testbed
and used download script from pacakgecloud site donwloads packages
based on host OS we need additional file to store vpp bionic stable
version for VPP_Device tests.

Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

FIX: Exclude softwire func tests from execution

CSIT-1371

Map commands were remove from VAT by patch https://gerrit.fd.io/r/#/c/16115/.
Excluding softwire functional tests from execution until corresponding csit KWs are fixed.

Change-Id: I2adc580fb4770746c355f12f5ce7e7f8823255d8
Signed-off-by: Jan Gelety <jgelety@cisco.com>