Use VPP release 18.04 builds

Change-Id: I2fdece7633774ba24660b78a465eb4b74bbf26a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1041: Trending dashboard

Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a1728c4f56cc44b9acb45614c20fc0a546ee3161)

CSIT-1041: Trending dashboard

Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0f662ea0defa9b30fa7a7d9256857fce92d20a6e)

CSIT-1041: Trending dashboard

Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6e1a15acc7bd3685d71f9d34238181c681dcd4c0)

CSIT-1041: Do not treat positive jumps as outliers

Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 0a8855adbb30a6079a538bea179a13988fdc20c0)

Edits of intro to perf trending dashboard

Change-Id: Ide9a38ac5798ba5a2c37f42232dc86b186502085
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 28f9f057aadad0b744dc91df3240caac7e311424)

Report: add data

 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/
 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/

Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 59e06f5e3143bf093bdb6b53c0186b050668e3d4)

FIX: Do not ignore zeros while creating csv file

Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d420e98c6838831877f1aad6aa924844fc009195)
(cherry picked from commit 2f5a43baecf26ebe978772efc8f6186509cff1c7)

FIX: Remove feature plots from base graphs

Change-Id: I4118a19bd6204858e96cbf8029aea045478efca7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cbd331c63db1db3ac51133732a0eb63ea8dc0712)

Use stable/1804 vpp builds for NSH_SFC tests

Change-Id: Iaaf1af31fa526108ebdcf3610bca76346d186183
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report: Add data sources

 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/14/
 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/16/

Change-Id: I7603a41f797a6dd5438c3daa40e883b1643ae712
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 53e9d835462c85738a61ce6f069a05d090645ac8)

CSIT-1041: Trending dashboard

Change-Id: I815e61432d418d0f741ed57f5450460951f7191f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9dad3f95c2624808aeb9892049c236fa788a55d9)

CSIT-1041: Trending dashboard

Change-Id: I1e05f75545d97ab186fbc48df44bfe17472d6cfd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 971bf6f4d091e15952199f0172119228d59f584a)

FIX: TCP perf tests

Change-Id: I6424722641b0cefdf1945b57996bf2c48dc86a3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit de0aa31e85515e2d8a2a5db24e4520e1db26936d)

CSIT-1041: Trending dashboard

Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 79e508504fcd6b5b677e567eb09092c5e0821790)

CSIT-1041: Trending dashboard

Change-Id: I8d53c68643acb18bf2b5ab171672b0de02d2d135
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 52f64f232293130904d54a62609eaffc1b145608)

Report: fix performance comparision tables

Change-Id: Ieae746412427980fb86512253cc58ebcee991317
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6f8266f81bb052e2c0e51b029e47f0eb4f04a7ed)

CSIT-1041: Trending dashboard

Change-Id: I3b8e545bd198281af502acc6e23268e840112423
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7aa0d625baca67d9789b5db3da2ee468597d254b)

CSIT-1009: SRv6 proxy tests

- SRv6 with endpoint to SR-unaware Service Function via static proxy
- SRv6 with endpoint to SR-unaware Service Function via dynamic proxy
- SRv6 with endpoint to SR-unaware Service Function via masquerading proxy

Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 73a01b1a7fc836c964627eea2c08106df0da5aee)

CSIT-1041: Trending dashboard

Change-Id: I99b7acbbf6c773a4d2c5fc74cf7ba02aa6f98fa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cd330b5a1bf1a289e7dad68420679a5d94de1eda)

Report: data

Change-Id: I63a4a6f65aa80a4edb11b1ea3ece9787a148f6f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 85a5bd538583f33dc63e072cfa4b3b6750958191)

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.04-rc2~18-gfd2e376~b37_amd64

- use new vpp ref build - centos7:
  18.04-rc2~18_gfd2e376~b38.x86_64

Change-Id: I597c9189afd0501141aa3417fc7bff235d33d7ef
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report: data

Change-Id: I3fd24ba9030a62f9307a24e8774e703fa8232692
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d94b0d05bad404db4d44bc12a96f29a838394c94)

CSIT-1041: Trending dashboard

 - add long term classification

Change-Id: Iec8d2275c01da3b1e41435b9abfb70ec3fe98fd3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7aff808942440ba9729bf60888738b920c024324)

PAL Trending: fix in remove_outliers

Change-Id: Iec4d1683b8bb97224971d803821aced3c37144bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7cfdac0cf07e3a7d9a8b53b7621f8b7500fd1515)

FIX: Use rolling window for outlier detection

+ Rename find_outliers to split_outliers.
+ Make remove_ouliers call split_outliers internally.
+ Add "window" argument to both functions.
+ Add TODOs to call sites not setting window size explicitly.
+ Improve docstrings.

Change-Id: I24961e2859ddbfa62b543031284517c7389a2abb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4f5872c1bb23873b3a93cb471aae8700d5ca029d)

FIX: Restart VPP in container before each test

Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit f3d66d9ca20e7fb2b153d83d809f005a93b76a8f)

CSIT-1053: csit-dpdk-perf-1804-all data

Change-Id: I38f6260bdaf94c39c105c0faa9779773d76cb972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4cc8b3a4b890ecd7cefcb22a5f2a2acd1036cf78)

CSIT-1041: Trending dashboard

Change-Id: I56437bdb0c0b7309e2bdf4a81fd9e9b20843b040
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0bd0db7f4e5333bcc93fc981594bb90a2ed140fb)

FIX: Configure number of memif queus properly

Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit c8b2f57cd09355e0e89e6b9d28930281573bec23)

CSIT-1041: Trending dashboard

Change-Id: Ide76682e210412fdcd945a21946fa9957429109d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bb81ef05b86154d000128ef15bd3ecffe997ef9a)

CSIT-1041: Trending dashboard

Change-Id: Id5a6a431261443eb8616c9d6ff4cc43b6f054791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a0f580f21995185fcbd02aac905d83275faeda72)

CSIT-1041: Trending dashboard

Change-Id: I175bf9269a9f958dc35d592a2810b7a6f37268a3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1265b8792b8edd44407c8073aeba2ca24dc0ad82)

CSIT-1052: Remove HC Performance from 1804 report

Change-Id: I924028fd6d56fff1859bc1fd27d7a5273d54435f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 98f7c4743d36b03cbe9952ff7e3e60e39f851e2d)

FIX: Memif tests failing

- CSIT-1049

Change-Id: I073c1e6d8cdda835fbb955cbf79e982bc2cc6228
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 30c94055dd6ec2fe1cb83455cf6eb4bca8648d45)
(cherry picked from commit 04cf5c92a82b11f8eb2cafc3a07793474e84a322)

CSIT-1041: Trending dashboard

Change-Id: I2b08c3c1859302437092456da4bb8f1ebe4756bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6942369b1102a8b9a3b705f9192f1ecb959382d1)

FIX: Topology schema after adding architecture

Change-Id: Ia6fd4fc1168a7171bbe480aac3c6c942375b1623
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 22ba8a3ee489fbc67a8d1727423188be52e1ef22)
(cherry picked from commit 25e1c57a7c7b40c29bf9f52046d145b3b757f245)

CSIT-1041: Trending dashboard

Change-Id: I98db049e4a8a3fedce73290815cf84e7d281f6ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 56b9eabf3b4c2f80c831c6440c67d0d65826461d)

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.04-rc2~7-ga45bdca~b25_amd64

- use new vpp ref build - centos7:
  18.04-rc2~7_ga45bdca~b27.x86_64

Change-Id: Id340bcff6a86c6275ae2cb35985738821fe5ac1e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report, trending

Change-Id: Ib71be16f2ddf172c381b43d289a9a0000dad10b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2387340f7050112311cd231f7d30d06731da4836)

Report: Compare MRR data

Change-Id: I66bfb11568401d0640e809b5d70fc414b09d5011
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e3554783146e2c4f2b6b5084c8afc707787d6922)

CSIT-1041: Trending dashboard

Change-Id: I983c5cccd165fb32742d395cf7e8aa02c7f9394a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 23731f392ad8705b17cf37f9c2d397b20305f924)

CSIT-1041: Trending dashboard

Change-Id: Ic706612218e0ac6b991a15abc4d67e16905e8087
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9821b058c2f4901a9b4d66667018da214513ab28)

CSIT-1041: Trending dashboard

Change-Id: Ib095a5cb1e825ffd4be09414b52fb0bbb133828c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c1768398d4b5e4b26154eefae85ddd1bf193cbf6)

CSIT-1041: Trending dashboard

Change-Id: I4f2068503cc02091b439ebfb15ebe92aa203252d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 99d4cc007624691f87f8c21a89eab73aec3a08fa)

CSIT-1041: Trending dashboard

Change-Id: I4cedfaab7f6e5d854a5107c4ac69413eb89186d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b6de6fb4bcf50cd347df181121602db9ac2c9eec)

CSIT-1041: Trending dashboard

Change-Id: I74b2c5d56ccf764868759fd5d7f2301d4ad3d725
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 29035746be0145db942832b55555b695da2323d7)

CSIT-1041: Trending dashboard

Change-Id: I1905039550283d7eb23d02b32bb5fb837215e37e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4914a78f593124788c754695b79be146c3916c6f)

CSIT-1041: Trending dashboard

Change-Id: I18f06b67af7ce8894bfbddbd70d2a9c1f33435be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f2f19bad6847e315366e5e9ab4952fded0097b1f)

CSIT-1041: Trending dashboard

Change-Id: I09097843d4d7f659db9a3133bb6e1c457bcd1ac1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit be6a64548431c215ba265ee2edc6dc2eb2bff947)

CSIT-1041: Trending dashboard

Change-Id: I227f9ec0e863307393a1e192a6faaea32b08673d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d0e06e9bc675e87f84af534af822cf2490e0337a)

FIX: CSIT-1044 Dpdk-testpmd 9000B tests failing

Change-Id: If2b27912f2523e9e7d3c24dd8c310cfcb3e935b2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 2038406703b82f513e6feaa1583118ba0d4eccaf)

CSIT-1041: Trending dashboard

Change-Id: I26aaf33a3df4d38fddadcfc7191900d80c02f855
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4a778c818108baf64a5abe6ffd6b27a4a88a2633)

CSIT-1041: Trending dashboard

Change-Id: Ie98b7b8885575be408686b4eec5b539f3bb68d1d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 482bb432e9607bce6cb92d41bf9e299c0e2fc288)

CSIT-1041: Trending dashboard

Change-Id: Iac6d4e5bd8b1e10d3ae3206a8361c434fb4b49ea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 295a68551716af397597bc721d6a3115572009f9)

Add log-level 8 to DPDK init sequence

- Add --log-level 8 for testpmd init
- Fix txqflags parameter for testpmd 18.02

Change-Id: Icc687ffdd7cf3ab5fa8ece0f3ce2eb03996b22cf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d3c64b0e39300b688f9339434436c6ecbcaee455)

CSIT-1041: Trending dashboard

Change-Id: I48f665a4ea095202a0792a2ee02794f779afb95c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4a40c75ffc9f6b62a2eb58007675ef17f4c32b1e)

Add more verbose DPDK logs

Change-Id: I98a07fa88d4959ab05996e053c5c02ef9bda5039
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1bbd587a4c5768f3292dfc88da587c41fed0b3d4)

Set correct paths to vpp stable/1804 and use vpp stable/1804 builds

- two IPSEC-LISP-GPE test suites tagged "EXPECTED_FAILING" as there
  is a bug in the test case - fix is under preparation and will be
  merged soon

Change-Id: I2d14d70873258aead1c8988ba5880987cfd1c02c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1042: Graph index

Change-Id: I82a31993e7353185f8fa84eaf294d2a2fc8b8bbb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9a0160ae94b1733b50e45c4c157419e74d8eaf4b)

CSIT-1042: Graph index

Change-Id: Id487184b779ae092b2b3722446fe2c741a21e37a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ba1d3d5e63fc28a2d011348cd067679fb08986b6)

CSIT-1042: Graph index

Change-Id: I9ea8d1ae75537bd635dd3a37487e44765a1d8923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ce2cc1a41038be2a1c737c3c4414571c7f32c455)

CSIT-1040: Static content improvements

Change-Id: I8c9290cc93496794f30275ee23cc013146be94fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1037 K8s container extensions

- Add new K8S topologies on i40 based nic

Change-Id: Id20f1e15dab347edee128633230aa098b774e43d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update DPDK to 18.02

- Update DPDK version to 18.02
- Code cleanup.

Change-Id: I33e2aa35cc80092561a4db99d75bdc7e4b62df3a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Cleanup perf bootstrap

- Remove the DPDK_TEST variable and replace it by internal global
variable
- Unify all perf boostrap for merge in future.
- Cleanup ligato perf bootstrap.

Change-Id: Id47d6614c8dd18a701493e00056ef17d2e37fc5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Create unified service operations

- Add ability to dump the logs from service unit (since last start)
- Cleanup service code to more streamlined way.

Change-Id: I6e332dce3229727dd36fd72a8ecfb9fc9efe4d63
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Fix: PAL Trending csv and txt tables

 - Fix the problem with missing builds in the range of builds

Change-Id: I17fbc083ad88ee7c1b30c05f4f05022a1c92683d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: Crypto execution order

Currently, VAT history looks like this:

sw_interface_set_flags sw_if_index 2 admin-up
sw_interface_set_flags sw_if_index 1 admin-up
sw_interface_dump
sw_interface_set_flags sw_if_index 2 admin-up
sw_interface_set_flags sw_if_index 1 admin-up
sw_interface_add_del_address sw_if_index 2 192.168.10.1/24
sw_interface_add_del_address sw_if_index 1 172.168.1.1/24
ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40
ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9
ip_add_del_route 10.0.0.0/8 via 192.168.10.2  sw_if_index 2
resolve-attempts 10 count 1
exec exec /tmp/ipsec_create_tunnel_dut1.config

It should be like this:

sw_interface_add_del_address sw_if_index 2 192.168.10.1/24
sw_interface_add_del_address sw_if_index 1 172.168.1.1/24
ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40
ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9
ip_add_del_route 10.0.0.0/8 via 192.168.10.2  sw_if_index 2
resolve-attempts 10 count 1
exec exec /tmp/ipsec_create_tunnel_dut1.config
sw_interface_set_flags sw_if_index 2 admin-up
sw_interface_set_flags sw_if_index 1 admin-up

Change-Id: I4e943436dee00166966b4f53d9d0a40440bbf1e4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

PAL Trending: Add build date to csv and txt tables

Change-Id: I75e614b45bcf1b38709b551ba13bc6e54d2c978d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

PAL: Static content - indexes

Change-Id: I5ebe1bc959e893fc617f69b9c3e01eee262651e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: Download from nexus

Change-Id: Ia6df570da214ff7af67550335f2c1c8b26a17bce
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Add .gitignore for files created by run_doc.sh

This is to prevent people who verify documentation locally
from accidentally contributing the generated files into gerrit.

Change-Id: I16d9993b9f7fd2652ea53661dd431c499b58db8e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1034: Add all x710 tests

Change-Id: Id96a3441a1f16ee4ca0a52e7dac1726884d6685d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: Remove Niantic from x710 and xl710

Change-Id: I3e41f30534870c2e4084f7fa81d5a757f08377ea
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: Jumbo frames are not received

 - 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot
 - 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot

Change-Id: I69f6fcb7c7cae46a8061fd75db9be2933154c3f9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1032: MRR Tests: IPv6, x710

 ─ 10ge2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot
 ─ 10ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot
 ─ 10ge2p1x710-ethip6-ip6base-mrr.robot
 ─ 10ge2p1x710-ethip6-ip6scale200k-mrr.robot
 ─ 10ge2p1x710-ethip6-ip6scale20k-mrr.robot
 ─ 10ge2p1x710-ethip6-ip6scale2m-mrr.robot

Change-Id: I270c1e52e61fd9765f139983d133432a3058c722
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1035: MRR Tests: container_memif, x710

 ─ 10ge2p1x710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
 ─ 10ge2p1x710-eth-l2xcbase-eth-2memif-1dcr-mrr.robot
 ─ 10ge2p1x710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot

Change-Id: I1ad44fc2a7f27edb060953cb301fda4abcffe52b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1033: MRR Tests: L2, x710

 ─ 10ge2p1x710-dot1q-l2bdbasemaclrn-mrr.robot
 ─ 10ge2p1x710-dot1q-l2xcbase-mrr.robot
 ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot
 ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot
 ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot
 ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot
 ─ 10ge2p1x710-eth-l2bdscale100kmaclrn-mrr.robot
 ─ 10ge2p1x710-eth-l2bdscale10kmaclrn-mrr.robot
 ─ 10ge2p1x710-eth-l2bdscale1mmaclrn-mrr.robot
 ─ 10ge2p1x710-eth-l2xcbase-mrr.robot

Change-Id: Ic5d5cb377eca25daaeb22e8390632a6d6421c2e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1030: Add x710 MRR tests - vm_vhost

+ 10ge2p1x710-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
+ 10ge2p1x710-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
+ 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot
+ 10ge2p1x710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot
+ 10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
+ 10ge2p1x710-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot
+ 10ge2p1x710-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot
+ 10ge2p1x710-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot
+ 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot
+ 10ge2p1x710-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot
+ 10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot

Copies of the respective x520 files,
with each "X520-DA2" or "X520" replaced by "X710".
Occurences of "Niantic" were removed.

Change-Id: I15bce75b704072b26a908f868e90a42dc3ea7661
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

FIX: VAT SSH timeout

Currently when VAT cannot connect to VPP via direct API call, there is
inner timeout of ~100s until it quits and returns RC. In our code we are
setting outer timeout to 10/15s to detect if VAT is not responding. If
VAT does not respond quickly enough due to e.g VPP crash, we are
incorrectly reporting SSHTimout exception.

This fix is suppose to set correct timeout values and also to set some
of the calls like show run|hard|err / clear to detect whether they were
successfull or not.

+ Various small library cleanup.

Change-Id: I787c4baecd7e086705a4076643e255a875ea8438
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1020: MRR Day 2 - x710

 - CSIT-1029: x710 MRR tests - IP4
   - ip4
     -10ge2p1x710-ethip4-ip4base-copwhtlistbase-mrr.robot
     -10ge2p1x710-ethip4-ip4base-iacldstbase-mrr.robot
     -10ge2p1x710-ethip4-ip4base-ipolicemarkbase-mrr.robot
     -10ge2p1x710-ethip4-ip4base-mrr.robot
     -10ge2p1x710-ethip4-ip4scale200k-mrr.robot
     -10ge2p1x710-ethip4-ip4scale20k-mrr.robot
     -10ge2p1x710-ethip4-ip4scale2m-mrr.robot
     -10ge2p1x710-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot
     -10ge2p1x710-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot
     -10ge2p1x710-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot
     -10ge2p1x710-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot
     -10ge2p1x710-ethip4udp-ip4base-nat44-mrr.robot
     - 10ge2p1x710-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot
   - ip4_tunnels
     -10ge2p1x710-ethip4lispip4-ip4base-mrr.robot
     -10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-mrr.robot
     - 10ge2p1x710-ethip4vxlan-l2xcbase-mrr.robot

Change-Id: I141bbd8039f4a5993c77758b1c410dcbd203ab97
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1008: Fix 9000B VM Vhost performance tests

Change-Id: I63105e8a4f11d740c38fc6123984005bcefa117b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

HC Tests: adapt hc2vpp tests to oxygen bump(HONEYCOMB-424)

Requires https://gerrit.fd.io/r/#/c/10376/
and
https://gerrit.fd.io/r/#/c/10643/

Change-Id: I32c81ddf4377f598c359bff278b34a76b9309a28
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

FIX: Change plugin default behavior for Container tests

Looks like disabling all plugins in container leaving
only memif_plugin.so results into issue that could lead
into lost of SSH connectivity to TB or in better case
to not handling any traffic.

This fix is supose to return previous behavior for Container
instance of VPP.
vpp_config.add_plugin('disable', 'dpdk_plugin.so')

Change-Id: I7bca6c73c0f5aaf30d423b90ff7c2d2c38d54700
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Revert "FIX: Change plugin default behavior for Container tests"

This reverts commit c754789176b1a3ca00a129d3d207aa5a6bad7c27.

Change-Id: Ic1bbe8fac0d98f41aa8b1b57da0c7a147111340b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: Change plugin default behavior for Container tests

Looks like disabling all plugins in container leaving
only memif_plugin.so results into issue that could lead
into lost of SSH connectivity to TB or in better case
to not handling any traffic.

This fix is supose to return previous behavior for Container
instance of VPP.

Change-Id: Ie8b3ce2e35a40c8f3498e490abb6967cd4dd912a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

HC Tests: fix authentication for ODL Oxygen jobs

Change-Id: I05dcb5f35ae1bc2abc7ce5c34eaced218e0ebd35
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

Put Centos 7.4-1711 1.9 image into production

The patch to create this image is gerrit patch 11245

CSIT-566
CSIT-688
CSIT-681
CSIT-682
CSIT-688
CSIT-683

7.4-1711 1.9 images have been installed on VIRL1, VIRL2 and VIRL3

The 7.4-1711_1.9 image has been tested locally on VIRL3 with a local patch
modifying bootstrap.sh. A pass of verify should force a check on VIRL2 and
VIRL1 to verify that the image works OK.

A merge of this patch will put the new image into production so review this
patch plus 11245 above carefully before merging.

Change-Id: I74a0b23d75120fdc3934bfe3c6e96f8fb10784db
Signed-off-by: Thomas F Herbert <therbert@redhat.com>

CSIT-1027: Add Index

Change-Id: I2928aee8665ba80f6a36643331db410d55683b38
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Update to Centos image 7.4-1711

Add qemu-ev version 2.9.0-16
Changes required for vpp 18.04:
Add selinux policy rpms at required version.
Add mbedtls

JIRA: CSIT-566
JIRA: CSIT-680
JIRA: CSIT-681
JIRA: CSIT-602
JIRA: CSIT-608
JIRA: CSIT-603

Update Centos image version 1.8:
Point to Vault repo specific to for 7.3-1611 for
consistent control of package versions and releases.

Fix for pypcap import problem.

JIRA: CSIT-991

This fix forces the downloads of the complete package for all the pip python
packages to be installed on Centos regardless of the Python metadata on
the host.

Change-Id: Id651dd113eec41db738ac1e10c92d1074e89b1de
Signed-off-by: Thomas F Herbert <therbert@redhat.com>

CSIT-1027: Add Index

Change-Id: If92bf076e4a55fff8f740b20a1f3aa5019c66091
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT Trending: Static content

Change-Id: Icc5ad530cf7f80eae08a6cb7ce0f49b65015f6a5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT Trending: Add x710, IMIX

 - L2
 - container memif
 - VM vhost

Change-Id: I74a720dad12e1709fd99f76f022c863c80969611
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT Trending: input files

Change-Id: I1570e55186c54718aa388c8ec24bd8d8ed67e0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT Trending: Input files

Change-Id: I4cfaaff8a372dbf807715ec47647fbe8760dbe6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT Trending: Input files

Change-Id: I93728caccec332e05af30858dc83e85ab2af91fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT Trending: input files

Change-Id: I15d987cd57272c29d463c711fb7049b33b1e0084
Signed-off-by: Tibor Frank <tifrank@cisco.com>

PAL Trending: download input files

Change-Id: I407e3cdeb25547d46fafed702ee608f6c0e03091
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Change the default plugin behavior in perf tests

Currently we are selectively disabling plugins by creating list of
disabled plugins for performance tests. Thanks to the new API in VPP we
can revert the logic to selectivly enable plugins. This is more stable
for future onboarding of new plugins into VPP.

Change-Id: Ibdd56d6097230d095a304bbb6984b565d9428f51
Signed-off-by: Peter Mikus <pmikus@cisco.com>