Report: VPP func, updated chagnes in rls and list of known issues.

Change-Id: Iea0bbe5ba81b3c63579edcc15eb728a5b0fe2876
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 57f138f79b614c9fdaf737b4a0e7e08a73b1fd76)

CSIT-1342: Edit the static content for CSIT-1810 report

Change-Id: Idb4abd737265504402aca56f826a6ae8c219a2c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f9983d929094a7b3200baaca3b31734438c79796)

report: added logical diagram to vpp_device environment.

Change-Id: Ia40ebd9c1158e51f5c6c173d7e55206aaf86e8f2
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7540019e72b0c9b959d58df86eb7e111e6c17c94)

report: test methodology updated with new bits and bites in 18.10.

Change-Id: I08fcb7c6d09adc37805083319d148c9659a80eff
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 90809c1375e79d4a3220f995bd0ed3b7762e7df8)
(cherry picked from commit 44d73d6d17b191fe2fabf2803d5ef8d8641d7350)

Temporarily remove Ligato tests

Change-Id: Ie21183185a241a497ed86ac901b5cedd5891803f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e0806c8358f38406432d1c6f09de7b90fadb8646)
(cherry picked from commit 203f03e3ae5e4426b097d5ae44b6d52b1beab212)

CSIT-1350: Add new data to 1810 report

Change-Id: I1c82729c2abc7e5d3699f254629da6a9095d3464
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8f3797c2b3c32b91eaaa214651c12de2e67e575c)
(cherry picked from commit edbcfdfa0c8b704718a5fb664c28ec9140c68aa8)

CSIT-1350: Add new data to 1810 report

Change-Id: I833df1c69ee86870ac19a747ea790dcffb749bca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 32bbad707629a44d17a7e9958b6ec462ba77fe49)
(cherry picked from commit ba4f013e902fca31db4052af57bac474ed59ec6b)

CSIT-1342: Edit the static content for CSIT-1810 report

Change-Id: I047939677a171dd729f3328b839bce9072bc482e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c225c222e1554d7d3406f92a40c74269620cc885)
(cherry picked from commit 0258ff7936da54bb0124dd49aaaf1c64af7ae701)

Fix: Calculation of max value.

Change-Id: Ibf84467f3e8a3a956814207261b4ea24f69f0a97
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2ea8039cf6a400e7c13219c7c2f826921aa64dfa)
(cherry picked from commit 0355ebddd5ca76e29617a3beb302de1ad39aa19a)

CSIT-1342: Edit the static content for CSIT-1810 report

Change-Id: Iba997abd93b136dafd3b77d217068dde3f586ea3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b6d247550a5ff8c3893fb918ea328fb0f1f9797d)
(cherry picked from commit 4bdecb3033537d00fe0ba3ac41197ee419071d68)

CSIT-1342: Edit the static content for CSIT-1810 report

Change-Id: I1b838deed822159d78728805c8269cf8a6592d2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d77d62178fa257cf84099811b9177b9e224a2dd8)
(cherry picked from commit 0c206faf2b515fbe1c25587ec3928cf473968170)

CSIT-1342: Edit the static content for CSIT-1810 report

Change-Id: I44abd4ad646813cc70e9fa2b46b51ee7613dc501
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b641b5bf12a0d1b63ac9afb7c89133297d3b63fe)
(cherry picked from commit 946813cd0d3982a81e55f12842e17361b353876a)

CSIT-1350: Add new data to 1810 report

Change-Id: I7451dd774e65bdef88adf700502063393cf0c49f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 312e541e0cc53a10429c40b41ad7f22ae4b8adc2)
(cherry picked from commit 1cac0c14770da34a8868afef1fc13d33ef969dbc)

Fix: Speedup Multi-Core throughput graphs

 - remove markers from "perfect" line

Change-Id: Iaeb93d6b728439262f1a1c7bcbace84d2e542bec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f5feb996b72ae37fb5f84e0138b03b645fded899)
(cherry picked from commit 32821462e41d366f1267cda536aab5212ed1b8cc)

CSIT-1342: Edit the static content for CSIT-1810 report

Change-Id: I547ccc1a40acbf1adac385f56d388406a5102bde
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4f1ba73c40decf810f27c044c9378aada8b39b43)
(cherry picked from commit 84f566a35775e9460be188c4607e8712bcfc31eb)

Static content for vpp_device sections

Change-Id: Ia445ab5c339aecc0dfc6db40b2eb962436f9aeea
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 455dd6483d66705ce78e60ce6ee22c73db80230b)
(cherry picked from commit a3f83b81b20deb7519c52e5e8363f2c4d3a326d3)

CSIT-1350: Add new data to 1810 report

Change-Id: Ifb215623eb376c6df30b4490023412f301b43153
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 41ae3f37ecb95800b261cd1b1c2dc5f141a355f6)
(cherry picked from commit c20b0777d10c5467f128d48620751cbeea4c0bc4)

CSIT-1349: Add VPP-device tests to report

 - only data

Change-Id: I1d5c50900b06ef938308855218885fa3ca1f2860
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 87c9212433574478b9c19a702c74bbaf39567404)
(cherry picked from commit d6b889b9004fae285fe769e1ebe7e66b32598ba7)

Report: Report history

Change-Id: I67bdefe20cf12625b6456341d1e2d25e81e41fad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 82a91dccf597c8562cb40c6f7a39c4fac45359c5)
(cherry picked from commit 4cc8ece0652bd192fd44e454bf02232f04dfd180)

Change the version

Change-Id: I4fac272bf3f0bf9bdbf446ea3c2eff48966c600e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e12b14a8a0713a08122ac0096bcd88002670bcba)
(cherry picked from commit b7e8f88289895dfbd9458146a4bf9565ed9e89dc)

CSIT-1350: Add new data to 1810 report

Change-Id: I49e39b9513bcd53caaecdc1948cb64aa58272311
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b932d6a6b053fc1262fe1e4012a12e75d7e13e2c)
(cherry picked from commit 544f071a3b65a53ff6a58c1db52b58282bac66c2)

Report-1810: Configuration

Change-Id: I0ada7489738d2cfc416aa6c3bea999d2534ad109
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e9d7bd6ec613cb8bd0217c4d70201671fa29ae10)
(cherry picked from commit 57d2baba79d1b95c88d5f9bdfa6f2bbf89febe64)

CSIT-1332: Proposal of new layout of all graphs

Change-Id: Ib5d113fd2071e481bcc5e3d043a43a58947b8da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8243ea78854683f2f80da53d8f197f10316e4801)
(cherry picked from commit db1f4030448cbf9d865e5e2964236ddc7fffa5f9)

FIX: put base interafce up when creating VLAN sub-interface

Change-Id: I879d1a0f1e901c59c9e3fc061a8accd6f423ee0b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit c963f61129ec095b09baf33c6ea78157ddf771ce)

FIX: show ip table in tear donw only when test failed

Change-Id: Id8fd73e22984d7d0728bf7e136b6b7b91c036066
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit ca7af34ad1d286fa0b2324c6d2d3f66b79c0c9aa)

CSIT-1339 Create initial l2xc test

- L2XC ping ICMPv4/ICMPv6 test

Change-Id: I1c1708e8c1050f140a02d56012f63b683fc3eec1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 3c9040f9a7a72abd149b403a95b8d12946ba69db)

Use VPP 18.10 release builds

Change-Id: I56176b2a57ee7ee9b3c8b5d3bf614935afb44de6
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Remove usage of vpp-ext-deps package

This package is not needed for csit enymore.

Change-Id: Ie32a9c9322873e66554bb69112d4428697c866db
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1260 Create initial version of bootstrap including VF reservation

Change-Id: I153d378849ea76444915b7fc219237db1b7bca1a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add Meltdown and Spectre checker output

Change-Id: I8c6ffada779483e083815afa7cc6337ca580ecb9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 3bb7803c9e74d4ceeac77480c11e01d5d8d7d589)

CSIT-1255 1-Node VPP_Device Documentation

Change-Id: I0152bd9c0d2a97aa206819b46e8e4c0fe7d643eb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit ccabfb04a4982c89d70b8bfbff67cc97438aad88)

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  18.10-rc2~11-g79e4bc2~b48

- use new vpp ref build - centos7:
  18.10-rc2~11_g79e4bc2~b40

- use new vpp-ext-deps:
  18.10-7

Change-Id: Id544aaa3daf57080776aa42b7271f01bd878bfca
Signed-off-by: Jan Gelety <jgelety@cisco.com>

FIX: Correct the packagecloud.io URL path

Change-Id: I8aae4cb85f9bb1efaa19d75e2fd7c9593f20756d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Script for PXE host staging

Introducing script for staging server via PXE and controlling
CIMC/IPMI reboot.

Change-Id: I1667e1906e7de73b7bca994d82de75e12c0d382a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 2f5317d594411424be9bffeb4ccfe441e7b50530)

FIX: Switch crypto tests to vfio-pci

Instead of igb_uio

Change-Id: Iaf0fc793b35e99f62ac442686ae7047e965086d0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit f4984a65cb0ed91220b45cd8d9c0ae698005089d)
(cherry picked from commit b363703dfbf2af9cb6cee0755028ff9a31b24364)

CSIT-1338 FIX: Failed to get VPP version on host

VPP was not initialized (shm), after service restart, quickly enough.
This results into vpp_api_test console timeouts when communicating over
uninitialized socket.

Patch is introducing more stable test to detect service (VPP) is fully
ready and initialized.

Change-Id: I300a763814feba28cb8163dcd4996b53b2994fec
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 0490e94aefea47f6bac0b00339cf832c196b7f09)
(cherry picked from commit 4a5b37a3cf84145e159fed5a0cc7a9b41992c10b)

Tag l2bdscale as L2BDSCALE, not L2BDBASE

Change-Id: I0d2d2f16f7e0b710f432711d7e0eccf70fcfcc8f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4b3af03b04a8b4c084b081ee0cb1b13f81d7393c)

Set .gitreview for rls1810

Change-Id: I5cd4e54476b07284e7b7fa414bfefdb1a2654bfd
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

FIX: Vhost interface UP issue for VTS tests

Change-Id: I2983b295cc8e070f6fe2ff7a5f19fe45d17cee27
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d53d63c0c0f1c26836d0653222916064844af1d3)

Update VPP_STABLE_VER files to use vpp 18.10 release build

Change-Id: Ic7244ea0a0babab0666fa14bdf0e9cf975ab15c7
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1297: Modify the bootstrap.sh to run only selected mrr suites

Change-Id: I2f5ac334e09bc35bfaefc112cf0bb7f57290a732
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Fix authorization for ODL fluorine tests

Change-Id: I2ccca8955949840305350bec1f60bc6d1cddcf82
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

Add VXLAN scale perf tests

Jira: CSIT-1273

Change-Id: Ic2a41661c158384a5aaa7d4e73f30ffca13ddf82
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER and DPDK_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~593-gb7620fd~b5386

- use new vpp ref build - centos7:
  18.10-rc0~593_gb7620fd~b5270

- use new version of vpp-ext-deps:
  18.10-6

Change-Id: I0fe0b045f62fa04bd48daca999d55c7ac6ada802
Signed-off-by: Jan Gelety <jgelety@cisco.com>

FIX: Vhost interface not up issue

Change-Id: Ibfd00c2eafbb11a66ef5989ef3baa735de865ded
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update Ansible scripts

- Allow Kubernetes to use specific version (allow-downgrade)
- Introduce ansible-vault for sudo password management
- Add Kubernetes fixes for 1.11.x+

Change-Id: Ieb77e773ea28f5c551ef0702027f699c1b758aa2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Switch Haswell TB to vfio-pci driver.

Change-Id: Id3ba5c5b3a03df7302b6def4bdb066cbb291ec43
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Fix failing tests after Fluorine bump in HC (HONEYCOMB-433)

- this fixes failing tests after bumping ODL dependencies
  in Honeycomb and HC2VPP projects.
- increased timeout for installing ODL feautres,
  sometimes it takes longer to install them.

Change-Id: Ib3ae8106ae0c1122410e9bd7924d0b49ed6059c7
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>

CSIT-1297: Modify the bootstrap.sh to run only selected mrr suites

Change-Id: I7071abd6c4a52a86efea573a4f9bcb54547dc004
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1294 FIX: ValueError: CTR mode needs counter parameter, not IV

The issue is caused by python-crypto library in upstream Ubuntu 1804
repo. Unless there is permanent fix there is workaround to always
download fresh version, not preinstalled.

Change-Id: Ic2318eb532a6e7a910e4ffb209556c17e6070d3d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1320 Update SFC-controller configurations to latest version

Change-Id: Ibaca5e848a8f4dcd2a50f873bea37bd99aa5d62c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1326 VLIB: barrier sync elog tracing

- API changed.

Change-Id: If70e1a930aa14b129ad38ef544cff32ad5a08cdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1325 - FIX: AVF tests failing on unbind

Currently there is and issue when consecutive AVF suites are
trying to initialize AVF and bind VF to vfio-pci driver, there
seems to be race condition if VPP has already VFs allocated.

This patch should introduce safer contstrain to disable VPP prior
AVF init.

Change-Id: Id8839200f19d9e7a18d161b660cfb1e43a8ca379
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1326 Add barrier event traces

Change-Id: I0f734c2f11cc89716371554880f1d7404ea16090
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1327 Migrate from vpp-dkms-dpdk to vpp-ext-deps

Change-Id: I6fad3303c5c331ad36d163ba735907e35931dea0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~526-g6648fc7~b5298

- use new vpp ref build - centos7:
  18.10-rc0~526_g6648fc7~b5203

Change-Id: I1304fb9bf55624569dd1d9665296e5a0a4fa19c9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

FIX: Single memif tests failing

This patch suppose to fix the single memif TCs failing on SKX nodes.
By stoping Host VPP during startup of Guest VPP. This way Guest VPP
can take interface on single pass.o

Change-Id: I88e6932bf007ce0f6a367927de5f017ffb8fdaca
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1321 Add IP4base tests using AVF driver

Change-Id: I960c2b4170efa06597851853cfc15bda1c60fe94
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Exclude dot1q in the default tag array

Mainly useful to reduce test set for per patch.

Change-Id: I55a5f2d268c3105ac32d25ae317e149d3c3b4e14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

integration of DMM+lwip testscripts

Change-Id: Ifb1a0702353e71c61a694dea5164df41f4e23389
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>

FIX: testcode detection in perf jobs

Change-Id: I4c0c5afa8a8dff814382cb0ad6d9df0410179755
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Fix jumbo frames

Change-Id: I8aa557fe75133d20eef9832e314357af71f1d19a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Add Vratko to committer list

Also specify "Europe/Bratislava" timezone for people based in Slovakia.

Change-Id: Ib2ac19668c4216bfe1d31e664d477b2986583bd9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1316 Fix ligato building mechanics in CSIT bootstraps

Change-Id: Ia8da73cbf7ab213b61a330b757419330667be24b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1317 ADD: Ability to blacklist tags per topology

- Add option to override some tags per topology.

Change-Id: I4045ebbee1c5d32e29cdb6c5c84e0dcd9217b2cf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: Add VatHistory for VATscript files.

Add ability to see Vat history for file sourced commands.

Change-Id: I49b19236bec7253ea412659368cb7ccb5f5e3274
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~465-gb7020d6~b5194

- use new vpp ref build - centos7:
  18.10-rc0~465_gb7020d6~b5101

Change-Id: I1fa617bb2d93e5f371b7d41ed6b9b060938493b5
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1292 Update Ansible playbooks with vpp_device tasks

Change-Id: I22d1fe2fc27d6adb39eba2578e68d06992a3f976
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Fix autogen regenerator and few suites

+ "elif" instead of "else if".
+ Some suites had test cases reordered.
+ Some suites contained 9000B cases for avf.

Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add example of 2-node topology file

Change-Id: I3e72c568f09e0b7e20b4ea395f1b2d5efce77f40
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: Do not run double link tests on 3n-hsw

Change-Id: I9dfb4bfba4d0650a42e34d0e1f97b60b031f0750
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: 40Ge2P1Vic1385-Eth-L2Bdbasemaclrn-Mrr typo

- Per trending.

Change-Id: I1e24b20bc774dae91df6fb81e3a9132ff79e3beb
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add dot1q-l2bdbase-2memif-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1289

Change-Id: I9e3f1f4a03e3cac9d8831f3a87e0b1bce27a109e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Add dot1q-l2bdbase-2vhost-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1286

Change-Id: Id51c7dbf15d846f1286e6efbc5240a2556ec9652
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1205 Create AVF driver test - Add Tests L2BD L2XC

Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Create basic 2-node topology performance tests for Intel-X553 NIC

Intel-X553 is Denverton (Intel Atom cpu based SOC) integrated NIC, add below
basic 2-node topology performance test suites for it, the test suites were
changed from the existing Intel-x710 test suites,

- eth-l2patch-mrr
- eth-l2patch-ndrpdr
- eth-l2xcbase-mrr
- eth-l2xcbase-ndrpdr
- eth-l2bdbasemaclrn-mrr
- eth-l2bdbasemaclrn-ndrpdr
- ethip4-ip4base-mrr
- ethip4-ip4base-ndrpdr
- ethip6-ip6base-mrr
- ethip6-ip6base-ndrpdr

Change-Id: Ib6d3655a6e14ae275c197fd7b39d59e17a233326
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

CSIT-1291 Improve service handling with container detection

Change-Id: Iaeac10676f46e0267041afee927bc6e3201146b2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1288: Prepare data to be sent by Jenkins

Change-Id: I0840883d52180d09f7de2bd9b0391a0db24105f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1288: Prepare data to be sent by Jenkins

 - Add creation of tar.gz file

Change-Id: I525c713bb3e157cd94337222781066252c3fa517
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Add dot1q-ip6base-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1283

Change-Id: I0f6841bafdb47bdbc3efe29801fe66a0d4c388ca
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1131: Alerting

- CSIT-1132: Send e-mail with a list of failed tests
- CSIT-1288: Prepare data to be sent by Jenkins

Change-Id: I7ac720dca44d7c13b22218abbca7a00d36d459cb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Add dot1q-l2[bd|xc]base-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1284

Change-Id: I8ce4ffc76adf55bf9a8423077b8639601c560c87
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~422-geeadc14~b5124

- use new vpp ref build - centos7:
  18.10-rc0~424_gef90ed0~b5050

- use new dpdk version:
  18.08-vpp3

NOTE: Centos7 and Ubuntu16.04 builds are litle bit different
      because of availability of builds on repo.

Change-Id: I6cefd91351848fb075935ae9b41354d3432eacf3
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Add dot1q-ip4base-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1278

Change-Id: I3cc929222d7fd58f38e33917e84675e9c0b55bbd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Add coding guidelines document

Started as a quite verbatim paste from:
https://wiki.fd.io/view/CSIT/Documentation#CSIT_Test_Code_Guidelines
then re-formatted, and new ideas added.

Change-Id: I13fc3d267f07d88cf22402051480613e55123d44
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1282 Migrate from Nexus.fd.io to packagecloud.io

Change-Id: Ib4e72dc8e3c0fedfcd702f4f97bc4f26cbc642e9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1280 Single memif container test failing

- FIX

Change-Id: I4b62d08b140dc73eb950d21bc85dc41ad638bbd2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Fix: L2 scale tests are not baseline

This fixes select_tags function in common.sh
to not include scale l2bd tests in default tag list.

This is needed because "L2BDBASE" tag selects also scale tests
(contrary to similar IP4BASE and IP6BASE tags).

(Line length over 80 characters is left there
as an indirect TODO to improve the tags.)

Change-Id: Ic1d4a046f327fdd1b8b08eb20f1cdb4b12f337c9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Fix: trap for unreserve before cleanup

Change-Id: I978a056ffdfd6daa00a0a1c587774b4a7204b434
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1269: Add VTS tests to trending

Change-Id: I9ddbad8e4c3f64553c72f77f93eb9d6c21602eca
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Create l2bdscale tests for 2-node topology

Jira: CSIT-1268

Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1179: Switch MRR to multiple trials

But keep the detection in PAL using only average, not size nor stdev.

Change-Id: I07092bdeb892c871550265757fd2846a36fbb352
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1270: Split feature tests in trending

Change-Id: Iecc841737552fea07b7fcf297c478479f7872ae7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1271: Add VTS tests to MRR jobs

Change-Id: I5c0be60a1819c5c46225b4468ba9c88068231f08
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1272: Fix VTS tests

Change-Id: Ibc4ae346032b2b711e4dcd1dbc9c0873e8464b19
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1262: Add 2n/3n-skx to trending

CSIT-1263: Edit Trending static content

Change-Id: Ief60f3bea75fb9fd153f7abb0a5933f1a3e317aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Create ip6scale tests for 2-node topology

Jira: CSIT-1176

Change-Id: I78f4e9cb24a7de0bde24a78d1ca26607598a62b2
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Add INFO.yaml file

Add INFO.yaml to list:
- Project description
- Properties
- Issue Tracking
- Contacts
- PTL information
- Meeting information
- Committer information

Change-Id: I02ef3fca1bef20ab5497b632c1995019bd7d1074
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>

Fix autogen violations

Four AVF suites had test cases in different order.

Change-Id: I12fbe3508016a79a2153cc004c654a21ee4279bf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1264: Add oper branch wrapper entry script

Change-Id: I569b089b711f89fecca8dd31d6906ef311982877
Signed-off-by: Vratko Polak <vrpolak@cisco.com>