report 1807: list and table formatting fixes.

Change-Id: I1233e903a9590d12ae0cf0032e33a017fea07b3e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b8502d5ccf9030270fafe06fe860143b5f9b78d0)

report 1807: fixed index.html for introduction section.

Change-Id: Ie733827e20083b78ed75f1e70f7762dd8a963404
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9cdc72c8d2708e644c91996a084b7143fc1aa52a)

report 1807: editorial nit-picking in all graph sections.

Change-Id: Ib366f57fbe590faae3b13f96ab68fb528046f619
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 64d3c3f78b5150ad27c934eaa1785e8ee8111bf0)

report 1807: editorial nit-picking in all performance changes and comparison sections.

Change-Id: Ib0ea94894df1bd70cef83a97453662f0074e640f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f77b4557b82d5049c722cb7a52954ee96c7c15b0)

report 1807: editorial nit-picking and formatting all release_notes sections.

Change-Id: If4678dca08139febfbbcad929dfde322a7008ff9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9e00a9702f6b17ff85c597a0915ffb8b693e87ba)

report 1807: introduction section editorial nit-picking.

Change-Id: I15ebef40034ff9637e549b95c4d6e7f35bf2ad09
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit e253cf226e1595acecf42db1262e1cb179aae5e7)

Bump report version to final

Change-Id: Ie424687a126b2ee5ffcbc5a0774474a67cc0cf50
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 5cf543e186c7d04c4d2feaed5e5606539a4df9be)

1807 report: updated dpdk performance overview section.

Change-Id: I48e6e5b5750bcb4b3b7b6eb82c351bed1de08c73
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 14f5a52b235fc196952c85e127a57821e325d7bc)

1807 report: updated virtual topologies for all functional tests.

Change-Id: I3053c7a9733ca7c03df993698472ad8d031dba96
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit c2ce046f71f7de1f247be68513e3d4e10c8c2a04)

General report fixes

- Fix few typos, and other corrections

Change-Id: I03679231c01ad34c3b2773b52f1327d8c871b750
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 2c55fe4a2d74352090b64118858a3557e197aeee)

rls1807: updated environment sections for all functional tests.

Change-Id: I8f0a2a49ee6e75990ee4638543259c40d1fb5d67
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit ab0b18bf513bb292b5d24d2eb339c2dddfbcd955)

1807 report: added VTS description in vpp performance overview section.

Change-Id: I0ba70947d895404723864da2a8477c682741620f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9b23b0e91b666274974173a4c0d942de8a51b920)

CSIT-1208: Add new data to 1807 report

Change-Id: Iea304ffd65e4ddbac277274b96207a351cf004fc
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 27d7bdafcffe0eff093fc775e6721026c3af6227)

1807 report: added HW calibration sections to test_environment plus editing nits.

Change-Id: I66698ae70d1bbbde6992e5663bc64c30249f7f79
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 25a40550e90c036dddf17698103a9a3c34ff6799)

CSIT-1208: Add new data to 1807 report

Change-Id: If575d2dc0e8ddb81afe693c646a911e33559b67e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 7ae94f2578699fcb50544742d6c27b59edc74abb)

Revert "CSIT-1208: Add new data to 1807 report"

This reverts commit f461386e3caaac1a33f8fa3ad44fd63ca26f0f1a.

Change-Id: Ic5a30273fa8103cb1d5ba918cb55b0d897715380
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1208: Add new data to 1807 report

Change-Id: I96260f9d22d19db608b8b119efede60f69897d98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a0f10dad4aea6c8f8cb0a75c041dce626e39c3d2)

1807 report: removing unused svg files from introduction dir.

Change-Id: I1a4b10bd97e6a0e78aba7f99083f4459f47bfc88
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 80bb30bcef742b17b292f29ce330e0ceada15de5)

CSIT-1208: Add new data to 1807 report

Change-Id: I1c51fe8b37e5a849310418c85be3db8053d67cbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 08e4ac10c1a718c352ecafb8f472f62dfe7dfd24)

CSIT-1208: Add new data to 1807 report

Change-Id: I6f4c03c66a762b129c86a9d751d15f57e62f2ea9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8f5f344d59674ea4c158e8ff1528716276f5b071)

CSIT-1229: Add DMM to report

Change-Id: Ib3ea8c13371a29ea2b4661a8506190dcb15c8ced
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
(cherry picked from commit 468da48d3f3ced298ff8dccc76885157dff5cfe7)

CSIT-1208: Add new data to 1807 report

Change-Id: I103417283196940db841be2a254d5d6e8537938f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1ba065be541936a73ba9a9113165583a8bdf36c3)

FIX: Section names in introduction/overview

Change-Id: I05e4be8f92625d95bfcb01270453069f498e88b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 84897128303f29df234efa36c6f7e862cc3b49e3)

Report: remove column doc

Change-Id: Icef72f6e248b6489f3fe0dc33435f71fa51723aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb61b6f15d88dbf51ff72fb942cd85dacf4c34e7)

CSIT-1231: Cleanup CSIT RF Tags Descriptions

Change-Id: Ib57014bf2461518eadcd156b16f8ee26eeb86785
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fed4db2ae63df547f04fd2ba1607bc3014515f41)

CSIT-1232: Edit docs/report/nsh_sfc_functional_tests/overview.rst

Change-Id: I5c8c81a971e5e2abde59eb144d707eaea0bf1ea2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5c44d48479824a3b8609da0a70f7857aa44b893d)

CSIT-1233: Edit honeycomb_functional_tests/overview

Change-Id: Id0bd955be59a95909aab5067965c2cc7e2fee520
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2866efb065355a197d88df492278a4ea92cefbbb)

CSIT-1208: Add new data to 1807 report

Change-Id: I90b094efc869f04ece54aadc6e0c26eeb4ef8bdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1d5213b0ec7ed99b58d519f4127ad77a00ef5096)

Update 18.07 release notes

- Part I

Change-Id: Ic97cfce98c560c9e873935fc72489ff102f201f1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1230: Improve layout of pdf report

Change-Id: I833f3bab2f3729b9f2e64d7e6a7f21efa247c967
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c17435e48f65f36b2f934cbad9ef1dc56524dae4)

CSIT-1230: Improve layout of pdf report

Change-Id: I6d89dc4dacd8b60a29662754dd920c5cec9e1efa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 03f07968114e4a10f2373c67ea938b2384bd110f)

CSIT-1226: Fix bugs in pdf version

Change-Id: Ibdcc1d79db4079af49167c5696ba1c4edb3a40bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2fc7ba3b3b5dad5a211310d529c5a375dea8b946)

CSIT-1208: Add new data to 1807 report

Change-Id: I242b96ef4fafd53745ea1900ac63b95024dccb0b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5a2c06dc4e1d3395082b6afef657453cb5bab18d)

CSIT-1228: Add DMM source code documentation

Change-Id: I2689e2ad5ef4776b9ff4bd652ed7f141d9e55d74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8c34e2945809ce12dd2795bb4e76c2a6b30e1be7)

CSIT-1226: Fix bugs in pdf version

Change-Id: I9c7abca28f98a581a8efb390c6ccf4f8937a958b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 903cb9f7dd664c5bc87f3295dd600d6cb23bf8ca)

HC Tests: 18.07 report update

Change-Id: I2c3df89532f0e728c58b54c220d4fe8ab1297ba4
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

hc2vpp-csit-verify: use vpp packages based on vpp-version

The hc2vpp-csit-verify allows to run HC CSIT tests per hc2vpp patch.
The job should not use most recent vpp artifacts
for respective branch ('RELEASE'),
but version specified in the vpp-version file.

The vpp-version file is used by hc2vpp-integration job
to produce honeycomb package.

Change-Id: If2811a01256e8217de50d220082dbc204443b54a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

CSIT-1208: Add new data to 1807 report

Change-Id: I15b8ad91c9f64c8fe5170905a8c7566f55dfe5d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit dadb06ada83c7f25f9cf884d54d3a30fad979b29)

CSIT-1208: Add new data to 1807 report

Change-Id: Ia28a587409327b266af75477a6dc0c2d6ccb5a7c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 18570b75b0cf920177dfbb5688112239a633fa08)

Fix ommissions from recent Changes

+ Insert missing "Add worker threads"... keyword to udpsrcscale15 suite.
+ Add MRR for 40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1 suite.

Change-Id: I467e5469a1421caa25373ab91010bd4d824fb32f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit e96c1376b9b5fd2f6b67c7f90252c5897b4bb84d)

CSIT-1208: Add new data to 1807 report

Change-Id: Iab06ce9a98aa680b6e947ecbae144e2ac92b84e5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e4456dd443f86253ed23fc1a07d4618b8ad4b6e4)

CSIT-1208: Add new data to 1807 report

Change-Id: I93c6625d537bfef3e955e171db92e5a639ffc22e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b37edd789d18a621896b26a42048bd6929742e0a)

FIX: Increase Ligato MTU for Jumbo frame testing

Change-Id: I6d2cb7a10b5245cbf81c88a0503dd14632a5acf3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d7d196fb51b37a91a3d4d904ca1ceb852df3543d)

FIX: Report TSA

Change-Id: Ieb29a1e213a5f8aa74054da57ceb15925fe4dee3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e59007133ffb0a6f38badf11fcb5d9cd2dc8da25)

CSIT-1208: Add new data to 1807 report

Change-Id: Id9a3dbc4dfa5213d527ecbea35a4a6a66b25c723
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1e000ed7785445d96588ab302b154c563d5d9331)

Report 1807 - Functional overview

Change-Id: I1c3254c10dd699f1288fc753cbfb09bbb1bc24f7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 396584e64f6127d5841222d55d0520ae1cc6a077)

HC Tests: remove trusty from download_hc_*.sh scripts

Ubuntu 14.04 packages are not being published since 1710.

Change-Id: I1372fe0eb4eab3c6c3e0f3a7ee435104f3c6f0fb
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

HC Tests: do not use vpp-dbg in CSIT tests

Honeycomb package does not require VPP debug symbols
and typical HC user does not have them installed.

Change-Id: I2cae502cad3216304d6f7ee44913f30c97fb5a20
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

PAL: Remove unused code

Change-Id: I14f8f4ed12071f1c6b2c57c55b1add24c56619cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f4b2f3a853b246513e7517217b7efafbf70ccac7)

CSIT-1208: Add new data to 1807 report

Change-Id: I514de6e4ac321900090a7f7ce9af60d23acd43ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 459d0af9c92134c5320e0f410b961c27f431f71f)

FIX: check IF up state after setting MTU, not before

Change-Id: Ic7a78af96a371e49993f6cbac01267e4bbe0dc46
Signed-off-by: Jan Gelety <jgelety@cisco.com>

rls1807 report: functional test static content

Change-Id: Iac120c650b8667c589e387666c28732aa14872b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit fe1e04358e1a88d7e2c821da03f04a251583fff5)

FIX: Set MTU before configuring l2patch

This should reduce number of "link down" failures dramatically.
The exact mechanism is not clear, but l2xc suites do not fail that much.

Change-Id: Ie102d90a58561121695c9938679ce0d3ee6a874f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 2799f44db47f5481233ffb32ce6cc7dd111e2d09)

FIX: Report - DPDK static content

Change-Id: If233133bfaf01cb46979ee83b4704b2645a8b7e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit feb1b3034bff4498bb23267523b8443ac76ffb6f)

FIX: Report - plots

Change-Id: Ia791d310e5942e10d62011cb879101828dfe7454
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7d6039a40aeda7ad2bd531b393e24ae3c72e4210)

FIX: Revert l3fwd patching

For now this solution does not work on Haswells, need to find permanent
fix.

Change-Id: Id5323a078db3a8f14c009d6f66ee393c89d851ef
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update report doc for rls1807

Change-Id: I713fe9b4a1a2830d6267c1dfc9b0442bf08b8ab4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit ee1321d27bc39baab5bc2615834fd7392b79a160)

Update VPP_STABLE_VER files to use vpp 18.07 release build

Change-Id: Ifaa666d2333ec2a2aff4cbea81faadd0f40e1748
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1197: Add Comparison Across Testbeds to the Report

Change-Id: Ibf0c880926b87e781830d7b39438b5145144ef5b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ce1088d88744f2c040801c9852565d522b3feb68)

HC Tests: do not install vpp-dev in hc2vpp-csit-verify

The download_hc_build_pkgs.sh is used by
hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs.
These jobs download latest VPP packages
and unlike other HC CSIT jobs, build hc2vpp.

This patch removes vpp-dev/vpp-devel packages
from the list of installed VPP packages
to unify the environment with the other HC CSIT jobs.

Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

CSIT-1219: Update job definitions in conf.py

Change-Id: Ib7e76f43a8ef2d4729962ff5856c987747b0b953
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit da39bb7cabae2ded535a974901a59d6191063c79)

FIX: LXC container creation on Ubuntu Bionic

Do not mount whole /dev into container as it can steal the PTS (tty).
Currently mounting only /dev/bus for pci devices and /dev/vfio

Change-Id: Ie829d35db81317bcd081257453ede7cbec2a302e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 2e42562fb9948e8bfa55cee1a0e5d77157ff2e18)

Revert MTU sequence to apply oafter interface UP

Change-Id: I8820350809ab63787a9e4a48b2db2c85320e7b11
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit c05d97223e4b69a5fab1d9f47421283c70440d38)

FIX: Interface up handling

- Increase timeout when trying to check interface (this is useful if
there are multiple interfaces and dump command take more than
TIMEOUT/NR_IF which is happening quite often).
- Reverse the order of applying MTU and interface UP to try to prevent
API overload during interface initialization phase.

Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1213: Add 2n/3n-skx to Test Oper Data

Change-Id: I217cc8dc6691c2a443460bd4e51ea96c4ec82806
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c7b2541ae5ff737691547daef2e4b25f9d232eba)

CSIT-1212: Add 2n/3n-skx to Test Configuration

Change-Id: I4be3e2072dbc1f1f27b840de1c04a2374944f724
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit dd1a88208be79852a99dc673411fe1ab0760a051)

CSIT-1211: Add 2n/3n-skx to detailed results

Change-Id: Ibfe838b355fa15d0f89ea3122f2d042af989b51d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 16ee14dd9116563422d379c18c9a2ca8e64a07a8)

rls1807 report: fixing cross-references to tested_logical_ and tested_physical_topologies.

Change-Id: I3273d9867abad193da361513791da2a915b9d76d
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2610ac288d0bbcd30d3a28c92068fb647034172b)

CSIT-1097: Edit dpdk suites for new rate and jumbo

Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 11abbc5f27ec2d2036a36e0e427afb9e2d5ffe59)

CSIT-1203: Add parsing of NDRPDR test

Change-Id: I55be02df7f8979ad4c10b79d87f5065452a3e6e6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb5271b56cb94711420a1eb7372b0f4d5f275a40)

rls1807 report: added section physical_testbeds.rst.

Change-Id: Ic3a5a598b27614dda8f464d3fdfddb2ad0e6a163
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit be3c126b04b89c1cacdfda2d82bad6e002d5135d)

CSIT-1065 High failure rate with K8s/Ligato orchestration

- Update Ligato Bootstrap for latest changes
- Update Ligato Test cases for latest vpp-agent changes
- Convert TC to new format
- Add Hyperthreading support

Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1bb5beef46104f8b5bfb844ace3633ed40fc3915)

HC Tests: remove vpp-dpdk-dkms dependency

The vpp-dpdk-dkms is not needed for current VPP versions.

Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

rls1807 report: moved and updated performance methodology section.

Change-Id: Ie67822c6c26cd42f548de542ef8a96d0a2d97f1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 064f852eeab1b0341c374586a847729c6980ffbc)

rls1807 report: moved and renamed s/mdr_search/mlr_search/.

Change-Id: Ifb97cb74c7f16592aa82dc2b1601407720985bc8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit dab4b820603978813ab931ac91cf1bee9d8b20a7)

Add MTU handling into perf tests

- Add ability to configure MTU on interfaces. Put the MTU into configuration
keywors for all perf testcases.

Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit cdf557ef070d004617ede4fc5a47dd6064d1c946)

rls1807 report: added section logical topologies in ../vpp_performance_tests/overview.rst.

Change-Id: Ied5a5caf95baddf8210b773002a8a3e5dc971a2d
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 974d52d1976f802c99738712bbfe56e16d56d650)

Fail bootstrap immediately if no topology found

Zero topologies might be found
if testbeds of some type are all unavailable,
or when purposedly restricted Change
is verified with a wrong trigger incantation.

The previous behavior enters an infinite cycle instead.

Change-Id: I9764a79ed4df57c6c99746438431bf1162b7f7ea
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit faadf83599b8640c9235c38a4ab57c7adfb9eb96)

Update VPP paths and versions

Change-Id: I8c5dae13beb58e15600f89719dcc1ec60a9e3601
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1097: Migrate L2 to NDRPDR and edit MRR

Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 5d6479beed22bb3d14a39e9c130946959c13f03e)

CSIT-1202: Unify min_rate

20000 is the bi-directional value,
suites should use 10000.

Change-Id: I61d6e83f4f6b8f1f9b3dc9457896997f686a2b66
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit c557187e2bcb86e610382726c5c7c00bf7a0217c)

CSIT-1097: Unify max NIC bandwidth in ip4

Also, minor fix in ip6.

Change-Id: I3a23e49d2162e34a1d2a8671ae9f7e74b832315c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 491fea98425d47eb02a5581666815557c57ef935)

WORKAROUND: Remove broken SKX-TB out of pool

Currently T22 and T23 are faulty
Tracked in [FD.io Helpdesk #58059]

Change-Id: Ib8d474400a7e109a87573e33ca73946208bbb5de
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 83bba1edaebd4a9a9b9c752bc75db318660a117e)

initial CSIT-DMM test scripts

Change-Id: I77a965751010b85d21335932baa5345a095dc4f3
Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com>
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
(cherry picked from commit 374b35938abf48e742fb3438ae8ed1e9b47d84ce)

CSIT-1097: Migrate Vts suite to NDRPDR

Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 298d0a61d75cded31fc0f09d408e7b3e3f9ee4f7)

CSIT-1097: Migrate ip4 to NDRPDR and edit MRR

Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 74771ecb4e2742efd3ab40bb8dd9cf9ac1bb40c8)

CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRR

Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 1e2e2be1c90c83a6b9b4283f285bc89a5ece64ec)

CSIT-1204: Make new TC names backward compatible (trending)

Change-Id: I48976a21ed022f0f8d840903db4d2415be9365cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb9e73f37019420ff8387c204b6621e73195fd97)

CSIT-1097: Migrate ip4_tun to NDRPDR and edit MRR

Change-Id: I20fe137cfbbcea1e337fe6295818ea105953d006
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1097: Migrate memif to NDRPDR and edit MRR

Change-Id: I22db20ec688f1a879e82549aa7aa68dafdc71b6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1196: Add hsw/skx and 2n/3n to the report structure

Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: Increase timeout for VAT for longer API calls.

Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625
Signed-off-by: Peter Mikus <pmikus@cisco.com>

DRAFT: FD.io CSIT high-level development plan in .txt format.
Provided for reviews and reference, not for tracking.
Jira continuous to be used for CSIT work tracking.

Change-Id: I0945f0ab910f85f41d16ae402368430ef8351ee3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

CSIT-1097: Crypto NDRPDR and missing MRR suites

Change-Id: If40f9283ee889f85e85fad74a490252e812bbe02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1097: Ip6 NDRPDR and edited MRR suites

Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1201 Create L2patch perf tests

- XL710, XXV710, X710
- 2n, 3n
- all pkt.size groups
- ndrpdr, mrr

Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1186: Add MRR and NDRPDR ip6_tunnels tests

Remove the corresponding NDRPDRdisc tests.

Change-Id: Ib46f53e97f703db19bcbcb82c3db0a7f5bb61dbf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1165 Create DPDK tests for 2-node topology

Create DPDK tests for 2-node topology
- x710, xxv710 only
- l3fwd, testpmd
- standard pkt.size group

Change-Id: I2fbf6c38a427775da9b289faaa8fe1b8c03d5527
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1186: Add srv6 NDRPDR suites

Delete the corresponding ndrpdrdisc suites.

MRR suites are also edited,
to make them less different from NDRPDR suites.

Now, there is a script to re-generate testcases of selected suites.
For that, resources/libraries/python/autogen is created,
with Regenerator holding the most of script logic.

The script looks at files matching a glob expression,
reuses a "prolog", but overwites test cases with the default template
and hardcoded set of testcase arguments.

Also, handling of overhead size has been simplified,
using new keyword Get Max Rate And Jumbo And Handle Multi Seg.

Default value for search timeout is increased to 12 minutes
to make timeout failures less frequent.

Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~517-g635ec3b~b4653

- use new vpp ref build - centos7:
  18.07-rc0~517_g635ec3b~b4569

- use new dpdk version:
  18.05-vpp2

Change-Id: I5fe34ea3603de136f8fe28fb8313533349257801
Signed-off-by: Jan Gelety <jgelety@cisco.com>