Move reservation directory to TG node.

Testing has showed SSH access to DUT affects performance.
Downside: No support for non-Linux TGs.
Complication: After merge there might be conflicts with older jobs,
including jobs for other branches.

Change-Id: Icefddc5a9ca8f4d830460e53a82bb45231f7222e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit e4091a25520e8cf1c62254df74b7ccf57f2ce1c7)

Add Report history

Change-Id: I5c7e594bcce266d765d2a517adcbec8e88da7c48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b456176a07ae1a3721407693d75931db6b1cd14e)

Add known issues to report 18.07

Change-Id: Ide101c80e2ef13021f25096da6afd9e4364ee263
Signed-off-by: Tibor Frank <tifrank@cisco.com>

report 18.07: added 2 known issues identified in CSIT-18.07 for vpp performance.

Change-Id: I220084bb5b5fd4909c8f1e2bef60e98594958e45
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit cac2b4314f1f7eeabccdbeec542d510025b318b4)

CSIT-1245 - Wrong configuration of srv6proxy-ndrpdr-stat and srv6proxy-masq-ndrpdr TCs

Change-Id: If5a45b97c90f85f2f193d796adbddd329f2728cd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit c48e0498b402c7c8e912d5c67031b510aec2c007)

HC Report: update list of known issues

Current list was based on Jira,
which turned out to be outdated.

Change-Id: I216616cda766075b8b78f7c3f2f7a6775a622e23
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

HC Tests: reenable VxLaN GPE ipv6 tests

The issue is no longer present in VPP master branch (1810).

Change-Id: I64f4fa8544ace8dc3686db9a1a3f3897ba333c61
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

HC Tests: mark BGP v6 tests as critical

TC13 of BGP tests was marked as EXPECTED_FAILING
due to HONEYCOMB-403,
but the error does not occur on 1807 nor master for some time.

Change-Id: I3d8f4ee78fed699927fed05e8fa070cfa95b2166
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

report 18.07: fixed link mapping for generated report  pdf file.

Change-Id: I2e23fe3b6f03055beab536e6534dd43d229b7024
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit c68692bef76f16a9bfa7ca943773b39b9c87e380)

release 1807: fixed directory nesting for perf comparison files.

Change-Id: I14e1a53543ab3b03b3136920a67ab594a22167cf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6246cad1f8a4389633f3cef919d4a598f809c802)

report 18.07: bump report version to v1.0.

Change-Id: Id8d17666bd6cff45641f5d44c63db59603680a54
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 8a2abddeea3e6daa2e32de559616c4c22b968fb5)

report 18.07: final final editorial nit picking in v0.9.
Formatting and removing excessive white space in static content.

Change-Id: I7400f4ba6386b85b59b667db026558685ec0d1a1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 5a1f4570778a7511415d94e58cc2299d02b871cd)

report 18.07: Bump report version to v0.9.

Change-Id: Ic4f5520f69d0a97afe54aa8fed269812993d66f7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit ec497a5a8a47544147f130187f178de40b80e5c0)

report 18.07: draft v0.9 editorial nit-picking, take-2.

Change-Id: Id2a627b1e48275f505a3ea50004285516a47897e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit c232ccdd329a3e4544757244882cf1eb461c6954)

report 18.07: draft v0.9 editorial nit-picking.

Change-Id: I7fb9dff8f5ebce0ac03ef99c74b14b02638042ac
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 0546e1656070b734ec57a4d8f732392bcafee0df)

report 18.07: Bump report version to 0.8.

Change-Id: Ic5ac9733534fc0f67467c6ea47a4123e246a793a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 899b1fc9800b1ccc802a57812846be9911a4c6d0)

report 18.07: moved performance change/compare sections out of rls notes to separate sections for vpp and dpdk.

Change-Id: If620cd894ea906baf0391617e5440e34f7136c37
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 637eb126bb4ed30df61a293e03d36bd8ad5265e5)

report 18.07: updated known issues perf changes based on latest test data in report.

Change-Id: I070cdecb936f294da4798712c197795aa0a85d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 908bc54fd36b636382a6c76c351cb85483f80d8e)

report 18.07: reformatted known issues tables in rls notes sections.

Change-Id: I2e6c6910542ec06ffd68a95d66c427fe2589c833
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit ca0944a9746c9f6cbad696469861516b22b92a02)

Remove DPDK MRR changes section from report
Bump report version to 0.7

Change-Id: I77478e3b58daab25bdece1e67795cc911f470136
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 8fdf612a77a9c6d6888364d41b238dcad34ff554)

report 1807: updated known issues in vpp perf rls notes.

Change-Id: I340548173018d234f699b1125c886fcd9ae75347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit c9011da954e3af3550191610784b358f9ba6a9bf)

Add new data to 1807 report

Change-Id: Ic03c55a198f6deb0cae5c920d7937696dfa19c9e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 584753afee16262530495cc7556666af995ddaf4)

Bump report version to 0.6

Change-Id: I820288a7209b6c0017ee42f5087f0687679ab078
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 56778a99d5b370f3f1d61ae595fe2f39c5c00957)

report 1807: dpdk and vpp rls notes update, known issues.

Change-Id: I15372226eaac6d505793b1c87e2ff16c8e5e8928
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 966a5b95c5c24bf0bbbeca7e837743cb92d1144e)

Change report version to 0.5

Change-Id: I556a8e98d1725ed9465eca2721886869a3a1a39b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 0b752a7820087d5fec452d00c3bc42b8f1298501)

Add new data set into report

Change-Id: Ic280eed9e888524805e019679c8549c75c5981c0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit b9c6d9e28db4b57f1a1ca182ee3331717dc7ff34)

report 1807: list and table formatting fixes.

Change-Id: I1233e903a9590d12ae0cf0032e33a017fea07b3e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b8502d5ccf9030270fafe06fe860143b5f9b78d0)

report 1807: fixed index.html for introduction section.

Change-Id: Ie733827e20083b78ed75f1e70f7762dd8a963404
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9cdc72c8d2708e644c91996a084b7143fc1aa52a)

report 1807: editorial nit-picking in all graph sections.

Change-Id: Ib366f57fbe590faae3b13f96ab68fb528046f619
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 64d3c3f78b5150ad27c934eaa1785e8ee8111bf0)

report 1807: editorial nit-picking in all performance changes and comparison sections.

Change-Id: Ib0ea94894df1bd70cef83a97453662f0074e640f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f77b4557b82d5049c722cb7a52954ee96c7c15b0)

report 1807: editorial nit-picking and formatting all release_notes sections.

Change-Id: If4678dca08139febfbbcad929dfde322a7008ff9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9e00a9702f6b17ff85c597a0915ffb8b693e87ba)

report 1807: introduction section editorial nit-picking.

Change-Id: I15ebef40034ff9637e549b95c4d6e7f35bf2ad09
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit e253cf226e1595acecf42db1262e1cb179aae5e7)

Bump report version to final

Change-Id: Ie424687a126b2ee5ffcbc5a0774474a67cc0cf50
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 5cf543e186c7d04c4d2feaed5e5606539a4df9be)

1807 report: updated dpdk performance overview section.

Change-Id: I48e6e5b5750bcb4b3b7b6eb82c351bed1de08c73
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 14f5a52b235fc196952c85e127a57821e325d7bc)

1807 report: updated virtual topologies for all functional tests.

Change-Id: I3053c7a9733ca7c03df993698472ad8d031dba96
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit c2ce046f71f7de1f247be68513e3d4e10c8c2a04)

General report fixes

- Fix few typos, and other corrections

Change-Id: I03679231c01ad34c3b2773b52f1327d8c871b750
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 2c55fe4a2d74352090b64118858a3557e197aeee)

rls1807: updated environment sections for all functional tests.

Change-Id: I8f0a2a49ee6e75990ee4638543259c40d1fb5d67
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit ab0b18bf513bb292b5d24d2eb339c2dddfbcd955)

1807 report: added VTS description in vpp performance overview section.

Change-Id: I0ba70947d895404723864da2a8477c682741620f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9b23b0e91b666274974173a4c0d942de8a51b920)

CSIT-1208: Add new data to 1807 report

Change-Id: Iea304ffd65e4ddbac277274b96207a351cf004fc
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 27d7bdafcffe0eff093fc775e6721026c3af6227)

1807 report: added HW calibration sections to test_environment plus editing nits.

Change-Id: I66698ae70d1bbbde6992e5663bc64c30249f7f79
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 25a40550e90c036dddf17698103a9a3c34ff6799)

CSIT-1208: Add new data to 1807 report

Change-Id: If575d2dc0e8ddb81afe693c646a911e33559b67e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 7ae94f2578699fcb50544742d6c27b59edc74abb)

Revert "CSIT-1208: Add new data to 1807 report"

This reverts commit f461386e3caaac1a33f8fa3ad44fd63ca26f0f1a.

Change-Id: Ic5a30273fa8103cb1d5ba918cb55b0d897715380
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1208: Add new data to 1807 report

Change-Id: I96260f9d22d19db608b8b119efede60f69897d98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a0f10dad4aea6c8f8cb0a75c041dce626e39c3d2)

1807 report: removing unused svg files from introduction dir.

Change-Id: I1a4b10bd97e6a0e78aba7f99083f4459f47bfc88
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 80bb30bcef742b17b292f29ce330e0ceada15de5)

CSIT-1208: Add new data to 1807 report

Change-Id: I1c51fe8b37e5a849310418c85be3db8053d67cbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 08e4ac10c1a718c352ecafb8f472f62dfe7dfd24)

CSIT-1208: Add new data to 1807 report

Change-Id: I6f4c03c66a762b129c86a9d751d15f57e62f2ea9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8f5f344d59674ea4c158e8ff1528716276f5b071)

CSIT-1229: Add DMM to report

Change-Id: Ib3ea8c13371a29ea2b4661a8506190dcb15c8ced
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
(cherry picked from commit 468da48d3f3ced298ff8dccc76885157dff5cfe7)

CSIT-1208: Add new data to 1807 report

Change-Id: I103417283196940db841be2a254d5d6e8537938f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1ba065be541936a73ba9a9113165583a8bdf36c3)

FIX: Section names in introduction/overview

Change-Id: I05e4be8f92625d95bfcb01270453069f498e88b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 84897128303f29df234efa36c6f7e862cc3b49e3)

Report: remove column doc

Change-Id: Icef72f6e248b6489f3fe0dc33435f71fa51723aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb61b6f15d88dbf51ff72fb942cd85dacf4c34e7)

CSIT-1231: Cleanup CSIT RF Tags Descriptions

Change-Id: Ib57014bf2461518eadcd156b16f8ee26eeb86785
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fed4db2ae63df547f04fd2ba1607bc3014515f41)

CSIT-1232: Edit docs/report/nsh_sfc_functional_tests/overview.rst

Change-Id: I5c8c81a971e5e2abde59eb144d707eaea0bf1ea2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5c44d48479824a3b8609da0a70f7857aa44b893d)

CSIT-1233: Edit honeycomb_functional_tests/overview

Change-Id: Id0bd955be59a95909aab5067965c2cc7e2fee520
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2866efb065355a197d88df492278a4ea92cefbbb)

CSIT-1208: Add new data to 1807 report

Change-Id: I90b094efc869f04ece54aadc6e0c26eeb4ef8bdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1d5213b0ec7ed99b58d519f4127ad77a00ef5096)

Update 18.07 release notes

- Part I

Change-Id: Ic97cfce98c560c9e873935fc72489ff102f201f1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1230: Improve layout of pdf report

Change-Id: I833f3bab2f3729b9f2e64d7e6a7f21efa247c967
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c17435e48f65f36b2f934cbad9ef1dc56524dae4)

CSIT-1230: Improve layout of pdf report

Change-Id: I6d89dc4dacd8b60a29662754dd920c5cec9e1efa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 03f07968114e4a10f2373c67ea938b2384bd110f)

CSIT-1226: Fix bugs in pdf version

Change-Id: Ibdcc1d79db4079af49167c5696ba1c4edb3a40bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2fc7ba3b3b5dad5a211310d529c5a375dea8b946)

CSIT-1208: Add new data to 1807 report

Change-Id: I242b96ef4fafd53745ea1900ac63b95024dccb0b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5a2c06dc4e1d3395082b6afef657453cb5bab18d)

CSIT-1228: Add DMM source code documentation

Change-Id: I2689e2ad5ef4776b9ff4bd652ed7f141d9e55d74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8c34e2945809ce12dd2795bb4e76c2a6b30e1be7)

CSIT-1226: Fix bugs in pdf version

Change-Id: I9c7abca28f98a581a8efb390c6ccf4f8937a958b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 903cb9f7dd664c5bc87f3295dd600d6cb23bf8ca)

HC Tests: 18.07 report update

Change-Id: I2c3df89532f0e728c58b54c220d4fe8ab1297ba4
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

hc2vpp-csit-verify: use vpp packages based on vpp-version

The hc2vpp-csit-verify allows to run HC CSIT tests per hc2vpp patch.
The job should not use most recent vpp artifacts
for respective branch ('RELEASE'),
but version specified in the vpp-version file.

The vpp-version file is used by hc2vpp-integration job
to produce honeycomb package.

Change-Id: If2811a01256e8217de50d220082dbc204443b54a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

CSIT-1208: Add new data to 1807 report

Change-Id: I15b8ad91c9f64c8fe5170905a8c7566f55dfe5d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit dadb06ada83c7f25f9cf884d54d3a30fad979b29)

CSIT-1208: Add new data to 1807 report

Change-Id: Ia28a587409327b266af75477a6dc0c2d6ccb5a7c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 18570b75b0cf920177dfbb5688112239a633fa08)

Fix ommissions from recent Changes

+ Insert missing "Add worker threads"... keyword to udpsrcscale15 suite.
+ Add MRR for 40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1 suite.

Change-Id: I467e5469a1421caa25373ab91010bd4d824fb32f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit e96c1376b9b5fd2f6b67c7f90252c5897b4bb84d)

CSIT-1208: Add new data to 1807 report

Change-Id: Iab06ce9a98aa680b6e947ecbae144e2ac92b84e5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e4456dd443f86253ed23fc1a07d4618b8ad4b6e4)

CSIT-1208: Add new data to 1807 report

Change-Id: I93c6625d537bfef3e955e171db92e5a639ffc22e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b37edd789d18a621896b26a42048bd6929742e0a)

FIX: Increase Ligato MTU for Jumbo frame testing

Change-Id: I6d2cb7a10b5245cbf81c88a0503dd14632a5acf3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d7d196fb51b37a91a3d4d904ca1ceb852df3543d)

FIX: Report TSA

Change-Id: Ieb29a1e213a5f8aa74054da57ceb15925fe4dee3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e59007133ffb0a6f38badf11fcb5d9cd2dc8da25)

CSIT-1208: Add new data to 1807 report

Change-Id: Id9a3dbc4dfa5213d527ecbea35a4a6a66b25c723
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1e000ed7785445d96588ab302b154c563d5d9331)

Report 1807 - Functional overview

Change-Id: I1c3254c10dd699f1288fc753cbfb09bbb1bc24f7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 396584e64f6127d5841222d55d0520ae1cc6a077)

HC Tests: remove trusty from download_hc_*.sh scripts

Ubuntu 14.04 packages are not being published since 1710.

Change-Id: I1372fe0eb4eab3c6c3e0f3a7ee435104f3c6f0fb
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

HC Tests: do not use vpp-dbg in CSIT tests

Honeycomb package does not require VPP debug symbols
and typical HC user does not have them installed.

Change-Id: I2cae502cad3216304d6f7ee44913f30c97fb5a20
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

PAL: Remove unused code

Change-Id: I14f8f4ed12071f1c6b2c57c55b1add24c56619cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f4b2f3a853b246513e7517217b7efafbf70ccac7)

CSIT-1208: Add new data to 1807 report

Change-Id: I514de6e4ac321900090a7f7ce9af60d23acd43ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 459d0af9c92134c5320e0f410b961c27f431f71f)

FIX: check IF up state after setting MTU, not before

Change-Id: Ic7a78af96a371e49993f6cbac01267e4bbe0dc46
Signed-off-by: Jan Gelety <jgelety@cisco.com>

rls1807 report: functional test static content

Change-Id: Iac120c650b8667c589e387666c28732aa14872b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit fe1e04358e1a88d7e2c821da03f04a251583fff5)

FIX: Set MTU before configuring l2patch

This should reduce number of "link down" failures dramatically.
The exact mechanism is not clear, but l2xc suites do not fail that much.

Change-Id: Ie102d90a58561121695c9938679ce0d3ee6a874f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 2799f44db47f5481233ffb32ce6cc7dd111e2d09)

FIX: Report - DPDK static content

Change-Id: If233133bfaf01cb46979ee83b4704b2645a8b7e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit feb1b3034bff4498bb23267523b8443ac76ffb6f)

FIX: Report - plots

Change-Id: Ia791d310e5942e10d62011cb879101828dfe7454
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7d6039a40aeda7ad2bd531b393e24ae3c72e4210)

FIX: Revert l3fwd patching

For now this solution does not work on Haswells, need to find permanent
fix.

Change-Id: Id5323a078db3a8f14c009d6f66ee393c89d851ef
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update report doc for rls1807

Change-Id: I713fe9b4a1a2830d6267c1dfc9b0442bf08b8ab4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit ee1321d27bc39baab5bc2615834fd7392b79a160)

Update VPP_STABLE_VER files to use vpp 18.07 release build

Change-Id: Ifaa666d2333ec2a2aff4cbea81faadd0f40e1748
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1197: Add Comparison Across Testbeds to the Report

Change-Id: Ibf0c880926b87e781830d7b39438b5145144ef5b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ce1088d88744f2c040801c9852565d522b3feb68)

HC Tests: do not install vpp-dev in hc2vpp-csit-verify

The download_hc_build_pkgs.sh is used by
hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs.
These jobs download latest VPP packages
and unlike other HC CSIT jobs, build hc2vpp.

This patch removes vpp-dev/vpp-devel packages
from the list of installed VPP packages
to unify the environment with the other HC CSIT jobs.

Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

CSIT-1219: Update job definitions in conf.py

Change-Id: Ib7e76f43a8ef2d4729962ff5856c987747b0b953
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit da39bb7cabae2ded535a974901a59d6191063c79)

FIX: LXC container creation on Ubuntu Bionic

Do not mount whole /dev into container as it can steal the PTS (tty).
Currently mounting only /dev/bus for pci devices and /dev/vfio

Change-Id: Ie829d35db81317bcd081257453ede7cbec2a302e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 2e42562fb9948e8bfa55cee1a0e5d77157ff2e18)

Revert MTU sequence to apply oafter interface UP

Change-Id: I8820350809ab63787a9e4a48b2db2c85320e7b11
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit c05d97223e4b69a5fab1d9f47421283c70440d38)

FIX: Interface up handling

- Increase timeout when trying to check interface (this is useful if
there are multiple interfaces and dump command take more than
TIMEOUT/NR_IF which is happening quite often).
- Reverse the order of applying MTU and interface UP to try to prevent
API overload during interface initialization phase.

Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1213: Add 2n/3n-skx to Test Oper Data

Change-Id: I217cc8dc6691c2a443460bd4e51ea96c4ec82806
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c7b2541ae5ff737691547daef2e4b25f9d232eba)

CSIT-1212: Add 2n/3n-skx to Test Configuration

Change-Id: I4be3e2072dbc1f1f27b840de1c04a2374944f724
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit dd1a88208be79852a99dc673411fe1ab0760a051)

CSIT-1211: Add 2n/3n-skx to detailed results

Change-Id: Ibfe838b355fa15d0f89ea3122f2d042af989b51d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 16ee14dd9116563422d379c18c9a2ca8e64a07a8)

rls1807 report: fixing cross-references to tested_logical_ and tested_physical_topologies.

Change-Id: I3273d9867abad193da361513791da2a915b9d76d
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2610ac288d0bbcd30d3a28c92068fb647034172b)

CSIT-1097: Edit dpdk suites for new rate and jumbo

Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 11abbc5f27ec2d2036a36e0e427afb9e2d5ffe59)

CSIT-1203: Add parsing of NDRPDR test

Change-Id: I55be02df7f8979ad4c10b79d87f5065452a3e6e6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb5271b56cb94711420a1eb7372b0f4d5f275a40)

rls1807 report: added section physical_testbeds.rst.

Change-Id: Ic3a5a598b27614dda8f464d3fdfddb2ad0e6a163
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit be3c126b04b89c1cacdfda2d82bad6e002d5135d)

CSIT-1065 High failure rate with K8s/Ligato orchestration

- Update Ligato Bootstrap for latest changes
- Update Ligato Test cases for latest vpp-agent changes
- Convert TC to new format
- Add Hyperthreading support

Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1bb5beef46104f8b5bfb844ace3633ed40fc3915)

HC Tests: remove vpp-dpdk-dkms dependency

The vpp-dpdk-dkms is not needed for current VPP versions.

Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

rls1807 report: moved and updated performance methodology section.

Change-Id: Ie67822c6c26cd42f548de542ef8a96d0a2d97f1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 064f852eeab1b0341c374586a847729c6980ffbc)