Add 78B tests to MRR trending daily

Change-Id: I73b9c505dcd28361978a075bc81db3112e308b9c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a1826160461e864060705202646cfc50f2e24015)

CSIT-998: MRR tests

 - CSIT-1001: MRR tests: IP4
   - ip4
     - 10ge2p1x520-ethip4-ip4base-copwhtlistbase-mrr.robot
     - 10ge2p1x520-ethip4-ip4base-iacldstbase-mrr.robot
     - 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-mrr.robot
     - 10ge2p1x520-ethip4-ip4scale200k-mrr.robot
     - 10ge2p1x520-ethip4-ip4scale20k-mrr.robot
     - 10ge2p1x520-ethip4-ip4scale2m-mrr.robot
     - 10ge2p1x520-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot
     - 10ge2p1x520-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot
     - 10ge2p1x520-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot
     - 10ge2p1x520-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot
     - 10ge2p1x520-ethip4udp-ip4base-nat44-mrr.robot
     - 10ge2p1x520-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot
     - 40ge2p1xl710-ethip4-ip4base-mrr.robot
   - ip4_tunnels
     - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-mrr.robot
     - 10ge2p1x520-ethip4vxlan-l2xcbase-mrr.robot
     - 10ge2p1x520-ethip4lispip4-ip4base-mrr.robot

Change-Id: Ibfd03aea9b97d29a8fa05e2956f6df54603a2208
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-935: Add mrr 9000B and 4t4c tests

CSIT-1002: container_memif
 - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
 - 10ge2p1x520-eth-l2xcbase-eth-2memif-1dcr-mrr.robot
 - 10ge2p1x520-eth-l2xcbase-eth-2memif-1lxc-mrr.robot
 - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
 - 40ge2p1xl710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot
CSIT-1003: vm vhost
 - 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
 - 10ge2p1x520-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
 - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
 - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot
 - 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot
 - 10ge2p1x520-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
 - 10ge2p1x520-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot
 - 10ge2p1x520-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot
 - 10ge2p1x520-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot
 - 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot
 - 10ge2p1x520-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot
 - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
 - 40ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
 - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
 - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot

Change-Id: Idd049db6134179f0f9ed603569ec8512faca1ab9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c9c2cb7ee2dfc00a280b25dcfd855a39ccfdc158)
(cherry picked from commit 88579f641831cbe365038f146c588cd5cd8d6b2a)

Add vhost and memif MRR suite

Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-998: MRR tests

 - CSIT-999: MRR tests: L2
   - 10ge2p1x520-eth-l2xcbase-mrr.robot
   - 10ge2p1x520-eth-l2bdbasemaclrn-mrr.robot
   - 10ge2p1x520-dot1q-l2bdbasemaclrn-mrr.robot
   - 10ge2p1x520-dot1q-l2xcbase-mrr.robot
   - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot
   - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot
   - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot
   - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot
   - 10ge2p1x520-eth-l2bdscale100kmaclrn-mrr.robot
   - 10ge2p1x520-eth-l2bdscale10kmaclrn-mrr.robot
   - 10ge2p1x520-eth-l2bdscale1mmaclrn-mrr.robot
   - 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot
   - 40ge2p1xl710-eth-l2bdbasemaclrn-mrr.robot
   - 40ge2p1xl710-eth-l2xcbase-mrr.robot
 - CSIT-1000: MRR tests: IPv6
   ─ 10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot
   - 10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot
   ─ 10ge2p1x520-ethip6-ip6scale200k-mrr.robot
   ─ 10ge2p1x520-ethip6-ip6scale20k-mrr.robot
   ─ 10ge2p1x520-ethip6-ip6scale2m-mrr.robot
   ─ 40ge2p1xl710-ethip6-ip6base-mrr.robot

Change-Id: Ie42b08151b5da3ba32b972af8b6bedf313c6d29c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit aefed05ca7fa9bdbbd2dbc5f2a179912db67cfd4)
(cherry picked from commit 2859297d100f90ab60092468d05d5a00d4c2e262)

FIX: MRR IPv6 tags

Change-Id: I2ca83b4405cd537671bf16fc57500be91455eadc
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit a4845b4c0419aa8785926b50d8d6c28f2e015e09)
(cherry picked from commit c1d1f59a15b066a3ddcf80bba33ad69b1fcef430)

Raw results chk keywords and initial TC

- Implementation of Display raw results
- Implementation of Traffic should pass with maximum rate
- Code optimizations
- L2BD, L2XC, IP4, IP6 TC

Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Report: Fix packet_throughput_graphs/ip4

Change-Id: I3943d02dcca95ed31baaa104648589c42ef479a7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Adapt hc2vpp-csit bootstrap scripts to HC2VPP-285/CIMANAGE-22

Since

https://gerrit.fd.io/r/#/c/10668/
and
https://gerrit.fd.io/r/#/c/10669/

honeycomb packages from stable branches
no longer depend on single VPP version.

This patch updates download_hc_pkgs.hc script,
used by hc2vpp-csit jobs, to use the latest honeycomb package
in such case.

Change-Id: If5b006e72caa8cc905137b1bf02af7d9e927e37a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

CSIT-891: Add data sources for 1801 report

Change-Id: I0379d0e62e4ae3065fc8181e6d7140bd81858d7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1ef49b2e3ab7a08cbe17ae89f3e3e48fd14aee27)

CSIT-891: Add data sources for 1801 report

Change-Id: I75fc2e4497d9cc57417c9205768c11d19403c9c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit dac9e69ccffb7ba77808ab8cf733524f93855f40)

CSIT-891: Add data sources for 1801 report

Change-Id: I1f5f7e931cdbd4eb9ede9b2cc527d975c63684ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 394659ca1c7cac87627347bc850477448d0743c7)

CSIT-891: Add data sources for 1801 report

Change-Id: Id178e852e4c94b1e093d72901689a7f7820c2c3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 55f514061b2da3dd71e13e0a0c5a89797a2773ec)

CSIT-891: Add data sources for 1801 report

Change-Id: I4c22c9e82bb746917198e345409eea3e0e322bbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a576a8096e610a56c098355a567e1a669692d056)

CSIT-891: Add data sources for 1801 report

Change-Id: Ia798986b14330c7e70d65d6123292a7eed6e3d7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e26807800bb2e5aa2bcbdc2b6f7acfa31e19b24d)

rls1801: updated known issues in rls notes for vpp performance.

Change-Id: I8f4a08933dc27db8f4f2134cdd9ddadbcd790577
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 5ad08ca51034048ab1965f993b2dde966ef934c8)

CSIT-891: Add data sources for 1801 report

Change-Id: Ifd1bcbf376e9eff9afbb578d88df377ba301cafa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3c5428b13bdf28774922b3abe370f23e3ccc5ead)

CSIT-891: Add data sources for 1801 report

Change-Id: I86f5bcbe4c5cd12ddccba5ae6f4df73c139a359c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c9d1aec367e6a6aa8cb0105d24eb828e4c9929b8)

Update report section with VPP startup conf

Change-Id: I074b557cb8dcd6013c388eed7548e170644a89d0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 2af84e23b731d99231949cfef3b3d496fdb69522)

CSIT-891: Add data sources for 1801 report

Change-Id: Id8a90708bf51e5c1df7bc91d3947e023d23b842a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 65ad0cb3bc0b2430628b2b250d51c41a8dc594c6)

rls1801 report: edits to static content for vpp and dpdk perf sections.

Change-Id: I22a38d2704b3a414798823c1846ff12f8f69d7b7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit cddac498bafc7a6092dade5e183e5c7a95cff64d)

CSIT-891: Add data sources for 1801 report

Change-Id: Ia1a1187c468d0fb57ee6160e633adb38512f0ad7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ec52d31c064fff2a6bf9c1e0716efa881bcf106e)

CSIT-891: Add data sources for 1801 report

Change-Id: I507878dba5eea9eff70336143cdcdd735b631898
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e15553412cfcc2b14ee3be0e30d1ca3bd146b32a)

CSIT-891: Add data sources for 1801 report

Change-Id: I632af9dafbadd12091c9063b098bb2db742780ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d23edad8b0f9a2463f5817a52766eebfdc5aa572)

CSIT-891: Add data sources for 1801 report

Change-Id: I2fd8fff455f419ef32a3562e77202278094482b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f1583b9230d23cae435baed107aed6f94c9095b6)

FIX: Ligato tests

- update binary search
- update VPP agent ver

Change-Id: If93346f43fabc8afac28b1dcfa5c44433d53a1a4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-932: Remove outliers form statistical calculations

Change-Id: Ibd90931bdc3dd8615fe2c975935c8a54fe85e6c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3cb49d761fa32c84ea7b6b9ba9d6c874dff2921a)

CSIT-932: Remove outliers form statistical calculations

Change-Id: If9b8eaa4d997ad3516c27befb4a868a948567482
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 79bcdf2e3321ca46c07e6b49a77ce1cf5b513956)

CSIT-932: Remove outliers form statistical calculations

Change-Id: I95934c92b2ebc77e5e3e7696d318ee8416f848e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a0918a2c7112621563f14ba06a7aee3eaa3ac711)

CSIT-932: Remove outliers form statistical calculations

Change-Id: I80d412e01eef364dfd76c1961a754e787f6ca7f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2036f500644bf34aebfd3456278d0efd0b9ab79f)

CSIT-891: Add data sources for 1801 report

Change-Id: Icda3dd888016a7074902ec6690cc7e874f46df2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1eb21dcbe8251be7c6633f67a2747abc62a46472)

CSIT-891: Add data sources for 1801 report

Change-Id: Iaf362be95b882b23fdaf478260e058b0495bbf5d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cfa3d9b1808826d1855bcf6c556cd26190e6f43a)

CSIT-891: Add data sources for 1801 report

Change-Id: I30b48ea252d11677d74daba2516a9ffbcd39bd94
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 555d383a9e92572483c8a27a0b580c09e7fa607f)

Fix typo in container doc ref label

Change-Id: I0cd7ad0a1cc4d990d739a80bd3e611ec92d8166e
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit 968b6ce89e79b9b29d30a4ab361ec277668ab888)

CSIT-891: Add data sources for 1801 report

Change-Id: I293e0df53a03fd18905ba59258fa66afa1299058
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 47f365e68a4392d6aed7b245e0c5c4b77270473f)

CSIT-891: Add data sources for 1801 report

Change-Id: Icd9a1c7bf821c54d0297ad52dabdfb345730ddc6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4185e3a96ea805ed7d2b287c21eb160bff6ef856)

CSIT-891: Add data sources for 1801 reportCSIT-891: Add data sources for 1801 reportCSIT-891: Add data sources for 1801 reportCSIT-891: Add data sources for 1801 report

Change-Id: I6334705f14c3515c0907b28abf468eef517a7dfa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 90211327a520e31b31785870fe00badb0301d00e)

FIX: 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot

- tc17-9000B-4t4c-eth-l2bdscale100kmaclrn-ndrdisc

Change-Id: I605f4903deb07f3a29944348cb32ac0a6747cb09
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 350ae2fee52b9d1963d4456564e73d22ce9c4cd5)

CSIT-891: Add data sources for 1801 report

Change-Id: I3a7ec5d40756b2179426cf031e88a0e01c2833cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0da2c5e0d0bd852d50d4f9c4ecdd13d0c4effb5a)

CSIT-891: Add data sources for 1801 report

Change-Id: Ib5d2fce665fbc421affde4fe1500ca8cf02613f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d9bafbe42e9ca8e3b16bdab2be1583a0d81ba63c)

CSIT-891: Add data sources for 1801 report

Change-Id: I1403ec2e72f2369c39033cbf3e54070d3e854bae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 289ba96be9ecf33495e669cf09e1bd9eda8dd7cb)

CSIT-891: Add data sources for 1801 report

Change-Id: I239a95dddcf2946a289fc4e91071fdbd6cc6573c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5ff648bac50bb669bd6f483f9515dbe78cdd42a7)

CSIT-891: Add data sources for 1801 report

Change-Id: Ie47f696401ec4286ff875d7dc291251e505d0a46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 699e20c6f043c39cf1d2ab215aae18d961de8bbe)

CSIT-891: Add data sources for 1801 report

Change-Id: I269a26c67b9e567007909438c221c58312458e61
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3cca71c6377e2c2405510127fc05c28a16e1d8d0)

Use vpp 18.01.1 release builds

Change-Id: I9616a92b9386048243e0326dcccfc37bf2d03433
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-891: Add data sources for 1801 report

Change-Id: I208ac7a2637181a0e8594845901037d31c09e602
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0a128f671f04b19b0cad453597fec82288a657b2)

CSIT-891: Add data sources for 1801 report

Change-Id: Id7b5bfef12be00dab4434a1c999c7382985b0d57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 52eabb71d784978afa48f7ac2f5d53a228b256ec)

CSIT-891: Add data sources for 1801 report

Change-Id: Ic54ad8fc093ee37d3f972fd220d63e3b20915e28
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3b4e1e9b779fd3865714681cc224226b5804c546)

CSIT-891: Add data sources for 1801 report

Change-Id: I8c37cff547c74399fde074b11972e2fb95bfac15
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9cb67fce6a738374020ad95eea93c05b9439900b)

CSIT-891: Add data sources for 1801 report

Change-Id: I320737f2edbf74caa8f12177dcc7186a88920a9a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6addc914c636a0dbc1e12a661019cce1715baf77)

FIX: Missing KW in suite setup

Change-Id: I278cb8a5381735694bad73031e534b080414305b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit fd987b10941ca09a54cf0325c2b097b734bdbc94)

Disable all plugins except DPDK by default

- enable corresponding plugin for ACL, NAT, MEMIF tests

Change-Id: Ie8bfdcbf1734283b6412ef3015215a00ce3ebdf6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit e6bbba641dfe38cf14155aa96576059ade64773c)

Update the binary steps for perf test cases.

- Reduce binary step fof:
64B -> 50Kpps
1518B -> 50Kpps
9000B -> 10Kpps
IMIX -> 50Kpps

Change-Id: Id88bff7b1c37b2a03583dd27ca3db720ec7ae4a2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit cd9235056d6ec7ed21d46027964e945b21710886)

rls18.01.1 report: updated make test unittest content.

Change-Id: Ic57148795df2459010f908b196acfc8de7c7b50f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 5cd30be240b965c17e84b3441ead277eaed6a8c7)

CSIT-907: process wrk results in PAL

 - CSIT-908: LLD
 - CSIT-909: Data model
 - CSIT-910: Algorithm
 - CSIT-911: Static content

Change-Id: I26b33c2a7e0f320f62c78871576ca400a83b307c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b1589042d816ce58648153c20906520916feff49)

HC CSIT Report: update Test Environment section

Change-Id: Ia2fcbb50e5ac7d90756ae9466a1efb2e6b6d337b
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
(cherry picked from commit c3550796453ef56884755e302aa5e428f7ec8dad)

HC CSIT Report: update Overview section

Change-Id: Ic12c5e456135e0b77b40be1f9194a7ee06a63560
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
(cherry picked from commit 748a0bf24b872e15c94bd97acb80d723b1daf3c8)

Add no-tx-checksum-offload to startup.conf in case of perf tests

Change-Id: I8de8f4f313befec23d6828c3b340c5042928ea1a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report: add source data

Change-Id: I471eb0d703f47d81b32ce0d1eb4f8cc6eb8d15ea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2cf48780a763a774c2b0f4173a3b7c82bbd09158)

Report: Performance improvements

Change-Id: Id320600dd505a61c67ca0eb93917f8f9c2b1acb6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ed69178aaddaba42d67c9def3deb8bad12129028)

Report: Performance improvements

Change-Id: Ib399f783ce6b85c35d8252d00d42d4d1493f2e35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 62d29c3e6945d0bf3c088f12fc215c168d75868e)

Report: Meltdown/Spectre disabled

Change-Id: Ia69fb79e9c182c71972ea4e530990d40f3dcb0e8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f2981bad427e56e55686c971fbfb29bb7455a2a5)

Report: Meltdown/spectre

Change-Id: Iad8170952983626c414c6b08bbc13d5ed652590a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 37a3c919c9610db9e0b9b5ec5e63c7bf71950d78)

Report: meltdown/spectre

Change-Id: Idf5369068037569ad15c4736802be9a7b5f4de84
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 11073106037e42ec87cadb855b6a2b7bf8b91b44)

rls1801 report: added TCP/IP test methodology, other minor edits of static content.

Change-Id: I8a94b6fc89fb4d182ece51425cca2ac429d73b5c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 516eb1c7840e037f53b02a8936c1e0fedeecd20a)

rls1801 report: meltdown and spectremeltdown static content edits.

Change-Id: Ia81a2fc86884a5c13deabce9b7e68b57d307ef5c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 1701c0a9db9cc57423e5d1a9009788d0a707ecd6)

Report: remove memif tests from L2 static content

Change-Id: Id9e9516c53eb26cf4d0cf7c644fc488b7b488b2f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ea195d1dd99a65736956c9b97e79ba0367b6206b)

Report: Meltdown/Spectre

Change-Id: I2476ccde3e8d8d5c26a77dcaf2f64303a9a39738
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 936e3c5f192cac6666f1f60919c990648ebeb80b)

Report: remove MEMIF tests from L2 plots

Change-Id: Id04708e2bd45461a92a4453adbc390b100b2603e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2e387760e5bac9635fce3de41f7008df6acdbb7a)

Report: PAL fixes

Change-Id: Ie7762343de4db66c442e45830030608c38d1ebf1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4ade202fbf0b8978cd7d348507c14eda28ae76ad)

Report: Source data

Change-Id: Iba9b91974aa030727669e28c5abb22c36c488353
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7e12e617468322c8b9d170c0c2b2d132e131431)

Report: Meltdown/spectre

Change-Id: I1342d96e44f432c7957af14b1e34a8cfe700d2a1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d726485430b477b19eaa4b407f89ab903e4cce05)

Report: Meltdown, spectre

Change-Id: I84828605e47ad729391cff4f82a8e3f33df592c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb201cfc23dd164f9b01918909313d5eabcb88e1)

Report: Source data

Change-Id: I45ea394bed08a57c519654e5ab6b0aba73f17088
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 97e479f0aaf5fd0ca3f72eb36ba822c0e94eb42c)

Report: Source data

Change-Id: Ic8951568eb02b8eb998638f76503f87ea8e4929b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 49033c34ed62a40d280724414ff5be1c12edc5b7)

Report: source data

Change-Id: Ibc928740a816fe56d6c7eeab95de67e5ebae9cf4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c3a9866686d251ef6c1b20a785d81ad3e7400528)

Report: Source data

Change-Id: I4d8ed8b7c93942f1e798e6ff26e5d295f1d2369d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d96d0862a69b1f2c5ee8484e5b883268d49bef40)

Report: source data

Change-Id: I1bbdc7e13287ff3bf3c0adbf5851f246bc8a292c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 986d064738e273bbb53856dbdfacc88f5bdfc134)

Source data

Change-Id: I2d22cde8d97aef58e1d649629d57ee48ecc4b57a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2db5cfe7d2ba920f695073e9381972c3cfbff2d9)

CSIT-891: Add data sources for 1801 Report

DO NOT MERGE: Some of the source data specifications are disabled,
              report will not be successfully generated.

 - csit-dpdk-perf-1801-all
 - csit-vpp-perf-1801-all
 - csit-ligato-perf-1801-all
 - csit-vpp-functional-1801-ubuntu1604-virl
 - csit-nsh_sfc-verify-func-1801-ubuntu1604-virl
 - csit-hc2vpp-verify-func-1801-ubuntu1604

 - update element's models

Change-Id: Id890aed33bad04653ae788bf272d0db9b28628d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6761bca0d1ea1e6004055895769aeca9a56253d1)

CSIT-907: Process wrk results in PAL

 - CSIT-911: Static content

Change-Id: I56a1edc78ef578e432948cddb57571e0f647e5e1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c48a47fad14d557b3f59bd513fb92d4af65c4590)

Correct typos

Change-Id: Iaf3546dcbf980625149302000a1c4a3fad296642
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c01120c62b3d3649a5c7e6962c077b88c5512622)

CSIT 1801 report update

- func csit release notes
- func test environment
- perf csit release notes

Change-Id: I2cfd56585c646bc4553fe80afd8208dd7a01be30
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 93907196951677ebaa47b9a384eee118cc2fad45)

CSIT-902: Compare performance results before/after meltdown/spectre

 - CSIT-903: LLD
 - CSIT-904: Data model
 - CSIT-905: Algorithm
 - CSIT-906: Static content

Change-Id: Ia7b77fc35ab852110c2f50efb7756ac15576749a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 0f6410d3c95eb28164fdd349778155c6525e1a79)

rls1801 report - static content edits - vpp performance.

Change-Id: I51d1741cc75a411dee78bc7907f553a65c5970ce
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f4cd1c230a2328fd647fd88da5d9149fbad556e3)

Use vpp 18.01 release build

Change-Id: I5687aa2393d4b842a514520256ee721d7c08ca11
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-901: Throughput Speedup Analysis - Static content

 - Add robustnes to the function which generates the plots
 - Add "Model for TSA" to LLD.

Change-Id: I78dffe3622b4566b30ecac411f8ff285689d1427
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b4b7fac76d29cc780b3ccd865379ad2ed38c0586)

FIX: Ignore removing dangling images if there aren't any

Change-Id: I0be23e67cfdc54169b9787e90eede28b32406c8b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Set IPFIX IPv6 test TC01 non-critical

- TC01: DUT reports packet flow for traffic by source address

Change-Id: I80a8192abda1ee440f879ae68af1e796a05b0c23
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 7dd7b797460428447d12c7b75815478dcf306f2e)

FIX: Set pkt_variable in init file of dpdk and ligato perf tests

Change-Id: I6b63ce03adc28dcab68f6791eae5158ab4305740
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-887: Throughput Speedup Analysis

 - CSIT-894: LLD
 - CSIT-900: Plot layout
 - CSIT 888: Data model
 - CSIT-889: Algorithm

Change-Id: I569107b474d216533568c1c731c50dcf7b706cd4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0f06aa38489e4242ee2b51bc23f79682a8f658f9)

CSIT-675: SRv6 performance tests

- update L1 KWs
- update L2 KWs
- tests with one SID (no SRH insertion)
- tests with two SIDs (SRH inserted) and decapsulation
- tests with two SIDs (SRH inserted) without decapsulation

- enabled packet traces and logged packet traces in the test case
  tear down if test failed

Change-Id: I3a0f4c350eed3f42509c6d49e832faa78fe64dbb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 95998a67270ffd72f09ce6f3d43235c723edf36b)

Rename Ligato tests

- Rename Ligato tests
- Change l2bdbasemacstat to l2bdbasemaclrn

Change-Id: I8a24b04f1da285082ef6c3ac90c0be7f1d8588cc
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit e81d599029f31fb433089eecf0d160ab01719383)

Modify IPsec test trigger

Change-Id: Ide575762b5e7682e3558f2138dc9ae07adf559c1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 35c56dcebead5b61ccc087024ed89d1c2fd7feed)
(cherry picked from commit 42a62da7d76f5a5fad344017653163706fe1d450)

CSIT-898: WRK improvments

Change-Id: I92aafaaedce5891727a983b8cf024a0fb0db7524
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 54ad6efd342695d0a7dad5380cc989a8d846f518)

FIX: Kubernetes ch-eth-1drcl2bdbasemaclrn-eth-8memif-4drcl2xc topology

Change-Id: I0ebef733b57d7042dc4bdb4d44771939839ccec2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 5f153c5987d9774dc67063cb4aaff352ac785ba3)

FIX: Naming of test cases

- Fix naming of VM testcases

Change-Id: I1bf78f5f4ee60dd061a63280624ada9d73b34518
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 73aa556800ac7b4300c3a76c39868a3a87c41cd1)

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.01-rc2~2-gd8a998e~b22_amd64

- use new vpp ref build - centos7:
  18.01-rc2~2_gd8a998e~b22.x86_64

Change-Id: I0ba181cf2d6d55b6fe3f19cfc04271eacf9e7947
Signed-off-by: Jan Gelety <jgelety@cisco.com>

HC CSIT Report: update release notes

Change-Id: I0479b9f9328f87b43f4a0c77820419dec30afea6
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

HC Tests: re-enable L2-fib update revert case

Change-Id: Ida6bf3f0fff4941bfe5ee18ec29fa44aa3dafb4c
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>