csit.git
4 years agoReport: Comparison tables 26/21726/1
Tibor Frank [Tue, 3 Sep 2019 17:52:02 +0000 (17:52 +0000)]
Report: Comparison tables

Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 92d09115493a50599ed5bea9126be28229b4211f)

4 years agoReport: Comparison tables 14/21714/1
Tibor Frank [Tue, 3 Sep 2019 12:08:37 +0000 (14:08 +0200)]
Report: Comparison tables

Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ac688f80adb649bd04ecbe1daa79748a439a9e19)

4 years agoReport: add data 09/21709/1
Tibor Frank [Tue, 3 Sep 2019 09:07:36 +0000 (11:07 +0200)]
Report: add data

Change-Id: I51fd0b9e07d09224452f842689925d1166246f19
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 54b25e85bf3efd1709043ded2d6a525fa0c73962)

4 years agoCSIT-1590: Performance comparison analysis 03/21703/1
Tibor Frank [Tue, 3 Sep 2019 06:56:27 +0000 (08:56 +0200)]
CSIT-1590: Performance comparison analysis

Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 259620ea6ca1c5864d4864f0f04d260e89ecb72a)

4 years agoCSIT-1590: Performance comparison analysis 99/21699/1
Tibor Frank [Tue, 3 Sep 2019 06:45:31 +0000 (08:45 +0200)]
CSIT-1590: Performance comparison analysis

Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3e5dbfab796da168865ba787382224b1b04b83a4)

4 years agoPAL: list all sel tests in table_performance_comparison 86/21686/1
Tibor Frank [Mon, 2 Sep 2019 16:48:37 +0000 (18:48 +0200)]
PAL: list all sel tests in table_performance_comparison

Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ff3201774cf904bad6c64adf11f1fae92d5f8588)

4 years agoPAL: list all sel tests in table_performance_comparison_nic 82/21682/1
Tibor Frank [Mon, 2 Sep 2019 13:52:06 +0000 (15:52 +0200)]
PAL: list all sel tests in table_performance_comparison_nic

Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0a67083bea6b5e740c89fcc6c9143e0f035eadd1)

4 years agoReport: Add data 70/21670/1
Tibor Frank [Mon, 2 Sep 2019 13:11:20 +0000 (15:11 +0200)]
Report: Add data

Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6d981f513fba8cbec434f5c10f83081034372f20)

4 years agoAdd: Testpmd VM test 61/21661/1
Peter Mikus [Sun, 1 Sep 2019 05:51:07 +0000 (05:51 +0000)]
Add: Testpmd VM test

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id39667515e304f4d92f230f82d3f1dbc1e22ac32
(cherry picked from commit 8beb22fb0a13ccc69281bb4a68b62a733d1f20e2)

4 years agoReport: functional tests static content 43/21643/3
Jan Gelety [Mon, 26 Aug 2019 03:41:53 +0000 (05:41 +0200)]
Report: functional tests static content

Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 97881b4e0142f98bbb8e1d54828bbc3c1b34d4ac)

4 years agoReport: Add 3n-tsh 59/21659/1
Tibor Frank [Mon, 2 Sep 2019 10:32:32 +0000 (12:32 +0200)]
Report: Add 3n-tsh

Change-Id: I6027b635191c7e64397915df8944699bb320daf3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a7886e481f492d996643fad5ab48944f1cd4f725)

4 years agoReport: Add data 32/21632/1
Tibor Frank [Fri, 30 Aug 2019 09:55:42 +0000 (11:55 +0200)]
Report: Add data

Change-Id: Ie9350530879fef7d2ae8c0b58f6fd799fde9fff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 603931f00dab6e4375f1ca9dff9f5877c7ed5135)

4 years agopresentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model. 04/21604/1
Maciek Konstantynowicz [Wed, 28 Aug 2019 12:38:34 +0000 (13:38 +0100)]
presentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model.

Change-Id: I90dd569ce42fe6bf29751ca29086fe458d40a095
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 25827ae5d147343408da1eb1e74bef3e2c1a8812)

4 years agoReport: Add data 99/21599/1
Tibor Frank [Wed, 28 Aug 2019 19:09:21 +0000 (21:09 +0200)]
Report: Add data

Change-Id: I5ae5fa7cb40ddc31e3fe3fd0d6182bf54c84ad00
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a907de589b3f49368b81394b4faf6f4202c1f404)

4 years agoReport: Add data 91/21591/1
Jan Gelety [Mon, 26 Aug 2019 09:03:38 +0000 (11:03 +0200)]
Report: Add data

Change-Id: I66c91e083138b50a575cbbd32d309d0c198e6a71
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit f18bab9daaa9ac4108cc7bc04213db9051c96567)

4 years agodocs: created full list of tests for report detailed results. 87/21587/1
Maciek Konstantynowicz [Tue, 20 Aug 2019 16:07:21 +0000 (17:07 +0100)]
docs: created full list of tests for report detailed results.

Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 97ff6490bbd4656e15422576556aeba8aa799345)

4 years agodocs: created select list of tests for report and trending. 83/21583/1
Maciek Konstantynowicz [Tue, 20 Aug 2019 12:51:51 +0000 (13:51 +0100)]
docs: created select list of tests for report and trending.

Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 218572c4932c47f08cb0b64b5e493ac939ce73ae)

4 years agoNEW: Added trex profiles for 60k ip4 destinations. 79/21579/1
Ludovit Mikula [Tue, 27 Aug 2019 11:51:18 +0000 (11:51 +0000)]
NEW: Added trex profiles for 60k ip4 destinations.

Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ib9e42914ad5ab6bf0febea3edbeea8d09c8918b1
(cherry picked from commit e895f7fad03c2d805c3b16ee490b51cb304f49c0)

4 years agoDOC: 1908rls release notes for VPP Hoststack TCP performance tests. 78/21578/1
Dave Wallace [Tue, 27 Aug 2019 21:02:07 +0000 (17:02 -0400)]
DOC: 1908rls release notes for VPP Hoststack TCP performance tests.

Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit f4952736d2f356cd3423c55891e133536ddc9552)

4 years agodocs: added csit tests job specs. 64/21564/1
Maciek Konstantynowicz [Sun, 25 Aug 2019 20:11:02 +0000 (21:11 +0100)]
docs: added csit tests job specs.

Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a0465dc55b2f7edfa86e7803704bdb1415fd2b8e)

4 years agoReport: Add data 49/21549/1
Tibor Frank [Tue, 27 Aug 2019 09:46:48 +0000 (11:46 +0200)]
Report: Add data

Change-Id: I534cbb4141b60609387f894e51c429e368520a23
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 823e79aca6d19531f3abb080ab6510418f6af94d)

4 years ago- Removed 9000B test cases from ipsec test suites. 42/21542/1
Ludovit Mikula [Mon, 26 Aug 2019 11:39:39 +0000 (11:39 +0000)]
- Removed 9000B test cases from ipsec test suites.
- Added new traffic profiles.

Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e
(cherry picked from commit ac37499ef8754d7ac8f6350ab80d389727bbcd03)

4 years agoReport: Comp Tables 35/21535/1
Tibor Frank [Mon, 26 Aug 2019 15:13:25 +0000 (17:13 +0200)]
Report: Comp Tables

Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7186f868f6fd24f8727e088301c4411c2a8e8a8c)

4 years agoReport: tables 28/21528/1
Tibor Frank [Mon, 26 Aug 2019 13:46:29 +0000 (15:46 +0200)]
Report: tables

Change-Id: Ideec743ae10909d91625ea5cfc7901624459f455
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 479b30c17e28e30b7c2e01e616e96b67d6ac1779)

4 years agoReport: NFV 24/21524/1
Tibor Frank [Mon, 26 Aug 2019 13:29:04 +0000 (15:29 +0200)]
Report: NFV

Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 320f82cc987dbc6d9c4ab1632de1005ac4c0077f)

4 years agoReport: Tables 18/21518/1
Tibor Frank [Mon, 26 Aug 2019 12:32:48 +0000 (14:32 +0200)]
Report: Tables

Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit af4d3ba04cddbfb198af47b2d1d74c0655e35a08)

4 years agoReport: Modify comparison tables, add data 11/21511/1
Tibor Frank [Mon, 26 Aug 2019 11:40:39 +0000 (13:40 +0200)]
Report: Modify comparison tables, add data

Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit db49a120f90f59f5277a5c812544ea0ad1592eb8)

4 years agoFIX: Copy-paste typo in 2n-10ge2p1x710-eth-l2bd-6ch-48vh-24vm1t-vppip4-ndrpdr.robot 07/21507/1
Jan Gelety [Sun, 25 Aug 2019 12:05:34 +0000 (14:05 +0200)]
FIX: Copy-paste typo in 2n-10ge2p1x710-eth-l2bd-6ch-48vh-24vm1t-vppip4-ndrpdr.robot

Change-Id: Ibe231547e26d9b379554eec8ca6a9b4d7bc1224b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit d8271912d325ca9d4dc57f0d667c26b51f70e2fd)

4 years agoReport: Select tests by name, specifications 02/21502/1
Tibor Frank [Mon, 19 Aug 2019 13:25:47 +0000 (15:25 +0200)]
Report: Select tests by name, specifications

Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 33cfe1217cb2d6bc9655b01f200b0ec8d5ccb466)

4 years agoOper: TB31 back in operation 98/21498/2
Jan Gelety [Sun, 25 Aug 2019 08:23:27 +0000 (10:23 +0200)]
Oper: TB31 back in operation

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I8a65efa632bfb095cd9ed8716ea2496288a88d0d

4 years agoIntroduce reconfig suites, for dot1q+ip4+vxlan 89/21489/2
Vratko Polak [Fri, 23 Aug 2019 15:00:29 +0000 (17:00 +0200)]
Introduce reconfig suites, for dot1q+ip4+vxlan

Ticket: CSIT-1551

+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
 + Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
 - Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
 - Only 1 additional chain.
+ Proper TAGs. Documented.
 + Clarified min framesize tags are for TG-DUT.
  + Added a TODO concerning overhead values.
 + Added 118B tag.
+ Robot performance keywords improvements.
 + Added missing return value documentation.
 + Frame size as required test variable, not an explicit argument.
 + MLRsearch keyword to store result (not into test message).
  - TODO: De-duplicate: main keyword to measure, minor to set test message.
   - But implementation uses the fact default arguments are different.
 + Keywords for starting and stopping background traffic.
  - No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
 - Support also vlan_per_chain=True?
 - Support dot1q without vxlan?
 - Support also deletion?
 - How to package config steps so -reconf can be generated from -ndrpdr?

Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)

4 years agoImprove PLRsearch yet again 75/21475/1
Vratko Polak [Thu, 22 Aug 2019 13:04:34 +0000 (15:04 +0200)]
Improve PLRsearch yet again

Logic improvements for rls1908 and post-pylint fixes:

+ Reduce search time to 30 minutes.
+ Use average instead alternating loads.
+ Rework log/exp avg/stdev from two estimates.
+ Introduce and use pessimistic variance of dual trackers.
+ Introduce safe_exp to use when None does not skip code.
+ Use dot relative imports (instead of disabling pylint).
+ Complete docstrings for simpler functions.
+ Append docstrings to named tuples.
+ Somewhat unify docstrings related to the same arguments.
+ Slightly improve intentation.
+ State named tuples as rtype where used.
+ Add returns and rtype to __repr__ where missing.
+ Return what docstring say (or update them).
+ Explicit copying for vector and matrix values.

Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit fbbc47359e3f7b59bbd5a84d85c673374933a50a)

4 years agoFramework: Refactor complex functions in PLRSearch 74/21474/1
Miroslav Los [Fri, 16 Aug 2019 13:09:39 +0000 (15:09 +0200)]
Framework: Refactor complex functions in PLRSearch

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25
(cherry picked from commit 281b230ba982f9f6ad589fb6e44f121a6a46531f)

4 years agoReport: Specify groups of tests for graphs 73/21473/1
Tibor Frank [Tue, 20 Aug 2019 08:52:11 +0000 (10:52 +0200)]
Report: Specify groups of tests for graphs

Groups of tests for graphs:
- Packet Throughput
- Packet Latency
- Speedup Multi-Core

Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 719a84662ad1482f09224543c07053d27d7b94ea)

4 years agoUse vpp 19.08-release builds 47/21447/2
Jan Gelety [Wed, 21 Aug 2019 05:54:06 +0000 (07:54 +0200)]
Use vpp 19.08-release builds

- vpp repo updated to release branch
- vpp stable builds updated to 19.08-release

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I47cdb90d2a9714d49b84648b8e3979815e4d4439

4 years agoAdd: 2-node ip4 oacl tests 49/21449/1
Jan Gelety [Wed, 21 Aug 2019 06:26:09 +0000 (08:26 +0200)]
Add: 2-node ip4 oacl tests

Change-Id: I786fe9f75777e1cd0daee70bc350185dd7fd17e1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 01be3c2278c79d83ae36290868ab66f3741abc38)

4 years agoAutogen: Create NICs for TCP suites. 32/21432/1
Vratko Polak [Fri, 16 Aug 2019 13:48:02 +0000 (15:48 +0200)]
Autogen: Create NICs for TCP suites.

+ Put Regenerator internal functions ourside class.
+ Duplicate into _default_ and _tcp_ functions.
+ Rework Testcase to be a single class with two factories.
+ Improve suite and testcase naming.

Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ae7dc0011f376861ba9259b7cb5166777520799c)

4 years agoAdd: avf-dot1q testcases 28/21428/1
Peter Mikus [Tue, 20 Aug 2019 09:51:54 +0000 (09:51 +0000)]
Add: avf-dot1q testcases

+ Few fixes in doc
+ Align testcases

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f
(cherry picked from commit a0a1bdba6245c685898bab5007de28452bbd2d27)

4 years agoFix Initialize layer dot1q on node 26/21426/1
Vratko Polak [Tue, 20 Aug 2019 14:25:51 +0000 (16:25 +0200)]
Fix Initialize layer dot1q on node

By using Get Variable Value keyword.

Change-Id: I3a9650b6f802d60422ffa6b6b00d444ebb050d89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b6cd8aba14026ee89178714171d2890a2796ca31)

4 years agoAlign NF_denisty tests 01/21401/1
Peter Mikus [Mon, 19 Aug 2019 11:49:07 +0000 (11:49 +0000)]
Align NF_denisty tests

+ Apply layer approach for interfaces

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea
(cherry picked from commit 329e0acee1cf31c6524883e15560993af76f0fad)

4 years agoAdd: NF_density combinations 00/21400/1
Peter Mikus [Mon, 19 Aug 2019 14:48:47 +0000 (14:48 +0000)]
Add: NF_density combinations

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9ba859cf8ecb2d65c90ec7c6f75dc3e353e74de9
(cherry picked from commit baa47eee42b9b1f5fd4d19f0d4549f3baeac8354)

4 years agoPAL: Select tests by name, functions 88/21388/1
Tibor Frank [Fri, 16 Aug 2019 07:37:31 +0000 (09:37 +0200)]
PAL: Select tests by name, functions

- throughput
- latency
- speedup

Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 144ebec26ff0a32000283eddfac393e497e01164)

4 years agoReport: Add data 85/21385/1
Tibor Frank [Mon, 19 Aug 2019 11:26:01 +0000 (13:26 +0200)]
Report: Add data

- DPDK

Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 42c64b70e6cdc0ba1466ca0919d5d0377f4c227d)

4 years agoPAL: Get DPDK version from output_info.xml 81/21381/1
Tibor Frank [Mon, 19 Aug 2019 11:02:56 +0000 (13:02 +0200)]
PAL: Get DPDK version from output_info.xml

Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 039a71a97592cfb864dff8fc56ec04b33f8f92bb)

4 years agoFIX: Missing ACL library 77/21377/1
Peter Mikus [Mon, 19 Aug 2019 06:39:27 +0000 (06:39 +0000)]
FIX: Missing ACL library

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1497a9b031603d09d69a29ed7167686848d4b7c5
(cherry picked from commit 00b3327cf9df8ac078bde5f936bd2ac9fe666f03)

4 years agoWrite DPDK version to log 74/21374/1
Tibor Frank [Mon, 19 Aug 2019 06:05:54 +0000 (08:05 +0200)]
Write DPDK version to log

Change-Id: Ia9ec0d420c8db9e71234f74e4013c21d039931b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f893de60bb36c3e241a992cb389697997a1cd0f2)

4 years agoPAL: Process show runtime output 3 52/21352/1
Tibor Frank [Fri, 16 Aug 2019 07:41:06 +0000 (09:41 +0200)]
PAL: Process show runtime output 3

- format the table

Change-Id: I871251a8329e5d52c527c93afe35d875bddaed0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 859a3f724c077f9db9a2f40f76b6dad27f199003)

4 years agoPAL: Process show runtime output 2 47/21347/1
Tibor Frank [Fri, 16 Aug 2019 06:20:07 +0000 (08:20 +0200)]
PAL: Process show runtime output 2

- format the tables

Change-Id: I31f786d53b79fa14c5d2dc21ff65d0465fde1d4f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7da9d215fc0867e19160d38b0096e58c78381bf8)

4 years agoPAL: Process show runtime output 31/21331/1
Tibor Frank [Thu, 15 Aug 2019 11:12:57 +0000 (13:12 +0200)]
PAL: Process show runtime output

Change-Id: If7eac41cd33837eea7291f87129e2c176fbe6aea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3e58c2f916288c5ed22ce11f01fa56a4d19689d2)

4 years agoUpdate of VPP_STABLE_VER files to RC2 25/21325/1
Jan Gelety [Wed, 14 Aug 2019 04:18:37 +0000 (06:18 +0200)]
Update of VPP_STABLE_VER files to RC2

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc2~b26

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc2

 - use new vpp ref build - centos7:
   19.08-rc2~b26

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Iccd5ba08559e202c1c39ffceceeab1ee8c0d9f36

4 years agoFIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear down 24/21324/1
Jan Gelety [Tue, 13 Aug 2019 20:57:07 +0000 (22:57 +0200)]
FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear down

Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAdd testbed info to output_info.xml 21/21321/1
Tibor Frank [Thu, 15 Aug 2019 07:00:38 +0000 (09:00 +0200)]
Add testbed info to output_info.xml

Change-Id: I2ff45926a754647c1be6263cf8e5e0c7cbfedfef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 16226fd221af3345c02de6d685c90ee6bf7cf9f9)

4 years agoVAT-to-PAPI: Fix HTTP/TCP tests 16/21316/1
Dave Wallace [Tue, 6 Aug 2019 22:26:00 +0000 (22:26 +0000)]
VAT-to-PAPI: Fix HTTP/TCP tests

Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit 6da7266754c28754c04cf37d1974e39766a261f6)

4 years agoMove: WRK installation into ansible 09/21309/1
Peter Mikus [Wed, 14 Aug 2019 12:30:06 +0000 (12:30 +0000)]
Move: WRK installation into ansible

- Remove ability to install from framework.
- Control via ansible with other dependencies.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315
(cherry picked from commit 37a9451377f7239365b5af778b8072d1585a2d2a)

4 years agoFIX: Container VPP pid detection 08/21308/1
Peter Mikus [Wed, 14 Aug 2019 09:00:54 +0000 (09:00 +0000)]
FIX: Container VPP pid detection

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47163aa9ee0114f13ab17badde773560243ce319
(cherry picked from commit be39339d5bf121d718623885d05848e50d466347)

4 years agoReport: Add data 06/21306/1
Tibor Frank [Wed, 14 Aug 2019 14:08:08 +0000 (16:08 +0200)]
Report: Add data

 - Dry runs
 - fix table 'VPP Soak vs NDR 2n-skx'

Change-Id: I1fb101ab1b7cc40de49e8bb564818a730d3853a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b0592824b3b8394f25577481533c406145136dcf)

4 years agoReport: Add data 97/21297/1
Tibor Frank [Wed, 14 Aug 2019 11:41:15 +0000 (13:41 +0200)]
Report: Add data

- Dry runs

Change-Id: Ib6e50853b5b4638dc0f4bc93a98b3818f5079658
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 72614c322675f63958ca668404f081d738660e42)

4 years agoFIX: Vhost teardown 94/21294/1
Peter Mikus [Wed, 7 Aug 2019 14:47:34 +0000 (14:47 +0000)]
FIX: Vhost teardown

If test failed before vnf_manager is created then teardown
does fail as well due to missing variable.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0b23648bce78738cf4c377979d7a06fb488d990d
(cherry picked from commit 8f41f1d040453d963440d8cc99fb2b957521120b)

4 years agoPAL: Archiving of input data 88/21288/1
Tibor Frank [Wed, 14 Aug 2019 06:49:30 +0000 (08:49 +0200)]
PAL: Archiving of input data

Change-Id: I0902613047d7543378a4b7d46811fc67776c6ad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9e476b274acf41b5ac358bc4dba3a0f1e16f04b2)

4 years agoReport: Download first from logs.fd.io 74/21274/1
Tibor Frank [Fri, 9 Aug 2019 10:45:27 +0000 (12:45 +0200)]
Report: Download first from logs.fd.io

Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cd2a57aba61553f36c638dc6e8d949e1739fb6bf)

4 years agoPAL: Get DPDK Version 71/21271/1
Tibor Frank [Tue, 13 Aug 2019 12:18:32 +0000 (14:18 +0200)]
PAL: Get DPDK Version

- Needed for trending

Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9e1bb28404a23f6d4c62fb945a3ee6dba42f1c47)

4 years agoPAL: Get TG IP address from output_info.xml 62/21262/1
Tibor Frank [Tue, 13 Aug 2019 10:24:18 +0000 (12:24 +0200)]
PAL: Get TG IP address from output_info.xml

Change-Id: I566c0e436fbe50e5e72da35be6a2afc81e8a33b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b763901692e207a8f07386bb3bcba254cdeaa790)

4 years agoAdd testbed info to output_info.xml 58/21258/1
Tibor Frank [Tue, 13 Aug 2019 09:31:25 +0000 (11:31 +0200)]
Add testbed info to output_info.xml

- Needed for trending

Change-Id: I59fc115ce62d1ad839e7c8a39c74af0497b9012d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5dea7e63a012cdbf4fba60e4fdcb5c6acce2fca4)

4 years agoFIX: Remove TB31 from pool 53/21253/1
Peter Mikus [Tue, 13 Aug 2019 07:25:56 +0000 (07:25 +0000)]
FIX: Remove TB31 from pool

- SSD failure on t31-dut2

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I82bec2f78341f3e8ea5647d9781910e89461c327
(cherry picked from commit aa69c5cf674ae8bfbfd69aae9358f617c53a1fc5)

4 years agoClean: Various libraries 50/21250/1
Peter Mikus [Fri, 9 Aug 2019 12:46:42 +0000 (12:46 +0000)]
Clean: Various libraries

- Remove translate TC as they have no perf opposite
- Remove unused keywords
- Merge similar keywords / rename
- Move keywords from perf library to categories

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6433006136e2497ad8fb17193aa20c578d836999
(cherry picked from commit 9c75b7bf5af74aa13cfa3aeeaf726cd965850fce)

4 years agoFIX: if MAC address must be updated after AVF interface creation 36/21236/1
Jan Gelety [Wed, 7 Aug 2019 19:21:58 +0000 (21:21 +0200)]
FIX: if MAC address must be updated after AVF interface creation

Change-Id: I9fc26a7d1bf8d9eed620173a73febe3d874a1351
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 3e664d4a46aecf847659df2fe3d2572697b582a7)

4 years agoFIX: Various typos in nf_density + missing KW 34/21234/1
Peter Mikus [Thu, 8 Aug 2019 07:37:44 +0000 (07:37 +0000)]
FIX: Various typos in nf_density + missing KW

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I73878542672ab2dcfa1db046fbca4b7d931e744c

4 years agoUpdate of VPP_STABLE_VER files 20/21220/2
Jan Gelety [Wed, 7 Aug 2019 16:07:15 +0000 (18:07 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc1~9-g28d8621~b14

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc1~9-g28d86217b

 - use new vpp ref build - centos7:
   19.08-rc1~9_g28d8621~b14

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Id9b87e14d806ff8c4ae67ad16695aa4834ccacde

4 years agoReport: data 24/21224/1
Tibor Frank [Mon, 12 Aug 2019 08:00:53 +0000 (10:00 +0200)]
Report: data

Change-Id: Id51e073d23d7bb54864eb5fd1c3c320077e6abb8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f187d0b4f9cfa3b980a94b1f56e828b183367c15)

4 years agoReport: Data 18/21218/1
Tibor Frank [Fri, 9 Aug 2019 13:13:12 +0000 (15:13 +0200)]
Report: Data

Change-Id: Ibd1a5dc6e451d992eb85b223973734c876e37fe7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f7037acce33b11dbbbb87ad079750525e6b95eb4)

4 years agoClean: L2 bridge domain 15/21215/2
Peter Mikus [Fri, 9 Aug 2019 10:14:34 +0000 (10:14 +0000)]
Clean: L2 bridge domain

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca

4 years agoFIX: macip_acl_rule needs binary mac data 90/21190/1
Jan Gelety [Wed, 7 Aug 2019 09:14:15 +0000 (11:14 +0200)]
FIX: macip_acl_rule needs binary mac data

Change-Id: I0d26b2b31f0ce7497c91b4ae965f9cc45a66ef0c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 5b28bc8c52a5f7ef72f03d03806f61ba45ecc623)

4 years agoClean: L2_xconnect keywords 84/21184/1
Peter Mikus [Thu, 8 Aug 2019 12:15:16 +0000 (12:15 +0000)]
Clean: L2_xconnect keywords

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic15a15c426db04defc15840883a772a0eb8e4885
(cherry picked from commit 181e882d5c939cc6620545e5fde411e46fd59559)

4 years agoTrending: Fix ipsec 82/21182/1
Tibor Frank [Fri, 9 Aug 2019 07:42:04 +0000 (09:42 +0200)]
Trending: Fix ipsec

Change-Id: I0f35098047bc1137cbf2a1ae39107698b1e9bf79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoDOC: rls1908 static content 79/21179/1
Peter Mikus [Fri, 9 Aug 2019 07:48:43 +0000 (07:48 +0000)]
DOC: rls1908 static content

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382
(cherry picked from commit ce1c52b1fd27d3e2b6c4909219fa98418565ba61)

4 years agoReport: Configuration 73/21173/1
Tibor Frank [Fri, 9 Aug 2019 07:09:33 +0000 (09:09 +0200)]
Report: Configuration

Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d6c832b02ac7d3073dd8651b089a72ec8240b183)

4 years agoTrending: Set 90 days period 71/21171/1
Tibor Frank [Fri, 9 Aug 2019 06:58:34 +0000 (08:58 +0200)]
Trending: Set 90 days period

Change-Id: I56403c30142876501602fe06c0ad2665fa73cb7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: TSH ipsec tests 67/21167/1
Tibor Frank [Fri, 9 Aug 2019 06:05:03 +0000 (08:05 +0200)]
Trending: TSH ipsec tests

Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoClean: L2_patch 64/21164/1
Peter Mikus [Thu, 8 Aug 2019 11:31:26 +0000 (11:31 +0000)]
Clean: L2_patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib3620689acb3641b2ec9a49e2ce552bab3f00eef
(cherry picked from commit 016fb5988a63c3086b0b5b9f5ad7155c6ebef291)

4 years agoClean: Interface Keywords 63/21163/1
Peter Mikus [Thu, 8 Aug 2019 11:20:49 +0000 (11:20 +0000)]
Clean: Interface Keywords

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ideddcea56120cf770aec78ca24813baf7d05ba11
(cherry picked from commit 484cb0bddf8ad75129ac20b955a72f36f4241ad2)

4 years agoUpdate of VPP_REPO_URL and VPP_STABLE_VER files 40/21140/1
Jan Gelety [Wed, 7 Aug 2019 01:11:50 +0000 (03:11 +0200)]
Update of VPP_REPO_URL and VPP_STABLE_VER files

- use vpp builds from vpp stable/1908 branch

- use new vpp ref build - ubuntu 16.04:
  19.08-rc1~b5

- use new vpp ref build - ubuntu 18.04:
  19.08-rc1

- use new vpp ref build - centos7:
  19.08-rc1~b5

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I8173e5342e9b6934608cd44c5581f33cba9552ec

4 years agoTrending: Add dnv mrr tests 02/21102/5
Tibor Frank [Wed, 7 Aug 2019 12:08:04 +0000 (14:08 +0200)]
Trending: Add dnv mrr tests

Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years ago3n-tsh trending docs fixes 12/21112/2
juraj.linkes [Wed, 7 Aug 2019 12:16:11 +0000 (14:16 +0200)]
3n-tsh trending docs fixes

Change-Id: Icf4babf8f7924be864520a0ecf8f7e718de51c32
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoUpdate DPDK ver 33/21133/1
Peter Mikus [Thu, 8 Aug 2019 05:43:40 +0000 (05:43 +0000)]
Update DPDK ver

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifc0b47d0849d34f5c4ddf9fea393e7c249720359

4 years agoClean: IPv6 keywords 10/21110/2
Peter Mikus [Wed, 7 Aug 2019 13:26:55 +0000 (13:26 +0000)]
Clean: IPv6 keywords

+ Move all base ipv6 related KW to library
+ Remove useless KW to save space in output.xml
+ Remove cross dependency in ip6.robot

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c5f72e9852c1017356ab6034c4d271cf7b53265

4 years agoClean: IPv4 keywords 05/21105/2
Peter Mikus [Wed, 7 Aug 2019 12:23:27 +0000 (12:23 +0000)]
Clean: IPv4 keywords

+ Move all base ipv4 related KW to library
+ Remove useless KW to save space in output.xml
+ Remove cross dependency in ip4.robot

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If1e3a6370d36caf4ce7411fb956a0b7d0f939b6b

4 years agoFIX: Pylint 13/21113/7
Peter Mikus [Wed, 7 Aug 2019 13:58:59 +0000 (13:58 +0000)]
FIX: Pylint

- my bad

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c1f57f6b648b99338f3f6a6ff9ec943082e9bc4

4 years agoFIX: IPsecUtil - create IP object separately in ever iteration 80/21080/4
Jan Gelety [Tue, 6 Aug 2019 11:52:33 +0000 (13:52 +0200)]
FIX: IPsecUtil - create IP object separately in ever iteration

- if we are trying to update ip field of already existing IP object
  in more iterations of e.g. ip_route_add_del the PapiExecutor uses
  value from last iteration for all iterations so it ends up in
  creation of ip route only for one IP not for all required IPs

Change-Id: I5ffa622e2a06d0c5c71720d2cf743a4c2104ab79
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: Remove PAPI_MAX_API_BULK 99/21099/2
Jan Gelety [Tue, 6 Aug 2019 19:46:13 +0000 (21:46 +0200)]
FIX: Remove PAPI_MAX_API_BULK

- it's not needed anymore as PapiSocketExecutor is used

Change-Id: Ia9fad1d18991821d14e9261d27f7f26fca03c14a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1473: Migrate Tap library from VAT to PAPI 54/20754/16
Jan Gelety [Fri, 12 Jul 2019 12:53:24 +0000 (14:53 +0200)]
CSIT-1473: Migrate Tap library from VAT to PAPI

Change-Id: Ibf4a4839c2e8b799b03eebd9dffae891d8f00dd4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoUpdate trending vpp ref 04/21104/1
juraj.linkes [Wed, 7 Aug 2019 12:23:11 +0000 (14:23 +0200)]
Update trending vpp ref

Nexus to Packagecloud
Xenial to Bionic

Change-Id: Id702076b9a5c37e84719bae66bcd87c9ab5ed2b7
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoExpand comment on API covering triggers 98/21098/1
Vratko Polak [Wed, 7 Aug 2019 08:51:04 +0000 (10:51 +0200)]
Expand comment on API covering triggers

GBP tests were added, they are only covered by 2n perf test.
Several tags used in the tag expression to proof against future suites.

Change-Id: I9facd8c72b41284b6b838e99ce9d38047aa68f40
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAdd: AVF ip4scale 17/20917/7
Peter Mikus [Tue, 30 Jul 2019 09:43:28 +0000 (09:43 +0000)]
Add: AVF ip4scale

+ Few corrections
+ Aligning 3n/2n

Change-Id: If0918c0df38c5532899bec9ae7a7019117fff477
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd: Dot1Q + L2BD + GBP 01/20901/15
Peter Mikus [Mon, 29 Jul 2019 12:36:18 +0000 (12:36 +0000)]
Add: Dot1Q + L2BD + GBP

Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoChange show hardware detail to show hardware verbose 85/21085/1
juraj.linkes [Tue, 6 Aug 2019 12:49:15 +0000 (14:49 +0200)]
Change show hardware detail to show hardware verbose

After https://gerrit.fd.io/r/#/c/vpp/+/21071/, show hardware verbose
doesn't output slowly processed module info which is not needed for
debugging purposes.

Change-Id: I2f91a0ce1bfc082b46f2fe43df968750bcd1cf3a
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoVPPD: Dot1Q 48/20848/30
Peter Mikus [Thu, 25 Jul 2019 11:09:23 +0000 (11:09 +0000)]
VPPD: Dot1Q

Change-Id: I0d3c925ea4a6896a0df98db6ddaf4238e6291bf1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoPapiHistory: Use repr strings for argument values 18/20818/4
Vratko Polak [Wed, 24 Jul 2019 07:49:05 +0000 (09:49 +0200)]
PapiHistory: Use repr strings for argument values

Composite arguments frequently do not have valid __str__ method
so the values were not visible.

Change-Id: If302934cb227f212580bb2f5c277a755ace51bcf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: Layer dot1q logic 59/21059/11
Peter Mikus [Mon, 5 Aug 2019 12:25:19 +0000 (12:25 +0000)]
FIX: Layer dot1q logic

Bug found by vrpolak

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibf61f14a838d0b49220ab8079a2d999f860a18e7

4 years agoFix CRCs, bump stable VPP version 02/21002/18
Vratko Polak [Thu, 1 Aug 2019 11:50:48 +0000 (13:50 +0200)]
Fix CRCs, bump stable VPP version

+ Migrate the data to a separate yaml file.
+ Improve some argument names.
+ Unify handling of unicode (to always utf-8 encode to str).

Change-Id: Id0622b24202be796c1cd33ad52c3b8dca81cff50
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoTrending: Reduce input data 51/21051/1
Tibor Frank [Mon, 5 Aug 2019 07:36:10 +0000 (09:36 +0200)]
Trending: Reduce input data

Change-Id: Iab9e6686ef163eda04d836e4f355a310058e846e
Signed-off-by: Tibor Frank <tifrank@cisco.com>