csit.git
4 years agoReport: NFV Graphs 10/19410/1
Tibor Frank [Tue, 7 May 2019 12:46:30 +0000 (14:46 +0200)]
Report: NFV Graphs

Change-Id: I8763f7977a48405787f93e34e750b47c5742c798
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: NFV Graphs 06/19406/1
Tibor Frank [Tue, 7 May 2019 11:46:40 +0000 (13:46 +0200)]
Report: NFV Graphs

Change-Id: I0f395d4bd2ec090e55f6650ea9042a77e82ead4d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Fix NFV Graphs 01/19401/1
Tibor Frank [Tue, 7 May 2019 10:24:38 +0000 (12:24 +0200)]
Report: Fix NFV Graphs

Change-Id: If11ed726cb75134c24cde3a752d2e72188bbe3a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: NFV Service Density - color bar tilte 92/19392/1
Tibor Frank [Tue, 7 May 2019 08:41:27 +0000 (10:41 +0200)]
Report: NFV Service Density - color bar tilte

Change-Id: I01014a5247994b5acb01c6d62d9178e4ddbcd025
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFix typos in DUTsetup.py 61/19361/4
Vratko Polak [Mon, 6 May 2019 10:53:56 +0000 (12:53 +0200)]
Fix typos in DUTsetup.py

Change-Id: I7fb255c26bfb62a273844b3753aa37b742835045
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 85/19385/1
Tibor Frank [Tue, 7 May 2019 06:18:45 +0000 (08:18 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I19d20c6c68b7b280c8fc7c2bba4e5ce4c660a2d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1492: Add NF density tests: Models and data 73/19373/1
Tibor Frank [Mon, 6 May 2019 12:58:39 +0000 (14:58 +0200)]
CSIT-1492: Add NF density tests: Models and data

Change-Id: I010fbf9acffc5a613e7b67810f66822ba2e46f42
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1492: Add NF density tests: Models and data 68/19368/1
Tibor Frank [Mon, 6 May 2019 12:08:55 +0000 (14:08 +0200)]
CSIT-1492: Add NF density tests: Models and data

Change-Id: Icad4c04e45224f694bc484eef6e6dd7903c2f136
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1492: Add new NF density tests to report 65/19165/51
Tibor Frank [Thu, 25 Apr 2019 10:58:43 +0000 (12:58 +0200)]
CSIT-1492: Add new NF density tests to report

Change-Id: Ifdfac80f7fd25124cb08a467329d6c8c525ffc06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1493 VPP restart handling code 41/19141/29
Peter Mikus [Wed, 24 Apr 2019 11:31:30 +0000 (11:31 +0000)]
CSIT-1493 VPP restart handling code

Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 51/19351/1
Tibor Frank [Mon, 6 May 2019 08:20:12 +0000 (10:20 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I49b1f3d9e2ac422ddae8382828756476a696a2c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure the version 46/19346/1
Tibor Frank [Mon, 6 May 2019 07:13:35 +0000 (09:13 +0200)]
Report: Configure the version

Change-Id: I29240b2286f48cc8027d97c9c1895c51b2a11ca5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoreport 1904: updated methodology (nfv density, startup.conf) and vpp perf rls notes 06/19306/3
Maciek Konstantynowicz [Thu, 2 May 2019 18:20:38 +0000 (19:20 +0100)]
report 1904: updated methodology (nfv density, startup.conf) and vpp perf rls notes

Change-Id: If6d24511d5d29dcc25c21437364e0da15af3cca1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoUpdate KVM methodology 13/19313/3
Peter Mikus [Fri, 3 May 2019 06:32:17 +0000 (06:32 +0000)]
Update KVM methodology

Change-Id: I8be9b9295b691a1ec4b810e3a1255ad1bc6947ab
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 24/19324/1
Peter Mikus [Fri, 3 May 2019 12:49:40 +0000 (12:49 +0000)]
CSIT-1488: Add data to the Report 1904

Change-Id: I7d63d16164e0cf54d74cc0b7286cde50a6e71404
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 52/19252/1
Tibor Frank [Tue, 30 Apr 2019 10:35:18 +0000 (12:35 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ibf630b85f2e7b164847628efb9969edba753eb74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate report static content 18/19218/4
Peter Mikus [Mon, 29 Apr 2019 09:34:59 +0000 (09:34 +0000)]
Update report static content

Change-Id: I8aef71fb2cc09d2c7862884f7ca68c9786ad5165
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 24/19224/1
Tibor Frank [Mon, 29 Apr 2019 11:21:10 +0000 (13:21 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Iec3270ccff9db2d8532f6f0d11640bf65d7f9ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure the version 10/19210/1
Tibor Frank [Mon, 29 Apr 2019 08:40:46 +0000 (10:40 +0200)]
Report: Configure the version

Change-Id: I064b16e0a2b7f96e4590622be340ab657d785f16
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoNF density tests with dtc=0.5 and dtcr=2 62/19062/14
Peter Mikus [Fri, 19 Apr 2019 06:40:44 +0000 (06:40 +0000)]
NF density tests with dtc=0.5 and dtcr=2

Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agofix removal of build packages for honeycomb 85/19185/1
Michal Cmarada [Fri, 26 Apr 2019 10:41:14 +0000 (12:41 +0200)]
fix removal of build packages for honeycomb

Change-Id: I19be5008067067c2e7c78e7673a9ceaaf2f52c8f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
4 years agoFIX: Change buffers per numa base on SMT 83/19183/1
Peter Mikus [Fri, 26 Apr 2019 10:29:53 +0000 (10:29 +0000)]
FIX: Change buffers per numa base on SMT

Change-Id: I4955210e2c723d4b91d8829ac42e47937d17833f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 61/19161/1
Tibor Frank [Thu, 25 Apr 2019 10:51:27 +0000 (12:51 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6f787445c0f4e91e4fbde7787c49d08d412347a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1489: Change graphs to display results by suite generator 10/19110/8
Tibor Frank [Tue, 23 Apr 2019 12:31:13 +0000 (14:31 +0200)]
CSIT-1489: Change graphs to display results by suite generator

Change-Id: I00fdc7ce87be5cecf5883ed2c991a8e67efd2e2a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Crypto tests 32/19132/5
Peter Mikus [Wed, 24 Apr 2019 05:53:02 +0000 (05:53 +0000)]
FIX: Crypto tests

- By adding crypto_ipsecmb.so into the list of loaded plugins

Change-Id: I52de9b410441422ad8e337208f40360fbdea264d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: Large number of interfaces and worker threads 43/18743/19
Peter Mikus [Mon, 8 Apr 2019 12:42:08 +0000 (12:42 +0000)]
FIX: Large number of interfaces and worker threads

Add buffers-per-numa (previously num-mbuf)

Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoMove generate_tests earlier in entry scripts 36/19136/1
Vratko Polak [Wed, 24 Apr 2019 08:51:37 +0000 (10:51 +0200)]
Move generate_tests earlier in entry scripts

The idea is to run test generation and archivation
before testbed reservation, as during generation and archivation
the testbed can be used by another job.
The two steps are moved just before (physical or docker) reservation,
as they currently take considerable time,
so simpler steps are kept before to save time if they fail.
Coincidentally, it is also just after activate_virtualenv,
Python is needed for test generation.

Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: TAP tests fix 2 15/19115/1
Jan Gelety [Sun, 14 Apr 2019 02:00:12 +0000 (04:00 +0200)]
FIX: TAP tests fix 2

Change-Id: Ie9591fe3d72f27be0b4cba21c7b0868ed5118de4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit d0293114feed3b8d4badec6bc8cc1ace91a4d3e6)

4 years agoFIX: Create TAP interface after API change 14/19114/1
Jan Gelety [Sat, 13 Apr 2019 23:57:33 +0000 (01:57 +0200)]
FIX: Create TAP interface after API change

Change-Id: Ib39671dcb808142037c2950b8b02b9aa64d72a3b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 48b40a6789050e8f40405663cc0e437df26fc56a)

4 years agoFIX: VTS pinning issue. 93/19093/5
Peter Mikus [Tue, 23 Apr 2019 08:43:12 +0000 (08:43 +0000)]
FIX: VTS pinning issue.

Change-Id: I12a79605a925c00d9c41b7115bc7cbb7f2cd49c1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 00/19100/1
Tibor Frank [Tue, 23 Apr 2019 09:57:23 +0000 (11:57 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I2ba9eeedf5668b5a99acbe0d26add2aa0a836a9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 94/19094/1
Tibor Frank [Tue, 23 Apr 2019 08:45:46 +0000 (10:45 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Idab323612b20ae06d92bd81310abdb1d44c6c9a7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1487: Configure PAL for the Report 1904 88/19088/1
Tibor Frank [Tue, 23 Apr 2019 07:01:12 +0000 (09:01 +0200)]
CSIT-1487: Configure PAL for the Report 1904

- change the week number
- add pdf generation
- change ubuntu and centos images

Change-Id: Iadea2f3dd9cfd77b508bf16ffd154bbd4f1145bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: eth_peer parameter after introducing OptionParams 46/19046/2
Peter Mikus [Thu, 18 Apr 2019 14:54:31 +0000 (14:54 +0000)]
FIX: eth_peer parameter after introducing OptionParams

Change-Id: Ief72af680a6252faf749b06b5289b8033af99b2d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoOptionString: Do not convert None to non-empty string 33/19033/2
Vratko Polak [Thu, 18 Apr 2019 12:19:24 +0000 (14:19 +0200)]
OptionString: Do not convert None to non-empty string

Change-Id: I2947394a478bde3fe048aef99fd7b5a394764ae2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Static content 35/19035/1
Tibor Frank [Thu, 18 Apr 2019 12:40:53 +0000 (14:40 +0200)]
Report: Static content

Change-Id: If8e2593dcaff368b2c7e191f70bab15e8974bb38
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1487: Configure PAL for the Report 1904 72/18972/3
Tibor Frank [Wed, 17 Apr 2019 13:54:45 +0000 (15:54 +0200)]
CSIT-1487: Configure PAL for the Report 1904

Change-Id: I4f112693a3b50665a9c53290de42d8e365c6d415
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd perpatch info to cpta methodology 37/18337/17
Vratko Polak [Tue, 16 Apr 2019 16:59:33 +0000 (18:59 +0200)]
Add perpatch info to cpta methodology

Also, split methodology file into multiple, per section.

Change-Id: I973b93d1a99205d7adb80996a3657215e05b8985
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1482: Change trending graphs 12/18812/5
Tibor Frank [Thu, 11 Apr 2019 11:44:02 +0000 (13:44 +0200)]
CSIT-1482: Change trending graphs

- Change trending graphs to display results when using suite  generator

Change-Id: I4f822c180f9c206be19a9c75ce105c2225ad9171
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCentos 7.6-1810 image update. 60/18860/4
Thomas F Herbert [Sun, 14 Apr 2019 19:12:10 +0000 (15:12 -0400)]
Centos 7.6-1810 image update.

Add python36 and update qemu to 2.12.
add boost-filesystem

Change-Id: I89bba0b807be6d6c2d98b2f07faae9c31b3370e1
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
5 years agoIncrease reliability of per patch perf job 88/18788/8
Vratko Polak [Wed, 10 Apr 2019 08:33:17 +0000 (10:33 +0200)]
Increase reliability of per patch perf job

CSIT-1485

- Measurement results are inconsistent, creating false positives.
- To avoid false positives, sensitivity has to be lowered.
+ Measurements are no more interleaved.
+ Measurement result are no longer filtered.
+ The job now runs faster.
- Ip6base regressions smaller than 4% are tolerated.
+ Ip6base false positives can happen, but less than 10% of the time.
- Part of job parameters is set on ci-management level.
+ Voter script output is improved.

Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1483: Add processing of output_info.xml as the first choice 83/18883/24
Tibor Frank [Mon, 15 Apr 2019 12:17:05 +0000 (14:17 +0200)]
CSIT-1483: Add processing of output_info.xml as the first choice

Change-Id: I27687ed6dda3a8717538653e75ad0d61c6516c7e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoClean up traffic_profile vs osi_layer 37/18937/2
Vratko Polak [Tue, 16 Apr 2019 14:32:59 +0000 (16:32 +0200)]
Clean up traffic_profile vs osi_layer

The two types were not well distinguished before.

Error introduced in:
https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255

Error hotfixed in:
https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109

+ Rename some arguments and improve method docstrings.

Newly introduced argument name osi_layer should be dissimilar enough.

Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoIntroduce OptionString for handling command line 44/18844/21
Vratko Polak [Mon, 15 Apr 2019 14:31:54 +0000 (16:31 +0200)]
Introduce OptionString for handling command line

+ Convert DpdkUtil to use it.
++ Rename args to kwargs where needed.
++ Fix errors in docstrings.
+ Also convert and QemuUtils to use it.
++ Minor formatting edits to save space.
+ Add disconnect parameter to some ssh.py functions.
++ ssh.SSH.disconnect() tries to work without argument.
+ Exec functions in ssh.py accept OptionString commands.

Change-Id: I82da71c568d120c283544c90242993fc76e9e83a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoRemove unused parameter in HoneycombSetup 29/18929/2
Michal Cmarada [Tue, 16 Apr 2019 13:20:03 +0000 (15:20 +0200)]
Remove unused parameter in HoneycombSetup

Change-Id: Ief75fcdc2c3ab77b708d1c7e7aecf312ea852898
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoAdd 2n AVF tests 47/18847/5
Peter Mikus [Fri, 12 Apr 2019 17:53:29 +0000 (17:53 +0000)]
Add 2n AVF tests

- Side effect of other troubleshooting, but better to
merge then throw away.

Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUse package location for apt-cache show command 15/18915/1
Jan Gelety [Sat, 13 Apr 2019 01:23:04 +0000 (03:23 +0200)]
Use package location for apt-cache show command

Change-Id: I141baa77c78ec467a56fcafb86061efe198dca9d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 66/18866/2
Jan Gelety [Fri, 12 Apr 2019 15:12:31 +0000 (17:12 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~14-g4e08316~b6856

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~14-g4e08316f3

- use new vpp ref build - centos7:
  19.08-rc0~14_g4e08316~b6690

Change-Id: Id377e18b0d6bfaa55762b7088c284866f5749a5d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoRemove obsolete QEMU installation 57/18857/3
Peter Mikus [Sat, 13 Apr 2019 06:15:25 +0000 (06:15 +0000)]
Remove obsolete QEMU installation

+Unify QEMU parameter to Contants.

Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd output.xml with only INFO logging leve 08/18808/5
Peter Mikus [Thu, 11 Apr 2019 08:36:06 +0000 (08:36 +0000)]
Add output.xml with only INFO logging leve

- Useful for post-processing.

Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAlerts: Change the error message 14/18814/8
Tibor Frank [Thu, 11 Apr 2019 12:28:00 +0000 (14:28 +0200)]
Alerts: Change the error message

Change-Id: I0fcd6ffaf24de0f6ce95eaba3d591eddf3f16b33
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFix pylint error in PapiExecutor 33/18833/2
Vratko Polak [Fri, 12 Apr 2019 11:22:00 +0000 (13:22 +0200)]
Fix pylint error in PapiExecutor

+ Remove ret_val as it cannot be nonzero outside _execute_papi.
+ Change indentation to save vertical space.
+ Return computed values without storing them to variable.
+ Add TODO to remove duplicated method.
+ Add missing fields to docstring.
+ Minor formatting changes.

Change-Id: I8e8f41d139de8aff3b76a7fe27ee450e89e8d1de
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoAdd DPDK install to ansible 50/18850/1
Peter Mikus [Fri, 12 Apr 2019 20:22:05 +0000 (20:22 +0000)]
Add DPDK install to ansible

Change-Id: If838c2a008ffd5bdf458c76d729f57b47e225b41
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoConvert existing nf_density testpmd-mac into KernelVM 42/18742/12
Peter Mikus [Mon, 8 Apr 2019 12:31:25 +0000 (12:31 +0000)]
Convert existing nf_density testpmd-mac into KernelVM

Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd notes for traffic_type argument 15/18815/1
Vratko Polak [Thu, 11 Apr 2019 12:45:32 +0000 (14:45 +0200)]
Add notes for traffic_type argument

To make this gerrit comment permanently visible in code:
https://gerrit.fd.io/r/#/c/17811/50/resources/libraries/python/InterfaceUtil.py@1335

Change-Id: I2b763d88fcc8186c9479a0f0c3336d8eeb8aed95
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoTrending: Reduce input data 84/18784/8
Tibor Frank [Wed, 10 Apr 2019 07:42:13 +0000 (09:42 +0200)]
Trending: Reduce input data

Change-Id: Ia787036e4a717b9693df09fc75738369d6d39b57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agofix auth for newer ODL versions 66/18766/2
Michal Cmarada [Tue, 9 Apr 2019 14:53:46 +0000 (16:53 +0200)]
fix auth for newer ODL versions

Since oxygen we need to add also "-p karaf" argument when
starting karaf and because we are not using older versions
anymore we can remove the if condition and use new authentication
by default.

Change-Id: I458fa35b7f26222dd5562349e6859844bfb7d05f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoAdd vagrant setup for testing VPP device locally 43/17343/3
Ludovit Mikula [Wed, 6 Feb 2019 14:47:23 +0000 (15:47 +0100)]
Add vagrant setup for testing VPP device locally
Fixed trailing whitespaces
Fixed tabs vs. spaces
Removed dead code
Changed network interface naming
Changed default number of retries for VPP startup to 120
Updated number of hugepages during provisioning
Externalized CSIT related sysctl settings to 90-csit.conf
Removed hardcoded local docker image name.
Added new interface required for honeycomb device testing.

Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
5 years agoAdd support DHCP Server Support for DNV 49/18749/4
Ray Kinsella [Mon, 8 Apr 2019 15:29:59 +0000 (16:29 +0100)]
Add support DHCP Server Support for DNV

Adding DHCP Server support for 2-node and 3-node DNV setups

Change-Id: If3d3517fd91ab46308c368910c1e79f5c25cc904
Signed-off-by: Ray Kinsella <ray.kinsella@intel.com>
5 years agoUpdate of ubuntu VPP_STABLE_VER 30/18730/2
Jan Gelety [Wed, 3 Apr 2019 01:39:11 +0000 (03:39 +0200)]
Update of ubuntu VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.04-rc0~640-g05f7ca1~b6800

- use new vpp ref build - ubuntu 18.04:
  19.04-rc0~640-g05f7ca110

Change-Id: I940b044210d3a552fb2af75359f62795230cd2ad
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoupdate tests after ODL bump to Neon 16/18616/14
Michal Cmarada [Tue, 9 Apr 2019 06:12:05 +0000 (08:12 +0200)]
update tests after ODL bump to Neon

Change-Id: Ia733ad304c51b28f2a945e570120821254077189
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoFix l2 Honeycomb tests 37/18737/3
Michal Cmarada [Mon, 8 Apr 2019 10:27:32 +0000 (12:27 +0200)]
Fix l2 Honeycomb tests

Change-Id: Ic75a9279fffe3a5d11211f4e57fc635d7d33ee5f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoUpgrade autogen to NICs and search types 11/17811/84
Vratko Polak [Thu, 4 Apr 2019 11:45:11 +0000 (13:45 +0200)]
Upgrade autogen to NICs and search types

+ All perf suites updated, as autogen change is backward incompatible.
+ Only x710 -ndrpdr suites remain in git repository.
+ Removed retry feature of run_tests.
+ Renamed topology_type and traffic_type to traffic_profile.
+ Renamed framesize to frame_size; nic_model to nic_name.
+ Reordered Variables table to start with nic_name and overhead.
+ Fixed wrong overhead value in some cbc-sha1 suites.
+ Fixed some suite tags.
++ Introduced tags to distinguish suites, such as IPSECINT.
+ Bound crypto hardware to NIC name.
+ Implemented NIC limit hiding.
+ Also search and teardown related arguments are now hidden.
+ Main measurement keywords updated to new arg handling.
+ Max rate related keywords moved to performance_limits.robot
+ Teardowns unified.
+ Generated tests are archived.
++ Generated directory is .gitignore-d.
+ Regenerator raises an exception on seeing non-compatible suite.
++ Relatively helpful message should be seen in exception.
+ Suite and template Documentation has generated parts.
+- With short NIC names only.
+ Autogen checker also upgraded.
+ Tag expressions replaced with long files to ensure analogous tests.

Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoRemove lbdpdk perf tests 23/18723/2
Peter Mikus [Sun, 7 Apr 2019 16:38:32 +0000 (16:38 +0000)]
Remove lbdpdk perf tests

- They are not used anywhere and failing all the time.

Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoRemove obsolete FDS tests 28/18728/1
Jan Gelety [Wed, 3 Apr 2019 01:28:13 +0000 (03:28 +0200)]
Remove obsolete FDS tests

Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: Qemu set affinity bug 22/18722/4
Peter Mikus [Sun, 7 Apr 2019 12:55:51 +0000 (12:55 +0000)]
FIX: Qemu set affinity bug

Change-Id: If1df58628b2150b1ea3f2f56b1e3d442176b0750
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: Operational issues 18/18718/3
Peter Mikus [Fri, 5 Apr 2019 21:47:48 +0000 (21:47 +0000)]
FIX: Operational issues

- FIX MSR package installation
- FIX VTS
- FIX sockets by removing from TCs

Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFixes for Taishan testbed 15/18115/9
juraj.linkes [Thu, 7 Mar 2019 13:03:36 +0000 (14:03 +0100)]
Fixes for Taishan testbed

* rename NICs in Taishan testbed to Intel-X520-DA2
* fix testbed NIC selection
* remove unnecessary 82599es tests
* blacklist unsupported tests on Taishan testbed
* lowercase previously created bash local variables

Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoAdd vpp-api-python for honeycomb tests 27/18627/3
Michal Cmarada [Tue, 2 Apr 2019 06:51:16 +0000 (08:51 +0200)]
Add vpp-api-python for honeycomb tests

 - Csit is migrating VAT scripts to PAPI, therefore
   python package for vpp is needed in honeycomb tests.

Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoTrending: Remove NF tests from alerts 82/18682/1
Tibor Frank [Thu, 4 Apr 2019 11:50:31 +0000 (13:50 +0200)]
Trending: Remove NF tests from alerts

Change-Id: Id8074a30f578af7df5bb15e9c127838d27cae8b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Alerts 18/18618/29
Tibor Frank [Mon, 1 Apr 2019 14:31:38 +0000 (16:31 +0200)]
Trending: Alerts

Change-Id: I1c744f4eeefe3082be02daa681bfc032d6db4d15
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoChange 2 node Denverton testbed description 13/18613/2
Yulong Pei [Mon, 1 Apr 2019 13:06:41 +0000 (21:06 +0800)]
Change 2 node Denverton testbed description

Change-Id: I09c5ac3c4fe90b1fff46c4211b401daefe40ac31
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agoUpdate draft-vpolak-mkonstan-bmwg-mlrsearch-00->01. 47/18647/1
Maciek Konstantynowicz [Tue, 2 Apr 2019 17:52:33 +0000 (18:52 +0100)]
Update draft-vpolak-mkonstan-bmwg-mlrsearch-00->01.

Change-Id: I7345fdf63a1e7355812e5089e16e14f47cd6e890
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoTrending: Remove invalid builds (3n-skx 356-372) 28/18628/2
Tibor Frank [Tue, 2 Apr 2019 07:10:05 +0000 (09:10 +0200)]
Trending: Remove invalid builds (3n-skx 356-372)

Change-Id: I8de833a87536b60382c54fa9be2f443ff8a7d900
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1412: Create trending graphs for svc density 35/17335/52
Tibor Frank [Wed, 6 Feb 2019 07:22:32 +0000 (08:22 +0100)]
CSIT-1412: Create trending graphs for svc density

 - static content
 - plots

Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1337: Migrate L2Util library from VAT to PAPI 10/18110/30
Jan Gelety [Wed, 6 Mar 2019 20:47:28 +0000 (21:47 +0100)]
CSIT-1337: Migrate L2Util library from VAT to PAPI

Change-Id: I22879c7bdd100d00216b9528663bf17406169826
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: change socket location for vhost-user interface 69/18569/2
Jan Gelety [Tue, 26 Mar 2019 17:57:06 +0000 (18:57 +0100)]
FIX: change socket location for vhost-user interface

Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoAdd ipsec crypto test for Denverton platform 46/18446/3
Yulong Pei [Thu, 21 Mar 2019 10:24:46 +0000 (18:24 +0800)]
Add ipsec crypto test for Denverton platform

add ipsec cryto test to support Denverton hardware crypto device C3xxx.
replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other
hardware crypto device type support in the future.

Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agoRe-enabling Honeycomb two IPs same subnet tests 71/17371/3
Michal Cmarada [Thu, 7 Feb 2019 08:47:13 +0000 (09:47 +0100)]
Re-enabling Honeycomb two IPs same subnet tests

 - reordering tests so unnumbered interface tests
   don't break following tests
 - removing EXPECTED_FAILING for fixed tests

Change-Id: Ic24d878849ab4f451e2fb59856c222167cb35d8f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoReport: Configure 1901.1.13 62/18562/1
Tibor Frank [Thu, 28 Mar 2019 09:26:32 +0000 (10:26 +0100)]
Report: Configure 1901.1.13

Change-Id: I17c72ddb8bc5df364761c9e0453aeb128d7951e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFix Tap failing tests 34/18534/5
Michal Cmarada [Thu, 28 Mar 2019 07:38:32 +0000 (08:38 +0100)]
Fix Tap failing tests

Due to migration to Tap-v2 the old Tap API was removed.
This fixes failing tests where Tap interface was used.

Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoCSIT-1460: Add VPP-stats to PAPI Provider 19/18419/13
Tibor Frank [Wed, 20 Mar 2019 12:15:40 +0000 (13:15 +0100)]
CSIT-1460: Add VPP-stats to PAPI Provider

Change-Id: I2665700a4948c481585d66c987f94af748f102c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFix virl ubuntu image + update ubuntu vpp builds 46/18546/3
Jan Gelety [Tue, 26 Mar 2019 06:39:15 +0000 (07:39 +0100)]
Fix virl ubuntu image + update ubuntu vpp builds

Change-Id: Ifcb38f09a9a84c8dbae879ad34af11fe9be4a450
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Update vpp perf tests release notes 44/18544/1
Jan Gelety [Tue, 26 Mar 2019 03:29:55 +0000 (04:29 +0100)]
Report: Update vpp perf tests release notes

Change-Id: I00bf6cf1d1c38a125be03a82853426e7980e088a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: Do not restart VPP immediately after VPP installation 33/18533/5
Jan Gelety [Mon, 25 Mar 2019 23:49:45 +0000 (00:49 +0100)]
FIX: Do not restart VPP immediately after VPP installation

Change-Id: Ib3ee517c850953fe87f3036702d2924cf41a9998
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoTrending: Set the last build for dpdk-3n-skx 15/18515/1
Tibor Frank [Mon, 25 Mar 2019 15:35:51 +0000 (16:35 +0100)]
Trending: Set the last build for dpdk-3n-skx

 - presentation_new

Change-Id: I2764f6dd90b360ad778510e32d592a6295eb3236
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Set the last build for dpdk-3n-skx 13/18513/1
Tibor Frank [Mon, 25 Mar 2019 15:31:18 +0000 (16:31 +0100)]
Trending: Set the last build for dpdk-3n-skx

Change-Id: Ic38ad46547c9a007cc8d59e44fcf5955956e663e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix vpp-ref 07/18507/1
Tibor Frank [Mon, 25 Mar 2019 13:48:26 +0000 (14:48 +0100)]
Trending: Fix vpp-ref

Change-Id: Ie2da87f9afbe22229a35abcf8598923c888ab7ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Reduce the amount of downloaded data 05/18505/1
Tibor Frank [Mon, 25 Mar 2019 12:43:33 +0000 (13:43 +0100)]
Trending: Reduce the amount of downloaded data

Change-Id: I13aeccc993bbdd98c29845554da714ce10add5c0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix vpp-ref 03/18503/1
Tibor Frank [Mon, 25 Mar 2019 12:32:52 +0000 (13:32 +0100)]
Trending: Fix vpp-ref

Change-Id: I3179175f681a99709445e6603711060e46fa8885
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoRemove main.py as it is confusing 21/18421/2
Peter Mikus [Wed, 20 Mar 2019 13:16:14 +0000 (13:16 +0000)]
Remove main.py as it is confusing

People try to run main.py instead of Robot

Change-Id: Ieff219c9df7586842f796c5fb17500327d71a7d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate and reorder tox.ini TODOs 27/18427/3
Vratko Polak [Wed, 20 Mar 2019 14:15:35 +0000 (15:15 +0100)]
Update and reorder tox.ini TODOs

Change-Id: Ieeb54f3e3cb413f15dfbf6595211fd7158aa1e1a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoConvert functional tests to statefull QemuUtils 22/18422/8
Peter Mikus [Wed, 20 Mar 2019 13:21:26 +0000 (13:21 +0000)]
Convert functional tests to statefull QemuUtils

Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Add note about nr of test runs 51/18451/1
Tibor Frank [Thu, 21 Mar 2019 08:23:34 +0000 (09:23 +0100)]
Report: Add note about nr of test runs

Change-Id: If7a29bb268c422f788b418c597af8305e04847cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1386 KernelVM - Part II 57/18157/42
Peter Mikus [Sat, 9 Mar 2019 08:00:54 +0000 (08:00 +0000)]
CSIT-1386 KernelVM - Part II

- Implementation of KernelVM (ThinVM)
- nf_density tests for KernelVM with VPP as VNF.

Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoietf draft: nfv service density rev. -00 31/17131/10
Maciek Konstantynowicz [Mon, 28 Jan 2019 21:52:02 +0000 (21:52 +0000)]
ietf draft: nfv service density rev. -00

Change-Id: I0490db919b4da198545f4a332fd722855bac84a8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoAdd tox checker for lengths of new lines only 20/18420/1
Vratko Polak [Wed, 20 Mar 2019 12:23:30 +0000 (13:23 +0100)]
Add tox checker for lengths of new lines only

- Still non-voting, but useful.

Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 07/18407/1
Jan Gelety [Tue, 19 Mar 2019 16:54:31 +0000 (17:54 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.04-rc0~214-gcae98b7~b6361

- use new vpp ref build - centos7:
  19.04-rc0~214_gcae98b7~b6184

- use new vpp ref build - ubuntu 18.04:
  19.04-rc0~214-gcae98b72c

Change-Id: I5f8288278576fb28f5bf3754ac18b60cc21e3e6e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Remove VNF 82/18382/4
Tibor Frank [Tue, 19 Mar 2019 14:35:30 +0000 (15:35 +0100)]
Report: Remove VNF

- add comparisons for dnv

Change-Id: I123a925a3c91fba782f152b3cd73f1b63fe50c59
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Configure 1901.1 80/18380/1
Tibor Frank [Tue, 19 Mar 2019 14:05:35 +0000 (15:05 +0100)]
Report: Configure 1901.1

Change-Id: Ica2483bdaebe70b9d6668a36a1b855c52e4d7c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>