csit.git
3 years agoImprove release notes 03/27603/1
Vratko Polak [Mon, 15 Jun 2020 15:26:34 +0000 (17:26 +0200)]
Improve release notes

+ Remove commented-out alternative notes.

Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4d6365deba4c28a8bc305169bb60c47f666c4a87)

3 years agoPAL: Use the reconf term from methodology 02/27602/1
Vratko Polak [Mon, 15 Jun 2020 15:54:55 +0000 (17:54 +0200)]
PAL: Use the reconf term from methodology

+ Instead of the term from test implementation.
+ The parser still looks for the old term.

Change-Id: Ic07ac336085f2bb07f9d906e83b82cb84ebddb24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ae654a8ade2a310effa49723ed577f05812a97ec)

3 years agoReport 2005: Add data 61/27561/1
Tibor Frank [Thu, 18 Jun 2020 07:55:46 +0000 (09:55 +0200)]
Report 2005: Add data

Change-Id: I2d3dd84aca4a1a41e652e4fd0d67fe6cee56bdac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75f8f739279790828ead808be3ecaa5c77b3073c)

3 years agoReport 2005: Add data, remove plots without data 60/27560/1
Tibor Frank [Wed, 17 Jun 2020 11:12:06 +0000 (13:12 +0200)]
Report 2005: Add data, remove plots without data

Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 19b2d3d3cc01a0c0ceab1569bf8f9ca3c848b424)

3 years agoReport 2005: Add data 58/27558/1
Tibor Frank [Wed, 17 Jun 2020 07:29:57 +0000 (09:29 +0200)]
Report 2005: Add data

Change-Id: I14d04b6251a74ade89f43f4733b5f16caccdbd72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3efabd6b8d8730bd0fa1d8df9ad4850412f64469)

3 years agoReport 2005: Fix graphs, tables 57/27557/1
Tibor Frank [Tue, 16 Jun 2020 10:20:50 +0000 (12:20 +0200)]
Report 2005: Fix graphs, tables

Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a6464e9cefe273bd3caea8b672895e208aeb0fcb)

3 years agoReport 2005: Add data 56/27556/1
Tibor Frank [Tue, 16 Jun 2020 06:35:16 +0000 (08:35 +0200)]
Report 2005: Add data

Change-Id: I1ea07802294b498e61774038c3a2ae1bf6fffc7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 60b5545b670cbcb7813d0ca7d6748b83e48072c6)

3 years agoReport 2005: Add data 55/27555/1
Tibor Frank [Mon, 15 Jun 2020 12:25:50 +0000 (14:25 +0200)]
Report 2005: Add data

Change-Id: I022aaef58b1217476d5639bc00328fc56584ac40
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7fb1dad82e15cd065e6aea8071374ae081ba3007)

3 years agoReport 2005: Clean-up graphs and tables 54/27554/1
Tibor Frank [Mon, 15 Jun 2020 11:25:06 +0000 (13:25 +0200)]
Report 2005: Clean-up graphs and tables

Change-Id: Ic0360a8a54e696aad5e7688d9f28808e868d1344
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9b2acc9eea24958d7a84b0b6e77c658497579824)

3 years agoReport 2005: Add data, hide dpdk 3n-tsh 53/27553/1
Tibor Frank [Mon, 15 Jun 2020 07:59:40 +0000 (09:59 +0200)]
Report 2005: Add data, hide dpdk 3n-tsh

Change-Id: Id2c83dc218ad766008f65e2ad218eb01444cde07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a37d06fd84d6653990e39c135252ef1623d0ccfd)

3 years agoReport 2005: Add data 18/27518/1
Tibor Frank [Fri, 12 Jun 2020 11:48:16 +0000 (13:48 +0200)]
Report 2005: Add data

Change-Id: I86da78cc8b828afc6650a67c7d205ca8512f9cad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b366c098031d995015fea0a56113c29a5fcd9a68)

3 years agoReport 2005: Add data 17/27517/1
Tibor Frank [Fri, 12 Jun 2020 09:43:01 +0000 (11:43 +0200)]
Report 2005: Add data

Change-Id: Ib5d8dd2b278865d1718c40383298b78d1e755759
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 566af41a85f6fb2fd6a6e0117456ec83d4e2a6c6)

3 years agodocs: update 2n-skx job_specs for report_iterative 11/27511/1
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:03:25 +0000 (13:03 +0100)]
docs: update 2n-skx job_specs for report_iterative

Changes in vpp-2n-skx.md:
- all nfv_density moved to separate file vpp-2n-skx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-skx/ and
  renamed

Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6fa263815306b43ab1813360f0123e8a245b4b56)

3 years agodocs: update 2n-clx job_specs for report_iterative 10/27510/1
Maciek Konstantynowicz [Wed, 10 Jun 2020 11:49:31 +0000 (12:49 +0100)]
docs: update 2n-clx job_specs for report_iterative

Changes in vpp-2n-clx.md:
- all nfv_density moved to separate file vpp-2n-clx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-clx/ and
  renamed

Change-Id: I639abe794bde511d27cefa50db2860945dcc0050
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 1dbd6729f2a6ec77f0d9e867d2bf858d9b5db488)

3 years agodocs: update 3n-skx job_specs for report_iterative 09/27509/1
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:17:23 +0000 (13:17 +0100)]
docs: update 3n-skx job_specs for report_iterative

Changes in vpp-3n-skx.md:
- all nfv_density moved to separate file vpp-3n-skx-nfv-density.md
- removed intel-x710: dot1q (except "./vm_vhost")
- removed drv_vfio_pci: dot1q, ipsec aes128cbc
- removed nat44, iacl, oacl

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/3n-skx/ and
  renamed

Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6b5f02d7f004003e4d87d62f6add260ea126c0da)

3 years agoUpdate selection of report-iterative test sets 08/27508/1
Tibor Frank [Thu, 11 Jun 2020 10:17:41 +0000 (12:17 +0200)]
Update selection of report-iterative test sets

- Create the same directory structure for report-iterative as it is
  for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
  report-coverage.
- Update the corresponding functionality in
  resources/libraries/bash/function/common.sh

The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.

Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 806a069bc5494d1c43dd9711e1512e518c823acd)

3 years agoReport 2005: Add data 07/27507/1
Tibor Frank [Thu, 11 Jun 2020 08:49:17 +0000 (10:49 +0200)]
Report 2005: Add data

Change-Id: Iea03f5f49f68ef2f65040f778108592f7b44ead3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c056a4fe51febfae290209c0d39b23bd63b6542a)

3 years agoReport 2005: Add data, 2n-clx x533 cur vs prev tab 06/27506/1
Tibor Frank [Wed, 10 Jun 2020 13:51:55 +0000 (15:51 +0200)]
Report 2005: Add data, 2n-clx x533 cur vs prev tab

CSIT-1727

Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 972b5c9a4f25982865067dc08325c7ea16cfcd96)

3 years agodocs: update 2n-dnv job_specs for report_coverage 41/27441/2
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:11:33 +0000 (13:11 +0100)]
docs: update 2n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 61012e6fc1590376b327ebdc026be8278a277611)

3 years agodocs: update 3n-hsw job_specs for report_coverage 02/27502/2
Maciek Konstantynowicz [Fri, 5 Jun 2020 18:24:34 +0000 (19:24 +0100)]
docs: update 3n-hsw job_specs for report_coverage

Removed for all tests: all packet sizes 4c, 9000B 2c.
Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/

Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 3921adc2cfbbdbba28ed94a3dd19bb80a0d85702)

3 years agodocs: update 3n-dnv job_specs for report_coverage 04/27504/2
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:53:25 +0000 (13:53 +0100)]
docs: update 3n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 366ac57ae0c775c4e60326ee51ce6659f841c0a9)

3 years agodocs: update 2n-skx job_specs for report_coverage 03/27503/2
Maciek Konstantynowicz [Fri, 5 Jun 2020 11:57:13 +0000 (12:57 +0100)]
docs: update 2n-skx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a33f758a6bca9c48940e7d69476cb78274395765)

3 years agodocs: update 3n-skx job_specs for report_coverage 05/27505/1
Maciek Konstantynowicz [Tue, 9 Jun 2020 15:51:42 +0000 (16:51 +0100)]
docs: update 3n-skx job_specs for report_coverage

Removed tests:
- crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c
- all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c

Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b4782ed542da67f619f1c043a8c6e23be81f715d)

3 years agoReport 2005: Add data 40/27440/1
Tibor Frank [Wed, 10 Jun 2020 10:17:47 +0000 (12:17 +0200)]
Report 2005: Add data

Change-Id: Ida07c263b93f30d146a32502245f425f898b87ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d76c78f267719c6ecdff22a40689117ee8cc1266)

3 years agoReport 2005: vpp-device static content 39/27439/1
Jan Gelety [Thu, 28 May 2020 20:50:12 +0000 (22:50 +0200)]
Report 2005: vpp-device static content

Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 6ebf54b7c0471d2723066e051307bff5561f63d1)

3 years agoReport 2005: Add data 37/27437/1
Tibor Frank [Tue, 9 Jun 2020 07:49:21 +0000 (09:49 +0200)]
Report 2005: Add data

Change-Id: I2b440c144a63720c2451f1b42d218f2e9d9c59bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e84eec8494a5f13fce73e13dfdb38af90608edb7)

3 years agoReport 2005: Add data, configure 2005.24 34/27434/1
Tibor Frank [Mon, 8 Jun 2020 10:14:09 +0000 (12:14 +0200)]
Report 2005: Add data, configure 2005.24

Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ba7130cebc9bc6ef66b9eb4f0e7d888462e10e48)

3 years agoReport 2005: Add data 31/27431/1
Tibor Frank [Thu, 4 Jun 2020 09:31:54 +0000 (11:31 +0200)]
Report 2005: Add data

Change-Id: I94f24c68c47cd3a93655d724b25e9cd0544d3400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2fab22524dac3f5aaa26dde53f74d15974e29901)

3 years agoReport 2005: Add data 30/27430/1
Tibor Frank [Thu, 4 Jun 2020 08:17:52 +0000 (10:17 +0200)]
Report 2005: Add data

Change-Id: Iab39f728760211694d1890078ba9db2fb7f18928
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4b145ea098f99b8305b5c94a66d3afa273e884f2)

3 years agoReport 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr 25/27425/1
Tibor Frank [Wed, 3 Jun 2020 13:56:08 +0000 (15:56 +0200)]
Report 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr

Change-Id: I7456a0bde176eb70492a4cc7be1412270b3e2b3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c08ca318fa9e8ee7d1396d6e6173135afef684da)

3 years agoReport 2005: Fix wrong indentation in spec file 24/27424/1
Tibor Frank [Wed, 3 Jun 2020 12:59:13 +0000 (14:59 +0200)]
Report 2005: Fix wrong indentation in spec file

Change-Id: Ifef31f84884cb9fd33d88e0806273905a4bb8e3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 638d32aed060bfe3db655f46c3d052a4bd3ec0cd)

3 years agoReport 2005: Add data 23/27423/1
Tibor Frank [Wed, 3 Jun 2020 12:49:30 +0000 (14:49 +0200)]
Report 2005: Add data

Change-Id: I0599426a0980c61a7fb21e56e9a7d6574e21c75d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1780255993d981987fad2e27a3afef71532a060a)

3 years agoFIX: IP4 IP6 3n-only 80/27380/1
pmikus [Wed, 3 Jun 2020 10:52:37 +0000 (10:52 +0000)]
FIX: IP4 IP6 3n-only

ARP not resolved as ARP plugin is not in use.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I655d39794f99e32a2f3905154d78e83853356ccf
(cherry picked from commit 7b226db0db360edcf3062dc794d64d25eb5ed57b)
(cherry picked from commit 39f23d400066df1826910a7d59250c3cbf560651)

3 years agoReport 2005: Add data 78/27378/1
Tibor Frank [Tue, 2 Jun 2020 18:38:52 +0000 (20:38 +0200)]
Report 2005: Add data

Change-Id: I0a1fa4bdefef7a6335e0a99dba8945fa3e82f28f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6a0b39bd8e0dd1bed25e98632ee45f9a88e071d3)

3 years agoReport 2005: Add data 77/27377/1
Tibor Frank [Tue, 2 Jun 2020 11:18:10 +0000 (13:18 +0200)]
Report 2005: Add data

Change-Id: Ic834b63c790396b4c8cce490cb084e4b3b2f93b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e1a91c854a401ff42319d50b7d53ffe8bd30bd0a)

3 years agoReport 2005: Add data 76/27376/1
Tibor Frank [Tue, 2 Jun 2020 09:16:36 +0000 (11:16 +0200)]
Report 2005: Add data

Change-Id: I58928d0138d9a7aeec6b3b4fc842537587fd6a6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bd3bcde273540e50602c24592c4aa41500ddcd85)

3 years agoReport 2005: Add data 68/27368/1
Tibor Frank [Mon, 1 Jun 2020 11:56:46 +0000 (13:56 +0200)]
Report 2005: Add data

Change-Id: Ib5515b03089069f37c8b135efe47ed5f2058f358
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b6e80a6cb4386192e9cd87551e288b6d3b5f497c)

3 years agoReport: Add data 67/27367/1
Tibor Frank [Mon, 1 Jun 2020 10:12:41 +0000 (12:12 +0200)]
Report: Add data

Ticket: CSIT-1723
Type: data

Change-Id: Iae3abf0740160e96bcd3126af9a8be04abf22db3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0bd85966e884d76dfb85bc1e6e4ee74658c01197)

3 years agoReport 2005: Add data 66/27366/1
Tibor Frank [Mon, 1 Jun 2020 06:32:03 +0000 (08:32 +0200)]
Report 2005: Add data

Ticket: CSIT-1723
Type: data

Change-Id: I4459da5ab5648d68599e8405d230047a6f4be0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 96a729f3fc001724044835d06c8c143e31d3c636)

3 years agoReport: Add data and dpdk comparison tables 16/27316/1
Tibor Frank [Fri, 29 May 2020 09:01:13 +0000 (11:01 +0200)]
Report: Add data and dpdk comparison tables

+ data:
  + vpp-device
  + perf-sel-3n-hsw
  + dpdk-3n-hsw
  + dpdk-3n-skx
  + dpdk-2n-skx
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv

+ comparison tables current vs previous:
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv
  + dpdk-3n-tsh

Ticket: CSIT-1723
Type: data

Change-Id: I3a29e7eb8f3a4106d2819362db0078c3b2091275
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f8103a10cf197c4b28a3d48abcf1bb6f16db5016)

3 years agoFIX: check if testpmd is alive 15/27315/1
Jan Gelety [Wed, 27 May 2020 01:55:11 +0000 (03:55 +0200)]
FIX: check if testpmd is alive

Change-Id: I12f21a4a7ae7c8593c42fa8e6cc4d65e36d41270
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 018dc06b3cf5fdd4733a1221f9592a48ddd6664c)

3 years agoRemove hugepage dirs when killing dpdk 14/27314/1
Juraj Linkeš [Thu, 28 May 2020 06:52:21 +0000 (08:52 +0200)]
Remove hugepage dirs when killing dpdk

There could be directories under /dev/hugepages/ so remove those as
well.

Change-Id: I8ecdde159b8e0049460d0bcdc8b1a2c85b1ed25f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 292604dff945080639021fb4ffe524c6aed3ff07)

3 years agoReport: Fix links to html tables 13/27313/1
Tibor Frank [Thu, 28 May 2020 09:50:45 +0000 (11:50 +0200)]
Report: Fix links to html tables

Type: Fix

Change-Id: Ic4bc131ba7dac6c3f3e984a2fa224633a5cb6f86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d91be0977ab077324d95d5a50702d4cb244b686a)

3 years agoPAL: Improvements in tables and formatting 12/27312/2
Tibor Frank [Wed, 27 May 2020 10:57:58 +0000 (12:57 +0200)]
PAL: Improvements in tables and formatting

+ legend
+ footnote
+ output to log
+ fix formatting in the methodology section

Type: Improvements

Change-Id: I605615a602b239265fc6768a65c8d33dd793d4c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 836cdd8930dd7383d5c59a4ae407864a1e03040f)

3 years agoUse vpp 20.05-release packages 99/27299/1
Jan Gelety [Tue, 26 May 2020 16:41:08 +0000 (18:41 +0200)]
Use vpp 20.05-release packages

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I2b1163567a86924e1a321dae2f977385d8b0a604

3 years agoFIX: do not fail when skipping patch for l3fwd 08/27308/1
Jan Gelety [Tue, 26 May 2020 13:10:07 +0000 (15:10 +0200)]
FIX: do not fail when skipping patch for l3fwd

Change-Id: I1159fb29d43f61628922cdbd51313f710aa72f4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit cb0188995fc92673b0d5701207a3b4dc7801589c)

3 years agoPAL: Fix table_comparison again 02/27302/1
Tibor Frank [Wed, 27 May 2020 08:57:46 +0000 (10:57 +0200)]
PAL: Fix table_comparison again

Change-Id: Ie408afd7bb8390ebe2fc90eca6daf8da44d22e3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ea4fcebabfaac866d469a7b4355ac8df7732a0f)

3 years agoPAL: Fix table_comparison 61/27261/1
Tibor Frank [Wed, 27 May 2020 08:18:24 +0000 (10:18 +0200)]
PAL: Fix table_comparison

Type: Fix

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I532cdb0967708e48bc9f9c5e87f96f95acbb9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cab556a47fee3858bd3ef9fc33eb84a563f0e82d)

3 years agoReport: configure report rls2005 59/27259/3
Tibor Frank [Tue, 26 May 2020 13:52:55 +0000 (15:52 +0200)]
Report: configure report rls2005

Ticket: CSIT-1722
Type: feature

Change-Id: I76f7f323f000cbfc802c6206b6232665bb88448c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7248cf97d0f950cda2e1167478d44455e03ddc8d)

3 years agoReport: Infra update 60/27260/1
pmikus [Tue, 5 May 2020 12:30:44 +0000 (12:30 +0000)]
Report: Infra update

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie39585e88460d9a5e3764726d93dc065f5cbacfb
(cherry picked from commit 9c459a2b303eb8d776ac040bc82830d850a67623)

3 years agoFIX: add dpdk mrr_weekly and report_iterative job specs 52/27252/1
Jan Gelety [Mon, 25 May 2020 15:50:28 +0000 (17:50 +0200)]
FIX: add dpdk mrr_weekly and report_iterative job specs

- split job specs to directories

Change-Id: I9a71621216ab0bdf85d147ce03f473e7cbb0b266
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit ae81c6c8ea54cd0ceee739fbce5d7e2445689ecb)

3 years agoAdd csit-vpp/dpdk-perf-report-coverage job and job specifications 51/27251/1
Jan Gelety [Fri, 8 May 2020 10:38:01 +0000 (12:38 +0200)]
Add csit-vpp/dpdk-perf-report-coverage job and job specifications

- note: currently dpdk report-coverge test sets are equal to dpdk
  report-iterative test sets

Change-Id: Ib9a718bfea4b24842742f49ee2eca022aa8a08e5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit f7c08d2bd14872ad888df9b95b823ab1784aa737)

3 years agoFIX: vts perf tests 65/27265/1
Jan Gelety [Mon, 25 May 2020 20:50:00 +0000 (22:50 +0200)]
FIX: vts perf tests

Change-Id: Ie144c22575a7976da0c77e787e450355b73b0006
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 89/27189/1
Jan Gelety [Sat, 9 May 2020 13:00:56 +0000 (15:00 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc2

 - use new vpp ref build - centos7:
   20.05-rc2~b13

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Id1d17eff3839853468a3db4fd999e86b77d1a01c

3 years agoUpdate of VPP_STABLE_VER files 17/27117/2
Jan Gelety [Fri, 8 May 2020 06:03:59 +0000 (08:03 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc1~1-g765ef3767

 - use new vpp ref build - centos7:
   20.05-rc1~1_g765ef37~b3

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I7c33da770cdea3fca30f9ee40de4e1a453f11cbc

3 years agoAdd csit-vpp-perf-report-iterative job 81/27081/1
Jan Gelety [Thu, 7 May 2020 20:53:56 +0000 (22:53 +0200)]
Add csit-vpp-perf-report-iterative job

- job will be used to collect vpp performance iterative data
  for csit report

Change-Id: I4cff5caa0a97d08b11f3eb9b72963deaf1b04c73
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit de08ebfec25d2d9bb3f3b46c07a5bcb9efd24d1c)

3 years agoAnsible: Small maintenance 69/27069/1
pmikus [Wed, 13 May 2020 11:46:46 +0000 (11:46 +0000)]
Ansible: Small maintenance

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I542401d77a777dfc2d930de626e19c1d8083941c
(cherry picked from commit f9f7672ff42274dd05320c153cd8efc7a9986e7e)

3 years agoExecute also show runtime CLI 68/27068/1
Vratko Polak [Thu, 9 Apr 2020 09:03:28 +0000 (11:03 +0200)]
Execute also show runtime CLI

Example of a test with missing info:
https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-clx/287/archives/log.html.gz#s1-s1-s1-s4-s8-t3-k2-k9-k1-k1-k4-k1
- Missing any -outpt and -tx nodes.
- Zeros in vectors in rdma-input node (even though calls are there).

Placing the CLI call after the stats one,
to confirm stats does not "break" the CLI.

+ Using an earlier parent, to dodge some test failures.

Change-Id: I79072b54b6bf964dab4f21428e186394bafda72a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoFIX: Download only vpp packages 60/27060/1
Jan Gelety [Thu, 7 May 2020 15:05:30 +0000 (17:05 +0200)]
FIX: Download only vpp packages

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I88682b972947d73ae8433b550bd5e96b0b7c2c76

3 years agoUpdate of VPP_REPO_URL and VPP_STABLE_VER files 55/27055/3
Jan Gelety [Thu, 7 May 2020 12:29:20 +0000 (14:29 +0200)]
Update of VPP_REPO_URL and VPP_STABLE_VER files

- use vpp builds from vpp stable/2005 branch

- use new vpp ref build - ubuntu 18.04:
  20.05-rc1

- use new vpp ref build - centos7:
  20.05-rc1~b2

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Ic9827612b8f96d84ceef617ac6d4f4080e2ad08e

3 years agoInfra: PIP installation freeze 67/27067/1
pmikus [Wed, 13 May 2020 06:06:47 +0000 (06:06 +0000)]
Infra: PIP installation freeze

+ Waiting for Docker image to be updated. Then next step
  I will disable any update attempt.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I92d4e27be0537a95473cd723a45e6185b26ce599
(cherry picked from commit 49bf78210fe2361beefd48b74e76f96484b5abd2)

3 years agojob-specs: new job test spec files including test count and durations 19/25619/9
Jan Gelety [Tue, 3 Mar 2020 14:55:27 +0000 (15:55 +0100)]
job-specs: new job test spec files including test count and durations

Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Disable pdf version 35/27035/1
Tibor Frank [Wed, 13 May 2020 11:37:45 +0000 (13:37 +0200)]
Report: Disable pdf version

Change-Id: I1dd0c4289c1318916b5351b378db8a85f136539f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add perf-sel set to oper tables 34/27034/1
Tibor Frank [Wed, 13 May 2020 11:34:26 +0000 (13:34 +0200)]
Report: Add perf-sel set to oper tables

Change-Id: If63bae7ee3dc439633e69e5b507dcaf262fabadf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: SRv6 encap 32/27032/1
Jan Gelety [Thu, 7 May 2020 02:41:16 +0000 (04:41 +0200)]
FIX: SRv6 encap

Change-Id: I4b75b343fc144489d81f82dbb4917b4a70a9911b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Fix bad chars for LaTex 31/27031/1
Tibor Frank [Wed, 13 May 2020 07:58:15 +0000 (09:58 +0200)]
Report: Fix bad chars for LaTex

Change-Id: I776dbe0ef7761dbc647b22f709ea1debbeddd718
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data, add pdf version 28/27028/1
Tibor Frank [Wed, 13 May 2020 04:42:30 +0000 (06:42 +0200)]
Report: Add data, add pdf version

Change-Id: I8c972aa7a1689494adc93d9c3c881e419913f47e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: L3fwd properly 18/27018/2
pmikus [Tue, 12 May 2020 13:39:57 +0000 (13:39 +0000)]
FIX: L3fwd properly

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881

3 years agoReport CSIT-2001: updated rls notes for VPP. 11/27011/4
Maciek Konstantynowicz [Tue, 12 May 2020 11:09:26 +0000 (12:09 +0100)]
Report CSIT-2001: updated rls notes for VPP.

Change-Id: I64853402cf6301a99ee97a463a5984516b52b0d3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport CSIT-2001: updated CSIT environment ver. 2 date to 2020-03-27 per repo. 13/27013/1
Maciek Konstantynowicz [Tue, 12 May 2020 11:36:59 +0000 (12:36 +0100)]
Report CSIT-2001: updated CSIT environment ver. 2 date to 2020-03-27 per repo.

Change-Id: Id797295397c7159264ce7f457e6fd60af3d805bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport 2001: updated 2n-/3n-skx RCA yaml files with jira tickets. 09/27009/3
Maciek Konstantynowicz [Tue, 12 May 2020 10:17:12 +0000 (11:17 +0100)]
Report 2001: updated 2n-/3n-skx RCA yaml files with jira tickets.

Change-Id: I79b874ad00b0d8a0be80de0be52df656a2ce36d6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Fix header of comp tables, add data 07/27007/1
Tibor Frank [Tue, 12 May 2020 09:01:46 +0000 (11:01 +0200)]
Report: Fix header of comp tables, add data

Change-Id: I6d8727a08dce888bfbc620ebe34b6bd35bac488b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-1597 API cleanup: ipsec 07/26807/3
Jan Gelety [Wed, 29 Apr 2020 06:24:16 +0000 (08:24 +0200)]
CSIT-1597 API cleanup: ipsec

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26276
- update vpp stable to version 20.05-rc0~727

Change-Id: I39a0b5e60fac6a74aff2426f6a448c0e117ab647
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Update to version numbering for RCA tables 74/26974/3
Tibor Frank [Mon, 11 May 2020 12:51:39 +0000 (14:51 +0200)]
Report: Update to version numbering for RCA tables

Change-Id: I7af3ef9ad545fa31477fc8f3403156c6aaea82f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate RCA1, RCA2 descriptions for 2n-skx, 3n-skx. 14/26814/4
Vratko Polak [Mon, 4 May 2020 09:10:00 +0000 (11:10 +0200)]
Update RCA1, RCA2 descriptions for 2n-skx, 3n-skx.

Change-Id: I729229a42a00aa4b93cb3d8331718413ca9e297c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Configure report 2001.20 38/26938/2
Tibor Frank [Thu, 7 May 2020 08:19:56 +0000 (10:19 +0200)]
Report: Configure report 2001.20

Change-Id: Ib0a3190dfd5b216aa9ff93d751fa48cd42cef88f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoperf: refactor 'setup suite topology interfaces' 52/26652/13
Dave Wallace [Thu, 23 Apr 2020 01:00:39 +0000 (01:00 +0000)]
perf: refactor 'setup suite topology interfaces'

- and 'setup suite topology interfaces no tg' to
  use a common keyword to create suite variables
  using the required topology information.

Change-Id: I46894948bc86eb7ce72d036e5b84f09c5c1385db
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoReport: Add data 37/26937/1
Tibor Frank [Thu, 7 May 2020 08:10:15 +0000 (10:10 +0200)]
Report: Add data

Change-Id: If1d8025104b0cb04eee138d77c5c50c774a52753
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Pre-check tests 47/26747/5
Peter Mikus [Tue, 28 Apr 2020 12:50:18 +0000 (12:50 +0000)]
Ansible: Pre-check tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I745ceb519220c4d08951dff07350f2f4709f3533

3 years agoTrending: NDRPDR dashboard 00/26900/6
Tibor Frank [Wed, 6 May 2020 12:38:29 +0000 (14:38 +0200)]
Trending: NDRPDR dashboard

Change-Id: I7f4c84dd47874c484f34f389b93de635c66a77c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: dot1q-ip6 30/26930/2
pmikus [Wed, 6 May 2020 17:15:29 +0000 (17:15 +0000)]
FIX: dot1q-ip6

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ied48646bd9de41e5a55e0006440d057c5fddf694

3 years agoAnsible: Remove cobbler 10/26810/2
Peter Mikus [Thu, 30 Apr 2020 13:19:59 +0000 (13:19 +0000)]
Ansible: Remove cobbler

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I34446125071ee7157e1c0e29027a6d973ee03c7e

3 years agoSeparate files needing GPL license 43/23143/31
Vratko Polak [Mon, 4 May 2020 11:05:26 +0000 (13:05 +0200)]
Separate files needing GPL license

+ Keep apache license for now, until this is completed:
  https://wiki.fd.io/view/TSC/Relicensing_Procedure
+ Add utilities for switching license comment blocks.
 - They do not preserve attributes, so executable flag is lost.
+ Move the affected files to GPL/.
 + Update paths so files are executed from the new location.
 + Change the way scripts are started to do not require executable flag.
 + Employ OptionString when constructing longer command lines.
+ Move also PacketVerifier.py and TrafficScriptArg.py
  as they are linked with traffic scripts.
 + That means the two files are outside "resources" package tree now.
 + Added __init__.py files so relative imports work in new package tree.
+ Start traffic scripts as python modules to allow relative imports.
 + Once again needed because they are outside the default PYTHONPATH.

Change-Id: Ieb135629e890adbaf5b79497570f3be25b746f9f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoPerformance: Fix l3fwd in 3node 23/26923/1
pmikus [Wed, 6 May 2020 13:53:45 +0000 (13:53 +0000)]
Performance: Fix l3fwd in 3node

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I32fd935078fb117bb1570e20a11baa2de46447e8

3 years agoReport 2001: Add data 92/26892/1
Tibor Frank [Wed, 6 May 2020 07:57:51 +0000 (09:57 +0200)]
Report 2001: Add data

Change-Id: I19e2d6a2592fc0f742cde6078eeb726f3703f306
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 91/26891/1
Tibor Frank [Wed, 6 May 2020 05:27:07 +0000 (07:27 +0200)]
Report: Add data

Change-Id: I50c8125dbc1040d8f85790a0065b282905ff64b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: CSIT-1301: Display stdev in hover info 37/26837/13
Tibor Frank [Mon, 4 May 2020 07:13:01 +0000 (09:13 +0200)]
Trending: CSIT-1301: Display stdev in hover info

+ make possible to use dashboard for ndrpdr tests
+ fixes in ndrpdr weekly comparison

Change-Id: I846dc207ea620fad78424a445b32095160d4431d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoperf: remove hoststack wrk cps/rps test suites. 22/26822/2
Dave Wallace [Fri, 1 May 2020 20:36:54 +0000 (20:36 +0000)]
perf: remove hoststack wrk cps/rps test suites.

- The VSAP project will be adding hoststack
  connections-per-second and requests-per-second
  tests of the hoststack using the Apache 'ab'
  test tools.
- WRK infra in /resources/libraries will be
  cleaned up separately as a part of the
  hoststack + LDP + nginx test suite.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Ic1d2f4299e8b6ae6be84283f22f6e28dd05bd80f

4 years agoFIX: IPsec 67/26867/3
vagrant [Mon, 4 May 2020 14:06:04 +0000 (14:06 +0000)]
FIX: IPsec

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iacd7aa49d9832233033fe18fc228ccd45c12b4db

4 years agoPrint more info when checking out oper branch 63/26863/1
Vratko Polak [Mon, 4 May 2020 15:12:28 +0000 (17:12 +0200)]
Print more info when checking out oper branch

Change-Id: Ic8d1080edacea1d27eb80e61f48cd4cd4430c139
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add data 38/26838/1
Tibor Frank [Mon, 4 May 2020 11:30:00 +0000 (13:30 +0200)]
Report: Add data

Change-Id: I816a65b70f0d85572e398e7e6677a287cf739192
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVPP-DEV API Coverages: SRv6 19/26619/47
Jan Gelety [Tue, 31 Mar 2020 16:19:03 +0000 (18:19 +0200)]
VPP-DEV API Coverages: SRv6

Jira: CSIT-1698

Change-Id: I6d9154284990df8877850e4014716510016e485b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Configure report 2001.19 36/26836/1
Tibor Frank [Mon, 4 May 2020 06:17:26 +0000 (08:17 +0200)]
Report: Configure report 2001.19

Change-Id: I42d2723745a119667b8af2165fbd99dc4fe3cc3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Fix typo in specification. 35/26835/1
Tibor Frank [Mon, 4 May 2020 04:29:53 +0000 (06:29 +0200)]
Report: Fix typo in specification.

Change-Id: Ie61f8c1eef8828ce30f82e33ef0c40b8f77de26b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoPAL: Comparison tables 74/26774/10
Tibor Frank [Wed, 29 Apr 2020 09:28:49 +0000 (11:28 +0200)]
PAL: Comparison tables

- Add tags to columns in "table_comparison"
- replace "table_perf_comparison" by "table_comparison"
- replace "table_perf_comparison_nic" by "table_comparison"

Change-Id: Ie9d871cb2fe04ab2efbc07737806826161a55ef4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: dot1qip4vxlan-l2bd 79/26779/2
Peter Mikus [Wed, 29 Apr 2020 15:09:19 +0000 (15:09 +0000)]
FIX: dot1qip4vxlan-l2bd

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia4415090263357d16cfd5f5bc93931ded5688557

4 years agoAPI: Add collection for 26276/7 77/26777/1
Jan Gelety [Wed, 29 Apr 2020 02:00:00 +0000 (04:00 +0200)]
API: Add collection for 26276/7

Change-Id: Ib65e3268e04fd4a7908e3e7c3c4217807f47a38b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Add data 73/26773/1
Tibor Frank [Wed, 29 Apr 2020 08:41:35 +0000 (10:41 +0200)]
Report: Add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I05ca2f6d33049809dd7b71a35923328e7b30a462

4 years agoCSIT-1597 API cleanup: lisp 04/26604/7
Jan Gelety [Tue, 31 Mar 2020 00:59:44 +0000 (02:59 +0200)]
CSIT-1597 API cleanup: lisp

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24663
- update vpp stable to version 20.05-rc0~637
- remove unused L1 and L2 lisp KWs

Change-Id: I2672b6a375ad70c82f331dcc991c145e868108b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: crc for create_vhost_user_if 45/26745/1
Jan Gelety [Tue, 28 Apr 2020 12:22:36 +0000 (14:22 +0200)]
FIX: crc for create_vhost_user_if

Change-Id: Ia43679c440da62ba44ad74d4c1eb9003b4ba0a63
Signed-off-by: Jan Gelety <jgelety@cisco.com>