csit.git
3 years agoFramework: 3n-tsh topology file update 97/30497/1 rls2005
Juraj Linkeš [Fri, 18 Dec 2020 08:47:56 +0000 (09:47 +0100)]
Framework: 3n-tsh topology file update

The TG is now shared, update port and user accordingly.

Change-Id: I8be4f41887498ae42935b7ab22a7f22dc21e6b50
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 1d6448f6c2eea55ec82694b30d6d5081ff631482)

3 years agoReport 2005: Add data, configure rls2005.32 26/28126/1
Tibor Frank [Wed, 5 Aug 2020 04:52:06 +0000 (06:52 +0200)]
Report 2005: Add data, configure rls2005.32

Change-Id: I79129cac48c60a959e4dc1ebfc9d63b9b230e933
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 959817353670be9d1b1502515bdeb9c8d201e4a0)

3 years agoUpdate RCA files with new findings 19/28119/1
Vratko Polak [Wed, 29 Jul 2020 12:33:10 +0000 (14:33 +0200)]
Update RCA files with new findings

Change-Id: I0db4d513cdc84c6f8c1e2dffa46cd41e13df5b21
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit fa87e0689e8712833478c9f921c1477af21aa575)

3 years agoReport 2005: Add data 34/27934/1
Tibor Frank [Fri, 24 Jul 2020 05:14:07 +0000 (07:14 +0200)]
Report 2005: Add data

Change-Id: Id91ac52634fbf4c6b931a61946eb7a9d8019dd76
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 242fc4d3af75bd8bc34dbff48aa6d56613df8688)

3 years agoReport 2005: Configure rls2005.31, add data 33/27933/1
Tibor Frank [Thu, 23 Jul 2020 05:54:18 +0000 (07:54 +0200)]
Report 2005: Configure rls2005.31, add data

Change-Id: I87e07e334783e10dc863194f240e5dbcbf141915
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 40537fb9c1045de244424ea989bb0e84d8640b8b)

3 years agoReport 2005: Add data 31/27931/1
Tibor Frank [Wed, 22 Jul 2020 05:43:36 +0000 (07:43 +0200)]
Report 2005: Add data

Change-Id: Ic6574e2bb24ce4004ed8c917d9deeff9a45b37ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6b89bd6c8f47b834420c31bfc64e1347c1dd0b46)

3 years agoReport 2005: Add data 29/27929/1
Tibor Frank [Tue, 21 Jul 2020 07:54:24 +0000 (09:54 +0200)]
Report 2005: Add data

Change-Id: I677f2aa67bcd51a31509aefacbe9c428578beec5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c982b0e388f573599c1d1cb92e4e87748c9efbcf)

3 years agoReport 2005: Add data 28/27928/1
Tibor Frank [Mon, 20 Jul 2020 17:58:24 +0000 (19:58 +0200)]
Report 2005: Add data

Change-Id: I312d707aeb5feccacb393009e6cd02959ced4145
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 580b42cbdb1ad76c58b205cb6c96ff9ab618db3a)

3 years agoReport 2005: Add data 27/27927/1
Tibor Frank [Sun, 19 Jul 2020 19:23:08 +0000 (21:23 +0200)]
Report 2005: Add data

Change-Id: I4c674a7821a83b523a9406515849d10341a0d2ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5814b1228cbb3a81401021ecfb053c9bd82b99f1)

3 years agojob-specs: Align 2n-skx nfv tests with 2n-clx 26/27926/1
Tibor Frank [Wed, 15 Jul 2020 13:33:35 +0000 (15:33 +0200)]
job-specs: Align 2n-skx nfv tests with 2n-clx

Change-Id: I6c828ee146bab8ebdb24be6b03369f6e772d25c8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 65c5cb181bd5bc774c5eab6c7a1c82c68597c248)

3 years agoReport 2005: Add data 25/27925/1
Tibor Frank [Fri, 17 Jul 2020 06:59:45 +0000 (08:59 +0200)]
Report 2005: Add data

Change-Id: I1d1b802481449c29056e541752228c47a6e3ea72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 524a5f35dab6f5dfe2eabb4852661f7c391a1cd5)

3 years agoReport 2005: Add data 23/27923/1
Tibor Frank [Thu, 16 Jul 2020 11:47:35 +0000 (13:47 +0200)]
Report 2005: Add data

Change-Id: I24215fa78d3ee9affb301d22c655b925dbb5bc14
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d9797db2c4640086be61ac68d7955ca6254ecd7f)

3 years agoReport 2005: Configure 2005.30, add data 22/27922/1
Tibor Frank [Wed, 15 Jul 2020 12:04:11 +0000 (14:04 +0200)]
Report 2005: Configure 2005.30, add data

Change-Id: I33908f6967e89e894560fd5f63c57a76c110e9ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2d15c9658eafe1fcbc082c92e29f48d3d1fe7333)

3 years agoReport 2005: Add pdf version 98/27898/1
Tibor Frank [Wed, 15 Jul 2020 08:31:13 +0000 (10:31 +0200)]
Report 2005: Add pdf version

Change-Id: I020559c4782b98700dfe5606a80695a1cfecbdcf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4be6395c5b8c1678faf1bdc3cfc1f72e98fce425)

3 years agoreport: 2n-clx, 2n-skx, 3n-skx RCA edits in comparison tables 96/27896/1
Maciek Konstantynowicz [Mon, 13 Jul 2020 16:14:16 +0000 (18:14 +0200)]
report: 2n-clx, 2n-skx, 3n-skx RCA edits in comparison tables

Change-Id: I9810b0b33355d880b606d7402564a3150d12397c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7d81bdcc650170eaa304defbf6b3b006245697fb)

3 years agoreport: Updated vpp performance tests release notes 95/27895/3
Maciek Konstantynowicz [Tue, 14 Jul 2020 10:09:14 +0000 (12:09 +0200)]
report: Updated vpp performance tests release notes

Change-Id: I1028f4fc9d0f38d70ba8b838a66f74274e534a40
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 0c97a55b6e70752ddc538c4166f498efabf802c0)

3 years agoReport 2005: Fix legend in comparison tables 94/27894/1
Tibor Frank [Tue, 14 Jul 2020 09:31:09 +0000 (11:31 +0200)]
Report 2005: Fix legend in comparison tables

Change-Id: I79265bb14c6daf75944ed596c21b9929f8524333
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c019e7db51461d5385ac5b26f708e6a25de85dec)

3 years agoReport 2005: Add soak tests 93/27893/1
Tibor Frank [Tue, 14 Jul 2020 06:02:38 +0000 (08:02 +0200)]
Report 2005: Add soak tests

Change-Id: Ib56215e906afba34d52b390ebc5a2d58bab4bf71
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 33d6c8475fa6e9f4a204f869ced4b2a802da5248)

3 years agoReport 2005: Add NFV tests 92/27892/1
Tibor Frank [Mon, 13 Jul 2020 11:42:13 +0000 (13:42 +0200)]
Report 2005: Add NFV tests

- 2n-skx - ndrpdr, mrr
- 2n-clx - ndrpdr, mrr

Change-Id: I75f78a3986b17bb03187a4cc91260c4a60a7d515
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c22a63d5813100d9fbdc8f43ba58f3cd3546641b)

3 years agoReport: remove wrk tests 91/27891/1
Tibor Frank [Mon, 13 Jul 2020 19:15:50 +0000 (21:15 +0200)]
Report: remove wrk tests

Change-Id: Ie3f6ad2e4b5542e915f310c7b9ebeddf88b6fd8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit faf579e9471ee8bd4e9c20beb40ed526d276b59c)

3 years agoreport: updated environment versioning section 90/27890/1
Maciek Konstantynowicz [Mon, 13 Jul 2020 12:02:24 +0000 (14:02 +0200)]
report: updated environment versioning section

Change-Id: I95adc8730d379286511398754042ad88b8c7d681
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit ca585727f655942827ea4db1ae0318485655a109)

3 years agoReport: Improve vnf_service_chains_reconf.rst 89/27889/1
Vratko Polak [Thu, 25 Jun 2020 12:50:16 +0000 (14:50 +0200)]
Report: Improve vnf_service_chains_reconf.rst

+ Use the quantity name from methodology (not from test implementation).

Change-Id: Ic46f0447af840b392fe5dbbfec2bd11a847b06ca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 8e7e436b037a38cb9d5ad8b14abdfcbe64cf9cc6)

3 years agoReport: vpp_performance_tests/overview.rst 88/27888/1
Vratko Polak [Thu, 25 Jun 2020 12:26:45 +0000 (14:26 +0200)]
Report: vpp_performance_tests/overview.rst

Change-Id: I1c5c1a26574861e22485e7b40e19304bb635bc4a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 25f8a0f4a8f52fe1fee2d385cdfd40704fb4538c)

3 years agoDocs: Update TRex information 87/27887/1
Vratko Polak [Mon, 13 Jul 2020 12:32:08 +0000 (14:32 +0200)]
Docs: Update TRex information

The previous was describing CSIT version 3.

+ Stateless profile is now under GPL directory.

Change-Id: I9810ca224159053386557493eaf90b4aa682710e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit f619cc7649671f38fa23c11bf005a9acc4438bc1)

3 years agoRCA 2005: Update status in RCA files 86/27886/1
Vratko Polak [Fri, 10 Jul 2020 19:06:04 +0000 (21:06 +0200)]
RCA 2005: Update status in RCA files

CSIT-1738, CSIT-1740 and CSIT-1741 are now DONE.

Change-Id: Id9b93ace9464a7e6af64f7860ad1a15c7a287a53
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 476e0bdbfce67873008fe1b3e0cfe59f64aec6c8)

3 years agoRCA: Improve footnotes for ACL VPP. 85/27885/1
Vratko Polak [Fri, 10 Jul 2020 11:58:40 +0000 (13:58 +0200)]
RCA: Improve footnotes for ACL VPP.

+ Stateful ends with single l.

Change-Id: I7be89b3f536d05ed9b21ba8849a4eef33259d312
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 2a9b24722825c3cf8ebed48d0d593cc3f91e722f)

3 years agoReport 2005: Add reconf tests 84/27884/1
Tibor Frank [Mon, 13 Jul 2020 10:48:02 +0000 (12:48 +0200)]
Report 2005: Add reconf tests

Change-Id: Ic9466d4c0e6fb757e7d7c01d1aa83a59c1389371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bc36a6a974e63722dbae42c552eb0d95ae7b95a9)

3 years agoReport 2005: Fix titles in test env 83/27883/1
Tibor Frank [Mon, 13 Jul 2020 08:47:54 +0000 (10:47 +0200)]
Report 2005: Fix titles in test env

Change-Id: I55e7a596d5fa23531e68d7ace9364411c3c372fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d6aed8b19c60ff81cad100c9c3a6931ce1686f38)

3 years agoReport 2005: Add data 82/27882/1
Tibor Frank [Mon, 13 Jul 2020 08:19:28 +0000 (10:19 +0200)]
Report 2005: Add data

- perf-iter-3n-tsh - 1 run
- perf-cov-3n-hsw - 35 runs

Change-Id: I9951cd2aa1883efa944b5c16b3b736761c1ff64f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b9056e2936fa92ae0ec514db2eed482ce33679a0)

3 years agoReport 2005: Configure rls2005.39 41/27841/1
Tibor Frank [Mon, 13 Jul 2020 07:17:03 +0000 (09:17 +0200)]
Report 2005: Configure rls2005.39

Change-Id: I7ea2e004b79d47420f6a1e0beb88731529b03706
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f2606a6a0826cf95fd9fe0b0ff0eb43bffd8e8b7)

3 years agoreport: fixed misplaced environment versioning section 40/27840/1
Maciek Konstantynowicz [Fri, 10 Jul 2020 16:49:27 +0000 (18:49 +0200)]
report: fixed misplaced environment versioning section

Change-Id: Id0da363b376e12dac583f95624ed6525b24290eb
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 30a988b35c6d66a11b5ec2f2c77c741dc942594e)

3 years agoDocs: job-specs: dpdk and nfv-density test sets 29/27829/2
Tibor Frank [Fri, 10 Jul 2020 07:24:02 +0000 (09:24 +0200)]
Docs: job-specs: dpdk and nfv-density test sets

+ synchronize iter dpdk test sets with coverage dpdk test sets
+ add iter nfv-density-mrr test sets

Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bc42880dfa7c5d4c9abe8e6957e44752db10918e)

3 years agoRCA 2005: Update RCA files. 27/27827/1
Vratko Polak [Fri, 10 Jul 2020 10:10:01 +0000 (12:10 +0200)]
RCA 2005: Update RCA files.

+ Current state.
+ Covers skx (also 3n) and clx.
+ Specific Jira sub-tasks, even for VPP progressions.
- Only 2n-skx data for NDR.

Change-Id: I56cf870aedc1319891b7188268ff6cf7bc744ff8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 713e795d22717f69edf298d9dc4a16859206335f)

3 years agoreport: added versioning sub-section to VPP Test Environment section 26/27826/1
Maciek Konstantynowicz [Thu, 9 Jul 2020 19:56:19 +0000 (21:56 +0200)]
report: added versioning sub-section to VPP Test Environment section

Change-Id: I59a93c0594ab5e5f0e267cacdf03d1f345e02b29
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6c03d82f93fd0a4f0f7a7c750e18246260e11dd4)

3 years agoReport 2005: Add data 25/27825/1
Tibor Frank [Fri, 10 Jul 2020 06:37:34 +0000 (08:37 +0200)]
Report 2005: Add data

Change-Id: I56b805eec6e5d606a954ba749b16ce72ce6047fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d3612b6d641dbfc8013ac3e4d8f2a33b123742f3)

3 years agoReport 2005: Add data, review graphs 75/27775/1
Tibor Frank [Thu, 9 Jul 2020 09:16:19 +0000 (11:16 +0200)]
Report 2005: Add data, review graphs

Change-Id: I2913ed579369a26a1226cfbe958432d1b3e11789
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 12c3608c3464add7664e3b8f41b07b9b8fd03f1c)

3 years agoReport 2005: Add data, hide dnv, soak, reconf, nfv 74/27774/1
Tibor Frank [Wed, 8 Jul 2020 07:59:24 +0000 (09:59 +0200)]
Report 2005: Add data, hide dnv, soak, reconf, nfv

Change-Id: Iff1b1db3e31d2e1f19f8309ba28f1f88e0538f6c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d0f1e8778dac3549a1f1e403541de9f3ee88ec8d)

3 years agoPAL: Improve comparison tables 72/27772/1
Tibor Frank [Tue, 7 Jul 2020 07:35:59 +0000 (09:35 +0200)]
PAL: Improve comparison tables

- place RCAs to the columns with diffs

CSIT-1737

Change-Id: I3ccf5ee510796684e3e09dbdc6264b05f391f633
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ff8c8cf6083f64fd337115fec20501f7b247540e)

3 years agoReport: 2005: Add data, configure rls2005.28 71/27771/1
Tibor Frank [Tue, 7 Jul 2020 07:26:02 +0000 (09:26 +0200)]
Report: 2005: Add data, configure rls2005.28

Change-Id: I686102fd7d17ad287ae890f1170ef7c78ff74a0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9439b30ba91e3532c66548c34bade4469fdfab37)

3 years agoReport 2005: Add data 70/27770/1
Tibor Frank [Sun, 5 Jul 2020 15:23:30 +0000 (17:23 +0200)]
Report 2005: Add data

Change-Id: Icc4ea692adcafef542dfa61e0fa594c85db6898e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 921a1c6556b0d8a20a8e7ba2a48b887b41a30e60)

3 years agoReport 2005: Add data 68/27768/1
Tibor Frank [Fri, 3 Jul 2020 10:00:41 +0000 (12:00 +0200)]
Report 2005: Add data

Change-Id: I8c0be475c73aa5c9c3d04780851faf25f1156aed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 617bf7e282e2eec5aaa9e33f98b0d65e6ac1874b)

3 years agoReport 2005: Add data, change legend in comp tables 67/27767/1
Tibor Frank [Fri, 3 Jul 2020 07:41:57 +0000 (09:41 +0200)]
Report 2005: Add data, change legend in comp tables

Change-Id: I538751d928a547b9c168798f853903dd56887f47
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f8f439e49ef481ceebac6cea76194bda83583927)

3 years agoTrending and report alignment 66/27766/1
Tibor Frank [Wed, 1 Jul 2020 11:58:40 +0000 (13:58 +0200)]
Trending and report alignment

- use test sets defined in report-iterative also for mrr
  tests and for mrr_daily and mlr_weekly

Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ea77fd004ce6dfbfe48d861743a9d14f99a620a4)

3 years agoReport 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710 65/27765/1
Tibor Frank [Thu, 2 Jul 2020 08:40:01 +0000 (10:40 +0200)]
Report 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710

Change-Id: I8e8a7e88475a789f04767893866db2502ec5f8ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75afcbc8614c69755c008e0d63eaf6ac79cb3184)

3 years agoReport 2005: Add data 64/27764/1
Tibor Frank [Thu, 2 Jul 2020 08:27:56 +0000 (10:27 +0200)]
Report 2005: Add data

Change-Id: I65e1a386a29faa9c890a526b8d264f4eabcbf382
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9e06ee18ddcd7287162afd6848121e9a094fee57)

3 years agodocs: added mrr tests for vpp and dpdk to job_specs/report_iterative 63/27763/1
Maciek Konstantynowicz [Tue, 30 Jun 2020 15:57:39 +0000 (16:57 +0100)]
docs: added mrr tests for vpp and dpdk to job_specs/report_iterative

Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f4a8cf0ceadf483938ce10cce93942c0d7000a1e)

3 years agoReport 2005: Add data 62/27762/1
Tibor Frank [Wed, 1 Jul 2020 06:49:40 +0000 (08:49 +0200)]
Report 2005: Add data

+ 2001.0-4 vs 2001.0-2 for 3n-hsw

Change-Id: Ice05011ea79681ede74825ed8ae6be849ea06b8f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 87940fb88ea6a32037fc0ee084fc9e423daa79a1)

3 years agoReport 2005: Add 3n-skx mrr env 4 data 98/27698/1
Tibor Frank [Tue, 30 Jun 2020 08:33:10 +0000 (10:33 +0200)]
Report 2005: Add 3n-skx mrr env 4 data

Change-Id: I44f05050c8e0c528c4980ac767232c497d058d9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4cbb1b7c9aa616e377b73b9d22ed2b5ac1735b65)

3 years agoReport 2005: Add 2n-clx and 3n-hsw mrr env 4 data 97/27697/1
Tibor Frank [Tue, 30 Jun 2020 05:13:33 +0000 (07:13 +0200)]
Report 2005: Add 2n-clx and 3n-hsw mrr env 4 data

Change-Id: I431215d96699381385199b61e9e5f37a581d91f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3a97223e49e848614fcd3881ded46d147d36af82)

3 years agoReport 2005: Replace data in thput graphs by env 4 94/27694/1
Tibor Frank [Mon, 29 Jun 2020 11:29:45 +0000 (13:29 +0200)]
Report 2005: Replace data in thput graphs by env 4

Change-Id: I6bd871d85c7ca2ed9748a96b0568f8f3dab82008
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b478ee316158a56b7e9f1910edc84918bc7d9466)

3 years agoReport 2005: Configure rls2005.27, add data 90/27690/1
Tibor Frank [Mon, 29 Jun 2020 05:58:35 +0000 (07:58 +0200)]
Report 2005: Configure rls2005.27, add data

Change-Id: I6a9911b500d40708e2570be9d83cdd860c677977
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6349e9f96178bd0f6ef31cb2e5e8d1244c861724)

3 years agoReport 2005: Fix comparison table hdr, add data 89/27689/1
Tibor Frank [Fri, 26 Jun 2020 10:14:27 +0000 (12:14 +0200)]
Report 2005: Fix comparison table hdr, add data

Change-Id: I3ef6dfb1b3da4f91c77841536a840a439816e61f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c9f903e4f7894cb61cf3cc67fb37c7602c917567)

3 years agoReport 2005: Add data, fix sorting in comp tables 88/27688/1
Tibor Frank [Fri, 26 Jun 2020 06:52:46 +0000 (08:52 +0200)]
Report 2005: Add data, fix sorting in comp tables

Change-Id: Ib0c42f5b9fbd9b9f9ebf0bff437ef9d145e6ddda
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f278b55927de4aa59cf87ac1e752effd1c64035c)

3 years agoReport 2005: Add data 87/27687/1
Tibor Frank [Fri, 26 Jun 2020 04:40:24 +0000 (06:40 +0200)]
Report 2005: Add data

Change-Id: I7ffbe353739c3077bbfc03f25f4b6e03b2fdcccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8ac495fdf576693d4c627a3211765facc688cfdc)

3 years agoReporet 2005: Add data, Fix comparison columns 86/27686/1
Tibor Frank [Thu, 25 Jun 2020 18:36:25 +0000 (20:36 +0200)]
Reporet 2005: Add data, Fix comparison columns

Change-Id: I83bd99c7afd63bd9ef0e432562c76cbe4ac8cb9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 94829f7603cc247d4e675c1a105ad27b073cb92a)

3 years agoReport 2005: Add data 85/27685/1
Tibor Frank [Thu, 25 Jun 2020 09:40:19 +0000 (11:40 +0200)]
Report 2005: Add data

Change-Id: I35803563351aa5419726a8a469f23557b49189f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e2d6dfa204eb3abef8845e742719cee7d4865ff7)

3 years agoReport 2005: Add 3n-skx comp tables 84/27684/1
Tibor Frank [Thu, 25 Jun 2020 08:09:23 +0000 (10:09 +0200)]
Report 2005: Add 3n-skx comp tables

Change-Id: Ic3237d165fdc9b7ca95498f724e0173f1cd29dad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 72019941bfab96c7e687f5122f50e7c1f8cb2fca)

3 years agoReport 2005: Add data 83/27683/1
Tibor Frank [Thu, 25 Jun 2020 07:39:32 +0000 (09:39 +0200)]
Report 2005: Add data

Change-Id: I11c238327de71e75ca1ad099455f8daeb1ce996b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8bfc85eef3f6214200cf7eb8d426d96de923e985)

3 years agoreport: updated rls notes for vpp performance section 82/27682/2
Maciek Konstantynowicz [Wed, 17 Jun 2020 18:25:01 +0000 (19:25 +0100)]
report: updated rls notes for vpp performance section

Change-Id: I114c7d64c24210df4273086757ef33735baffe94
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 0074e91ecc792db04f82f51dc760ddf29375dc13)

3 years agoReport: Improve soak_tests/index.rst 21/27621/1
Vratko Polak [Mon, 15 Jun 2020 15:39:00 +0000 (17:39 +0200)]
Report: Improve soak_tests/index.rst

- The -iterative- jobs should be used in future,
  but for 2005 the results still come from -verify- jobs.

Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit a216afda94f4e23ecc50e03587e31b754d0f0116)

3 years agoReport 2005: Add data, improve comp tables desc 20/27620/1
Tibor Frank [Thu, 25 Jun 2020 06:04:49 +0000 (08:04 +0200)]
Report 2005: Add data, improve comp tables desc

Change-Id: I7d3afd5c3f6322cb76668b7ecfa288e9b64c6cc3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e0f8fb48f1f569c78a92c075a66c256f1efb995b)

3 years agoReport 2005: Add data 19/27619/1
Tibor Frank [Wed, 24 Jun 2020 14:09:53 +0000 (16:09 +0200)]
Report 2005: Add data

Change-Id: Iffffa9dc7f87d0838cb674ffae01ca2407939dbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3c1b802a13265c776bcf0712989558bd9ff0ee1a)

3 years agoReport 2005: Update comp tables, add data 18/27618/1
Tibor Frank [Wed, 24 Jun 2020 11:46:51 +0000 (13:46 +0200)]
Report 2005: Update comp tables, add data

Change-Id: Ifcbf9e1f382ea33d0601f0bf52ad08b5f5f123a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ac9ae837b482f0220fea4f44a4eb2e490e8fa9e)

3 years agoReport 2005: Add env 2 data, update 3n-hsw comp tables 17/27617/1
Tibor Frank [Wed, 24 Jun 2020 09:59:41 +0000 (11:59 +0200)]
Report 2005: Add env 2 data, update 3n-hsw comp tables

Change-Id: Ibaab929900abec2321a36ed1251d936d4327c927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6d45a74ca33951a02b9a1bcc8b0e2cf2f9db8745)

3 years agoRevert "Tweak TRex cores and RDMA pps limit" 16/27616/1
Vratko Polak [Tue, 23 Jun 2020 12:08:05 +0000 (14:08 +0200)]
Revert "Tweak TRex cores and RDMA pps limit"

This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197.
It was affecting 2005 performance, confusing comparisons.

The revert includes the RDMA limit.

Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 6b81daa7407cd62a7916a1405a79a1f1f11555c1)

3 years agoReport 2005: Add data, remove obsolete graphs 15/27615/1
Tibor Frank [Mon, 22 Jun 2020 12:03:40 +0000 (14:03 +0200)]
Report 2005: Add data, remove obsolete graphs

Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5b683bf3a43e8c5de1a48e2a842b952b4a9d7ae5)

3 years agoReport: Add data, 2n-skx-nfv, configure 2005.26 14/27614/1
Tibor Frank [Mon, 22 Jun 2020 09:18:51 +0000 (11:18 +0200)]
Report: Add data, 2n-skx-nfv, configure 2005.26

Change-Id: Ia00d19101e0521d89f23ee68be8e701b043a3a1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1a0f5d37b11bafc784985875540f0e99abec88c0)

3 years agoReport 2005: Add data 13/27613/1
Tibor Frank [Sat, 20 Jun 2020 06:52:06 +0000 (08:52 +0200)]
Report 2005: Add data

Change-Id: I0a3bdefce6dae7cbd297f47c6aaf9f631f909eb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ac38e4639b25835273f69a91d2779cae115bae30)

3 years agoReport 2005: Add data 12/27612/2
Tibor Frank [Fri, 19 Jun 2020 18:51:42 +0000 (20:51 +0200)]
Report 2005: Add data

Change-Id: Ie1d4677c91bfb3f9245dc553e3ca779f95c98ba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b693006d4267dd19bb3ba3d873cdc8ce18d2fe92)

3 years agoReport 2005: Add data 11/27611/1
Tibor Frank [Fri, 19 Jun 2020 09:09:00 +0000 (11:09 +0200)]
Report 2005: Add data

Change-Id: If87e87170d4d1dfd533265fa5b1c6875a770146e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 399d51b81b2144ad84edf6ea423cb04d69777eab)

3 years agoReport 2005: Add data 10/27610/1
Tibor Frank [Thu, 18 Jun 2020 12:15:17 +0000 (14:15 +0200)]
Report 2005: Add data

Change-Id: I6b36e1c2fc42e37aa3cb42b79844c3581e17e430
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 226b126e78fe7095b4dbee82dcb308c890a3155c)

3 years agoImprove release notes 03/27603/1
Vratko Polak [Mon, 15 Jun 2020 15:26:34 +0000 (17:26 +0200)]
Improve release notes

+ Remove commented-out alternative notes.

Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4d6365deba4c28a8bc305169bb60c47f666c4a87)

3 years agoPAL: Use the reconf term from methodology 02/27602/1
Vratko Polak [Mon, 15 Jun 2020 15:54:55 +0000 (17:54 +0200)]
PAL: Use the reconf term from methodology

+ Instead of the term from test implementation.
+ The parser still looks for the old term.

Change-Id: Ic07ac336085f2bb07f9d906e83b82cb84ebddb24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ae654a8ade2a310effa49723ed577f05812a97ec)

3 years agoReport 2005: Add data 61/27561/1
Tibor Frank [Thu, 18 Jun 2020 07:55:46 +0000 (09:55 +0200)]
Report 2005: Add data

Change-Id: I2d3dd84aca4a1a41e652e4fd0d67fe6cee56bdac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75f8f739279790828ead808be3ecaa5c77b3073c)

3 years agoReport 2005: Add data, remove plots without data 60/27560/1
Tibor Frank [Wed, 17 Jun 2020 11:12:06 +0000 (13:12 +0200)]
Report 2005: Add data, remove plots without data

Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 19b2d3d3cc01a0c0ceab1569bf8f9ca3c848b424)

3 years agoReport 2005: Add data 58/27558/1
Tibor Frank [Wed, 17 Jun 2020 07:29:57 +0000 (09:29 +0200)]
Report 2005: Add data

Change-Id: I14d04b6251a74ade89f43f4733b5f16caccdbd72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3efabd6b8d8730bd0fa1d8df9ad4850412f64469)

3 years agoReport 2005: Fix graphs, tables 57/27557/1
Tibor Frank [Tue, 16 Jun 2020 10:20:50 +0000 (12:20 +0200)]
Report 2005: Fix graphs, tables

Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a6464e9cefe273bd3caea8b672895e208aeb0fcb)

3 years agoReport 2005: Add data 56/27556/1
Tibor Frank [Tue, 16 Jun 2020 06:35:16 +0000 (08:35 +0200)]
Report 2005: Add data

Change-Id: I1ea07802294b498e61774038c3a2ae1bf6fffc7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 60b5545b670cbcb7813d0ca7d6748b83e48072c6)

3 years agoReport 2005: Add data 55/27555/1
Tibor Frank [Mon, 15 Jun 2020 12:25:50 +0000 (14:25 +0200)]
Report 2005: Add data

Change-Id: I022aaef58b1217476d5639bc00328fc56584ac40
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7fb1dad82e15cd065e6aea8071374ae081ba3007)

3 years agoReport 2005: Clean-up graphs and tables 54/27554/1
Tibor Frank [Mon, 15 Jun 2020 11:25:06 +0000 (13:25 +0200)]
Report 2005: Clean-up graphs and tables

Change-Id: Ic0360a8a54e696aad5e7688d9f28808e868d1344
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9b2acc9eea24958d7a84b0b6e77c658497579824)

3 years agoReport 2005: Add data, hide dpdk 3n-tsh 53/27553/1
Tibor Frank [Mon, 15 Jun 2020 07:59:40 +0000 (09:59 +0200)]
Report 2005: Add data, hide dpdk 3n-tsh

Change-Id: Id2c83dc218ad766008f65e2ad218eb01444cde07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a37d06fd84d6653990e39c135252ef1623d0ccfd)

3 years agoReport 2005: Add data 18/27518/1
Tibor Frank [Fri, 12 Jun 2020 11:48:16 +0000 (13:48 +0200)]
Report 2005: Add data

Change-Id: I86da78cc8b828afc6650a67c7d205ca8512f9cad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b366c098031d995015fea0a56113c29a5fcd9a68)

3 years agoReport 2005: Add data 17/27517/1
Tibor Frank [Fri, 12 Jun 2020 09:43:01 +0000 (11:43 +0200)]
Report 2005: Add data

Change-Id: Ib5d8dd2b278865d1718c40383298b78d1e755759
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 566af41a85f6fb2fd6a6e0117456ec83d4e2a6c6)

3 years agodocs: update 2n-skx job_specs for report_iterative 11/27511/1
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:03:25 +0000 (13:03 +0100)]
docs: update 2n-skx job_specs for report_iterative

Changes in vpp-2n-skx.md:
- all nfv_density moved to separate file vpp-2n-skx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-skx/ and
  renamed

Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6fa263815306b43ab1813360f0123e8a245b4b56)

3 years agodocs: update 2n-clx job_specs for report_iterative 10/27510/1
Maciek Konstantynowicz [Wed, 10 Jun 2020 11:49:31 +0000 (12:49 +0100)]
docs: update 2n-clx job_specs for report_iterative

Changes in vpp-2n-clx.md:
- all nfv_density moved to separate file vpp-2n-clx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-clx/ and
  renamed

Change-Id: I639abe794bde511d27cefa50db2860945dcc0050
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 1dbd6729f2a6ec77f0d9e867d2bf858d9b5db488)

3 years agodocs: update 3n-skx job_specs for report_iterative 09/27509/1
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:17:23 +0000 (13:17 +0100)]
docs: update 3n-skx job_specs for report_iterative

Changes in vpp-3n-skx.md:
- all nfv_density moved to separate file vpp-3n-skx-nfv-density.md
- removed intel-x710: dot1q (except "./vm_vhost")
- removed drv_vfio_pci: dot1q, ipsec aes128cbc
- removed nat44, iacl, oacl

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/3n-skx/ and
  renamed

Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6b5f02d7f004003e4d87d62f6add260ea126c0da)

3 years agoUpdate selection of report-iterative test sets 08/27508/1
Tibor Frank [Thu, 11 Jun 2020 10:17:41 +0000 (12:17 +0200)]
Update selection of report-iterative test sets

- Create the same directory structure for report-iterative as it is
  for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
  report-coverage.
- Update the corresponding functionality in
  resources/libraries/bash/function/common.sh

The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.

Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 806a069bc5494d1c43dd9711e1512e518c823acd)

3 years agoReport 2005: Add data 07/27507/1
Tibor Frank [Thu, 11 Jun 2020 08:49:17 +0000 (10:49 +0200)]
Report 2005: Add data

Change-Id: Iea03f5f49f68ef2f65040f778108592f7b44ead3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c056a4fe51febfae290209c0d39b23bd63b6542a)

3 years agoReport 2005: Add data, 2n-clx x533 cur vs prev tab 06/27506/1
Tibor Frank [Wed, 10 Jun 2020 13:51:55 +0000 (15:51 +0200)]
Report 2005: Add data, 2n-clx x533 cur vs prev tab

CSIT-1727

Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 972b5c9a4f25982865067dc08325c7ea16cfcd96)

3 years agodocs: update 2n-dnv job_specs for report_coverage 41/27441/2
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:11:33 +0000 (13:11 +0100)]
docs: update 2n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 61012e6fc1590376b327ebdc026be8278a277611)

3 years agodocs: update 3n-hsw job_specs for report_coverage 02/27502/2
Maciek Konstantynowicz [Fri, 5 Jun 2020 18:24:34 +0000 (19:24 +0100)]
docs: update 3n-hsw job_specs for report_coverage

Removed for all tests: all packet sizes 4c, 9000B 2c.
Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/

Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 3921adc2cfbbdbba28ed94a3dd19bb80a0d85702)

3 years agodocs: update 3n-dnv job_specs for report_coverage 04/27504/2
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:53:25 +0000 (13:53 +0100)]
docs: update 3n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 366ac57ae0c775c4e60326ee51ce6659f841c0a9)

3 years agodocs: update 2n-skx job_specs for report_coverage 03/27503/2
Maciek Konstantynowicz [Fri, 5 Jun 2020 11:57:13 +0000 (12:57 +0100)]
docs: update 2n-skx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a33f758a6bca9c48940e7d69476cb78274395765)

3 years agodocs: update 3n-skx job_specs for report_coverage 05/27505/1
Maciek Konstantynowicz [Tue, 9 Jun 2020 15:51:42 +0000 (16:51 +0100)]
docs: update 3n-skx job_specs for report_coverage

Removed tests:
- crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c
- all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c

Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b4782ed542da67f619f1c043a8c6e23be81f715d)

3 years agoReport 2005: Add data 40/27440/1
Tibor Frank [Wed, 10 Jun 2020 10:17:47 +0000 (12:17 +0200)]
Report 2005: Add data

Change-Id: Ida07c263b93f30d146a32502245f425f898b87ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d76c78f267719c6ecdff22a40689117ee8cc1266)

3 years agoReport 2005: vpp-device static content 39/27439/1
Jan Gelety [Thu, 28 May 2020 20:50:12 +0000 (22:50 +0200)]
Report 2005: vpp-device static content

Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 6ebf54b7c0471d2723066e051307bff5561f63d1)

3 years agoReport 2005: Add data 37/27437/1
Tibor Frank [Tue, 9 Jun 2020 07:49:21 +0000 (09:49 +0200)]
Report 2005: Add data

Change-Id: I2b440c144a63720c2451f1b42d218f2e9d9c59bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e84eec8494a5f13fce73e13dfdb38af90608edb7)

3 years agoReport 2005: Add data, configure 2005.24 34/27434/1
Tibor Frank [Mon, 8 Jun 2020 10:14:09 +0000 (12:14 +0200)]
Report 2005: Add data, configure 2005.24

Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ba7130cebc9bc6ef66b9eb4f0e7d888462e10e48)

3 years agoReport 2005: Add data 31/27431/1
Tibor Frank [Thu, 4 Jun 2020 09:31:54 +0000 (11:31 +0200)]
Report 2005: Add data

Change-Id: I94f24c68c47cd3a93655d724b25e9cd0544d3400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2fab22524dac3f5aaa26dde53f74d15974e29901)

3 years agoReport 2005: Add data 30/27430/1
Tibor Frank [Thu, 4 Jun 2020 08:17:52 +0000 (10:17 +0200)]
Report 2005: Add data

Change-Id: Iab39f728760211694d1890078ba9db2fb7f18928
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4b145ea098f99b8305b5c94a66d3afa273e884f2)