csit.git
22 months agoReport: Add release data 75/36575/1
Tibor Frank [Thu, 7 Jul 2022 08:35:50 +0000 (10:35 +0200)]
Report: Add release data

Change-Id: If9d60c0b063c520400b028efe46991f4e546920f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2c8d9b777f21c57f1c526ee05b0fd377bec631a3)

22 months agoReport: Add release data 74/36574/1
Tibor Frank [Wed, 6 Jul 2022 11:47:53 +0000 (13:47 +0200)]
Report: Add release data

Change-Id: I37f2acf2662a8cac38fe2a849ab35a9696e6f51c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4458f261feaffaf131b88fb01f02e69be3f4680c)

22 months agoReport: Add Hoststack and VSAP comparison tables 73/36573/1
Tibor Frank [Wed, 6 Jul 2022 11:32:34 +0000 (13:32 +0200)]
Report: Add Hoststack and VSAP comparison tables

Change-Id: Ic4f2fa308c24952694430c72c673c82e0b9cc997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 00e7fb1c447155f3db6cb93fe7a3a049138660de)

22 months agoReport: Add rls data 72/36572/1
Tibor Frank [Wed, 6 Jul 2022 08:05:48 +0000 (10:05 +0200)]
Report: Add rls data

Change-Id: I8891fcfec6cd5805c1be802aa0b47c978e0c3982
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b01ef17f1de1e965383d2353a1ef5316660584e9)

22 months agoReport: Comparison tables 70/36570/1
Tibor Frank [Wed, 29 Jun 2022 14:38:49 +0000 (16:38 +0200)]
Report: Comparison tables

- normalization
- table headers
- legend

Change-Id: Ie095a84b7a62481d01fa5ece7c9da7f320d6d5c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 55cad0badce981ec3f0b544e687d898eba689368)

22 months agofeat(ansible): Add numactl dependency 69/36569/1
Peter Mikus [Fri, 1 Jul 2022 08:04:28 +0000 (08:04 +0000)]
feat(ansible): Add numactl dependency

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7abde98b9d929d6dba35c8b93efb6071fc818b8b
(cherry picked from commit eed8d3731d33161990c3f5f05e22f73826b3f500)

22 months agodocs(report): Update some infra sections 68/36568/1
Peter Mikus [Fri, 1 Jul 2022 07:32:11 +0000 (07:32 +0000)]
docs(report): Update some infra sections

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e7b1b35c3a7036a55d1a78addfde0eebfe7f1be
(cherry picked from commit 0ec89ddbaf81cbcafce7d91ac71e1ab85ca2f913)

22 months agoReport: add 3n-alt static content 67/36567/1
Juraj Linkeš [Thu, 30 Jun 2022 12:20:43 +0000 (14:20 +0200)]
Report: add 3n-alt static content

Also unify the order of testbeds in documents where 3n-alt appears.

Change-Id: I571dc1a2f87f45c4039080b28cfbeeb09d8d990e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit bf0fa247e2e95c14bc76dae43a0df26be410d931)

22 months agoFix typo in aws_ami.rst 66/36566/1
Vratko Polak [Tue, 16 Nov 2021 16:54:08 +0000 (17:54 +0100)]
Fix typo in aws_ami.rst

Change-Id: I501d892c89c6db81e5daf946b357889f7af44631
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b9dd086436d08c4afd6651fdb46a29473a3db072)

22 months agofeat(infra): Add SNR 65/36565/1
Peter Mikus [Thu, 30 Jun 2022 08:17:31 +0000 (08:17 +0000)]
feat(infra): Add SNR

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e39a59a192682c4bd9ebc7fa81ac727b55cf8e4
(cherry picked from commit 8485f3bf773ad3b6ec4426dd2465b356b41c5a06)

22 months agolab: update 3n-alt docs 64/36564/1
Juraj Linkeš [Mon, 14 Mar 2022 13:46:47 +0000 (14:46 +0100)]
lab: update 3n-alt docs

Change-Id: I6c77f633bfcae3b342d211a6b6379acb2f1adb6a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 7b06cddf4f0ceca580b71b695e34a39e706931fc)

22 months agojob-spec: Reduce number of iterative tests for 2n-clx 63/36563/1
Tibor Frank [Thu, 30 Jun 2022 08:59:01 +0000 (10:59 +0200)]
job-spec: Reduce number of iterative tests for 2n-clx

- For e810cq remove dpdk-vfio-pci L2 100k and 1M scale tests

Change-Id: Icded4fdca2720fad7f51cd072ed72fc4a1b4742d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 339628cdb5be2e4e488579a95c9f0c3eb3268bc4)

22 months agofeat(methodology): add methodology for autogen 62/36562/1
Vratko Polak [Tue, 28 Jun 2022 10:36:17 +0000 (12:36 +0200)]
feat(methodology): add methodology for autogen

Change-Id: I416c4120f2d7e05582a1f4fc529dfc86a09a7788
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 44ff812b59a8cdcb3ac97cbda528e84e74b3547f)

22 months agofeat(doc): update ASTF related methodology 61/36561/1
Vratko Polak [Tue, 28 Jun 2022 15:59:59 +0000 (17:59 +0200)]
feat(doc): update ASTF related methodology

Also added some TODOs for future methodology improvements.
Some of them will addressed in subsequent changes soon,
but not sure yet which ones exactly.

Change-Id: Ib827371b7d7a598c5fa6ab41fb7e48c73185844f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 2db1998c0432569702738524e66c9d4e3f553b20)

22 months agojob_specs: add wireguard perf tests to regression 59/36559/3
Yulong Pei [Mon, 27 Jun 2022 05:27:48 +0000 (05:27 +0000)]
job_specs: add wireguard perf tests to regression

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I9e499df973fd9990ab02fe7008d12e78b2ab089f
(cherry picked from commit 325cef50672aed697e277405fe9bb9b797d02701)

22 months agoAdd Test Suite for VPP WireGuard 60/36560/1
Cui,Cheng [Thu, 19 May 2022 06:48:04 +0000 (06:48 +0000)]
Add Test Suite for VPP WireGuard

Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
(cherry picked from commit 75ef277536c43096e7646430568d97d2cc489238)

22 months agoUpdate VPP_STABLE_VER files 56/36556/3
Tibor Frank [Thu, 30 Jun 2022 04:30:54 +0000 (04:30 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia2b760ca18758eaec048cfb1c6206af1ba224c59
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agojob_specs: add IPsec perf tests and GTPU perf tests to regression 58/36558/1
Yulong Pei [Fri, 24 Jun 2022 01:25:12 +0000 (01:25 +0000)]
job_specs: add IPsec perf tests and GTPU perf tests to regression

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: If70f910003d8208e08d4dc101ac70b33e7e4162b
(cherry picked from commit d0099eacdcbaeb7fcc80592daf350e4f0e7b3936)

22 months agojob-spec: Reduce number of iterative tests for 2n-clx 57/36557/1
Tibor Frank [Wed, 29 Jun 2022 12:40:09 +0000 (14:40 +0200)]
job-spec: Reduce number of iterative tests for 2n-clx

- For e810cq use the same dpdk-vfio-pci tests as for xxv710

Change-Id: I5857332fa8f2256b293efd610902d30a015e716d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f323eea4adbddff526ee49f0752d9dbc5396091e)

22 months agofeat(telemetry): print executed command in vppctl 34/36534/1
Vratko Polak [Tue, 28 Jun 2022 15:33:55 +0000 (17:33 +0200)]
feat(telemetry): print executed command in vppctl

The vpp bundle does that, so this will make the outputs more similar.

Change-Id: Iadad9b683d90b7bdd672ed3f51bce9f57f652eaa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 71d84bb6f1f493ce589499a6de149cfa3222e006)

22 months agoReport: Add rc2, re-test data 33/36533/1
Tibor Frank [Wed, 29 Jun 2022 08:47:17 +0000 (10:47 +0200)]
Report: Add rc2, re-test data

Change-Id: I3fe5d3a1b5fcb8ab182442d6af85719b16e52fe0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 30badc023cb58f7ae4ddcf747c28f49c39b1dca6)

22 months agoReport: Add rc2 data 27/36527/1
Tibor Frank [Tue, 28 Jun 2022 11:40:06 +0000 (13:40 +0200)]
Report: Add rc2 data

Change-Id: Ie5df83a47c352ef84486c2d62be91365ad005409
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8335a5a3f8935e6f1ab760986ac715c22839ca7a)

22 months agofeat(telemetry): Rework 26/36526/1
Peter Mikus [Fri, 24 Jun 2022 10:32:28 +0000 (10:32 +0000)]
feat(telemetry): Rework

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0a84ce88b318c488ba2d519b20237c88b9f9f1e6
(cherry picked from commit b33b1461fe815b1a09267118644538a5b9351c60)

22 months agoReport: Add normalized comp tabels - static content 25/36525/1
Tibor Frank [Tue, 28 Jun 2022 08:11:33 +0000 (10:11 +0200)]
Report: Add normalized comp tabels - static content

Change-Id: I0a9782248fee91f3db2fb5db00c800c7e5447f32
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e076cc8c47e7c10a48d0c5410967cd0269b98723)

22 months agoReport: Add normalized comparison tables 24/36524/1
Tibor Frank [Tue, 28 Jun 2022 07:24:31 +0000 (09:24 +0200)]
Report: Add normalized comparison tables

Change-Id: Ief631c4b8924885642435669a151be9f9c9e585f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9748f8e1b20bc528fb0143a08f111f48426ada3e)

22 months agoReport: Add rc2 data 23/36523/1
Tibor Frank [Tue, 28 Jun 2022 05:06:51 +0000 (07:06 +0200)]
Report: Add rc2 data

Change-Id: Ia5c242d8904b2f8b7e774ce4cec421e58b84a2ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 050e8699a96175ecda2dc696dbe63dbafc783812)

22 months agoTrending: Add names of new ICX TBs 21/36521/1
Tibor Frank [Mon, 27 Jun 2022 13:54:56 +0000 (15:54 +0200)]
Trending: Add names of new ICX TBs

Change-Id: Ic5b708a935272fda935398fe7f0ab53de72c5eba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75a332d56cfbcf9e824e4c3bfa3ff87893d9033a)

22 months agofix(ansible): ICX rules 20/36520/1
Peter Mikus [Mon, 27 Jun 2022 12:08:28 +0000 (12:08 +0000)]
fix(ansible): ICX rules

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4b9fdeac0e4ec85cf0def7cfeefbf2ce4e7b0bd9
(cherry picked from commit d428ea995298bc82237b3309609c4abab9cf04e2)

22 months agofix(infra): Topology 3n-icx 18/36518/1
Peter Mikus [Mon, 27 Jun 2022 10:17:39 +0000 (10:17 +0000)]
fix(infra): Topology 3n-icx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibdf60c87dd56282d7c10eb94efd0914aa5944bbd
(cherry picked from commit f99fee38be3f0a15bdc52f7672a35c21fc9d89de)

22 months agoReport: Add VSAP tests 17/36517/1
Tibor Frank [Mon, 27 Jun 2022 08:51:23 +0000 (10:51 +0200)]
Report: Add VSAP tests

Change-Id: If0ebb92ded94bf2b0cf8ad0d17ac2b0bd6d165a3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7fd5509ba966027c118d3930e7b20d5c080faa9a)

22 months agoReport: Add rc2 data 16/36516/1
Tibor Frank [Mon, 27 Jun 2022 05:02:39 +0000 (07:02 +0200)]
Report: Add rc2 data

Change-Id: I8b69a5029a200c327e7276675c847809af367908
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0f3f40e1c2857daff628a9e2280a2de00c6f9331)

22 months agoReport: Add rc2 data 75/36475/1
Tibor Frank [Fri, 24 Jun 2022 10:37:18 +0000 (12:37 +0200)]
Report: Add rc2 data

Change-Id: Iad3cb32e346bf6c7e0754275e5ccba6cb19b731a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7909919cf42d6835d284dc6fbe9dfb3498784c20)

22 months agoReport: Add rc2 data 74/36474/1
Tibor Frank [Fri, 24 Jun 2022 07:49:48 +0000 (09:49 +0200)]
Report: Add rc2 data

Change-Id: Ifaecbf2f1788cc0da44b4ef64abc63b531f161c8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7f99e1ae98fc222b35f94445921ce656206e6689)

22 months agofix(infra): Topology file 73/36473/1
Peter Mikus [Thu, 23 Jun 2022 12:19:27 +0000 (12:19 +0000)]
fix(infra): Topology file

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47cc26d500e088154ffe88aceb384128a78b70ee
(cherry picked from commit 50053fbdc3de57026b940242a445ed39b4be49f8)

22 months agofeat(infra): Add ICX 72/36472/1
Peter Mikus [Wed, 22 Jun 2022 14:51:23 +0000 (14:51 +0000)]
feat(infra): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I609e039026bf5cd71a06549caa0ba917579e525c
(cherry picked from commit d8449a2d2b64566b4e3d30879305119d1c500d59)

22 months agoReport: Add rc2 data 71/36471/1
Tibor Frank [Thu, 23 Jun 2022 08:06:33 +0000 (10:06 +0200)]
Report: Add rc2 data

Change-Id: Ia8a81135cb0dbd3b2f8877de66a5d9ed3f6e8309
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bb734f5c497c9329d6cd28d0fbb0bff3ba1992cc)

22 months agofix: 3n-alt missing in regressions and progressions 70/36470/1
Viliam Luc [Wed, 22 Jun 2022 13:39:55 +0000 (15:39 +0200)]
fix: 3n-alt missing in regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I8b2cdf6f8dc45cae9a921c1ecbd2e952ef30bfbe
(cherry picked from commit a28b496bafd3c7a951e4732b4bd42182d8ab2d69)

22 months agofeat(ansible): Add ICX 68/36468/1
Peter Mikus [Wed, 22 Jun 2022 11:01:17 +0000 (11:01 +0000)]
feat(ansible): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3a62dc7048102381598b3e0dfc16f82fad834d7b
(cherry picked from commit 99a0ec18cb9117e9c22b4416c97d603215e3fa8b)

22 months agoReport: Add 2n-clx-e810cq latency 67/36467/1
Tibor Frank [Wed, 22 Jun 2022 08:46:41 +0000 (10:46 +0200)]
Report: Add 2n-clx-e810cq latency

Change-Id: I5674d40362ea958c34845c22c1b5fd090d08be83
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0fa376d390b3de02c75e4611c1e9d134e49b5b9d)

22 months agofeat(doc): Infra updates 66/36466/1
Peter Mikus [Wed, 22 Jun 2022 07:21:15 +0000 (07:21 +0000)]
feat(doc): Infra updates

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I208fc73382754d3182f6f7eedc1a46ae72ef6aa2
(cherry picked from commit ce081da3605b234cf257db52a083e15022f06de4)

22 months agofix(hoststack): distinguish two tcp tag types 02/36402/2
Vratko Polak [Fri, 10 Jun 2022 14:01:22 +0000 (16:01 +0200)]
fix(hoststack): distinguish two tcp tag types

Previous change did not consider TCP_PPS and TCP_CPS robot tags
are used by two different suite types (hoststack or ASTF).
This fixes the unintended impact on hoststack.

+ Add HOSTSTACK tag to VSAP suites.
 - They could also get VSAP tag, but not needed for this Change.

Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a

Change-Id: Ic583b5ae336c9b74794706fefc232f221a243c87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit f3a55b00e3f9e3418426c295cc6f9810a6eb137e)

22 months agoReport: Comparisons 65/36465/1
Tibor Frank [Tue, 21 Jun 2022 12:05:28 +0000 (14:05 +0200)]
Report: Comparisons

Change-Id: Icbb4709c84b66251438b73d109606977527c6c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d0a30297017d1e947c3540ca81b00599ea77825e)

22 months agoReport: Add 2n-clx-e810cq 64/36464/1
Tibor Frank [Tue, 21 Jun 2022 11:36:54 +0000 (13:36 +0200)]
Report: Add 2n-clx-e810cq

Change-Id: I4c7f37d77a9b8bda17eb3fb0b9a5bf468f1fd853
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0807c16320ff5c864dd77168e2b8a36556a941d4)

22 months agofeat(pxe): Add ICX 63/36463/1
Peter Mikus [Fri, 17 Jun 2022 11:55:49 +0000 (11:55 +0000)]
feat(pxe): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e3ec03a87f356c0e588011b848f8dd4ab7f30aa
(cherry picked from commit 5fc677579d18ec73390fa5ec86dc9168da3245f6)

22 months agoTrending: Add 2n-clx-e810cq - fixes 61/36461/1
Tibor Frank [Tue, 21 Jun 2022 08:27:59 +0000 (10:27 +0200)]
Trending: Add 2n-clx-e810cq - fixes

Change-Id: I9789e459c3db272e8f76c25df1ced266c9f5213f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4e6de308248a9aadd54f0183740bbe807cf9e985)

22 months agoTrending: Add 2n-clx-e810cq 59/36459/1
Tibor Frank [Tue, 21 Jun 2022 08:01:26 +0000 (10:01 +0200)]
Trending: Add 2n-clx-e810cq

Change-Id: Iefcd777f2e51038c4efc13ff68c777efb7ed78c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6a559c656f42c2122458338125ba5da68f8cdcad)

22 months agofix: testpmd and l3fwd check state 57/36457/1
Viliam Luc [Mon, 13 Jun 2022 11:42:29 +0000 (13:42 +0200)]
fix: testpmd and l3fwd check state
     + print testpmd and l3fwd pid after start

Testpmd and l3fwd utility can be started but link might not be
ready yet. This fix start the utility on all DUTs and do the
check later.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If476e22f206d9a6a0dd399879a88eafedca92bb6
(cherry picked from commit 5c4c05c8ea9f1b07862c09c8d971a3dae3b16adf)

23 months agoAdd ipsec policy test suites with flow director or rss accelerated 56/36456/1
Yulong Pei [Wed, 11 May 2022 04:29:50 +0000 (04:29 +0000)]
Add ipsec policy test suites with flow director or rss accelerated

The test scenario is about two private networks which communication was
protected by ipsec.

The test suites are to show performance impovement about ipsec esp flow
lookup that offloaded by NIC flow director and rss.

Verified on 3n-clx and Intel E810 NIC environment, with 64B ipsec packet
flow, performance improved ~31% with 1C2T, ~110% with 2C4T, ~250% with 4C8T.

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I30aec8c5115e5a6fbef88c11d1bef2624029d1b9
(cherry picked from commit f7ee014dee09b4089924342b0fe5654b2fe91e90)

23 months agodoc(infra): ICX onboarding 15/36415/1
Peter Mikus [Wed, 15 Jun 2022 13:44:17 +0000 (13:44 +0000)]
doc(infra): ICX onboarding

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I542a16dcc1f00b0cc2a9f1bce873b0e67d60b69e
(cherry picked from commit 7f1c5531d5f2b04b43ba84964a82f72e74469a59)

23 months agoUpdate VPP_STABLE_VER files 14/36414/2
Tibor Frank [Thu, 16 Jun 2022 06:58:23 +0000 (06:58 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ib6247374f12b5a25432407870bf9135c6196c725
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agofeat(jobspec): Avoid tests affected by CSIT-1830 13/36413/1
Vratko Polak [Wed, 8 Jun 2022 08:42:26 +0000 (10:42 +0200)]
feat(jobspec): Avoid tests affected by CSIT-1830

+ Replace TCP TPUT 100b tests on xxv710 NICs with 1518b ones.
 + Keep UDP TPUT tests at 100b for now.
+ Add both 100b and 1518b TCP TPUT tests to Denverton.
 + Its x553 NIC is not affected.
 + That gives us some comparison on how packet size affects performance.

Ticket: CSIT-1830

Change-Id: I5544f7ba84d4813148bcad2f9d64634939492647
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 5d412da6bf08a042765eabfea91e9484a8daba11)

23 months agofeat(tests): Remove PPS tests. 12/36412/1
Vratko Polak [Wed, 8 Jun 2022 08:39:49 +0000 (10:39 +0200)]
feat(tests): Remove PPS tests.

+ Delete nat44 pps suites.
+ Rename ip4base suites, testcases, suite tags (also tg) to -tput.
 + Also robot tags like UDP_PPS and TCP_PPS.
- Keep traffic types and traffic profile names with pps.
 + They can be renamed in a different change if needed.
+ Update job specs.
- Do not update methodology yet (avoid conflict with another Change).

Ticket: CSIT-1829

Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 158f54ff4d416c9bd282ffd0b8e812ec4e8214f4)

23 months agofeat(infra): SnowRidge docs 11/36411/1
Peter Mikus [Wed, 18 May 2022 09:57:02 +0000 (11:57 +0200)]
feat(infra): SnowRidge docs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie53e1e7474542547d73bdfe2a234e6e838bdd454
(cherry picked from commit 9f9e8be234eb422f189a6b3bc008963be7f1b213)

23 months agodoc(report): Update test environment 09/36409/1
Peter Mikus [Tue, 14 Jun 2022 11:14:49 +0000 (11:14 +0000)]
doc(report): Update test environment

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9987cac1493ea75eb097a0f2123768eec1ca3d73
(cherry picked from commit 1b97d7088f4db702b05c0fd4cbc02a52c97e4529)

23 months agofix(infra): Topopology link swap 07/36407/1
Peter Mikus [Tue, 14 Jun 2022 09:53:03 +0000 (09:53 +0000)]
fix(infra): Topopology link swap

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I20fc441cb46b70b2c315a2c865c3d11e3c341212
(cherry picked from commit 04288f6c4806fad01710225e4c4b789704e399d7)

23 months agotrending: fix 3n-alt missing in dashboard 06/36406/1
Viliam Luc [Tue, 14 Jun 2022 08:30:17 +0000 (10:30 +0200)]
trending: fix 3n-alt missing in dashboard

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I356998c521d47f085a78bf2577574ea0d489e02d
(cherry picked from commit a08e07a8f6c614899b85f891efd45d5e4e93f7f4)

23 months agofeat(dpdk): Bump the version within VM 04/36404/1
Peter Mikus [Mon, 13 Jun 2022 08:16:04 +0000 (08:16 +0000)]
feat(dpdk): Bump the version within VM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie358593f9977d04aca9e50a14e0d14158e1b0cf1
(cherry picked from commit 7e88ea8b9a31713be65587672f4fe22bccb5f386)

23 months agodoc(infra): Fix firmware versions 03/36403/1
Peter Mikus [Mon, 13 Jun 2022 05:57:02 +0000 (05:57 +0000)]
doc(infra): Fix firmware versions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I755043bc10b2bc419daf007f023742e814c3c63b
(cherry picked from commit e483990fff726fca8ec6a70fe202ab790517eddd)

23 months agoUpdate VPP_STABLE_VER files 01/36401/2
Tibor Frank [Mon, 13 Jun 2022 04:26:09 +0000 (04:26 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1ed61d9d807d2b8e66555deb26456017597cb9ae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agofix(core): T-Rex initialization 62/36362/1
Peter Mikus [Thu, 9 Jun 2022 09:45:26 +0000 (09:45 +0000)]
fix(core): T-Rex initialization

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I53226ff6a345ac99c1e2e110712b2ff6197efe95

23 months agoReport: Add retest data 61/36361/1
Tibor Frank [Thu, 9 Jun 2022 09:43:11 +0000 (11:43 +0200)]
Report: Add retest data

Change-Id: Ic42a15b44e0395c194cdeddef6d91635fd0f9b10
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 400205b1f838b88e72236559308d9c4b3ee61aa4)

23 months agofix(infra): 2n-clx links and docs 60/36360/1
Peter Mikus [Wed, 8 Jun 2022 12:35:04 +0000 (12:35 +0000)]
fix(infra): 2n-clx links and docs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iac1743da3eb51c69c67e8496ad4145dcc616341c
(cherry picked from commit 13a3991322bc77e5bc88c6b3970c191adb487f7d)

23 months agoReport: Add dpdk and re-test data 59/36359/1
Tibor Frank [Wed, 8 Jun 2022 08:49:08 +0000 (10:49 +0200)]
Report: Add dpdk and re-test data

Change-Id: Ia078a30f467c9a0eac45a58b83dd82975b815b5a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ea1e99ccb945344050ecd8f186a3d502ac51d28)

23 months agofix(infra): Temporarily disable X710 link loop 58/36358/1
Peter Mikus [Tue, 7 Jun 2022 08:20:45 +0000 (10:20 +0200)]
fix(infra): Temporarily disable X710 link loop

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4a8eb282754a5689cd538653e34bbc456e198f94
(cherry picked from commit 9d676f47078716600bd81504065755939c06d14a)

23 months agoReport: Add rc1, re-test, dpdk data 57/36357/1
Tibor Frank [Tue, 7 Jun 2022 05:29:50 +0000 (07:29 +0200)]
Report: Add rc1, re-test, dpdk data

Change-Id: I1ae47ee5d0ae21dd17bd6e99d81ab5e8f223f70b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8b91420cd22bca6203ac43aa09d1f227dacdaec4)

23 months agoReport: Add rc1, dpdk, re-test data 56/36356/1
Tibor Frank [Mon, 6 Jun 2022 07:56:17 +0000 (09:56 +0200)]
Report: Add rc1, dpdk, re-test  data

Change-Id: Icb8c2acccd27a7d2ec0da2b524a743f795f7ab36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 06833d943ed20cb5d816c024a61cf0a55d0d3e88)

23 months agoUpdate VPP_STABLE_VER files 95/36295/2
Tibor Frank [Mon, 6 Jun 2022 04:52:32 +0000 (04:52 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia08baac966f4cb5cff37ef84de7e9749c0a3aa30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoReport: Add rc1 data 91/36291/1
Tibor Frank [Fri, 3 Jun 2022 04:45:02 +0000 (06:45 +0200)]
Report: Add rc1 data

Change-Id: I569e49967bdebb02828cd166f7a9164afbbe9205
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1645eb04cff6d7340f7cf0301c1f5c65c9a5609a)

23 months agoReport: Add 3n-alt latency graphs 90/36290/1
Tibor Frank [Thu, 2 Jun 2022 09:55:48 +0000 (11:55 +0200)]
Report: Add 3n-alt latency graphs

Change-Id: Iaf2d123bcfd594d3e35d07c981c9f4b0597c7929
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b4fdfefab5579db61e4e98e898b2632eac4df8a8)

23 months agoReport: Add rc1 data 89/36289/1
Tibor Frank [Thu, 2 Jun 2022 06:19:54 +0000 (08:19 +0200)]
Report: Add rc1 data

Change-Id: I06c976cb91d5125d18fc9b2d313c2373f61d88b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 30fe9cc425351f1474f125b3baf40e6b841ba2fb)

23 months agoReport: fix: 3n-alt 88/36288/1
Tibor Frank [Wed, 1 Jun 2022 18:38:40 +0000 (20:38 +0200)]
Report: fix: 3n-alt

Change-Id: Idf3d8a393b928cf6f939355d2f6a5af93d18f440
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1541c34876f7134a542640d70a7c9a1d4df5e67d)

23 months agoReport: Add 3n-alt rc1 data 87/36287/1
Tibor Frank [Wed, 1 Jun 2022 18:22:08 +0000 (20:22 +0200)]
Report: Add 3n-alt rc1 data

Change-Id: I176dd4a109056b01c2b1b3b11e274b57258b7a02
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f895827a31218d4e149911a6b0a46ea045503b16)

23 months agoReport: Add 3n-alt 86/36286/1
Tibor Frank [Wed, 1 Jun 2022 13:40:43 +0000 (15:40 +0200)]
Report: Add 3n-alt

Change-Id: I2a811d5a2e618dc339a3e40c3b8c374a5051649c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5c2d02b6cd08e03b00ed8ec1bfc5289000e4da0a)

23 months agoReport: Remove 3n-aws 85/36285/1
Tibor Frank [Wed, 1 Jun 2022 07:38:04 +0000 (09:38 +0200)]
Report: Remove 3n-aws

Change-Id: I6e065cf25536197c2e414fde017390d54fb3b15c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 466bf87200ec963f4d7f809454876212c9273b0a)

23 months agoReport: Add rc1 data 84/36284/1
Tibor Frank [Wed, 1 Jun 2022 07:16:15 +0000 (09:16 +0200)]
Report: Add rc1 data

Change-Id: I79678b56fcdc5c8ff8736a87a7437ee145a40459
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 700100edcef04a78f3f8a9f99ced2d170d01875f)

23 months agofix(core): TG export 83/36283/1
Peter Mikus [Wed, 1 Jun 2022 05:22:19 +0000 (07:22 +0200)]
fix(core): TG export

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I80f9f32f10d46eccf1157949a184ec4467d071cd
(cherry picked from commit ed9140f77876c00b6caff6b9d76c516a493be921)

23 months agoReport: Add rc1 data 82/36282/1
Tibor Frank [Tue, 31 May 2022 04:47:49 +0000 (06:47 +0200)]
Report: Add rc1 data

Change-Id: I4f83a043c65ac1c968020024d139123a836fb33b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7afe43cad35079b93c223a2553e0e8746ddbc4c7)

23 months agoPAL: Remove nexus from data sources 81/36281/1
Tibor Frank [Mon, 30 May 2022 13:51:30 +0000 (15:51 +0200)]
PAL: Remove nexus from data sources

Change-Id: Iec40f3cb1ca543dc42017ccfb2a663aee1204531
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 83baf715f77d68e2d90ef279d34a85c8f51d0883)

23 months agoReport: Add rc1 data 80/36280/1
Tibor Frank [Mon, 30 May 2022 12:52:21 +0000 (14:52 +0200)]
Report: Add rc1 data

Change-Id: If71ad64c0778793afd9b8d8aff8a55c035b7dbfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5a7175b6a9fc0a6cd31441a203cd711796e56108)

23 months agofeat(infra): Update AWS AMIs 78/36278/1
Peter Mikus [Mon, 30 May 2022 10:01:22 +0000 (12:01 +0200)]
feat(infra): Update AWS AMIs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fd9351b2c3448809bdef282c23eedd1ca3364a7
(cherry picked from commit 63f02ab0e082f49b5fbc47f1e6f42c63fdb3b54f)

23 months agotrending: tput 100b tests update + static content 77/36277/1
Viliam Luc [Thu, 26 May 2022 06:57:45 +0000 (08:57 +0200)]
trending: tput 100b tests update + static content

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iba05311055b901ca3f5c2714bf0ea1c87525af50
(cherry picked from commit 36a4b3bd44f4da3740b69011dadc43e212864c11)

23 months agofeat(docs): Add e810 for 2n-clx 75/36275/1
Peter Mikus [Mon, 30 May 2022 08:06:17 +0000 (10:06 +0200)]
feat(docs): Add e810 for 2n-clx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I607ccd5d4b28dca576e40b79285bb2b31a65d76c
(cherry picked from commit 66b77bbd243e65346b593577fe7d2d0d85614626)

23 months agofeat(docs): Add e810 for 2n-clx 61/36261/1
Peter Mikus [Thu, 26 May 2022 10:34:04 +0000 (12:34 +0200)]
feat(docs): Add e810 for 2n-clx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I59f9df885907c7ce316e95a65fe98e9637820d01
(cherry picked from commit 28f1f3e4735386efae45630c8347b35089a3897c)

23 months agofix(core): TG export 60/36260/1
Peter Mikus [Thu, 26 May 2022 11:28:26 +0000 (13:28 +0200)]
fix(core): TG export

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60313cd62a878bb713832f14121a938a81c954ed
(cherry picked from commit 14b538d836f6a3562cf8df506bc09a53ec0ca950)

23 months agofeat(infra): remove 2n-skx 27/36227/1
Peter Mikus [Thu, 26 May 2022 06:57:38 +0000 (08:57 +0200)]
feat(infra): remove 2n-skx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Idabdef957f6191c6a05bc82fb8f86d3015b67fc7
(cherry picked from commit 67f7039576834e2feefb0fad223cb5c9c8ad852d)

23 months agoUpdate VPP_STABLE_VER files 92/35992/2
Tibor Frank [Thu, 26 May 2022 04:35:41 +0000 (04:35 +0000)]
Update VPP_STABLE_VER files

Change-Id: I851ee5f597927fe39b4eac4aa745c4f5f7ca58b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoReport: Configure report rls2206 09/36209/1
Tibor Frank [Wed, 25 May 2022 13:34:36 +0000 (15:34 +0200)]
Report: Configure report rls2206

Change-Id: If5cb8bfd0af11c9a9d35bac8de7a9c8f8c59092b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agofeat(etl): optimization 06/36206/1
Peter Mikus [Wed, 25 May 2022 09:06:41 +0000 (11:06 +0200)]
feat(etl): optimization

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2f313d5967e1ac745b817c4074487ccf56940b0a

23 months agofeat(etl): report 2206 05/36205/1
Peter Mikus [Wed, 25 May 2022 08:59:06 +0000 (10:59 +0200)]
feat(etl): report 2206

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I159860b7da1bd03f5cdf6a35c59221c079c863b1

23 months agofeat(etl): report 2206 04/36204/1
Peter Mikus [Wed, 25 May 2022 07:02:29 +0000 (09:02 +0200)]
feat(etl): report 2206

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I61fc4187ecd9948c2a8091229c5670f9c73e82ae

23 months agofix(uti): Add TG type export 88/36088/9
Peter Mikus [Thu, 5 May 2022 11:08:10 +0000 (13:08 +0200)]
fix(uti): Add TG type export

- This is actually bug not a feature.
- AB to be added later
- Tested on TREX and iPerf3

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib6f2d13e3b9401a9fb5759e42a8a310ee11b9d41

23 months agofeat(uti): Use only 1 worker 93/36193/1
Peter Mikus [Tue, 24 May 2022 07:52:13 +0000 (09:52 +0200)]
feat(uti): Use only 1 worker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84d20520abd58f698dac936ee06163e1b5b20e04

23 months agofix(dash): improve date formatting in hover 81/36181/2
Vratko Polak [Fri, 20 May 2022 08:27:49 +0000 (10:27 +0200)]
fix(dash): improve date formatting in hover

Bring it closer to RFC 3339 while keeping spaces.
The fully compatible format (2022-03-29T08:45:02Z)
may look too exotic for average human.

Dates other than in hover (e.g. in Time Period selection)
are not affected by this Change.

Change-Id: Ic5033d1b0db8505b0919e6a1392e28004c718f21
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoUpdate VPP_STABLE_VER files 88/35988/3
Tibor Frank [Mon, 23 May 2022 04:48:41 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7fa27b403f8e12d8c36728d462762dacd05de852
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoreport,trending: updated tput test to 100B 82/36182/3
Viliam Luc [Fri, 20 May 2022 10:37:33 +0000 (12:37 +0200)]
report,trending: updated tput test to 100B

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I4af6076dc0f02b952a04a3d3a5729b82f8a1e354

23 months agofeat(uti): Infra updates 80/36180/1
Peter Mikus [Fri, 20 May 2022 06:47:19 +0000 (08:47 +0200)]
feat(uti): Infra updates

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I82f84b81f4a016c8bd503e60caacf34f24d407d5

23 months agofeat(uti): Deploy tuning 73/36173/2
Peter Mikus [Thu, 19 May 2022 12:24:37 +0000 (14:24 +0200)]
feat(uti): Deploy tuning

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6f83e88a34997183fa2e7ac5bfe52b9bce50c906

23 months agofeat(uti): Add iterative data 55/36155/8
Tibor Frank [Tue, 17 May 2022 12:30:37 +0000 (14:30 +0200)]
feat(uti): Add iterative data

Change-Id: Iaa7253b377f019235289f6bbf48eafd850a2dfc8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agofix(jobspec): use 100b for tput and pps tests 87/36087/2
Vratko Polak [Thu, 5 May 2022 10:46:44 +0000 (12:46 +0200)]
fix(jobspec): use 100b for tput and pps tests

For TCP tests, 1518b is closer to what the real traffic would be,
but as usual we want smaller sizes to stress VPP before filling line.

CPS tests remain at 64b.

Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a

Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agofix(trex): use reset instead of clear_profile 52/36152/13
Vratko Polak [Tue, 17 May 2022 13:32:04 +0000 (15:32 +0200)]
fix(trex): use reset instead of clear_profile

Now sure why clear_profile gets stuck with v2.97
(unless block=False), but calling reset() works,
and will be less risky next time we bump TRex version.

- Only ASTF for now.

Change-Id: Ib6906fb8ce269e888bf0e0438d3309931d5e9981
Signed-off-by: Vratko Polak <vrpolak@cisco.com>