csit.git
2 years agoReport: Add data 14/35314/1
Tibor Frank [Thu, 17 Feb 2022 08:27:45 +0000 (09:27 +0100)]
Report: Add data

Change-Id: I1c9f58a27f1e881cca3e639d084547dfac88af91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1f7bfaf0f94fe68aadf41fde09b57c2f3171dea9)

2 years agoReport: Add data 11/35311/1
Tibor Frank [Wed, 16 Feb 2022 09:19:39 +0000 (10:19 +0100)]
Report: Add data

Change-Id: I908272cd297d9c4c27bfeb8d945a2a7dcf9ca494
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fa01a6c0347dbc40618e3419e005a5da7ae99bde)

2 years agoReport: Add data 09/35309/1
Tibor Frank [Mon, 14 Feb 2022 13:05:09 +0000 (14:05 +0100)]
Report: Add data

Change-Id: Ia50d5531f0a026512a694d349b37fef4916117a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d6199f77dc6d8d110adb8ac0680ef81eff88e069)

2 years agoReport: Remove 2n-icx vsap from stats 08/35308/1
Tibor Frank [Mon, 14 Feb 2022 10:12:14 +0000 (11:12 +0100)]
Report: Remove 2n-icx vsap from stats

Change-Id: I3794109781f2b599e24cc2749b76b776f6d66d29
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fb31765ac3f1b7c55eea7ca8ebc7e45185cb0a7d)

2 years agoReport: Enable stats tables for 2n-icx 07/35307/1
Tibor Frank [Mon, 14 Feb 2022 10:04:53 +0000 (11:04 +0100)]
Report: Enable stats tables for 2n-icx

Change-Id: Ia1db6924f52aafa096ccdc23361f001b05331af8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 61844eb0397f65133642929078fcbe678b0a7d4a)

2 years agoReport: Fix typo 06/35306/1
Tibor Frank [Mon, 14 Feb 2022 09:52:43 +0000 (10:52 +0100)]
Report: Fix typo

Change-Id: Ia7e3550a3904880cf5a6a8c867fef6d0c72462fe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ea59c76c67254c10a016dcd60974d58dcf10a18f)

2 years agoReport: Add data 05/35305/1
Tibor Frank [Mon, 14 Feb 2022 09:47:09 +0000 (10:47 +0100)]
Report: Add data

Change-Id: I14da70eea5a9268709d28edec1617499e3926b7e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit aae45cfa26d184413c13e55bacce85c524cdc571)

2 years agoReport: Add RC2 data 04/35304/1
Tibor Frank [Mon, 14 Feb 2022 08:52:52 +0000 (09:52 +0100)]
Report: Add RC2 data

Change-Id: I60b46dd75cae3a75fb17faa1d6020ebaf37cae96
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c564c79f4aa329ef1df8ef732e7971ab968acfbc)

2 years agojob-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skx 01/35301/1
Tibor Frank [Fri, 11 Feb 2022 11:06:22 +0000 (12:06 +0100)]
job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skx

Reason:
- ndrpdr job execution time >> 24hrs

Remove:
- ip4 and ip6 scale200k tests for dpdk and rdma
- ip4 and ip6 scale2m tests for dpdk and rdma
- af_xdp tests from NICs other than xxv710

Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9256923c6b890771ed17c53cd2896355e84987d0)

2 years agoReport: Small fixes 49/35249/1
Tibor Frank [Thu, 10 Feb 2022 09:19:19 +0000 (10:19 +0100)]
Report: Small fixes

Change-Id: I9c453f299aa291afec0605ce4a4a87e2b21dc480
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 841acf20d513fbf7b7b9e82cab02567ebd908c19)

2 years agoReport: Add 2n-icx GSO 48/35248/1
Tibor Frank [Tue, 8 Feb 2022 09:07:40 +0000 (10:07 +0100)]
Report: Add 2n-icx GSO

Change-Id: I171980a4ec67b85c3d0f2a680ebff29a2e6afcf2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 113ff4499daceefec04a3a25e594ee5554e80738)

2 years agoReport: Add icx soak, reconf, nfv 47/35247/1
Tibor Frank [Tue, 8 Feb 2022 08:24:15 +0000 (09:24 +0100)]
Report: Add icx soak, reconf, nfv

Change-Id: I96e59e75c0bb877e0aa68c2d9eccd73959358350
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1ec63f657dff7ce76eefa7787089866e9b99717c)

2 years agoUpdate VPP_STABLE_VER files 43/35243/2
Tibor Frank [Wed, 9 Feb 2022 15:33:58 +0000 (15:33 +0000)]
Update VPP_STABLE_VER files

Change-Id: I6039e946b797dfef15d2a3f39635125f69d9faa2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(iperf3): Compare string literals using != 42/35242/1
Vratko Polak [Tue, 8 Feb 2022 12:58:54 +0000 (13:58 +0100)]
fix(iperf3): Compare string literals using !=

The previous code leads to warnings from Robot.

Change-Id: I323f2abb277ae26d43ee5540a3b21e01a8dd9ef1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 0576c4293e05b1eded486b48a217495451a8b685)

2 years agofeat(autogen): generate gso suites for all nics 40/35240/1
Vratko Polak [Tue, 8 Feb 2022 09:45:46 +0000 (10:45 +0100)]
feat(autogen): generate gso suites for all nics

Previously, only x710 was generated, but ICX has xxv710 instead.
Nic drivers (tap or vhost) remain hardcoded.

Change-Id: I0ed3abb60258d74622995a8910f67ae4500ace56
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 31854f0cc48f0dde63b1ba82b467528181873435)

2 years agoReport: Small fixes 37/35237/1
Tibor Frank [Mon, 7 Feb 2022 13:47:08 +0000 (14:47 +0100)]
Report: Small fixes

Change-Id: Ib2cb94c747168b773409c18e3e366ebf3400ab99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7197f5428b5eb836a6fa636ff4ec9f14a65deca)

2 years agoTrending: Add icx latency trending graphs 36/35236/1
Tibor Frank [Mon, 7 Feb 2022 13:03:28 +0000 (14:03 +0100)]
Trending: Add icx latency trending graphs

Change-Id: I75dc5fa2e0f8d92651ec22293875c8b3568a2159
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 54fcebc6cdab6a2bff1e88bb07970ef3fe112508)

2 years agoTrending: Add icx nfv 94/35194/1
Tibor Frank [Mon, 7 Feb 2022 09:28:00 +0000 (10:28 +0100)]
Trending: Add icx nfv

Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c1b75945e67f1673afd5b2979636d22d861226bc)

2 years agoReport: Add icx latencies 92/35192/1
Tibor Frank [Mon, 7 Feb 2022 08:35:54 +0000 (09:35 +0100)]
Report: Add icx latencies

Change-Id: Idcab4424a1439f22e4708abc1c88fbd1125ca439
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c194cb7c8eebee1482f1c95c01252c35cfc26905)

2 years agoTrending: Add icx weekly 91/35191/1
Tibor Frank [Thu, 3 Feb 2022 07:09:49 +0000 (08:09 +0100)]
Trending: Add icx weekly

- Tables
  - data
  - dashboard
  - failed tests
  - last failed tests
  - weekly comparison tables
- graphs
  - stats
    - dpdk_mrr
    - vpp_ndrpdr
  - DPDK MRR
  - VPP NDRPDR

Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e5796ad7fac33f70942e4fd0f126a9c97e9fe9be)

2 years agoReport: Suite doc format 88/35188/1
Tibor Frank [Fri, 4 Feb 2022 09:47:56 +0000 (10:47 +0100)]
Report: Suite doc format

Change-Id: Ia2fb6c72d07ad008c36ff0ecd76b9dcd8b4abab4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit aead5d42f927ebaeff2bf1b2f4063d6adfd99f36)

2 years agoFix: Typo in Perf.NfvDensity.DcrMemif.ChainIpsec 87/35187/1
Tibor Frank [Fri, 4 Feb 2022 05:58:08 +0000 (06:58 +0100)]
Fix: Typo in Perf.NfvDensity.DcrMemif.ChainIpsec

Change-Id: I901ef0afce782bf69b7169e0dd08ce06b6f074b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 24ec60f7342fbb18c4a134406fb439af04947377)

2 years agoReport: Add dpdk icx static content 85/35185/1
Tibor Frank [Thu, 3 Feb 2022 15:19:24 +0000 (16:19 +0100)]
Report: Add dpdk icx static content

Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9af72734b4ff4cc239e69e8f787228e68d02501c)

2 years agoPAL: Process exception while writing table 84/35184/1
Tibor Frank [Thu, 3 Feb 2022 09:11:36 +0000 (10:11 +0100)]
PAL: Process exception while writing table

- table_merged_details

Change-Id: I4ee8b1c2f56c367e22d6e75853c8bb074d62935b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 100fc988c8140e36affac9fadc770328cc1d34b2)

2 years agoReport: Add data 83/35183/1
Tibor Frank [Thu, 3 Feb 2022 05:40:01 +0000 (06:40 +0100)]
Report: Add data

Change-Id: I9b3f1da0a889c73e4a0e00f3a283ca51e6ba64f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 11c41202e1d2e5f7e21975ea77372f2c91dbe4b0)

2 years agoReport: fix spec 82/35182/1
Tibor Frank [Wed, 2 Feb 2022 15:20:08 +0000 (16:20 +0100)]
Report: fix spec

Change-Id: Id5570aa55b2fec5973c4e924124dddf398eeecfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ef9715d1867b6a93e5dfdfcf84cf24f65f3ef44)

2 years agoReport: Add ICX 81/35181/1
Tibor Frank [Tue, 1 Feb 2022 12:34:40 +0000 (13:34 +0100)]
Report: Add ICX

- Stats
- DPDK
  - comparisom tables
  - detailed results
  - graphs
    - tput
    - speedup
- VPP
  - detailed results
  - graphs
    - tput
    - speedup

Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f4c31f23462c376e442b35242b2502541baccb83)

2 years agotrending: icx added 80/35180/1
Viliam Luc [Tue, 1 Feb 2022 14:09:59 +0000 (15:09 +0100)]
trending: icx added

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib742be7841b462eaa97ba1f6f87f7ac63bde03df
(cherry picked from commit bfd31ed5f42e106121e142c1da20bd9ab0745dd1)

2 years agoReport: Add data 78/35178/1
Tibor Frank [Tue, 1 Feb 2022 09:44:32 +0000 (10:44 +0100)]
Report: Add data

Change-Id: Ia516ffda944356cd9fbe18bc147371dcf7e9996d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f01d6e878cfe4213fd8bb02eb6cca4aa6536fdbd)

2 years agoReport: Add data 77/35177/1
Tibor Frank [Tue, 1 Feb 2022 09:35:45 +0000 (10:35 +0100)]
Report: Add data

Change-Id: I8908036f7eb84d22d0c23abfe149b8f5aa188639
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ea53ece9afb2bf58763ea508c063bdf8649fa413)

2 years agoTrending: Fix - 3n-icx spec 34/35134/1
Tibor Frank [Tue, 1 Feb 2022 05:49:42 +0000 (06:49 +0100)]
Trending: Fix - 3n-icx spec

Change-Id: I869e808fced5458dcc348d1fdc183580634aa977
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c800466d73d4f7233f677a7c30949392583c8f55)

2 years agoTrending: Add 3n-icx 32/35132/1
Tibor Frank [Mon, 31 Jan 2022 12:54:49 +0000 (13:54 +0100)]
Trending: Add 3n-icx

Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d3d4f9989b2fa7977bb545e0fb847bb3e785e8ba)

2 years agofeat(docs): Static content update 29/35129/1
Peter Mikus [Mon, 31 Jan 2022 11:25:21 +0000 (12:25 +0100)]
feat(docs): Static content update

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1cdd628be1d358fcca4bf05c9357c195ee3a8288
(cherry picked from commit ed72f828240f6184b38c38f8ccd078308c9cdfb9)

2 years agoTrending: Remove HSW 28/35128/1
Tibor Frank [Mon, 31 Jan 2022 09:42:54 +0000 (10:42 +0100)]
Trending: Remove HSW

Change-Id: I80ddeb6174c180e90c7e4b63378f08e430e452ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 87ad7ca7db9581990effa792a55a8a9bc9cac58a)

2 years agofix(telemetry): Add mpls to parse 26/35126/1
Peter Mikus [Mon, 31 Jan 2022 09:05:35 +0000 (10:05 +0100)]
fix(telemetry): Add mpls to parse

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I77d7273324cea884b561fc977cd9553fcf027ae5
(cherry picked from commit da6afcc3bd940c4bc7a9481f9e06b44f55f985aa)
(cherry picked from commit d0afc7b09fccc1945bf4130b5c70d74e0d53685e)

2 years agoTrending: Add 2n-icx 24/35124/1
Tibor Frank [Thu, 27 Jan 2022 11:01:09 +0000 (12:01 +0100)]
Trending: Add 2n-icx

Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3d629c4e670186a8506bfd9f50c85453c4fa7acd)

2 years agoUpdate VPP_STABLE_VER files 22/35122/2
Tibor Frank [Mon, 31 Jan 2022 05:41:59 +0000 (05:41 +0000)]
Update VPP_STABLE_VER files

Change-Id: I0f508a736ab7f09103c42d38e5ed75a11ea1eef7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(core): 3n-icx topology 20/35120/1
Peter Mikus [Thu, 27 Jan 2022 12:24:58 +0000 (13:24 +0100)]
fix(core): 3n-icx topology

+ Temporarily disable, until investigated

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9fd0ec96fe27b674dfcc4a36df05cc9a7a1db6ab
(cherry picked from commit c33444749e1a5ced42234437d92641f1a97c8375)
(cherry picked from commit b2f520933bcfd58365913407ca5db51cffc39f5a)

2 years agofix(dpdk): Jumbo 17/35117/1
Peter Mikus [Thu, 27 Jan 2022 09:30:26 +0000 (10:30 +0100)]
fix(dpdk): Jumbo

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0e659937440e9ff7070f0d13b7a1db99f27cf2bb
(cherry picked from commit d94696b6f770de74b48a6a97c01c192d9e76a9b2)

2 years agofix(core): ICX topology file 16/35116/1
Peter Mikus [Thu, 27 Jan 2022 08:49:25 +0000 (09:49 +0100)]
fix(core): ICX topology file

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I11b6a1d953f850240e1e95e0fc9e3c2b460cd43a
(cherry picked from commit 9c4eaa96ddd6c728c21eacf5ea28fb671311dbcb)
(cherry picked from commit 5d53efb957c17cb7d03d1e0d213433416a48929d)

2 years agoReport: Add data 94/35094/1
Tibor Frank [Thu, 27 Jan 2022 07:19:01 +0000 (08:19 +0100)]
Report: Add data

Change-Id: I1b8a3c10a065bf9f68ad855f2a892cd47af35f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 29c1d6edc81681cdd70f1eccb1e36d7ebab79ca6)

2 years agoReport: Add data 93/35093/1
Tibor Frank [Wed, 26 Jan 2022 09:35:11 +0000 (10:35 +0100)]
Report: Add data

Change-Id: I29e3bab8bcb57076f0eece519fa870a8645c2ce6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6b90944aac25d514b44041f0dca44dd0b34d8537)

2 years agofix(core): topology files, tox 91/35091/1
Peter Mikus [Tue, 25 Jan 2022 12:13:45 +0000 (13:13 +0100)]
fix(core): topology files, tox

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I93e2035568527c2f68732a0c7fe1865d100831ad
(cherry picked from commit d304fcfd3cc7caa710738ad45f6134809819e95d)

2 years agofix(core): Remove unused stuff 89/35089/1
Peter Mikus [Tue, 25 Jan 2022 11:37:43 +0000 (12:37 +0100)]
fix(core): Remove unused stuff

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0cfc9d9fbb1a82a308231a5d2c0b12cb632c469b
(cherry picked from commit f8f5d883fc816750ac051233709cfef869a10666)

2 years agotrending: fix re-pro showing wrong data 87/35087/1
Viliam Luc [Mon, 24 Jan 2022 11:59:47 +0000 (12:59 +0100)]
trending: fix re-pro showing wrong data

vpp-2n-zn2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-zn2/484, vpp version: 22.06-rc0~0-g017a67665~b2179

4t2c-avf-eth-l2bdbasemaclrn-mrr                   10ge2p1x710    64B    29.6   1  -0.2
2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.14   1  -58.08
4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.98   1  -57.73
4t4c-ethip4-ip4base-mrr                           10ge2p1x553    64B    2.97   1  -79.05
1t1c-eth-l2patch-mrr                              10ge2p1x553    64B    2.98   1  -75.94
2t2c-eth-l2bdbasemaclrn-mrr                       10ge2p1x553    64B    8.27   1  -11.0
2t1c-af-xdp-ethip4-ip4scale2m-mrr                 25ge2p1xxv710  64B    6.21   1  -53.14

vpp-2n-tx2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-tx2/265, vpp version: 22.02-rc0~508-g88a9c0e02~b851

4t2c-avf-eth-l2bdbasemaclrn-mrr                   10ge2p1x710    64B    29.6   1  -0.2
2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.14   1  -58.08
4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.98   1  -57.73
4t4c-ethip4-ip4base-mrr                           10ge2p1x553    64B    2.97   1  -79.05
1t1c-eth-l2patch-mrr                              10ge2p1x553    64B    2.98   1  -75.94
2t2c-eth-l2bdbasemaclrn-mrr                       10ge2p1x553    64B    8.27   1  -11.0
2t1c-af-xdp-ethip4-ip4scale2m-mrr                 25ge2p1xxv710  64B    6.21   1  -53.14

The same data for different TB.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iefce9a7196bae6fde45ee1935184efab4735e6e0
(cherry picked from commit 8967c82701a5b4e66536db6baefccbcfe5f8dfaf)

2 years agoReport: Add Comparison tables 86/35086/1
Tibor Frank [Tue, 25 Jan 2022 08:51:38 +0000 (09:51 +0100)]
Report: Add Comparison tables

- DPDK: 2n-tx2, 3n-tsh
- VPP: 2n-aws, 3n-aws

Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6e5cf8806c8c30bc58a5e6ad2e7dff1932c0d7d8)

2 years agoTrending: Add aws 85/35085/1
Tibor Frank [Mon, 24 Jan 2022 15:13:23 +0000 (16:13 +0100)]
Trending: Add aws

Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6c0c46585063c486867200e92b35b1e782a8d36e)

2 years agofeat(core): Add ICX 83/35083/1
Peter Mikus [Fri, 21 Jan 2022 13:11:13 +0000 (14:11 +0100)]
feat(core): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
(cherry picked from commit 75351e349449d6c397cb830828dc4f55883511a3)
(cherry picked from commit 8eb5cc75ca7c756e5d8dfb9f018dc8250dfe2fd3)

2 years agoReport: Configure Report 2202 81/35081/1
Tibor Frank [Mon, 24 Jan 2022 13:31:40 +0000 (14:31 +0100)]
Report: Configure Report 2202

Change-Id: I9be8b74716b09b2395fbab95eb37877867abbc22
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ac1fbfcd12d5bd4db1b04bbf27b6d47880bcd3e7)

2 years agofeat(doc): Add ICX 08/35008/2
Peter Mikus [Thu, 20 Jan 2022 10:49:49 +0000 (11:49 +0100)]
feat(doc): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0
(cherry picked from commit 6844308e3c8db8612d572fdb4f39f7eea02867e9)

2 years agofeat(ansible): Add ICX 07/35007/1
Peter Mikus [Fri, 21 Jan 2022 11:51:39 +0000 (12:51 +0100)]
feat(ansible): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9
(cherry picked from commit 62c4aa14348c9a4e0c44ca01e71ef842760c1d73)

2 years agofeat(pxe): Add ICX 00/35000/1
Peter Mikus [Wed, 19 Jan 2022 12:53:56 +0000 (13:53 +0100)]
feat(pxe): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I96918306e280cdefb023d24ff466be7c6eab44b6
(cherry picked from commit a5e623b3cd749ab86627b733c7c2c99c58588e90)

2 years agofeat(ansible): Compatibility matrix bump 51/34951/1
Peter Mikus [Thu, 20 Jan 2022 09:13:26 +0000 (10:13 +0100)]
feat(ansible): Compatibility matrix bump

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79
(cherry picked from commit e310defb66f8b66ebd505c3e04c62ae57f8fe447)

2 years agoUpdate VPP_STABLE_VER files 49/34949/2
Tibor Frank [Thu, 20 Jan 2022 07:57:10 +0000 (07:57 +0000)]
Update VPP_STABLE_VER files

Change-Id: I34a534bd6ff6cc9be754dea26232914047d1ed57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agotrending: fix empty regressions and progressions 71/34971/2
Viliam Luc [Wed, 19 Jan 2022 14:29:23 +0000 (15:29 +0100)]
trending: fix empty regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1405c5d1dbf9e137afbc5fd5d9f83ea572613ea9

2 years agofix(vpp_device): pci address existence condition 81/34481/3
Juraj Linkeš [Fri, 12 Nov 2021 13:34:52 +0000 (14:34 +0100)]
fix(vpp_device): pci address existence condition

The function get_pci_addr could check a different PCI_ADDR in case the
netdev device directory doesn't exit. Move the check so that it always
uses the proper PCI_ADDR and add a failure case when the netdev device
directory doesn't exist.

Change-Id: Ibadfea3fba34509cd3ea8f906ac5962c0f01dd17
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agofix(ansible): Compatibility matrix 64/34964/2
Peter Mikus [Wed, 19 Jan 2022 11:09:56 +0000 (12:09 +0100)]
fix(ansible): Compatibility matrix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I298625dc75cdc6ffc168484e19ca30f02c2f46a0

2 years agoTrending: Add NAT44Det tests for 2n-zn2 62/34962/1
Tibor Frank [Wed, 19 Jan 2022 08:36:00 +0000 (09:36 +0100)]
Trending: Add NAT44Det tests for 2n-zn2

Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoDoc: Update anomaly methodology documentation 27/34627/4
Vratko Polak [Fri, 14 Jan 2022 13:26:53 +0000 (14:26 +0100)]
Doc: Update anomaly methodology documentation

+ Define currently used compliance metrics (e.g. no short term change),
+ Clarify that (and why) column names in Dashboard and Alerting
  are somewhat different from the ones in the methodology document.

Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTrending: Unify anomaly related column names 09/34909/3
Vratko Polak [Fri, 14 Jan 2022 13:25:46 +0000 (14:25 +0100)]
Trending: Unify anomaly related column names

The most recent update merged was related to alerting,
so this Change uses the new column names defined there
also in Dashboard tables and legend.

Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agotrending: new view in regressions and progressions 64/34764/16
Viliam Luc [Fri, 17 Dec 2021 14:26:36 +0000 (15:26 +0100)]
trending: new view in regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I8524319a215ff551cf67c30d0b08ddae69883f61

2 years agofix(perpatch): Correct the autogen archive name 26/34926/3
Vratko Polak [Mon, 17 Jan 2022 17:09:16 +0000 (18:09 +0100)]
fix(perpatch): Correct the autogen archive name

Change-Id: I82bc5cd69de82a2d6b6689cf3380f667ea905886
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agotrending: shorten error messages 20/34920/5
Viliam Luc [Mon, 17 Jan 2022 09:45:15 +0000 (10:45 +0100)]
trending: shorten error messages

Sometimes error messages are longer than 1000 chars. This change
looks for [;, :, '] in messages between 128 and 256 character.
If it finds any of these the error message will be cut from
beggining to this character. If there's no character from the list
in error message and message is longer than 128 chars. It will
be cut from beggining to 129 character of error message

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I283f8ee8d81422235d897370dbc9508fafda6a7f

2 years agoReport: Add 2n-tx2 ipsec tests 29/34629/3
Tibor Frank [Wed, 1 Dec 2021 14:55:10 +0000 (15:55 +0100)]
Report: Add 2n-tx2 ipsec tests

- throughput
- speedup
- todo: latency

Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoRevert "Report: Temporarily change report specs" 41/34941/2
Tibor Frank [Mon, 17 Jan 2022 13:26:56 +0000 (13:26 +0000)]
Revert "Report: Temporarily change report specs"

This reverts commit cd1f9904e173ecb34836b33cb551ab9b9d378e18.

Reason for revert: Not needed

Change-Id: Id0739d4fba2d2abadd8ee9954c724a54b39cd8a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(uti): Fixing broken code part V 12/34912/9
Peter Mikus [Fri, 14 Jan 2022 14:02:31 +0000 (15:02 +0100)]
fix(uti): Fixing broken code part V

- UTI export breaks local execution
- disabling useless tox rules

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2f610b08f06f437e4482f291fa7b47cbb7b92984

2 years agoReport: Temporarily change report specs 36/34936/2
Tibor Frank [Mon, 17 Jan 2022 10:20:13 +0000 (10:20 +0000)]
Report: Temporarily change report specs

Change-Id: Ic8724a9676c2b2c37ee4f2de4c056b770a10d5af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoRevert "Temporarily change report specs" 55/34755/1
Tibor Frank [Mon, 17 Jan 2022 10:18:03 +0000 (10:18 +0000)]
Revert "Temporarily change report specs"

This reverts commit cc04963a4ad9bfd8dce0e31fd41226fa35e5e5d6.

Reason for revert: Some data-sets missing.

Change-Id: Id2363c2a71c0e87ad3d3e206a09d7af3984a1f36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTemporarily change report specs 53/34753/2
Tibor Frank [Mon, 17 Jan 2022 09:53:03 +0000 (09:53 +0000)]
Temporarily change report specs

- to generate tables with oper data

Change-Id: I06878713cd085d72eb3b9fef0c1aae1102dfb363
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(IPsec): fix policy tests 91/34591/27
Juraj Linkeš [Fri, 26 Nov 2021 10:03:05 +0000 (11:03 +0100)]
fix(IPsec): fix policy tests

Replace the hardcoded SPD inbound/outbound ranges with values derived
from test inputs.
Add the necessary routes now that the tunnel endpoints are not in the
same subnet. Also add ip neighbor entry on DUT2 for the same reason.
Also replace ipsec sa dump with show ipsec all in teardown of tests
where both SAs and SPDs are configured to improve troubleshooting.

Change-Id: I7d89a99fcf457a701c87bf6ac07364b62802677d
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoPAL: Fix sh-run 06/34906/8
Tibor Frank [Fri, 14 Jan 2022 08:43:47 +0000 (09:43 +0100)]
PAL: Fix sh-run

- do not post-process telemetry data

Change-Id: I800a99d8e92016d1fa675b18e2b2d30db4a15077
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 50/34750/2
Tibor Frank [Mon, 17 Jan 2022 05:05:05 +0000 (05:05 +0000)]
Update VPP_STABLE_VER files

Change-Id: I686383bddec601403c2fbc11d79260f9579a7470
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoJumpAvg: Fix string format 03/34903/2
Vratko Polak [Fri, 14 Jan 2022 09:16:23 +0000 (10:16 +0100)]
JumpAvg: Fix string format

Change-Id: Id3975dfcca0040b799f31dcd14789d8c90993b14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agofix(uti): Fixing broken code part IV 86/34886/1
Peter Mikus [Wed, 12 Jan 2022 09:12:49 +0000 (10:12 +0100)]
fix(uti): Fixing broken code part IV

Part of fixing chain

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie423ccf5a51751e605d906dd1214f5174bb364ac

2 years agofeat(uti): Dash demo 72/34872/4
Peter Mikus [Mon, 10 Jan 2022 12:19:31 +0000 (13:19 +0100)]
feat(uti): Dash demo

- displays the table with trending data downloaded from trending pages

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic0d48290105ccd846c7de9ee4d8acb78e0b72f00

2 years agofix(core): Constants.py 67/34867/3
Peter Mikus [Mon, 10 Jan 2022 10:03:27 +0000 (11:03 +0100)]
fix(core): Constants.py

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia5a097797b54c2e71acdcc8d72706e5540536252

2 years agoDoc: Tweak trend analysis document 32/34532/4
Vratko Polak [Wed, 1 Dec 2021 13:45:56 +0000 (14:45 +0100)]
Doc: Tweak trend analysis document

Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 46/34746/2
Tibor Frank [Mon, 10 Jan 2022 06:15:50 +0000 (06:15 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1b4b92a69a31c3a934acb6e305631eeb9152ef31
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(uti): Fixing broken code part III 89/34789/5
pmikus [Wed, 22 Dec 2021 13:29:53 +0000 (14:29 +0100)]
fix(uti): Fixing broken code part III

Part of fixing chain after early merge.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I06e19def003575993bc3d97c0dc7fbedd3e5ff7a

2 years agoUpdate VPP_STABLE_VER files 45/34745/2
Tibor Frank [Fri, 7 Jan 2022 06:08:10 +0000 (06:08 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ic468388973a84b00bf3f62de88bf65c1f37d780f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 44/34744/2
Tibor Frank [Mon, 27 Dec 2021 06:34:02 +0000 (06:34 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7a91fd0d8bbfcfffa2a4ae9c6873826b56299e22
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 43/34743/2
Tibor Frank [Thu, 23 Dec 2021 08:03:37 +0000 (08:03 +0000)]
Update VPP_STABLE_VER files

Change-Id: I2ff994b6eb9a2b87d4ea99f861a5b47b15a5d642
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agofix(uti): Fixing broken code part II 87/34787/2
pmikus [Wed, 22 Dec 2021 11:38:26 +0000 (12:38 +0100)]
fix(uti): Fixing broken code part II

Part of fixing chain after early merge.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I983b3036a388656bbad91aba71cf14b503f875bd

2 years agofeat(telemetry): show hardware 83/34783/3
pmikus [Wed, 22 Dec 2021 08:49:25 +0000 (09:49 +0100)]
feat(telemetry): show hardware

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0c0bf055e5963ac794f66cce9d5d45bb628facee

2 years agofix(uti): Fixing broken code part I 81/34781/2
pmikus [Wed, 22 Dec 2021 07:24:24 +0000 (08:24 +0100)]
fix(uti): Fixing broken code part I

Part of fixing chain after early merge.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624

2 years agoadd 2-node ipsec hwasync cases 00/34600/3
xinfeng zhao [Mon, 29 Nov 2021 03:59:52 +0000 (11:59 +0800)]
add 2-node ipsec hwasync cases

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I1590d438216e4c886aae03f83364837153623dbc

2 years agoansible: match vpp device config to perf config 56/34556/2
Juraj Linkeš [Thu, 26 Aug 2021 08:43:45 +0000 (10:43 +0200)]
ansible: match vpp device config to perf config

We're not using unsafe noiommu on perf testbeds and we should mirror
that config in vpp device.
As a side note, on arm vpp device, enabling unsafe noiommu leads to
corrupted packets, so it must be disabled at least on arm vpp device.

Also update arm vpp device kernel parameters to match perf testbeds.

Change-Id: Id3d3e8fcf71583cc04887b4180cd20561856d902
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agofeat(infra): DPDK 21.11 78/34778/2
pmikus [Tue, 21 Dec 2021 09:34:45 +0000 (10:34 +0100)]
feat(infra): DPDK 21.11

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib52fab112d458decfecf39c77085bcd85f811eba

2 years agofeat(infra): Add new compatibility matrix 77/34777/1
pmikus [Tue, 21 Dec 2021 09:23:49 +0000 (10:23 +0100)]
feat(infra): Add new compatibility matrix

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64deff93308771c2b3fc2e07fa8f2614b5e4ac9a

2 years agoansible: add kernel pinning to vpp device 79/34479/4
Juraj Linkeš [Fri, 12 Nov 2021 12:31:12 +0000 (13:31 +0100)]
ansible: add kernel pinning to vpp device

Change-Id: Ife26766e5f92ab95b537b39c25202fec6be27db3
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agotrending: hotfix failing trending emails 56/34756/4
Viliam Luc [Thu, 16 Dec 2021 08:22:43 +0000 (09:22 +0100)]
trending: hotfix failing trending emails

Legend was showing for each job_name. When trying to fix it
we broke the cpta with I/O operation. This fixes legend
positioning and I/O operation error.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I809daa3eabe6a728e5e183630fc7c6615dfef8bf

2 years agofeat(dpdk): bump dpdk version 33/34733/1
pmikus [Wed, 15 Dec 2021 17:07:55 +0000 (18:07 +0100)]
feat(dpdk): bump dpdk version

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia3601c7d990bfe491e2b927b1208742e506f7c43

2 years agofix(dpdk): allow 32/34732/1
pmikus [Wed, 15 Dec 2021 16:59:45 +0000 (17:59 +0100)]
fix(dpdk): allow

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic7f24767b60eef5ddb7cdf5f933d82930c625f5c

2 years agoUTI: Export results 27/34727/3
Vratko Polak [Wed, 15 Dec 2021 16:14:36 +0000 (17:14 +0100)]
UTI: Export results

+ Model version 1.0.0.
- Only some result types are exported.
 + MRR, NDRPDR and SOAK.
 - Other result types to be added later.
 + In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
 + Sort dict keys before converting to JSON.
  + Override the order for some known keys.
 + Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
 + Info files for setup/teardown exist only temporarily.
 + The data is merged into suite.info.json file.
  + This simplifies presentation of total suite duration.
+ Define model via JSON schema:
 - Just test case, suite setup/teardown/suite to be added later.
 - Just info, raw to be added later.
 + Proper descriptions.
 + Json is generated from yaml.
  + This is a convenience for maintainers.
  + The officially used schema is the .json one.
 + TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
 + Include format checking.
 + Update CSIT requirements for validation dependencies.
  + This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
 + This unifies with NDRPDR to simplify schema definition.
 - PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
 + Move raw outputs into test_output_raw.tar.xz.
 + Rename existing tar with suites to generated_robot_files.tar.xz.

Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTox: Add checker for CSIT model version 88/32488/55
Vratko Polak [Mon, 29 Nov 2021 15:17:15 +0000 (16:17 +0100)]
Tox: Add checker for CSIT model version

+ Implementation stub so checker can check already.
+ Also add documentation stub for the implemented model.
+ Checker checks also for bumps in documentation version.
- Not comparing implementation and documentation version yet.

Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoINFO: Remove Jan from committers 81/34581/2
Vratko Polak [Wed, 24 Nov 2021 15:53:56 +0000 (16:53 +0100)]
INFO: Remove Jan from committers

He is no longer active on the project.

Change-Id: Ic7621fb3dc4148ba41760f227e39bc52256b7463
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agotrending: legend positioning 29/34729/2
Viliam Luc [Wed, 15 Dec 2021 07:40:09 +0000 (08:40 +0100)]
trending: legend positioning

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc

2 years agodocs: small update structure fix 24/34724/3
Viliam Luc [Tue, 14 Dec 2021 13:44:27 +0000 (14:44 +0100)]
docs: small update structure fix

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib0a853f7bd8cdbb0dee747e4f601bc4e54d006e9

2 years agotrending: fix broken trending 23/34723/3
Viliam Luc [Tue, 14 Dec 2021 11:03:33 +0000 (12:03 +0100)]
trending: fix broken trending

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a

2 years agodocs(lab): Intel Icelake 73/34673/8
pmikus [Fri, 3 Dec 2021 08:53:23 +0000 (09:53 +0100)]
docs(lab): Intel Icelake

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98