csit.git
8 months agoUpdate VPP_STABLE_VER files 96/35496/2
Tibor Frank [Mon, 28 Feb 2022 05:20:04 +0000 (05:20 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ic4b5525109c18d41f9a50beda029973384ad993a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agochore(etl): move etl url 31/35431/1
Peter Mikus [Thu, 24 Feb 2022 08:28:53 +0000 (09:28 +0100)]
chore(etl): move etl url

- Due to circle dependency moving in this patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie774ebcfddae232a43966c3ae8f716db6e1a63d5

9 months agofeat(uti): etl 07/35407/4
Peter Mikus [Tue, 22 Feb 2022 10:00:47 +0000 (11:00 +0100)]
feat(uti): etl

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7cdcdcbf1e4986664d5d48357688185319f67b0c

9 months agoUTI: PoC - Dash application for Trending 02/35102/8
Tibor Frank [Wed, 26 Jan 2022 08:31:43 +0000 (09:31 +0100)]
UTI: PoC - Dash application for Trending

- delete old dash demo

Change-Id: I3e75c1dc18ee85c1826838af0343a4b779f71754
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Configure rls report 18/35418/2
Tibor Frank [Wed, 23 Feb 2022 06:54:57 +0000 (07:54 +0100)]
Report: Configure rls report

Change-Id: I21249913fa713507519bd3ae385575c7d2bab300
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 16/35416/1
Tibor Frank [Wed, 23 Feb 2022 05:43:40 +0000 (06:43 +0100)]
Report: Add data

Change-Id: Ia7841d8f8827b9c2d387981a573fe5dd1e1f4956
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofix(uti): Fixing broken code part VI 06/35406/2
Peter Mikus [Tue, 22 Feb 2022 07:47:48 +0000 (08:47 +0100)]
fix(uti): Fixing broken code part VI

- Printing large sets makes no sense.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia4bf411368ca2424ad313b8e7bb0fb76cb175988

9 months agoReport: Add data 00/35400/1
Tibor Frank [Mon, 21 Feb 2022 08:19:55 +0000 (09:19 +0100)]
Report: Add data

Change-Id: Ie0fa38ce16d09dda06c433ed2fee5bfd64cb8627
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 84/35384/2
Tibor Frank [Mon, 21 Feb 2022 05:42:45 +0000 (05:42 +0000)]
Update VPP_STABLE_VER files

Change-Id: I23e75498af51b8e6aa28d10974c522cac7cf5a31
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Fixes 71/35371/1
Tibor Frank [Fri, 18 Feb 2022 13:17:35 +0000 (14:17 +0100)]
Trending: Fixes

Change-Id: I2bb089720fda87f28c17c64bc664ae79343360fb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 63/35363/1
Tibor Frank [Fri, 18 Feb 2022 06:37:27 +0000 (07:37 +0100)]
Report: Add data

Change-Id: If66753eae0416da9371cd124d790635b276210d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agodoc update 54/35354/1
tomas.smado [Thu, 17 Feb 2022 12:50:20 +0000 (13:50 +0100)]
doc update

Change-Id: I6f1663006813f13b34aa0c88eed25c77ac7d8a73
Signed-off-by: tomas.smado <tomas.smado@pantheon.tech>
9 months agoPer-patch: Allow parsing CPS MRR results 53/30953/5
Vratko Polak [Wed, 27 Jan 2021 16:13:05 +0000 (17:13 +0100)]
Per-patch: Allow parsing CPS MRR results

The previous grep was too strict about test message.

Change-Id: Ib0c120a32d205b905f257e5b3c948a309ed8abb2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Add data 47/35347/1
Tibor Frank [Thu, 17 Feb 2022 08:27:45 +0000 (09:27 +0100)]
Report: Add data

Change-Id: I1c9f58a27f1e881cca3e639d084547dfac88af91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agochore(api): use the non-deprecated nat init call 39/35339/7
Vratko Polak [Wed, 16 Feb 2022 13:28:45 +0000 (14:28 +0100)]
chore(api): use the non-deprecated nat init call

Change-Id: Ic1949c46aa339e66a47a0ebbc428499c5cf9305e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoadded 2 new servers 32/35332/6
tomas.smado [Tue, 15 Feb 2022 13:00:51 +0000 (14:00 +0100)]
added 2 new servers

Signed-off-by: tomas.smado <tomas.smado@pantheon.tech>
Change-Id: I45663638ac65b2d7c0fba51698811ccd06e4af55

9 months agoReport: Add data 40/35340/1
Tibor Frank [Wed, 16 Feb 2022 09:19:39 +0000 (10:19 +0100)]
Report: Add data

Change-Id: I908272cd297d9c4c27bfeb8d945a2a7dcf9ca494
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofix(nat): parse new show nat44 summary output 95/35295/8
Vratko Polak [Tue, 15 Feb 2022 09:59:14 +0000 (10:59 +0100)]
fix(nat): parse new show nat44 summary output

+ Keep support for VPP 22.02 CLI output.
 + Keep tolerating "timed out" sessions for 2202 output.
+ Subtract timed-out sessions for post-2202 output.
+ Explain the logic differences in docstring.
+ Convert the return value to int.

Change-Id: I8a119e1034848bfd0fb131cb633e2441b44634a2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Add data 20/35320/2
Tibor Frank [Mon, 14 Feb 2022 13:05:09 +0000 (14:05 +0100)]
Report: Add data

Change-Id: Ia50d5531f0a026512a694d349b37fef4916117a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Remove 2n-icx vsap from stats 19/35319/1
Tibor Frank [Mon, 14 Feb 2022 10:12:14 +0000 (11:12 +0100)]
Report: Remove 2n-icx vsap from stats

Change-Id: I3794109781f2b599e24cc2749b76b776f6d66d29
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Enable stats tables for 2n-icx 18/35318/1
Tibor Frank [Mon, 14 Feb 2022 10:04:53 +0000 (11:04 +0100)]
Report: Enable stats tables for 2n-icx

Change-Id: Ia1db6924f52aafa096ccdc23361f001b05331af8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Fix typo 17/35317/2
Tibor Frank [Mon, 14 Feb 2022 09:52:43 +0000 (10:52 +0100)]
Report: Fix typo

Change-Id: Ia7e3550a3904880cf5a6a8c867fef6d0c72462fe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 16/35316/1
Tibor Frank [Mon, 14 Feb 2022 09:47:09 +0000 (10:47 +0100)]
Report: Add data

Change-Id: I14da70eea5a9268709d28edec1617499e3926b7e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add RC2 data 94/35294/2
Tibor Frank [Mon, 14 Feb 2022 08:52:52 +0000 (09:52 +0100)]
Report: Add RC2 data

Change-Id: I60b46dd75cae3a75fb17faa1d6020ebaf37cae96
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 02/35302/2
Tibor Frank [Mon, 14 Feb 2022 05:50:26 +0000 (05:50 +0000)]
Update VPP_STABLE_VER files

Change-Id: I04d34eb358a0383049736e41ef93e46f48213458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agojob-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skx 87/35287/2
Tibor Frank [Fri, 11 Feb 2022 11:06:22 +0000 (12:06 +0100)]
job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skx

Reason:
- ndrpdr job execution time >> 24hrs

Remove:
- ip4 and ip6 scale200k tests for dpdk and rdma
- ip4 and ip6 scale2m tests for dpdk and rdma
- af_xdp tests from NICs other than xxv710

Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Small fixes 75/35275/1
Tibor Frank [Thu, 10 Feb 2022 09:19:19 +0000 (10:19 +0100)]
Report: Small fixes

Change-Id: I9c453f299aa291afec0605ce4a4a87e2b21dc480
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofix(terraform): Prometheus job 74/35274/2
Peter Mikus [Thu, 10 Feb 2022 08:10:28 +0000 (09:10 +0100)]
fix(terraform): Prometheus job

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1c0b736e2b2cd820271ee0aaddf3167e61d713d4

9 months agoReport: Add 2n-icx GSO 57/35257/2
Tibor Frank [Tue, 8 Feb 2022 09:07:40 +0000 (10:07 +0100)]
Report: Add 2n-icx GSO

Change-Id: I171980a4ec67b85c3d0f2a680ebff29a2e6afcf2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add icx soak, reconf, nfv 56/35256/5
Tibor Frank [Tue, 8 Feb 2022 08:24:15 +0000 (09:24 +0100)]
Report: Add icx soak, reconf, nfv

Change-Id: I96e59e75c0bb877e0aa68c2d9eccd73959358350
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofeat(terraform): Refactor Prometheus 66/35266/1
Peter Mikus [Wed, 9 Feb 2022 10:07:53 +0000 (11:07 +0100)]
feat(terraform): Refactor Prometheus

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47a05fc0207d691d84c6e65c7b84997edab8e272

9 months agofeat(terraform): Refactor Alertmanager 65/35265/2
Peter Mikus [Wed, 9 Feb 2022 08:58:09 +0000 (09:58 +0100)]
feat(terraform): Refactor Alertmanager

- prepare for ETL

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8931f76f78b5acee39716398b92e4b107d399773

9 months agofix(iperf3): Compare string literals using != 60/35260/2
Vratko Polak [Tue, 8 Feb 2022 12:58:54 +0000 (13:58 +0100)]
fix(iperf3): Compare string literals using !=

The previous code leads to warnings from Robot.

Change-Id: I323f2abb277ae26d43ee5540a3b21e01a8dd9ef1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agofeat(autogen): generate gso suites for all nics 59/35259/2
Vratko Polak [Tue, 8 Feb 2022 09:45:46 +0000 (10:45 +0100)]
feat(autogen): generate gso suites for all nics

Previously, only x710 was generated, but ICX has xxv710 instead.
Nic drivers (tap or vhost) remain hardcoded.

Change-Id: I0ed3abb60258d74622995a8910f67ae4500ace56
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoReport: Small fixes 29/35229/2
Tibor Frank [Mon, 7 Feb 2022 13:47:08 +0000 (14:47 +0100)]
Report: Small fixes

Change-Id: Ib2cb94c747168b773409c18e3e366ebf3400ab99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Add icx latency trending graphs 28/35228/1
Tibor Frank [Mon, 7 Feb 2022 13:03:28 +0000 (14:03 +0100)]
Trending: Add icx latency trending graphs

Change-Id: I75dc5fa2e0f8d92651ec22293875c8b3568a2159
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Add icx nfv 26/35226/1
Tibor Frank [Mon, 7 Feb 2022 09:28:00 +0000 (10:28 +0100)]
Trending: Add icx nfv

Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add icx latencies 25/35225/3
Tibor Frank [Mon, 7 Feb 2022 08:35:54 +0000 (09:35 +0100)]
Report: Add icx latencies

Change-Id: Idcab4424a1439f22e4708abc1c88fbd1125ca439
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 89/35189/3
Tibor Frank [Mon, 7 Feb 2022 05:34:14 +0000 (05:34 +0000)]
Update VPP_STABLE_VER files

Change-Id: I4502d63b732924acc361de3f1141e792a32dbf8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Add icx weekly 05/35205/4
Tibor Frank [Thu, 3 Feb 2022 07:09:49 +0000 (08:09 +0100)]
Trending: Add icx weekly

- Tables
  - data
  - dashboard
  - failed tests
  - last failed tests
  - weekly comparison tables
- graphs
  - stats
    - dpdk_mrr
    - vpp_ndrpdr
  - DPDK MRR
  - VPP NDRPDR

Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Suite doc format 17/35217/1
Tibor Frank [Fri, 4 Feb 2022 09:47:56 +0000 (10:47 +0100)]
Report: Suite doc format

Change-Id: Ia2fb6c72d07ad008c36ff0ecd76b9dcd8b4abab4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofeat(terraform): Refactor vault backend 16/35216/3
Peter Mikus [Fri, 4 Feb 2022 08:56:00 +0000 (09:56 +0100)]
feat(terraform): Refactor vault backend

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I914ecf444b5f8870969f1d996ba03a42fd92a5d5

9 months agoFix: Typo in Perf.NfvDensity.DcrMemif.ChainIpsec 15/35215/2
Tibor Frank [Fri, 4 Feb 2022 05:58:08 +0000 (06:58 +0100)]
Fix: Typo in Perf.NfvDensity.DcrMemif.ChainIpsec

Change-Id: I901ef0afce782bf69b7169e0dd08ce06b6f074b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add dpdk icx static content 10/35210/1
Tibor Frank [Thu, 3 Feb 2022 15:19:24 +0000 (16:19 +0100)]
Report: Add dpdk icx static content

Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoPAL: Process exception while writing table 06/35206/3
Tibor Frank [Thu, 3 Feb 2022 09:11:36 +0000 (10:11 +0100)]
PAL: Process exception while writing table

- table_merged_details

Change-Id: I4ee8b1c2f56c367e22d6e75853c8bb074d62935b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 04/35204/1
Tibor Frank [Thu, 3 Feb 2022 05:40:01 +0000 (06:40 +0100)]
Report: Add data

Change-Id: I9b3f1da0a889c73e4a0e00f3a283ca51e6ba64f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: fix spec 99/35199/1
Tibor Frank [Wed, 2 Feb 2022 15:20:08 +0000 (16:20 +0100)]
Report: fix spec

Change-Id: Id5570aa55b2fec5973c4e924124dddf398eeecfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add ICX 69/35169/4
Tibor Frank [Tue, 1 Feb 2022 12:34:40 +0000 (13:34 +0100)]
Report: Add ICX

- Stats
- DPDK
  - comparisom tables
  - detailed results
  - graphs
    - tput
    - speedup
- VPP
  - detailed results
  - graphs
    - tput
    - speedup

Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agotrending: icx added 71/35171/1
Viliam Luc [Tue, 1 Feb 2022 14:09:59 +0000 (15:09 +0100)]
trending: icx added

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib742be7841b462eaa97ba1f6f87f7ac63bde03df

9 months agoReport: Add data 67/35167/1
Tibor Frank [Tue, 1 Feb 2022 09:44:32 +0000 (10:44 +0100)]
Report: Add data

Change-Id: Ia516ffda944356cd9fbe18bc147371dcf7e9996d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoReport: Add data 66/35166/1
Tibor Frank [Tue, 1 Feb 2022 09:35:45 +0000 (10:35 +0100)]
Report: Add data

Change-Id: I8908036f7eb84d22d0c23abfe149b8f5aa188639
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Fix - 3n-icx spec 61/35161/1
Tibor Frank [Tue, 1 Feb 2022 05:49:42 +0000 (06:49 +0100)]
Trending: Fix - 3n-icx spec

Change-Id: I869e808fced5458dcc348d1fdc183580634aa977
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoTrending: Add 3n-icx 52/35152/3
Tibor Frank [Mon, 31 Jan 2022 12:54:49 +0000 (13:54 +0100)]
Trending: Add 3n-icx

Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofeat(docs): Static content update 51/35151/2
Peter Mikus [Mon, 31 Jan 2022 11:25:21 +0000 (12:25 +0100)]
feat(docs): Static content update

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1cdd628be1d358fcca4bf05c9357c195ee3a8288

9 months agoTrending: Remove HSW 49/35149/2
Tibor Frank [Mon, 31 Jan 2022 09:42:54 +0000 (10:42 +0100)]
Trending: Remove HSW

Change-Id: I80ddeb6174c180e90c7e4b63378f08e430e452ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofix(telemetry): Add mpls to parse 47/35147/2
Peter Mikus [Mon, 31 Jan 2022 09:05:35 +0000 (10:05 +0100)]
fix(telemetry): Add mpls to parse

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I77d7273324cea884b561fc977cd9553fcf027ae5

9 months agoTrending: Add 2n-icx 09/35109/3
Tibor Frank [Thu, 27 Jan 2022 11:01:09 +0000 (12:01 +0100)]
Trending: Add 2n-icx

Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 21/35121/2
Tibor Frank [Mon, 31 Jan 2022 05:40:48 +0000 (05:40 +0000)]
Update VPP_STABLE_VER files

Change-Id: If7be325e8c10ae12a30bc3363b6d5daadc685e56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoDoc: Add discussion about common anomaly patterns 10/34910/5
Vratko Polak [Fri, 28 Jan 2022 10:06:00 +0000 (11:06 +0100)]
Doc: Add discussion about common anomaly patterns

Change-Id: Ic70c653cb660663abe48c2a0ae3e496a4e8c85f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofix(core): 3n-icx topology 10/35110/1
Peter Mikus [Thu, 27 Jan 2022 12:24:58 +0000 (13:24 +0100)]
fix(core): 3n-icx topology

+ Temporarily disable, until investigated

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9fd0ec96fe27b674dfcc4a36df05cc9a7a1db6ab

10 months agofix(dpdk): Jumbo 07/35107/2
Peter Mikus [Thu, 27 Jan 2022 09:30:26 +0000 (10:30 +0100)]
fix(dpdk): Jumbo

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0e659937440e9ff7070f0d13b7a1db99f27cf2bb

10 months agofix(core): ICX topology file 06/35106/2
Peter Mikus [Thu, 27 Jan 2022 08:49:25 +0000 (09:49 +0100)]
fix(core): ICX topology file

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I11b6a1d953f850240e1e95e0fc9e3c2b460cd43a

10 months agoReport: Add data 05/35105/1
Tibor Frank [Thu, 27 Jan 2022 07:19:01 +0000 (08:19 +0100)]
Report: Add data

Change-Id: I1b8a3c10a065bf9f68ad855f2a892cd47af35f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoReport: Add data 00/35100/1
Tibor Frank [Wed, 26 Jan 2022 09:35:11 +0000 (10:35 +0100)]
Report: Add data

Change-Id: I29e3bab8bcb57076f0eece519fa870a8645c2ce6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(core): topology files, tox 74/35074/1
Peter Mikus [Tue, 25 Jan 2022 12:13:45 +0000 (13:13 +0100)]
fix(core): topology files, tox

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I93e2035568527c2f68732a0c7fe1865d100831ad

10 months agofix(core): Remove unused stuff 73/35073/2
Peter Mikus [Tue, 25 Jan 2022 11:37:43 +0000 (12:37 +0100)]
fix(core): Remove unused stuff

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0cfc9d9fbb1a82a308231a5d2c0b12cb632c469b

10 months agotrending: fix re-pro showing wrong data 57/35057/3
Viliam Luc [Mon, 24 Jan 2022 11:59:47 +0000 (12:59 +0100)]
trending: fix re-pro showing wrong data

vpp-2n-zn2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-zn2/484, vpp version: 22.06-rc0~0-g017a67665~b2179

4t2c-avf-eth-l2bdbasemaclrn-mrr                   10ge2p1x710    64B    29.6   1  -0.2
2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.14   1  -58.08
4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.98   1  -57.73
4t4c-ethip4-ip4base-mrr                           10ge2p1x553    64B    2.97   1  -79.05
1t1c-eth-l2patch-mrr                              10ge2p1x553    64B    2.98   1  -75.94
2t2c-eth-l2bdbasemaclrn-mrr                       10ge2p1x553    64B    8.27   1  -11.0
2t1c-af-xdp-ethip4-ip4scale2m-mrr                 25ge2p1xxv710  64B    6.21   1  -53.14

vpp-2n-tx2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-tx2/265, vpp version: 22.02-rc0~508-g88a9c0e02~b851

4t2c-avf-eth-l2bdbasemaclrn-mrr                   10ge2p1x710    64B    29.6   1  -0.2
2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.14   1  -58.08
4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr  10ge2p1x520    64B    1.98   1  -57.73
4t4c-ethip4-ip4base-mrr                           10ge2p1x553    64B    2.97   1  -79.05
1t1c-eth-l2patch-mrr                              10ge2p1x553    64B    2.98   1  -75.94
2t2c-eth-l2bdbasemaclrn-mrr                       10ge2p1x553    64B    8.27   1  -11.0
2t1c-af-xdp-ethip4-ip4scale2m-mrr                 25ge2p1xxv710  64B    6.21   1  -53.14

The same data for different TB.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iefce9a7196bae6fde45ee1935184efab4735e6e0

10 months agoReport: Add Comparison tables 70/35070/1
Tibor Frank [Tue, 25 Jan 2022 08:51:38 +0000 (09:51 +0100)]
Report: Add Comparison tables

- DPDK: 2n-tx2, 3n-tsh
- VPP: 2n-aws, 3n-aws

Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTrending: Add aws 61/35061/2
Tibor Frank [Mon, 24 Jan 2022 15:13:23 +0000 (16:13 +0100)]
Trending: Add aws

Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofeat(core): Add ICX 92/34992/5
Peter Mikus [Fri, 21 Jan 2022 13:11:13 +0000 (14:11 +0100)]
feat(core): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505

10 months agoReport: Configure Report 2202 58/35058/1
Tibor Frank [Mon, 24 Jan 2022 13:31:40 +0000 (14:31 +0100)]
Report: Configure Report 2202

Change-Id: I9be8b74716b09b2395fbab95eb37877867abbc22
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoUpdate VPP_STABLE_VER files 76/35076/2
Tibor Frank [Mon, 24 Jan 2022 05:25:31 +0000 (05:25 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia9d9b107ac7c10ea058e1fc0263b0461ef73ed9e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofeat(ansible): Add ICX 90/34990/1
Peter Mikus [Fri, 21 Jan 2022 11:51:39 +0000 (12:51 +0100)]
feat(ansible): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9

10 months agofeat(doc): Add ICX 81/34981/4
Peter Mikus [Thu, 20 Jan 2022 10:49:49 +0000 (11:49 +0100)]
feat(doc): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0

10 months agofeat(pxe): Add ICX 69/34969/3
Peter Mikus [Wed, 19 Jan 2022 12:53:56 +0000 (13:53 +0100)]
feat(pxe): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I96918306e280cdefb023d24ff466be7c6eab44b6

10 months agofeat(ansible): Compatibility matrix bump 79/34979/1
Peter Mikus [Thu, 20 Jan 2022 09:13:26 +0000 (10:13 +0100)]
feat(ansible): Compatibility matrix bump

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79

10 months agotrending: fix empty regressions and progressions 71/34971/2
Viliam Luc [Wed, 19 Jan 2022 14:29:23 +0000 (15:29 +0100)]
trending: fix empty regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1405c5d1dbf9e137afbc5fd5d9f83ea572613ea9

10 months agofix(vpp_device): pci address existence condition 81/34481/3
Juraj Linkeš [Fri, 12 Nov 2021 13:34:52 +0000 (14:34 +0100)]
fix(vpp_device): pci address existence condition

The function get_pci_addr could check a different PCI_ADDR in case the
netdev device directory doesn't exit. Move the check so that it always
uses the proper PCI_ADDR and add a failure case when the netdev device
directory doesn't exist.

Change-Id: Ibadfea3fba34509cd3ea8f906ac5962c0f01dd17
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agofix(ansible): Compatibility matrix 64/34964/2
Peter Mikus [Wed, 19 Jan 2022 11:09:56 +0000 (12:09 +0100)]
fix(ansible): Compatibility matrix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I298625dc75cdc6ffc168484e19ca30f02c2f46a0

10 months agoTrending: Add NAT44Det tests for 2n-zn2 62/34962/1
Tibor Frank [Wed, 19 Jan 2022 08:36:00 +0000 (09:36 +0100)]
Trending: Add NAT44Det tests for 2n-zn2

Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoDoc: Update anomaly methodology documentation 27/34627/4
Vratko Polak [Fri, 14 Jan 2022 13:26:53 +0000 (14:26 +0100)]
Doc: Update anomaly methodology documentation

+ Define currently used compliance metrics (e.g. no short term change),
+ Clarify that (and why) column names in Dashboard and Alerting
  are somewhat different from the ones in the methodology document.

Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoTrending: Unify anomaly related column names 09/34909/3
Vratko Polak [Fri, 14 Jan 2022 13:25:46 +0000 (14:25 +0100)]
Trending: Unify anomaly related column names

The most recent update merged was related to alerting,
so this Change uses the new column names defined there
also in Dashboard tables and legend.

Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agotrending: new view in regressions and progressions 64/34764/16
Viliam Luc [Fri, 17 Dec 2021 14:26:36 +0000 (15:26 +0100)]
trending: new view in regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I8524319a215ff551cf67c30d0b08ddae69883f61

10 months agofix(perpatch): Correct the autogen archive name 26/34926/3
Vratko Polak [Mon, 17 Jan 2022 17:09:16 +0000 (18:09 +0100)]
fix(perpatch): Correct the autogen archive name

Change-Id: I82bc5cd69de82a2d6b6689cf3380f667ea905886
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agotrending: shorten error messages 20/34920/5
Viliam Luc [Mon, 17 Jan 2022 09:45:15 +0000 (10:45 +0100)]
trending: shorten error messages

Sometimes error messages are longer than 1000 chars. This change
looks for [;, :, '] in messages between 128 and 256 character.
If it finds any of these the error message will be cut from
beggining to this character. If there's no character from the list
in error message and message is longer than 128 chars. It will
be cut from beggining to 129 character of error message

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I283f8ee8d81422235d897370dbc9508fafda6a7f

10 months agoReport: Add 2n-tx2 ipsec tests 29/34629/3
Tibor Frank [Wed, 1 Dec 2021 14:55:10 +0000 (15:55 +0100)]
Report: Add 2n-tx2 ipsec tests

- throughput
- speedup
- todo: latency

Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoRevert "Report: Temporarily change report specs" 41/34941/2
Tibor Frank [Mon, 17 Jan 2022 13:26:56 +0000 (13:26 +0000)]
Revert "Report: Temporarily change report specs"

This reverts commit cd1f9904e173ecb34836b33cb551ab9b9d378e18.

Reason for revert: Not needed

Change-Id: Id0739d4fba2d2abadd8ee9954c724a54b39cd8a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(uti): Fixing broken code part V 12/34912/9
Peter Mikus [Fri, 14 Jan 2022 14:02:31 +0000 (15:02 +0100)]
fix(uti): Fixing broken code part V

- UTI export breaks local execution
- disabling useless tox rules

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2f610b08f06f437e4482f291fa7b47cbb7b92984

10 months agoReport: Temporarily change report specs 36/34936/2
Tibor Frank [Mon, 17 Jan 2022 10:20:13 +0000 (10:20 +0000)]
Report: Temporarily change report specs

Change-Id: Ic8724a9676c2b2c37ee4f2de4c056b770a10d5af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoRevert "Temporarily change report specs" 55/34755/1
Tibor Frank [Mon, 17 Jan 2022 10:18:03 +0000 (10:18 +0000)]
Revert "Temporarily change report specs"

This reverts commit cc04963a4ad9bfd8dce0e31fd41226fa35e5e5d6.

Reason for revert: Some data-sets missing.

Change-Id: Id2363c2a71c0e87ad3d3e206a09d7af3984a1f36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoTemporarily change report specs 53/34753/2
Tibor Frank [Mon, 17 Jan 2022 09:53:03 +0000 (09:53 +0000)]
Temporarily change report specs

- to generate tables with oper data

Change-Id: I06878713cd085d72eb3b9fef0c1aae1102dfb363
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(IPsec): fix policy tests 91/34591/27
Juraj Linkeš [Fri, 26 Nov 2021 10:03:05 +0000 (11:03 +0100)]
fix(IPsec): fix policy tests

Replace the hardcoded SPD inbound/outbound ranges with values derived
from test inputs.
Add the necessary routes now that the tunnel endpoints are not in the
same subnet. Also add ip neighbor entry on DUT2 for the same reason.
Also replace ipsec sa dump with show ipsec all in teardown of tests
where both SAs and SPDs are configured to improve troubleshooting.

Change-Id: I7d89a99fcf457a701c87bf6ac07364b62802677d
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
10 months agoPAL: Fix sh-run 06/34906/8
Tibor Frank [Fri, 14 Jan 2022 08:43:47 +0000 (09:43 +0100)]
PAL: Fix sh-run

- do not post-process telemetry data

Change-Id: I800a99d8e92016d1fa675b18e2b2d30db4a15077
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoUpdate VPP_STABLE_VER files 50/34750/2
Tibor Frank [Mon, 17 Jan 2022 05:05:05 +0000 (05:05 +0000)]
Update VPP_STABLE_VER files

Change-Id: I686383bddec601403c2fbc11d79260f9579a7470
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoJumpAvg: Fix string format 03/34903/2
Vratko Polak [Fri, 14 Jan 2022 09:16:23 +0000 (10:16 +0100)]
JumpAvg: Fix string format

Change-Id: Id3975dfcca0040b799f31dcd14789d8c90993b14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofix(uti): Fixing broken code part IV 86/34886/1
Peter Mikus [Wed, 12 Jan 2022 09:12:49 +0000 (10:12 +0100)]
fix(uti): Fixing broken code part IV

Part of fixing chain

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie423ccf5a51751e605d906dd1214f5174bb364ac

10 months agofeat(uti): Dash demo 72/34872/4
Peter Mikus [Mon, 10 Jan 2022 12:19:31 +0000 (13:19 +0100)]
feat(uti): Dash demo

- displays the table with trending data downloaded from trending pages

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic0d48290105ccd846c7de9ee4d8acb78e0b72f00

10 months agofix(core): Constants.py 67/34867/3
Peter Mikus [Mon, 10 Jan 2022 10:03:27 +0000 (11:03 +0100)]
fix(core): Constants.py

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia5a097797b54c2e71acdcc8d72706e5540536252

10 months agoDoc: Tweak trend analysis document 32/34532/4
Vratko Polak [Wed, 1 Dec 2021 13:45:56 +0000 (14:45 +0100)]
Doc: Tweak trend analysis document

Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoUpdate VPP_STABLE_VER files 46/34746/2
Tibor Frank [Mon, 10 Jan 2022 06:15:50 +0000 (06:15 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1b4b92a69a31c3a934acb6e305631eeb9152ef31
Signed-off-by: Tibor Frank <tifrank@cisco.com>