csit.git
3 months agofix(infra): Temporarily disable X710 link loop 41/36341/1
Peter Mikus [Tue, 7 Jun 2022 08:20:45 +0000 (10:20 +0200)]
fix(infra): Temporarily disable X710 link loop

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4a8eb282754a5689cd538653e34bbc456e198f94

3 months agoReport: Add rc1, re-test, dpdk data 40/36340/1
Tibor Frank [Tue, 7 Jun 2022 05:29:50 +0000 (07:29 +0200)]
Report: Add rc1, re-test, dpdk data

Change-Id: I1ae47ee5d0ae21dd17bd6e99d81ab5e8f223f70b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Add rc1, dpdk, re-test data 37/36337/1
Tibor Frank [Mon, 6 Jun 2022 07:56:17 +0000 (09:56 +0200)]
Report: Add rc1, dpdk, re-test  data

Change-Id: Icb8c2acccd27a7d2ec0da2b524a743f795f7ab36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoUpdate VPP_STABLE_VER files 94/36294/2
Tibor Frank [Mon, 6 Jun 2022 04:49:56 +0000 (04:49 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ib6b2e0121b57aeba48baf1fcb7dacf5c07f05da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Add rc1 data 29/36329/1
Tibor Frank [Fri, 3 Jun 2022 04:45:02 +0000 (06:45 +0200)]
Report: Add rc1 data

Change-Id: I569e49967bdebb02828cd166f7a9164afbbe9205
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Add 3n-alt latency graphs 24/36324/2
Tibor Frank [Thu, 2 Jun 2022 09:55:48 +0000 (11:55 +0200)]
Report: Add 3n-alt latency graphs

Change-Id: Iaf2d123bcfd594d3e35d07c981c9f4b0597c7929
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Add rc1 data 23/36323/1
Tibor Frank [Thu, 2 Jun 2022 06:19:54 +0000 (08:19 +0200)]
Report: Add rc1 data

Change-Id: I06c976cb91d5125d18fc9b2d313c2373f61d88b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: fix: 3n-alt 20/36320/1
Tibor Frank [Wed, 1 Jun 2022 18:38:40 +0000 (20:38 +0200)]
Report: fix: 3n-alt

Change-Id: Idf3d8a393b928cf6f939355d2f6a5af93d18f440
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Add 3n-alt rc1 data 19/36319/2
Tibor Frank [Wed, 1 Jun 2022 18:22:08 +0000 (20:22 +0200)]
Report: Add 3n-alt rc1 data

Change-Id: I176dd4a109056b01c2b1b3b11e274b57258b7a02
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Add 3n-alt 14/36314/2
Tibor Frank [Wed, 1 Jun 2022 13:40:43 +0000 (15:40 +0200)]
Report: Add 3n-alt

Change-Id: I2a811d5a2e618dc339a3e40c3b8c374a5051649c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Remove 3n-aws 12/36312/1
Tibor Frank [Wed, 1 Jun 2022 07:38:04 +0000 (09:38 +0200)]
Report: Remove 3n-aws

Change-Id: I6e065cf25536197c2e414fde017390d54fb3b15c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoReport: Add rc1 data 11/36311/2
Tibor Frank [Wed, 1 Jun 2022 07:16:15 +0000 (09:16 +0200)]
Report: Add rc1 data

Change-Id: I79678b56fcdc5c8ff8736a87a7437ee145a40459
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agofix(core): TG export 10/36310/1
Peter Mikus [Wed, 1 Jun 2022 05:22:19 +0000 (07:22 +0200)]
fix(core): TG export

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I80f9f32f10d46eccf1157949a184ec4467d071cd

3 months agofix(etl): Typo 04/36304/1
Peter Mikus [Tue, 31 May 2022 10:48:56 +0000 (12:48 +0200)]
fix(etl): Typo

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4deed6b4c64cf9c04547d2a7cc0319bfa8aee1b6

3 months agoFramework: exclude env and .git when copying 55/35655/6
Juraj Linkeš [Wed, 16 Mar 2022 08:46:15 +0000 (09:46 +0100)]
Framework: exclude env and .git when copying

The tarball is unnecessarily big, remove superflous directories.

Change-Id: I55f6fae64973cfac34a1dc18cbdc688cd416e8b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 months agoReport: Add rc1 data 03/36303/1
Tibor Frank [Tue, 31 May 2022 04:47:49 +0000 (06:47 +0200)]
Report: Add rc1 data

Change-Id: I4f83a043c65ac1c968020024d139123a836fb33b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoPAL: Remove nexus from data sources 98/36298/1
Tibor Frank [Mon, 30 May 2022 13:51:30 +0000 (15:51 +0200)]
PAL: Remove nexus from data sources

Change-Id: Iec40f3cb1ca543dc42017ccfb2a663aee1204531
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoReport: Add rc1 data 97/36297/2
Tibor Frank [Mon, 30 May 2022 12:52:21 +0000 (14:52 +0200)]
Report: Add rc1 data

Change-Id: If71ad64c0778793afd9b8d8aff8a55c035b7dbfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(infra): Update AWS AMIs 55/36255/2
Peter Mikus [Mon, 30 May 2022 10:01:22 +0000 (12:01 +0200)]
feat(infra): Update AWS AMIs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fd9351b2c3448809bdef282c23eedd1ca3364a7

4 months agotrending: tput 100b tests update + static content 15/36215/4
Viliam Luc [Thu, 26 May 2022 06:57:45 +0000 (08:57 +0200)]
trending: tput 100b tests update + static content

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iba05311055b901ca3f5c2714bf0ea1c87525af50

4 months agofeat(docs): Add e810 for 2n-clx 54/36254/3
Peter Mikus [Mon, 30 May 2022 08:06:17 +0000 (10:06 +0200)]
feat(docs): Add e810 for 2n-clx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I607ccd5d4b28dca576e40b79285bb2b31a65d76c

4 months agoUpdate VPP_STABLE_VER files 74/36274/2
Tibor Frank [Mon, 30 May 2022 04:45:47 +0000 (04:45 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia8d310749ef074f3eaaf1251b9b5106a978ea42d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agotrending: fix missing csit-trex-perf-ndrpdr in trending emails 36/36236/2
Viliam Luc [Thu, 26 May 2022 08:58:24 +0000 (10:58 +0200)]
trending: fix missing csit-trex-perf-ndrpdr in trending emails

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I62af32fd69af35491f3ed97ffc6ff31fb3f19720

4 months agofeat(docs): Add e810 for 2n-clx 37/36237/2
Peter Mikus [Thu, 26 May 2022 10:34:04 +0000 (12:34 +0200)]
feat(docs): Add e810 for 2n-clx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I59f9df885907c7ce316e95a65fe98e9637820d01

4 months agofix(core): TG export 39/36239/2
Peter Mikus [Thu, 26 May 2022 11:28:26 +0000 (13:28 +0200)]
fix(core): TG export

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60313cd62a878bb713832f14121a938a81c954ed

4 months agofeat(infra): remove 2n-skx 38/36238/2
Peter Mikus [Thu, 26 May 2022 10:57:46 +0000 (12:57 +0200)]
feat(infra): remove 2n-skx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id263f260ecb7a7a11b8c7eb64b415418da36c5c8

4 months agofeat(infra): remove 2n-skx 14/36214/1
Peter Mikus [Thu, 26 May 2022 06:57:38 +0000 (08:57 +0200)]
feat(infra): remove 2n-skx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Idabdef957f6191c6a05bc82fb8f86d3015b67fc7

4 months agoReport: Configure report rls2206 09/36209/1
Tibor Frank [Wed, 25 May 2022 13:34:36 +0000 (15:34 +0200)]
Report: Configure report rls2206

Change-Id: If5cb8bfd0af11c9a9d35bac8de7a9c8f8c59092b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(etl): optimization 06/36206/1
Peter Mikus [Wed, 25 May 2022 09:06:41 +0000 (11:06 +0200)]
feat(etl): optimization

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2f313d5967e1ac745b817c4074487ccf56940b0a

4 months agofeat(etl): report 2206 05/36205/1
Peter Mikus [Wed, 25 May 2022 08:59:06 +0000 (10:59 +0200)]
feat(etl): report 2206

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I159860b7da1bd03f5cdf6a35c59221c079c863b1

4 months agofeat(etl): report 2206 04/36204/1
Peter Mikus [Wed, 25 May 2022 07:02:29 +0000 (09:02 +0200)]
feat(etl): report 2206

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I61fc4187ecd9948c2a8091229c5670f9c73e82ae

4 months agofix(uti): Add TG type export 88/36088/9
Peter Mikus [Thu, 5 May 2022 11:08:10 +0000 (13:08 +0200)]
fix(uti): Add TG type export

- This is actually bug not a feature.
- AB to be added later
- Tested on TREX and iPerf3

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib6f2d13e3b9401a9fb5759e42a8a310ee11b9d41

4 months agofeat(uti): Use only 1 worker 93/36193/1
Peter Mikus [Tue, 24 May 2022 07:52:13 +0000 (09:52 +0200)]
feat(uti): Use only 1 worker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84d20520abd58f698dac936ee06163e1b5b20e04

4 months agofix(dash): improve date formatting in hover 81/36181/2
Vratko Polak [Fri, 20 May 2022 08:27:49 +0000 (10:27 +0200)]
fix(dash): improve date formatting in hover

Bring it closer to RFC 3339 while keeping spaces.
The fully compatible format (2022-03-29T08:45:02Z)
may look too exotic for average human.

Dates other than in hover (e.g. in Time Period selection)
are not affected by this Change.

Change-Id: Ic5033d1b0db8505b0919e6a1392e28004c718f21
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoUpdate VPP_STABLE_VER files 88/35988/3
Tibor Frank [Mon, 23 May 2022 04:48:41 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7fa27b403f8e12d8c36728d462762dacd05de852
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoreport,trending: updated tput test to 100B 82/36182/3
Viliam Luc [Fri, 20 May 2022 10:37:33 +0000 (12:37 +0200)]
report,trending: updated tput test to 100B

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I4af6076dc0f02b952a04a3d3a5729b82f8a1e354

4 months agofeat(uti): Infra updates 80/36180/1
Peter Mikus [Fri, 20 May 2022 06:47:19 +0000 (08:47 +0200)]
feat(uti): Infra updates

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I82f84b81f4a016c8bd503e60caacf34f24d407d5

4 months agofeat(uti): Deploy tuning 73/36173/2
Peter Mikus [Thu, 19 May 2022 12:24:37 +0000 (14:24 +0200)]
feat(uti): Deploy tuning

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6f83e88a34997183fa2e7ac5bfe52b9bce50c906

4 months agofeat(uti): Add iterative data 55/36155/8
Tibor Frank [Tue, 17 May 2022 12:30:37 +0000 (14:30 +0200)]
feat(uti): Add iterative data

Change-Id: Iaa7253b377f019235289f6bbf48eafd850a2dfc8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofix(jobspec): use 100b for tput and pps tests 87/36087/2
Vratko Polak [Thu, 5 May 2022 10:46:44 +0000 (12:46 +0200)]
fix(jobspec): use 100b for tput and pps tests

For TCP tests, 1518b is closer to what the real traffic would be,
but as usual we want smaller sizes to stress VPP before filling line.

CPS tests remain at 64b.

Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a

Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agofix(trex): use reset instead of clear_profile 52/36152/13
Vratko Polak [Tue, 17 May 2022 13:32:04 +0000 (15:32 +0200)]
fix(trex): use reset instead of clear_profile

Now sure why clear_profile gets stuck with v2.97
(unless block=False), but calling reset() works,
and will be less risky next time we bump TRex version.

- Only ASTF for now.

Change-Id: Ib6906fb8ce269e888bf0e0438d3309931d5e9981
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agoAdd gtpu flow offload test suite 20/36120/7
Yulong Pei [Wed, 11 May 2022 05:11:28 +0000 (05:11 +0000)]
Add gtpu flow offload test suite

The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action
of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct
received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input,
ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node
processing.

Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet,
performance improve ~33% that compare with pure software way.

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 months agofeat(perf): T-Rex core usage 2n-zn2 56/36156/1
Peter Mikus [Tue, 17 May 2022 13:03:21 +0000 (15:03 +0200)]
feat(perf): T-Rex core usage 2n-zn2

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6

4 months agofix(uti): Terraform settings 53/36153/2
Peter Mikus [Tue, 17 May 2022 10:32:47 +0000 (12:32 +0200)]
fix(uti): Terraform settings

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica539512f3129391551938541d00d9e9d1560af3

4 months agofeat(uti): Values in hover as integers (no decimals) 51/36151/2
Tibor Frank [Tue, 17 May 2022 08:17:52 +0000 (10:17 +0200)]
feat(uti): Values in hover as integers (no decimals)

Change-Id: I3b4246a77daeb41ec23e6de341fafdfad5ed657b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(uti): Add list of failed tests to stats 44/36144/5
Tibor Frank [Mon, 16 May 2022 14:22:43 +0000 (16:22 +0200)]
feat(uti): Add list of failed tests to stats

Change-Id: Ie0bedafc7be3235fe696af4f356e95f64773e783
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoinfra(ansible): Jammy placeholder 50/36150/1
Peter Mikus [Tue, 17 May 2022 06:16:15 +0000 (08:16 +0200)]
infra(ansible): Jammy placeholder

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I693841cadf33d23e417374b949771ba7c3dbccd2

4 months agofeat(perf): T-Rex core usage 45/36145/1
Peter Mikus [Mon, 16 May 2022 14:30:20 +0000 (16:30 +0200)]
feat(perf): T-Rex core usage

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id0e7d31dc1368140c2c829fb2fcab009fbbed26d

4 months agoCore: T-rex 2.97 24/33224/10
pmikus [Wed, 21 Jul 2021 12:01:34 +0000 (12:01 +0000)]
Core: T-rex 2.97

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b

4 months agofeat(uti): set styles for url dialog 41/36141/3
Tibor Frank [Mon, 16 May 2022 11:47:59 +0000 (13:47 +0200)]
feat(uti): set styles for url dialog

Change-Id: I27e741436be82499c84371018a4f03f2330cbab4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoAnsible: T-rex 2.97 23/33223/5
pmikus [Wed, 21 Jul 2021 11:57:10 +0000 (11:57 +0000)]
Ansible: T-rex 2.97

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d5e00c45648dd4ae9e03ce1c7d0f2d2c53db476

4 months agoUpdate VPP_STABLE_VER files 82/35982/2
Tibor Frank [Mon, 16 May 2022 04:52:41 +0000 (04:52 +0000)]
Update VPP_STABLE_VER files

Change-Id: I3a549ec0a0d8d060fdc9e5642c589454eaae93cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(uti): Trending - add encoded and zipped url 27/36127/1
Tibor Frank [Thu, 12 May 2022 09:50:06 +0000 (11:50 +0200)]
feat(uti): Trending - add encoded and zipped url

Change-Id: I0148999ed5fe3f7e51078545b88e2bb2d2481884
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(uti): Statistics - base64 encoded url 23/36123/4
Tibor Frank [Wed, 11 May 2022 12:45:35 +0000 (14:45 +0200)]
feat(uti): Statistics - base64 encoded url

Change-Id: Iab6d5c62ab35778127bb328a032a63cd7c21d0bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(infra): Mellanox compatibility Matrix 14/36114/3
Peter Mikus [Tue, 10 May 2022 08:57:43 +0000 (10:57 +0200)]
feat(infra): Mellanox compatibility Matrix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iec87340aed64dd72e5289bd13af27c177f92c466

4 months agofeat(uti): Statistics - add url 13/36113/3
Tibor Frank [Tue, 10 May 2022 07:00:34 +0000 (09:00 +0200)]
feat(uti): Statistics - add url

Change-Id: Ied1ec832379dad4965ad2299834d2eaa7d1a4c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(uti): data to csv 04/36104/1
Tibor Frank [Mon, 9 May 2022 13:57:01 +0000 (15:57 +0200)]
feat(uti): data to csv

Change-Id: Iebc24dae2b76408f07c145b2638c346193cf8e1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(uti): tooltips 93/36093/4
Tibor Frank [Fri, 6 May 2022 12:29:55 +0000 (14:29 +0200)]
feat(uti): tooltips

Change-Id: I615affce80f1e6af9ea0a5d581b84e17ee88e458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoUpdate VPP_STABLE_VER files 81/35981/2
Tibor Frank [Mon, 9 May 2022 04:32:56 +0000 (04:32 +0000)]
Update VPP_STABLE_VER files

Change-Id: I5e48e9d9759b456c8e4b67815045e8376632df65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(uti): Generate structure of tests from data for trending 75/36075/6
Tibor Frank [Tue, 3 May 2022 13:41:11 +0000 (15:41 +0200)]
feat(uti): Generate structure of tests from data for trending

Change-Id: I14a59da85112473fde342b2f687bd87256a7d416
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agofeat(astf): Support framesizes for ASTF 10/35910/56
Vratko Polak [Mon, 25 Apr 2022 08:22:05 +0000 (10:22 +0200)]
feat(astf): Support framesizes for ASTF

- No support for IMIX.
+ Fix a bad bug in padding (most ASTF profiles had wrong frame sizes).
+ Fix a big typo in TCP PPS profiles (s->c was not data, just RST).
+ Control transaction size via ASTF_N_DATA_FRAMES env variable.
 - Default value 5 leads to transactions smaller than before.
 + It ensures transaction is one burst (per direction) even for jumbo.
+ Edit autogen to set supported frame sizes based on suite id.
 + Both TCP and UDP use the same values:
  + 64B for CPS (exact for UDP, nominal for TCP).
  + 100B, 1518B and 9000B for TPUT and PPS.
   - TCP TPUT achievable minimum is 70B.
   + Used 100B to leave room for possible IPv6 ASTF tests.
 + Separate function for code reused by vpp and trex tests.
 - I do not really like the new "copy and edit" approach added here.
  + But it is a quick edit, better autogen refactor is low priority.
+ Consider both established and transitory sessions as valid.
 - Mostly for compatibility with 2202 behavior and to avoid ramp-ups.
 - Assuming both session states have similar enough VPP CPU overhead.
 + Added a TODO to investigate and maybe reconsider later.
+ Update the state timeout value to 240s.
 + That is the default for TCP (for transitory state).
 - UDP could keep using 300s.
  + But I prefer UDP and TCP to behave as similarly as possible.
+ Use TRex tunables to get the exact frame size (for data packets).
 - It is not clear why the recipe for MSS has to be this complicated.
 + Move code away from profile init, as frame size is not known there.
 + Change internal profile API, so values related to MSS are passed.
+ Lower ramp-up rate for TCP TPUT tests.
 + Because without lower rate, jumbo fails on packet loss in ramp-up.
 + UDP TPUT ramp-up rate also lowered (just to keep suites more similar).
+ Distinguish one-direction and aggregated average frame size.
 + Update keyword documentation where the distiction matters.
 + One-direction is needed for turning bandwidth limit to TPS limit.
 + Aggregated is needed for correct NDRPDR bandwidth result value.
 - TCP TPUT will always be few percent below bidirectional maximum.
  + That is unavoidable, as one direction sends more control packets.
+ Add runtime consistency checks so future refactors are safer.
 + Fail if padding requested would be negative.
 + Fail if suite claims unexpected values for packets per transaction.
+ Edit the 4 types of ASTF profiles to keep them similar to each other.
 + Move UDP TPUT limit value from a field back to direct argument.
 + Stop pretending first UDP packet is not data.
+ Apply small improvements where convenient.
 + Replace "aggregate" with "aggregated" where possible.
  + To lower probability of any future typos in variable names.
 + Avoid calling Set Numeric Frame Sizes twice.
 + Code formatting, keyword documentation, code comments, ...
 + Add TODOs for less important code quality improvements.
- Postpone updating of methodology pages to a subsequent change.

Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 months agofeat(uti): Add structured menu for stats 72/36072/4
Tibor Frank [Mon, 2 May 2022 08:39:24 +0000 (10:39 +0200)]
feat(uti): Add structured menu for stats

Change-Id: I907606b1b994e991975f887611750d23fd7f1634
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agoUpdate VPP_STABLE_VER files 79/35979/3
Tibor Frank [Mon, 2 May 2022 06:28:15 +0000 (06:28 +0000)]
Update VPP_STABLE_VER files

Change-Id: I5207153be2b3231633ee3c16ac78a099bd60893f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 months agotrending: fix failing trending job 70/36070/2
Viliam Luc [Mon, 2 May 2022 07:27:56 +0000 (09:27 +0200)]
trending: fix failing trending job

3n-aws job was recently removed which caused trending jobs to fail.
For historical reason we keep 3n-aws in trending until 180 days
period pass.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I7b59fc4b6f1b46bf910bc540cf37dd042df9c64a

5 months agofeat(infra): Terraform updates 55/36055/2
Peter Mikus [Wed, 27 Apr 2022 13:28:42 +0000 (15:28 +0200)]
feat(infra): Terraform updates

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3d7ecad9125e3ff55c0b4e1da5cda5a1ff22d690

5 months agofeat(uti): Add constant TIME_PERIOD 54/36054/4
Tibor Frank [Wed, 27 Apr 2022 11:39:07 +0000 (13:39 +0200)]
feat(uti): Add constant TIME_PERIOD

It defines the time period from now back to the past from which data is
raed to dataframes.

Change-Id: Ic6feeb8e7958d69aa2e39922b48e9898e09b45dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): Add offcanvas to stats 53/36053/2
Tibor Frank [Wed, 27 Apr 2022 08:28:47 +0000 (10:28 +0200)]
feat(uti): Add offcanvas to stats

Change-Id: I5d807944b0158e51998bfc709a87d9d6c826112c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): Form layout 52/36052/2
Peter Mikus [Wed, 27 Apr 2022 08:27:33 +0000 (10:27 +0200)]
feat(uti): Form layout

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1c00a9b3ffa69b1a0be1d51bb72d13516293afd2

5 months agofeat(uti): Add init files to dirs 51/36051/1
Tibor Frank [Wed, 27 Apr 2022 07:38:34 +0000 (09:38 +0200)]
feat(uti): Add init files to dirs

Change-Id: Ic643da296861350b4d86eaec0245c8312f3c1a35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(infra): Onboard Mellanox III. 38/36038/2
Peter Mikus [Tue, 26 Apr 2022 11:58:43 +0000 (13:58 +0200)]
feat(infra): Onboard Mellanox III.

+ DPDK matrix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I473265ae1ebf08e1518a6b6e2998abdc750167d1

5 months agofeat(uti): Add statistics 35/36035/4
Tibor Frank [Mon, 25 Apr 2022 14:55:01 +0000 (16:55 +0200)]
feat(uti): Add statistics

Change-Id: I14046fd1050f130d201bbe81a72e48ad4fd10057
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofix(tgtest): filter by TG NIC model 97/35997/3
Vratko Polak [Wed, 20 Apr 2022 12:27:18 +0000 (14:27 +0200)]
fix(tgtest): filter by TG NIC model

The previous path computation code was only correct
for tests with DUT (and TG).
There, we only want to filter by DUT NICs, but not TG NICs
(e.g. to allow testing E810 DUT with MLX TG).

But for tests without DUT (still with TG),
we do indeed want to filter by NICs on TG, so this patch does that.

Change-Id: Ia482c6327af7bca26353ad6e503ae224d90cb3a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agofeat(infra): Onboard Mellanox II. 33/36033/2
Peter Mikus [Mon, 25 Apr 2022 13:02:47 +0000 (15:02 +0200)]
feat(infra): Onboard Mellanox II.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifd90f6b77f49e2a6907262d6f1e3da19ef275ac6

5 months agofeat(infra): AWS Beanstalk adjustments 25/36025/2
Peter Mikus [Fri, 22 Apr 2022 13:05:48 +0000 (15:05 +0200)]
feat(infra): AWS Beanstalk adjustments

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad492c1a848052de4e5a7cb50dd3312d25234e2e

5 months agoUpdate VPP_STABLE_VER files 78/35978/2
Tibor Frank [Mon, 25 Apr 2022 04:33:47 +0000 (04:33 +0000)]
Update VPP_STABLE_VER files

Change-Id: If6d3461a2712a6854e3d80d8ac04329f2debd029
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): swap buttons 20/36020/1
Tibor Frank [Fri, 22 Apr 2022 08:25:20 +0000 (10:25 +0200)]
feat(uti): swap buttons

Change-Id: I0c0069a37783658099fb11d7fa15f45b6d0dc3cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(infra): Onboard Mellanox I. 14/36014/1
Peter Mikus [Thu, 21 Apr 2022 11:47:46 +0000 (13:47 +0200)]
feat(infra): Onboard Mellanox I.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47781b9d0cf6c08d12ac36774b9093c3934d9ee6

5 months agofeat(uti): Form layout 13/36013/1
Peter Mikus [Thu, 21 Apr 2022 09:36:53 +0000 (11:36 +0200)]
feat(uti): Form layout

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibea233e89ef87b684adba65ad3a4a13524d32809

5 months agofeat(uti): optimize offcanvas 12/36012/2
Tibor Frank [Thu, 21 Apr 2022 07:55:40 +0000 (09:55 +0200)]
feat(uti): optimize offcanvas

Change-Id: I323e6743ed3f77b552b0556806ad8d7a4ba5675c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): Remove button "Display" 11/36011/1
Tibor Frank [Thu, 21 Apr 2022 05:38:49 +0000 (07:38 +0200)]
feat(uti): Remove button "Display"

- not needed

Change-Id: Ic2bc74af1574e766c007f310f626c2e9ba61bbc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): Form layout 08/36008/1
Peter Mikus [Wed, 20 Apr 2022 14:50:53 +0000 (16:50 +0200)]
feat(uti): Form layout

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id065f8ecd0571567f1f679bdd70c46794fc71a94

5 months agofeat(uti): list of selected tests 06/36006/1
Tibor Frank [Wed, 20 Apr 2022 13:02:21 +0000 (15:02 +0200)]
feat(uti): list of selected tests

Change-Id: I7ddfb7afd62f4a30c4f5c0ebc1df86d32354b2cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): plotting area with default view 04/36004/1
Tibor Frank [Wed, 20 Apr 2022 11:46:03 +0000 (13:46 +0200)]
feat(uti): plotting area with default view

Change-Id: I150d6b79f869734385204a2236fe8608474a213d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): Add copyable text also to anomalies 02/36002/2
Tibor Frank [Wed, 20 Apr 2022 08:28:59 +0000 (10:28 +0200)]
feat(uti): Add copyable text also to anomalies

Change-Id: I4d850985bafc00594c61e5cf1c2ece2be6a90b1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): hrdh latency graph 01/36001/1
Tibor Frank [Wed, 20 Apr 2022 07:40:34 +0000 (09:40 +0200)]
feat(uti): hrdh latency graph

Change-Id: Ib08b31b6dda79c66f4d204145a1b2ed78e9636b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): Form layout 99/35999/1
Peter Mikus [Tue, 19 Apr 2022 13:53:41 +0000 (15:53 +0200)]
feat(uti): Form layout

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Icc0fd99492c75ce41104c70cc5df279949c8265e

5 months agofeat(uti): re-work the callbacks 98/35998/2
Tibor Frank [Tue, 19 Apr 2022 13:44:44 +0000 (15:44 +0200)]
feat(uti): re-work the callbacks

Change-Id: I5394b562be7991ab268521362270e0771a6528af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agotelemetry: convert openmetrics to readable output 66/35866/4
Viliam Luc [Mon, 4 Apr 2022 09:27:44 +0000 (11:27 +0200)]
telemetry: convert openmetrics to readable output

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I4b12f8e49a473ff54ca30d9ed3f02798136c6971

5 months agofeat(uti): Cover theme sync 57/35957/5
Peter Mikus [Thu, 14 Apr 2022 08:45:50 +0000 (10:45 +0200)]
feat(uti): Cover theme sync

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8ffe4311a67790066fd82a5ac6c3661e95533693

5 months agofeat(uti): Add c&p to offcanvas 96/35996/2
Tibor Frank [Tue, 19 Apr 2022 05:43:31 +0000 (07:43 +0200)]
feat(uti): Add c&p to offcanvas

Change-Id: I235f78d1e7fab94114958dee8aba004bee6b6b03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoUpdate VPP_STABLE_VER files 76/35976/2
Tibor Frank [Tue, 19 Apr 2022 04:11:49 +0000 (04:11 +0000)]
Update VPP_STABLE_VER files

Change-Id: I412eb8aba84919e2cb4aae670b6b856da4bb27d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): Add offcanvas 61/35961/2
Tibor Frank [Thu, 14 Apr 2022 12:44:11 +0000 (14:44 +0200)]
feat(uti): Add offcanvas

Change-Id: Ibb83c43162db9c90f816faa2572187a69bb8a0b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(telemetry): Add bpf on all testbeds 59/35959/1
Peter Mikus [Thu, 14 Apr 2022 09:11:40 +0000 (11:11 +0200)]
feat(telemetry): Add bpf on all testbeds

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic0c02c3bce4544597c8ee49e1f0b8629ad1dd24f

5 months agofeat(uti): Refactor plotting area 56/35956/2
Tibor Frank [Thu, 14 Apr 2022 08:38:58 +0000 (10:38 +0200)]
feat(uti): Refactor plotting area

Change-Id: Ib3fce8f8f011b50919c1abebed21c7e962913650
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(uti): Refactor grid layout 50/35950/4
Peter Mikus [Wed, 13 Apr 2022 10:29:45 +0000 (12:29 +0200)]
feat(uti): Refactor grid layout

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I992ac4f2a4ecfa779c9fbf393a2f4dfa8cea704f

5 months agofeat(uti): Refactor styling 39/35939/4
Peter Mikus [Tue, 12 Apr 2022 13:36:22 +0000 (15:36 +0200)]
feat(uti): Refactor styling

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7880e58b2b97b1c365da7755784d3f93e85568cc

5 months agoTrending: Add 3n-alt - fixes 44/35944/1
Tibor Frank [Wed, 13 Apr 2022 04:43:50 +0000 (06:43 +0200)]
Trending: Add 3n-alt - fixes

Change-Id: I017bcc3ef9e9ceb4e8110c8d58a5f4ef1e46db15
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoTrending: Add 3n-alt 38/35938/2
Tibor Frank [Tue, 12 Apr 2022 10:52:28 +0000 (12:52 +0200)]
Trending: Add 3n-alt

Change-Id: I2614c5688697f4b58c523cc8abe2aa34c11730a1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agoUTI: UX Styling 19/35919/5
Tibor Frank [Fri, 8 Apr 2022 12:09:08 +0000 (14:09 +0200)]
UTI: UX Styling

Change-Id: I54e3992f81db04c7c978b2157dafd067de917664
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 months agofeat(telemetry): T-Rex runtime 29/35929/2
Peter Mikus [Mon, 11 Apr 2022 14:00:56 +0000 (16:00 +0200)]
feat(telemetry): T-Rex runtime

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2829b5931e5a63a33f524e1d14ffb20c27f4ce5a