Vratko Polak [Thu, 9 Jun 2022 11:13:22 +0000 (13:13 +0200)]
fix(vlan): do not apply strip offload
Some tests (bonding) are failing as VPP refuses startup.conf.
That is because the config parameter support has been removed:
https://gerrit.fd.io/r/c/vpp/+/34822
That is VPP commit
8c8531c15c9195c2c82695eff6e70887de67fd88.
According to commit message, it was just a workaround
for Cisco ENIC cards, which are no longer tested in CSIT.
+ Delete 1 robot and 1 python keyword as they become unused.
Change-Id: If53e324a27cfbd4659e49ab8bcd03253642dde96
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 13 Jun 2022 12:44:15 +0000 (14:44 +0200)]
fix(stl_traffic): track both ports on unidir
Even if the suite asks for unidirectional stateless traffic,
in some circumstances (e.g. reconf tests)
stats from both ports are needed to determine overall loss.
Enabling both ports unconditionally fixes that
without any negative consequences.
Latency info is still gathered only for one direction in unidir tests.
Change-Id: Ifec6603d6103c9981fc0af02a81b0db215ccb77c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Tue, 14 Jun 2022 11:14:49 +0000 (11:14 +0000)]
doc(report): Update test environment
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9987cac1493ea75eb097a0f2123768eec1ca3d73
Peter Mikus [Tue, 14 Jun 2022 09:53:03 +0000 (09:53 +0000)]
fix(infra): Topopology link swap
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I20fc441cb46b70b2c315a2c865c3d11e3c341212
Peter Mikus [Tue, 14 Jun 2022 06:34:55 +0000 (06:34 +0000)]
fix(pylint): Some quick pylints
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba133914882485191ad962e36fae70b6fda0af98
Viliam Luc [Tue, 14 Jun 2022 08:30:17 +0000 (10:30 +0200)]
trending: fix 3n-alt missing in dashboard
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I356998c521d47f085a78bf2577574ea0d489e02d
Tibor Frank [Mon, 13 Jun 2022 13:07:47 +0000 (15:07 +0200)]
feat(uti): remove not neccessary data
Change-Id: I10f00fce9623ec1dfe34925087e2669ae411e036
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 13 Jun 2022 08:16:04 +0000 (08:16 +0000)]
feat(dpdk): Bump the version within VM
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie358593f9977d04aca9e50a14e0d14158e1b0cf1
Peter Mikus [Mon, 13 Jun 2022 05:57:02 +0000 (05:57 +0000)]
doc(infra): Fix firmware versions
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I755043bc10b2bc419daf007f023742e814c3c63b
Tibor Frank [Mon, 13 Jun 2022 04:23:57 +0000 (04:23 +0000)]
Update VPP_STABLE_VER files
Change-Id: I918daab67aa4a4495b9080f7e0e87b9aa950d2b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 10 Jun 2022 14:01:22 +0000 (16:01 +0200)]
fix(hoststack): distinguish two tcp tag types
Previous change did not consider TCP_PPS and TCP_CPS robot tags
are used by two different suite types (hoststack or ASTF).
This fixes the unintended impact on hoststack.
+ Add HOSTSTACK tag to VSAP suites.
- They could also get VSAP tag, but not needed for this Change.
Fixes:
1daa6fdc0bae284dee1b61f34534e59b60b7526a
Change-Id: Ic583b5ae336c9b74794706fefc232f221a243c87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 9 Jun 2022 09:45:26 +0000 (09:45 +0000)]
fix(core): T-Rex initialization
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I53226ff6a345ac99c1e2e110712b2ff6197efe95
Tibor Frank [Fri, 10 Jun 2022 11:13:08 +0000 (13:13 +0200)]
feat(uti): statistical graphs
Change-Id: Ic05d56dae08e9745582e02e59e8b76145050ca73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 10 Jun 2022 08:10:15 +0000 (10:10 +0200)]
fix(wireguard): add missing test teardown
Fixes:
75ef277536c43096e7646430568d97d2cc489238
Change-Id: I94575bee0aa77907cc900b58b186c3612fb18d85
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 19 May 2022 12:24:15 +0000 (14:24 +0200)]
feat(uti): Add statistical graphs
Change-Id: Ia2831cfbcb9e2333c5b49af5c6b0577867d99902
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 9 Jun 2022 09:43:11 +0000 (11:43 +0200)]
Report: Add retest data
Change-Id: Ic42a15b44e0395c194cdeddef6d91635fd0f9b10
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Cui,Cheng [Thu, 19 May 2022 06:48:04 +0000 (06:48 +0000)]
Add Test Suite for VPP WireGuard
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
Peter Mikus [Wed, 8 Jun 2022 12:35:04 +0000 (12:35 +0000)]
fix(infra): 2n-clx links and docs
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iac1743da3eb51c69c67e8496ad4145dcc616341c
Tibor Frank [Wed, 8 Jun 2022 08:49:08 +0000 (10:49 +0200)]
Report: Add dpdk and re-test data
Change-Id: Ia078a30f467c9a0eac45a58b83dd82975b815b5a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 7 Jun 2022 08:20:45 +0000 (10:20 +0200)]
fix(infra): Temporarily disable X710 link loop
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4a8eb282754a5689cd538653e34bbc456e198f94
Tibor Frank [Tue, 7 Jun 2022 05:29:50 +0000 (07:29 +0200)]
Report: Add rc1, re-test, dpdk data
Change-Id: I1ae47ee5d0ae21dd17bd6e99d81ab5e8f223f70b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 6 Jun 2022 07:56:17 +0000 (09:56 +0200)]
Report: Add rc1, dpdk, re-test data
Change-Id: Icb8c2acccd27a7d2ec0da2b524a743f795f7ab36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 6 Jun 2022 04:49:56 +0000 (04:49 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ib6b2e0121b57aeba48baf1fcb7dacf5c07f05da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 3 Jun 2022 04:45:02 +0000 (06:45 +0200)]
Report: Add rc1 data
Change-Id: I569e49967bdebb02828cd166f7a9164afbbe9205
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 2 Jun 2022 09:55:48 +0000 (11:55 +0200)]
Report: Add 3n-alt latency graphs
Change-Id: Iaf2d123bcfd594d3e35d07c981c9f4b0597c7929
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 2 Jun 2022 06:19:54 +0000 (08:19 +0200)]
Report: Add rc1 data
Change-Id: I06c976cb91d5125d18fc9b2d313c2373f61d88b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 18:38:40 +0000 (20:38 +0200)]
Report: fix: 3n-alt
Change-Id: Idf3d8a393b928cf6f939355d2f6a5af93d18f440
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 18:22:08 +0000 (20:22 +0200)]
Report: Add 3n-alt rc1 data
Change-Id: I176dd4a109056b01c2b1b3b11e274b57258b7a02
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 13:40:43 +0000 (15:40 +0200)]
Report: Add 3n-alt
Change-Id: I2a811d5a2e618dc339a3e40c3b8c374a5051649c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 07:38:04 +0000 (09:38 +0200)]
Report: Remove 3n-aws
Change-Id: I6e065cf25536197c2e414fde017390d54fb3b15c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 07:16:15 +0000 (09:16 +0200)]
Report: Add rc1 data
Change-Id: I79678b56fcdc5c8ff8736a87a7437ee145a40459
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 1 Jun 2022 05:22:19 +0000 (07:22 +0200)]
fix(core): TG export
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I80f9f32f10d46eccf1157949a184ec4467d071cd
Peter Mikus [Tue, 31 May 2022 10:48:56 +0000 (12:48 +0200)]
fix(etl): Typo
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4deed6b4c64cf9c04547d2a7cc0319bfa8aee1b6
Juraj Linkeš [Wed, 16 Mar 2022 08:46:15 +0000 (09:46 +0100)]
Framework: exclude env and .git when copying
The tarball is unnecessarily big, remove superflous directories.
Change-Id: I55f6fae64973cfac34a1dc18cbdc688cd416e8b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Tue, 31 May 2022 04:47:49 +0000 (06:47 +0200)]
Report: Add rc1 data
Change-Id: I4f83a043c65ac1c968020024d139123a836fb33b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 30 May 2022 13:51:30 +0000 (15:51 +0200)]
PAL: Remove nexus from data sources
Change-Id: Iec40f3cb1ca543dc42017ccfb2a663aee1204531
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 30 May 2022 12:52:21 +0000 (14:52 +0200)]
Report: Add rc1 data
Change-Id: If71ad64c0778793afd9b8d8aff8a55c035b7dbfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 30 May 2022 10:01:22 +0000 (12:01 +0200)]
feat(infra): Update AWS AMIs
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fd9351b2c3448809bdef282c23eedd1ca3364a7
Viliam Luc [Thu, 26 May 2022 06:57:45 +0000 (08:57 +0200)]
trending: tput 100b tests update + static content
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iba05311055b901ca3f5c2714bf0ea1c87525af50
Peter Mikus [Mon, 30 May 2022 08:06:17 +0000 (10:06 +0200)]
feat(docs): Add e810 for 2n-clx
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I607ccd5d4b28dca576e40b79285bb2b31a65d76c
Tibor Frank [Mon, 30 May 2022 04:45:47 +0000 (04:45 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ia8d310749ef074f3eaaf1251b9b5106a978ea42d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Viliam Luc [Thu, 26 May 2022 08:58:24 +0000 (10:58 +0200)]
trending: fix missing csit-trex-perf-ndrpdr in trending emails
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I62af32fd69af35491f3ed97ffc6ff31fb3f19720
Peter Mikus [Thu, 26 May 2022 10:34:04 +0000 (12:34 +0200)]
feat(docs): Add e810 for 2n-clx
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I59f9df885907c7ce316e95a65fe98e9637820d01
Peter Mikus [Thu, 26 May 2022 11:28:26 +0000 (13:28 +0200)]
fix(core): TG export
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60313cd62a878bb713832f14121a938a81c954ed
Peter Mikus [Thu, 26 May 2022 10:57:46 +0000 (12:57 +0200)]
feat(infra): remove 2n-skx
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id263f260ecb7a7a11b8c7eb64b415418da36c5c8
Peter Mikus [Thu, 26 May 2022 06:57:38 +0000 (08:57 +0200)]
feat(infra): remove 2n-skx
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Idabdef957f6191c6a05bc82fb8f86d3015b67fc7
Tibor Frank [Wed, 25 May 2022 13:34:36 +0000 (15:34 +0200)]
Report: Configure report rls2206
Change-Id: If5cb8bfd0af11c9a9d35bac8de7a9c8f8c59092b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 25 May 2022 09:06:41 +0000 (11:06 +0200)]
feat(etl): optimization
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2f313d5967e1ac745b817c4074487ccf56940b0a
Peter Mikus [Wed, 25 May 2022 08:59:06 +0000 (10:59 +0200)]
feat(etl): report 2206
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I159860b7da1bd03f5cdf6a35c59221c079c863b1
Peter Mikus [Wed, 25 May 2022 07:02:29 +0000 (09:02 +0200)]
feat(etl): report 2206
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I61fc4187ecd9948c2a8091229c5670f9c73e82ae
Peter Mikus [Thu, 5 May 2022 11:08:10 +0000 (13:08 +0200)]
fix(uti): Add TG type export
- This is actually bug not a feature.
- AB to be added later
- Tested on TREX and iPerf3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib6f2d13e3b9401a9fb5759e42a8a310ee11b9d41
Peter Mikus [Tue, 24 May 2022 07:52:13 +0000 (09:52 +0200)]
feat(uti): Use only 1 worker
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84d20520abd58f698dac936ee06163e1b5b20e04
Vratko Polak [Fri, 20 May 2022 08:27:49 +0000 (10:27 +0200)]
fix(dash): improve date formatting in hover
Bring it closer to RFC 3339 while keeping spaces.
The fully compatible format (2022-03-29T08:45:02Z)
may look too exotic for average human.
Dates other than in hover (e.g. in Time Period selection)
are not affected by this Change.
Change-Id: Ic5033d1b0db8505b0919e6a1392e28004c718f21
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 23 May 2022 04:48:41 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files
Change-Id: I7fa27b403f8e12d8c36728d462762dacd05de852
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Viliam Luc [Fri, 20 May 2022 10:37:33 +0000 (12:37 +0200)]
report,trending: updated tput test to 100B
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I4af6076dc0f02b952a04a3d3a5729b82f8a1e354
Peter Mikus [Fri, 20 May 2022 06:47:19 +0000 (08:47 +0200)]
feat(uti): Infra updates
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I82f84b81f4a016c8bd503e60caacf34f24d407d5
Peter Mikus [Thu, 19 May 2022 12:24:37 +0000 (14:24 +0200)]
feat(uti): Deploy tuning
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6f83e88a34997183fa2e7ac5bfe52b9bce50c906
Tibor Frank [Tue, 17 May 2022 12:30:37 +0000 (14:30 +0200)]
feat(uti): Add iterative data
Change-Id: Iaa7253b377f019235289f6bbf48eafd850a2dfc8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 5 May 2022 10:46:44 +0000 (12:46 +0200)]
fix(jobspec): use 100b for tput and pps tests
For TCP tests, 1518b is closer to what the real traffic would be,
but as usual we want smaller sizes to stress VPP before filling line.
CPS tests remain at 64b.
Fixes:
1daa6fdc0bae284dee1b61f34534e59b60b7526a
Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 17 May 2022 13:32:04 +0000 (15:32 +0200)]
fix(trex): use reset instead of clear_profile
Now sure why clear_profile gets stuck with v2.97
(unless block=False), but calling reset() works,
and will be less risky next time we bump TRex version.
- Only ASTF for now.
Change-Id: Ib6906fb8ce269e888bf0e0438d3309931d5e9981
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Yulong Pei [Wed, 11 May 2022 05:11:28 +0000 (05:11 +0000)]
Add gtpu flow offload test suite
The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action
of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct
received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input,
ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node
processing.
Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet,
performance improve ~33% that compare with pure software way.
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Peter Mikus [Tue, 17 May 2022 13:03:21 +0000 (15:03 +0200)]
feat(perf): T-Rex core usage 2n-zn2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
Peter Mikus [Tue, 17 May 2022 10:32:47 +0000 (12:32 +0200)]
fix(uti): Terraform settings
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica539512f3129391551938541d00d9e9d1560af3
Tibor Frank [Tue, 17 May 2022 08:17:52 +0000 (10:17 +0200)]
feat(uti): Values in hover as integers (no decimals)
Change-Id: I3b4246a77daeb41ec23e6de341fafdfad5ed657b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 16 May 2022 14:22:43 +0000 (16:22 +0200)]
feat(uti): Add list of failed tests to stats
Change-Id: Ie0bedafc7be3235fe696af4f356e95f64773e783
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 17 May 2022 06:16:15 +0000 (08:16 +0200)]
infra(ansible): Jammy placeholder
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I693841cadf33d23e417374b949771ba7c3dbccd2
Peter Mikus [Mon, 16 May 2022 14:30:20 +0000 (16:30 +0200)]
feat(perf): T-Rex core usage
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id0e7d31dc1368140c2c829fb2fcab009fbbed26d
pmikus [Wed, 21 Jul 2021 12:01:34 +0000 (12:01 +0000)]
Core: T-rex 2.97
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
Tibor Frank [Mon, 16 May 2022 11:47:59 +0000 (13:47 +0200)]
feat(uti): set styles for url dialog
Change-Id: I27e741436be82499c84371018a4f03f2330cbab4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Wed, 21 Jul 2021 11:57:10 +0000 (11:57 +0000)]
Ansible: T-rex 2.97
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d5e00c45648dd4ae9e03ce1c7d0f2d2c53db476
Tibor Frank [Mon, 16 May 2022 04:52:41 +0000 (04:52 +0000)]
Update VPP_STABLE_VER files
Change-Id: I3a549ec0a0d8d060fdc9e5642c589454eaae93cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 12 May 2022 09:50:06 +0000 (11:50 +0200)]
feat(uti): Trending - add encoded and zipped url
Change-Id: I0148999ed5fe3f7e51078545b88e2bb2d2481884
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 11 May 2022 12:45:35 +0000 (14:45 +0200)]
feat(uti): Statistics - base64 encoded url
Change-Id: Iab6d5c62ab35778127bb328a032a63cd7c21d0bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 10 May 2022 08:57:43 +0000 (10:57 +0200)]
feat(infra): Mellanox compatibility Matrix
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iec87340aed64dd72e5289bd13af27c177f92c466
Tibor Frank [Tue, 10 May 2022 07:00:34 +0000 (09:00 +0200)]
feat(uti): Statistics - add url
Change-Id: Ied1ec832379dad4965ad2299834d2eaa7d1a4c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 May 2022 13:57:01 +0000 (15:57 +0200)]
feat(uti): data to csv
Change-Id: Iebc24dae2b76408f07c145b2638c346193cf8e1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 6 May 2022 12:29:55 +0000 (14:29 +0200)]
feat(uti): tooltips
Change-Id: I615affce80f1e6af9ea0a5d581b84e17ee88e458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 May 2022 04:32:56 +0000 (04:32 +0000)]
Update VPP_STABLE_VER files
Change-Id: I5e48e9d9759b456c8e4b67815045e8376632df65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 May 2022 13:41:11 +0000 (15:41 +0200)]
feat(uti): Generate structure of tests from data for trending
Change-Id: I14a59da85112473fde342b2f687bd87256a7d416
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 25 Apr 2022 08:22:05 +0000 (10:22 +0200)]
feat(astf): Support framesizes for ASTF
- No support for IMIX.
+ Fix a bad bug in padding (most ASTF profiles had wrong frame sizes).
+ Fix a big typo in TCP PPS profiles (s->c was not data, just RST).
+ Control transaction size via ASTF_N_DATA_FRAMES env variable.
- Default value 5 leads to transactions smaller than before.
+ It ensures transaction is one burst (per direction) even for jumbo.
+ Edit autogen to set supported frame sizes based on suite id.
+ Both TCP and UDP use the same values:
+ 64B for CPS (exact for UDP, nominal for TCP).
+ 100B, 1518B and 9000B for TPUT and PPS.
- TCP TPUT achievable minimum is 70B.
+ Used 100B to leave room for possible IPv6 ASTF tests.
+ Separate function for code reused by vpp and trex tests.
- I do not really like the new "copy and edit" approach added here.
+ But it is a quick edit, better autogen refactor is low priority.
+ Consider both established and transitory sessions as valid.
- Mostly for compatibility with 2202 behavior and to avoid ramp-ups.
- Assuming both session states have similar enough VPP CPU overhead.
+ Added a TODO to investigate and maybe reconsider later.
+ Update the state timeout value to 240s.
+ That is the default for TCP (for transitory state).
- UDP could keep using 300s.
+ But I prefer UDP and TCP to behave as similarly as possible.
+ Use TRex tunables to get the exact frame size (for data packets).
- It is not clear why the recipe for MSS has to be this complicated.
+ Move code away from profile init, as frame size is not known there.
+ Change internal profile API, so values related to MSS are passed.
+ Lower ramp-up rate for TCP TPUT tests.
+ Because without lower rate, jumbo fails on packet loss in ramp-up.
+ UDP TPUT ramp-up rate also lowered (just to keep suites more similar).
+ Distinguish one-direction and aggregated average frame size.
+ Update keyword documentation where the distiction matters.
+ One-direction is needed for turning bandwidth limit to TPS limit.
+ Aggregated is needed for correct NDRPDR bandwidth result value.
- TCP TPUT will always be few percent below bidirectional maximum.
+ That is unavoidable, as one direction sends more control packets.
+ Add runtime consistency checks so future refactors are safer.
+ Fail if padding requested would be negative.
+ Fail if suite claims unexpected values for packets per transaction.
+ Edit the 4 types of ASTF profiles to keep them similar to each other.
+ Move UDP TPUT limit value from a field back to direct argument.
+ Stop pretending first UDP packet is not data.
+ Apply small improvements where convenient.
+ Replace "aggregate" with "aggregated" where possible.
+ To lower probability of any future typos in variable names.
+ Avoid calling Set Numeric Frame Sizes twice.
+ Code formatting, keyword documentation, code comments, ...
+ Add TODOs for less important code quality improvements.
- Postpone updating of methodology pages to a subsequent change.
Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 2 May 2022 08:39:24 +0000 (10:39 +0200)]
feat(uti): Add structured menu for stats
Change-Id: I907606b1b994e991975f887611750d23fd7f1634
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 2 May 2022 06:28:15 +0000 (06:28 +0000)]
Update VPP_STABLE_VER files
Change-Id: I5207153be2b3231633ee3c16ac78a099bd60893f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Viliam Luc [Mon, 2 May 2022 07:27:56 +0000 (09:27 +0200)]
trending: fix failing trending job
3n-aws job was recently removed which caused trending jobs to fail.
For historical reason we keep 3n-aws in trending until 180 days
period pass.
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I7b59fc4b6f1b46bf910bc540cf37dd042df9c64a
Peter Mikus [Wed, 27 Apr 2022 13:28:42 +0000 (15:28 +0200)]
feat(infra): Terraform updates
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3d7ecad9125e3ff55c0b4e1da5cda5a1ff22d690
Tibor Frank [Wed, 27 Apr 2022 11:39:07 +0000 (13:39 +0200)]
feat(uti): Add constant TIME_PERIOD
It defines the time period from now back to the past from which data is
raed to dataframes.
Change-Id: Ic6feeb8e7958d69aa2e39922b48e9898e09b45dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 27 Apr 2022 08:28:47 +0000 (10:28 +0200)]
feat(uti): Add offcanvas to stats
Change-Id: I5d807944b0158e51998bfc709a87d9d6c826112c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 27 Apr 2022 08:27:33 +0000 (10:27 +0200)]
feat(uti): Form layout
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1c00a9b3ffa69b1a0be1d51bb72d13516293afd2
Tibor Frank [Wed, 27 Apr 2022 07:38:34 +0000 (09:38 +0200)]
feat(uti): Add init files to dirs
Change-Id: Ic643da296861350b4d86eaec0245c8312f3c1a35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 26 Apr 2022 11:58:43 +0000 (13:58 +0200)]
feat(infra): Onboard Mellanox III.
+ DPDK matrix
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I473265ae1ebf08e1518a6b6e2998abdc750167d1
Tibor Frank [Mon, 25 Apr 2022 14:55:01 +0000 (16:55 +0200)]
feat(uti): Add statistics
Change-Id: I14046fd1050f130d201bbe81a72e48ad4fd10057
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 20 Apr 2022 12:27:18 +0000 (14:27 +0200)]
fix(tgtest): filter by TG NIC model
The previous path computation code was only correct
for tests with DUT (and TG).
There, we only want to filter by DUT NICs, but not TG NICs
(e.g. to allow testing E810 DUT with MLX TG).
But for tests without DUT (still with TG),
we do indeed want to filter by NICs on TG, so this patch does that.
Change-Id: Ia482c6327af7bca26353ad6e503ae224d90cb3a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Mon, 25 Apr 2022 13:02:47 +0000 (15:02 +0200)]
feat(infra): Onboard Mellanox II.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifd90f6b77f49e2a6907262d6f1e3da19ef275ac6
Peter Mikus [Fri, 22 Apr 2022 13:05:48 +0000 (15:05 +0200)]
feat(infra): AWS Beanstalk adjustments
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad492c1a848052de4e5a7cb50dd3312d25234e2e
Tibor Frank [Mon, 25 Apr 2022 04:33:47 +0000 (04:33 +0000)]
Update VPP_STABLE_VER files
Change-Id: If6d3461a2712a6854e3d80d8ac04329f2debd029
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 22 Apr 2022 08:25:20 +0000 (10:25 +0200)]
feat(uti): swap buttons
Change-Id: I0c0069a37783658099fb11d7fa15f45b6d0dc3cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 21 Apr 2022 11:47:46 +0000 (13:47 +0200)]
feat(infra): Onboard Mellanox I.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47781b9d0cf6c08d12ac36774b9093c3934d9ee6
Peter Mikus [Thu, 21 Apr 2022 09:36:53 +0000 (11:36 +0200)]
feat(uti): Form layout
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibea233e89ef87b684adba65ad3a4a13524d32809
Tibor Frank [Thu, 21 Apr 2022 07:55:40 +0000 (09:55 +0200)]
feat(uti): optimize offcanvas
Change-Id: I323e6743ed3f77b552b0556806ad8d7a4ba5675c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 21 Apr 2022 05:38:49 +0000 (07:38 +0200)]
feat(uti): Remove button "Display"
- not needed
Change-Id: Ic2bc74af1574e766c007f310f626c2e9ba61bbc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 20 Apr 2022 14:50:53 +0000 (16:50 +0200)]
feat(uti): Form layout
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id065f8ecd0571567f1f679bdd70c46794fc71a94
Code Review / csit.git / log