Viliam Luc [Wed, 22 Jun 2022 13:39:55 +0000 (15:39 +0200)]
fix: 3n-alt missing in regressions and progressions
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I8b2cdf6f8dc45cae9a921c1ecbd2e952ef30bfbe
Peter Mikus [Wed, 22 Jun 2022 11:01:17 +0000 (11:01 +0000)]
feat(ansible): Add ICX
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3a62dc7048102381598b3e0dfc16f82fad834d7b
Tibor Frank [Wed, 22 Jun 2022 08:46:41 +0000 (10:46 +0200)]
Report: Add 2n-clx-e810cq latency
Change-Id: I5674d40362ea958c34845c22c1b5fd090d08be83
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 22 Jun 2022 07:21:15 +0000 (07:21 +0000)]
feat(doc): Infra updates
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I208fc73382754d3182f6f7eedc1a46ae72ef6aa2
Tibor Frank [Tue, 21 Jun 2022 12:05:28 +0000 (14:05 +0200)]
Report: Comparisons
Change-Id: Icbb4709c84b66251438b73d109606977527c6c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 21 Jun 2022 11:36:54 +0000 (13:36 +0200)]
Report: Add 2n-clx-e810cq
Change-Id: I4c7f37d77a9b8bda17eb3fb0b9a5bf468f1fd853
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 21 Jun 2022 08:33:36 +0000 (08:33 +0000)]
Update VPP_STABLE_VER files
Change-Id: Iea2b40aa5df6a96fd26f1d85f23dd6d304a7ca8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 17 Jun 2022 11:55:49 +0000 (11:55 +0000)]
feat(pxe): Add ICX
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e3ec03a87f356c0e588011b848f8dd4ab7f30aa
Tibor Frank [Tue, 21 Jun 2022 08:27:59 +0000 (10:27 +0200)]
Trending: Add 2n-clx-e810cq - fixes
Change-Id: I9789e459c3db272e8f76c25df1ced266c9f5213f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 21 Jun 2022 08:01:26 +0000 (10:01 +0200)]
Trending: Add 2n-clx-e810cq
Change-Id: Iefcd777f2e51038c4efc13ff68c777efb7ed78c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 22 Apr 2022 11:29:06 +0000 (13:29 +0200)]
fix(uti): export correct units in cps ndrpdr
Compute Bandwidth keyword returns value in Gbps,
as that is convenient for test messages.
Export Search Bound keyword expects value in bps,
as that is convenient for JSON export.
While the conversion was present in
Display Single PPS Bound keyword, it was missing from
Display Single CPS Bound keyword. Now added.
Change-Id: I5bb5934beeecfa2ee1b77dd1b1bfc788d034c845
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 22 Apr 2022 11:27:48 +0000 (13:27 +0200)]
style(robot): capitalize two keywords properly
This is just to make the subsequent fix more readable.
Change-Id: I7cebcaed3f658cd026f05713ea2f94dce60786c0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Viliam Luc [Mon, 13 Jun 2022 11:42:29 +0000 (13:42 +0200)]
fix: testpmd and l3fwd check state
+ print testpmd and l3fwd pid after start
Testpmd and l3fwd utility can be started but link might not be
ready yet. This fix start the utility on all DUTs and do the
check later.
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If476e22f206d9a6a0dd399879a88eafedca92bb6
Yulong Pei [Wed, 11 May 2022 04:29:50 +0000 (04:29 +0000)]
Add ipsec policy test suites with flow director or rss accelerated
The test scenario is about two private networks which communication was
protected by ipsec.
The test suites are to show performance impovement about ipsec esp flow
lookup that offloaded by NIC flow director and rss.
Verified on 3n-clx and Intel E810 NIC environment, with 64B ipsec packet
flow, performance improved ~31% with 1C2T, ~110% with 2C4T, ~250% with 4C8T.
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I30aec8c5115e5a6fbef88c11d1bef2624029d1b9
Peter Mikus [Wed, 15 Jun 2022 13:44:17 +0000 (13:44 +0000)]
doc(infra): ICX onboarding
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I542a16dcc1f00b0cc2a9f1bce873b0e67d60b69e
Vratko Polak [Wed, 8 Jun 2022 08:42:26 +0000 (10:42 +0200)]
feat(jobspec): Avoid tests affected by CSIT-1830
+ Replace TCP TPUT 100b tests on xxv710 NICs with 1518b ones.
+ Keep UDP TPUT tests at 100b for now.
+ Add both 100b and 1518b TCP TPUT tests to Denverton.
+ Its x553 NIC is not affected.
+ That gives us some comparison on how packet size affects performance.
Ticket: CSIT-1830
Change-Id: I5544f7ba84d4813148bcad2f9d64634939492647
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 8 Jun 2022 08:39:49 +0000 (10:39 +0200)]
feat(tests): Remove PPS tests.
+ Delete nat44 pps suites.
+ Rename ip4base suites, testcases, suite tags (also tg) to -tput.
+ Also robot tags like UDP_PPS and TCP_PPS.
- Keep traffic types and traffic profile names with pps.
+ They can be renamed in a different change if needed.
+ Update job specs.
- Do not update methodology yet (avoid conflict with another Change).
Ticket: CSIT-1829
Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 14 Jun 2022 12:31:17 +0000 (14:31 +0200)]
Feat(uti): Last failed tests
Change-Id: Ifac36b3f2c886a78cb8a7922f98a760287d631ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 18 May 2022 09:57:02 +0000 (11:57 +0200)]
feat(infra): SnowRidge docs
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie53e1e7474542547d73bdfe2a234e6e838bdd454
Vratko Polak [Thu, 9 Jun 2022 11:13:22 +0000 (13:13 +0200)]
fix(vlan): do not apply strip offload
Some tests (bonding) are failing as VPP refuses startup.conf.
That is because the config parameter support has been removed:
https://gerrit.fd.io/r/c/vpp/+/34822
That is VPP commit
8c8531c15c9195c2c82695eff6e70887de67fd88.
According to commit message, it was just a workaround
for Cisco ENIC cards, which are no longer tested in CSIT.
+ Delete 1 robot and 1 python keyword as they become unused.
Change-Id: If53e324a27cfbd4659e49ab8bcd03253642dde96
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 13 Jun 2022 12:44:15 +0000 (14:44 +0200)]
fix(stl_traffic): track both ports on unidir
Even if the suite asks for unidirectional stateless traffic,
in some circumstances (e.g. reconf tests)
stats from both ports are needed to determine overall loss.
Enabling both ports unconditionally fixes that
without any negative consequences.
Latency info is still gathered only for one direction in unidir tests.
Change-Id: Ifec6603d6103c9981fc0af02a81b0db215ccb77c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Tue, 14 Jun 2022 11:14:49 +0000 (11:14 +0000)]
doc(report): Update test environment
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9987cac1493ea75eb097a0f2123768eec1ca3d73
Peter Mikus [Tue, 14 Jun 2022 09:53:03 +0000 (09:53 +0000)]
fix(infra): Topopology link swap
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I20fc441cb46b70b2c315a2c865c3d11e3c341212
Peter Mikus [Tue, 14 Jun 2022 06:34:55 +0000 (06:34 +0000)]
fix(pylint): Some quick pylints
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba133914882485191ad962e36fae70b6fda0af98
Viliam Luc [Tue, 14 Jun 2022 08:30:17 +0000 (10:30 +0200)]
trending: fix 3n-alt missing in dashboard
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I356998c521d47f085a78bf2577574ea0d489e02d
Tibor Frank [Mon, 13 Jun 2022 13:07:47 +0000 (15:07 +0200)]
feat(uti): remove not neccessary data
Change-Id: I10f00fce9623ec1dfe34925087e2669ae411e036
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 13 Jun 2022 08:16:04 +0000 (08:16 +0000)]
feat(dpdk): Bump the version within VM
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie358593f9977d04aca9e50a14e0d14158e1b0cf1
Peter Mikus [Mon, 13 Jun 2022 05:57:02 +0000 (05:57 +0000)]
doc(infra): Fix firmware versions
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I755043bc10b2bc419daf007f023742e814c3c63b
Tibor Frank [Mon, 13 Jun 2022 04:23:57 +0000 (04:23 +0000)]
Update VPP_STABLE_VER files
Change-Id: I918daab67aa4a4495b9080f7e0e87b9aa950d2b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 10 Jun 2022 14:01:22 +0000 (16:01 +0200)]
fix(hoststack): distinguish two tcp tag types
Previous change did not consider TCP_PPS and TCP_CPS robot tags
are used by two different suite types (hoststack or ASTF).
This fixes the unintended impact on hoststack.
+ Add HOSTSTACK tag to VSAP suites.
- They could also get VSAP tag, but not needed for this Change.
Fixes:
1daa6fdc0bae284dee1b61f34534e59b60b7526a
Change-Id: Ic583b5ae336c9b74794706fefc232f221a243c87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 9 Jun 2022 09:45:26 +0000 (09:45 +0000)]
fix(core): T-Rex initialization
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I53226ff6a345ac99c1e2e110712b2ff6197efe95
Tibor Frank [Fri, 10 Jun 2022 11:13:08 +0000 (13:13 +0200)]
feat(uti): statistical graphs
Change-Id: Ic05d56dae08e9745582e02e59e8b76145050ca73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 10 Jun 2022 08:10:15 +0000 (10:10 +0200)]
fix(wireguard): add missing test teardown
Fixes:
75ef277536c43096e7646430568d97d2cc489238
Change-Id: I94575bee0aa77907cc900b58b186c3612fb18d85
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 19 May 2022 12:24:15 +0000 (14:24 +0200)]
feat(uti): Add statistical graphs
Change-Id: Ia2831cfbcb9e2333c5b49af5c6b0577867d99902
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 9 Jun 2022 09:43:11 +0000 (11:43 +0200)]
Report: Add retest data
Change-Id: Ic42a15b44e0395c194cdeddef6d91635fd0f9b10
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Cui,Cheng [Thu, 19 May 2022 06:48:04 +0000 (06:48 +0000)]
Add Test Suite for VPP WireGuard
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
Peter Mikus [Wed, 8 Jun 2022 12:35:04 +0000 (12:35 +0000)]
fix(infra): 2n-clx links and docs
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iac1743da3eb51c69c67e8496ad4145dcc616341c
Tibor Frank [Wed, 8 Jun 2022 08:49:08 +0000 (10:49 +0200)]
Report: Add dpdk and re-test data
Change-Id: Ia078a30f467c9a0eac45a58b83dd82975b815b5a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 7 Jun 2022 08:20:45 +0000 (10:20 +0200)]
fix(infra): Temporarily disable X710 link loop
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4a8eb282754a5689cd538653e34bbc456e198f94
Tibor Frank [Tue, 7 Jun 2022 05:29:50 +0000 (07:29 +0200)]
Report: Add rc1, re-test, dpdk data
Change-Id: I1ae47ee5d0ae21dd17bd6e99d81ab5e8f223f70b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 6 Jun 2022 07:56:17 +0000 (09:56 +0200)]
Report: Add rc1, dpdk, re-test data
Change-Id: Icb8c2acccd27a7d2ec0da2b524a743f795f7ab36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 6 Jun 2022 04:49:56 +0000 (04:49 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ib6b2e0121b57aeba48baf1fcb7dacf5c07f05da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 3 Jun 2022 04:45:02 +0000 (06:45 +0200)]
Report: Add rc1 data
Change-Id: I569e49967bdebb02828cd166f7a9164afbbe9205
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 2 Jun 2022 09:55:48 +0000 (11:55 +0200)]
Report: Add 3n-alt latency graphs
Change-Id: Iaf2d123bcfd594d3e35d07c981c9f4b0597c7929
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 2 Jun 2022 06:19:54 +0000 (08:19 +0200)]
Report: Add rc1 data
Change-Id: I06c976cb91d5125d18fc9b2d313c2373f61d88b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 18:38:40 +0000 (20:38 +0200)]
Report: fix: 3n-alt
Change-Id: Idf3d8a393b928cf6f939355d2f6a5af93d18f440
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 18:22:08 +0000 (20:22 +0200)]
Report: Add 3n-alt rc1 data
Change-Id: I176dd4a109056b01c2b1b3b11e274b57258b7a02
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 13:40:43 +0000 (15:40 +0200)]
Report: Add 3n-alt
Change-Id: I2a811d5a2e618dc339a3e40c3b8c374a5051649c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 07:38:04 +0000 (09:38 +0200)]
Report: Remove 3n-aws
Change-Id: I6e065cf25536197c2e414fde017390d54fb3b15c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 1 Jun 2022 07:16:15 +0000 (09:16 +0200)]
Report: Add rc1 data
Change-Id: I79678b56fcdc5c8ff8736a87a7437ee145a40459
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 1 Jun 2022 05:22:19 +0000 (07:22 +0200)]
fix(core): TG export
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I80f9f32f10d46eccf1157949a184ec4467d071cd
Peter Mikus [Tue, 31 May 2022 10:48:56 +0000 (12:48 +0200)]
fix(etl): Typo
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4deed6b4c64cf9c04547d2a7cc0319bfa8aee1b6
Juraj Linkeš [Wed, 16 Mar 2022 08:46:15 +0000 (09:46 +0100)]
Framework: exclude env and .git when copying
The tarball is unnecessarily big, remove superflous directories.
Change-Id: I55f6fae64973cfac34a1dc18cbdc688cd416e8b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Tue, 31 May 2022 04:47:49 +0000 (06:47 +0200)]
Report: Add rc1 data
Change-Id: I4f83a043c65ac1c968020024d139123a836fb33b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 30 May 2022 13:51:30 +0000 (15:51 +0200)]
PAL: Remove nexus from data sources
Change-Id: Iec40f3cb1ca543dc42017ccfb2a663aee1204531
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 30 May 2022 12:52:21 +0000 (14:52 +0200)]
Report: Add rc1 data
Change-Id: If71ad64c0778793afd9b8d8aff8a55c035b7dbfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 30 May 2022 10:01:22 +0000 (12:01 +0200)]
feat(infra): Update AWS AMIs
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fd9351b2c3448809bdef282c23eedd1ca3364a7
Viliam Luc [Thu, 26 May 2022 06:57:45 +0000 (08:57 +0200)]
trending: tput 100b tests update + static content
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iba05311055b901ca3f5c2714bf0ea1c87525af50
Peter Mikus [Mon, 30 May 2022 08:06:17 +0000 (10:06 +0200)]
feat(docs): Add e810 for 2n-clx
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I607ccd5d4b28dca576e40b79285bb2b31a65d76c
Tibor Frank [Mon, 30 May 2022 04:45:47 +0000 (04:45 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ia8d310749ef074f3eaaf1251b9b5106a978ea42d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Viliam Luc [Thu, 26 May 2022 08:58:24 +0000 (10:58 +0200)]
trending: fix missing csit-trex-perf-ndrpdr in trending emails
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I62af32fd69af35491f3ed97ffc6ff31fb3f19720
Peter Mikus [Thu, 26 May 2022 10:34:04 +0000 (12:34 +0200)]
feat(docs): Add e810 for 2n-clx
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I59f9df885907c7ce316e95a65fe98e9637820d01
Peter Mikus [Thu, 26 May 2022 11:28:26 +0000 (13:28 +0200)]
fix(core): TG export
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60313cd62a878bb713832f14121a938a81c954ed
Peter Mikus [Thu, 26 May 2022 10:57:46 +0000 (12:57 +0200)]
feat(infra): remove 2n-skx
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id263f260ecb7a7a11b8c7eb64b415418da36c5c8
Peter Mikus [Thu, 26 May 2022 06:57:38 +0000 (08:57 +0200)]
feat(infra): remove 2n-skx
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Idabdef957f6191c6a05bc82fb8f86d3015b67fc7
Tibor Frank [Wed, 25 May 2022 13:34:36 +0000 (15:34 +0200)]
Report: Configure report rls2206
Change-Id: If5cb8bfd0af11c9a9d35bac8de7a9c8f8c59092b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 25 May 2022 09:06:41 +0000 (11:06 +0200)]
feat(etl): optimization
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2f313d5967e1ac745b817c4074487ccf56940b0a
Peter Mikus [Wed, 25 May 2022 08:59:06 +0000 (10:59 +0200)]
feat(etl): report 2206
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I159860b7da1bd03f5cdf6a35c59221c079c863b1
Peter Mikus [Wed, 25 May 2022 07:02:29 +0000 (09:02 +0200)]
feat(etl): report 2206
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I61fc4187ecd9948c2a8091229c5670f9c73e82ae
Peter Mikus [Thu, 5 May 2022 11:08:10 +0000 (13:08 +0200)]
fix(uti): Add TG type export
- This is actually bug not a feature.
- AB to be added later
- Tested on TREX and iPerf3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib6f2d13e3b9401a9fb5759e42a8a310ee11b9d41
Peter Mikus [Tue, 24 May 2022 07:52:13 +0000 (09:52 +0200)]
feat(uti): Use only 1 worker
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84d20520abd58f698dac936ee06163e1b5b20e04
Vratko Polak [Fri, 20 May 2022 08:27:49 +0000 (10:27 +0200)]
fix(dash): improve date formatting in hover
Bring it closer to RFC 3339 while keeping spaces.
The fully compatible format (2022-03-29T08:45:02Z)
may look too exotic for average human.
Dates other than in hover (e.g. in Time Period selection)
are not affected by this Change.
Change-Id: Ic5033d1b0db8505b0919e6a1392e28004c718f21
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 23 May 2022 04:48:41 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files
Change-Id: I7fa27b403f8e12d8c36728d462762dacd05de852
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Viliam Luc [Fri, 20 May 2022 10:37:33 +0000 (12:37 +0200)]
report,trending: updated tput test to 100B
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I4af6076dc0f02b952a04a3d3a5729b82f8a1e354
Peter Mikus [Fri, 20 May 2022 06:47:19 +0000 (08:47 +0200)]
feat(uti): Infra updates
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I82f84b81f4a016c8bd503e60caacf34f24d407d5
Peter Mikus [Thu, 19 May 2022 12:24:37 +0000 (14:24 +0200)]
feat(uti): Deploy tuning
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6f83e88a34997183fa2e7ac5bfe52b9bce50c906
Tibor Frank [Tue, 17 May 2022 12:30:37 +0000 (14:30 +0200)]
feat(uti): Add iterative data
Change-Id: Iaa7253b377f019235289f6bbf48eafd850a2dfc8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 5 May 2022 10:46:44 +0000 (12:46 +0200)]
fix(jobspec): use 100b for tput and pps tests
For TCP tests, 1518b is closer to what the real traffic would be,
but as usual we want smaller sizes to stress VPP before filling line.
CPS tests remain at 64b.
Fixes:
1daa6fdc0bae284dee1b61f34534e59b60b7526a
Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 17 May 2022 13:32:04 +0000 (15:32 +0200)]
fix(trex): use reset instead of clear_profile
Now sure why clear_profile gets stuck with v2.97
(unless block=False), but calling reset() works,
and will be less risky next time we bump TRex version.
- Only ASTF for now.
Change-Id: Ib6906fb8ce269e888bf0e0438d3309931d5e9981
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Yulong Pei [Wed, 11 May 2022 05:11:28 +0000 (05:11 +0000)]
Add gtpu flow offload test suite
The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action
of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct
received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input,
ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node
processing.
Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet,
performance improve ~33% that compare with pure software way.
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Peter Mikus [Tue, 17 May 2022 13:03:21 +0000 (15:03 +0200)]
feat(perf): T-Rex core usage 2n-zn2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
Peter Mikus [Tue, 17 May 2022 10:32:47 +0000 (12:32 +0200)]
fix(uti): Terraform settings
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica539512f3129391551938541d00d9e9d1560af3
Tibor Frank [Tue, 17 May 2022 08:17:52 +0000 (10:17 +0200)]
feat(uti): Values in hover as integers (no decimals)
Change-Id: I3b4246a77daeb41ec23e6de341fafdfad5ed657b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 16 May 2022 14:22:43 +0000 (16:22 +0200)]
feat(uti): Add list of failed tests to stats
Change-Id: Ie0bedafc7be3235fe696af4f356e95f64773e783
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 17 May 2022 06:16:15 +0000 (08:16 +0200)]
infra(ansible): Jammy placeholder
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I693841cadf33d23e417374b949771ba7c3dbccd2
Peter Mikus [Mon, 16 May 2022 14:30:20 +0000 (16:30 +0200)]
feat(perf): T-Rex core usage
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id0e7d31dc1368140c2c829fb2fcab009fbbed26d
pmikus [Wed, 21 Jul 2021 12:01:34 +0000 (12:01 +0000)]
Core: T-rex 2.97
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
Tibor Frank [Mon, 16 May 2022 11:47:59 +0000 (13:47 +0200)]
feat(uti): set styles for url dialog
Change-Id: I27e741436be82499c84371018a4f03f2330cbab4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Wed, 21 Jul 2021 11:57:10 +0000 (11:57 +0000)]
Ansible: T-rex 2.97
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d5e00c45648dd4ae9e03ce1c7d0f2d2c53db476
Tibor Frank [Mon, 16 May 2022 04:52:41 +0000 (04:52 +0000)]
Update VPP_STABLE_VER files
Change-Id: I3a549ec0a0d8d060fdc9e5642c589454eaae93cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 12 May 2022 09:50:06 +0000 (11:50 +0200)]
feat(uti): Trending - add encoded and zipped url
Change-Id: I0148999ed5fe3f7e51078545b88e2bb2d2481884
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 11 May 2022 12:45:35 +0000 (14:45 +0200)]
feat(uti): Statistics - base64 encoded url
Change-Id: Iab6d5c62ab35778127bb328a032a63cd7c21d0bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 10 May 2022 08:57:43 +0000 (10:57 +0200)]
feat(infra): Mellanox compatibility Matrix
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iec87340aed64dd72e5289bd13af27c177f92c466
Tibor Frank [Tue, 10 May 2022 07:00:34 +0000 (09:00 +0200)]
feat(uti): Statistics - add url
Change-Id: Ied1ec832379dad4965ad2299834d2eaa7d1a4c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 May 2022 13:57:01 +0000 (15:57 +0200)]
feat(uti): data to csv
Change-Id: Iebc24dae2b76408f07c145b2638c346193cf8e1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 6 May 2022 12:29:55 +0000 (14:29 +0200)]
feat(uti): tooltips
Change-Id: I615affce80f1e6af9ea0a5d581b84e17ee88e458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 May 2022 04:32:56 +0000 (04:32 +0000)]
Update VPP_STABLE_VER files
Change-Id: I5e48e9d9759b456c8e4b67815045e8376632df65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 May 2022 13:41:11 +0000 (15:41 +0200)]
feat(uti): Generate structure of tests from data for trending
Change-Id: I14a59da85112473fde342b2f687bd87256a7d416
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 25 Apr 2022 08:22:05 +0000 (10:22 +0200)]
feat(astf): Support framesizes for ASTF
- No support for IMIX.
+ Fix a bad bug in padding (most ASTF profiles had wrong frame sizes).
+ Fix a big typo in TCP PPS profiles (s->c was not data, just RST).
+ Control transaction size via ASTF_N_DATA_FRAMES env variable.
- Default value 5 leads to transactions smaller than before.
+ It ensures transaction is one burst (per direction) even for jumbo.
+ Edit autogen to set supported frame sizes based on suite id.
+ Both TCP and UDP use the same values:
+ 64B for CPS (exact for UDP, nominal for TCP).
+ 100B, 1518B and 9000B for TPUT and PPS.
- TCP TPUT achievable minimum is 70B.
+ Used 100B to leave room for possible IPv6 ASTF tests.
+ Separate function for code reused by vpp and trex tests.
- I do not really like the new "copy and edit" approach added here.
+ But it is a quick edit, better autogen refactor is low priority.
+ Consider both established and transitory sessions as valid.
- Mostly for compatibility with 2202 behavior and to avoid ramp-ups.
- Assuming both session states have similar enough VPP CPU overhead.
+ Added a TODO to investigate and maybe reconsider later.
+ Update the state timeout value to 240s.
+ That is the default for TCP (for transitory state).
- UDP could keep using 300s.
+ But I prefer UDP and TCP to behave as similarly as possible.
+ Use TRex tunables to get the exact frame size (for data packets).
- It is not clear why the recipe for MSS has to be this complicated.
+ Move code away from profile init, as frame size is not known there.
+ Change internal profile API, so values related to MSS are passed.
+ Lower ramp-up rate for TCP TPUT tests.
+ Because without lower rate, jumbo fails on packet loss in ramp-up.
+ UDP TPUT ramp-up rate also lowered (just to keep suites more similar).
+ Distinguish one-direction and aggregated average frame size.
+ Update keyword documentation where the distiction matters.
+ One-direction is needed for turning bandwidth limit to TPS limit.
+ Aggregated is needed for correct NDRPDR bandwidth result value.
- TCP TPUT will always be few percent below bidirectional maximum.
+ That is unavoidable, as one direction sends more control packets.
+ Add runtime consistency checks so future refactors are safer.
+ Fail if padding requested would be negative.
+ Fail if suite claims unexpected values for packets per transaction.
+ Edit the 4 types of ASTF profiles to keep them similar to each other.
+ Move UDP TPUT limit value from a field back to direct argument.
+ Stop pretending first UDP packet is not data.
+ Apply small improvements where convenient.
+ Replace "aggregate" with "aggregated" where possible.
+ To lower probability of any future typos in variable names.
+ Avoid calling Set Numeric Frame Sizes twice.
+ Code formatting, keyword documentation, code comments, ...
+ Add TODOs for less important code quality improvements.
- Postpone updating of methodology pages to a subsequent change.
Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 2 May 2022 08:39:24 +0000 (10:39 +0200)]
feat(uti): Add structured menu for stats
Change-Id: I907606b1b994e991975f887611750d23fd7f1634
Signed-off-by: Tibor Frank <tifrank@cisco.com>