Tibor Frank [Mon, 7 Feb 2022 13:47:08 +0000 (14:47 +0100)]
Report: Small fixes
Change-Id: Ib2cb94c747168b773409c18e3e366ebf3400ab99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 7 Feb 2022 13:03:28 +0000 (14:03 +0100)]
Trending: Add icx latency trending graphs
Change-Id: I75dc5fa2e0f8d92651ec22293875c8b3568a2159
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 7 Feb 2022 09:28:00 +0000 (10:28 +0100)]
Trending: Add icx nfv
Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 7 Feb 2022 08:35:54 +0000 (09:35 +0100)]
Report: Add icx latencies
Change-Id: Idcab4424a1439f22e4708abc1c88fbd1125ca439
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 7 Feb 2022 05:34:14 +0000 (05:34 +0000)]
Update VPP_STABLE_VER files
Change-Id: I4502d63b732924acc361de3f1141e792a32dbf8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 Feb 2022 07:09:49 +0000 (08:09 +0100)]
Trending: Add icx weekly
- Tables
- data
- dashboard
- failed tests
- last failed tests
- weekly comparison tables
- graphs
- stats
- dpdk_mrr
- vpp_ndrpdr
- DPDK MRR
- VPP NDRPDR
Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 4 Feb 2022 09:47:56 +0000 (10:47 +0100)]
Report: Suite doc format
Change-Id: Ia2fb6c72d07ad008c36ff0ecd76b9dcd8b4abab4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 4 Feb 2022 08:56:00 +0000 (09:56 +0100)]
feat(terraform): Refactor vault backend
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I914ecf444b5f8870969f1d996ba03a42fd92a5d5
Tibor Frank [Fri, 4 Feb 2022 05:58:08 +0000 (06:58 +0100)]
Fix: Typo in Perf.NfvDensity.DcrMemif.ChainIpsec
Change-Id: I901ef0afce782bf69b7169e0dd08ce06b6f074b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 Feb 2022 15:19:24 +0000 (16:19 +0100)]
Report: Add dpdk icx static content
Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 Feb 2022 09:11:36 +0000 (10:11 +0100)]
PAL: Process exception while writing table
- table_merged_details
Change-Id: I4ee8b1c2f56c367e22d6e75853c8bb074d62935b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 Feb 2022 05:40:01 +0000 (06:40 +0100)]
Report: Add data
Change-Id: I9b3f1da0a889c73e4a0e00f3a283ca51e6ba64f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 Feb 2022 15:20:08 +0000 (16:20 +0100)]
Report: fix spec
Change-Id: Id5570aa55b2fec5973c4e924124dddf398eeecfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 1 Feb 2022 12:34:40 +0000 (13:34 +0100)]
Report: Add ICX
- Stats
- DPDK
- comparisom tables
- detailed results
- graphs
- tput
- speedup
- VPP
- detailed results
- graphs
- tput
- speedup
Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Viliam Luc [Tue, 1 Feb 2022 14:09:59 +0000 (15:09 +0100)]
trending: icx added
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib742be7841b462eaa97ba1f6f87f7ac63bde03df
Tibor Frank [Tue, 1 Feb 2022 09:44:32 +0000 (10:44 +0100)]
Report: Add data
Change-Id: Ia516ffda944356cd9fbe18bc147371dcf7e9996d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 1 Feb 2022 09:35:45 +0000 (10:35 +0100)]
Report: Add data
Change-Id: I8908036f7eb84d22d0c23abfe149b8f5aa188639
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 1 Feb 2022 05:49:42 +0000 (06:49 +0100)]
Trending: Fix - 3n-icx spec
Change-Id: I869e808fced5458dcc348d1fdc183580634aa977
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 31 Jan 2022 12:54:49 +0000 (13:54 +0100)]
Trending: Add 3n-icx
Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 31 Jan 2022 11:25:21 +0000 (12:25 +0100)]
feat(docs): Static content update
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1cdd628be1d358fcca4bf05c9357c195ee3a8288
Tibor Frank [Mon, 31 Jan 2022 09:42:54 +0000 (10:42 +0100)]
Trending: Remove HSW
Change-Id: I80ddeb6174c180e90c7e4b63378f08e430e452ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 31 Jan 2022 09:05:35 +0000 (10:05 +0100)]
fix(telemetry): Add mpls to parse
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I77d7273324cea884b561fc977cd9553fcf027ae5
Tibor Frank [Thu, 27 Jan 2022 11:01:09 +0000 (12:01 +0100)]
Trending: Add 2n-icx
Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 31 Jan 2022 05:40:48 +0000 (05:40 +0000)]
Update VPP_STABLE_VER files
Change-Id: If7be325e8c10ae12a30bc3363b6d5daadc685e56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 28 Jan 2022 10:06:00 +0000 (11:06 +0100)]
Doc: Add discussion about common anomaly patterns
Change-Id: Ic70c653cb660663abe48c2a0ae3e496a4e8c85f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 27 Jan 2022 12:24:58 +0000 (13:24 +0100)]
fix(core): 3n-icx topology
+ Temporarily disable, until investigated
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9fd0ec96fe27b674dfcc4a36df05cc9a7a1db6ab
Peter Mikus [Thu, 27 Jan 2022 09:30:26 +0000 (10:30 +0100)]
fix(dpdk): Jumbo
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0e659937440e9ff7070f0d13b7a1db99f27cf2bb
Peter Mikus [Thu, 27 Jan 2022 08:49:25 +0000 (09:49 +0100)]
fix(core): ICX topology file
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I11b6a1d953f850240e1e95e0fc9e3c2b460cd43a
Tibor Frank [Thu, 27 Jan 2022 07:19:01 +0000 (08:19 +0100)]
Report: Add data
Change-Id: I1b8a3c10a065bf9f68ad855f2a892cd47af35f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 26 Jan 2022 09:35:11 +0000 (10:35 +0100)]
Report: Add data
Change-Id: I29e3bab8bcb57076f0eece519fa870a8645c2ce6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 25 Jan 2022 12:13:45 +0000 (13:13 +0100)]
fix(core): topology files, tox
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I93e2035568527c2f68732a0c7fe1865d100831ad
Peter Mikus [Tue, 25 Jan 2022 11:37:43 +0000 (12:37 +0100)]
fix(core): Remove unused stuff
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0cfc9d9fbb1a82a308231a5d2c0b12cb632c469b
Viliam Luc [Mon, 24 Jan 2022 11:59:47 +0000 (12:59 +0100)]
trending: fix re-pro showing wrong data
vpp-2n-zn2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-zn2/484, vpp version: 22.06-rc0~
0-g017a67665~b2179
4t2c-avf-eth-l2bdbasemaclrn-mrr 10ge2p1x710 64B 29.6 1 -0.2
2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.14 1 -58.08
4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.98 1 -57.73
4t4c-ethip4-ip4base-mrr 10ge2p1x553 64B 2.97 1 -79.05
1t1c-eth-l2patch-mrr 10ge2p1x553 64B 2.98 1 -75.94
2t2c-eth-l2bdbasemaclrn-mrr 10ge2p1x553 64B 8.27 1 -11.0
2t1c-af-xdp-ethip4-ip4scale2m-mrr 25ge2p1xxv710 64B 6.21 1 -53.14
vpp-2n-tx2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-tx2/265, vpp version: 22.02-rc0~
508-g88a9c0e02~b851
4t2c-avf-eth-l2bdbasemaclrn-mrr 10ge2p1x710 64B 29.6 1 -0.2
2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.14 1 -58.08
4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.98 1 -57.73
4t4c-ethip4-ip4base-mrr 10ge2p1x553 64B 2.97 1 -79.05
1t1c-eth-l2patch-mrr 10ge2p1x553 64B 2.98 1 -75.94
2t2c-eth-l2bdbasemaclrn-mrr 10ge2p1x553 64B 8.27 1 -11.0
2t1c-af-xdp-ethip4-ip4scale2m-mrr 25ge2p1xxv710 64B 6.21 1 -53.14
The same data for different TB.
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iefce9a7196bae6fde45ee1935184efab4735e6e0
Tibor Frank [Tue, 25 Jan 2022 08:51:38 +0000 (09:51 +0100)]
Report: Add Comparison tables
- DPDK: 2n-tx2, 3n-tsh
- VPP: 2n-aws, 3n-aws
Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 24 Jan 2022 15:13:23 +0000 (16:13 +0100)]
Trending: Add aws
Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 21 Jan 2022 13:11:13 +0000 (14:11 +0100)]
feat(core): Add ICX
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
Tibor Frank [Mon, 24 Jan 2022 13:31:40 +0000 (14:31 +0100)]
Report: Configure Report 2202
Change-Id: I9be8b74716b09b2395fbab95eb37877867abbc22
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 24 Jan 2022 05:25:31 +0000 (05:25 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ia9d9b107ac7c10ea058e1fc0263b0461ef73ed9e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 21 Jan 2022 11:51:39 +0000 (12:51 +0100)]
feat(ansible): Add ICX
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9
Peter Mikus [Thu, 20 Jan 2022 10:49:49 +0000 (11:49 +0100)]
feat(doc): Add ICX
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0
Peter Mikus [Wed, 19 Jan 2022 12:53:56 +0000 (13:53 +0100)]
feat(pxe): Add ICX
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I96918306e280cdefb023d24ff466be7c6eab44b6
Peter Mikus [Thu, 20 Jan 2022 09:13:26 +0000 (10:13 +0100)]
feat(ansible): Compatibility matrix bump
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79
Viliam Luc [Wed, 19 Jan 2022 14:29:23 +0000 (15:29 +0100)]
trending: fix empty regressions and progressions
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1405c5d1dbf9e137afbc5fd5d9f83ea572613ea9
Juraj Linkeš [Fri, 12 Nov 2021 13:34:52 +0000 (14:34 +0100)]
fix(vpp_device): pci address existence condition
The function get_pci_addr could check a different PCI_ADDR in case the
netdev device directory doesn't exit. Move the check so that it always
uses the proper PCI_ADDR and add a failure case when the netdev device
directory doesn't exist.
Change-Id: Ibadfea3fba34509cd3ea8f906ac5962c0f01dd17
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Peter Mikus [Wed, 19 Jan 2022 11:09:56 +0000 (12:09 +0100)]
fix(ansible): Compatibility matrix
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I298625dc75cdc6ffc168484e19ca30f02c2f46a0
Tibor Frank [Wed, 19 Jan 2022 08:36:00 +0000 (09:36 +0100)]
Trending: Add NAT44Det tests for 2n-zn2
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 14 Jan 2022 13:26:53 +0000 (14:26 +0100)]
Doc: Update anomaly methodology documentation
+ Define currently used compliance metrics (e.g. no short term change),
+ Clarify that (and why) column names in Dashboard and Alerting
are somewhat different from the ones in the methodology document.
Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 14 Jan 2022 13:25:46 +0000 (14:25 +0100)]
Trending: Unify anomaly related column names
The most recent update merged was related to alerting,
so this Change uses the new column names defined there
also in Dashboard tables and legend.
Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Viliam Luc [Fri, 17 Dec 2021 14:26:36 +0000 (15:26 +0100)]
trending: new view in regressions and progressions
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I8524319a215ff551cf67c30d0b08ddae69883f61
Vratko Polak [Mon, 17 Jan 2022 17:09:16 +0000 (18:09 +0100)]
fix(perpatch): Correct the autogen archive name
Change-Id: I82bc5cd69de82a2d6b6689cf3380f667ea905886
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Viliam Luc [Mon, 17 Jan 2022 09:45:15 +0000 (10:45 +0100)]
trending: shorten error messages
Sometimes error messages are longer than 1000 chars. This change
looks for [;, :, '] in messages between 128 and 256 character.
If it finds any of these the error message will be cut from
beggining to this character. If there's no character from the list
in error message and message is longer than 128 chars. It will
be cut from beggining to 129 character of error message
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I283f8ee8d81422235d897370dbc9508fafda6a7f
Tibor Frank [Wed, 1 Dec 2021 14:55:10 +0000 (15:55 +0100)]
Report: Add 2n-tx2 ipsec tests
- throughput
- speedup
- todo: latency
Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 17 Jan 2022 13:26:56 +0000 (13:26 +0000)]
Revert "Report: Temporarily change report specs"
This reverts commit
cd1f9904e173ecb34836b33cb551ab9b9d378e18.
Reason for revert: Not needed
Change-Id: Id0739d4fba2d2abadd8ee9954c724a54b39cd8a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 14 Jan 2022 14:02:31 +0000 (15:02 +0100)]
fix(uti): Fixing broken code part V
- UTI export breaks local execution
- disabling useless tox rules
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2f610b08f06f437e4482f291fa7b47cbb7b92984
Tibor Frank [Mon, 17 Jan 2022 10:20:13 +0000 (10:20 +0000)]
Report: Temporarily change report specs
Change-Id: Ic8724a9676c2b2c37ee4f2de4c056b770a10d5af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 17 Jan 2022 10:18:03 +0000 (10:18 +0000)]
Revert "Temporarily change report specs"
This reverts commit
cc04963a4ad9bfd8dce0e31fd41226fa35e5e5d6.
Reason for revert: Some data-sets missing.
Change-Id: Id2363c2a71c0e87ad3d3e206a09d7af3984a1f36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 17 Jan 2022 09:53:03 +0000 (09:53 +0000)]
Temporarily change report specs
- to generate tables with oper data
Change-Id: I06878713cd085d72eb3b9fef0c1aae1102dfb363
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Fri, 26 Nov 2021 10:03:05 +0000 (11:03 +0100)]
fix(IPsec): fix policy tests
Replace the hardcoded SPD inbound/outbound ranges with values derived
from test inputs.
Add the necessary routes now that the tunnel endpoints are not in the
same subnet. Also add ip neighbor entry on DUT2 for the same reason.
Also replace ipsec sa dump with show ipsec all in teardown of tests
where both SAs and SPDs are configured to improve troubleshooting.
Change-Id: I7d89a99fcf457a701c87bf6ac07364b62802677d
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Fri, 14 Jan 2022 08:43:47 +0000 (09:43 +0100)]
PAL: Fix sh-run
- do not post-process telemetry data
Change-Id: I800a99d8e92016d1fa675b18e2b2d30db4a15077
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 17 Jan 2022 05:05:05 +0000 (05:05 +0000)]
Update VPP_STABLE_VER files
Change-Id: I686383bddec601403c2fbc11d79260f9579a7470
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 14 Jan 2022 09:16:23 +0000 (10:16 +0100)]
JumpAvg: Fix string format
Change-Id: Id3975dfcca0040b799f31dcd14789d8c90993b14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Wed, 12 Jan 2022 09:12:49 +0000 (10:12 +0100)]
fix(uti): Fixing broken code part IV
Part of fixing chain
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie423ccf5a51751e605d906dd1214f5174bb364ac
Peter Mikus [Mon, 10 Jan 2022 12:19:31 +0000 (13:19 +0100)]
feat(uti): Dash demo
- displays the table with trending data downloaded from trending pages
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic0d48290105ccd846c7de9ee4d8acb78e0b72f00
Peter Mikus [Mon, 10 Jan 2022 10:03:27 +0000 (11:03 +0100)]
fix(core): Constants.py
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia5a097797b54c2e71acdcc8d72706e5540536252
Vratko Polak [Wed, 1 Dec 2021 13:45:56 +0000 (14:45 +0100)]
Doc: Tweak trend analysis document
Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 10 Jan 2022 06:15:50 +0000 (06:15 +0000)]
Update VPP_STABLE_VER files
Change-Id: I1b4b92a69a31c3a934acb6e305631eeb9152ef31
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Wed, 22 Dec 2021 13:29:53 +0000 (14:29 +0100)]
fix(uti): Fixing broken code part III
Part of fixing chain after early merge.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I06e19def003575993bc3d97c0dc7fbedd3e5ff7a
Tibor Frank [Fri, 7 Jan 2022 06:08:10 +0000 (06:08 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ic468388973a84b00bf3f62de88bf65c1f37d780f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 27 Dec 2021 06:34:02 +0000 (06:34 +0000)]
Update VPP_STABLE_VER files
Change-Id: I7a91fd0d8bbfcfffa2a4ae9c6873826b56299e22
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 23 Dec 2021 08:03:37 +0000 (08:03 +0000)]
Update VPP_STABLE_VER files
Change-Id: I2ff994b6eb9a2b87d4ea99f861a5b47b15a5d642
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Wed, 22 Dec 2021 11:38:26 +0000 (12:38 +0100)]
fix(uti): Fixing broken code part II
Part of fixing chain after early merge.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I983b3036a388656bbad91aba71cf14b503f875bd
pmikus [Wed, 22 Dec 2021 08:49:25 +0000 (09:49 +0100)]
feat(telemetry): show hardware
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0c0bf055e5963ac794f66cce9d5d45bb628facee
pmikus [Wed, 22 Dec 2021 07:24:24 +0000 (08:24 +0100)]
fix(uti): Fixing broken code part I
Part of fixing chain after early merge.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624
xinfeng zhao [Mon, 29 Nov 2021 03:59:52 +0000 (11:59 +0800)]
add 2-node ipsec hwasync cases
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I1590d438216e4c886aae03f83364837153623dbc
Juraj Linkeš [Thu, 26 Aug 2021 08:43:45 +0000 (10:43 +0200)]
ansible: match vpp device config to perf config
We're not using unsafe noiommu on perf testbeds and we should mirror
that config in vpp device.
As a side note, on arm vpp device, enabling unsafe noiommu leads to
corrupted packets, so it must be disabled at least on arm vpp device.
Also update arm vpp device kernel parameters to match perf testbeds.
Change-Id: Id3d3e8fcf71583cc04887b4180cd20561856d902
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
pmikus [Tue, 21 Dec 2021 09:34:45 +0000 (10:34 +0100)]
feat(infra): DPDK 21.11
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib52fab112d458decfecf39c77085bcd85f811eba
pmikus [Tue, 21 Dec 2021 09:23:49 +0000 (10:23 +0100)]
feat(infra): Add new compatibility matrix
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64deff93308771c2b3fc2e07fa8f2614b5e4ac9a
Juraj Linkeš [Fri, 12 Nov 2021 12:31:12 +0000 (13:31 +0100)]
ansible: add kernel pinning to vpp device
Change-Id: Ife26766e5f92ab95b537b39c25202fec6be27db3
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Viliam Luc [Thu, 16 Dec 2021 08:22:43 +0000 (09:22 +0100)]
trending: hotfix failing trending emails
Legend was showing for each job_name. When trying to fix it
we broke the cpta with I/O operation. This fixes legend
positioning and I/O operation error.
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I809daa3eabe6a728e5e183630fc7c6615dfef8bf
pmikus [Wed, 15 Dec 2021 17:07:55 +0000 (18:07 +0100)]
feat(dpdk): bump dpdk version
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia3601c7d990bfe491e2b927b1208742e506f7c43
pmikus [Wed, 15 Dec 2021 16:59:45 +0000 (17:59 +0100)]
fix(dpdk): allow
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic7f24767b60eef5ddb7cdf5f933d82930c625f5c
Vratko Polak [Wed, 15 Dec 2021 16:14:36 +0000 (17:14 +0100)]
UTI: Export results
+ Model version 1.0.0.
- Only some result types are exported.
+ MRR, NDRPDR and SOAK.
- Other result types to be added later.
+ In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
+ Sort dict keys before converting to JSON.
+ Override the order for some known keys.
+ Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
+ Info files for setup/teardown exist only temporarily.
+ The data is merged into suite.info.json file.
+ This simplifies presentation of total suite duration.
+ Define model via JSON schema:
- Just test case, suite setup/teardown/suite to be added later.
- Just info, raw to be added later.
+ Proper descriptions.
+ Json is generated from yaml.
+ This is a convenience for maintainers.
+ The officially used schema is the .json one.
+ TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
+ Include format checking.
+ Update CSIT requirements for validation dependencies.
+ This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
+ This unifies with NDRPDR to simplify schema definition.
- PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
+ Move raw outputs into test_output_raw.tar.xz.
+ Rename existing tar with suites to generated_robot_files.tar.xz.
Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 29 Nov 2021 15:17:15 +0000 (16:17 +0100)]
Tox: Add checker for CSIT model version
+ Implementation stub so checker can check already.
+ Also add documentation stub for the implemented model.
+ Checker checks also for bumps in documentation version.
- Not comparing implementation and documentation version yet.
Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 24 Nov 2021 15:53:56 +0000 (16:53 +0100)]
INFO: Remove Jan from committers
He is no longer active on the project.
Change-Id: Ic7621fb3dc4148ba41760f227e39bc52256b7463
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Viliam Luc [Wed, 15 Dec 2021 07:40:09 +0000 (08:40 +0100)]
trending: legend positioning
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc
Viliam Luc [Tue, 14 Dec 2021 13:44:27 +0000 (14:44 +0100)]
docs: small update structure fix
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib0a853f7bd8cdbb0dee747e4f601bc4e54d006e9
Viliam Luc [Tue, 14 Dec 2021 11:03:33 +0000 (12:03 +0100)]
trending: fix broken trending
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a
pmikus [Fri, 3 Dec 2021 08:53:23 +0000 (09:53 +0100)]
docs(lab): Intel Icelake
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98
Viliam Luc [Fri, 3 Dec 2021 13:54:25 +0000 (14:54 +0100)]
trending: regression and progression add info to email
adding trend in Mpps, runs for trend in #, trend change in %
+ dashboard - removed Short-Term change and added # of runs for trend
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib02d2a2224fc52b79832560241b0530aa2eaaf77
Viliam Luc [Thu, 28 Oct 2021 13:05:53 +0000 (15:05 +0200)]
doc: fixing documentation structure
When building documentation using sphinx we see ~1200 similar warnings [0]
[0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz
These warning are harmless and can be fixed later
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ac1099d38935971d47491dde905715345d3935c
Tibor Frank [Mon, 13 Dec 2021 05:49:53 +0000 (05:49 +0000)]
Update VPP_STABLE_VER files
Change-Id: I460247c30a19adb41e6c9ccd5f8c9c914791d219
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 13 Dec 2021 07:58:42 +0000 (08:58 +0100)]
Report: Hide empty latency graph(s) for 3n-icx
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 10 Dec 2021 13:57:00 +0000 (14:57 +0100)]
Report: Add Latency graphs for 3n-icx
Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 10 Dec 2021 06:54:55 +0000 (07:54 +0100)]
Report: Add 3n-icx - fixes
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 8 Dec 2021 15:52:36 +0000 (16:52 +0100)]
Report: Add 3n-icx
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 6 Dec 2021 12:54:34 +0000 (13:54 +0100)]
PLRsearch: Update docscrings
Previous code changes updated code comments, but not docstring.
Change-Id: I5be3fd07620cc97c9088efceb72c2f68ab103915
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 6 Dec 2021 06:03:25 +0000 (06:03 +0000)]
Update VPP_STABLE_VER files
Change-Id: I31046025e88ee0e7a13b8d7dd4d40574687a1bd8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 3 Dec 2021 13:20:01 +0000 (14:20 +0100)]
Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphs
Change-Id: Iec877a74701409c87f941b540494e1f313b32911
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 2 Dec 2021 13:17:15 +0000 (14:17 +0100)]
feat(AWS): Remove obsolete code
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I97bba8f2092bc0554702a3acac10594426bd79c3
Juraj Linkeš [Wed, 25 Aug 2021 11:37:17 +0000 (13:37 +0200)]
lab WIP: add new 3n-alt Arm testbed
Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>