Juraj Linkeš [Fri, 18 Dec 2020 08:28:38 +0000 (09:28 +0100)]
ansible: arm perf TG update
Update TG to shared (docker) TG and add hugepages accordingly.
Change-Id: I45ece9d1c8d6dbc3174661447ae46a7e28613313
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
pmikus [Wed, 17 Mar 2021 07:26:12 +0000 (07:26 +0000)]
FIX: ARM VPP_DEVICE executor
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2a5554884d49ab8063d84c914e447b29d79c676b
pmikus [Tue, 16 Mar 2021 20:41:48 +0000 (20:41 +0000)]
Infra: csit-sut temporary build
- Untill the issue with fdiotools will be solved
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3c2b06f37014a0571487d527447d90ceafdf52a9
pmikus [Tue, 16 Mar 2021 06:51:48 +0000 (06:51 +0000)]
Infra: Upgrade csit-dut image
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0341a1564ba510acf46bda3e24225209abef2f82
pmikus [Mon, 15 Mar 2021 19:45:04 +0000 (19:45 +0000)]
Perf: Bump T-Rex to 2.88
+ Mellanox 4.6 is not for Ubuntu 20.04
+ Mellanox for ubuntu 20.04 is 4.9+
+ T-Rex 2.86 is not for Mellanox 4.6+
+ T-Rex for Mellanox 5.2 is 2.88+
==================================
= Bump
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I902dfc2a43e6718b385e89f31a34260e09d61bd3
Vratko Polak [Mon, 15 Mar 2021 09:02:45 +0000 (10:02 +0100)]
API options: Fix case when no options are present
In that case we want to pass by returning an empty dict,
as docstring already describes.
Before this, the code failed when checking for included version.
Change-Id: Ia0d6b81a64ad0e7027ac7daf15c72ace1f6982ce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Mon, 15 Mar 2021 19:36:40 +0000 (19:36 +0000)]
Infra: Ansible Ubuntu 20.04 follow-ups
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I36a8b4a6cab976f51685df56c0dc2d95c00e248f
Tibor Frank [Mon, 15 Mar 2021 08:32:41 +0000 (09:32 +0100)]
PAL: set DEBIAN_FRONTEND=noninteractive in run_report.sh
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I30037a41019ca1071b1dad443a0d09054c09fb3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 15 Mar 2021 05:18:56 +0000 (05:18 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ic0ab23721178d8e8c7322806899bc36d33ae59ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 12 Mar 2021 11:39:37 +0000 (12:39 +0100)]
Allow IPSECSW on 2node testbeds
Change-Id: I71d72699a7fa99749e2554fcb2252f8bd86bfdfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 4 Mar 2021 11:30:07 +0000 (12:30 +0100)]
PAL: Optimize specification of elements
- plot_mrr_box_name
- plot_ndrpdr_box_name
- plot_perf_box_name
- plot_tsa_name
- plot_nf_reconf_box_name
- plot_nf_heatmap
- plot_cpta
Change-Id: I28ff2ea0e4f610e5ce48ffd083bf9a37bdc2f62d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 11 Mar 2021 08:30:44 +0000 (08:30 +0000)]
Infra: Minor ansible tweaks
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I47de0b78ed64b2426d39c5edf22ec36866609e8e
pmikus [Sun, 7 Mar 2021 08:57:13 +0000 (08:57 +0000)]
Infra: Switch csit-shim to fdiotools
+ use /u/fdiotools
+ use ubuntu 20.04
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I091e63a0d9e50de203b1527c7500b3864a616af6
pmikus [Mon, 8 Mar 2021 12:08:26 +0000 (12:08 +0000)]
Infra: Do not strict check keys in Ansible
- not until we migrate to SSH keys in ubuntu 2004
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I796f86922c672ba053d64f317cf6adb46b845cac
Vratko Polak [Tue, 9 Mar 2021 13:22:34 +0000 (14:22 +0100)]
API: Track options and version
If options are not present in .api.json file
(e.g. old PVP build), use an empty dict.
If a message is used in CSIT, check its options.
Tolerate vat_help, but print warning for others.
This aims to discover in-progress and obsolete APIs.
If .api.json version is not detected, or starts with "0.",
add a "version" item to options, so they get reported.
Change-Id: Ic5a9423157728a58f7ad306c7bd9eaef3bd92488
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tomas Alexy [Fri, 5 Mar 2021 10:15:55 +0000 (11:15 +0100)]
Infra: AWS/Azure fix OOM issues on smaller instances
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ic799f5eeaf03f34386603421c1d9282167c25aa5
pmikus [Sat, 6 Mar 2021 21:03:37 +0000 (21:03 +0000)]
Infra: Add reschedule policy
Add rechedule policy to jobs so in case of failure they will respawn
in a endless loop
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I15698d9e147644e68bec549fc53474d421b25d9a
Tibor Frank [Mon, 8 Mar 2021 05:56:28 +0000 (05:56 +0000)]
Update VPP_STABLE_VER files
Change-Id: I6ebf0bb7eb831619140a4a556f9c24b95760774e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Sat, 6 Mar 2021 19:34:41 +0000 (19:34 +0000)]
Infra: Docker DNS on Nomad hosts
+ Make the host default resolver
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifadb8901c66b65b2213878180c87370262ab22f0
pmikus [Fri, 5 Mar 2021 11:48:19 +0000 (11:48 +0000)]
Infra: Move nginx service closer to storage
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bbaa6c458e7994e964f7a07f69f9dab008a48fd
Tibor Frank [Fri, 5 Mar 2021 13:10:08 +0000 (14:10 +0100)]
PAL: repeat the download if it fails 2
Change-Id: I9bba50281bfe65f62a1cfab76364d834dc10d80c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Mar 2021 12:36:47 +0000 (13:36 +0100)]
PAL: repeat the download if it fails
Change-Id: I0a977009345ca5e46d23cc55405c6fd9b6e61c58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Fri, 5 Mar 2021 11:36:29 +0000 (11:36 +0000)]
FIX: JenkinsJob alert condition
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b996d0ed6252ed2b790656879e9068ff9c52039
Tibor Frank [Fri, 5 Mar 2021 08:00:47 +0000 (09:00 +0100)]
PAL: Fix: ignore verifying the SSL certificate
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ia39c9fcfc6240a30d48b492ec5e1451d8279c646
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Mar 2021 07:43:45 +0000 (08:43 +0100)]
PAL: download - ignore verifying the SSL certificate
- only for https://logs.nginx.service.consul/vex-yul-rot-jenkins-1
Change-Id: Ibdcc59a44d5aae331aeef22fad54c4e90b2eec6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Mar 2021 06:01:19 +0000 (07:01 +0100)]
PAL: use http instead of https for S3
Change-Id: Ie70f48142d182518d794e542052c31427d788849
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 4 Mar 2021 08:52:20 +0000 (09:52 +0100)]
PAL: Add s3_storage as the data source
Priorities for download:
1. s3_storage
2. logs.fd.io
3. docs.fd.io release
4. docs.fd.io master
5. jenkins
Change-Id: I7114715c3ec9a33acc8edf3c5c473f4eaffa639d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 4 Mar 2021 13:07:16 +0000 (13:07 +0000)]
FIX: Methodology GSO headers
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I38f8b16ced2c5cfd0ea8b2b0e767f5a73f6a7dd7
Tibor Frank [Thu, 4 Mar 2021 07:07:47 +0000 (08:07 +0100)]
Report: Hide 2c and 4c GSO tests
Change-Id: Ifab207f12b056a8c77911ed69590337cea4355af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 4 Mar 2021 06:57:55 +0000 (06:57 +0000)]
Report: GSO release notes
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I369afd2c90d68078443436402a6224fa42ca646d
pmikus [Thu, 4 Mar 2021 06:24:13 +0000 (06:24 +0000)]
FIX: Ansible storage bugs
- daily digest
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifa2dc10831fde0a101c916f2b8abd26abb93cb7f
pmikus [Wed, 3 Mar 2021 10:13:28 +0000 (10:13 +0000)]
Methodology: GSO
- Report methodology
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1726af15ab003ff6ee4411ca1ceace986d3ee42b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Tue, 2 Mar 2021 11:55:57 +0000 (12:55 +0100)]
job-specs: Update durations of jobs
- coverage
- 2n-clx
- 2n-skx
- 2n-zn2
- 2n-tx2
- 2n-dnv
- 3n-skx
- 3n-hsw
- 3n-tsh
- 3n-dnv
- iterative
- 2n-clx
- 2n-skx
- 2n-zn2
- 2n-tx2
- 2n-dnv
- 3n-skx
- 3n-hsw
- 3n-tsh
- 3n-dnv
Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Tue, 2 Mar 2021 08:02:20 +0000 (09:02 +0100)]
Job specs: add 2n-tx2 crypto mrr-daily tests
Iteratively increase coverage, but only of mrr-daily tests.
Because of time constraints (i.e. we won't have enough time to run all
of the tests), only add mrr-daily tests and not ndrpdr iterative/cov
tests. For iter tests, add the tests commented out which documents which
tests we're omitting from iter runs compared to mrr-daily.
Change-Id: I35625a1f67004473305cb752a98a962dcb825e16
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Wed, 3 Mar 2021 06:07:55 +0000 (07:07 +0100)]
job-specs: Fix ipsec scheduler
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 2 Mar 2021 16:46:44 +0000 (17:46 +0100)]
Fix: Async scheduler tests are not hw
Suite name part is correct: swasync.
This fixes the tag, from IPSECHW to IPSECSW.
Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Mon, 1 Mar 2021 08:07:04 +0000 (08:07 +0000)]
Infra: Configurable CSIT SHIM image
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I299ed8032f9210e20c304327abca3f62cd85ee81
Tibor Frank [Mon, 1 Mar 2021 05:23:18 +0000 (05:23 +0000)]
Update VPP_STABLE_VER files
Change-Id: I332decea2b783f7868e4a512d417c5c50990adae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Tue, 16 Feb 2021 12:59:59 +0000 (13:59 +0100)]
IPsec: add 2n crypto udir perf tests
Add unidirectional 2n crypto tests. Only one direction can be tested on
a 2 node topology, since we can't use the same interface for both
encrypted and unencrypted traffic. Add the following tests:
* {n}tnlsw-ip4base-int ndrpdr tests
* {n}tnlsw-1atnl-ip4base-int reconf tests
* {n}tnlswasync-scheduler-ip4base-int ndrpdr tests
Where n is the number of tunnels:
1, 4, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 for the first two
1, 2, 4, 8 for the async scheduler tests
All of these with the following ecryption-auth algorithms:
aes128gcm
aes256gcm
aes128cbc-hmac256sha
aes128cbc-hmac512sha
Also add the corresponding trex profiles:
trex-stl-2n-ethip4-ip4dst{n}-udir.py
Where n is the number of tunnels listed above. The profiles are shared
among the tests.
Change-Id: I22bb46e6ad59801581a78aa19310bee8a5293e56
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Thu, 25 Feb 2021 06:33:33 +0000 (07:33 +0100)]
Report: Configure rls2101.09
Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 25 Feb 2021 06:16:38 +0000 (07:16 +0100)]
Trending: Fix file names fro nat44 tput graphs
Change-Id: I7e722b268595e8b1de370b3dde9d2b00c566f143
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tomas Alexy [Mon, 22 Feb 2021 08:43:54 +0000 (09:43 +0100)]
Infra: Azure - file cleanup
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I8b97123711a76bf8851f6c4997e819d79364b83b
Tibor Frank [Mon, 22 Feb 2021 14:53:05 +0000 (15:53 +0100)]
job-spec: Add test suites for crypto sw scheduler engine
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 24 Feb 2021 08:41:10 +0000 (09:41 +0100)]
Trending: Add nat44-tput tests
Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 23 Feb 2021 10:57:27 +0000 (11:57 +0100)]
Report: Set .08 revision, fix GSO graphs
Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 22 Feb 2021 13:43:46 +0000 (14:43 +0100)]
Ipsec: Always generate ikey
Some tests use a crypto algorithm with no integrity algorithm.
Generate empty binary strings as fake integrity keys
to keep return values of low level methods consistent.
+ Add return_keys argument to avoid returning long lists.
+ Improve various docstrings.
Change-Id: Idae1877bdde32d194ce4e3bb3053c8dba39d377a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Mon, 22 Feb 2021 14:23:26 +0000 (14:23 +0000)]
ietf: renamed mlrsearch to bmwg adopted draft
Change-Id: I86401078e63c01a88b606f27bfbbd17491de99fd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Mon, 22 Feb 2021 06:42:26 +0000 (06:42 +0000)]
Update VPP_STABLE_VER files
Change-Id: I3058879ed54a686eb596b2822ff943568d0d5405
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Mon, 22 Feb 2021 08:56:42 +0000 (09:56 +0100)]
Job specs: add 2n-tx2 memif tests
Iteratively increase coverage.
Change-Id: Ia506232e68db70608b415003a031661b73023c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Fri, 19 Feb 2021 13:07:29 +0000 (14:07 +0100)]
Report: Add gso tests
Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Yulong Pei [Thu, 19 Nov 2020 20:56:18 +0000 (13:56 -0700)]
Add test suites for crypto sw scheduler engine
This patch is to add test suites for vpp plugin crypto_sw_scheduler,
IPsec sync mode is to do crypto and packet forward work in same worker cores,
crypto_sw_scheduler can schedule crypto work to other async crypto cores to
improve whole crypto processing capability.
This test suites configure fixed 1 rx queues per port, then measure IPsec
performance with 1, 2, 3 crypto cores.
This patchset include 1, 2, 4, 8 ipsec tunnels test cases.
+Vratko help to change to count total physical cores instead of previous only
count crypto cores in test cases.
Change-Id: I0e67182e3d13273890a23703d838101900e25126
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
pmikus [Fri, 19 Feb 2021 13:31:51 +0000 (13:31 +0000)]
FIX: Use x710 for gso tests
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
pmikus [Fri, 19 Feb 2021 12:51:16 +0000 (12:51 +0000)]
FIX: Naming convention compliance
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
Vratko Polak [Wed, 17 Feb 2021 19:04:36 +0000 (20:04 +0100)]
API: Use newer messages
The mesages are the newest present in last common ancestor
of master and rls2101 (so not yet ipsec_sad_entry_add_del_v3).
Added a TODO for the RDMA create improvement,
to be implemented in a separate change.
Change-Id: I94bcd2f1bc109fb995c4dd6df44f8928865634f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Fri, 19 Feb 2021 11:40:52 +0000 (11:40 +0000)]
Performance: Add GSO tests to report execution
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
pmikus [Mon, 15 Feb 2021 16:16:31 +0000 (16:16 +0000)]
Infra: Ansible Ubuntu Focal
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc
pmikus [Thu, 18 Feb 2021 14:52:31 +0000 (14:52 +0000)]
Framework: GSO test
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad
Tomas Alexy [Fri, 19 Feb 2021 09:10:18 +0000 (10:10 +0100)]
Infra: AWS deployment - minor fixes
Bump aws provider to 3.28
Code readability improvements
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Iaa966f2795f228e31e90acf27ca9999a730a87f0
Tomas Alexy [Thu, 28 Jan 2021 07:59:22 +0000 (08:59 +0100)]
Infra: Fix AWS deployment
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910
pmikus [Thu, 18 Feb 2021 09:56:27 +0000 (09:56 +0000)]
Framework: SciPy upgrade
+ 1.5.4 to solve python3.8 dependency.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb
pmikus [Thu, 18 Feb 2021 10:02:55 +0000 (10:02 +0000)]
Framework: Qemu 4.2 compatibility fix
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d
pmikus [Wed, 17 Feb 2021 14:27:12 +0000 (14:27 +0000)]
PAPI: Python 3.8 compatibility
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4
pmikus [Wed, 10 Feb 2021 08:14:40 +0000 (08:14 +0000)]
Infra: Ansible docker images cleanup
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0
Tibor Frank [Wed, 17 Feb 2021 06:11:08 +0000 (07:11 +0100)]
Report: Add data
Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Tue, 16 Feb 2021 18:44:21 +0000 (18:44 +0000)]
report: fixed typo AMD 2n-tx2 to Arm
Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Fri, 14 Feb 2020 13:03:43 +0000 (13:03 +0000)]
Infra: Ansible 2.10
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997
Vratko Polak [Tue, 16 Feb 2021 09:33:15 +0000 (10:33 +0100)]
RCA: Link to NAT44ed performance regression bug
Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 16 Feb 2021 08:43:47 +0000 (09:43 +0100)]
Report: Add data
Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 15 Feb 2021 10:51:04 +0000 (11:51 +0100)]
Report: Add comp tables for 2n-clx with mellanox NIC
Change-Id: I64f1821877f749cfb44b886b4760faba577a2014
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 15 Feb 2021 16:18:26 +0000 (17:18 +0100)]
Report: Add framework speedup to notes
Change-Id: If01c977a48bb64c53608f6b937a715fc11000446
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 15 Feb 2021 09:33:59 +0000 (10:33 +0100)]
Release notes: Tput tests and jumbo ipsec
+ Also randomized profiles.
Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
1b6c4949b794b0efd091f101ff450a04944c21ba)
Tibor Frank [Mon, 15 Feb 2021 09:57:15 +0000 (10:57 +0100)]
Report: Add 2n-clx cx556a Latency graphs
Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 15 Feb 2021 05:21:11 +0000 (05:21 +0000)]
Update VPP_STABLE_VER files
Change-Id: I7baa8931325b16363b7d95c1bc17d82f75a109d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 12 Feb 2021 13:17:23 +0000 (14:17 +0100)]
Report: Fix spec for Latency by percentile: 2n-clx MLX
Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 12 Feb 2021 12:56:53 +0000 (13:56 +0100)]
Report: re-group RND tests
Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 9 Feb 2021 16:16:21 +0000 (17:16 +0100)]
Methodology: Added packet flow ordering
Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Thu, 11 Feb 2021 11:51:34 +0000 (12:51 +0100)]
Report: Add data
Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 11 Feb 2021 12:01:01 +0000 (13:01 +0100)]
Job specs: Add -tput tests to iterative
- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
+ Because ip4base is stateless.
+ So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.
Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 11 Feb 2021 09:04:07 +0000 (10:04 +0100)]
Report: Add 2n-clx Mellanox tests and graphs
Change-Id: Ib947d47b31138ac816acefee03429d454511dd05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Wed, 10 Feb 2021 13:46:46 +0000 (14:46 +0100)]
Report: vpp device i40e known issue
Add the i40e PF/VF race condition known issue to the known issues list.
Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Wed, 10 Feb 2021 12:12:05 +0000 (13:12 +0100)]
Report: Add data
Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 9 Feb 2021 17:18:12 +0000 (18:18 +0100)]
Methodology: Add NAT44ed tput tests
Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 10 Feb 2021 10:35:45 +0000 (11:35 +0100)]
Report: Small fixes
Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Wed, 10 Feb 2021 09:39:28 +0000 (09:39 +0000)]
FIX: Hide slack url
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If965c0d4ff52d96c407cf83b642119c321cc25fc
pmikus [Fri, 5 Feb 2021 14:51:43 +0000 (14:51 +0000)]
Infra: JenkinsJobHealthExporter
- Integration of Jenkins Job checker
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I822039cb64a3a352b49314ddab7c6099af3fe644
pmikus [Mon, 8 Feb 2021 11:39:24 +0000 (11:39 +0000)]
Report: Update release note section
- Infra update
- Cleanup
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35
Tibor Frank [Wed, 10 Feb 2021 06:24:07 +0000 (07:24 +0100)]
Report: Add data
Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 9 Feb 2021 14:08:08 +0000 (15:08 +0100)]
Report: Hide nat44 tput tests
Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 9 Feb 2021 10:30:58 +0000 (11:30 +0100)]
Report: Add latency graphs for NAT44 tput tests
Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 9 Feb 2021 06:57:19 +0000 (07:57 +0100)]
Report: Add NAT44 tput tests
Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Wed, 3 Feb 2021 14:37:01 +0000 (14:37 +0000)]
report: Update packet latency methodology
Change-Id: I0378e96c6f64a1dd035d56465710b82f64dc4d32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
pmikus [Mon, 8 Feb 2021 11:43:51 +0000 (11:43 +0000)]
FIX: Nic selection
- Buggy unnoticed for quite some time
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa
Vratko Polak [Mon, 8 Feb 2021 10:31:57 +0000 (11:31 +0100)]
Latency graphs: Do not hardcode x range
+ Compute it from PERCENTILE_MAX.
+ Use slightly higher PERCENTILE_MAX to avoid rounding errors.
+ Add a comment why slightly higher value is needed.
Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 8 Feb 2021 09:05:10 +0000 (10:05 +0100)]
job-spec: fix report_coverage/2n-tx2/l2-04.md
- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by
eth-l2bdbasemaclrn-macip-iacl50sl-10kflows
Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 8 Feb 2021 08:53:25 +0000 (08:53 +0000)]
Update VPP_STABLE_VER files
Change-Id: I3fbe46788e8b3b5701134e842b4db4583d842214
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Tue, 2 Feb 2021 12:00:21 +0000 (12:00 +0000)]
report: add 2n-tx2 phy testbed diagram and update description
Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Fri, 5 Feb 2021 15:14:27 +0000 (16:14 +0100)]
Traffic generator: Force ramp-up in next test
The behavior was already documented, just not implemented properly.
Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 8 Feb 2021 08:41:43 +0000 (09:41 +0100)]
Report: Add data
Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Feb 2021 19:36:00 +0000 (20:36 +0100)]
Report: Add data
Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Feb 2021 19:19:04 +0000 (19:19 +0000)]
Revert "Job specs: Add -tput tests to iterative"
This reverts commit
7e70ee38f1debce33df1547c76f22c3fea7887c5.
Reason for revert: Faulty tests, those which are running
take too much time
Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909
Signed-off-by: Tibor Frank <tifrank@cisco.com>