Tibor Frank [Mon, 15 Mar 2021 05:18:56 +0000 (05:18 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ic0ab23721178d8e8c7322806899bc36d33ae59ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 12 Mar 2021 11:39:37 +0000 (12:39 +0100)]
Allow IPSECSW on 2node testbeds
Change-Id: I71d72699a7fa99749e2554fcb2252f8bd86bfdfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 4 Mar 2021 11:30:07 +0000 (12:30 +0100)]
PAL: Optimize specification of elements
- plot_mrr_box_name
- plot_ndrpdr_box_name
- plot_perf_box_name
- plot_tsa_name
- plot_nf_reconf_box_name
- plot_nf_heatmap
- plot_cpta
Change-Id: I28ff2ea0e4f610e5ce48ffd083bf9a37bdc2f62d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 11 Mar 2021 08:30:44 +0000 (08:30 +0000)]
Infra: Minor ansible tweaks
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I47de0b78ed64b2426d39c5edf22ec36866609e8e
pmikus [Sun, 7 Mar 2021 08:57:13 +0000 (08:57 +0000)]
Infra: Switch csit-shim to fdiotools
+ use /u/fdiotools
+ use ubuntu 20.04
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I091e63a0d9e50de203b1527c7500b3864a616af6
pmikus [Mon, 8 Mar 2021 12:08:26 +0000 (12:08 +0000)]
Infra: Do not strict check keys in Ansible
- not until we migrate to SSH keys in ubuntu 2004
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I796f86922c672ba053d64f317cf6adb46b845cac
Vratko Polak [Tue, 9 Mar 2021 13:22:34 +0000 (14:22 +0100)]
API: Track options and version
If options are not present in .api.json file
(e.g. old PVP build), use an empty dict.
If a message is used in CSIT, check its options.
Tolerate vat_help, but print warning for others.
This aims to discover in-progress and obsolete APIs.
If .api.json version is not detected, or starts with "0.",
add a "version" item to options, so they get reported.
Change-Id: Ic5a9423157728a58f7ad306c7bd9eaef3bd92488
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tomas Alexy [Fri, 5 Mar 2021 10:15:55 +0000 (11:15 +0100)]
Infra: AWS/Azure fix OOM issues on smaller instances
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ic799f5eeaf03f34386603421c1d9282167c25aa5
pmikus [Sat, 6 Mar 2021 21:03:37 +0000 (21:03 +0000)]
Infra: Add reschedule policy
Add rechedule policy to jobs so in case of failure they will respawn
in a endless loop
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I15698d9e147644e68bec549fc53474d421b25d9a
Tibor Frank [Mon, 8 Mar 2021 05:56:28 +0000 (05:56 +0000)]
Update VPP_STABLE_VER files
Change-Id: I6ebf0bb7eb831619140a4a556f9c24b95760774e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Sat, 6 Mar 2021 19:34:41 +0000 (19:34 +0000)]
Infra: Docker DNS on Nomad hosts
+ Make the host default resolver
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifadb8901c66b65b2213878180c87370262ab22f0
pmikus [Fri, 5 Mar 2021 11:48:19 +0000 (11:48 +0000)]
Infra: Move nginx service closer to storage
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bbaa6c458e7994e964f7a07f69f9dab008a48fd
Tibor Frank [Fri, 5 Mar 2021 13:10:08 +0000 (14:10 +0100)]
PAL: repeat the download if it fails 2
Change-Id: I9bba50281bfe65f62a1cfab76364d834dc10d80c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Mar 2021 12:36:47 +0000 (13:36 +0100)]
PAL: repeat the download if it fails
Change-Id: I0a977009345ca5e46d23cc55405c6fd9b6e61c58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Fri, 5 Mar 2021 11:36:29 +0000 (11:36 +0000)]
FIX: JenkinsJob alert condition
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b996d0ed6252ed2b790656879e9068ff9c52039
Tibor Frank [Fri, 5 Mar 2021 08:00:47 +0000 (09:00 +0100)]
PAL: Fix: ignore verifying the SSL certificate
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ia39c9fcfc6240a30d48b492ec5e1451d8279c646
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Mar 2021 07:43:45 +0000 (08:43 +0100)]
PAL: download - ignore verifying the SSL certificate
- only for https://logs.nginx.service.consul/vex-yul-rot-jenkins-1
Change-Id: Ibdcc59a44d5aae331aeef22fad54c4e90b2eec6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Mar 2021 06:01:19 +0000 (07:01 +0100)]
PAL: use http instead of https for S3
Change-Id: Ie70f48142d182518d794e542052c31427d788849
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 4 Mar 2021 08:52:20 +0000 (09:52 +0100)]
PAL: Add s3_storage as the data source
Priorities for download:
1. s3_storage
2. logs.fd.io
3. docs.fd.io release
4. docs.fd.io master
5. jenkins
Change-Id: I7114715c3ec9a33acc8edf3c5c473f4eaffa639d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 4 Mar 2021 13:07:16 +0000 (13:07 +0000)]
FIX: Methodology GSO headers
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I38f8b16ced2c5cfd0ea8b2b0e767f5a73f6a7dd7
Tibor Frank [Thu, 4 Mar 2021 07:07:47 +0000 (08:07 +0100)]
Report: Hide 2c and 4c GSO tests
Change-Id: Ifab207f12b056a8c77911ed69590337cea4355af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 4 Mar 2021 06:57:55 +0000 (06:57 +0000)]
Report: GSO release notes
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I369afd2c90d68078443436402a6224fa42ca646d
pmikus [Thu, 4 Mar 2021 06:24:13 +0000 (06:24 +0000)]
FIX: Ansible storage bugs
- daily digest
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifa2dc10831fde0a101c916f2b8abd26abb93cb7f
pmikus [Wed, 3 Mar 2021 10:13:28 +0000 (10:13 +0000)]
Methodology: GSO
- Report methodology
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1726af15ab003ff6ee4411ca1ceace986d3ee42b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Tue, 2 Mar 2021 11:55:57 +0000 (12:55 +0100)]
job-specs: Update durations of jobs
- coverage
- 2n-clx
- 2n-skx
- 2n-zn2
- 2n-tx2
- 2n-dnv
- 3n-skx
- 3n-hsw
- 3n-tsh
- 3n-dnv
- iterative
- 2n-clx
- 2n-skx
- 2n-zn2
- 2n-tx2
- 2n-dnv
- 3n-skx
- 3n-hsw
- 3n-tsh
- 3n-dnv
Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Tue, 2 Mar 2021 08:02:20 +0000 (09:02 +0100)]
Job specs: add 2n-tx2 crypto mrr-daily tests
Iteratively increase coverage, but only of mrr-daily tests.
Because of time constraints (i.e. we won't have enough time to run all
of the tests), only add mrr-daily tests and not ndrpdr iterative/cov
tests. For iter tests, add the tests commented out which documents which
tests we're omitting from iter runs compared to mrr-daily.
Change-Id: I35625a1f67004473305cb752a98a962dcb825e16
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Wed, 3 Mar 2021 06:07:55 +0000 (07:07 +0100)]
job-specs: Fix ipsec scheduler
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 2 Mar 2021 16:46:44 +0000 (17:46 +0100)]
Fix: Async scheduler tests are not hw
Suite name part is correct: swasync.
This fixes the tag, from IPSECHW to IPSECSW.
Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Mon, 1 Mar 2021 08:07:04 +0000 (08:07 +0000)]
Infra: Configurable CSIT SHIM image
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I299ed8032f9210e20c304327abca3f62cd85ee81
Tibor Frank [Mon, 1 Mar 2021 05:23:18 +0000 (05:23 +0000)]
Update VPP_STABLE_VER files
Change-Id: I332decea2b783f7868e4a512d417c5c50990adae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Tue, 16 Feb 2021 12:59:59 +0000 (13:59 +0100)]
IPsec: add 2n crypto udir perf tests
Add unidirectional 2n crypto tests. Only one direction can be tested on
a 2 node topology, since we can't use the same interface for both
encrypted and unencrypted traffic. Add the following tests:
* {n}tnlsw-ip4base-int ndrpdr tests
* {n}tnlsw-1atnl-ip4base-int reconf tests
* {n}tnlswasync-scheduler-ip4base-int ndrpdr tests
Where n is the number of tunnels:
1, 4, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 for the first two
1, 2, 4, 8 for the async scheduler tests
All of these with the following ecryption-auth algorithms:
aes128gcm
aes256gcm
aes128cbc-hmac256sha
aes128cbc-hmac512sha
Also add the corresponding trex profiles:
trex-stl-2n-ethip4-ip4dst{n}-udir.py
Where n is the number of tunnels listed above. The profiles are shared
among the tests.
Change-Id: I22bb46e6ad59801581a78aa19310bee8a5293e56
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Thu, 25 Feb 2021 06:33:33 +0000 (07:33 +0100)]
Report: Configure rls2101.09
Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 25 Feb 2021 06:16:38 +0000 (07:16 +0100)]
Trending: Fix file names fro nat44 tput graphs
Change-Id: I7e722b268595e8b1de370b3dde9d2b00c566f143
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tomas Alexy [Mon, 22 Feb 2021 08:43:54 +0000 (09:43 +0100)]
Infra: Azure - file cleanup
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I8b97123711a76bf8851f6c4997e819d79364b83b
Tibor Frank [Mon, 22 Feb 2021 14:53:05 +0000 (15:53 +0100)]
job-spec: Add test suites for crypto sw scheduler engine
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 24 Feb 2021 08:41:10 +0000 (09:41 +0100)]
Trending: Add nat44-tput tests
Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 23 Feb 2021 10:57:27 +0000 (11:57 +0100)]
Report: Set .08 revision, fix GSO graphs
Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 22 Feb 2021 13:43:46 +0000 (14:43 +0100)]
Ipsec: Always generate ikey
Some tests use a crypto algorithm with no integrity algorithm.
Generate empty binary strings as fake integrity keys
to keep return values of low level methods consistent.
+ Add return_keys argument to avoid returning long lists.
+ Improve various docstrings.
Change-Id: Idae1877bdde32d194ce4e3bb3053c8dba39d377a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Mon, 22 Feb 2021 14:23:26 +0000 (14:23 +0000)]
ietf: renamed mlrsearch to bmwg adopted draft
Change-Id: I86401078e63c01a88b606f27bfbbd17491de99fd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Mon, 22 Feb 2021 06:42:26 +0000 (06:42 +0000)]
Update VPP_STABLE_VER files
Change-Id: I3058879ed54a686eb596b2822ff943568d0d5405
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Mon, 22 Feb 2021 08:56:42 +0000 (09:56 +0100)]
Job specs: add 2n-tx2 memif tests
Iteratively increase coverage.
Change-Id: Ia506232e68db70608b415003a031661b73023c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Fri, 19 Feb 2021 13:07:29 +0000 (14:07 +0100)]
Report: Add gso tests
Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Yulong Pei [Thu, 19 Nov 2020 20:56:18 +0000 (13:56 -0700)]
Add test suites for crypto sw scheduler engine
This patch is to add test suites for vpp plugin crypto_sw_scheduler,
IPsec sync mode is to do crypto and packet forward work in same worker cores,
crypto_sw_scheduler can schedule crypto work to other async crypto cores to
improve whole crypto processing capability.
This test suites configure fixed 1 rx queues per port, then measure IPsec
performance with 1, 2, 3 crypto cores.
This patchset include 1, 2, 4, 8 ipsec tunnels test cases.
+Vratko help to change to count total physical cores instead of previous only
count crypto cores in test cases.
Change-Id: I0e67182e3d13273890a23703d838101900e25126
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
pmikus [Fri, 19 Feb 2021 13:31:51 +0000 (13:31 +0000)]
FIX: Use x710 for gso tests
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
pmikus [Fri, 19 Feb 2021 12:51:16 +0000 (12:51 +0000)]
FIX: Naming convention compliance
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
Vratko Polak [Wed, 17 Feb 2021 19:04:36 +0000 (20:04 +0100)]
API: Use newer messages
The mesages are the newest present in last common ancestor
of master and rls2101 (so not yet ipsec_sad_entry_add_del_v3).
Added a TODO for the RDMA create improvement,
to be implemented in a separate change.
Change-Id: I94bcd2f1bc109fb995c4dd6df44f8928865634f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Fri, 19 Feb 2021 11:40:52 +0000 (11:40 +0000)]
Performance: Add GSO tests to report execution
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
pmikus [Mon, 15 Feb 2021 16:16:31 +0000 (16:16 +0000)]
Infra: Ansible Ubuntu Focal
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc
pmikus [Thu, 18 Feb 2021 14:52:31 +0000 (14:52 +0000)]
Framework: GSO test
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad
Tomas Alexy [Fri, 19 Feb 2021 09:10:18 +0000 (10:10 +0100)]
Infra: AWS deployment - minor fixes
Bump aws provider to 3.28
Code readability improvements
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Iaa966f2795f228e31e90acf27ca9999a730a87f0
Tomas Alexy [Thu, 28 Jan 2021 07:59:22 +0000 (08:59 +0100)]
Infra: Fix AWS deployment
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910
pmikus [Thu, 18 Feb 2021 09:56:27 +0000 (09:56 +0000)]
Framework: SciPy upgrade
+ 1.5.4 to solve python3.8 dependency.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb
pmikus [Thu, 18 Feb 2021 10:02:55 +0000 (10:02 +0000)]
Framework: Qemu 4.2 compatibility fix
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d
pmikus [Wed, 17 Feb 2021 14:27:12 +0000 (14:27 +0000)]
PAPI: Python 3.8 compatibility
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4
pmikus [Wed, 10 Feb 2021 08:14:40 +0000 (08:14 +0000)]
Infra: Ansible docker images cleanup
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0
Tibor Frank [Wed, 17 Feb 2021 06:11:08 +0000 (07:11 +0100)]
Report: Add data
Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Tue, 16 Feb 2021 18:44:21 +0000 (18:44 +0000)]
report: fixed typo AMD 2n-tx2 to Arm
Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Fri, 14 Feb 2020 13:03:43 +0000 (13:03 +0000)]
Infra: Ansible 2.10
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997
Vratko Polak [Tue, 16 Feb 2021 09:33:15 +0000 (10:33 +0100)]
RCA: Link to NAT44ed performance regression bug
Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 16 Feb 2021 08:43:47 +0000 (09:43 +0100)]
Report: Add data
Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 15 Feb 2021 10:51:04 +0000 (11:51 +0100)]
Report: Add comp tables for 2n-clx with mellanox NIC
Change-Id: I64f1821877f749cfb44b886b4760faba577a2014
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 15 Feb 2021 16:18:26 +0000 (17:18 +0100)]
Report: Add framework speedup to notes
Change-Id: If01c977a48bb64c53608f6b937a715fc11000446
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 15 Feb 2021 09:33:59 +0000 (10:33 +0100)]
Release notes: Tput tests and jumbo ipsec
+ Also randomized profiles.
Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
1b6c4949b794b0efd091f101ff450a04944c21ba)
Tibor Frank [Mon, 15 Feb 2021 09:57:15 +0000 (10:57 +0100)]
Report: Add 2n-clx cx556a Latency graphs
Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 15 Feb 2021 05:21:11 +0000 (05:21 +0000)]
Update VPP_STABLE_VER files
Change-Id: I7baa8931325b16363b7d95c1bc17d82f75a109d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 12 Feb 2021 13:17:23 +0000 (14:17 +0100)]
Report: Fix spec for Latency by percentile: 2n-clx MLX
Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 12 Feb 2021 12:56:53 +0000 (13:56 +0100)]
Report: re-group RND tests
Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 9 Feb 2021 16:16:21 +0000 (17:16 +0100)]
Methodology: Added packet flow ordering
Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Thu, 11 Feb 2021 11:51:34 +0000 (12:51 +0100)]
Report: Add data
Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 11 Feb 2021 12:01:01 +0000 (13:01 +0100)]
Job specs: Add -tput tests to iterative
- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
+ Because ip4base is stateless.
+ So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.
Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 11 Feb 2021 09:04:07 +0000 (10:04 +0100)]
Report: Add 2n-clx Mellanox tests and graphs
Change-Id: Ib947d47b31138ac816acefee03429d454511dd05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Wed, 10 Feb 2021 13:46:46 +0000 (14:46 +0100)]
Report: vpp device i40e known issue
Add the i40e PF/VF race condition known issue to the known issues list.
Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Wed, 10 Feb 2021 12:12:05 +0000 (13:12 +0100)]
Report: Add data
Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 9 Feb 2021 17:18:12 +0000 (18:18 +0100)]
Methodology: Add NAT44ed tput tests
Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 10 Feb 2021 10:35:45 +0000 (11:35 +0100)]
Report: Small fixes
Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Wed, 10 Feb 2021 09:39:28 +0000 (09:39 +0000)]
FIX: Hide slack url
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If965c0d4ff52d96c407cf83b642119c321cc25fc
pmikus [Fri, 5 Feb 2021 14:51:43 +0000 (14:51 +0000)]
Infra: JenkinsJobHealthExporter
- Integration of Jenkins Job checker
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I822039cb64a3a352b49314ddab7c6099af3fe644
pmikus [Mon, 8 Feb 2021 11:39:24 +0000 (11:39 +0000)]
Report: Update release note section
- Infra update
- Cleanup
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35
Tibor Frank [Wed, 10 Feb 2021 06:24:07 +0000 (07:24 +0100)]
Report: Add data
Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 9 Feb 2021 14:08:08 +0000 (15:08 +0100)]
Report: Hide nat44 tput tests
Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 9 Feb 2021 10:30:58 +0000 (11:30 +0100)]
Report: Add latency graphs for NAT44 tput tests
Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 9 Feb 2021 06:57:19 +0000 (07:57 +0100)]
Report: Add NAT44 tput tests
Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Wed, 3 Feb 2021 14:37:01 +0000 (14:37 +0000)]
report: Update packet latency methodology
Change-Id: I0378e96c6f64a1dd035d56465710b82f64dc4d32
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
pmikus [Mon, 8 Feb 2021 11:43:51 +0000 (11:43 +0000)]
FIX: Nic selection
- Buggy unnoticed for quite some time
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa
Vratko Polak [Mon, 8 Feb 2021 10:31:57 +0000 (11:31 +0100)]
Latency graphs: Do not hardcode x range
+ Compute it from PERCENTILE_MAX.
+ Use slightly higher PERCENTILE_MAX to avoid rounding errors.
+ Add a comment why slightly higher value is needed.
Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 8 Feb 2021 09:05:10 +0000 (10:05 +0100)]
job-spec: fix report_coverage/2n-tx2/l2-04.md
- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by
eth-l2bdbasemaclrn-macip-iacl50sl-10kflows
Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 8 Feb 2021 08:53:25 +0000 (08:53 +0000)]
Update VPP_STABLE_VER files
Change-Id: I3fbe46788e8b3b5701134e842b4db4583d842214
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Tue, 2 Feb 2021 12:00:21 +0000 (12:00 +0000)]
report: add 2n-tx2 phy testbed diagram and update description
Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Fri, 5 Feb 2021 15:14:27 +0000 (16:14 +0100)]
Traffic generator: Force ramp-up in next test
The behavior was already documented, just not implemented properly.
Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 8 Feb 2021 08:41:43 +0000 (09:41 +0100)]
Report: Add data
Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Feb 2021 19:36:00 +0000 (20:36 +0100)]
Report: Add data
Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Feb 2021 19:19:04 +0000 (19:19 +0000)]
Revert "Job specs: Add -tput tests to iterative"
This reverts commit
7e70ee38f1debce33df1547c76f22c3fea7887c5.
Reason for revert: Faulty tests, those which are running
take too much time
Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 5 Feb 2021 12:48:06 +0000 (13:48 +0100)]
Job specs: Add -tput tests to iterative
- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
+ Because ip4base is stateless.
+ So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.
Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 5 Feb 2021 13:28:06 +0000 (14:28 +0100)]
Report: Various fixes
Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 5 Feb 2021 10:46:40 +0000 (11:46 +0100)]
NAT44ed: Add pure throuhput bidir tests
+ With ramp-up, without reset, with session verification.
+ Uses the same profile as pps tests.
+ Ramp up duration is not specified, as duration is computed.
+ Timeout tracking with automated ramp-up.
+ Correct computation of next duration.
+ Checking both early and late sessions.
+ No loss measurement also acts as a ramp-up.
+ Return ReceiveRateMeasurement from send_traffic_on_tg_internal,
as that is needed for detecting whether trial is ok as ramp up.
- Udp needs quite low ramp-up rate after recent regression.
- Max scale has higher rate (so failing) to avoid session timeouts.
+ Bump copyright year.
Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 5 Feb 2021 09:44:24 +0000 (10:44 +0100)]
Report: Set range of x-axis for latency graphs, add data
Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Feb 2021 08:28:48 +0000 (09:28 +0100)]
Trending: RND tests
Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 5 Feb 2021 07:42:12 +0000 (08:42 +0100)]
Report: Add data
Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 4 Feb 2021 13:03:12 +0000 (13:03 +0000)]
Infra: Move probes under ansible instead of terraform
+ More stable probe handling.
+ Naming cleanup due to errors.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3bb1237af20636919f869f2eee53597202d00792
Tibor Frank [Thu, 4 Feb 2021 13:19:00 +0000 (14:19 +0100)]
Report: Set the range of x-axis fro Latency graphs
Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>