Jan Gelety [Wed, 22 Jan 2020 15:38:39 +0000 (16:38 +0100)]
FIX: Detection if l2fwd/l3fwd is up/down
Change-Id: Ide5de222e8314a0ea0be59f9a478f8d59147f722
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
b968e370fe2737233f138ffd67a5bff75a6de091)
Tibor Frank [Mon, 10 Feb 2020 13:21:36 +0000 (14:21 +0100)]
Report: Add data
Change-Id: I58831fb795cd300d31306d040e8239c2a1b9a7fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
c34b584bec20a3239b204d9bb4e8b8e5ccfad6f2)
Tibor Frank [Mon, 10 Feb 2020 12:48:50 +0000 (13:48 +0100)]
Report: Add data
Change-Id: I57b4f1cdb6d4467f8a93b466a5173e00d493b9a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
704f231f80444be4b28eb565465c8ad76ab55be6)
Tibor Frank [Fri, 7 Feb 2020 13:07:07 +0000 (14:07 +0100)]
PAL: Latency by percentile
Change-Id: I413271f4b1fad801463fb7f8f16112aedc0d058b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
c1335b81c08aeeb5d45af39d45ce02dc1a7d4235)
Jan Gelety [Wed, 22 Jan 2020 09:29:00 +0000 (10:29 +0100)]
FIX: policer
Change-Id: I23910b74c8720245b43067ac8c68880291b4b1c2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
d7e14a0a93e7e06047daeaf6a5575f227aeb925a)
Peter Mikus [Fri, 7 Feb 2020 12:33:20 +0000 (12:33 +0000)]
FIX: Detection if testpmd/l3fwd is up
Change-Id: Ibd2e038332fe2bdf0e5bd69bf7376a2a7357e901
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit
b9ffc1b5eb6bf80c95171d0496cef07d70bcfa5c)
Tibor Frank [Fri, 7 Feb 2020 12:13:16 +0000 (13:13 +0100)]
PAL: Process NDRPDR test msg
Change-Id: I4098fa52cfa2feb2fca507ffe203c2a325c1d140
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
707562eb45f21c89014c667aaef788d869f9b215)
Tibor Frank [Fri, 7 Feb 2020 09:40:01 +0000 (10:40 +0100)]
Report: Configure 2001-07
Change-Id: I6323a3cf86bdebb6f1dc41a10fc840b5c80fab01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
2dd05d1daafcc5a4985a9593350aa2c0b290efa4)
Tibor Frank [Tue, 4 Feb 2020 08:49:54 +0000 (09:49 +0100)]
PAL: Operational data
Change-Id: I43eb12117ddc9b6df447f0303881bf7ec6153900
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
2c06090c7b919783a91d3ca9ca8c8319b5c35b07)
Tibor Frank [Thu, 30 Jan 2020 08:10:38 +0000 (09:10 +0100)]
Report: Placeholder for LD preload tests
- methodology
- test results
Change-Id: I0d102875045ab295d9b44fa7bc328f2a728803d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit
107438e93a51eefc61dc171cfa9b959007ccc739)
Jan Gelety [Tue, 21 Jan 2020 23:14:11 +0000 (00:14 +0100)]
FIX: use correct xRyC tags in nfv_density chain_ipsec tests
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I2cc27c012faeb93ca4a302fffb0ddbe9b1fb0e9c
Tibor Frank [Wed, 5 Feb 2020 13:18:53 +0000 (14:18 +0100)]
Report: Remove data from 2n-skx TB23
Change-Id: Ibd8ccb2ebc5d158abb4fe295e8b514ab7a7c5422
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
5d8cbe573c3781663e134187def17360a4fa923e)
Tibor Frank [Wed, 5 Feb 2020 09:49:47 +0000 (10:49 +0100)]
Report: Add data
Change-Id: I58c85e6dccca28d402e6a54cf49ce5eebcdd5b1b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
d639b4d35441078219c77a887d222d26d42ebeff)
Jan Gelety [Tue, 21 Jan 2020 06:34:46 +0000 (07:34 +0100)]
FIX: nat44 scale
+ missing ip_min for vm1
Change-Id: I8a30eaa36f6e417a88a6888b70f72d74183c9141
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
630dc7475e92aaa828512930d93bda7c568bd1f0)
Peter Mikus [Thu, 30 Jan 2020 13:45:11 +0000 (13:45 +0000)]
T-Rex: CPU pinning
+ Detect NUMA
+ Pin based on numa location
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ife350f8c70e5437ac7c1413c7753f2a2f62777d9
(cherry picked from commit
6bcf4d40d83bbf026f9fd0105bebf579423c65a6)
(cherry picked from commit
6cb55db44f4c9817395d5fe5d8391c88412a6d59)
Vratko Polak [Wed, 29 Jan 2020 11:35:29 +0000 (12:35 +0100)]
Add more reconf tests, for IPsec
- Not adding nf_density tests.
- Not adding hardware ipsec tests.
- Not adding -policy- tests.
- Using old crypto_ia32_plugin.so plugin name.
+ Suitable for cherry-picking to rls2001.
Change-Id: Ibf44d6d91e2afa2320637ecd9eb69d5d5dc364aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 4 Feb 2020 10:21:57 +0000 (11:21 +0100)]
Report: Add data
Change-Id: I8377704590e7278d0faab5497b538300e26fd0ba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
70f49a035f459358bb9209d06bb50f51716a0776)
Tibor Frank [Tue, 4 Feb 2020 07:18:57 +0000 (08:18 +0100)]
Report: Remove cx556a from DPDK
Change-Id: I19f87dc6608dab684663174d541dfcee47e045da
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
c16b1af983a3408dedb3da8a568ded1b8c804d37)
Tibor Frank [Mon, 3 Feb 2020 14:58:29 +0000 (15:58 +0100)]
Report: Fix spec
Change-Id: Ia86a1542b69aa07d9d26a4aea3c5ccda6dd69862
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
f4468158296209fe591a14e95ee7e57fef9dc208)
Tibor Frank [Mon, 3 Feb 2020 13:59:46 +0000 (14:59 +0100)]
Report: Add VPP 2n-clx cx556a
Change-Id: I95e713f1e1d41eb886261b802f711fbb6ad6d27f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
8da14b3b1d12f48a405ad23cf8ef49a3f6d26b1e)
Vratko Polak [Mon, 3 Feb 2020 12:15:49 +0000 (13:15 +0100)]
Autogen: Fix typo affecting DPDK
With the typo, only the first type+nic combination is generated.
With fix, all combinations are generated.
Change-Id: Ieb2db31cebed4940b063505b70f4d12a30da489c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
7a035831fc06de7849876b782bf6f97136a39208)
Tibor Frank [Mon, 3 Feb 2020 09:21:29 +0000 (10:21 +0100)]
Report: Add DPDK 2n-clx
Change-Id: I4cd0fb5169a8ce571cce23bf8c3b9709afe8dc9b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
27fbd8171dcc2a3982274224ccb4979e56a22e87)
Dave Wallace [Wed, 15 Jan 2020 06:29:16 +0000 (06:29 +0000)]
perf: Add hoststack NSIM+LDPRELOAD+IPERF3 test suite
Change-Id: Ia7a876b1aa240676e1f2d23618c1d4e09ead14f0
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit
d79b753c1fde3cd831f60ac5cc0034f613c44b43)
Jan Gelety [Sun, 19 Jan 2020 23:13:23 +0000 (00:13 +0100)]
Use vpp 20.01-release pacakges
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Ibd1b78fd5bb9424564f27497a19176527c604be4
Tibor Frank [Wed, 29 Jan 2020 15:30:05 +0000 (16:30 +0100)]
PAL: Latency processing
Very ugly solution for now. It will be replaced by using JSON structure
for test results soon.
Change-Id: If5b63de94bf02e7fc2a518c1f6a94f42dcec9e07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
20e972ce413e727b0a3d89d04460534cb454f107)
Vratko Polak [Wed, 29 Jan 2020 14:28:16 +0000 (15:28 +0100)]
Display target_tr for ndr/pdr results
Small differences in Tx packet counts can cause
the previous way (which used transmit_rate,
computed from packets sent and nominal duration)
to report lower bounds as higher than upper bounds.
Also, reconf tests need the target (not actual) rate.
Change-Id: If5222dabd9762b8d9c2e22d875c12ad355bc6838
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
401c24914d84058d06ef9b7a4f893662dfeb0dcb)
Vratko Polak [Tue, 28 Jan 2020 14:26:01 +0000 (15:26 +0100)]
Ndrpdr: Remove unused latency measurements
+ Improve keyword Documentation.
+ Reorder measurements, higher loads first.
Change-Id: I1aeab1c8ada268422e9f421e075aff2ac9eec23f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
703d013c83c9a4ce2283f1a0c16fe1511f1144d3)
Vratko Polak [Mon, 27 Jan 2020 12:26:27 +0000 (13:26 +0100)]
Restore PDR stat run for NDRPDR
Before [0], the NDRPDR test ended with two measurements
that perform runtime stats collection, each 2 seconds long.
[0] then decreased that duration to one second,
and removed the PDR measurement.
This change re-adds the PDR measurement,
while keeping the duration at 1 second.
[0] https://gerrit.fd.io/r/c/csit/+/24427
Change-Id: I76828f11863a9e278cdd0cf60f2792d5b614ce43
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
f7699715f37ee6846bceb1fa7baf51366a683737)
Dave Wallace [Wed, 8 Jan 2020 21:14:25 +0000 (21:14 +0000)]
perf: QUIC transport hoststack test suite
Change-Id: I73f4be7ea315c7a5dcce46e1bd3034bcb0a97ee2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit
074ae9732d06f962a65d91147b55abf86b42b6d9)
Dave Wallace [Tue, 21 Jan 2020 19:02:14 +0000 (19:02 +0000)]
perf: hoststack iperf3 test tuning
Change-Id: I53425f57fe9ecef9cff2c94642cc7cb24537a961
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit
b340b5c9925b43869b91197850504760757a0bfe)
Tibor Frank [Wed, 29 Jan 2020 12:38:13 +0000 (13:38 +0100)]
Report: Fix: Add new NFV data
Change-Id: Iae3557db30c5a95cb26d2e9b5acf24df2f64e429
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
3bc72c6e268474a6bed725e5371d66f0e369ab16)
Tibor Frank [Wed, 29 Jan 2020 12:25:48 +0000 (13:25 +0100)]
Report: Add new NFV data
Change-Id: Ic5a20940466545611150cfceaed58cee702636c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
8f6b774bfb9d5728ce1b1dafc11ff1d00a05d90c)
Tibor Frank [Wed, 29 Jan 2020 07:32:00 +0000 (08:32 +0100)]
Report: Add NFV data for existing elements
Change-Id: Ib76dbf36f6eb0234f6947fc43bd6c31e12a1d8e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
33741e9e4d961c7ca805ef635982cd210a44a3b4)
Vratko Polak [Tue, 28 Jan 2020 12:20:24 +0000 (13:20 +0100)]
Ipsec: Unify first line of Local Template doc
Seeing differences when diff-ing between suites is distracting.
+ Bump copyright year, even for files with no change.
Change-Id: Iaca79647821dd8233bdbe6b0ac8b14fdb04060a8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
286a1db6861bca96155eb0c282277e225883ed54)
Vratko Polak [Tue, 28 Jan 2020 11:34:24 +0000 (12:34 +0100)]
Fix two auth_alg values
Change-Id: I0e85fc958779df3d5dbacf1ad1e3898268a832ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
0c6d1142326b6953b972733c4fa3bddf078ec802)
Vratko Polak [Tue, 28 Jan 2020 11:18:22 +0000 (12:18 +0100)]
Update overheads for IPsec CBC tests
Updated to the values as seen in packet trace.
Even if VPP creates wrongly sized packets (compared to RFCs),
the overhead should correspond to the actual packet size present,
in order to correctly prevent linerate on DUT-DUT link.
The new overhead values are 62 (256SHA) and 78 (512SHA).
The GCM value is already correct, at 54 bytes, so density tests are ok.
- The lispgpe test is not updated, as it currently fails.
We will update overhead there in (or after) 24578.
Change-Id: I5cc6920205f37ddc80e76804fabd90b67174addf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
13eec694e7a5eaeb9fe385a06d54565ea76eb974)
Vratko Polak [Fri, 24 Jan 2020 15:16:10 +0000 (16:16 +0100)]
Check interval validity in reconf tests
Without this, if the search part returns min_rate,
then reconf part reports few seconds with a small loss count.
But min_rate means there is a bug or misconfiguration,
so the tests should fail, instead of returning misleading results.
Change-Id: I566608b40ae11d6aaa3fe022a32da97901e1999c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
6ac704e7388409c6aa719e50f83d0e08ebd671a0)
Vratko Polak [Fri, 24 Jan 2020 11:22:14 +0000 (12:22 +0100)]
Perform some cleanup discovered by GPL work
+ Remove one __init__.robot file with no function.
+ Remove executable flags from traffic profiles.
+ Improve indentation in some traffic profiles.
Change-Id: I099e63069003fba788976a9470a909ccff51a88c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
ceaa2959217752716496b6257595d12cbcb0c657)
Peter Mikus [Tue, 28 Jan 2020 10:33:36 +0000 (10:33 +0000)]
FIX: dot1qip4vxlan tests
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ieb6e6010108987f99f55730149e3e4b7f1a7fc21
(cherry picked from commit
97dbe2feecc6d592db7427c4f1a72c1ac31990d1)
Tibor Frank [Tue, 28 Jan 2020 10:16:34 +0000 (11:16 +0100)]
Report: Add RC2 data
Change-Id: I29dc3e34293d8bcc940e2adc3034e32b3806c71c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
a4882cb1547e2abf424bb53f424439989fc3b6e7)
Tibor Frank [Mon, 27 Jan 2020 14:24:08 +0000 (15:24 +0100)]
PAL: Add latency by percentile graph
Change-Id: I38c03e089fd709afc848ecec55474d5c6925a58e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
6716e51e3a27cfd2850a399c9ccc2818c2038eaf)
Vratko Polak [Mon, 27 Jan 2020 13:17:24 +0000 (14:17 +0100)]
Increase min_rate for NDRPDR tests
Latency measurements break for loads less than 9 kpps per direction.
Setting min_rate to 90 kpps prevents 10% latency trial from breaking.
90 kpps should be enough for any type of test.
When some test finds a lower value, this patch will make the fail
with a message saying the loss rate at minimal load is too high
(instead of a cryptic error from 10% measurement without this patch).
Change-Id: I97b8428aa5044da23343b86447857b3a101f6baa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
f7452e826cd83fc5ded28c1268f6f4aab252ca2d)
Jan Gelety [Sun, 19 Jan 2020 03:31:10 +0000 (04:31 +0100)]
FIX: t29 yaml file
Change-Id: I20e01457b492ddb9f23cc31f5eab8388f3ea2405
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
ae904eb12cde28fd21bf154fd300970fcfbe48eb)
Tibor Frank [Mon, 27 Jan 2020 14:31:29 +0000 (15:31 +0100)]
Report: Add RC1 data
Change-Id: I3d6d9c56456a12435096f7c61f744519279a850b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
cdb023e3eb911ad3367fccec8ba1a2935a18c7fd)
Tibor Frank [Mon, 27 Jan 2020 13:33:25 +0000 (14:33 +0100)]
Report: Add RC1 data
Change-Id: I7ebbabd1f56b892b6f88a6a183632cb11fc2bc3c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
9afeffb373c05a5853cbfc5a61456c69af423d9e)
Peter Mikus [Mon, 27 Jan 2020 12:49:23 +0000 (12:49 +0000)]
Add t29 Mellanox NIC into topology
Change-Id: I1361595b2a7bda78f45b1379c29a293f863728a8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit
03ce6e3c1a942b040a5a35008d0d382de39c473f)
Tibor Frank [Mon, 27 Jan 2020 12:41:22 +0000 (13:41 +0100)]
Report: Add RC1 data
Change-Id: I7ab49f6a910b9273b78e89096e06761ff7537ec9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
2221396d9ebacf7a5333d63ed329a38f9507838b)
Jan Gelety [Sun, 19 Jan 2020 00:44:22 +0000 (01:44 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
20.01-rc2~
3-g9af7a98cf
- use new vpp ref build - centos7:
20.01-rc2~3_g9af7a98~b8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I40e1aa17f7cd5e6ef7d5736b1623a4063ec04f07
Peter Mikus [Fri, 24 Jan 2020 12:08:52 +0000 (12:08 +0000)]
Attempt to fix journalctl
- AWK
- ECHO
- pipe
+ Much simpler
Change-Id: I4876f4eae68c96571dc38fd21e53ba269f5f888e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Sat, 18 Jan 2020 10:03:52 +0000 (11:03 +0100)]
FIX: VTS tests
Change-Id: I594d248c58dcdcdeceea57af2dd25e2b2e08247f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
100fee239bb1627e4d109f72e742cf7087315d31)
Jan Gelety [Fri, 17 Jan 2020 17:53:27 +0000 (18:53 +0100)]
FIX: nfv_density
- use correct osi_layer=L2 (so L2 spoofing check is switched off
in case of avf driver)
- add pci address information to eth interface in topology file
- nfv_density chain_ipsec tests work only with DPDK
in current implementation
Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
f31b70ee422ed0dc4e5d9b60061a1c2cfc904684)
Peter Mikus [Wed, 22 Jan 2020 13:11:14 +0000 (13:11 +0000)]
FIX: Various issues
- TrafficProfile
- IPsec jumbo
- TDLK leftover
- Trex scapy server
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0601ea75ed6e7318c46124fb02e9c61066089791
(cherry picked from commit
6ccc6d6811a173b8cc3816c51a2dbef8934b3ffd)
Jan Gelety [Sat, 18 Jan 2020 05:38:29 +0000 (06:38 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
20.01-rc2~
1-g20398a368
- use new vpp ref build - centos7:
20.01-rc2~1_g20398a3~b6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I5b6b95ece0bbd2c90eddf78bd6f194f7b8b921c2
Tibor Frank [Wed, 22 Jan 2020 14:27:29 +0000 (15:27 +0100)]
Report: Add diagrams for testbeds
- Diagrams for testbeds:
- 3n-dnv
- 3n-tsh
- 2n-clx
- Replace s/Cascadelake/Cascade Lake
Change-Id: I77e7659a0aba4766a28577f940b7e44e60cbd82d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
25a8fe0aa594ca010b7f1aad449a2af2b6625bd7)
Tibor Frank [Tue, 21 Jan 2020 13:04:01 +0000 (14:04 +0100)]
PAL: Process HDRH Latency
Change-Id: Ifc48869ccb6c05f4b5af6cd97e05f009c7632dc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
654bfa4c33dca6d6eeba6636199de0ff80f75652)
Vratko Polak [Tue, 21 Jan 2020 11:02:46 +0000 (12:02 +0100)]
Ndrpdr: Add latency trials for smaller loads
Change-Id: I46bd4b58bdd02a3deed38c158214e1e9977dde05
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
8840972e7bbc45735f6e82e41ad369728c1b370e)
Yulong Pei [Sun, 19 Jan 2020 12:58:07 +0000 (20:58 +0800)]
reduce test cases for 2n-dnv and 3n-dnv mrr daily test
since dnv platform is to use by low end market product, no need care
more about too much flows performance test.
Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
(cherry picked from commit
b693dedec9077ddb08f50ebefc9d84addcdc047a)
Tibor Frank [Mon, 20 Jan 2020 07:17:02 +0000 (08:17 +0100)]
revert "Report: Remove 'avf' from TC name in plots"
Change-Id: I9b10b8f2f84daad543ac9b84671753785dfb23ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
87f81f123c054908df6770f11a947b9fe6ab0e93)
Dave Wallace [Wed, 8 Jan 2020 20:51:43 +0000 (20:51 +0000)]
perf: add TCP Iperf3+LDPRELOAD test suite
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit
6518c73a0e5cdaf12ae01d247a65aec287d01625)
Vratko Polak [Fri, 17 Jan 2020 13:20:49 +0000 (14:20 +0100)]
Fix unreservation
It got broken by the previous reservation fix.
Change-Id: I5d9091b7fa4fcc37148c0223fe8eb83f7e5b6770
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
ac33ed374cb82c9258e4cf57e150f77750362bbc)
Tibor Frank [Fri, 17 Jan 2020 12:35:31 +0000 (13:35 +0100)]
Report: Remove 'avf' from TC name in plots
Change-Id: Ie1d04347de123032a5d424747d216f90022bc813
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
c26ab619b300e6bf38c447c0600a5739ca46e27b)
(cherry picked from commit
21591b3ec26ce457f8374acb970b0504cd373b55)
Jan Gelety [Thu, 16 Jan 2020 22:39:05 +0000 (23:39 +0100)]
FIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily job
- not enough cpu cores reported
Change-Id: If3ddbbf4f5af741f328c45ac6b8c874e61d348ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
8b64d3f942a28a01df1daac3ccee42828021a410)
Jan Gelety [Thu, 16 Jan 2020 22:22:41 +0000 (23:22 +0100)]
FIX: missing write of mac_dst for direction 0 --> 1 in cnf trex profiles
Change-Id: I3acf5220c24f77bc4bfc451919bf9b5345a988ef
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
9159c81f65c71cf77e9f1d59241e9ebcbbe9abc4)
Vratko Polak [Fri, 17 Jan 2020 11:26:47 +0000 (12:26 +0100)]
Fix reservation if connect fails
Change-Id: I136cc51cbd5a01451e04a39c5d8e5554d6d39305
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit
1b9d4210b9b466fedab3a5891ec16a34e67a78ee)
Tibor Frank [Fri, 17 Jan 2020 09:18:57 +0000 (10:18 +0100)]
Report: Prepare data sets
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit
e864945ddfd65b99b3311fddc9260dba3a02b1bc)
Jan Gelety [Thu, 16 Jan 2020 18:49:06 +0000 (19:49 +0100)]
FIX: L2XC with vhost and VLAN
Change-Id: Ia87abadba431099eeacd8b50ce5d116597a1f393
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit
633e1f40e5adcb38458fbd6d1209afc1240244a5)
Jan Gelety [Thu, 16 Jan 2020 15:22:48 +0000 (16:22 +0100)]
Update of VPP_REPO_URL and VPP_STABLE_VER files
- use vpp builds from vpp stable/2001 branch
- use new vpp ref build - ubuntu 18.04:
20.01-rc1
- use new vpp ref build - centos7:
20.01-rc1~b2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Ice08e71fe825ef722776a487a300d3972835ff9f
Balaji Venkatraman [Tue, 14 Jan 2020 14:57:10 +0000 (06:57 -0800)]
Python3: Migration of files under traffic-profiles/trex
Change-Id: Iae16225d3d3daa4e1e9b177228fb89efe4aa5405
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Tibor Frank [Thu, 16 Jan 2020 12:31:08 +0000 (13:31 +0100)]
Report: Latency by Percentile Distribution
- legend
Change-Id: I35477ce5c2cabfdcef68424854a8574bd3655e55
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 16 Jan 2020 09:53:35 +0000 (10:53 +0100)]
Report: Latency by Percentile Distribution
- Set X-axis
Change-Id: Ica300c7b1352c824bf51ac26e7485c9295ac60dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 10 Jan 2020 12:41:09 +0000 (13:41 +0100)]
Report: Add placeholders for new TBs
Change-Id: I92cb693343c4f96503b45a15211e0dadd6fcde5f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 5 Dec 2019 14:37:27 +0000 (15:37 +0100)]
Remove leftovers from previous removals
- Except KubernetesUtils and its bash dependencies.
It is a dead code currently, but we hope new tests will resurrect it.
+ Mention device tests instead of functional in Readme.
Change-Id: I6bdbea13ea9f995a06a0fb7cb5e98ae4fce29581
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 15 Jan 2020 14:48:48 +0000 (15:48 +0100)]
Report: Latency by Percentile Distribution
- Set the position of the Lagend
Change-Id: I1bcea6002bd8beeba3300c9976d1603a234c3c14
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 15 Jan 2020 10:15:14 +0000 (11:15 +0100)]
Report: Add Latency by Percentile Distribution
Change-Id: I5291db8117da611497e910aa7cd2fbb2276bfe65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 15 Jan 2020 13:12:48 +0000 (13:12 +0000)]
Docs: Update report sections
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib6e9ac003c1d91673984c52baf2f3eec30c9d21d
Peter Mikus [Wed, 15 Jan 2020 12:01:35 +0000 (12:01 +0000)]
Ansible: Increase TG hugepages
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa87e372ed45f6dfc883723acbb325e34fb814a8
Vratko Polak [Fri, 22 Nov 2019 13:14:15 +0000 (14:14 +0100)]
Remove everything related to TLDK
- Leftovers from kubernetes found, but not removed here.
Change-Id: If8cb9269d0f3e69f642d7fe02c59122e17925a4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 13 Dec 2019 15:11:58 +0000 (16:11 +0100)]
Trending: new daily set
New daily sets are prepared based on information in
https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md
and previous test set definitions in
docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md
files.
- mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h
- mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h
- mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h
- mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h
- mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h
- mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h
- mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h
+ add some missing test suites
+ add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile
+ correction of TS and TC names and tags in directory
tests/vpp/perf/nfv_density/chain_ipsec
Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Thu, 2 Jan 2020 14:30:09 +0000 (15:30 +0100)]
Support suite tags in autogen
+ Include a script to add suite tags to many suites at once.
+ Add suite tags also to device tests (not covered by autogen).
Change-Id: I514ee6178e22999b43460028fe2696738b012f04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 3 Jan 2020 15:01:30 +0000 (16:01 +0100)]
Autogen: Generate also NIC drivers.
+ Disallowed -avf- (or -rdma-) as "template" suites.
+ GBP suite switched to DPDK driver in repo.
+ Each NIC has its own list of supported drivers, in Constants.
+ Updated tag expressions for daily jobs:
+ Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts
are tested only with vfio-pci.
+ Other (base, dot1q, dot1ad) tested with all drivers.
+ Setup actions currently depend on driver, generated.
- The performance_rdma action is trivial for now.
- Several tests fail, to be fixed later, e.g. by performance_rdma.
+ Reconf tests are also supported.
+ Added DRV_VFIO_PCI tags missing, mainly in density tests.
- Vhost suites (density, reconf) are failing, but suites look good.
- TCP suites do not support NIC drivers yet.
- DPDK obviously not supported.
+ Use Python 3 in regenerate scripts.
+ Fix typos binded => bound.
+ File open modes set either u"rt" or u"wt" everywhere.
+ Remove a trailing space in an environment variable name.
Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 14 Jan 2020 12:47:18 +0000 (13:47 +0100)]
Report: Current vs. Previous Release - NFV Tests
Change-Id: I00cbde38b8f900efe3e3123a942de2288381ea3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Dave Wallace [Fri, 20 Dec 2019 22:46:51 +0000 (22:46 +0000)]
Hoststack perf infrastructure refactoring
- DUT only topology (hoststack test
apps are co-located with vpp)
- Make vpp app specific keywords generic
where applicable
- Add IP4 Prefix to topology file
- Support running wrk in linux namespace
- Refactor namespace cleanup
- Remove redundant namespace creation code
- Refactor test/keyword dirs: tcp -> hoststack
- Add hoststack utility keywords
- Refactor wrk suite setup/teardown
- Update tests with recent perf infra changes
Change-Id: Ia1cf07978d579393eef94923819a87c8c1f36f34
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Peter Mikus [Tue, 14 Jan 2020 15:05:22 +0000 (15:05 +0000)]
FIX: VXLAN scale
+ Another stupid arp -> neighbor rename
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia873d6c2a485659033f71cdf546782db74787d13
Peter Mikus [Tue, 14 Jan 2020 07:51:12 +0000 (07:51 +0000)]
FIX: NF_density tests
+ ARP -> Neighbor
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I74044bd7db6cb4b1bd3648a424e9c8f1473be8d1
Vratko Polak [Mon, 13 Jan 2020 13:55:27 +0000 (14:55 +0100)]
Update comments in crc file.
+ L2patch is already covered.
+ RDMA is not device testable yet.
Change-Id: I1dcccfcb340a8fe61c20d3516340e26db293cfaa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 13 Jan 2020 14:20:12 +0000 (15:20 +0100)]
Report: Add VNF Service Chains Tunnels
Change-Id: Iafdcb543f6adc583567a05aa5a882dce17b58f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 13 Jan 2020 13:22:31 +0000 (13:22 +0000)]
FIX: NF_density tests
+ Because arp->neigbor was so important to do.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I552e175b7555ebf5053d7994c0c9173c0c96fc58
Tibor Frank [Mon, 13 Jan 2020 10:23:27 +0000 (11:23 +0100)]
Report: Move VTS tests from 3n to 2n
Change-Id: Ie2faa6cb611d372c4a20584f7b40f3281660f2b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 9 Jan 2020 16:22:06 +0000 (17:22 +0100)]
CSIT-1597 API cleanup: rdma
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24225
- update vpp stable to version 20.01-rc0~1011
Change-Id: Ibbfdbe867cf89715619efc5c5507859983025ece
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 10 Jan 2020 12:22:00 +0000 (13:22 +0100)]
Report: Add comparison tables
CSIT-1654
Change-Id: I280195b295d4fc717cb355e78c5f1731bb1eabe5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 9 Jan 2020 14:02:10 +0000 (15:02 +0100)]
Report: Add 2n-clx
Change-Id: I34dc11c28d21f0b9fed87d76942fe8b8cdd86c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 9 Jan 2020 13:45:06 +0000 (13:45 +0000)]
FIX: Container test
+ We should check if container is UP
+ We should adjust privileges.
Change-Id: I3f604b7b9740943b4fd3b0574c18d2729e88b816
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Thu, 9 Jan 2020 09:11:55 +0000 (10:11 +0100)]
Report: Configure Report 2001
Change-Id: I5ef3c37cf329b76a1a7f94d60c3563872eef3c5d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 14 Nov 2019 08:28:14 +0000 (09:28 +0100)]
DMM: Remove
Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 8 Jan 2020 02:11:12 +0000 (03:11 +0100)]
API: Add collection for 24225/3
Change-Id: I5c4593d05dbcb4d918611dc7520432a446dbf664
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 8 Jan 2020 09:41:50 +0000 (10:41 +0100)]
PAL: Set y-axis for HDRHistogram
Change-Id: Ibdee625d6d9215b18771a6348735dc6a07e9ae58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 8 Jan 2020 14:08:14 +0000 (15:08 +0100)]
Track real(er) duration of traffic
+ Print duration.
- Missing: Parse duration.
- We do not have good formula to compensate, yet.
Change-Id: I1c76ac35ce531b1994480d6aa0638f16992231f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Tue, 10 Dec 2019 09:04:59 +0000 (09:04 +0000)]
T-Rex: Upgrade to 2.73 with DDP profile fix
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Icaa99e0a71a19ba23697c21a4b5aa046813a718a
Peter Mikus [Thu, 2 Jan 2020 13:25:01 +0000 (13:25 +0000)]
Vhost: Add GSO option
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba9af71c293645b480203af72fcf940cbe9ccb3a
Vratko Polak [Tue, 7 Jan 2020 09:23:23 +0000 (10:23 +0100)]
Fix Trex start configuration
Since https://gerrit.fd.io/r/c/csit/+/24056
csit-vpp perf tests are failing.
Turns out the reason is too large limit_memory value,
but other improvements applied during investigation
are included as well.
+ Cat trex.log if trex fails to start.
+ Improve trex startup command formatting (remove double spaces).
+ Reorder imports.
Change-Id: I2c1106ea6f88a1a275682e73eba212d08c7947c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>