Peter Mikus [Wed, 11 Sep 2019 11:19:27 +0000 (11:19 +0000)]
TRex: 2.61
- HDRhistogram can be rebased and used in separate patch.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680
Peter Mikus [Wed, 11 Sep 2019 09:33:21 +0000 (09:33 +0000)]
Topology: Cascadelake
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb
Tibor Frank [Thu, 12 Sep 2019 06:53:21 +0000 (08:53 +0200)]
Report: Configure 1908.38
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 11 Sep 2019 16:21:56 +0000 (18:21 +0200)]
Revert "API cleanup: tap" and bump stable_vpp
The VPP change got a temporary -1,
as other change has higher priority.
Bumping stable VPP version, so this passes verify right away.
This reverts commit
ae62a4348f7de53cfb91a5ae25a10723d5f9b398.
Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Tue, 3 Sep 2019 20:18:17 +0000 (22:18 +0200)]
CSIT-1597 API cleanup: tap
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 4 Sep 2019 13:42:08 +0000 (15:42 +0200)]
CSIT-1597: API cleanup: bond
Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 10 Sep 2019 11:27:11 +0000 (11:27 +0000)]
Ansible: Cascadelake include
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3
Tibor Frank [Wed, 11 Sep 2019 11:14:40 +0000 (13:14 +0200)]
Report: Remove NFV full data
Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 10 Sep 2019 08:09:43 +0000 (08:09 +0000)]
Ansible: Trex installation
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0
Tibor Frank [Wed, 11 Sep 2019 08:18:49 +0000 (10:18 +0200)]
Report: Add data
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 10 Sep 2019 11:50:24 +0000 (13:50 +0200)]
Report: Add pdf version
Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 6 Sep 2019 11:54:11 +0000 (13:54 +0200)]
PAL: Add replacing of data in tables
+ vhost data
Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 30 Aug 2019 13:20:14 +0000 (13:20 +0000)]
Refactor getting telemetry
+ Ability to get stats from CNF via SocketPAPI
- Remove obsolete functions
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4d1b32a7279244592be96644e4f8a530c4f29a15
Jan Gelety [Wed, 4 Sep 2019 06:31:13 +0000 (08:31 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
163-g546f955~b7955
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
163-g546f955b3
- use new vpp ref build - centos7:
20.01-rc0~163_g546f955~b7763
Change-Id: I69ed9d37d2786de923c93d1de8d78e0a5e248954
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 4 Sep 2019 04:40:31 +0000 (06:40 +0200)]
FIX: correct crc for sw_interface_slave_details
Change-Id: I4baae7da6f8fef8bd65f08e28fa1b55fb81857ce
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 9 Sep 2019 12:55:26 +0000 (14:55 +0200)]
Report: Report history
Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 3 Sep 2019 11:52:44 +0000 (13:52 +0200)]
API cleanup: memif
Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 4 Sep 2019 01:56:26 +0000 (03:56 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
159-gb736e75~b7951
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
159-gb736e75d5
- use new vpp ref build - centos7:
20.01-rc0~159_gb736e75~b7759
Change-Id: I4def341aad97cb039c11ec45be2846d0fb691435
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 9 Sep 2019 10:58:25 +0000 (12:58 +0200)]
Report: Add dnv mrr data
Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 Sep 2019 10:16:36 +0000 (12:16 +0200)]
Report: Fix tsh and dnv plots
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 Sep 2019 07:01:18 +0000 (09:01 +0200)]
Report: Add soak tests
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 6 Sep 2019 17:41:15 +0000 (17:41 +0000)]
Report: Fix2 - Add 3n-dnv plots and tables
Change-Id: Ia182e6e52a37f9b3248eab60ffe4dd4746ed7fa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 3 Sep 2019 20:33:45 +0000 (22:33 +0200)]
docs: add select list of tests for report - tsh and dnv
Change-Id: I63a69d998c80029422bae9f90e186eb2286196d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Thu, 5 Sep 2019 08:33:12 +0000 (10:33 +0200)]
Support new sw_interface_slave_details CRC
Change-Id: I2f72a741ac7353ad36f6a2dada26eabb1a76cb2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 5 Sep 2019 14:15:19 +0000 (16:15 +0200)]
Read environment variables in Constants.py
Instead of using EnsureGlobalVariable,
which is clunky to use from Python.
As a consequence, all caps variables from Constants.py are used directly
and tests/__init__.robot and robot_enhancements.robot are deleted.
+ Rename the CRC global kill switch based on ci-man review.
Change-Id: I10723792475bc83352bf8c3b7f7946ecf885a194
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 6 Sep 2019 07:43:53 +0000 (09:43 +0200)]
Report: Fix - Add 3n-dnv plots and tables
Change-Id: I5f09f1f20e532e71d6abde02111a90f5868035f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 6 Sep 2019 06:13:09 +0000 (08:13 +0200)]
Report: Add 3n-dnv plots and tables
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 12:01:09 +0000 (14:01 +0200)]
Report: Add 2n-dnv plots and tables
Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 08:49:33 +0000 (10:49 +0200)]
Report: Add DNV data
Change-Id: I020373b1553300459654ded31d940b0a5562eb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 4 Sep 2019 11:13:08 +0000 (13:13 +0200)]
Allow CRC checking to be controlled via env var
The plan is to override the default in some (but not all) jobs.
The csit-vpp jobs shall do the checking, but vpp-csit jobs shall not
(except api-crc job of course) in order to confirm benign changes.
Change-Id: If59d17991de3fb0e847113a87e0533a8ee62af7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 07:54:39 +0000 (09:54 +0200)]
Report: Fix listing order of new vs. see footnote
Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 06:40:20 +0000 (08:40 +0200)]
Report: Fix hsw vs. skx comparison table
Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 06:27:10 +0000 (08:27 +0200)]
Report: Fix fonts in release notes table
Change-Id: I4a3486c313c4aa4754c455389b8ebb363ead469a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 06:20:32 +0000 (08:20 +0200)]
Report: Configure Report 1908.37
Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 2 Sep 2019 21:28:30 +0000 (23:28 +0200)]
FIX: Use vhost macs when testpmd_mac forwarding used in VM
Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Mon, 2 Sep 2019 12:13:19 +0000 (14:13 +0200)]
Clarify why 9000B tests are skipped for IPsec
Ticket: VPP-1207
Change-Id: I506b4a24dfa6b10578407b261926f37215a714f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 4 Sep 2019 10:51:50 +0000 (12:51 +0200)]
Report methodology: PLRsearch update with graphs
Change-Id: Ib73a64c93bdba3945b8237783a24134b47d4eb99
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Wed, 4 Sep 2019 11:56:55 +0000 (12:56 +0100)]
docs: report vpp performance rls notes update.
Change-Id: Ie4a7a80cad9ff92b9f30953096cca8a029edc687
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 4 Sep 2019 11:11:54 +0000 (12:11 +0100)]
docs: report packet_throughput_graphs text formatting fixes.
Change-Id: Ibea6e70e2fcf9cfeb7627ee1cbcfa6e177c0b2c6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Wed, 4 Sep 2019 08:33:49 +0000 (10:33 +0200)]
Hotfix: Bump version and CRCs
Naginator caused a false Verified+1,
so a benign API change had been merged prematurely.
Change-Id: I8852ca684cba4876d46049ca34204ebbccf96b2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Wed, 4 Sep 2019 09:04:40 +0000 (09:04 +0000)]
Doc: Report release notes (perf)
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c1667efec67febd375818bc1dfe1d9bebc70708
Maciek Konstantynowicz [Wed, 28 Aug 2019 13:41:07 +0000 (14:41 +0100)]
docs: added methodology terminology section to report.
Change-Id: Id787d12b577165a1081dba84b610c32df57a7c44
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Mon, 2 Sep 2019 18:29:05 +0000 (19:29 +0100)]
docs: report updates in physical_testbeds section.
Change-Id: Id31e6ed294dc80619a108296be580925509bb7d7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 3 Sep 2019 21:16:30 +0000 (22:16 +0100)]
docs: updated report intro in packet_throughput_graphs
Change-Id: I3bf70cc7e48ef2134841bc4bf9300cda6a118cb3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 3 Sep 2019 21:37:45 +0000 (22:37 +0100)]
docs: added 3n-tsh testbed tests to report_test_groups.txt
Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Wed, 4 Sep 2019 07:21:26 +0000 (09:21 +0200)]
Report: ixgbe for tsh
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 4 Sep 2019 06:47:28 +0000 (08:47 +0200)]
Report: Add data
Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 20:26:25 +0000 (20:26 +0000)]
Report: Comparison tables
Change-Id: I108e1292c5de8024060c220b877b668b8843c68f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 17:52:02 +0000 (17:52 +0000)]
Report: Comparison tables
Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 12:08:37 +0000 (14:08 +0200)]
Report: Comparison tables
Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 09:07:36 +0000 (11:07 +0200)]
Report: add data
Change-Id: I51fd0b9e07d09224452f842689925d1166246f19
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 06:56:27 +0000 (08:56 +0200)]
CSIT-1590: Performance comparison analysis
Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 06:45:31 +0000 (08:45 +0200)]
CSIT-1590: Performance comparison analysis
Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 2 Sep 2019 16:48:37 +0000 (18:48 +0200)]
PAL: list all sel tests in table_performance_comparison
Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 2 Sep 2019 13:52:06 +0000 (15:52 +0200)]
PAL: list all sel tests in table_performance_comparison_nic
Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 2 Sep 2019 13:11:20 +0000 (15:11 +0200)]
Report: Add data
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 2 Sep 2019 11:55:41 +0000 (13:55 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~129_g5c89fbf~b7728
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
129-g5c89fbf28
- use new vpp ref build - centos7:
20.01-rc0~129_g5c89fbf~b7728
Change-Id: Ie11a1fddd8f2e1c27e45a4b231a09fbdeced9c24
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Sun, 1 Sep 2019 05:51:07 +0000 (05:51 +0000)]
Add: Testpmd VM test
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id39667515e304f4d92f230f82d3f1dbc1e22ac32
Tibor Frank [Mon, 2 Sep 2019 10:32:32 +0000 (12:32 +0200)]
Report: Add 3n-tsh
Change-Id: I6027b635191c7e64397915df8944699bb320daf3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 26 Aug 2019 03:41:53 +0000 (05:41 +0200)]
Report: functional tests static content
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 30 Aug 2019 09:55:42 +0000 (11:55 +0200)]
Report: Add data
Change-Id: Ie9350530879fef7d2ae8c0b58f6fd799fde9fff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Wed, 28 Aug 2019 12:38:34 +0000 (13:38 +0100)]
presentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model.
Change-Id: I90dd569ce42fe6bf29751ca29086fe458d40a095
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Wed, 28 Aug 2019 19:09:21 +0000 (21:09 +0200)]
Report: Add data
Change-Id: I5ae5fa7cb40ddc31e3fe3fd0d6182bf54c84ad00
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 26 Aug 2019 09:03:38 +0000 (11:03 +0200)]
Report: Add data
Change-Id: I66c91e083138b50a575cbbd32d309d0c198e6a71
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Tue, 20 Aug 2019 16:07:21 +0000 (17:07 +0100)]
docs: created full list of tests for report detailed results.
Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 20 Aug 2019 12:51:51 +0000 (13:51 +0100)]
docs: created select list of tests for report and trending.
Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Ludovit Mikula [Tue, 27 Aug 2019 11:51:18 +0000 (11:51 +0000)]
NEW: Added trex profiles for 60k ip4 destinations.
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ib9e42914ad5ab6bf0febea3edbeea8d09c8918b1
Dave Wallace [Tue, 27 Aug 2019 21:02:07 +0000 (17:02 -0400)]
DOC: 1908rls release notes for VPP Hoststack TCP performance tests.
Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Vratko Polak [Wed, 21 Aug 2019 15:36:21 +0000 (17:36 +0200)]
Bump DPDK version
VPP has bumped it in https://gerrit.fd.io/r/c/vpp/+/21406
Change-Id: I32a950134f5e93b3c68e3748ab9aaaec2dde2d5a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Sun, 25 Aug 2019 20:11:02 +0000 (21:11 +0100)]
docs: added csit tests job specs.
Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Thu, 22 Aug 2019 12:15:09 +0000 (14:15 +0200)]
Delete unused SR keywords
Trim both Python (L1) and Robot (L2) keywords,
as no test performs SR related deletions.
Change-Id: Ic76d870c3f58e927ea222b350e149d0770985072
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 27 Aug 2019 09:46:48 +0000 (11:46 +0200)]
Report: Add data
Change-Id: I534cbb4141b60609387f894e51c429e368520a23
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Ludovit Mikula [Mon, 26 Aug 2019 11:39:39 +0000 (11:39 +0000)]
- Removed 9000B test cases from ipsec test suites.
- Added new traffic profiles.
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e
Vratko Polak [Fri, 23 Aug 2019 15:02:04 +0000 (17:02 +0200)]
Stop using SSH() in TrafficGenerator.py
This is a partial fix for:
Ticket: CSIT-1434
and should fix one pylint violation.
Many files to remove SSH() from remain.
+ Use -E (together with previous -S) in ssh.py when sudo=True.
Needed in some cases, no downsides expected.
Change-Id: Ie2ad03b3c656a4d3965a61a1e5435276f99a28c0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 15:13:25 +0000 (17:13 +0200)]
Report: Comp Tables
Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 13:46:29 +0000 (15:46 +0200)]
Report: tables
Change-Id: Ideec743ae10909d91625ea5cfc7901624459f455
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 13:29:04 +0000 (15:29 +0200)]
Report: NFV
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 12:32:48 +0000 (14:32 +0200)]
Report: Tables
Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 11:40:39 +0000 (13:40 +0200)]
Report: Modify comparison tables, add data
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Sun, 25 Aug 2019 12:05:34 +0000 (14:05 +0200)]
FIX: Copy-paste typo in 2n-10ge2p1x710-eth-l2bd-6ch-48vh-24vm1t-vppip4-ndrpdr.robot
Change-Id: Ibe231547e26d9b379554eec8ca6a9b4d7bc1224b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 19 Aug 2019 13:25:47 +0000 (15:25 +0200)]
Report: Select tests by name, specifications
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 23 Aug 2019 15:00:29 +0000 (17:00 +0200)]
Introduce reconfig suites, for dot1q+ip4+vxlan
Ticket: CSIT-1551
+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
+ Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
- Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
- Only 1 additional chain.
+ Proper TAGs. Documented.
+ Clarified min framesize tags are for TG-DUT.
+ Added a TODO concerning overhead values.
+ Added 118B tag.
+ Robot performance keywords improvements.
+ Added missing return value documentation.
+ Frame size as required test variable, not an explicit argument.
+ MLRsearch keyword to store result (not into test message).
- TODO: De-duplicate: main keyword to measure, minor to set test message.
- But implementation uses the fact default arguments are different.
+ Keywords for starting and stopping background traffic.
- No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
- Support also vlan_per_chain=True?
- Support dot1q without vxlan?
- Support also deletion?
- How to package config steps so -reconf can be generated from -ndrpdr?
Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 22 Aug 2019 13:04:34 +0000 (15:04 +0200)]
Improve PLRsearch yet again
Logic improvements for rls1908 and post-pylint fixes:
+ Reduce search time to 30 minutes.
+ Use average instead alternating loads.
+ Rework log/exp avg/stdev from two estimates.
+ Introduce and use pessimistic variance of dual trackers.
+ Introduce safe_exp to use when None does not skip code.
+ Use dot relative imports (instead of disabling pylint).
+ Complete docstrings for simpler functions.
+ Append docstrings to named tuples.
+ Somewhat unify docstrings related to the same arguments.
+ Slightly improve intentation.
+ State named tuples as rtype where used.
+ Add returns and rtype to __repr__ where missing.
+ Return what docstring say (or update them).
+ Explicit copying for vector and matrix values.
Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 22 Aug 2019 08:08:15 +0000 (10:08 +0200)]
Update CRC list comments
+ Add testcases and tag expressions for perf occurrences.
+ Add TNL_1 tag for single tunnel IPsec suites.
- Some CRCs were missing before, but form a pair with a listed CRC.
- Probably the other half of the pair is not used.
- Will be fixed in subsequent Change.
Change-Id: I5754210755c13c41226b71045813714a65a1cdf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 20 Aug 2019 08:52:11 +0000 (10:52 +0200)]
Report: Specify groups of tests for graphs
Groups of tests for graphs:
- Packet Throughput
- Packet Latency
- Speedup Multi-Core
Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 21 Aug 2019 06:26:09 +0000 (08:26 +0200)]
Add: 2-node ip4 oacl tests
Change-Id: I786fe9f75777e1cd0daee70bc350185dd7fd17e1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Miroslav Los [Thu, 15 Aug 2019 17:08:47 +0000 (19:08 +0200)]
Framework: simplify CpuUtils
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I7682d802f405070e34f72bc4a80cbe6a63b03619
Peter Mikus [Tue, 20 Aug 2019 09:51:54 +0000 (09:51 +0000)]
Add: avf-dot1q testcases
+ Few fixes in doc
+ Align testcases
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f
Vratko Polak [Tue, 20 Aug 2019 14:25:51 +0000 (16:25 +0200)]
Fix Initialize layer dot1q on node
By using Get Variable Value keyword.
Change-Id: I3a9650b6f802d60422ffa6b6b00d444ebb050d89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 20 Aug 2019 10:45:10 +0000 (12:45 +0200)]
Bump stable vpp version to 20.01-rc0~68
After API change.
CSIT: https://gerrit.fd.io/r/c/csit/+/21245
VPP: https://gerrit.fd.io/r/c/vpp/+/18361
+ Add ip_probe_neighbor_reply CRC, not sure how that got missing.
Change-Id: I790875dab771981af3b9eceac5425d4d2f374984
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Wed, 7 Aug 2019 19:07:26 +0000 (21:07 +0200)]
Interface API cleanup
CSIT code alignment with API changes in VPP introduced
by patch https://gerrit.fd.io/r/c/vpp/+/18361
Change-Id: Ib0357bba79f55d297ef1086fbf3b760caca16cdb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Mon, 19 Aug 2019 11:49:07 +0000 (11:49 +0000)]
Align NF_denisty tests
+ Apply layer approach for interfaces
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea
Peter Mikus [Mon, 19 Aug 2019 14:48:47 +0000 (14:48 +0000)]
Add: NF_density combinations
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9ba859cf8ecb2d65c90ec7c6f75dc3e353e74de9
Vratko Polak [Mon, 19 Aug 2019 13:58:43 +0000 (15:58 +0200)]
VPP perf per patch: Reverse the order of tests
If current VPP is broken, we want to fail early.
If there is API change, we are more interested in current results,
even if parent is likely to fail.
Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 16 Aug 2019 13:48:02 +0000 (15:48 +0200)]
Autogen: Create NICs for TCP suites.
+ Put Regenerator internal functions ourside class.
+ Duplicate into _default_ and _tcp_ functions.
+ Rework Testcase to be a single class with two factories.
+ Improve suite and testcase naming.
Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 16 Aug 2019 07:37:31 +0000 (09:37 +0200)]
PAL: Select tests by name, functions
- throughput
- latency
- speedup
Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 19 Aug 2019 11:26:01 +0000 (13:26 +0200)]
Report: Add data
- DPDK
Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 19 Aug 2019 11:02:56 +0000 (13:02 +0200)]
PAL: Get DPDK version from output_info.xml
Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Miroslav Los [Thu, 15 Aug 2019 18:41:51 +0000 (20:41 +0200)]
Framework: MLRSearch refactor of ndrpdr
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I86bc69f8b2f38b58cb3eb030bec7d0ce5c79d040
Miroslav Los [Fri, 16 Aug 2019 13:09:39 +0000 (15:09 +0200)]
Framework: Refactor complex functions in PLRSearch
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25
Code Review / csit.git / log