Tibor Frank [Wed, 18 Sep 2019 14:42:22 +0000 (16:42 +0200)]
Report: Fix formating of static content for reconf tests
Change-Id: I5b93749b13af870955c1cf9eb8053c446356c329
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 13 Sep 2019 13:40:54 +0000 (15:40 +0200)]
Fix errors found by pylint
Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 18 Sep 2019 08:40:17 +0000 (10:40 +0200)]
Report: Add disclaimer for reconf tests
+ Improve description for reconf tests
Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 17 Sep 2019 07:23:07 +0000 (09:23 +0200)]
Report: Enable pdf version
Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 17 Sep 2019 11:00:39 +0000 (13:00 +0200)]
Update CRC list and support 21997/7
- Attempt to repair IPsec LispGpe perf suite.
+ Collection name to reflect the current stable vpp.
+ Add messages found in CSIT L1 keywords.
- Uncommented (instead of deleted) untestable messages. Reasons:
- Honeycomb.
- Messages used by unused keywords.
+ Listed reasons. Honeycomb not mentioned if both reasons apply.
+ Delete CRC items for commands not found in keywords anymore.
+ Add CRCs from .json.api files (as teardown is hard to execute).
+ Define and restore alphabetical order.
+ Add hints to find used API commands (not entirely reliable).
+ Move used commands to "cmd = " form so hints find them.
+ Argument to run_cli_command changed from "cmd" to "cli_cmd".
+ Except also struct.error where IOError is excepted.
Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 17 Sep 2019 09:15:03 +0000 (11:15 +0200)]
Report: Fix Report History
Change-Id: I654677ca9252e592e635eab28577bb3bb3b8bf85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 17 Sep 2019 07:07:06 +0000 (09:07 +0200)]
Report: Update Report History
Change-Id: Ie16a2f2298eeaf0793171c7268a95abb6986246a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 16 Sep 2019 16:34:29 +0000 (18:34 +0200)]
Report: Add methodology for reconf tests
Change-Id: I833d63f4e305ba60c94aa16cbb3a31a52ee3b3bb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 16 Sep 2019 14:54:43 +0000 (16:54 +0200)]
Trending: Fix removing of old input files
Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 16 Sep 2019 10:03:52 +0000 (12:03 +0200)]
Trending: Reduce input data
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 13 Sep 2019 08:17:08 +0000 (10:17 +0200)]
Report: Add data
Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 13 Sep 2019 08:22:29 +0000 (08:22 +0000)]
Add: AVF IPv6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6cb4ef356047bdc341a70a4e7b8d0b3f54eb7f9d
Peter Mikus [Fri, 13 Sep 2019 08:13:09 +0000 (08:13 +0000)]
FIX: Pylint + Container mount
- Mount is affecting only LXC container
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84
Tibor Frank [Fri, 13 Sep 2019 11:53:23 +0000 (13:53 +0200)]
Report: Fixes
Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 12 Sep 2019 13:45:31 +0000 (15:45 +0200)]
CRC checker: Sort and indent dict output
Also, use double quotes, so the dict is shown
not only as a valid Python code, but also a valid JSON.
This should make it easier to handle big CRC changes such as:
https://logs.fd.io/production/vex-yul-rot-jenkins-1
/vpp-csit-verify-api-crc-master/646/console.log.gz
+ Log indented message about CRC conflict to console even on failure,
as in the exception, endlines are escaped.
Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 13 Sep 2019 06:56:08 +0000 (08:56 +0200)]
Report: Add data
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 6 Sep 2019 08:14:45 +0000 (10:14 +0200)]
Support unidirection in all searches
+ Rename bool unidirection to int traffic_directions.
+ Rename "untagged" to "initial" for bandwidth calculation.
+ Fix latency measurement for unidirectional traffic.
+ Remove duplicate colon in soak test message.
+ Edit PAL to accept both forms.
+ Fix minor documentation issues.
Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 12 Sep 2019 13:11:13 +0000 (15:11 +0200)]
CRC list: Compatible collection for 21997
Change-Id: I749d0164e9397769fc178f20eefe88b952e295d4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 12 Sep 2019 13:16:35 +0000 (15:16 +0200)]
Report: Add nfv reconf
Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 11 Sep 2019 13:40:41 +0000 (15:40 +0200)]
Skip CRC checking by default
During https://gerrit.fd.io/r/c/ci-management/+/21955
we decided this new default is more convenient for development.
Change-Id: I07f10cbb586e79f6ac714ad635dda35561c07125
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 11 Sep 2019 09:55:13 +0000 (11:55 +0200)]
PAL: Add NFV reconf tests
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 12 Sep 2019 07:53:49 +0000 (09:53 +0200)]
Report: Temporarily remove pdf version
Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 11 Sep 2019 11:19:27 +0000 (11:19 +0000)]
TRex: 2.61
- HDRhistogram can be rebased and used in separate patch.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680
Peter Mikus [Wed, 11 Sep 2019 09:33:21 +0000 (09:33 +0000)]
Topology: Cascadelake
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb
Tibor Frank [Thu, 12 Sep 2019 06:53:21 +0000 (08:53 +0200)]
Report: Configure 1908.38
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 11 Sep 2019 16:21:56 +0000 (18:21 +0200)]
Revert "API cleanup: tap" and bump stable_vpp
The VPP change got a temporary -1,
as other change has higher priority.
Bumping stable VPP version, so this passes verify right away.
This reverts commit
ae62a4348f7de53cfb91a5ae25a10723d5f9b398.
Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Tue, 3 Sep 2019 20:18:17 +0000 (22:18 +0200)]
CSIT-1597 API cleanup: tap
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 4 Sep 2019 13:42:08 +0000 (15:42 +0200)]
CSIT-1597: API cleanup: bond
Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 10 Sep 2019 11:27:11 +0000 (11:27 +0000)]
Ansible: Cascadelake include
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3
Tibor Frank [Wed, 11 Sep 2019 11:14:40 +0000 (13:14 +0200)]
Report: Remove NFV full data
Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 10 Sep 2019 08:09:43 +0000 (08:09 +0000)]
Ansible: Trex installation
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0
Tibor Frank [Wed, 11 Sep 2019 08:18:49 +0000 (10:18 +0200)]
Report: Add data
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 10 Sep 2019 11:50:24 +0000 (13:50 +0200)]
Report: Add pdf version
Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 6 Sep 2019 11:54:11 +0000 (13:54 +0200)]
PAL: Add replacing of data in tables
+ vhost data
Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 30 Aug 2019 13:20:14 +0000 (13:20 +0000)]
Refactor getting telemetry
+ Ability to get stats from CNF via SocketPAPI
- Remove obsolete functions
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4d1b32a7279244592be96644e4f8a530c4f29a15
Jan Gelety [Wed, 4 Sep 2019 06:31:13 +0000 (08:31 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
163-g546f955~b7955
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
163-g546f955b3
- use new vpp ref build - centos7:
20.01-rc0~163_g546f955~b7763
Change-Id: I69ed9d37d2786de923c93d1de8d78e0a5e248954
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 4 Sep 2019 04:40:31 +0000 (06:40 +0200)]
FIX: correct crc for sw_interface_slave_details
Change-Id: I4baae7da6f8fef8bd65f08e28fa1b55fb81857ce
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 9 Sep 2019 12:55:26 +0000 (14:55 +0200)]
Report: Report history
Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 3 Sep 2019 11:52:44 +0000 (13:52 +0200)]
API cleanup: memif
Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 4 Sep 2019 01:56:26 +0000 (03:56 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
159-gb736e75~b7951
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
159-gb736e75d5
- use new vpp ref build - centos7:
20.01-rc0~159_gb736e75~b7759
Change-Id: I4def341aad97cb039c11ec45be2846d0fb691435
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 9 Sep 2019 10:58:25 +0000 (12:58 +0200)]
Report: Add dnv mrr data
Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 Sep 2019 10:16:36 +0000 (12:16 +0200)]
Report: Fix tsh and dnv plots
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 Sep 2019 07:01:18 +0000 (09:01 +0200)]
Report: Add soak tests
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 6 Sep 2019 17:41:15 +0000 (17:41 +0000)]
Report: Fix2 - Add 3n-dnv plots and tables
Change-Id: Ia182e6e52a37f9b3248eab60ffe4dd4746ed7fa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 3 Sep 2019 20:33:45 +0000 (22:33 +0200)]
docs: add select list of tests for report - tsh and dnv
Change-Id: I63a69d998c80029422bae9f90e186eb2286196d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Thu, 5 Sep 2019 08:33:12 +0000 (10:33 +0200)]
Support new sw_interface_slave_details CRC
Change-Id: I2f72a741ac7353ad36f6a2dada26eabb1a76cb2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 5 Sep 2019 14:15:19 +0000 (16:15 +0200)]
Read environment variables in Constants.py
Instead of using EnsureGlobalVariable,
which is clunky to use from Python.
As a consequence, all caps variables from Constants.py are used directly
and tests/__init__.robot and robot_enhancements.robot are deleted.
+ Rename the CRC global kill switch based on ci-man review.
Change-Id: I10723792475bc83352bf8c3b7f7946ecf885a194
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 6 Sep 2019 07:43:53 +0000 (09:43 +0200)]
Report: Fix - Add 3n-dnv plots and tables
Change-Id: I5f09f1f20e532e71d6abde02111a90f5868035f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 6 Sep 2019 06:13:09 +0000 (08:13 +0200)]
Report: Add 3n-dnv plots and tables
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 12:01:09 +0000 (14:01 +0200)]
Report: Add 2n-dnv plots and tables
Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 08:49:33 +0000 (10:49 +0200)]
Report: Add DNV data
Change-Id: I020373b1553300459654ded31d940b0a5562eb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 4 Sep 2019 11:13:08 +0000 (13:13 +0200)]
Allow CRC checking to be controlled via env var
The plan is to override the default in some (but not all) jobs.
The csit-vpp jobs shall do the checking, but vpp-csit jobs shall not
(except api-crc job of course) in order to confirm benign changes.
Change-Id: If59d17991de3fb0e847113a87e0533a8ee62af7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 07:54:39 +0000 (09:54 +0200)]
Report: Fix listing order of new vs. see footnote
Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 06:40:20 +0000 (08:40 +0200)]
Report: Fix hsw vs. skx comparison table
Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 06:27:10 +0000 (08:27 +0200)]
Report: Fix fonts in release notes table
Change-Id: I4a3486c313c4aa4754c455389b8ebb363ead469a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 5 Sep 2019 06:20:32 +0000 (08:20 +0200)]
Report: Configure Report 1908.37
Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 2 Sep 2019 21:28:30 +0000 (23:28 +0200)]
FIX: Use vhost macs when testpmd_mac forwarding used in VM
Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Mon, 2 Sep 2019 12:13:19 +0000 (14:13 +0200)]
Clarify why 9000B tests are skipped for IPsec
Ticket: VPP-1207
Change-Id: I506b4a24dfa6b10578407b261926f37215a714f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 4 Sep 2019 10:51:50 +0000 (12:51 +0200)]
Report methodology: PLRsearch update with graphs
Change-Id: Ib73a64c93bdba3945b8237783a24134b47d4eb99
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Wed, 4 Sep 2019 11:56:55 +0000 (12:56 +0100)]
docs: report vpp performance rls notes update.
Change-Id: Ie4a7a80cad9ff92b9f30953096cca8a029edc687
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 4 Sep 2019 11:11:54 +0000 (12:11 +0100)]
docs: report packet_throughput_graphs text formatting fixes.
Change-Id: Ibea6e70e2fcf9cfeb7627ee1cbcfa6e177c0b2c6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Wed, 4 Sep 2019 08:33:49 +0000 (10:33 +0200)]
Hotfix: Bump version and CRCs
Naginator caused a false Verified+1,
so a benign API change had been merged prematurely.
Change-Id: I8852ca684cba4876d46049ca34204ebbccf96b2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Wed, 4 Sep 2019 09:04:40 +0000 (09:04 +0000)]
Doc: Report release notes (perf)
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c1667efec67febd375818bc1dfe1d9bebc70708
Maciek Konstantynowicz [Wed, 28 Aug 2019 13:41:07 +0000 (14:41 +0100)]
docs: added methodology terminology section to report.
Change-Id: Id787d12b577165a1081dba84b610c32df57a7c44
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Mon, 2 Sep 2019 18:29:05 +0000 (19:29 +0100)]
docs: report updates in physical_testbeds section.
Change-Id: Id31e6ed294dc80619a108296be580925509bb7d7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 3 Sep 2019 21:16:30 +0000 (22:16 +0100)]
docs: updated report intro in packet_throughput_graphs
Change-Id: I3bf70cc7e48ef2134841bc4bf9300cda6a118cb3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 3 Sep 2019 21:37:45 +0000 (22:37 +0100)]
docs: added 3n-tsh testbed tests to report_test_groups.txt
Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Wed, 4 Sep 2019 07:21:26 +0000 (09:21 +0200)]
Report: ixgbe for tsh
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 4 Sep 2019 06:47:28 +0000 (08:47 +0200)]
Report: Add data
Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 20:26:25 +0000 (20:26 +0000)]
Report: Comparison tables
Change-Id: I108e1292c5de8024060c220b877b668b8843c68f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 17:52:02 +0000 (17:52 +0000)]
Report: Comparison tables
Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 12:08:37 +0000 (14:08 +0200)]
Report: Comparison tables
Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 09:07:36 +0000 (11:07 +0200)]
Report: add data
Change-Id: I51fd0b9e07d09224452f842689925d1166246f19
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 06:56:27 +0000 (08:56 +0200)]
CSIT-1590: Performance comparison analysis
Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 3 Sep 2019 06:45:31 +0000 (08:45 +0200)]
CSIT-1590: Performance comparison analysis
Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 2 Sep 2019 16:48:37 +0000 (18:48 +0200)]
PAL: list all sel tests in table_performance_comparison
Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 2 Sep 2019 13:52:06 +0000 (15:52 +0200)]
PAL: list all sel tests in table_performance_comparison_nic
Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 2 Sep 2019 13:11:20 +0000 (15:11 +0200)]
Report: Add data
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 2 Sep 2019 11:55:41 +0000 (13:55 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~129_g5c89fbf~b7728
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
129-g5c89fbf28
- use new vpp ref build - centos7:
20.01-rc0~129_g5c89fbf~b7728
Change-Id: Ie11a1fddd8f2e1c27e45a4b231a09fbdeced9c24
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Sun, 1 Sep 2019 05:51:07 +0000 (05:51 +0000)]
Add: Testpmd VM test
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id39667515e304f4d92f230f82d3f1dbc1e22ac32
Tibor Frank [Mon, 2 Sep 2019 10:32:32 +0000 (12:32 +0200)]
Report: Add 3n-tsh
Change-Id: I6027b635191c7e64397915df8944699bb320daf3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 26 Aug 2019 03:41:53 +0000 (05:41 +0200)]
Report: functional tests static content
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 30 Aug 2019 09:55:42 +0000 (11:55 +0200)]
Report: Add data
Change-Id: Ie9350530879fef7d2ae8c0b58f6fd799fde9fff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Wed, 28 Aug 2019 12:38:34 +0000 (13:38 +0100)]
presentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model.
Change-Id: I90dd569ce42fe6bf29751ca29086fe458d40a095
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Wed, 28 Aug 2019 19:09:21 +0000 (21:09 +0200)]
Report: Add data
Change-Id: I5ae5fa7cb40ddc31e3fe3fd0d6182bf54c84ad00
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 26 Aug 2019 09:03:38 +0000 (11:03 +0200)]
Report: Add data
Change-Id: I66c91e083138b50a575cbbd32d309d0c198e6a71
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Tue, 20 Aug 2019 16:07:21 +0000 (17:07 +0100)]
docs: created full list of tests for report detailed results.
Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 20 Aug 2019 12:51:51 +0000 (13:51 +0100)]
docs: created select list of tests for report and trending.
Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Ludovit Mikula [Tue, 27 Aug 2019 11:51:18 +0000 (11:51 +0000)]
NEW: Added trex profiles for 60k ip4 destinations.
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ib9e42914ad5ab6bf0febea3edbeea8d09c8918b1
Dave Wallace [Tue, 27 Aug 2019 21:02:07 +0000 (17:02 -0400)]
DOC: 1908rls release notes for VPP Hoststack TCP performance tests.
Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Vratko Polak [Wed, 21 Aug 2019 15:36:21 +0000 (17:36 +0200)]
Bump DPDK version
VPP has bumped it in https://gerrit.fd.io/r/c/vpp/+/21406
Change-Id: I32a950134f5e93b3c68e3748ab9aaaec2dde2d5a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Sun, 25 Aug 2019 20:11:02 +0000 (21:11 +0100)]
docs: added csit tests job specs.
Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Thu, 22 Aug 2019 12:15:09 +0000 (14:15 +0200)]
Delete unused SR keywords
Trim both Python (L1) and Robot (L2) keywords,
as no test performs SR related deletions.
Change-Id: Ic76d870c3f58e927ea222b350e149d0770985072
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 27 Aug 2019 09:46:48 +0000 (11:46 +0200)]
Report: Add data
Change-Id: I534cbb4141b60609387f894e51c429e368520a23
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Ludovit Mikula [Mon, 26 Aug 2019 11:39:39 +0000 (11:39 +0000)]
- Removed 9000B test cases from ipsec test suites.
- Added new traffic profiles.
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e
Vratko Polak [Fri, 23 Aug 2019 15:02:04 +0000 (17:02 +0200)]
Stop using SSH() in TrafficGenerator.py
This is a partial fix for:
Ticket: CSIT-1434
and should fix one pylint violation.
Many files to remove SSH() from remain.
+ Use -E (together with previous -S) in ssh.py when sudo=True.
Needed in some cases, no downsides expected.
Change-Id: Ie2ad03b3c656a4d3965a61a1e5435276f99a28c0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 15:13:25 +0000 (17:13 +0200)]
Report: Comp Tables
Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 13:46:29 +0000 (15:46 +0200)]
Report: tables
Change-Id: Ideec743ae10909d91625ea5cfc7901624459f455
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 13:29:04 +0000 (15:29 +0200)]
Report: NFV
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 12:32:48 +0000 (14:32 +0200)]
Report: Tables
Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Code Review / csit.git / log