Jan Gelety [Mon, 2 Sep 2019 11:55:41 +0000 (13:55 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~129_g5c89fbf~b7728
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
129-g5c89fbf28
- use new vpp ref build - centos7:
20.01-rc0~129_g5c89fbf~b7728
Change-Id: Ie11a1fddd8f2e1c27e45a4b231a09fbdeced9c24
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Sun, 1 Sep 2019 05:51:07 +0000 (05:51 +0000)]
Add: Testpmd VM test
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id39667515e304f4d92f230f82d3f1dbc1e22ac32
Tibor Frank [Mon, 2 Sep 2019 10:32:32 +0000 (12:32 +0200)]
Report: Add 3n-tsh
Change-Id: I6027b635191c7e64397915df8944699bb320daf3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 26 Aug 2019 03:41:53 +0000 (05:41 +0200)]
Report: functional tests static content
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 30 Aug 2019 09:55:42 +0000 (11:55 +0200)]
Report: Add data
Change-Id: Ie9350530879fef7d2ae8c0b58f6fd799fde9fff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Wed, 28 Aug 2019 12:38:34 +0000 (13:38 +0100)]
presentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model.
Change-Id: I90dd569ce42fe6bf29751ca29086fe458d40a095
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Wed, 28 Aug 2019 19:09:21 +0000 (21:09 +0200)]
Report: Add data
Change-Id: I5ae5fa7cb40ddc31e3fe3fd0d6182bf54c84ad00
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 26 Aug 2019 09:03:38 +0000 (11:03 +0200)]
Report: Add data
Change-Id: I66c91e083138b50a575cbbd32d309d0c198e6a71
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Maciek Konstantynowicz [Tue, 20 Aug 2019 16:07:21 +0000 (17:07 +0100)]
docs: created full list of tests for report detailed results.
Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Tue, 20 Aug 2019 12:51:51 +0000 (13:51 +0100)]
docs: created select list of tests for report and trending.
Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Ludovit Mikula [Tue, 27 Aug 2019 11:51:18 +0000 (11:51 +0000)]
NEW: Added trex profiles for 60k ip4 destinations.
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ib9e42914ad5ab6bf0febea3edbeea8d09c8918b1
Dave Wallace [Tue, 27 Aug 2019 21:02:07 +0000 (17:02 -0400)]
DOC: 1908rls release notes for VPP Hoststack TCP performance tests.
Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Vratko Polak [Wed, 21 Aug 2019 15:36:21 +0000 (17:36 +0200)]
Bump DPDK version
VPP has bumped it in https://gerrit.fd.io/r/c/vpp/+/21406
Change-Id: I32a950134f5e93b3c68e3748ab9aaaec2dde2d5a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Sun, 25 Aug 2019 20:11:02 +0000 (21:11 +0100)]
docs: added csit tests job specs.
Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Thu, 22 Aug 2019 12:15:09 +0000 (14:15 +0200)]
Delete unused SR keywords
Trim both Python (L1) and Robot (L2) keywords,
as no test performs SR related deletions.
Change-Id: Ic76d870c3f58e927ea222b350e149d0770985072
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 27 Aug 2019 09:46:48 +0000 (11:46 +0200)]
Report: Add data
Change-Id: I534cbb4141b60609387f894e51c429e368520a23
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Ludovit Mikula [Mon, 26 Aug 2019 11:39:39 +0000 (11:39 +0000)]
- Removed 9000B test cases from ipsec test suites.
- Added new traffic profiles.
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e
Vratko Polak [Fri, 23 Aug 2019 15:02:04 +0000 (17:02 +0200)]
Stop using SSH() in TrafficGenerator.py
This is a partial fix for:
Ticket: CSIT-1434
and should fix one pylint violation.
Many files to remove SSH() from remain.
+ Use -E (together with previous -S) in ssh.py when sudo=True.
Needed in some cases, no downsides expected.
Change-Id: Ie2ad03b3c656a4d3965a61a1e5435276f99a28c0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 15:13:25 +0000 (17:13 +0200)]
Report: Comp Tables
Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 13:46:29 +0000 (15:46 +0200)]
Report: tables
Change-Id: Ideec743ae10909d91625ea5cfc7901624459f455
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 13:29:04 +0000 (15:29 +0200)]
Report: NFV
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 12:32:48 +0000 (14:32 +0200)]
Report: Tables
Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Aug 2019 11:40:39 +0000 (13:40 +0200)]
Report: Modify comparison tables, add data
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Sun, 25 Aug 2019 12:05:34 +0000 (14:05 +0200)]
FIX: Copy-paste typo in 2n-10ge2p1x710-eth-l2bd-6ch-48vh-24vm1t-vppip4-ndrpdr.robot
Change-Id: Ibe231547e26d9b379554eec8ca6a9b4d7bc1224b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 19 Aug 2019 13:25:47 +0000 (15:25 +0200)]
Report: Select tests by name, specifications
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 23 Aug 2019 15:00:29 +0000 (17:00 +0200)]
Introduce reconfig suites, for dot1q+ip4+vxlan
Ticket: CSIT-1551
+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
+ Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
- Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
- Only 1 additional chain.
+ Proper TAGs. Documented.
+ Clarified min framesize tags are for TG-DUT.
+ Added a TODO concerning overhead values.
+ Added 118B tag.
+ Robot performance keywords improvements.
+ Added missing return value documentation.
+ Frame size as required test variable, not an explicit argument.
+ MLRsearch keyword to store result (not into test message).
- TODO: De-duplicate: main keyword to measure, minor to set test message.
- But implementation uses the fact default arguments are different.
+ Keywords for starting and stopping background traffic.
- No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
- Support also vlan_per_chain=True?
- Support dot1q without vxlan?
- Support also deletion?
- How to package config steps so -reconf can be generated from -ndrpdr?
Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 22 Aug 2019 13:04:34 +0000 (15:04 +0200)]
Improve PLRsearch yet again
Logic improvements for rls1908 and post-pylint fixes:
+ Reduce search time to 30 minutes.
+ Use average instead alternating loads.
+ Rework log/exp avg/stdev from two estimates.
+ Introduce and use pessimistic variance of dual trackers.
+ Introduce safe_exp to use when None does not skip code.
+ Use dot relative imports (instead of disabling pylint).
+ Complete docstrings for simpler functions.
+ Append docstrings to named tuples.
+ Somewhat unify docstrings related to the same arguments.
+ Slightly improve intentation.
+ State named tuples as rtype where used.
+ Add returns and rtype to __repr__ where missing.
+ Return what docstring say (or update them).
+ Explicit copying for vector and matrix values.
Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 22 Aug 2019 08:08:15 +0000 (10:08 +0200)]
Update CRC list comments
+ Add testcases and tag expressions for perf occurrences.
+ Add TNL_1 tag for single tunnel IPsec suites.
- Some CRCs were missing before, but form a pair with a listed CRC.
- Probably the other half of the pair is not used.
- Will be fixed in subsequent Change.
Change-Id: I5754210755c13c41226b71045813714a65a1cdf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 20 Aug 2019 08:52:11 +0000 (10:52 +0200)]
Report: Specify groups of tests for graphs
Groups of tests for graphs:
- Packet Throughput
- Packet Latency
- Speedup Multi-Core
Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 21 Aug 2019 06:26:09 +0000 (08:26 +0200)]
Add: 2-node ip4 oacl tests
Change-Id: I786fe9f75777e1cd0daee70bc350185dd7fd17e1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Miroslav Los [Thu, 15 Aug 2019 17:08:47 +0000 (19:08 +0200)]
Framework: simplify CpuUtils
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I7682d802f405070e34f72bc4a80cbe6a63b03619
Peter Mikus [Tue, 20 Aug 2019 09:51:54 +0000 (09:51 +0000)]
Add: avf-dot1q testcases
+ Few fixes in doc
+ Align testcases
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f
Vratko Polak [Tue, 20 Aug 2019 14:25:51 +0000 (16:25 +0200)]
Fix Initialize layer dot1q on node
By using Get Variable Value keyword.
Change-Id: I3a9650b6f802d60422ffa6b6b00d444ebb050d89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 20 Aug 2019 10:45:10 +0000 (12:45 +0200)]
Bump stable vpp version to 20.01-rc0~68
After API change.
CSIT: https://gerrit.fd.io/r/c/csit/+/21245
VPP: https://gerrit.fd.io/r/c/vpp/+/18361
+ Add ip_probe_neighbor_reply CRC, not sure how that got missing.
Change-Id: I790875dab771981af3b9eceac5425d4d2f374984
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Wed, 7 Aug 2019 19:07:26 +0000 (21:07 +0200)]
Interface API cleanup
CSIT code alignment with API changes in VPP introduced
by patch https://gerrit.fd.io/r/c/vpp/+/18361
Change-Id: Ib0357bba79f55d297ef1086fbf3b760caca16cdb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Mon, 19 Aug 2019 11:49:07 +0000 (11:49 +0000)]
Align NF_denisty tests
+ Apply layer approach for interfaces
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea
Peter Mikus [Mon, 19 Aug 2019 14:48:47 +0000 (14:48 +0000)]
Add: NF_density combinations
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9ba859cf8ecb2d65c90ec7c6f75dc3e353e74de9
Vratko Polak [Mon, 19 Aug 2019 13:58:43 +0000 (15:58 +0200)]
VPP perf per patch: Reverse the order of tests
If current VPP is broken, we want to fail early.
If there is API change, we are more interested in current results,
even if parent is likely to fail.
Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 16 Aug 2019 13:48:02 +0000 (15:48 +0200)]
Autogen: Create NICs for TCP suites.
+ Put Regenerator internal functions ourside class.
+ Duplicate into _default_ and _tcp_ functions.
+ Rework Testcase to be a single class with two factories.
+ Improve suite and testcase naming.
Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 16 Aug 2019 07:37:31 +0000 (09:37 +0200)]
PAL: Select tests by name, functions
- throughput
- latency
- speedup
Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 19 Aug 2019 11:26:01 +0000 (13:26 +0200)]
Report: Add data
- DPDK
Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 19 Aug 2019 11:02:56 +0000 (13:02 +0200)]
PAL: Get DPDK version from output_info.xml
Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Miroslav Los [Thu, 15 Aug 2019 18:41:51 +0000 (20:41 +0200)]
Framework: MLRSearch refactor of ndrpdr
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I86bc69f8b2f38b58cb3eb030bec7d0ce5c79d040
Miroslav Los [Fri, 16 Aug 2019 13:09:39 +0000 (15:09 +0200)]
Framework: Refactor complex functions in PLRSearch
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25
Peter Mikus [Mon, 19 Aug 2019 08:13:28 +0000 (08:13 +0000)]
TB: Move T24 back into production
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia5521c8efe0322f4d9160a21dacb803321ea68ee
Peter Mikus [Mon, 19 Aug 2019 06:39:27 +0000 (06:39 +0000)]
FIX: Missing ACL library
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1497a9b031603d09d69a29ed7167686848d4b7c5
Tibor Frank [Mon, 19 Aug 2019 06:05:54 +0000 (08:05 +0200)]
Write DPDK version to log
Change-Id: Ia9ec0d420c8db9e71234f74e4013c21d039931b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 16 Aug 2019 06:47:53 +0000 (06:47 +0000)]
FIX: Topology reservation
Last attempt [0] is doing more harm then good. If testbed is down
but recovered quickly enough (reboot, temporary ssh connectivity
issue, ...) it never gets back into pool making other testbeds
overloaded and queued.
This patch is suppose to partially revert previous behavior until
proper patch will follow.
[0] https://gerrit.fd.io/r/c/csit/+/21148
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3
Mohammed Naser [Thu, 15 Aug 2019 15:30:21 +0000 (11:30 -0400)]
labs: add new Cascade Lake IPs
This patch adds the IP addresses for all the new Cascade Lake
machines inside the FD.io labs.
Signed-off-by: Mohammed Naser <mnaser@vexxhost.com>
Change-Id: Icc35aac52cb04c9dcf4e2fa682fcbe24e7007d63
Peter Mikus [Fri, 16 Aug 2019 09:15:41 +0000 (09:15 +0000)]
FIX: Small errors in ansible
- that prevents installation
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4fe4694ab7479481481aacc2eb550058bd7618e6
Peter Mikus [Fri, 16 Aug 2019 09:21:09 +0000 (09:21 +0000)]
TB: Move t31 in, move t24 out
- Good news,
- Bad news
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I104b079ae2201e76300c41ee859dfc4b57ce7278
Tibor Frank [Fri, 16 Aug 2019 07:41:06 +0000 (09:41 +0200)]
PAL: Process show runtime output 3
- format the table
Change-Id: I871251a8329e5d52c527c93afe35d875bddaed0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 16 Aug 2019 05:48:54 +0000 (05:48 +0000)]
TOX: Make tc_naming voting.
- We get to 0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5c079248c1fc2383c399e5034aa46b570c5c1dce
Tibor Frank [Fri, 16 Aug 2019 06:20:07 +0000 (08:20 +0200)]
PAL: Process show runtime output 2
- format the tables
Change-Id: I31f786d53b79fa14c5d2dc21ff65d0465fde1d4f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Miroslav Los [Thu, 15 Aug 2019 10:57:35 +0000 (12:57 +0200)]
Refactor traffic profile verification
- CSIT-1194
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I0f4c234fb5f5f6543a5d525301f17f5a111e1053
Tibor Frank [Thu, 15 Aug 2019 11:12:57 +0000 (13:12 +0200)]
PAL: Process show runtime output
Change-Id: If7eac41cd33837eea7291f87129e2c176fbe6aea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 13 Aug 2019 10:10:50 +0000 (10:10 +0000)]
TOX: DOC verify
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b
Jan Gelety [Tue, 13 Aug 2019 20:57:07 +0000 (22:57 +0200)]
FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear down
Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Thu, 15 Aug 2019 07:00:38 +0000 (09:00 +0200)]
Add testbed info to output_info.xml
Change-Id: I2ff45926a754647c1be6263cf8e5e0c7cbfedfef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 15 Aug 2019 06:36:36 +0000 (06:36 +0000)]
Reduce disabled pylint to address them not hide
+ Fixed Qemu
- Broad Exception should be addressed
- Policer is about to be refactored
- Drop search to be refactored
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I97eb992497ff6334057bf82a0f413387706e17fd
Peter Mikus [Wed, 14 Aug 2019 14:49:54 +0000 (14:49 +0000)]
FIX: VM startup after socket move
+ Still workaround for VPP bug not creating dir at startup
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8b87ac70e5f85d538a25058dcb5453f89e21498f
Dave Wallace [Tue, 6 Aug 2019 22:26:00 +0000 (22:26 +0000)]
VAT-to-PAPI: Fix HTTP/TCP tests
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Miroslav Los [Wed, 14 Aug 2019 15:29:33 +0000 (17:29 +0200)]
DO_NOT_MERGE CSIT-1194 - Framework easy pylint improvements
- force a python2 environment in tox for pylint
- let pylint load some compiled modules for member checking
- allow locally enabled pylint rules
- ignore bad enum names
- ignore complexity for code to be refactored by other tickets
- broad excepts are acceptable sometimes
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: If4c3a1b85e8609f074e1de8ce91fc9c4fedbeb38
Peter Mikus [Wed, 14 Aug 2019 12:30:06 +0000 (12:30 +0000)]
Move: WRK installation into ansible
- Remove ability to install from framework.
- Control via ansible with other dependencies.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315
Peter Mikus [Wed, 14 Aug 2019 09:00:54 +0000 (09:00 +0000)]
FIX: Container VPP pid detection
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47163aa9ee0114f13ab17badde773560243ce319
Tibor Frank [Wed, 14 Aug 2019 14:08:08 +0000 (16:08 +0200)]
Report: Add data
- Dry runs
- fix table 'VPP Soak vs NDR 2n-skx'
Change-Id: I1fb101ab1b7cc40de49e8bb564818a730d3853a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 14 Aug 2019 11:41:15 +0000 (13:41 +0200)]
Report: Add data
- Dry runs
Change-Id: Ib6e50853b5b4638dc0f4bc93a98b3818f5079658
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 13 Aug 2019 08:20:26 +0000 (10:20 +0200)]
Revert "Disable CRC checking at runtime"
Needed to verify CSIT expects the correct CRCs.
This reverts commit
d541b2b7d99651b53bd21ff75cd5fdacf8472a98.
This reverts commit
2dd27f5a638b5231c0f074ca61e6b67fed9d1faf.
+ Some pylint related improvements since then.
+ Less and better documented caching to class fields.
+ Global kill switch in Constants.
Change-Id: Id459800744cd93c578eab9c2e84cb9528235b064
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Wed, 7 Aug 2019 14:47:34 +0000 (14:47 +0000)]
FIX: Vhost teardown
If test failed before vnf_manager is created then teardown
does fail as well due to missing variable.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0b23648bce78738cf4c377979d7a06fb488d990d
Vratko Polak [Tue, 13 Aug 2019 12:19:29 +0000 (14:19 +0200)]
Add show memory to show_vpp_statistics
https://lists.fd.io/g/csit-dev/message/2867
Change-Id: I8934218f2ccac9a458cec37e71e403db7d49281c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 14 Aug 2019 06:49:30 +0000 (08:49 +0200)]
PAL: Archiving of input data
Change-Id: I0902613047d7543378a4b7d46811fc67776c6ad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 14 Aug 2019 06:27:27 +0000 (06:27 +0000)]
Reduce VIRL paralel simulations
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I04c97231f1ce6f98ad16bc3662da62d7d8af0a01
Tibor Frank [Fri, 9 Aug 2019 10:45:27 +0000 (12:45 +0200)]
Report: Download first from logs.fd.io
Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 13 Aug 2019 12:18:32 +0000 (14:18 +0200)]
PAL: Get DPDK Version
- Needed for trending
Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 12 Aug 2019 08:14:57 +0000 (08:14 +0000)]
FIX: Vhost tests in latest VPP nightly
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I26ec27b00e5cd48143a2389f2ff41ed876a7a013
Tibor Frank [Tue, 13 Aug 2019 10:24:18 +0000 (12:24 +0200)]
PAL: Get TG IP address from output_info.xml
Change-Id: I566c0e436fbe50e5e72da35be6a2afc81e8a33b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 13 Aug 2019 09:31:25 +0000 (11:31 +0200)]
Add testbed info to output_info.xml
- Needed for trending
Change-Id: I59fc115ce62d1ad839e7c8a39c74af0497b9012d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 13 Aug 2019 07:25:56 +0000 (07:25 +0000)]
FIX: Remove TB31 from pool
- SSD failure on t31-dut2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I82bec2f78341f3e8ea5647d9781910e89461c327
Peter Mikus [Fri, 9 Aug 2019 12:46:42 +0000 (12:46 +0000)]
Clean: Various libraries
- Remove translate TC as they have no perf opposite
- Remove unused keywords
- Merge similar keywords / rename
- Move keywords from perf library to categories
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6433006136e2497ad8fb17193aa20c578d836999
Jan Gelety [Wed, 7 Aug 2019 19:21:58 +0000 (21:21 +0200)]
FIX: if MAC address must be updated after AVF interface creation
Change-Id: I9fc26a7d1bf8d9eed620173a73febe3d874a1351
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 12 Aug 2019 08:00:53 +0000 (10:00 +0200)]
Report: data
Change-Id: Id51e073d23d7bb54864eb5fd1c3c320077e6abb8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 9 Aug 2019 13:13:12 +0000 (15:13 +0200)]
Report: Data
Change-Id: Ibd1a5dc6e451d992eb85b223973734c876e37fe7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 12 Aug 2019 06:11:10 +0000 (06:11 +0000)]
FIX: Remove unwanted Jenkins dependency
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7a43c3183dc276fa5e4806f31a52cf5844792d4d
Peter Mikus [Fri, 9 Aug 2019 10:14:34 +0000 (10:14 +0000)]
Clean: L2 bridge domain
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca
Vratko Polak [Thu, 8 Aug 2019 13:11:38 +0000 (15:11 +0200)]
Skip bad testbeds in reservation
Previously, ssh-inaccesible testbeds
were handled the same way as reserved,
never ending the wait loop.
With this, if no testbed is accessible,
the job fails early.
Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Wed, 7 Aug 2019 09:14:15 +0000 (11:14 +0200)]
FIX: macip_acl_rule needs binary mac data
Change-Id: I0d26b2b31f0ce7497c91b4ae965f9cc45a66ef0c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Fri, 9 Aug 2019 10:32:59 +0000 (12:32 +0200)]
Bump VPP stable version: socksvr
VPP changed the default socket path in:
https://gerrit.fd.io/r/c/vpp/+/21100
Instead of "default", explicit value is used now.
It coincides with VPP default one,
and is stored in Constants.py (except documentation).
The file name for robot side forwarded socket remains,
as the path leading to is is different anyway.
Change-Id: I0058d16794a3cd04411640c2c8d5fd4ee8cb997d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 8 Aug 2019 12:15:16 +0000 (12:15 +0000)]
Clean: L2_xconnect keywords
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic15a15c426db04defc15840883a772a0eb8e4885
Tibor Frank [Fri, 9 Aug 2019 07:42:04 +0000 (09:42 +0200)]
Trending: Fix ipsec
Change-Id: I0f35098047bc1137cbf2a1ae39107698b1e9bf79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 9 Aug 2019 07:48:43 +0000 (07:48 +0000)]
DOC: rls1908 static content
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382
Tibor Frank [Fri, 9 Aug 2019 07:09:33 +0000 (09:09 +0200)]
Report: Configuration
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 9 Aug 2019 06:58:34 +0000 (08:58 +0200)]
Trending: Set 90 days period
Change-Id: I56403c30142876501602fe06c0ad2665fa73cb7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 9 Aug 2019 06:05:03 +0000 (08:05 +0200)]
Trending: TSH ipsec tests
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 8 Aug 2019 11:31:26 +0000 (11:31 +0000)]
Clean: L2_patch
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib3620689acb3641b2ec9a49e2ce552bab3f00eef
Peter Mikus [Thu, 8 Aug 2019 11:20:49 +0000 (11:20 +0000)]
Clean: Interface Keywords
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ideddcea56120cf770aec78ca24813baf7d05ba11
Vratko Polak [Wed, 7 Aug 2019 15:54:50 +0000 (17:54 +0200)]
Fix: Deep-copy arguments in papi executors
Without this, it is not safe to re-use the original argument dicts
with additional edits for subsequent commands.
Change-Id: Ib4f67d09e6bf7438dfdf7669263957a42c8d4dbe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 8 Aug 2019 10:49:20 +0000 (10:49 +0000)]
Remove: Obsolete bash code
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ide17a2e2ae7e1311f00093c14f6c4879406e5868
Peter Mikus [Thu, 8 Aug 2019 10:34:29 +0000 (10:34 +0000)]
Remove obsolete bootstraps
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0fd3b85ef261185694e636f0b5d4556798815125
Tibor Frank [Thu, 8 Aug 2019 10:17:32 +0000 (12:17 +0200)]
Trending: Reduce ipsec tests
Change-Id: Ib164551d09ccf3ab5a95baade6d8b2744bc5ce16
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 8 Aug 2019 07:47:14 +0000 (09:47 +0200)]
Trending: ipsec
Change-Id: I2fc623ac152b8559a230b340be2f1cc92c7e934a
Signed-off-by: Tibor Frank <tifrank@cisco.com>