Jan Gelety [Mon, 13 Mar 2017 08:10:34 +0000 (09:10 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
418-g374e2c5~b2044_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-weekly/6/
Change-Id: I33d7846534f28e91979b20ddff117cb41c1e1394
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Mon, 27 Feb 2017 12:56:22 +0000 (13:56 +0100)]
HC Test: create Vlan sub-interface using netconf
- add netconf test for specific issue HC2VPP-60
Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Fri, 20 Jan 2017 16:17:43 +0000 (17:17 +0100)]
SPAN test - improvement of packet check
Change-Id: Ic95fbe288495ee4cd75178d74c220f6af5d2b11a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 22 Feb 2017 08:06:27 +0000 (09:06 +0100)]
CSIT-530: Add common setup and teardown to perf tests
Change-Id: I2e76de710b4b758eac1d24d447a9c5938f937385
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 6 Mar 2017 09:29:20 +0000 (10:29 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
353-g6f6f52a~b1979_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/5/
Change-Id: I0b3a2be26a263f61f150e85d3b484984fa6539b3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Matej Klotton [Wed, 1 Mar 2017 14:34:37 +0000 (15:34 +0100)]
Change DPDK Stable version
Change-Id: I5e0f0e40226d059c65b084886e37c68d56ea271f
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Jan Gelety [Mon, 27 Feb 2017 14:05:42 +0000 (15:05 +0100)]
Use common files to store distro related data for VIRL
- use separate files to store VIRL topology file and VIRL image file
version information per distro
- read content of appropriate files in all affected bootstrap files
Change-Id: I5297ddd610af6a719efaf5792ced12efab35fc7a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Neale Ranns [Sat, 25 Feb 2017 14:23:37 +0000 (14:23 +0000)]
Remove unused VRF paramter from IP neighbour Add/del
Change-Id: I4a348c696e4cacbf5aa0723f2b8070bbcce7666c
Signed-off-by: Neale Ranns <nranns@cisco.com>
selias [Tue, 28 Feb 2017 15:28:25 +0000 (16:28 +0100)]
HC Test: Add missing VAT template - interface vrf dump
Change-Id: I5bf26d4091b86cb8e4f4efa4eb4a4793c758ebbb
Signed-off-by: selias <samelias@cisco.com>
selias [Tue, 21 Feb 2017 10:51:01 +0000 (11:51 +0100)]
HC Test: update plugin-ACL tests
- improve packet trace logging after each test
- suppress IPv6RA on VPP because it interfered with ipv6 test cases
- do not use fictional destination MAC address, doesn't work in VIRL
- ignore errors when logging configuration - should not fail the test
Change-Id: I16a3321670d4c2fa8f6434dc4badd243b7e4f9fc
Signed-off-by: selias <samelias@cisco.com>
pmikus [Fri, 24 Feb 2017 06:54:59 +0000 (07:54 +0100)]
Add libpcap-dev package as dependency on physical TB
Due to adding pypcap into pip requirement for VIRL we need to add
libpcap-dev package on physical TB
Change-Id: I5a86f7104111d016f1fa941b382de13383dbd064
Signed-off-by: pmikus <pmikus@cisco.com>
Tibor Frank [Tue, 14 Feb 2017 13:09:11 +0000 (14:09 +0100)]
CSIT-339: Add Keywords for SMT
- modify keywords in CpuUtils.py
- add RF keywords
Change-Id: I57230b3948254e8f149b2563a8e24e948bc2ec27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Matej Klotton [Wed, 15 Feb 2017 16:01:59 +0000 (17:01 +0100)]
Add symlink to nodes on Virl
Change-Id: I3351787787419ef97897ad436cfb71c812af79ba
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Matej Klotton [Mon, 30 Jan 2017 18:31:41 +0000 (19:31 +0100)]
VIRL test: Dot1Q-L2BD-vhost_user test (CSIT-502)
- Create test cases to test Dot1Q+L2BD+vhost_user IPv4 and IPv6
scenarios
Change-Id: I0823e2d22a36fce236c037cfda27d588ebcd1cc5
Signed-off-by: Matej Klotton <mklotton@cisco.com>
selias [Fri, 17 Feb 2017 10:59:15 +0000 (11:59 +0100)]
CSIT-522 HC Test: tests for secondary IP address
- fix and update ipv4 and ipv6 tests
- add tests for ipv6 neighbor and vrf-id
- add tests for secondary IP address on ipv4, ipv6
Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f
Signed-off-by: selias <samelias@cisco.com>
Matej Klotton [Mon, 16 Jan 2017 07:55:05 +0000 (08:55 +0100)]
VIRL test: eth2p-ethip4-ip4base-eth-2vhost-1vm
Change-Id: Icd21df2568df78f83f67d6ce36491afecb91d8f9
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Matej Klotton [Mon, 30 Jan 2017 11:36:34 +0000 (12:36 +0100)]
Add pypcap python requirement
Using pypcap's L2listen instead of standard AF_PACKET scapy can
see received Dot1Q tag.
Change-Id: Icb3dcb272a9611158a26a83fede7550bba3f367e
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Matej Klotton [Fri, 17 Feb 2017 12:18:43 +0000 (13:18 +0100)]
QemuUtil lib change to work with ubuntu and centos
- replace nc to socat for comunicating with qemu QGA
- change disk type to use virtio driver
- add check to bind only network interface for testpmd
Change-Id: I19ab16cbd8fec1ec78263ccfb1309a144e5af845
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Neale Ranns [Fri, 17 Feb 2017 21:09:54 +0000 (21:09 +0000)]
The interface must be assigned to the VRF and then given a prefix
Change-Id: I6a2fc503989576f806413ae98845e3e3676889b8
Signed-off-by: Neale Ranns <nranns@cisco.com>
Jan Gelety [Mon, 20 Feb 2017 18:25:30 +0000 (19:25 +0100)]
Fix of centos bootstrap and dut_setup.sh
Change-Id: I9fc3a74bf6356bdccee16c977df86567e91b4acf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Mon, 20 Feb 2017 18:25:30 +0000 (19:25 +0100)]
Fix VPP install packages paths for semiweekly job
Change-Id: Ifabd7dd00b53007202b593ac492c5f869aa8dab5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Mon, 20 Feb 2017 09:27:50 +0000 (10:27 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
270-g6e9cf3b~b1891_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/3/
Change-Id: I961c512a0e5b380c3e7d1dec52ba25e45432fa2d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Mon, 20 Feb 2017 09:49:01 +0000 (10:49 +0100)]
HC Test: hc2vpp bootstrap script fix
Trying to scp both *.deb and *.rpm packages in one command will
not work if only one of them exists.
Change-Id: I9692efff309eb7eac64dd45873ee455fbbb48a86
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Wed, 15 Feb 2017 11:23:51 +0000 (12:23 +0100)]
Implement support of Centos7 for semiweekly job
- adapt bootstrap-vpp-verify-semiweekly.sh script to be able to
run with Centos7 distro
- adapt script to download vpp pkgs to be able to download
Centos7 release packages
- changes are needed for Jenkins job
csit-vpp-verify-{branch}-centos7-semiweekly
Change-Id: Iddb5d2867b83615eeaaa1f08359138c31a3e5607
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Fri, 17 Feb 2017 11:00:12 +0000 (12:00 +0100)]
HC Test: reorder commands in HC package download script
Change-Id: I5e1ca7619704758f44b51154be62e40dd27e3117
Signed-off-by: selias <samelias@cisco.com>
selias [Wed, 15 Feb 2017 09:36:14 +0000 (10:36 +0100)]
HC Test: address job failures
- make HC package download script correctly use the OS variable
- force HC restart after netconf suite, to clean up leftover interfaces
- remove EXPECTED_FAILING tag from vhost-user suite, VPP bug was fixed
- add EXPECTED_FAILING tag to reflexive test case of plugin-acl suite
Change-Id: Id56eb52a5e22718de31aa5bef27159a5a531b244
Signed-off-by: selias <samelias@cisco.com>
Matej Klotton [Thu, 16 Feb 2017 07:18:00 +0000 (08:18 +0100)]
Fix ssh prompts for centos
Change-Id: I864f97b4559fc1d692bfba80266150a3d06dd6bb
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Tibor Frank [Mon, 30 Jan 2017 10:38:17 +0000 (11:38 +0100)]
CSIT-514: Kill Qemu when it does not respond
Change-Id: Id13c7fd51e693a273637c80cb35a159434be4826
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Matej Klotton [Tue, 14 Feb 2017 06:45:01 +0000 (07:45 +0100)]
Fix Centos Virl deployment and image build want list
Change-Id: I65d54fff4f936444bed3382ee21a260cf718bafd
Signed-off-by: Matej Klotton <mklotton@cisco.com>
selias [Thu, 1 Dec 2016 09:11:53 +0000 (10:11 +0100)]
HC Test: ACL updates
- update low level ACL based on yang model changes
- remove ietf-ACL test suite and test data and keywords
- add ACL-plugin test suite, test data and keywords
The ietf model of ACLs is no longer supported in Honeycomb. It has
been replaced by the ACL plugin.
Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9
Signed-off-by: selias <samelias@cisco.com>
selias [Tue, 7 Feb 2017 12:49:03 +0000 (13:49 +0100)]
HC Test: Update sNAT tests due to API changes
- add protocol value to expected VAT data
- add protocol value to snat_static_mapping_dump parser
- add temp workaround for returned "error:misc" on Ubuntu14.04
Change-Id: I42776b62b04eac65d03dcae1ec6a386a765b2e52
Signed-off-by: selias <samelias@cisco.com>
selias [Tue, 7 Feb 2017 12:39:31 +0000 (13:39 +0100)]
HC Test: Add temporary workaround for VAT issues on Ubuntu14.04
Some VAT commands return "error:misc" in addition to their normal
JSON output. This causes the JSON parser to complain about extra data.
Change-Id: I0da9739f371998dd6e2e6d6f70c1e8a3d82b6350
Signed-off-by: selias <samelias@cisco.com>
selias [Mon, 6 Feb 2017 09:42:00 +0000 (10:42 +0100)]
HC Test: Add branch and os parameters to honeycomb scripts
- partial cherrypick of https://gerrit.fd.io/r/4933
- add OS argument to scripts in preparation for Ubuntu16 and Centos7
Change-Id: I14119703be0f73766a731478e09e0126078f84ba
Signed-off-by: selias <samelias@cisco.com>
Jan Gelety [Wed, 8 Feb 2017 11:51:31 +0000 (12:51 +0100)]
Introduce simple VAT history per test case
- print list of VAT commands executed per DUT node during the test
case in the func test teardown
Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Mon, 13 Feb 2017 09:29:49 +0000 (10:29 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
231-ge4ad8cc~b1855_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/1/
Change-Id: Ibd405c9de7dd75c3ab989987487bbbe4405d006e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Tue, 7 Feb 2017 11:58:47 +0000 (12:58 +0100)]
CSIT-518: Add testpmd numa awareness
Change-Id: I982834de1fbe71cf5303808ea58d4b58e530ffcb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 9 Feb 2017 12:27:33 +0000 (13:27 +0100)]
Enable to pass vpp pacakges to VIRL in case of vpp patch
Change-Id: Ibab23153b698470e640530c44d95ca6f3c4898b2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Thu, 2 Feb 2017 11:45:16 +0000 (11:45 +0000)]
Upgrade T-rex to newer version
Change-Id: I8b918a3c1d8109fb64bfdeec8e5c9afe45a86d21
Signed-off-by: pmikus <pmikus@cisco.com>
Maciek Konstantynowicz [Tue, 7 Feb 2017 18:52:35 +0000 (18:52 +0000)]
csit rls1701 report nits and updates:
- Completed paragraph for each thput and latency graph in report describing: graphs title, x-axis, y-axis, legend.
Change-Id: Ia45e2da2623b909123f6b3d4abe65e6caf72e058
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Jan Gelety [Mon, 6 Feb 2017 09:13:57 +0000 (10:13 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build:
- build tested by semiweekly job: 17.04-rc0~
200-g460bc63~b1824_amd64
https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1080/
Change-Id: I5a17095bccf1e8b11dc2a0f52cfd27a8621f6f74
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 3 Feb 2017 10:26:37 +0000 (11:26 +0100)]
CSIT-517: DPDK initialization and teardown
Change-Id: Iff42549e3be610c88b7a7d5518ef2cbb88c75ed2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 6 Feb 2017 13:06:12 +0000 (14:06 +0100)]
CSIT doc autogen: Add media wiki format
Change-Id: I4231cf4f056b2370e0a7a7f8a7267859bbeccd6f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 17 Jan 2017 13:16:06 +0000 (14:16 +0100)]
Add perf tests for DPDK L2XC
- 10ge2p1vic1227-eth-l2xcbase-ndrdisc
- 10ge2p1x710-eth-l2xcbase-ndrdisc
- 40ge2p1vic1385-eth-l2xcbase-ndrdisc
- 40ge2p1x1710-eth-l2xcbase-ndrdisc
Change-Id: I1bd125c5d384fbece47d885a950226990e801837
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 6 Feb 2017 16:45:24 +0000 (16:45 +0000)]
Fix: Add apt-get update for report-gen
Change-Id: Id98c370be0a74b16667dd3b43fc44e36c286fdf0
Signed-off-by: pmikus <pmikus@cisco.com>
Maciek Konstantynowicz [Sun, 5 Feb 2017 16:33:28 +0000 (16:33 +0000)]
csit rls1701 report edits:
- simplified section structure for clarity and readability,
- updated overview sections,
- moved not rls related content from rls_notes to overview sections,
- removed section title suffixes: HW, VIRL.
- completed vpp_unit_tests and vpp_unittest_results sections.
- updated all documentation sections.
- updated rls_notes sections for vpp performance and vpp functional.
Change-Id: Id2c2abbf9d3531ec9f63ecd353f385a0b55ae1ba
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Fri, 3 Feb 2017 20:58:06 +0000 (20:58 +0000)]
Revert "Fix: CSIT 1701 report files and script AD1"
This reverts commit
8e3e798d302bef12d490c2963056bbcceedb8b13.
Change-Id: I90c40e51b2f0e364ca33fb92fa36f8cae3e5829c
Signed-off-by: pmikus <pmikus@cisco.com>
Peter Mikus [Fri, 3 Feb 2017 20:50:59 +0000 (20:50 +0000)]
Fix: CSIT 1701 report files and script AD1
fix libxslt-dev package
Change-Id: I9ee8f23faa3a30a4e5894045b8375f983d05adc1
Signed-off-by: pmikus <pmikus@cisco.com>
pmikus [Wed, 1 Feb 2017 17:54:58 +0000 (18:54 +0100)]
CSIT 1701 report files and script AD1
CSIT 1701 report files and script addendum 1
Edits to correct and align all Overview sub-sections.
Updates in Performance CSIT Release Notes - added more NDR and PDR performance changes.
Change-Id: I52b6ee89e9c536fb4ab9d30dc27cca8dbdd88a20
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
Peter Mikus [Thu, 2 Feb 2017 08:34:47 +0000 (08:34 +0000)]
Fix: Timeout during VPP installation
Increase timeout during installation of VPP packages to 60s.
Change-Id: I9384564a45951bbfb648c99f25d8de70b79ab783
Signed-off-by: pmikus <pmikus@cisco.com>
Tibor Frank [Fri, 3 Feb 2017 08:21:28 +0000 (09:21 +0100)]
CSIT-516: Add keywords for 2-node topology
Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Matej Klotton [Thu, 2 Feb 2017 15:03:59 +0000 (16:03 +0100)]
Mark ipv4 ipfix test as non-critical
Change-Id: I8998cbc08979340a680d872fab48bfeca8091365
Signed-off-by: Matej Klotton <mklotton@cisco.com>
pmikus [Tue, 17 Jan 2017 14:32:46 +0000 (15:32 +0100)]
CSIT 1701 report files and script
Add RST source files and script to generate CSIT 1701 report
Change-Id: I4345564547270ba10c64d6beebf2c2b5a83de459
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
Tibor Frank [Fri, 27 Jan 2017 13:50:31 +0000 (14:50 +0100)]
CSIT doc: Add chapter numbering
Change-Id: I5cdcda0461e6f4bdabd91ea440edf7a71db9afd9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
selias [Mon, 30 Jan 2017 17:29:33 +0000 (18:29 +0100)]
HC Test: Fix jvpp workaround for 17.04
- original commit at https://gerrit.fd.io/r/4683
Change-Id: I0b2d77f66830fbbc2d27e9015ec67ea9cd9a9885
Signed-off-by: selias <samelias@cisco.com>
Tibor Frank [Mon, 30 Jan 2017 15:49:30 +0000 (16:49 +0100)]
Add exception processing to output.xml parser
Change-Id: Ie7d7a004ae540233efcb3c3114d46d40d5d1f07d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 30 Jan 2017 10:32:33 +0000 (11:32 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
175-gd9aad29~b1798_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1078/
Change-Id: Ib51e4fc98edf463ea440dbeb655956382e11b5c6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
selias [Tue, 17 Jan 2017 15:59:03 +0000 (16:59 +0100)]
CSIT-506: HC Test- Update and cleanup all suites
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU
- fix bridge domain removal with interfaces assigned, it should fail
- fix teardown of L2 FIB suite (bridge domain removal, see above)
- disable vhost-user "server" test cases (VPP bug)
- fix keyword verifying sub-interface state
- update ACL test data (yang model changes)
- remove EXPECTED_FAILING tag from ACL table removal test
- update Jira IDs and comments in failing Lisp test case
- remove EXPECTED_FAILING tag from Lisp removal test case
- use vhost-user "client" instead of "server" in persistence tests
Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49
Signed-off-by: selias <samelias@cisco.com>
selias [Fri, 13 Jan 2017 16:40:57 +0000 (17:40 +0100)]
HC Test: Workaround for 17.04 jvpp version mismatch
- add workaround for mismatched jvpp versions in deb packages
- disable NSH_SFC madule and test suite, it depends on outdated jvpp
- cleanup package download script used in hc2vpp-csit-verify job
Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac
Signed-off-by: selias <samelias@cisco.com>
Miroslav Miklus [Tue, 25 Oct 2016 21:25:09 +0000 (23:25 +0200)]
CSIT-507: Add perf tests for Cisco VIC-1385 L2BD
- 40ge2p1vic1385-eth-l2bdbasemaclrn-ndrdisc
Change-Id: I8e1f49b5d41a81544b8a03dd2d6be98c97b94d28
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Miroslav Miklus [Fri, 28 Oct 2016 09:57:19 +0000 (11:57 +0200)]
CSIT-508: Add perf tests for Cisco VIC-1227 L2BD
- 10ge2p1vic1227-eth-l2bdbasemaclrn-ndrdisc
Change-Id: Ib0e99f8160ca951b58b0244de88fa587e61bd941
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Thomas F Herbert [Wed, 18 Jan 2017 23:28:55 +0000 (18:28 -0500)]
Add Centos specific bootstrap files.
Add download and install script for rpms.
Add topology virl file for Centos.
Change VPP repo urls for centos.
JIRA: CSIT-356
Change-Id: I3a0a88958a712d1b652f19c76e5e1b019796d0ae
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
pmikus [Thu, 26 Jan 2017 12:55:55 +0000 (13:55 +0100)]
Fix: Display of PDR latency
Fix the string in PDR latency output
Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853
Signed-off-by: pmikus <pmikus@cisco.com>
Tibor Frank [Tue, 24 Jan 2017 12:04:23 +0000 (13:04 +0100)]
CSIT-511: Add script to generate report with TC results
Change-Id: Iee1c3310e445487bb216c4e9c6a3bc7ee7879788
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Jan 2017 07:35:19 +0000 (08:35 +0100)]
CSIT-512: Add x710, xl710 l2bd vhost tests
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc
Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952
Signed-off-by: Tibor Frank <tifrank@cisco.com>
selias [Mon, 23 Jan 2017 17:14:46 +0000 (18:14 +0100)]
csit-func-hc naming change
- change test suite filenames
- add numbering to all test cases
more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change
Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a
Signed-off-by: selias <samelias@cisco.com>
Tibor Frank [Wed, 25 Jan 2017 11:20:31 +0000 (12:20 +0100)]
CSIT doc gen: remove "package" and change "module" to "suite"
Change-Id: I36664eb4c1ade7c2c96df457ed939f8681ba2dce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Thomas F Herbert [Wed, 25 Jan 2017 00:27:23 +0000 (19:27 -0500)]
Centos 7.3 image Version 1.2 Add dhcp client to VIRL base image
Change-Id: Ibedc2002f26824cc763eb2ff62de09d5f262e0c3
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
Jan Gelety [Wed, 25 Jan 2017 12:32:01 +0000 (13:32 +0100)]
Remove _base from test suite dir names
Change-Id: I2e495f99a88dedc47f64efcc14722bb629a25f02
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 24 Jan 2017 12:41:23 +0000 (13:41 +0100)]
Correction of dpdk packages download when vpp deb packages provided
Change-Id: I7cefd0797103e5062eb48df95ad2e48cdddc19b6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 17 Jan 2017 13:50:46 +0000 (14:50 +0100)]
csit-func-tc-naming-change - phase 1
- change of ts directories
- change of ts file names
- splitting of former files to more files when suitable
- more details:
https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change
Change-Id: Ifda1038f8323735f86c1be7ba7f93e3fda183618
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Thu, 19 Jan 2017 11:06:49 +0000 (12:06 +0100)]
CSIT-509: Add perf tests for vlan + l2 + vhost
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 23 Jan 2017 09:38:34 +0000 (10:38 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
134-g2ce7f98~b1759_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1076/
- use new path for DPDK packages
Change-Id: I1001ee3a22817f97a60b3a6555e3026d2b153913
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Matej Klotton [Fri, 20 Jan 2017 14:33:47 +0000 (15:33 +0100)]
Mark VXLAN test as non critical
Change-Id: I1a788de4106d7e71d8cad6b68759b9a01d21bb4a
Signed-off-by: Matej Klotton <mklotton@cisco.com>
pmikus [Thu, 19 Jan 2017 09:53:19 +0000 (10:53 +0100)]
Fix: Adjust NDRCHK threshold values
Adjust treshold values in NDRCHK tests based on latest data.
Change-Id: I10f39b9a1a071bf0b38c91f904361ad7f54ccc92
Signed-off-by: pmikus <pmikus@cisco.com>
pmikus [Tue, 17 Jan 2017 08:43:24 +0000 (09:43 +0100)]
Add unified latency output for PDRDISC and NDRDISC
Add same latency formatting for PDR as for NDR search results.
This will help us to parse the data in same way.
Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b
Signed-off-by: pmikus <pmikus@cisco.com>
Tibor Frank [Fri, 13 Jan 2017 13:41:08 +0000 (14:41 +0100)]
Renaming of all perf TCs.
Change-Id: Id71abf4f52d7fc555ed9c3ec19563d54f5db9ec5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Fri, 13 Jan 2017 12:33:03 +0000 (13:33 +0100)]
Update: robot parser scripts
Update robot parser script due to new naming and TAG structure
Change-Id: I963de747d2c88dadcb2d3fa48747fb2ef1403294
Signed-off-by: pmikus <pmikus@cisco.com>
Jan Gelety [Mon, 16 Jan 2017 12:02:45 +0000 (13:02 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
105-g5a3a6c0~b1730_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1074/
Change-Id: Ied08466e0aafee1913697873596a43d416e2cc65
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Matej Klotton [Tue, 17 Jan 2017 11:14:23 +0000 (12:14 +0100)]
VIRL test: Replace IP probe for VXLAN test
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477
Signed-off-by: Matej Klotton <mklotton@cisco.com>
Jan Gelety [Mon, 9 Jan 2017 08:18:15 +0000 (09:18 +0100)]
VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6
scenarios
Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 13 Jan 2017 08:58:06 +0000 (09:58 +0100)]
Tags for tests with IPSec.
Change-Id: Ic06bd15de44303f99133fa0df83319b5568b64dd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 12 Jan 2017 11:55:05 +0000 (12:55 +0100)]
Update: plot script for new tags
Update plot script based on the change in TC TAGS
Change-Id: I9412e38d4306b69c75b16943b64b987c2553c167
Signed-off-by: pmikus <pmikus@cisco.com>
Tibor Frank [Wed, 11 Jan 2017 14:02:13 +0000 (15:02 +0100)]
CSIT-501: Perf tests re-tagging
- Implement tags introduced by https://gerrit.fd.io/r/#/c/3856/
Change-Id: I59313f43f338e2b4a1ad5caf9521b1a0da84d1d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Tue, 10 Jan 2017 14:07:57 +0000 (15:07 +0100)]
Clean up bootstrap-verify-perf file
Remove obsolete code from performance bootstrap file
Change-Id: I8486c000ee4049b390017a1bf96459ec9fc828ea
Signed-off-by: pmikus <pmikus@cisco.com>
Fangyin Hu [Fri, 25 Nov 2016 11:52:22 +0000 (03:52 -0800)]
Add the DPDK l2fwd performance test cases.
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
pmikus [Wed, 11 Jan 2017 08:32:52 +0000 (09:32 +0100)]
Fix: Crypto-dev TB3 topology changes
- Add crypto device into TB3 topology file
- Change the @PCI after new device insertion
Change-Id: I7fabe3173506c473982490fe24976b68ab45430c
Signed-off-by: pmikus <pmikus@cisco.com>
selias [Fri, 16 Dec 2016 14:28:39 +0000 (15:28 +0100)]
CSIT-482: HC Test - NAT
- add NAT test suite
- add keywords and methods for configuring and reading NAT settings
- add test data used in NAT suite
Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38
Signed-off-by: selias <samelias@cisco.com>
pmikus [Wed, 16 Nov 2016 15:45:05 +0000 (16:45 +0100)]
CSIT-469 Rename performance suites
Rename performance suites and add more TAGS
Change-Id: I6a5251bb6e380fe2a47a6ec1c1aeb4a9f70c5ce3
Signed-off-by: pmikus <pmikus@cisco.com>
selias [Mon, 9 Jan 2017 15:10:17 +0000 (16:10 +0100)]
HC Test: Fix log archiving in honeycomb tests
Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced
Signed-off-by: selias <samelias@cisco.com>
pmikus [Tue, 10 Jan 2017 07:06:23 +0000 (08:06 +0100)]
Fix: Add prefix to elements of output-perf-xml
Robot results parser is using names of suites to create XML with
performance data. This patch is supposed to fix the situation when
the name of suite starts with digit. This leads to issue that
final XML is not valid.
Change-Id: I0046da4ff62f661de07f8e659ae511610c8c61f8
Signed-off-by: pmikus <pmikus@cisco.com>
Tibor Frank [Thu, 5 Jan 2017 08:16:14 +0000 (09:16 +0100)]
CSIT-499: Perf Tests - VXLAN + L2BD + vhost
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost
Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 9 Jan 2017 08:36:35 +0000 (09:36 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
64-gf952692~b1689_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1072/
Change-Id: I6e760f4145ee5c31f34f725c9d9d923575688410
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Mon, 2 Jan 2017 12:49:22 +0000 (12:49 +0000)]
Fix pylint messages
Change-Id: I78ca27169f7f0fd6d786f222684e4c482ae54a43
Signed-off-by: pmikus <pmikus@cisco.com>
Tibor Frank [Mon, 2 Jan 2017 13:58:34 +0000 (14:58 +0100)]
CSIT-498: Packet throughput L2BD with VXLANoIPv4
- Add performance tests for packet throughput L2BD with VXLANoIPv4
Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Thomas F Herbert [Tue, 15 Nov 2016 23:59:48 +0000 (18:59 -0500)]
Add Centos 7 image to CSIT.
JIRA: CSIT-256
JIRA: CSIT-490
libpcap and Qemu version 2.3.0
Centos 7.3 support added from 7.3.1611 base image.
Change-Id: Ia4ebe22980206cade4beb87760a455ca18f9fbfc
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
Jan Gelety [Mon, 2 Jan 2017 11:03:38 +0000 (12:03 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.04-rc0~
25-gfdc62ab~b1650_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1070/
Change-Id: I7eadc339053cfeff99103308660933eb3362f046
Signed-off-by: Jan Gelety <jgelety@cisco.com>
pmikus [Tue, 20 Dec 2016 07:17:16 +0000 (08:17 +0100)]
CSIT-488 TLDK jbb validation jobs need cmake installed
Add cmake into VIRL Ubuntu image
Change-Id: I2cd33a58c0043a2c3e04809d1f73068520767929
Signed-off-by: pmikus <pmikus@cisco.com>
pmikus [Wed, 21 Dec 2016 08:51:47 +0000 (09:51 +0100)]
Fix: Qemu wait_until_vm_boot
There is an issue that booting Nested VM is successful but
QGA guest-ping or flush returns partial response. This fix suppose
to do checking until an error or timeout occurs. In case of QGA
returns correct response it is success. In case of partial
response it will log an error and continue in checking.
Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9
Signed-off-by: pmikus <pmikus@cisco.com>
Jan Gelety [Mon, 19 Dec 2016 08:54:08 +0000 (09:54 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build: 17.01-rc0~
256-gbd6462e~b1592_amd64
- build tested by semiweekly job:
https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1065/
Change-Id: I70019095a41c5e8bc8a15c472c608b77124cbe7f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Sat, 17 Dec 2016 07:13:45 +0000 (07:13 +0000)]
Pylint fixes
- fix Map.py
Change-Id: I0241e655df12f8135884e48d14c8eea43c501323
Signed-off-by: pmikus <pmikus@cisco.com>