csit.git
2 years agoReport: perf improvemnets 77/9077/1
Tibor Frank [Fri, 27 Oct 2017 10:03:10 +0000 (12:03 +0200)]
Report: perf improvemnets

Change-Id: Ib5b822db59bfbb77683b3d59077fba584bfcbd37
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFix: table_performance_improvements 75/9075/2
Tibor Frank [Fri, 27 Oct 2017 08:56:01 +0000 (10:56 +0200)]
Fix: table_performance_improvements

Change-Id: I5052d47988c1644768ed6c8cdefc76dc1defb898
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Update data sources 73/9073/2
Tibor Frank [Fri, 27 Oct 2017 08:08:44 +0000 (10:08 +0200)]
Report: Update data sources

Change-Id: I3cec31d1db74330ef7ef8341c19f7fe1d5894b53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHC Test: Update tags in IPv6 control suite 65/9065/2
selias [Thu, 26 Oct 2017 15:33:54 +0000 (17:33 +0200)]
HC Test: Update tags in IPv6 control suite

 - remove EXPECTED_FAILING tag, IPv6 is no longer disabled
 - add HC_REST_ONLY tag, these tests should not be executed with ODL

Change-Id: I5c4ba8d08751e259d6ca158c2fb034660629916c
Signed-off-by: selias <samelias@cisco.com>
2 years agoReport: VPP documentation 57/9057/1
Tibor Frank [Thu, 26 Oct 2017 12:28:45 +0000 (14:28 +0200)]
Report: VPP documentation

Change-Id: Idda800c92f8c09404927fc88ef23cb4fd005f268
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHC Test: Mark BGP tests as expected_failing 55/9055/1
selias [Thu, 26 Oct 2017 11:39:39 +0000 (13:39 +0200)]
HC Test: Mark BGP tests as expected_failing

Change-Id: Id01088da3e01df7c110572ae0a22303f5f9a283c
Signed-off-by: selias <samelias@cisco.com>
2 years agoUpdate static report content - functional tests 53/9053/2
Jan Gelety [Thu, 26 Oct 2017 11:24:33 +0000 (13:24 +0200)]
Update static report content - functional tests

Change-Id: Ieded0a5d4fd7e15dce10bea3bcc023710ebe872c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoUpdate static report content - Honeycomb 48/9048/3
selias [Thu, 26 Oct 2017 10:14:48 +0000 (12:14 +0200)]
Update static report content - Honeycomb

Change-Id: I9f6612a4495df62f3a43c19457864a4eeff64a3d
Signed-off-by: selias <samelias@cisco.com>
2 years agoHC Test: cleanup expected_failing tags in routing suite 47/9047/2
selias [Thu, 26 Oct 2017 10:13:06 +0000 (12:13 +0200)]
HC Test: cleanup expected_failing tags in routing suite

Change-Id: I5ab5b784e77664291e1a40a2459964e7efe3d3af
Signed-off-by: selias <samelias@cisco.com>
2 years agoPAL: Implement changes in show-run output 41/9041/1
Tibor Frank [Thu, 26 Oct 2017 08:49:41 +0000 (10:49 +0200)]
PAL: Implement changes in show-run output

Change-Id: I2d28e048206d38179447e1d2ac8646ccffc97c8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate the static content 38/9038/3
Tibor Frank [Thu, 26 Oct 2017 08:33:19 +0000 (10:33 +0200)]
Update the static content

Change-Id: I8869bddef992f75707b740533a57ad80a3696e73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFix the NSH SFC functional test failed issue. 37/9037/1
Fangyin Hu [Thu, 26 Oct 2017 09:21:38 +0000 (02:21 -0700)]
Fix the NSH SFC functional test failed issue.

Change-Id: If118254b6479f7ffb3e0b4f81d3585b4b90cc92c
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
(cherry picked from commit 751a5aed2cac6bd7b87028eaf7eab1a8f87fface)

2 years ago Update the NSH protocol header fields 28/9028/3
Fangyin Hu [Thu, 26 Oct 2017 04:47:04 +0000 (21:47 -0700)]
Update the NSH protocol header fields
Fix the NSH SFC functional test cases failed issues.

Change-Id: I5d49b50a8c0958dc8db4bc10d6852f0cf4e77962
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2 years agoAdd link to pdf version 19/9019/1
Tibor Frank [Wed, 25 Oct 2017 15:19:33 +0000 (17:19 +0200)]
Add link to pdf version

Change-Id: I6a2d33284dff8a156a9231ded5e337db2ff5fb06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoAdd ligato test results 16/9016/2
Tibor Frank [Wed, 25 Oct 2017 13:37:08 +0000 (15:37 +0200)]
Add ligato test results

Change-Id: I107dd0430fb9d59264aeabc63f51d5e615509078
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add VPP func results 10/9010/1
Tibor Frank [Wed, 25 Oct 2017 07:43:12 +0000 (09:43 +0200)]
Report: Add VPP func results

Change-Id: Ice0b4cf2a960e8047191ff5e38789050c985d75e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add job ligato 1 97/8997/1
Tibor Frank [Tue, 24 Oct 2017 15:32:54 +0000 (17:32 +0200)]
Report: Add job ligato 1

Change-Id: I3e1a990ce472cf309efc9ddd3257b00a2a6a56f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoAdd ligato data to the report 90/8990/1
Tibor Frank [Tue, 24 Oct 2017 10:12:25 +0000 (12:12 +0200)]
Add ligato data to the report

Change-Id: Iadfa50ee1bc1a5930cb609835e316228567ceb53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate csit_design_picture.svg for rls17.10 85/8985/1
Tibor Frank [Tue, 24 Oct 2017 10:16:00 +0000 (12:16 +0200)]
Update csit_design_picture.svg for rls17.10

Change-Id: Iaa373e60c2b509e78ee905405cc9f20cce157757
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoSplit container sections in report 83/8983/3
Peter Mikus [Tue, 24 Oct 2017 08:37:11 +0000 (10:37 +0200)]
Split container sections in report

- Split Container Memif section and Container Orchestrated section
- Fix naming conventions

Change-Id: Icb8d0c92ad08f87b998aa20291eeae9958c36e43
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoChange release number to 17.10 74/8974/1
Tibor Frank [Tue, 24 Oct 2017 06:44:56 +0000 (08:44 +0200)]
Change release number to 17.10

Change-Id: I40ed4aee9d5b8a3727c056a8ba6563d760c635eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agorls1710 report: vpp performance methodology updates. 40/8940/3
Maciek Konstantynowicz [Fri, 20 Oct 2017 12:23:01 +0000 (13:23 +0100)]
rls1710 report: vpp performance methodology updates.

Change-Id: Ifc3b06dc8be0c82b8c424fb599eeac5a8e1f286f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoAdd DPDK results to the report 69/8969/1
Tibor Frank [Mon, 23 Oct 2017 15:48:26 +0000 (17:48 +0200)]
Add DPDK results to the report

Change-Id: If92a55bf74a0e6e41d4c37defed5bbf76fbec441
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoAdd vpp perf jobs to report 65/8965/1
Tibor Frank [Mon, 23 Oct 2017 13:17:35 +0000 (15:17 +0200)]
Add vpp perf jobs to report

Change-Id: Ieb041b31dc18b03a865c7128db1f32a2c5db2c0b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: CSIT Framework Documentation 37/8937/7
Tibor Frank [Fri, 20 Oct 2017 11:35:53 +0000 (13:35 +0200)]
Report: CSIT Framework Documentation

Change-Id: I2eba1183a5acdd1fb34efab16fc5c89e38dedb14
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate disk-image-builder scripts to allow IPv6 99/8499/12
selias [Fri, 22 Sep 2017 08:49:28 +0000 (10:49 +0200)]
Update disk-image-builder scripts to allow IPv6

Change-Id: I28ed08689db97eabc21726afa9d977fcda526dfb
Signed-off-by: selias <samelias@cisco.com>
2 years agoFIX: use correct IF name in Vpp Route Add in case of multi-VMs config 61/8961/4
Jan Gelety [Mon, 23 Oct 2017 11:47:45 +0000 (13:47 +0200)]
FIX: use correct IF name in Vpp Route Add in case of multi-VMs config

Change-Id: Iab5a6db1eac11798e2a3ec56f7d68043f6c8c2ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: IPSec tunnel interface 56/8956/1
Jan Gelety [Mon, 23 Oct 2017 10:56:04 +0000 (12:56 +0200)]
FIX: IPSec tunnel interface

- add following line per interface tunnel:
  set int unnum <ipsec> use <interface>

Change-Id: Iff75f27b7cf25f3d24eea92366b1fd4a718c253b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-806 Container Orchestration in CSIT - Low Level Design 20/8620/14
Peter Mikus [Mon, 2 Oct 2017 16:13:50 +0000 (16:13 +0000)]
CSIT-806 Container Orchestration in CSIT - Low Level Design

Change-Id: I993f1a4d0ae6332d2c7f9b170277bc726a1826cf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoRename all container based test following name conventions 39/8939/4
Peter Mikus [Fri, 20 Oct 2017 11:50:08 +0000 (13:50 +0200)]
Rename all container based test following name conventions

Change-Id: I84f6da2bede47e7ae35e6b4911d425d2402dbd1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFix: PDF - Add dpdk plots 34/8934/2
Tibor Frank [Fri, 20 Oct 2017 10:53:26 +0000 (12:53 +0200)]
Fix: PDF - Add dpdk plots

Change-Id: I0c76bfda6e84db4aee62b097282b9cf46fe51270
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoAdd csit-dpdk-perf-1710-all/2, 3 to testing data 32/8932/2
Tibor Frank [Fri, 20 Oct 2017 07:33:52 +0000 (09:33 +0200)]
Add csit-dpdk-perf-1710-all/2, 3 to testing data

Change-Id: I5e8cce83f179729df61afd506932310aba44e898
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoGenerate pdf 27/8927/1
Tibor Frank [Fri, 20 Oct 2017 06:23:47 +0000 (08:23 +0200)]
Generate pdf

Change-Id: I47ff419c8b9309cc73238c79acb3b395144929cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoAdd IPSEC tests to DAILY Jenkins job 84/8884/2
Tibor Frank [Wed, 18 Oct 2017 15:14:11 +0000 (17:14 +0200)]
Add IPSEC tests to DAILY Jenkins job

Change-Id: Ie4558b53a0c0a19b9fa24e951bcf0fcb320076b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate the dpdk version to 17.08 77/8877/7
Peter Mikus [Wed, 18 Oct 2017 14:07:46 +0000 (14:07 +0000)]
Update the dpdk version to 17.08

Change-Id: Idcf705d40f45c10c3c4dee694a80202d576b8026
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoPAL: do not generate pdf 13/8913/1
Tibor Frank [Thu, 19 Oct 2017 12:35:38 +0000 (14:35 +0200)]
PAL: do not generate pdf

Change-Id: Iab192d78491db9f8909ea708cf5dd588030f0b30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL test runs 09/8909/1
Tibor Frank [Thu, 19 Oct 2017 10:31:42 +0000 (12:31 +0200)]
PAL test runs

Change-Id: I8232b998fd00b5a09e7f9b72d4acb0f1140aade6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHC Test: Fix expected error when ACL table should be empty 04/8904/1
selias [Thu, 19 Oct 2017 08:56:02 +0000 (10:56 +0200)]
HC Test: Fix expected error when ACL table should be empty

Due to VATExecutor changes in https://gerrit.fd.io/r/8679

Change-Id: Iaecf6ff7b2562ff111a3afbce0ecbb2df00c62a9
Signed-off-by: selias <samelias@cisco.com>
2 years agoFIX: apply changes implemented for FIB settings 69/8869/7
Jan Gelety [Wed, 18 Oct 2017 08:24:14 +0000 (10:24 +0200)]
FIX: apply changes implemented for FIB settings

Change-Id: I00c3407f4324e282c438cb8fcd44470c331089c5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-834: Add HLD picture 73/8773/3
Tibor Frank [Thu, 12 Oct 2017 07:47:09 +0000 (09:47 +0200)]
CSIT-834: Add HLD picture

Change-Id: Ie64874c5555794ee70276f2a65d436337102b465
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-836: PDF format: Improvements in pdf layout 80/8780/16
Tibor Frank [Thu, 12 Oct 2017 10:47:56 +0000 (12:47 +0200)]
CSIT-836: PDF format: Improvements in pdf layout

CSIT-837: Scope of pdf version

Change-Id: Idfc9c04274c6635fbef14f87147665d31cfd7352
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-748 Add K8S 2memif-2vnf topologies 55/8855/4
Peter Mikus [Tue, 17 Oct 2017 12:17:49 +0000 (14:17 +0200)]
CSIT-748 Add K8S 2memif-2vnf topologies

Change-Id: I23e118bf9fc9cfd638ac3ec0589f2ced14cc240c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFIX: Log MACIP ACL settings only if test failed 59/8859/1
Jan Gelety [Tue, 17 Oct 2017 13:36:54 +0000 (15:36 +0200)]
FIX: Log MACIP ACL settings only if test failed

Change-Id: I6d51c662d8b23789adcd9c3d1b1e8736f71d5279
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-841 Optimize cheking k8s POD state 49/8849/2
Peter Mikus [Tue, 17 Oct 2017 06:13:14 +0000 (08:13 +0200)]
CSIT-841 Optimize cheking k8s POD state

Change-Id: Ie1725c0017b78945e431f493743f9a01a66e83c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoCSIT-828: Fix the output of failed VAT execution 79/8679/7
Jan Gelety [Thu, 5 Oct 2017 11:20:20 +0000 (13:20 +0200)]
CSIT-828: Fix the output of failed VAT execution

Change-Id: Id387bd685142dcfaa17f0236e930e40e6c0bce5a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-841 Optimize creating of vnf-agent docker image Part I 78/8778/16
Peter Mikus [Thu, 12 Oct 2017 09:06:58 +0000 (09:06 +0000)]
CSIT-841 Optimize creating of vnf-agent docker image Part I

- Optimize building of prod_vpp_agent docker image by using
  dev_vpp_agent docker image pulled from dockerhub/ligato instead of
  building on slave.
- Add detailed logs from every POD deployed in namespace.
- Hardening condition for considering PODs Running.

Change-Id: I9f771d6365d38fef2ec2e00ab642853e6a44ad03
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoCSIT-748 vnf-agent integration 04/8504/38
Peter Mikus [Fri, 22 Sep 2017 12:59:40 +0000 (14:59 +0200)]
CSIT-748 vnf-agent integration

CSIT-773 Implement RF keywords for k8s

- Implementation of Test Suite Setup for Ligato vnf-agent testing
- Implementation of KubernetesUtil for controlling kubectl
- Yaml templates for L2XC topology with 1cswitch and 1cnf
- Yaml templates for L2BD topology with 1cswitch and 1cnf
- ligato bootstrap script for creating vnf-agent image

Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFIX: Robotframework version. 69/8769/2
Peter Mikus [Thu, 12 Oct 2017 04:56:54 +0000 (04:56 +0000)]
FIX: Robotframework version.

Change-Id: I7fa8fb91bb3db6b62a4215a966bef74b7ec5be84
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoCSIT-811 HC Test: BGP tests - IPv4 CRUD 76/8676/8
selias [Fri, 29 Sep 2017 13:31:06 +0000 (15:31 +0200)]
CSIT-811 HC Test: BGP tests - IPv4 CRUD

Tests configure BGP neighbor peers and simple routes for these peers.

Change-Id: I5102986d710551a451e838d934cc9650bcd38a60
Signed-off-by: selias <samelias@cisco.com>
2 years agoCSIT-778: Add mac-ip binding acl l2bd perf test 38/8038/31
Jan Gelety [Mon, 14 Aug 2017 14:25:46 +0000 (16:25 +0200)]
CSIT-778: Add mac-ip binding acl l2bd perf test

Change-Id: Iaced68458b0e4070f861be7854ee428ae8ca4e13
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-672: SNAT44 multi-thread multi-core perf tests 31/8731/4
Tibor Frank [Tue, 10 Oct 2017 09:03:01 +0000 (11:03 +0200)]
CSIT-672: SNAT44 multi-thread multi-core perf tests

 - re-write existing tests using templates
 - add 2t2c, 4t4c tests

Change-Id: I7061f4cfe2304d625de6afcb85cad30695fe6faa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-755: Presentation and analytics layer 93/7993/81
Tibor Frank [Fri, 11 Aug 2017 08:44:36 +0000 (10:44 +0200)]
CSIT-755: Presentation and analytics layer

- CSIT-760: Configuration - real example
- CSIT-774: Implementation - parse configuration
- CSIT-779: Implementation - set environment
- CSIT-780: Implementation - download data
- CSIT-783: Implementation - debug mode
- CSIT-761: Implementation - Data pre-processing - parse input files
- CSIT-784: Implementation - Data pre-processing - store the data, access to data
- CSIT-789: Implementation - Data pre-processing - extract Documentation of the suite
- CSIT-757: Low Level Design
- CSIT-788: Implementation - Data pre-processing - extract VAT history and show runtime
- CSIT-785: Implementation - Data filtering
- CSIT-763: Presentation - tables
- CSIT-804: Presentation - files
- CSIT-762: Presentation - plots
- LLD: API + functional diagram
- CSIT-807: Element's models
- CSIT-813: Process static content
- CSIT-812: Report generation
- CSIT-764: Integration to CSIT
- CSIT-822: Archiving
- CSIT-790: Documentation
- configuration od the Input data is the same as for 17.07 report

Change-Id: I6fd1eb1df4af99eaf91925282cdee1c892698c59
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHC Test: mark NSH tests as expected_failing 14/8714/2
selias [Mon, 9 Oct 2017 14:46:30 +0000 (16:46 +0200)]
HC Test: mark NSH tests as expected_failing

NSH packages are not yet available in the stable.17.10 repositories

Change-Id: I660dcf667e1fcf42823a08345f4b0ec3d4cba7b1
Signed-off-by: selias <samelias@cisco.com>
2 years agoCSIT-775 HC Test: CRUD over IPv6 control-plane interface 81/8381/22
selias [Tue, 15 Aug 2017 17:33:50 +0000 (19:33 +0200)]
CSIT-775 HC Test: CRUD over IPv6 control-plane interface

Adds new test suite which accesses Honeycomb's Restconf and Netconf northbound
over IPv6. This is done by sending the requests to TG where an IPv4 to IPv6
tunnel is configured to the Honeycomb DUT.

Change-Id: I3b7467d8108b0da9756e632851215c66ed41bb61
Signed-off-by: selias <samelias@cisco.com>
2 years agoFIB table add/delete 43/8043/12
Neale Ranns [Mon, 14 Aug 2017 19:22:58 +0000 (12:22 -0700)]
FIB table add/delete

Change-Id: Icadb4884a1c08a2230fd4692df69310ce382ec94
Signed-off-by: Neale Ranns <nranns@cisco.com>
2 years agoCSIT-768: Refactor Python container libraries 41/8141/48
Peter Mikus [Mon, 21 Aug 2017 09:01:24 +0000 (11:01 +0200)]
CSIT-768: Refactor Python container libraries
CSIT-769: Implement L2 RF keywords for container orchestration

Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoHC Test: remove log check from HC startup 72/8672/4
selias [Thu, 5 Oct 2017 10:19:55 +0000 (12:19 +0200)]
HC Test: remove log check from HC startup

 - remove log check from "Check Honeycomb Startup State" keyword
 - fix workaround for ODL startup issue
 - change log level for HttpRequestError so it doesn't clutter
log.html output
 - update EXPECTED_FAILING tags for plugin-acl and routing suites

Change-Id: I7380d24801a6535bdf77505edada39ea2412e833
Signed-off-by: selias <samelias@cisco.com>
2 years agoCSIT-830: Add framesize tags to DPDK perf tests 56/8656/2
Tibor Frank [Wed, 4 Oct 2017 11:19:37 +0000 (13:19 +0200)]
CSIT-830: Add framesize tags to DPDK perf tests

Change-Id: I4ba3b5bac27a95b4529b3501a24a1f2d1ba27ed6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHC Test: increase timeout for archiving HC log file 25/8625/2
selias [Tue, 3 Oct 2017 08:32:35 +0000 (10:32 +0200)]
HC Test: increase timeout for archiving HC log file

 - add timeout parameter to ssh.scp method
 - increase timeout in "Archive Honeycomb Log" keyword
 - increase timeout for copying ODL client in setup

Change-Id: I9e914d5f439fd14471b10b611efdbb6afada4c6e
Signed-off-by: selias <samelias@cisco.com>
2 years agoHC Test: Fix intermittent failures of HC startup 75/8475/11
selias [Wed, 20 Sep 2017 13:47:39 +0000 (15:47 +0200)]
HC Test: Fix intermittent failures of HC startup

 - rework "check Honeycomb startup state" keyword
 - increase timeout value for startup
 - add separators to Honeycomb log file between test suites
 - other minor fixes:
    - remove usused import from NAT suite
    - fix loop in ICMPv6 ND proxy traffic script
    - add teardown to LISP cases
    - update prerequisites for sub-interface SPAN test

Change-Id: I2f714ffc1d2e8435d3abe690d8bd15099e071c9a
Signed-off-by: selias <samelias@cisco.com>
2 years agoFIX: Vhost tests waiting for VirtualEthernet UP 35/8535/5
Peter Mikus [Tue, 26 Sep 2017 10:41:35 +0000 (10:41 +0000)]
FIX: Vhost tests waiting for VirtualEthernet UP

Due to the change in VPP #8472
    When changing the admin state of a vhost-user interface, do not put
    it in link-up mode if the interface is not actually ready.

We have to remove "All Vpp Interfaces Ready Wait" for VirtualEthernet
interfaces.

Change-Id: I70d60b9f54a75b18b179f3315b636b763962acdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoHC Test: update ODL startup in hc2vpp jobs 42/8542/4
selias [Fri, 11 Aug 2017 07:33:56 +0000 (09:33 +0200)]
HC Test: update ODL startup in hc2vpp jobs

- mountpoint configuration through controller-config is deprecated. Use the
new method through odl-netconf-topology feature.

Change-Id: I1297622db7ab6a3853b3c97ab7f59c31b4269b6d
Signed-off-by: selias <samelias@cisco.com>
2 years agoAdd memif to TEST_TAG cases 21/8521/1
Jan Gelety [Mon, 25 Sep 2017 12:41:13 +0000 (14:41 +0200)]
Add memif to TEST_TAG cases

- implement possibility to manually triger memif perf tests in case
  of csit as well as vpp patch

Change-Id: I6bec350a496ba138bcb8ffb8da01c81672187bac
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-796: l2bd-memif perf tests 45/8445/11
Jan Gelety [Mon, 18 Sep 2017 11:01:35 +0000 (13:01 +0200)]
CSIT-796: l2bd-memif perf tests

Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoUpdate of VPP_STABLE_VER files 00/8500/1
Jan Gelety [Fri, 22 Sep 2017 08:50:01 +0000 (10:50 +0200)]
Update of VPP_STABLE_VER files

- we need to use the latest vpp build were vpp runs correctly in
  lxc/docker with dpdk plugin disabled in CSIT

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~334-gce41a5c~b2870_amd64

- use new vpp ref build - centos7:
  17.10-rc0~334_gce41a5c~b2867.x86_64

Change-Id: I87f306d0d7f6e78db8670a1969ae1a8e66b92c8a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoIgnore unexpected ICMPv6 Neighbor Discovery - Neighbor Solicitation packets 59/8359/4
Jan Gelety [Fri, 8 Sep 2017 09:38:38 +0000 (11:38 +0200)]
Ignore unexpected ICMPv6 Neighbor Discovery - Neighbor Solicitation packets

We need to adapt all functional traffic scripts related to functional
IPv6 tests to ingore receiving of unexpected ICMPv6ND_NS
(ICMPv6 Neighbor Discovery - Neighbor Solicitation) packets that are
sent automatically and we cannot avoid to receive them.

The reason is to prevent false negative test results in case of csit
functional tests that could block creation of new operational branch
(csit weekly jobs), usage of new vpp builds (csit semiweekly jobs)
and merging patches - csit as well as vpp.

Change-Id: I43c90e7c766762fa769a81661338759a11b401a1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoUpdate of VPP_STABLE_VER files and DPDK_STABLE_VER file 42/8442/1
Jan Gelety [Mon, 18 Sep 2017 07:15:22 +0000 (09:15 +0200)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~337-g2f9b0c0~b2873_amd64

- use new vpp ref build - centos7:
  17.10-rc0~337_g2f9b0c0~b2870.x86_64

- use new dpdk version>
  17.08-vpp1

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/73/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/73/

Change-Id: I20245e50f5acf93af5d2f2bfae0307f7774f0c3b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-665: Re-write L1 robot keywords in python 03/8203/10
Dasa Simkova [Thu, 24 Aug 2017 15:25:21 +0000 (17:25 +0200)]
CSIT-665: Re-write L1 robot keywords in python

Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149
Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>
2 years agoHC Test: re-enable NSH tests, minor fixes 22/8222/9
selias [Mon, 28 Aug 2017 10:47:29 +0000 (12:47 +0200)]
HC Test: re-enable NSH tests, minor fixes

NSH plugin was fixed in https://gerrit.fd.io/r/8218

- updated lispGPE test data
- added missing teardown to multi-IP traffic test
- marked L2-fib update revert case as failing

Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924
Signed-off-by: selias <samelias@cisco.com>
2 years agoUpdate of VPP_STABLE_VER files 94/8294/1
Jan Gelety [Mon, 4 Sep 2017 06:48:40 +0000 (08:48 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~263-gedfa2fd~b2799_amd64

- use new vpp ref build - centos7:
  17.10-rc0~263_gedfa2fd~b2796.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/69/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/69/

Change-Id: I510d288a4a5444f980769d7fd13ab1ff46d227a5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-786 L2FIB scale testing 45/8145/23
Peter Mikus [Mon, 21 Aug 2017 13:48:34 +0000 (15:48 +0200)]
CSIT-786 L2FIB scale testing

L2FIB scale testing for 10k, 100k, 1m FIB entries
 ./l2:
 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot
 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot
 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot
 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc
 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc
 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc

Change-Id: I7e3884bd5ab5294c289030a3465ec5b6def83cf7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoUpdate T-rex to v2.29 91/8291/2
Peter Mikus [Sun, 3 Sep 2017 16:25:49 +0000 (16:25 +0000)]
Update T-rex to v2.29

Change-Id: Id60525182cbe5870f40aebf165e8bd86c101d267
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFIX: SNAT -> NAT renaming of API 10/8210/8
Peter Mikus [Fri, 25 Aug 2017 10:51:57 +0000 (12:51 +0200)]
FIX: SNAT -> NAT renaming of API

- Based on https://gerrit.fd.io/r/#/c/8146/

Change-Id: I774483c7e2b419a9b9b6be78812ecf53a5c91eab
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFix: Do not validate LXC image 23/8223/2
Peter Mikus [Mon, 28 Aug 2017 11:52:12 +0000 (11:52 +0000)]
Fix: Do not validate LXC image

Change-Id: I476f463ad7dd91f1d80a1e4b537a2cb3dd4ddee5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoUpdate of VPP_STABLE_VER files 54/8154/5
Peter Mikus [Tue, 22 Aug 2017 05:30:17 +0000 (05:30 +0000)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  vpp-17.10-rc0~206-g5f22f4d~b2740_amd64-deb

- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/???/

NOTE: centos7 build not updated because of issue with deletion of tap interface

Change-Id: I1df4c10f40d983952c1dad4a94f2dcdb2534c00e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoUpdate T-rex to v2.28 93/8193/2
Peter Mikus [Thu, 24 Aug 2017 07:02:47 +0000 (09:02 +0200)]
Update T-rex to v2.28

Change-Id: I506589c3785eec3a2eaa9fdb32bfc3375388d6f4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoHC Test: Disable NSH plugin installation and tests 09/8209/1
selias [Fri, 25 Aug 2017 10:47:43 +0000 (12:47 +0200)]
HC Test: Disable NSH plugin installation and tests

 - VPP refuses to start with vpp-nsh-plugin installed

Change-Id: If1ca45295c63094d2542fc829b8eae7dc0e4977c
Signed-off-by: selias <samelias@cisco.com>
2 years agoCSIT-777: L2 keywords for MACIP ACL tests 19/8019/5
Jan Gelety [Mon, 14 Aug 2017 07:04:09 +0000 (09:04 +0200)]
CSIT-777: L2 keywords for MACIP ACL tests

Change-Id: I678d87770405105555ccc30ce0003f704d7ca82e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT-770 Installation of prerequisites on physical hosts 64/8064/2
Peter Mikus [Wed, 16 Aug 2017 09:32:13 +0000 (11:32 +0200)]
CSIT-770 Installation of prerequisites on physical hosts

- Update ansible to install kubernetes and docker

Change-Id: Ibf57d4fa697f7c9b58f2e4925387b0c4e8b67274
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoHC Test: cleanup test failures 53/7953/6
selias [Wed, 9 Aug 2017 08:50:46 +0000 (10:50 +0200)]
HC Test: cleanup test failures

 - have unnumbered interface cases use a real interface instead of local0
 - add EXPECTED_FAILING tag and Jira link to known failing test cases

Change-Id: I8bc0f4a74ea1949289a3f12dd54168acdf9edc39
Signed-off-by: selias <samelias@cisco.com>
3 years agoCSIT-777: L1 keywords for MACIP ACL tests 82/7982/3
Jan Gelety [Thu, 10 Aug 2017 14:47:47 +0000 (16:47 +0200)]
CSIT-777: L1 keywords for MACIP ACL tests

Change-Id: I90eb824cbabaaece6798812268177ad9bd4eff65
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 22/8022/1
Jan Gelety [Mon, 14 Aug 2017 07:54:56 +0000 (09:54 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~154-gb2215d6~b2690_amd64

- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/63/

NOTE: centos7 build not updated because of issue with deletion of tap interface

Change-Id: I937ea3d106f7e62ccd977bcd3114b17326912e82
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix: Memif API change 65/7965/2
Peter Mikus [Wed, 9 Aug 2017 11:23:19 +0000 (13:23 +0200)]
Fix: Memif API change

Due to changes in API in latest VPP, Memif/LXC test are failing.
This patch is supposed to change Memif config in LXC.

Change-Id: I5c3844fd7559eba948bcb5619c8969611eb200c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-767: Add acl 64B 4t4c perf tests 34/7934/3
Jan Gelety [Tue, 8 Aug 2017 13:08:15 +0000 (15:08 +0200)]
CSIT-767: Add acl 64B 4t4c perf tests

Change-Id: Id1b187c195c955d0e533d8d6864fff6a3fa8332e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT-611: HC Test: Lisp suite updates + LispGPE 17/7917/5
selias [Thu, 13 Jul 2017 11:15:41 +0000 (13:15 +0200)]
CSIT-611: HC Test: Lisp suite updates + LispGPE

 - added LispGPE test suite
 - added IPv6 tests to Lisp suite
 - added traffic tests to Lisp suite

Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b
Signed-off-by: selias <samelias@cisco.com>
3 years agoHC Test: re-enable VxLAN GPE test suite 62/7662/4
selias [Thu, 20 Jul 2017 07:53:05 +0000 (09:53 +0200)]
HC Test: re-enable VxLAN GPE test suite

VPP crash partially fixed in https://gerrit.fd.io/r/7267
Still occuring in IPv6 case.

Change-Id: Iff6cd99098c6273fc56940b475e5262889076775
Signed-off-by: selias <samelias@cisco.com>
3 years agoHC Test: test data updates for HC bump to ODL-Carbon dependencies 26/7926/2
selias [Wed, 7 Jun 2017 09:23:57 +0000 (11:23 +0200)]
HC Test: test data updates for HC bump to ODL-Carbon dependencies

related Honeycomb change: https://gerrit.fd.io/r/6924

Change-Id: I290a65428c8d64304be6e35dad5d21755a925f86
Signed-off-by: selias <samelias@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 23/7923/1
Jan Gelety [Mon, 7 Aug 2017 08:35:39 +0000 (10:35 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~121-g63a46fc~b2656_amd64

- use new vpp ref build - centos7:
  17.10-rc0~121_g63a46fc~b2653.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/61/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/61/

Change-Id: Ifea4b98550c28619289a170508a20e496aaa30b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoUse 100kpps step for ACL 64B perf tests 20/7920/1
Jan Gelety [Mon, 7 Aug 2017 07:01:01 +0000 (09:01 +0200)]
Use 100kpps step for ACL 64B perf tests

ACL 64B tests take a long time. Usage of 100kpps will provide results
with adequate accurancy and test exectuion time.

Change-Id: I6818963f3ce16b9aaae72cf579294f87d10a24a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFix: Release report PDF generation bug 78/7878/2
Peter Mikus [Wed, 2 Aug 2017 11:17:35 +0000 (13:17 +0200)]
Fix: Release report PDF generation bug

QXcbConnection: Could not connect to display

Change-Id: Ie6e99f7dc3a0372768955c28f32c90c542e0be78
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-744 Update report content for proper parsing 72/7872/3
Peter Mikus [Wed, 2 Aug 2017 09:34:42 +0000 (11:34 +0200)]
CSIT-744 Update report content for proper parsing

Follow the good practices for formatting. Update the content of release
report RST files to use the proper directives like :cite:, :footnote:,
:abbr:, :captions: etc.With these markings we will be able to format
output in proper way and style it in various sphinx output builders.

Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoCSIT-742: Add manual trigger for ACL perf tests 63/7863/3
Jan Gelety [Tue, 1 Aug 2017 07:56:13 +0000 (09:56 +0200)]
CSIT-742: Add manual trigger for ACL perf tests

Impelmenting needed change in bootstrap-verify-perf.sh file to
provide manual trigger that will allow to run 1T1C (1 core, 1 thread)
and 2T2C (2 core, 2 threads) ACL tests per VPP patch when required.

Change-Id: I3d9cc403ca8ea90da23aca524c4b4ddbf26eb217
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT-699: Add l2bd+dot1q perf tests 39/7339/9
Jan Gelety [Thu, 29 Jun 2017 07:05:00 +0000 (09:05 +0200)]
CSIT-699: Add l2bd+dot1q perf tests

Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years ago Test TLDK tcpdump command not found issue. 04/7604/5
Fangyin Hu [Tue, 18 Jul 2017 08:22:49 +0000 (01:22 -0700)]
Test TLDK tcpdump command not found issue.
Use the new VIRL image to test.
Add the debug information for the test.

Change-Id: I8343a17d38dffbf84039e39a06fc5c5a65aaf201
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
3 years agoCSIT-727 Add the tcpdump application into the VIRL image 37/7837/6
Peter Mikus [Fri, 28 Jul 2017 11:47:49 +0000 (13:47 +0200)]
CSIT-727 Add the tcpdump application into the VIRL image

- Reqested by TLDK

Change-Id: Iac94a946005fe2e919334309c77b8774af1a1573
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 54/7854/2
Jan Gelety [Mon, 31 Jul 2017 10:27:25 +0000 (12:27 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~94-g03a6213~b2626_amd64

- use new vpp ref build - centos7:
  17.10-rc0~94_g03a6213~b2623.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/59/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/59/

Change-Id: Ifce15bc885f38e9c3407688fcc702efbee42a7dd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoCSIT-618 Add LaTeX support to release report 34/7834/5
Peter Mikus [Fri, 28 Jul 2017 11:06:56 +0000 (13:06 +0200)]
CSIT-618 Add LaTeX support to release report

- Add option to generate PDF from release report.
- Conditional content
- Static plot conversion

Change-Id: I7c4f0b41898791d1cab446d0fc3b07220380e1b8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 years agoFIX: remove import of non-existing vrf resource file 35/7835/1
Jan Gelety [Fri, 28 Jul 2017 11:21:24 +0000 (13:21 +0200)]
FIX: remove import of non-existing vrf resource file

Change-Id: I532beccc9f5034f7f6fa09a8757e5ff6bfbcd88a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoHC Test: add mising sudo to ODL client statup 93/7793/3
selias [Wed, 26 Jul 2017 12:01:48 +0000 (14:01 +0200)]
HC Test: add mising sudo to ODL client statup

Change-Id: I5231cb131f09edc0271c99095aacbf68144e7ded
Signed-off-by: selias <samelias@cisco.com>
3 years agoAdd memif to report 91/7791/2
Tibor Frank [Wed, 26 Jul 2017 11:16:30 +0000 (13:16 +0200)]
Add memif to report

Change-Id: Ie62a4d8b324e6557d9fdf9e37835bb79770bb7e5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.