csit.git
6 years agoReport: Remove *CHK tests from report 67/9367/1
Tibor Frank [Fri, 10 Nov 2017 09:21:12 +0000 (10:21 +0100)]
Report: Remove *CHK tests from report

Change-Id: I2a9882c2995554ea6adbfd9c1af070df03dbaf93
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoPAL: Sort merged data in tables 23/9323/2
Tibor Frank [Wed, 8 Nov 2017 19:39:13 +0000 (19:39 +0000)]
PAL: Sort merged data in tables

Change-Id: I58b2e05dbcbac693455ecdf575c179db3020595f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Add perf data 00/9300/2
Tibor Frank [Wed, 8 Nov 2017 18:45:11 +0000 (18:45 +0000)]
Report: Add perf data

Change-Id: Ife57be6f0c1b0f37c92dba9ae3d9498fd32c3a3a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoPAL: perf improvements table 93/9293/1
Tibor Frank [Wed, 8 Nov 2017 15:53:45 +0000 (16:53 +0100)]
PAL: perf improvements table

Change-Id: I7836da939d486442031fe8f689bc3c4d86195e59
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: exception handling for restconf GET operation 86/9286/3
selias [Wed, 8 Nov 2017 13:42:09 +0000 (14:42 +0100)]
HC Test: exception handling for restconf GET operation

When response to GET is 404, json loads() may fail with ValueError.

Change-Id: If627574bb7909a105d13381a2b89445f527ccb7b
Signed-off-by: selias <samelias@cisco.com>
6 years agoPAL: Implement data sets for specification file. 87/9287/1
Tibor Frank [Wed, 8 Nov 2017 13:51:05 +0000 (14:51 +0100)]
PAL: Implement data sets for specification file.

Change-Id: I4a2d290a69700425f33caf7274c6fa525271e0c8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoPAL: Implement data sets for specification file. 84/9284/2
Tibor Frank [Wed, 8 Nov 2017 12:51:29 +0000 (13:51 +0100)]
PAL: Implement data sets for specification file.

Change-Id: Iacafb676f280a980d02bcdba3aa3abd8bd035cfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-811 HC Test: BGP functional tests 99/8999/11
selias [Mon, 9 Oct 2017 14:36:16 +0000 (16:36 +0200)]
CSIT-811 HC Test: BGP functional tests

Added traffic tests for Honeycomb's BGP feature.

Change-Id: I5fa99908ab61d8bc9d2975e451917b98571b6aca
Signed-off-by: selias <samelias@cisco.com>
6 years agoPAL: Perf improvements - more data sources 63/9263/2
Tibor Frank [Tue, 7 Nov 2017 13:34:25 +0000 (14:34 +0100)]
PAL: Perf improvements - more data sources

Change-Id: I39c8c896f3fa3a7b6a87364e4b700810a9b5d9a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoPAL: Merge input data 54/9254/9
Tibor Frank [Tue, 7 Nov 2017 09:49:56 +0000 (10:49 +0100)]
PAL: Merge input data

Change-Id: I597358a02a6a73106d4664b364433fb5cffbb135
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: cleanup known test failures 19/9219/4
selias [Fri, 3 Nov 2017 13:22:00 +0000 (14:22 +0100)]
HC Test: cleanup known test failures

 - update expected data from L2-FIB dump, due to API changes
 - mark LISP PITR case as expected failing, add Jira ID

Change-Id: I6c6c67697bcea73cdbc248b8f9898cb80ed7b21b
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-402: Remove EXPECTED_FAILING tag from IPFIX tests 51/9151/2
Jan Gelety [Tue, 31 Oct 2017 14:11:40 +0000 (15:11 +0100)]
CSIT-402: Remove EXPECTED_FAILING tag from IPFIX tests

Change-Id: If78504ad2b2b45f020318b894bef9325a8271447
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-564: Remove EXPECTED_FAILING tag from IPv4 + VLAN tests 52/9152/2
Jan Gelety [Tue, 31 Oct 2017 14:17:52 +0000 (15:17 +0100)]
CSIT-564: Remove EXPECTED_FAILING tag from IPv4 + VLAN tests

Change-Id: If491664f04ede03905640809dc060d264723a2a4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 33/9233/1
Jan Gelety [Mon, 6 Nov 2017 08:24:25 +0000 (09:24 +0100)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.01-rc0~185-g6e3b5a2~b3122_amd64

- use new vpp ref build - centos7:
  18.01-rc0~185_g6e3b5a2~b3118.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/87/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/87/

Change-Id: Icb69004e67c3ecb402e4d14be247b5829ec22c7f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoReport: Data - vpp perf full added 24/9224/1
Tibor Frank [Sat, 4 Nov 2017 07:09:01 +0000 (08:09 +0100)]
Report: Data - vpp perf full added

Change-Id: I217fa37ab98624679d61953b26603f6e5ffab550
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: Update list of Honeycomb BGP modules 18/9118/2
selias [Mon, 30 Oct 2017 15:19:08 +0000 (16:19 +0100)]
HC Test: Update list of Honeycomb BGP modules

BGP functionality was split into additional modules in
https://gerrit.fd.io/r/8486

Change-Id: I1cf5971fa8cb5f0cde17306bdc06ebe7f3008473
Signed-off-by: selias <samelias@cisco.com>
6 years agoReport: plots - added ligato scale 09/9209/1
Tibor Frank [Fri, 3 Nov 2017 06:03:19 +0000 (07:03 +0100)]
Report: plots - added ligato scale

Change-Id: I80b14f661203b38fe65506475eee930667bfe767
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agorls1710: rls_notes update. 02/9202/2
Maciek Konstantynowicz [Thu, 2 Nov 2017 17:25:03 +0000 (17:25 +0000)]
rls1710: rls_notes update.

Change-Id: I75a589ee7d408e1504ee0d137519699734f54ee3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agorls1710 report: added ref to vpp vpp-config tool. 95/9195/1
Maciek Konstantynowicz [Thu, 2 Nov 2017 12:13:23 +0000 (12:13 +0000)]
rls1710 report: added ref to vpp vpp-config tool.

Change-Id: I9b39faa3722d2bf366a741770753b623892f420a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agotake-2: csit report static content updates for rls1710. 82/9182/2
Maciek Konstantynowicz [Wed, 1 Nov 2017 14:33:12 +0000 (14:33 +0000)]
take-2: csit report static content updates for rls1710.

Change-Id: I097d62a36473303f9e0c6c06a38a68e077f86b14
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoReport: ligato data 90/9190/1
Tibor Frank [Thu, 2 Nov 2017 05:41:15 +0000 (06:41 +0100)]
Report: ligato data

Change-Id: Ib058b8e6bf108878fb13f7c135afe18c266887fb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: ligato data 84/9184/1
Tibor Frank [Wed, 1 Nov 2017 16:44:25 +0000 (17:44 +0100)]
Report: ligato data

Change-Id: I76ac8db5e7a96c2f50696d8a6b69101f4da81e42
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: data 72/9172/1
Tibor Frank [Wed, 1 Nov 2017 05:31:01 +0000 (06:31 +0100)]
Report: data

Change-Id: Ibd3831118791c61b24216e84868bb694230436d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: perf improvements 66/9166/1
Tibor Frank [Tue, 31 Oct 2017 17:47:49 +0000 (18:47 +0100)]
Report: perf improvements

Change-Id: I5e323a2d79639555b8b2fa76596ba17d173a0335
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: data 63/9163/1
Tibor Frank [Tue, 31 Oct 2017 17:01:37 +0000 (18:01 +0100)]
Report: data

Change-Id: I972d3e95b2272dd2acd1e4f495f607faebd13079
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: data 60/9160/1
Tibor Frank [Tue, 31 Oct 2017 16:25:47 +0000 (17:25 +0100)]
Report: data

Change-Id: I182250716776f31328e4c33e53166a19b6f9ce73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: data 56/9156/1
Tibor Frank [Tue, 31 Oct 2017 15:25:02 +0000 (16:25 +0100)]
Report: data

Change-Id: I55b715aefd4d9d2e95010a445e6cef880875d0f1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport:data 47/9147/2
Tibor Frank [Tue, 31 Oct 2017 13:45:51 +0000 (14:45 +0100)]
Report:data

Change-Id: I3a89d58155b92c819c0ad9406921c346812c8730
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files and DPDK_STABLE_VER file 06/9106/4
Jan Gelety [Mon, 30 Oct 2017 13:02:06 +0000 (14:02 +0100)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file

- use new vpp ref build - ubuntu 16.04:
  18.01-rc0~156-gae5a02f~b3093_amd64

- use new vpp ref build - centos7:
  18.01-rc0~156_gae5a02f~b3090.x86_64

- use new dpdk version:
  17.08-vpp2

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/85/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/85/

- remove vpp-debuginfo centos7 artifact as not provided for new versions

Change-Id: I18445feac98304e7e7ecdf77968acebf2d5aef09
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoReport: data 44/9144/1
Tibor Frank [Tue, 31 Oct 2017 13:18:09 +0000 (14:18 +0100)]
Report: data

Change-Id: Ice5fd91cf1bd935331bdb516253a2afc9c309930
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: data 41/9141/1
Tibor Frank [Tue, 31 Oct 2017 13:00:29 +0000 (14:00 +0100)]
Report: data

Change-Id: I1e6d9a6df9989a3730391be878b619bf02302a7e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agocsit report static content updates for rls1710. 26/9126/3
Maciek Konstantynowicz [Mon, 30 Oct 2017 21:28:43 +0000 (21:28 +0000)]
csit report static content updates for rls1710.

Change-Id: I6744f1c206410564114ce7b9d06f840432f97ed2
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoReport: new data added 29/9129/1
Tibor Frank [Tue, 31 Oct 2017 07:31:02 +0000 (08:31 +0100)]
Report: new data added

Change-Id: I3d9ab46df4dada7b3ba1957a79eb8a4cb598e7ba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: plots 19/9119/1
Tibor Frank [Mon, 30 Oct 2017 16:19:32 +0000 (17:19 +0100)]
Report: plots

Change-Id: Ife20611fc3eab19b4b6bde405907fcad420f7cf8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Plots 13/9113/1
Tibor Frank [Mon, 30 Oct 2017 13:53:34 +0000 (14:53 +0100)]
Report: Plots

Change-Id: I83929e4e6dc43d30f7472c2caa710515389af864
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Fix templ file 01/9101/1
Tibor Frank [Mon, 30 Oct 2017 12:09:52 +0000 (13:09 +0100)]
Report: Fix templ file

Change-Id: I503f56da43b1216ff6b8a4c2c22c0fa2cf439d07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Add data 96/9096/2
Tibor Frank [Mon, 30 Oct 2017 08:42:44 +0000 (09:42 +0100)]
Report: Add data

Change-Id: Ib09d9dc12ecd349b467e87f190e035d39306812e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoUpdate static report content - performance tests, part I 60/9060/2
Jan Gelety [Thu, 26 Oct 2017 13:37:41 +0000 (15:37 +0200)]
Update static report content - performance tests, part I

Change-Id: I08f76946cbefb125f3dac326a6485cceb5d7a8af
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoHC Test: Fix missing import in performance job setup 81/9081/2
selias [Fri, 27 Oct 2017 14:26:02 +0000 (16:26 +0200)]
HC Test: Fix missing import in performance job setup

Change-Id: Ib125fbaf38e2a10892d2bbaf4cd68121dd2247ce
Signed-off-by: selias <samelias@cisco.com>
6 years agoReport: perf improvements 82/9082/1
Tibor Frank [Fri, 27 Oct 2017 14:34:29 +0000 (16:34 +0200)]
Report: perf improvements

Change-Id: I319bb63d21c48f3390ca639db144ad00ca0ae927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: perf improvemnets 77/9077/1
Tibor Frank [Fri, 27 Oct 2017 10:03:10 +0000 (12:03 +0200)]
Report: perf improvemnets

Change-Id: Ib5b822db59bfbb77683b3d59077fba584bfcbd37
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoFix: table_performance_improvements 75/9075/2
Tibor Frank [Fri, 27 Oct 2017 08:56:01 +0000 (10:56 +0200)]
Fix: table_performance_improvements

Change-Id: I5052d47988c1644768ed6c8cdefc76dc1defb898
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Update data sources 73/9073/2
Tibor Frank [Fri, 27 Oct 2017 08:08:44 +0000 (10:08 +0200)]
Report: Update data sources

Change-Id: I3cec31d1db74330ef7ef8341c19f7fe1d5894b53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: Update tags in IPv6 control suite 65/9065/2
selias [Thu, 26 Oct 2017 15:33:54 +0000 (17:33 +0200)]
HC Test: Update tags in IPv6 control suite

 - remove EXPECTED_FAILING tag, IPv6 is no longer disabled
 - add HC_REST_ONLY tag, these tests should not be executed with ODL

Change-Id: I5c4ba8d08751e259d6ca158c2fb034660629916c
Signed-off-by: selias <samelias@cisco.com>
6 years agoReport: VPP documentation 57/9057/1
Tibor Frank [Thu, 26 Oct 2017 12:28:45 +0000 (14:28 +0200)]
Report: VPP documentation

Change-Id: Idda800c92f8c09404927fc88ef23cb4fd005f268
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: Mark BGP tests as expected_failing 55/9055/1
selias [Thu, 26 Oct 2017 11:39:39 +0000 (13:39 +0200)]
HC Test: Mark BGP tests as expected_failing

Change-Id: Id01088da3e01df7c110572ae0a22303f5f9a283c
Signed-off-by: selias <samelias@cisco.com>
6 years agoUpdate static report content - functional tests 53/9053/2
Jan Gelety [Thu, 26 Oct 2017 11:24:33 +0000 (13:24 +0200)]
Update static report content - functional tests

Change-Id: Ieded0a5d4fd7e15dce10bea3bcc023710ebe872c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoUpdate static report content - Honeycomb 48/9048/3
selias [Thu, 26 Oct 2017 10:14:48 +0000 (12:14 +0200)]
Update static report content - Honeycomb

Change-Id: I9f6612a4495df62f3a43c19457864a4eeff64a3d
Signed-off-by: selias <samelias@cisco.com>
6 years agoHC Test: cleanup expected_failing tags in routing suite 47/9047/2
selias [Thu, 26 Oct 2017 10:13:06 +0000 (12:13 +0200)]
HC Test: cleanup expected_failing tags in routing suite

Change-Id: I5ab5b784e77664291e1a40a2459964e7efe3d3af
Signed-off-by: selias <samelias@cisco.com>
6 years agoPAL: Implement changes in show-run output 41/9041/1
Tibor Frank [Thu, 26 Oct 2017 08:49:41 +0000 (10:49 +0200)]
PAL: Implement changes in show-run output

Change-Id: I2d28e048206d38179447e1d2ac8646ccffc97c8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoUpdate the static content 38/9038/3
Tibor Frank [Thu, 26 Oct 2017 08:33:19 +0000 (10:33 +0200)]
Update the static content

Change-Id: I8869bddef992f75707b740533a57ad80a3696e73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoFix the NSH SFC functional test failed issue. 37/9037/1
Fangyin Hu [Thu, 26 Oct 2017 09:21:38 +0000 (02:21 -0700)]
Fix the NSH SFC functional test failed issue.

Change-Id: If118254b6479f7ffb3e0b4f81d3585b4b90cc92c
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
(cherry picked from commit 751a5aed2cac6bd7b87028eaf7eab1a8f87fface)

6 years ago Update the NSH protocol header fields 28/9028/3
Fangyin Hu [Thu, 26 Oct 2017 04:47:04 +0000 (21:47 -0700)]
Update the NSH protocol header fields
Fix the NSH SFC functional test cases failed issues.

Change-Id: I5d49b50a8c0958dc8db4bc10d6852f0cf4e77962
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
6 years agoAdd link to pdf version 19/9019/1
Tibor Frank [Wed, 25 Oct 2017 15:19:33 +0000 (17:19 +0200)]
Add link to pdf version

Change-Id: I6a2d33284dff8a156a9231ded5e337db2ff5fb06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoAdd ligato test results 16/9016/2
Tibor Frank [Wed, 25 Oct 2017 13:37:08 +0000 (15:37 +0200)]
Add ligato test results

Change-Id: I107dd0430fb9d59264aeabc63f51d5e615509078
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Add VPP func results 10/9010/1
Tibor Frank [Wed, 25 Oct 2017 07:43:12 +0000 (09:43 +0200)]
Report: Add VPP func results

Change-Id: Ice0b4cf2a960e8047191ff5e38789050c985d75e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: Add job ligato 1 97/8997/1
Tibor Frank [Tue, 24 Oct 2017 15:32:54 +0000 (17:32 +0200)]
Report: Add job ligato 1

Change-Id: I3e1a990ce472cf309efc9ddd3257b00a2a6a56f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoAdd ligato data to the report 90/8990/1
Tibor Frank [Tue, 24 Oct 2017 10:12:25 +0000 (12:12 +0200)]
Add ligato data to the report

Change-Id: Iadfa50ee1bc1a5930cb609835e316228567ceb53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoUpdate csit_design_picture.svg for rls17.10 85/8985/1
Tibor Frank [Tue, 24 Oct 2017 10:16:00 +0000 (12:16 +0200)]
Update csit_design_picture.svg for rls17.10

Change-Id: Iaa373e60c2b509e78ee905405cc9f20cce157757
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoSplit container sections in report 83/8983/3
Peter Mikus [Tue, 24 Oct 2017 08:37:11 +0000 (10:37 +0200)]
Split container sections in report

- Split Container Memif section and Container Orchestrated section
- Fix naming conventions

Change-Id: Icb8d0c92ad08f87b998aa20291eeae9958c36e43
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoChange release number to 17.10 74/8974/1
Tibor Frank [Tue, 24 Oct 2017 06:44:56 +0000 (08:44 +0200)]
Change release number to 17.10

Change-Id: I40ed4aee9d5b8a3727c056a8ba6563d760c635eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agorls1710 report: vpp performance methodology updates. 40/8940/3
Maciek Konstantynowicz [Fri, 20 Oct 2017 12:23:01 +0000 (13:23 +0100)]
rls1710 report: vpp performance methodology updates.

Change-Id: Ifc3b06dc8be0c82b8c424fb599eeac5a8e1f286f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoAdd DPDK results to the report 69/8969/1
Tibor Frank [Mon, 23 Oct 2017 15:48:26 +0000 (17:48 +0200)]
Add DPDK results to the report

Change-Id: If92a55bf74a0e6e41d4c37defed5bbf76fbec441
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoAdd vpp perf jobs to report 65/8965/1
Tibor Frank [Mon, 23 Oct 2017 13:17:35 +0000 (15:17 +0200)]
Add vpp perf jobs to report

Change-Id: Ieb041b31dc18b03a865c7128db1f32a2c5db2c0b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoReport: CSIT Framework Documentation 37/8937/7
Tibor Frank [Fri, 20 Oct 2017 11:35:53 +0000 (13:35 +0200)]
Report: CSIT Framework Documentation

Change-Id: I2eba1183a5acdd1fb34efab16fc5c89e38dedb14
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoUpdate disk-image-builder scripts to allow IPv6 99/8499/12
selias [Fri, 22 Sep 2017 08:49:28 +0000 (10:49 +0200)]
Update disk-image-builder scripts to allow IPv6

Change-Id: I28ed08689db97eabc21726afa9d977fcda526dfb
Signed-off-by: selias <samelias@cisco.com>
6 years agoFIX: use correct IF name in Vpp Route Add in case of multi-VMs config 61/8961/4
Jan Gelety [Mon, 23 Oct 2017 11:47:45 +0000 (13:47 +0200)]
FIX: use correct IF name in Vpp Route Add in case of multi-VMs config

Change-Id: Iab5a6db1eac11798e2a3ec56f7d68043f6c8c2ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFIX: IPSec tunnel interface 56/8956/1
Jan Gelety [Mon, 23 Oct 2017 10:56:04 +0000 (12:56 +0200)]
FIX: IPSec tunnel interface

- add following line per interface tunnel:
  set int unnum <ipsec> use <interface>

Change-Id: Iff75f27b7cf25f3d24eea92366b1fd4a718c253b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-806 Container Orchestration in CSIT - Low Level Design 20/8620/14
Peter Mikus [Mon, 2 Oct 2017 16:13:50 +0000 (16:13 +0000)]
CSIT-806 Container Orchestration in CSIT - Low Level Design

Change-Id: I993f1a4d0ae6332d2c7f9b170277bc726a1826cf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoRename all container based test following name conventions 39/8939/4
Peter Mikus [Fri, 20 Oct 2017 11:50:08 +0000 (13:50 +0200)]
Rename all container based test following name conventions

Change-Id: I84f6da2bede47e7ae35e6b4911d425d2402dbd1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFix: PDF - Add dpdk plots 34/8934/2
Tibor Frank [Fri, 20 Oct 2017 10:53:26 +0000 (12:53 +0200)]
Fix: PDF - Add dpdk plots

Change-Id: I0c76bfda6e84db4aee62b097282b9cf46fe51270
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoAdd csit-dpdk-perf-1710-all/2, 3 to testing data 32/8932/2
Tibor Frank [Fri, 20 Oct 2017 07:33:52 +0000 (09:33 +0200)]
Add csit-dpdk-perf-1710-all/2, 3 to testing data

Change-Id: I5e8cce83f179729df61afd506932310aba44e898
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoGenerate pdf 27/8927/1
Tibor Frank [Fri, 20 Oct 2017 06:23:47 +0000 (08:23 +0200)]
Generate pdf

Change-Id: I47ff419c8b9309cc73238c79acb3b395144929cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoAdd IPSEC tests to DAILY Jenkins job 84/8884/2
Tibor Frank [Wed, 18 Oct 2017 15:14:11 +0000 (17:14 +0200)]
Add IPSEC tests to DAILY Jenkins job

Change-Id: Ie4558b53a0c0a19b9fa24e951bcf0fcb320076b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoUpdate the dpdk version to 17.08 77/8877/7
Peter Mikus [Wed, 18 Oct 2017 14:07:46 +0000 (14:07 +0000)]
Update the dpdk version to 17.08

Change-Id: Idcf705d40f45c10c3c4dee694a80202d576b8026
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoPAL: do not generate pdf 13/8913/1
Tibor Frank [Thu, 19 Oct 2017 12:35:38 +0000 (14:35 +0200)]
PAL: do not generate pdf

Change-Id: Iab192d78491db9f8909ea708cf5dd588030f0b30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoPAL test runs 09/8909/1
Tibor Frank [Thu, 19 Oct 2017 10:31:42 +0000 (12:31 +0200)]
PAL test runs

Change-Id: I8232b998fd00b5a09e7f9b72d4acb0f1140aade6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: Fix expected error when ACL table should be empty 04/8904/1
selias [Thu, 19 Oct 2017 08:56:02 +0000 (10:56 +0200)]
HC Test: Fix expected error when ACL table should be empty

Due to VATExecutor changes in https://gerrit.fd.io/r/8679

Change-Id: Iaecf6ff7b2562ff111a3afbce0ecbb2df00c62a9
Signed-off-by: selias <samelias@cisco.com>
6 years agoFIX: apply changes implemented for FIB settings 69/8869/7
Jan Gelety [Wed, 18 Oct 2017 08:24:14 +0000 (10:24 +0200)]
FIX: apply changes implemented for FIB settings

Change-Id: I00c3407f4324e282c438cb8fcd44470c331089c5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-834: Add HLD picture 73/8773/3
Tibor Frank [Thu, 12 Oct 2017 07:47:09 +0000 (09:47 +0200)]
CSIT-834: Add HLD picture

Change-Id: Ie64874c5555794ee70276f2a65d436337102b465
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-836: PDF format: Improvements in pdf layout 80/8780/16
Tibor Frank [Thu, 12 Oct 2017 10:47:56 +0000 (12:47 +0200)]
CSIT-836: PDF format: Improvements in pdf layout

CSIT-837: Scope of pdf version

Change-Id: Idfc9c04274c6635fbef14f87147665d31cfd7352
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-748 Add K8S 2memif-2vnf topologies 55/8855/4
Peter Mikus [Tue, 17 Oct 2017 12:17:49 +0000 (14:17 +0200)]
CSIT-748 Add K8S 2memif-2vnf topologies

Change-Id: I23e118bf9fc9cfd638ac3ec0589f2ced14cc240c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: Log MACIP ACL settings only if test failed 59/8859/1
Jan Gelety [Tue, 17 Oct 2017 13:36:54 +0000 (15:36 +0200)]
FIX: Log MACIP ACL settings only if test failed

Change-Id: I6d51c662d8b23789adcd9c3d1b1e8736f71d5279
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-841 Optimize cheking k8s POD state 49/8849/2
Peter Mikus [Tue, 17 Oct 2017 06:13:14 +0000 (08:13 +0200)]
CSIT-841 Optimize cheking k8s POD state

Change-Id: Ie1725c0017b78945e431f493743f9a01a66e83c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-828: Fix the output of failed VAT execution 79/8679/7
Jan Gelety [Thu, 5 Oct 2017 11:20:20 +0000 (13:20 +0200)]
CSIT-828: Fix the output of failed VAT execution

Change-Id: Id387bd685142dcfaa17f0236e930e40e6c0bce5a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-841 Optimize creating of vnf-agent docker image Part I 78/8778/16
Peter Mikus [Thu, 12 Oct 2017 09:06:58 +0000 (09:06 +0000)]
CSIT-841 Optimize creating of vnf-agent docker image Part I

- Optimize building of prod_vpp_agent docker image by using
  dev_vpp_agent docker image pulled from dockerhub/ligato instead of
  building on slave.
- Add detailed logs from every POD deployed in namespace.
- Hardening condition for considering PODs Running.

Change-Id: I9f771d6365d38fef2ec2e00ab642853e6a44ad03
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-748 vnf-agent integration 04/8504/38
Peter Mikus [Fri, 22 Sep 2017 12:59:40 +0000 (14:59 +0200)]
CSIT-748 vnf-agent integration

CSIT-773 Implement RF keywords for k8s

- Implementation of Test Suite Setup for Ligato vnf-agent testing
- Implementation of KubernetesUtil for controlling kubectl
- Yaml templates for L2XC topology with 1cswitch and 1cnf
- Yaml templates for L2BD topology with 1cswitch and 1cnf
- ligato bootstrap script for creating vnf-agent image

Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: Robotframework version. 69/8769/2
Peter Mikus [Thu, 12 Oct 2017 04:56:54 +0000 (04:56 +0000)]
FIX: Robotframework version.

Change-Id: I7fa8fb91bb3db6b62a4215a966bef74b7ec5be84
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-811 HC Test: BGP tests - IPv4 CRUD 76/8676/8
selias [Fri, 29 Sep 2017 13:31:06 +0000 (15:31 +0200)]
CSIT-811 HC Test: BGP tests - IPv4 CRUD

Tests configure BGP neighbor peers and simple routes for these peers.

Change-Id: I5102986d710551a451e838d934cc9650bcd38a60
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-778: Add mac-ip binding acl l2bd perf test 38/8038/31
Jan Gelety [Mon, 14 Aug 2017 14:25:46 +0000 (16:25 +0200)]
CSIT-778: Add mac-ip binding acl l2bd perf test

Change-Id: Iaced68458b0e4070f861be7854ee428ae8ca4e13
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-672: SNAT44 multi-thread multi-core perf tests 31/8731/4
Tibor Frank [Tue, 10 Oct 2017 09:03:01 +0000 (11:03 +0200)]
CSIT-672: SNAT44 multi-thread multi-core perf tests

 - re-write existing tests using templates
 - add 2t2c, 4t4c tests

Change-Id: I7061f4cfe2304d625de6afcb85cad30695fe6faa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-755: Presentation and analytics layer 93/7993/81
Tibor Frank [Fri, 11 Aug 2017 08:44:36 +0000 (10:44 +0200)]
CSIT-755: Presentation and analytics layer

- CSIT-760: Configuration - real example
- CSIT-774: Implementation - parse configuration
- CSIT-779: Implementation - set environment
- CSIT-780: Implementation - download data
- CSIT-783: Implementation - debug mode
- CSIT-761: Implementation - Data pre-processing - parse input files
- CSIT-784: Implementation - Data pre-processing - store the data, access to data
- CSIT-789: Implementation - Data pre-processing - extract Documentation of the suite
- CSIT-757: Low Level Design
- CSIT-788: Implementation - Data pre-processing - extract VAT history and show runtime
- CSIT-785: Implementation - Data filtering
- CSIT-763: Presentation - tables
- CSIT-804: Presentation - files
- CSIT-762: Presentation - plots
- LLD: API + functional diagram
- CSIT-807: Element's models
- CSIT-813: Process static content
- CSIT-812: Report generation
- CSIT-764: Integration to CSIT
- CSIT-822: Archiving
- CSIT-790: Documentation
- configuration od the Input data is the same as for 17.07 report

Change-Id: I6fd1eb1df4af99eaf91925282cdee1c892698c59
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: mark NSH tests as expected_failing 14/8714/2
selias [Mon, 9 Oct 2017 14:46:30 +0000 (16:46 +0200)]
HC Test: mark NSH tests as expected_failing

NSH packages are not yet available in the stable.17.10 repositories

Change-Id: I660dcf667e1fcf42823a08345f4b0ec3d4cba7b1
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-775 HC Test: CRUD over IPv6 control-plane interface 81/8381/22
selias [Tue, 15 Aug 2017 17:33:50 +0000 (19:33 +0200)]
CSIT-775 HC Test: CRUD over IPv6 control-plane interface

Adds new test suite which accesses Honeycomb's Restconf and Netconf northbound
over IPv6. This is done by sending the requests to TG where an IPv4 to IPv6
tunnel is configured to the Honeycomb DUT.

Change-Id: I3b7467d8108b0da9756e632851215c66ed41bb61
Signed-off-by: selias <samelias@cisco.com>
6 years agoFIB table add/delete 43/8043/12
Neale Ranns [Mon, 14 Aug 2017 19:22:58 +0000 (12:22 -0700)]
FIB table add/delete

Change-Id: Icadb4884a1c08a2230fd4692df69310ce382ec94
Signed-off-by: Neale Ranns <nranns@cisco.com>
6 years agoCSIT-768: Refactor Python container libraries 41/8141/48
Peter Mikus [Mon, 21 Aug 2017 09:01:24 +0000 (11:01 +0200)]
CSIT-768: Refactor Python container libraries
CSIT-769: Implement L2 RF keywords for container orchestration

Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoHC Test: remove log check from HC startup 72/8672/4
selias [Thu, 5 Oct 2017 10:19:55 +0000 (12:19 +0200)]
HC Test: remove log check from HC startup

 - remove log check from "Check Honeycomb Startup State" keyword
 - fix workaround for ODL startup issue
 - change log level for HttpRequestError so it doesn't clutter
log.html output
 - update EXPECTED_FAILING tags for plugin-acl and routing suites

Change-Id: I7380d24801a6535bdf77505edada39ea2412e833
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-830: Add framesize tags to DPDK perf tests 56/8656/2
Tibor Frank [Wed, 4 Oct 2017 11:19:37 +0000 (13:19 +0200)]
CSIT-830: Add framesize tags to DPDK perf tests

Change-Id: I4ba3b5bac27a95b4529b3501a24a1f2d1ba27ed6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoHC Test: increase timeout for archiving HC log file 25/8625/2
selias [Tue, 3 Oct 2017 08:32:35 +0000 (10:32 +0200)]
HC Test: increase timeout for archiving HC log file

 - add timeout parameter to ssh.scp method
 - increase timeout in "Archive Honeycomb Log" keyword
 - increase timeout for copying ODL client in setup

Change-Id: I9e914d5f439fd14471b10b611efdbb6afada4c6e
Signed-off-by: selias <samelias@cisco.com>
6 years agoHC Test: Fix intermittent failures of HC startup 75/8475/11
selias [Wed, 20 Sep 2017 13:47:39 +0000 (15:47 +0200)]
HC Test: Fix intermittent failures of HC startup

 - rework "check Honeycomb startup state" keyword
 - increase timeout value for startup
 - add separators to Honeycomb log file between test suites
 - other minor fixes:
    - remove usused import from NAT suite
    - fix loop in ICMPv6 ND proxy traffic script
    - add teardown to LISP cases
    - update prerequisites for sub-interface SPAN test

Change-Id: I2f714ffc1d2e8435d3abe690d8bd15099e071c9a
Signed-off-by: selias <samelias@cisco.com>