csit.git
6 years agoHC Test: re-enable NSH tests, minor fixes 22/8222/9
selias [Mon, 28 Aug 2017 10:47:29 +0000 (12:47 +0200)]
HC Test: re-enable NSH tests, minor fixes

NSH plugin was fixed in https://gerrit.fd.io/r/8218

- updated lispGPE test data
- added missing teardown to multi-IP traffic test
- marked L2-fib update revert case as failing

Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924
Signed-off-by: selias <samelias@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 94/8294/1
Jan Gelety [Mon, 4 Sep 2017 06:48:40 +0000 (08:48 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~263-gedfa2fd~b2799_amd64

- use new vpp ref build - centos7:
  17.10-rc0~263_gedfa2fd~b2796.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/69/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/69/

Change-Id: I510d288a4a5444f980769d7fd13ab1ff46d227a5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-786 L2FIB scale testing 45/8145/23
Peter Mikus [Mon, 21 Aug 2017 13:48:34 +0000 (15:48 +0200)]
CSIT-786 L2FIB scale testing

L2FIB scale testing for 10k, 100k, 1m FIB entries
 ./l2:
 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot
 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot
 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot
 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc
 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc
 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc

Change-Id: I7e3884bd5ab5294c289030a3465ec5b6def83cf7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoUpdate T-rex to v2.29 91/8291/2
Peter Mikus [Sun, 3 Sep 2017 16:25:49 +0000 (16:25 +0000)]
Update T-rex to v2.29

Change-Id: Id60525182cbe5870f40aebf165e8bd86c101d267
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: SNAT -> NAT renaming of API 10/8210/8
Peter Mikus [Fri, 25 Aug 2017 10:51:57 +0000 (12:51 +0200)]
FIX: SNAT -> NAT renaming of API

- Based on https://gerrit.fd.io/r/#/c/8146/

Change-Id: I774483c7e2b419a9b9b6be78812ecf53a5c91eab
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFix: Do not validate LXC image 23/8223/2
Peter Mikus [Mon, 28 Aug 2017 11:52:12 +0000 (11:52 +0000)]
Fix: Do not validate LXC image

Change-Id: I476f463ad7dd91f1d80a1e4b537a2cb3dd4ddee5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 54/8154/5
Peter Mikus [Tue, 22 Aug 2017 05:30:17 +0000 (05:30 +0000)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  vpp-17.10-rc0~206-g5f22f4d~b2740_amd64-deb

- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/???/

NOTE: centos7 build not updated because of issue with deletion of tap interface

Change-Id: I1df4c10f40d983952c1dad4a94f2dcdb2534c00e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoUpdate T-rex to v2.28 93/8193/2
Peter Mikus [Thu, 24 Aug 2017 07:02:47 +0000 (09:02 +0200)]
Update T-rex to v2.28

Change-Id: I506589c3785eec3a2eaa9fdb32bfc3375388d6f4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoHC Test: Disable NSH plugin installation and tests 09/8209/1
selias [Fri, 25 Aug 2017 10:47:43 +0000 (12:47 +0200)]
HC Test: Disable NSH plugin installation and tests

 - VPP refuses to start with vpp-nsh-plugin installed

Change-Id: If1ca45295c63094d2542fc829b8eae7dc0e4977c
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-777: L2 keywords for MACIP ACL tests 19/8019/5
Jan Gelety [Mon, 14 Aug 2017 07:04:09 +0000 (09:04 +0200)]
CSIT-777: L2 keywords for MACIP ACL tests

Change-Id: I678d87770405105555ccc30ce0003f704d7ca82e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-770 Installation of prerequisites on physical hosts 64/8064/2
Peter Mikus [Wed, 16 Aug 2017 09:32:13 +0000 (11:32 +0200)]
CSIT-770 Installation of prerequisites on physical hosts

- Update ansible to install kubernetes and docker

Change-Id: Ibf57d4fa697f7c9b58f2e4925387b0c4e8b67274
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoHC Test: cleanup test failures 53/7953/6
selias [Wed, 9 Aug 2017 08:50:46 +0000 (10:50 +0200)]
HC Test: cleanup test failures

 - have unnumbered interface cases use a real interface instead of local0
 - add EXPECTED_FAILING tag and Jira link to known failing test cases

Change-Id: I8bc0f4a74ea1949289a3f12dd54168acdf9edc39
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-777: L1 keywords for MACIP ACL tests 82/7982/3
Jan Gelety [Thu, 10 Aug 2017 14:47:47 +0000 (16:47 +0200)]
CSIT-777: L1 keywords for MACIP ACL tests

Change-Id: I90eb824cbabaaece6798812268177ad9bd4eff65
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 22/8022/1
Jan Gelety [Mon, 14 Aug 2017 07:54:56 +0000 (09:54 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~154-gb2215d6~b2690_amd64

- build tested by semiweekly job:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/63/

NOTE: centos7 build not updated because of issue with deletion of tap interface

Change-Id: I937ea3d106f7e62ccd977bcd3114b17326912e82
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFix: Memif API change 65/7965/2
Peter Mikus [Wed, 9 Aug 2017 11:23:19 +0000 (13:23 +0200)]
Fix: Memif API change

Due to changes in API in latest VPP, Memif/LXC test are failing.
This patch is supposed to change Memif config in LXC.

Change-Id: I5c3844fd7559eba948bcb5619c8969611eb200c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-767: Add acl 64B 4t4c perf tests 34/7934/3
Jan Gelety [Tue, 8 Aug 2017 13:08:15 +0000 (15:08 +0200)]
CSIT-767: Add acl 64B 4t4c perf tests

Change-Id: Id1b187c195c955d0e533d8d6864fff6a3fa8332e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-611: HC Test: Lisp suite updates + LispGPE 17/7917/5
selias [Thu, 13 Jul 2017 11:15:41 +0000 (13:15 +0200)]
CSIT-611: HC Test: Lisp suite updates + LispGPE

 - added LispGPE test suite
 - added IPv6 tests to Lisp suite
 - added traffic tests to Lisp suite

Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b
Signed-off-by: selias <samelias@cisco.com>
6 years agoHC Test: re-enable VxLAN GPE test suite 62/7662/4
selias [Thu, 20 Jul 2017 07:53:05 +0000 (09:53 +0200)]
HC Test: re-enable VxLAN GPE test suite

VPP crash partially fixed in https://gerrit.fd.io/r/7267
Still occuring in IPv6 case.

Change-Id: Iff6cd99098c6273fc56940b475e5262889076775
Signed-off-by: selias <samelias@cisco.com>
6 years agoHC Test: test data updates for HC bump to ODL-Carbon dependencies 26/7926/2
selias [Wed, 7 Jun 2017 09:23:57 +0000 (11:23 +0200)]
HC Test: test data updates for HC bump to ODL-Carbon dependencies

related Honeycomb change: https://gerrit.fd.io/r/6924

Change-Id: I290a65428c8d64304be6e35dad5d21755a925f86
Signed-off-by: selias <samelias@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 23/7923/1
Jan Gelety [Mon, 7 Aug 2017 08:35:39 +0000 (10:35 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~121-g63a46fc~b2656_amd64

- use new vpp ref build - centos7:
  17.10-rc0~121_g63a46fc~b2653.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/61/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/61/

Change-Id: Ifea4b98550c28619289a170508a20e496aaa30b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoUse 100kpps step for ACL 64B perf tests 20/7920/1
Jan Gelety [Mon, 7 Aug 2017 07:01:01 +0000 (09:01 +0200)]
Use 100kpps step for ACL 64B perf tests

ACL 64B tests take a long time. Usage of 100kpps will provide results
with adequate accurancy and test exectuion time.

Change-Id: I6818963f3ce16b9aaae72cf579294f87d10a24a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFix: Release report PDF generation bug 78/7878/2
Peter Mikus [Wed, 2 Aug 2017 11:17:35 +0000 (13:17 +0200)]
Fix: Release report PDF generation bug

QXcbConnection: Could not connect to display

Change-Id: Ie6e99f7dc3a0372768955c28f32c90c542e0be78
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-744 Update report content for proper parsing 72/7872/3
Peter Mikus [Wed, 2 Aug 2017 09:34:42 +0000 (11:34 +0200)]
CSIT-744 Update report content for proper parsing

Follow the good practices for formatting. Update the content of release
report RST files to use the proper directives like :cite:, :footnote:,
:abbr:, :captions: etc.With these markings we will be able to format
output in proper way and style it in various sphinx output builders.

Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-742: Add manual trigger for ACL perf tests 63/7863/3
Jan Gelety [Tue, 1 Aug 2017 07:56:13 +0000 (09:56 +0200)]
CSIT-742: Add manual trigger for ACL perf tests

Impelmenting needed change in bootstrap-verify-perf.sh file to
provide manual trigger that will allow to run 1T1C (1 core, 1 thread)
and 2T2C (2 core, 2 threads) ACL tests per VPP patch when required.

Change-Id: I3d9cc403ca8ea90da23aca524c4b4ddbf26eb217
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-699: Add l2bd+dot1q perf tests 39/7339/9
Jan Gelety [Thu, 29 Jun 2017 07:05:00 +0000 (09:05 +0200)]
CSIT-699: Add l2bd+dot1q perf tests

Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years ago Test TLDK tcpdump command not found issue. 04/7604/5
Fangyin Hu [Tue, 18 Jul 2017 08:22:49 +0000 (01:22 -0700)]
Test TLDK tcpdump command not found issue.
Use the new VIRL image to test.
Add the debug information for the test.

Change-Id: I8343a17d38dffbf84039e39a06fc5c5a65aaf201
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
6 years agoCSIT-727 Add the tcpdump application into the VIRL image 37/7837/6
Peter Mikus [Fri, 28 Jul 2017 11:47:49 +0000 (13:47 +0200)]
CSIT-727 Add the tcpdump application into the VIRL image

- Reqested by TLDK

Change-Id: Iac94a946005fe2e919334309c77b8774af1a1573
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 54/7854/2
Jan Gelety [Mon, 31 Jul 2017 10:27:25 +0000 (12:27 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~94-g03a6213~b2626_amd64

- use new vpp ref build - centos7:
  17.10-rc0~94_g03a6213~b2623.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/59/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/59/

Change-Id: Ifce15bc885f38e9c3407688fcc702efbee42a7dd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-618 Add LaTeX support to release report 34/7834/5
Peter Mikus [Fri, 28 Jul 2017 11:06:56 +0000 (13:06 +0200)]
CSIT-618 Add LaTeX support to release report

- Add option to generate PDF from release report.
- Conditional content
- Static plot conversion

Change-Id: I7c4f0b41898791d1cab446d0fc3b07220380e1b8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: remove import of non-existing vrf resource file 35/7835/1
Jan Gelety [Fri, 28 Jul 2017 11:21:24 +0000 (13:21 +0200)]
FIX: remove import of non-existing vrf resource file

Change-Id: I532beccc9f5034f7f6fa09a8757e5ff6bfbcd88a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoHC Test: add mising sudo to ODL client statup 93/7793/3
selias [Wed, 26 Jul 2017 12:01:48 +0000 (14:01 +0200)]
HC Test: add mising sudo to ODL client statup

Change-Id: I5231cb131f09edc0271c99095aacbf68144e7ded
Signed-off-by: selias <samelias@cisco.com>
6 years agoAdd memif to report 91/7791/2
Tibor Frank [Wed, 26 Jul 2017 11:16:30 +0000 (13:16 +0200)]
Add memif to report

Change-Id: Ie62a4d8b324e6557d9fdf9e37835bb79770bb7e5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoFIX: typo in tc02-64B-1t1c-ethip4udp-ip4base-iacl50-stateful-flows100k-pdrdisc 88/7788/2
Jan Gelety [Wed, 26 Jul 2017 10:16:59 +0000 (12:16 +0200)]
FIX: typo in tc02-64B-1t1c-ethip4udp-ip4base-iacl50-stateful-flows100k-pdrdisc

Change-Id: I31db1ee3f661715e9066035bdc4819fdc9171bb7
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-618 Update release report datapoints 86/7786/1
Peter Mikus [Wed, 26 Jul 2017 09:49:45 +0000 (11:49 +0200)]
CSIT-618 Update release report datapoints

Change-Id: Id1fe7dc826bb22e4267c29cce2a544c314ac0648
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFix pylint errors 04/7704/3
Tibor Frank [Fri, 21 Jul 2017 13:17:51 +0000 (15:17 +0200)]
Fix pylint errors

Change-Id: I9b8d69978ee35bf7610cdfd372135ce3515eec96
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoreport content - honeycomb, part 3 66/7766/3
selias [Tue, 25 Jul 2017 12:14:00 +0000 (14:14 +0200)]
report content - honeycomb, part 3

Change-Id: Ib87ef43e2ccdcd12b942f623051a4f268dda1a42
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-618 Release report update VIII 60/7760/2
Peter Mikus [Tue, 25 Jul 2017 09:54:26 +0000 (11:54 +0200)]
CSIT-618 Release report update VIII

Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoreport content - honeycomb, part2 56/7756/2
selias [Tue, 25 Jul 2017 08:52:41 +0000 (10:52 +0200)]
report content - honeycomb, part2

Change-Id: I0e49be2c78130b3a289b8d04839ed005b6a5ad7e
Signed-off-by: selias <samelias@cisco.com>
6 years agoReport: Use rounded values 57/7757/1
Tibor Frank [Tue, 25 Jul 2017 09:10:42 +0000 (11:10 +0200)]
Report: Use rounded values

Change-Id: I218ea0900ec6f5d3e513f5dfc15f6f4f3db16a66
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoDisplay "change" in format "xx.x%" 53/7753/1
Tibor Frank [Tue, 25 Jul 2017 05:30:29 +0000 (07:30 +0200)]
Display "change" in format "xx.x%"

Change-Id: I79e9abc28926759e3c4ce775ab2afa9fed79a377
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-618 Update report data points. 49/7749/2
Peter Mikus [Tue, 25 Jul 2017 03:45:31 +0000 (03:45 +0000)]
CSIT-618 Update report data points.

Change-Id: I9294e81690eabd198fe1b6d4974c5c4186e06d89
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: Path in run_report.sh 46/7746/2
Peter Mikus [Mon, 24 Jul 2017 18:40:41 +0000 (18:40 +0000)]
FIX: Path in run_report.sh

Change-Id: I2341a23b6165d0cec760021980937a3dc8dde7f0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: Typo in report_gen 44/7744/3
Peter Mikus [Mon, 24 Jul 2017 17:13:38 +0000 (17:13 +0000)]
FIX: Typo in report_gen

Change-Id: Ia8826ccf79b405d35025e06cafb8a80b877dc77d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoReport - fix generation of performance improvements 37/7737/1
Tibor Frank [Mon, 24 Jul 2017 14:27:07 +0000 (16:27 +0200)]
Report - fix generation of performance improvements

Change-Id: I93ef628f7abb82b880a02a5deddc36e626389e04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoFIX: Typo in run_report script 35/7735/1
Peter Mikus [Mon, 24 Jul 2017 13:48:51 +0000 (15:48 +0200)]
FIX: Typo in run_report script

Change-Id: I267b1bcc2aad6ccf1a162376950c27f96de7c03f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-618 Release report update VII 30/7730/6
Peter Mikus [Mon, 24 Jul 2017 12:22:02 +0000 (14:22 +0200)]
CSIT-618 Release report update VII

Change-Id: Ide7771b59cc3ee7619502a6805c8401528a8c874
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoStatic report content - Honeycomb 26/7726/6
selias [Thu, 20 Jul 2017 07:50:58 +0000 (09:50 +0200)]
Static report content - Honeycomb

Change-Id: I39899747f99684b932bb9c88268391e55b6fc779
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-726: Automate data collection for csv files for perf improvments 80/7680/9
Tibor Frank [Thu, 20 Jul 2017 12:10:13 +0000 (14:10 +0200)]
CSIT-726: Automate data collection for csv files for perf improvments

Change-Id: Ia161ecf9af94fd7193bba045be56738b323e4e2e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoFIX: add missing PDRDISC tag 27/7727/1
Jan Gelety [Mon, 24 Jul 2017 11:12:45 +0000 (13:12 +0200)]
FIX: add missing PDRDISC tag

Change-Id: Ide3963cb7d776d94f512009b9f34c6b4b6554253
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 23/7723/1
Jan Gelety [Mon, 24 Jul 2017 07:56:02 +0000 (09:56 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~78-g161c59c~b2610_amd64

- use new vpp ref build - centos7:
  17.10-rc0~78_g161c59c~b2607.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/57/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/57/

Change-Id: I2ea6e6be1aa111be275d9bef8003e64c10a581c2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-618 Update plot data points 18/7718/2
Peter Mikus [Mon, 24 Jul 2017 05:00:14 +0000 (05:00 +0000)]
CSIT-618 Update plot data points

Change-Id: I07102a162fbaad578b38f77e6069d277bb98517c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-618 Update plot data points. 14/7714/2
Peter Mikus [Sun, 23 Jul 2017 13:30:49 +0000 (13:30 +0000)]
CSIT-618 Update plot data points.

Change-Id: I7d7074af7506c4ec88061360e1cc88cadb52786c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: Report script typo 10/7710/1
Peter Mikus [Fri, 21 Jul 2017 18:55:53 +0000 (20:55 +0200)]
FIX: Report script typo

Change-Id: I05bdcad4b2602f961d353aa6dce2b5dac62eef3a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-618 Release report update VI 08/7708/2
Peter Mikus [Fri, 21 Jul 2017 16:11:39 +0000 (16:11 +0000)]
CSIT-618 Release report update VI

Change-Id: If78280fb0edc9b34478eeca6f7b972361e179d05
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-618 CSIT rls1707 Report - Update V 03/7703/3
Peter Mikus [Fri, 21 Jul 2017 12:58:29 +0000 (14:58 +0200)]
CSIT-618 CSIT rls1707 Report - Update V

Change-Id: Ie83a9410d0dffae5db337160984655e9d0c61b6e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agorls1707 report: edits of vpp_functional_tests/rls_notes 83/7683/3
Jan Gelety [Thu, 20 Jul 2017 14:54:48 +0000 (16:54 +0200)]
rls1707 report: edits of vpp_functional_tests/rls_notes

- updated section "Changes in CSIT"

- updated section "Known Issues"

Change-Id: I32e014889d4846f1a915e302a1c8fe93146444b8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoHC Test: update HC config file locations 97/7697/3
selias [Fri, 21 Jul 2017 08:12:10 +0000 (10:12 +0200)]
HC Test: update HC config file locations

Config location changed in:
https://gerrit.fd.io/r/#/c/7345/
https://gerrit.fd.io/r/#/c/7411/

Change-Id: I6eac14581f5cc4b23885e38753612962f7b807c7
Signed-off-by: selias <samelias@cisco.com>
6 years agorls1707 report: updates in vpp_unit_tests/overview.rst 91/7691/2
Maciek Konstantynowicz [Thu, 20 Jul 2017 18:13:58 +0000 (19:13 +0100)]
rls1707 report: updates in vpp_unit_tests/overview.rst

Change-Id: Idf00f16ade648ebf5653e5dca1c0759997f37589
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agorls1707 report: edits in introduction/csit_design.rst 87/7687/2
Maciek Konstantynowicz [Thu, 20 Jul 2017 17:46:17 +0000 (18:46 +0100)]
rls1707 report: edits in introduction/csit_design.rst

Change-Id: I9f89ebbfc6b999dc4bb0cf0d938ecc03ef42c2fb
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agorls1707 report: methodology content updates in vpp_performance_tests/overview.rst 86/7686/2
Maciek Konstantynowicz [Thu, 20 Jul 2017 17:33:50 +0000 (18:33 +0100)]
rls1707 report: methodology content updates in vpp_performance_tests/overview.rst

Change-Id: I99d8671528ad20600f44a5aab967782561d5207c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoHC Test: update bootstrap for HC performance job 82/7682/1
selias [Thu, 20 Jul 2017 14:38:28 +0000 (16:38 +0200)]
HC Test: update bootstrap for HC performance job

missing in change https://gerrit.fd.io/r/7221

Change-Id: Ib372ae70864fa9bdf6e6b7df1e4c60ed8507b691
Signed-off-by: selias <samelias@cisco.com>
6 years agoFIX: run build qemu only for the 1st VM on DUT 78/7678/2
Jan Gelety [Thu, 20 Jul 2017 12:47:07 +0000 (14:47 +0200)]
FIX: run build qemu only for the 1st VM on DUT

Change-Id: Ib0fd10e9cb0c6eaeb75ec96e4459d5fb27c656bf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoHC Test: bugfixes for hc2vpp ODL jobs 85/7485/4
selias [Fri, 7 Jul 2017 13:28:48 +0000 (15:28 +0200)]
HC Test: bugfixes for hc2vpp ODL jobs

 - add shutdown check for ODL client in teardown
 - stop VPP in teardown

 - add delay after HC startup
HC features load asynchronously, no way to check if they're all running.

Change-Id: I9d2c51b68ba51284d2d409a77d6cd9fd478e1725
Signed-off-by: selias <samelias@cisco.com>
6 years agorls1707 report: edits of vpp_performance_tests/rls_notes 37/7637/6
Maciek Konstantynowicz [Wed, 19 Jul 2017 10:20:44 +0000 (11:20 +0100)]
rls1707 report: edits of vpp_performance_tests/rls_notes

Change-Id: Ia7fbe0fbfa83c7f61f59850ea98e00405fc82711
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoFIX: Report script typo 73/7673/2
Peter Mikus [Thu, 20 Jul 2017 10:19:18 +0000 (12:19 +0200)]
FIX: Report script typo

Change-Id: I80cafa86157869a03dfd5d0a0f6d6c0affd2df75
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-ndrpdrdisc 71/7671/1
Jan Gelety [Thu, 20 Jul 2017 11:13:29 +0000 (13:13 +0200)]
FIX: 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-ndrpdrdisc

Change-Id: I5ca0649875c74bcd86106e53ba77d64f833cf28f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFIX: Report script typo 67/7667/1
Peter Mikus [Thu, 20 Jul 2017 10:19:18 +0000 (12:19 +0200)]
FIX: Report script typo

Change-Id: I1358fcf558f1156f2e1bc559652f6f98c5438b36
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: fix of multiple perf test issues 63/7663/2
Jan Gelety [Thu, 20 Jul 2017 07:51:16 +0000 (09:51 +0200)]
FIX: fix of multiple perf test issues

Change-Id: I24c823352b2832eb6da2aad0fd70570beb990f3f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-618 CSIT rls1707 Report - Update IV 64/7664/4
Peter Mikus [Thu, 20 Jul 2017 09:03:03 +0000 (11:03 +0200)]
CSIT-618 CSIT rls1707 Report - Update IV

Change-Id: Iff48d515ebdae40920660627b4b3b2e35351b3a1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFix order of TC blocks in l2bd alc perf test 49/7649/2
Jan Gelety [Wed, 19 Jul 2017 15:51:18 +0000 (17:51 +0200)]
Fix order of TC blocks in l2bd alc perf test

Change-Id: I7862ef59813b6fd2f9b35897e04b4b9785e189e8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agorls1707 report: edits of vpp_performance_tests/test_environment.rst 52/7652/2
Maciek Konstantynowicz [Wed, 19 Jul 2017 22:14:00 +0000 (23:14 +0100)]
rls1707 report: edits of vpp_performance_tests/test_environment.rst

Change-Id: Ic0a544e12ab1a3b7caf39ef1a45db412b887bff7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agorls1707 report: edits of vpp_performance_tests/overview.rst 53/7653/1
Maciek Konstantynowicz [Wed, 19 Jul 2017 22:24:46 +0000 (23:24 +0100)]
rls1707 report: edits of vpp_performance_tests/overview.rst

Change-Id: I2a152dc6b0367281485da07fcf89e6f2814b4a2d
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoFIX: typo issues in teardown for ACL perf tests 45/7645/1
Jan Gelety [Wed, 19 Jul 2017 13:08:18 +0000 (15:08 +0200)]
FIX: typo issues in teardown for ACL perf tests

Change-Id: I2232b010efb4f4b071a0fe3efaaeb85f2830bf3c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFIX: CSIT rls1707 Report - Update III 89/7589/4
Peter Mikus [Mon, 17 Jul 2017 05:52:54 +0000 (07:52 +0200)]
FIX: CSIT rls1707 Report - Update III

Change-Id: Ic857e004136b2d936c2a8affb779ada238eb007c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-704: Add ACL IP4BASE perf tests 84/7484/10
Jan Gelety [Fri, 7 Jul 2017 13:05:33 +0000 (15:05 +0200)]
CSIT-704: Add ACL IP4BASE perf tests

Change-Id: I1fada28f2855534faf3b3051a3efe1cbb4dcdd03
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFIX: Do not download Qemu multiple times per job 33/7633/2
Peter Mikus [Wed, 19 Jul 2017 07:21:49 +0000 (07:21 +0000)]
FIX: Do not download Qemu multiple times per job

- Add caching of Qemu source code to avoid downloading multiple times.

Change-Id: Ie06dd87a08c38ca27fbe9844f25f11b8df1ff2e2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-725: Use csv files for performance improvments table 24/7624/2
Tibor Frank [Tue, 18 Jul 2017 12:39:07 +0000 (14:39 +0200)]
CSIT-725: Use csv files for performance improvments table

 - Use CSV files instead of static content in "performance improvments"
   chapter in report.
 - The content of csv files is created manualy now, it will be automatized.

Change-Id: Ied00f33612e0daf13cf81cf9b4c3827d04c5d5b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-703: Add ACL 2t2c perf test cases 79/7479/6
Jan Gelety [Fri, 7 Jul 2017 08:04:37 +0000 (10:04 +0200)]
CSIT-703: Add ACL 2t2c perf test cases

Change-Id: I51f6015681d1fc62da56cf1cca110f7a4c82ba10
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFIX: Vhost tagging 22/7622/2
Peter Mikus [Tue, 18 Jul 2017 12:41:39 +0000 (14:41 +0200)]
FIX: Vhost tagging

Change-Id: Id2111bdf45dd88e28c25917a3519ba59f3fad550
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoHC Test: Update archive items path in csit-hc2vpp jobs 60/7560/4
selias [Thu, 13 Jul 2017 09:45:10 +0000 (11:45 +0200)]
HC Test: Update archive items path in csit-hc2vpp jobs

merge after https://gerrit.fd.io/r/7314

Change-Id: I36d10bc7fd3c720eaf75a427b691d516a7399ea0
Signed-off-by: selias <samelias@cisco.com>
6 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 99/7599/2
Jan Gelety [Mon, 17 Jul 2017 13:26:55 +0000 (15:26 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~60-g213b5aa~b2592_amd64

- use new vpp ref build - centos7:
  17.10-rc0~60_g213b5aa~b2589.x86_64

- use new dpdk build:
  17.05-vpp6

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/55/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/55/

Change-Id: I7654c7e8186f5be2bb8ccd4dbebe0ac9e3707a92
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFIX: Vhost 1024 - typo 09/7609/1
Peter Mikus [Tue, 18 Jul 2017 09:21:24 +0000 (11:21 +0200)]
FIX: Vhost 1024 - typo

Change-Id: I341b8280dfb87e620387b3d7cbf3fc2019c85a53
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: Initialize L2BD keyword 06/7606/4
Peter Mikus [Tue, 18 Jul 2017 07:19:45 +0000 (09:19 +0200)]
FIX: Initialize L2BD keyword

Currently in Performance the "Initialize L2 bridge domain" keyword is adding
interfaces to L2DB per node and at the same time waiting until interfaces
become UP. This may be an issue if physical interfaces interconnecting DUTs
required to be administratively UP on both DUTs to physical link state became
UP.

This fix is supposed to check the link state after all DUTs are
initialized.

Change-Id: I430b4285967f6168e6c74e0089a3e0d037b251d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-618 CSIT rls1707 Report - Update II 95/7595/3
Peter Mikus [Mon, 17 Jul 2017 12:14:23 +0000 (14:14 +0200)]
CSIT-618 CSIT rls1707 Report - Update II

Change-Id: I50a210930c0571ca910ead1724de7848c0911646
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-723: Source code auto-generation for 1707 98/7598/2
Tibor Frank [Mon, 17 Jul 2017 13:27:00 +0000 (15:27 +0200)]
CSIT-723: Source code auto-generation for 1707

Change-Id: Ia178ac180fd344db620757dcc2b9cbb5010276c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years ago Fix the TLDK test tcpdump not found issue. 82/7582/3
Fangyin Hu [Fri, 14 Jul 2017 11:27:20 +0000 (04:27 -0700)]
Fix the TLDK test tcpdump not found issue.
Add the PYBOT execute exit status code.

Change-Id: If0fc29c580177f1b187ec751c6708fc138838bed
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
6 years ago Add the NSH SFC functional test document. 90/7590/2
Fangyin Hu [Mon, 17 Jul 2017 08:18:02 +0000 (01:18 -0700)]
Add the NSH SFC functional test document.

Change-Id: I8e99d2311a530390349dddca522d6f3c8c35ab00
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
6 years agoFIX: remove previous QEMU build when needed to change qsz 68/7568/4
Jan Gelety [Thu, 13 Jul 2017 15:06:06 +0000 (17:06 +0200)]
FIX: remove previous QEMU build when needed to change qsz

Change-Id: I949f8800b45354c205c5a5d36ab2abeeb93409dc
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-618 CSIT rls1707 Report - Update I 67/7567/6
Peter Mikus [Thu, 13 Jul 2017 12:42:38 +0000 (14:42 +0200)]
CSIT-618 CSIT rls1707 Report - Update I

Change-Id: I7c3af55db6cc89f03004db6ddf6fcf67965132a7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFix: Memif IMIX frame size test case 74/7574/2
Peter Mikus [Fri, 14 Jul 2017 05:14:25 +0000 (05:14 +0000)]
Fix: Memif IMIX frame size test case

Fix the variable for calculating the IMIX_v4_1 in traffic
profile.

Change-Id: Ia5e643c0ec2c9cd67d4506b081a919f836ac1b26
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 57/7557/1
Jan Gelety [Thu, 13 Jul 2017 06:59:58 +0000 (08:59 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~44-g75e2f2a~b2576_amd64

- use new vpp ref build - centos7:
  17.10-rc0~44_g75e2f2a~b2573.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/54/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/54/

Change-Id: Ia4b60c29a43db5a009024128badce5a369a77d20
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFIX: use correct test suite name in weeklu bootstrap (typo fix) 34/7534/1
Jan Gelety [Wed, 12 Jul 2017 14:12:03 +0000 (16:12 +0200)]
FIX: use correct test suite name in weeklu bootstrap (typo fix)

Change-Id: Ic063e8688ee180f28ccf03831168aa38eee03d7e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-688 Create test cases for memif 08/7408/5
Peter Mikus [Tue, 4 Jul 2017 04:50:36 +0000 (04:50 +0000)]
CSIT-688 Create test cases for memif

Change-Id: Ia95850af4883474a0929df8e5269b59b3de95087
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoAdd IRQ/RCU/Writeback pinning to ansible 18/7518/1
Peter Mikus [Tue, 11 Jul 2017 12:44:13 +0000 (14:44 +0200)]
Add IRQ/RCU/Writeback pinning to ansible

Change-Id: I650d9cb1ee44b6fa7cee79a86dad2b515256b239
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years ago Fix the TLDK test scripts execute path issue. 73/7473/1
Fangyin Hu [Fri, 7 Jul 2017 03:58:40 +0000 (20:58 -0700)]
Fix the TLDK test scripts execute path issue.

Change-Id: I7d0c20443db841516942479a067561c822a03bbd
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
6 years ago Patch to tldk bootstrap on the tldk package download. 40/7240/4
Fangyin Hu [Wed, 21 Jun 2017 02:08:17 +0000 (22:08 -0400)]
Patch to tldk bootstrap on the tldk package download.
    Rebase and fix the path issue.

Change-Id: I572e4c81feb54e7f391af0007af709cafa42c255
Signed-off-by: qun wan <qun.wan@intel.com>
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
6 years agoHC Test: Update script path on bootstrap-hc2vpp-perf.sh 36/7436/2
selias [Thu, 6 Jul 2017 09:52:05 +0000 (11:52 +0200)]
HC Test: Update script path on bootstrap-hc2vpp-perf.sh

Change-Id: I5ed178448e99465b39267577ae77d79fc8f3f2c2
Signed-off-by: selias <samelias@cisco.com>
6 years agoHC Test: increase timeout value for ODL setup 37/7437/3
selias [Thu, 6 Jul 2017 10:00:09 +0000 (12:00 +0200)]
HC Test: increase timeout value for ODL setup

Change-Id: I9be9ef6bb6751fbaa61115d2052433e14b4b14fb
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-622: Stateful Security Groups perf tests 21/6121/40
Jan Gelety [Wed, 5 Apr 2017 06:54:11 +0000 (08:54 +0200)]
CSIT-622: Stateful Security Groups perf tests

1. add L2BD iACL statefull and stateless tests with 1, 10 and 50 not-hitting
   ACEs in combination with 100, 10k and 100k flows per direction

2. add L2BD oACL statefull and stateless tests with 1, 10 and 50 not-hitting
   ACEs in combination with 100, 10k and 100k flows per direction

Change-Id: Ia38589aa81b50c5ccdf2813ad6fadd22b46fffeb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-660: add vring1024 tuned CFS for vpp workers and guest-testpmd 93/7293/12
Jan Gelety [Fri, 23 Jun 2017 11:12:25 +0000 (13:12 +0200)]
CSIT-660: add vring1024 tuned CFS for vpp workers and guest-testpmd

- add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 1024 and
  tuned CFS setting

Change-Id: Ief8b4b86cdecfa39bf8cf0ec90fb844edfc6f396
Signed-off-by: Jan Gelety <jgelety@cisco.com>