csit.git
6 years agoHC Test: Increase timeout values in HC Setup and Teardown 27/8627/2 rls1707
selias [Tue, 3 Oct 2017 08:56:06 +0000 (10:56 +0200)]
HC Test: Increase timeout values in HC Setup and Teardown

needed due to recent VIRL slowness

Change-Id: I4cbca94001a7503f1e29c56680fa68a88e6092c6
Signed-off-by: selias <samelias@cisco.com>
6 years agoHC Test: add missing teardown to multi-IP traffic test 59/8259/3
selias [Wed, 30 Aug 2017 17:00:43 +0000 (19:00 +0200)]
HC Test: add missing teardown to multi-IP traffic test

Change-Id: I43cc3fffa2a5a8a7bcd965937fcd0bc3e5ac3b24
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-767: Add acl 64B 4t4c perf tests 67/7967/1
Jan Gelety [Tue, 8 Aug 2017 13:08:15 +0000 (15:08 +0200)]
CSIT-767: Add acl 64B 4t4c perf tests

Change-Id: Id1b187c195c955d0e533d8d6864fff6a3fa8332e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 8c9bec21e04461742de8f45d8ec17046fe96ddd9)

6 years agoUse 100kpps step for ACL 64B perf tests 66/7966/1
Jan Gelety [Mon, 7 Aug 2017 07:01:01 +0000 (09:01 +0200)]
Use 100kpps step for ACL 64B perf tests

ACL 64B tests take a long time. Usage of 100kpps will provide results
with adequate accurancy and test exectuion time.

Change-Id: I6818963f3ce16b9aaae72cf579294f87d10a24a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 8280ef881d743a935d7804f02615b1f315d44f14)

6 years agoCSIT-742: Add manual trigger for ACL perf tests 82/7882/1
Jan Gelety [Tue, 1 Aug 2017 07:56:13 +0000 (09:56 +0200)]
CSIT-742: Add manual trigger for ACL perf tests

Impelmenting needed change in bootstrap-verify-perf.sh file to
provide manual trigger that will allow to run 1T1C (1 core, 1 thread)
and 2T2C (2 core, 2 threads) ACL tests per VPP patch when required.

Change-Id: I3d9cc403ca8ea90da23aca524c4b4ddbf26eb217
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 1a65bb060fb464ea0113ec082af66fce481c7773)

6 years agoCSIT-618 Add LaTeX support to release report 60/7860/1
Peter Mikus [Fri, 28 Jul 2017 11:06:56 +0000 (13:06 +0200)]
CSIT-618 Add LaTeX support to release report

- Add option to generate PDF from release report.
- Conditional content
- Static plot conversion

Change-Id: I7c4f0b41898791d1cab446d0fc3b07220380e1b8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 196ed0599148d6c8ed0e2ca82ad03e129e26428a)

6 years agoHC Test: add mising sudo to ODL client statup 95/7795/1
selias [Wed, 26 Jul 2017 12:06:37 +0000 (14:06 +0200)]
HC Test: add mising sudo to ODL client statup

Change-Id: I2b023ae584599c7cc4d942bf85c6c93b1fe294fb
Signed-off-by: selias <samelias@cisco.com>
6 years agoAdd memif to report 92/7792/1
Tibor Frank [Wed, 26 Jul 2017 11:16:30 +0000 (13:16 +0200)]
Add memif to report

Change-Id: Ie62a4d8b324e6557d9fdf9e37835bb79770bb7e5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a459a83441b1eaa6268238c53e41f84753b1e76c)

6 years agoFIX: typo in tc02-64B-1t1c-ethip4udp-ip4base-iacl50-stateful-flows100k-pdrdisc 90/7790/1
Jan Gelety [Wed, 26 Jul 2017 10:16:59 +0000 (12:16 +0200)]
FIX: typo in tc02-64B-1t1c-ethip4udp-ip4base-iacl50-stateful-flows100k-pdrdisc

Change-Id: I31db1ee3f661715e9066035bdc4819fdc9171bb7
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 5f976e3fd3572edfdd5ce5e3e1b7604a5c2a5807)

6 years agoCSIT-618 Update release report datapoints 87/7787/1
Peter Mikus [Wed, 26 Jul 2017 09:49:45 +0000 (11:49 +0200)]
CSIT-618 Update release report datapoints

Change-Id: Id1fe7dc826bb22e4267c29cce2a544c314ac0648
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit e312d70bfe230efcdce9ff933aa61a6bcc1a8f3c)

6 years agoreport content - honeycomb, part 3 67/7767/1
selias [Tue, 25 Jul 2017 12:14:00 +0000 (14:14 +0200)]
report content - honeycomb, part 3

Change-Id: Ib87ef43e2ccdcd12b942f623051a4f268dda1a42
Signed-off-by: selias <samelias@cisco.com>
(cherry picked from commit 601629148310349732f76259df0fc5b5e26ea9f7)

6 years agoHC Test: Update archive items path in csit-hc2vpp jobs 40/7740/2
selias [Thu, 13 Jul 2017 09:45:10 +0000 (11:45 +0200)]
HC Test: Update archive items path in csit-hc2vpp jobs

merge after https://gerrit.fd.io/r/7314

Change-Id: I36d10bc7fd3c720eaf75a427b691d516a7399ea0
Signed-off-by: selias <samelias@cisco.com>
(cherry picked from commit e6d3baeead965e36546efd4bb6d80f974b650d29)

6 years agoHC Test: bugfixes for hc2vpp ODL jobs 41/7741/2
selias [Fri, 7 Jul 2017 13:28:48 +0000 (15:28 +0200)]
HC Test: bugfixes for hc2vpp ODL jobs

 - add shutdown check for ODL client in teardown
 - stop VPP in teardown

 - add delay after HC startup
HC features load asynchronously, no way to check if they're all running.

Change-Id: I9d2c51b68ba51284d2d409a77d6cd9fd478e1725
Signed-off-by: selias <samelias@cisco.com>
(cherry picked from commit 835cb6439afb359dc2ebef02355314c4bebde75e)

6 years agoCSIT-618 Release report update VIII 62/7762/1
Peter Mikus [Tue, 25 Jul 2017 09:54:26 +0000 (11:54 +0200)]
CSIT-618 Release report update VIII

Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1e2bf354994a7ec53c1acee2d1c2fe2208f7c905)

6 years agoreport content - honeycomb, part2 61/7761/1
selias [Tue, 25 Jul 2017 08:52:41 +0000 (10:52 +0200)]
report content - honeycomb, part2

Change-Id: I0e49be2c78130b3a289b8d04839ed005b6a5ad7e
Signed-off-by: selias <samelias@cisco.com>
(cherry picked from commit 69a8a040b70ed67bbc7d3a820166871f815f1d9c)

6 years agoReport: Use rounded values 58/7758/1
Tibor Frank [Tue, 25 Jul 2017 09:10:42 +0000 (11:10 +0200)]
Report: Use rounded values

Change-Id: I218ea0900ec6f5d3e513f5dfc15f6f4f3db16a66
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a0ff7c5d45f49e06d72071ad926274fd4c0bb061)

6 years agoDisplay "change" in format "xx.x%" 55/7755/1
Tibor Frank [Tue, 25 Jul 2017 05:30:29 +0000 (07:30 +0200)]
Display "change" in format "xx.x%"

Change-Id: I79e9abc28926759e3c4ce775ab2afa9fed79a377
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit dbc81d911fb43d76b255d11fd0dbfebff38bd261)

6 years agoCSIT-618 Update report data points. 50/7750/1
Peter Mikus [Tue, 25 Jul 2017 03:45:31 +0000 (03:45 +0000)]
CSIT-618 Update report data points.

Change-Id: I9294e81690eabd198fe1b6d4974c5c4186e06d89
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 7ab64cd86a58dd5f2039fd0cf79cd4045c1b2789)

6 years agoFIX: Path in run_report.sh 47/7747/1
Peter Mikus [Mon, 24 Jul 2017 18:40:41 +0000 (18:40 +0000)]
FIX: Path in run_report.sh

Change-Id: I2341a23b6165d0cec760021980937a3dc8dde7f0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit f4a86c6f5432c16394b98f339030c5ea04d435e2)

6 years agoFIX: Typo in report_gen 45/7745/1
Peter Mikus [Mon, 24 Jul 2017 17:13:38 +0000 (17:13 +0000)]
FIX: Typo in report_gen

Change-Id: Ia8826ccf79b405d35025e06cafb8a80b877dc77d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 267795011019bb2ee9df3c0e568d54aa2281908d)

6 years agoReport - fix generation of performance improvements 38/7738/1
Tibor Frank [Mon, 24 Jul 2017 14:27:07 +0000 (16:27 +0200)]
Report - fix generation of performance improvements

Change-Id: I93ef628f7abb82b880a02a5deddc36e626389e04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 601d8e63eed1d7db19a001923298b6fe209787b0)

6 years agoFIX: Typo in run_report script 36/7736/1
Peter Mikus [Mon, 24 Jul 2017 13:48:51 +0000 (15:48 +0200)]
FIX: Typo in run_report script

Change-Id: I267b1bcc2aad6ccf1a162376950c27f96de7c03f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 71e61ec941914c658dba7442cb828b8479b90b83)

6 years agoCSIT-618 Release report update VII 34/7734/1
Peter Mikus [Mon, 24 Jul 2017 12:22:02 +0000 (14:22 +0200)]
CSIT-618 Release report update VII

Change-Id: Ide7771b59cc3ee7619502a6805c8401528a8c874
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 61407a72649b7b355472350c2186aa36bf8182e7)

6 years agoStatic report content - Honeycomb 33/7733/1
selias [Thu, 20 Jul 2017 07:50:58 +0000 (09:50 +0200)]
Static report content - Honeycomb

Change-Id: I39899747f99684b932bb9c88268391e55b6fc779
Signed-off-by: selias <samelias@cisco.com>
(cherry picked from commit cd8d4dc1498a69b4f9541fb4405fd31fd61d81d9)

6 years agoCSIT-726: Automate data collection for csv files for perf improvments 29/7729/1
Tibor Frank [Thu, 20 Jul 2017 12:10:13 +0000 (14:10 +0200)]
CSIT-726: Automate data collection for csv files for perf improvments

Change-Id: Ia161ecf9af94fd7193bba045be56738b323e4e2e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1911067935bdf6481fc9b89f40d79ca61f2448d0)

6 years agoFIX: add missing PDRDISC tag 28/7728/1
Jan Gelety [Mon, 24 Jul 2017 11:12:45 +0000 (13:12 +0200)]
FIX: add missing PDRDISC tag

Change-Id: Ide3963cb7d776d94f512009b9f34c6b4b6554253
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 856e4096117e596dda3f518eb6f6c503e58ea4e1)

6 years agoCSIT-618 Update plot data points 19/7719/1
Peter Mikus [Mon, 24 Jul 2017 05:00:14 +0000 (05:00 +0000)]
CSIT-618 Update plot data points

Change-Id: I07102a162fbaad578b38f77e6069d277bb98517c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d351379e46964bf50f3dd27dc94c302596cd6110)

6 years agoCSIT-618 Update plot data points. 15/7715/1
Peter Mikus [Sun, 23 Jul 2017 13:30:49 +0000 (13:30 +0000)]
CSIT-618 Update plot data points.

Change-Id: I7d7074af7506c4ec88061360e1cc88cadb52786c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 6281fac904be991f5b80bbd7b42b8b8177bc3823)

6 years agoFIX: Report script typo 11/7711/1
Peter Mikus [Fri, 21 Jul 2017 18:55:53 +0000 (20:55 +0200)]
FIX: Report script typo

Change-Id: I05bdcad4b2602f961d353aa6dce2b5dac62eef3a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 113052a53f9a771f465ea26ccd64344b46b78cf9)

6 years agoCSIT-618 Release report update VI 09/7709/1
Peter Mikus [Fri, 21 Jul 2017 16:11:39 +0000 (16:11 +0000)]
CSIT-618 Release report update VI

Change-Id: If78280fb0edc9b34478eeca6f7b972361e179d05
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 20ee7a806931d09c5b773ca0987a29eafb202ed2)

6 years agoCSIT-618 CSIT rls1707 Report - Update V 05/7705/1
Peter Mikus [Fri, 21 Jul 2017 12:58:29 +0000 (14:58 +0200)]
CSIT-618 CSIT rls1707 Report - Update V

Change-Id: Ie83a9410d0dffae5db337160984655e9d0c61b6e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 4a4f4d6d0f4aafc3c7a97d525879503fdf0e8ad0)

6 years agorls1707 report: edits of vpp_functional_tests/rls_notes 00/7700/1
Jan Gelety [Thu, 20 Jul 2017 14:54:48 +0000 (16:54 +0200)]
rls1707 report: edits of vpp_functional_tests/rls_notes

- updated section "Changes in CSIT"

- updated section "Known Issues"

Change-Id: I32e014889d4846f1a915e302a1c8fe93146444b8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit b6872c6baf0cb9d7cee3bba633c2cf851d2419b4)

6 years agoHC Test: update bootstrap for HC performance job 84/7684/2
selias [Thu, 20 Jul 2017 14:38:28 +0000 (16:38 +0200)]
HC Test: update bootstrap for HC performance job

missing in change https://gerrit.fd.io/r/7221

Change-Id: Ib372ae70864fa9bdf6e6b7df1e4c60ed8507b691
Signed-off-by: selias <samelias@cisco.com>
(cherry picked from commit 41348644e8ea2633bce38f1576c6178492b52cf7)

6 years agorls1707 report: updates in vpp_unit_tests/overview.rst 96/7696/1
Maciek Konstantynowicz [Thu, 20 Jul 2017 18:13:58 +0000 (19:13 +0100)]
rls1707 report: updates in vpp_unit_tests/overview.rst

Change-Id: Idf00f16ade648ebf5653e5dca1c0759997f37589
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 44d9ef67350e094f184a5d465f1dc93ddc94cfdc)

6 years agorls1707 report: edits in introduction/csit_design.rst 95/7695/1
Maciek Konstantynowicz [Thu, 20 Jul 2017 17:46:17 +0000 (18:46 +0100)]
rls1707 report: edits in introduction/csit_design.rst

Change-Id: I9f89ebbfc6b999dc4bb0cf0d938ecc03ef42c2fb
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit fb6e84c36e47c9f9998efa8139d50d96feb871f1)

6 years agorls1707 report: methodology content updates in vpp_performance_tests/overview.rst 94/7694/1
Maciek Konstantynowicz [Thu, 20 Jul 2017 17:33:50 +0000 (18:33 +0100)]
rls1707 report: methodology content updates in vpp_performance_tests/overview.rst

Change-Id: I99d8671528ad20600f44a5aab967782561d5207c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit db98afadb9664144386c1642d217a21e5f223b00)

6 years agoFIX: run build qemu only for the 1st VM on DUT 79/7679/1
Jan Gelety [Thu, 20 Jul 2017 12:47:07 +0000 (14:47 +0200)]
FIX: run build qemu only for the 1st VM on DUT

Change-Id: Ib0fd10e9cb0c6eaeb75ec96e4459d5fb27c656bf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit e4071a518036fa008507e27e9d0be047fb32ae7e)

6 years agoUpdate of NSH_SFC_VER files 75/7675/3
Peter Mikus [Thu, 20 Jul 2017 11:30:11 +0000 (11:30 +0000)]
Update of NSH_SFC_VER files

Change-Id: I561c69a88e9f3dff5879bab35ecffb275bbd44e9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agorls1707 report: edits of vpp_performance_tests/rls_notes 77/7677/1
Maciek Konstantynowicz [Wed, 19 Jul 2017 10:20:44 +0000 (11:20 +0100)]
rls1707 report: edits of vpp_performance_tests/rls_notes

Change-Id: Ia7fbe0fbfa83c7f61f59850ea98e00405fc82711
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 912acb80b6607a6b904242a0ec695c874580bd02)

6 years agoFIX: Report script typo 74/7674/1
Peter Mikus [Thu, 20 Jul 2017 10:19:18 +0000 (12:19 +0200)]
FIX: Report script typo

Change-Id: I80cafa86157869a03dfd5d0a0f6d6c0affd2df75
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 173ce06df28d56769eab6d76a36d609a32459d27)

6 years agoFIX: 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-ndrpdrdisc 72/7672/1
Jan Gelety [Thu, 20 Jul 2017 11:13:29 +0000 (13:13 +0200)]
FIX: 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-ndrpdrdisc

Change-Id: I5ca0649875c74bcd86106e53ba77d64f833cf28f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 279d6429b58c30579bd4afbe21bbe6ee7d86f181)

6 years agoFIX: Report script typo 68/7668/1
Peter Mikus [Thu, 20 Jul 2017 10:19:18 +0000 (12:19 +0200)]
FIX: Report script typo

Change-Id: I1358fcf558f1156f2e1bc559652f6f98c5438b36
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 2656fed5d73b3ffde2b8b7496a68b527e9e32045)

6 years agoFIX: fix of multiple perf test issues 66/7666/1
Jan Gelety [Thu, 20 Jul 2017 07:51:16 +0000 (09:51 +0200)]
FIX: fix of multiple perf test issues

Change-Id: I24c823352b2832eb6da2aad0fd70570beb990f3f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 5906589057ce7ed9e1182bc93381dee42c79f2a4)

6 years agoCSIT-618 CSIT rls1707 Report - Update IV 65/7665/1
Peter Mikus [Thu, 20 Jul 2017 09:03:03 +0000 (11:03 +0200)]
CSIT-618 CSIT rls1707 Report - Update IV

Change-Id: Iff48d515ebdae40920660627b4b3b2e35351b3a1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 0956f4f87140b878a3a4da2e192dddd2c9ecc975)

6 years agoFix order of TC blocks in l2bd alc perf test 60/7660/1
Jan Gelety [Wed, 19 Jul 2017 15:51:18 +0000 (17:51 +0200)]
Fix order of TC blocks in l2bd alc perf test

Change-Id: I7862ef59813b6fd2f9b35897e04b4b9785e189e8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit fb2e2d191ff81f0a26c1ba67f75eca27bc701cca)

6 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 55/7655/3
Peter Mikus [Thu, 20 Jul 2017 04:48:03 +0000 (04:48 +0000)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use release vpp build - ubuntu 16.04:
  17.07-release_amd64

- use release vpp build - centos7:
  17.07-release.x86_64

Change-Id: I4539baa647e7fb27c5c41995507c56e42b676da3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agorls1707 report: edits of vpp_performance_tests/test_environment.rst 58/7658/1
Maciek Konstantynowicz [Wed, 19 Jul 2017 22:14:00 +0000 (23:14 +0100)]
rls1707 report: edits of vpp_performance_tests/test_environment.rst

Change-Id: Ic0a544e12ab1a3b7caf39ef1a45db412b887bff7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 133b8b6c080d0372bccf7b803ddad1301abc9dd1)

6 years agorls1707 report: edits of vpp_performance_tests/overview.rst 56/7656/1
Maciek Konstantynowicz [Wed, 19 Jul 2017 22:24:46 +0000 (23:24 +0100)]
rls1707 report: edits of vpp_performance_tests/overview.rst

Change-Id: I2a152dc6b0367281485da07fcf89e6f2814b4a2d
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 02b0011703354f4caaf476ff4cac0ec4ccd8e43a)

6 years agoFIX: typo issues in teardown for ACL perf tests 46/7646/1
Jan Gelety [Wed, 19 Jul 2017 13:08:18 +0000 (15:08 +0200)]
FIX: typo issues in teardown for ACL perf tests

Change-Id: I2232b010efb4f4b071a0fe3efaaeb85f2830bf3c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 38d995705f36eec47ecefc927acea009e93cab19)

6 years agoFIX: CSIT rls1707 Report - Update III 42/7642/1
Peter Mikus [Mon, 17 Jul 2017 05:52:54 +0000 (07:52 +0200)]
FIX: CSIT rls1707 Report - Update III

Change-Id: Ic857e004136b2d936c2a8affb779ada238eb007c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit be82f49dda573dfc7010a56d6f76f8e161beac16)

6 years agoCSIT-704: Add ACL IP4BASE perf tests 39/7639/1
Jan Gelety [Fri, 7 Jul 2017 13:05:33 +0000 (15:05 +0200)]
CSIT-704: Add ACL IP4BASE perf tests

Change-Id: I1fada28f2855534faf3b3051a3efe1cbb4dcdd03
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit cb6b9fd6499a6e2f0efbb87ee84a8e768a7df869)

6 years agoFIX: Do not download Qemu multiple times per job 35/7635/1
Peter Mikus [Wed, 19 Jul 2017 07:21:49 +0000 (07:21 +0000)]
FIX: Do not download Qemu multiple times per job

- Add caching of Qemu source code to avoid downloading multiple times.

Change-Id: Ie06dd87a08c38ca27fbe9844f25f11b8df1ff2e2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit ebf71b8ec8863ac82becfcdee97d4e7164fb2fcb)

6 years agoCSIT-725: Use csv files for performance improvments table 31/7631/1
Tibor Frank [Tue, 18 Jul 2017 12:39:07 +0000 (14:39 +0200)]
CSIT-725: Use csv files for performance improvments table

 - Use CSV files instead of static content in "performance improvments"
   chapter in report.
 - The content of csv files is created manualy now, it will be automatized.

Change-Id: Ied00f33612e0daf13cf81cf9b4c3827d04c5d5b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fa19644365e53cdf2a02c3c93b1b93a5d3891210)

6 years agoCSIT-703: Add ACL 2t2c perf test cases 30/7630/1
Jan Gelety [Fri, 7 Jul 2017 08:04:37 +0000 (10:04 +0200)]
CSIT-703: Add ACL 2t2c perf test cases

Change-Id: I51f6015681d1fc62da56cf1cca110f7a4c82ba10
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 1e81689582f6f1308903406ae443eb437a889726)

6 years agoFIX: Vhost tagging 23/7623/1
Peter Mikus [Tue, 18 Jul 2017 12:41:39 +0000 (14:41 +0200)]
FIX: Vhost tagging

Change-Id: Id2111bdf45dd88e28c25917a3519ba59f3fad550
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 6714a31b73bd8aa03c9edd8da9db4f9173d5679d)

6 years agoFIX: Vhost 1024 - typo 10/7610/1
Peter Mikus [Tue, 18 Jul 2017 09:21:24 +0000 (11:21 +0200)]
FIX: Vhost 1024 - typo

Change-Id: I341b8280dfb87e620387b3d7cbf3fc2019c85a53
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 7f1f3767de67af6d4f33e8466d8cc274d2f8ca71)

6 years agoFIX: Initialize L2BD keyword 08/7608/1
Peter Mikus [Tue, 18 Jul 2017 07:19:45 +0000 (09:19 +0200)]
FIX: Initialize L2BD keyword

Currently in Performance the "Initialize L2 bridge domain" keyword is adding
interfaces to L2DB per node and at the same time waiting until interfaces
become UP. This may be an issue if physical interfaces interconnecting DUTs
required to be administratively UP on both DUTs to physical link state became
UP.

This fix is supposed to check the link state after all DUTs are
initialized.

Change-Id: I430b4285967f6168e6c74e0089a3e0d037b251d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit e40cf5b489e36323d401b864c5b2e610de037e20)

6 years agoCSIT-618 CSIT rls1707 Report - Update II 07/7607/1
Peter Mikus [Mon, 17 Jul 2017 12:14:23 +0000 (14:14 +0200)]
CSIT-618 CSIT rls1707 Report - Update II

Change-Id: I50a210930c0571ca910ead1724de7848c0911646
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 4457640600a2b875da17e97dba2dcab8a411eb95)

6 years agoCSIT-723: Source code auto-generation for 1707 05/7605/1
Tibor Frank [Mon, 17 Jul 2017 13:27:00 +0000 (15:27 +0200)]
CSIT-723: Source code auto-generation for 1707

Change-Id: Ia178ac180fd344db620757dcc2b9cbb5010276c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 997a1485635dd74aaf090ca5de608b6fdc25b74b)

6 years agoUpdate of VPP_STABLE_VER files 96/7596/2
Jan Gelety [Mon, 17 Jul 2017 13:12:31 +0000 (15:12 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.07-rc2~19-ged8a105~b36_amd64

- use new vpp ref build - centos7:
  17.07-rc2~19_ged8a105~b36.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-1707-ubuntu1604-semiweekly/3/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-1707-centos7-semiweekly/3/

Change-Id: I0a4892266b82af4826549eb93ff1f82b5bce9fa9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFix the TLDK test tcpdump not found issue. 94/7594/1
Fangyin Hu [Fri, 14 Jul 2017 11:27:20 +0000 (04:27 -0700)]
Fix the TLDK test tcpdump not found issue.
Add the PYBOT execute exit status code.

Change-Id: If0fc29c580177f1b187ec751c6708fc138838bed
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
(cherry picked from commit c76f8f80681c352b67fb714d65da25a5217c4ac8)

6 years agoFIX: remove previous QEMU build when needed to change qsz 93/7593/2
Jan Gelety [Thu, 13 Jul 2017 15:06:06 +0000 (17:06 +0200)]
FIX: remove previous QEMU build when needed to change qsz

Change-Id: I949f8800b45354c205c5a5d36ab2abeeb93409dc
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit b4157d62463fc54621fed74b223fcada4811efd1)

6 years agoAdd the NSH SFC functional test document. 92/7592/1
Fangyin Hu [Mon, 17 Jul 2017 08:18:02 +0000 (01:18 -0700)]
Add the NSH SFC functional test document.

Change-Id: I8e99d2311a530390349dddca522d6f3c8c35ab00
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
(cherry picked from commit de33bd3f6669287361a5d7d8dc1a610764ca6683)

6 years agoCSIT-618 CSIT rls1707 Report - Update I 83/7583/1
Peter Mikus [Thu, 13 Jul 2017 12:42:38 +0000 (14:42 +0200)]
CSIT-618 CSIT rls1707 Report - Update I

Change-Id: I7c3af55db6cc89f03004db6ddf6fcf67965132a7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d9a08e59581aafe44d446b5bc1ce6ff86b2b173b)

6 years agoFix: Memif IMIX frame size test case 80/7580/1
Peter Mikus [Fri, 14 Jul 2017 05:14:25 +0000 (05:14 +0000)]
Fix: Memif IMIX frame size test case

Fix the variable for calculating the IMIX_v4_1 in traffic
profile.

Change-Id: Ia5e643c0ec2c9cd67d4506b081a919f836ac1b26
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit d6226b0df6d07f886184a5d35ff647dbdfe5d4ce)

6 years agoAdd IRQ/RCU/Writeback pinning to ansible 76/7576/1
Peter Mikus [Tue, 11 Jul 2017 12:44:13 +0000 (14:44 +0200)]
Add IRQ/RCU/Writeback pinning to ansible

Change-Id: I650d9cb1ee44b6fa7cee79a86dad2b515256b239
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit c288339208b92eaed60f5c01866d6dec3675314a)

6 years agoUpdate of VPP_STABLE_VER files 56/7556/1
Jan Gelety [Thu, 13 Jul 2017 06:43:09 +0000 (08:43 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.07-rc2~10-gcdb8514~b27_amd64

- use new vpp ref build - centos7:
  17.07-rc2~10_gcdb8514~b27.x86_64

Change-Id: If79842dd3f0ed6639fa801d1bc60e60ce0d89e0c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFIX: use correct test suite name in weeklu bootstrap (typo fix) 35/7535/1
Jan Gelety [Wed, 12 Jul 2017 14:12:03 +0000 (16:12 +0200)]
FIX: use correct test suite name in weeklu bootstrap (typo fix)

Change-Id: Ic063e8688ee180f28ccf03831168aa38eee03d7e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 24ba1e81f527cf14cbb56bc73661e62353d4f4d9)

6 years agoCSIT-688 Create test cases for memif 33/7533/1
Peter Mikus [Tue, 4 Jul 2017 04:50:36 +0000 (04:50 +0000)]
CSIT-688 Create test cases for memif

Change-Id: Ia95850af4883474a0929df8e5269b59b3de95087
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit b1a3ce7a60ab930f4ee26a341ff4986ed5b28346)

6 years agoFix the TLDK test scripts execute path issue. 32/7532/1
Fangyin Hu [Fri, 7 Jul 2017 03:58:40 +0000 (20:58 -0700)]
Fix the TLDK test scripts execute path issue.

Change-Id: I7d0c20443db841516942479a067561c822a03bbd
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
(cherry picked from commit 71c7b4a491fece7940c6e8b2c1e5b7d57390f7c8)

6 years agoSet correct vpp repos and versions for rls1707 71/7471/1
Jan Gelety [Thu, 6 Jul 2017 19:01:34 +0000 (21:01 +0200)]
Set correct vpp repos and versions for rls1707

Change-Id: I236fce4e0bb13ccb3f0ae1be2b90087ecea6b039
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years ago Patch to tldk bootstrap on the tldk package download. 40/7240/4
Fangyin Hu [Wed, 21 Jun 2017 02:08:17 +0000 (22:08 -0400)]
Patch to tldk bootstrap on the tldk package download.
    Rebase and fix the path issue.

Change-Id: I572e4c81feb54e7f391af0007af709cafa42c255
Signed-off-by: qun wan <qun.wan@intel.com>
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
6 years agoHC Test: Update script path on bootstrap-hc2vpp-perf.sh 36/7436/2
selias [Thu, 6 Jul 2017 09:52:05 +0000 (11:52 +0200)]
HC Test: Update script path on bootstrap-hc2vpp-perf.sh

Change-Id: I5ed178448e99465b39267577ae77d79fc8f3f2c2
Signed-off-by: selias <samelias@cisco.com>
6 years agoHC Test: increase timeout value for ODL setup 37/7437/3
selias [Thu, 6 Jul 2017 10:00:09 +0000 (12:00 +0200)]
HC Test: increase timeout value for ODL setup

Change-Id: I9be9ef6bb6751fbaa61115d2052433e14b4b14fb
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-622: Stateful Security Groups perf tests 21/6121/40
Jan Gelety [Wed, 5 Apr 2017 06:54:11 +0000 (08:54 +0200)]
CSIT-622: Stateful Security Groups perf tests

1. add L2BD iACL statefull and stateless tests with 1, 10 and 50 not-hitting
   ACEs in combination with 100, 10k and 100k flows per direction

2. add L2BD oACL statefull and stateless tests with 1, 10 and 50 not-hitting
   ACEs in combination with 100, 10k and 100k flows per direction

Change-Id: Ia38589aa81b50c5ccdf2813ad6fadd22b46fffeb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-660: add vring1024 tuned CFS for vpp workers and guest-testpmd 93/7293/12
Jan Gelety [Fri, 23 Jun 2017 11:12:25 +0000 (13:12 +0200)]
CSIT-660: add vring1024 tuned CFS for vpp workers and guest-testpmd

- add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 1024 and
  tuned CFS setting

Change-Id: Ief8b4b86cdecfa39bf8cf0ec90fb844edfc6f396
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoCSIT-661: re-add vring256 tuned CFS for vpp workers and guest-testpmd 30/7030/28
Jan Gelety [Tue, 6 Jun 2017 15:47:28 +0000 (17:47 +0200)]
CSIT-661: re-add vring256 tuned CFS for vpp workers and guest-testpmd

1. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and
   tuned CFS setting
2. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and
   default CFS setting

Change-Id: I25aae6839d3e621316d35f5c9525389a6faabd56
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFix: DPDK paths after code refactor 21/7421/2
Peter Mikus [Wed, 5 Jul 2017 12:44:53 +0000 (14:44 +0200)]
Fix: DPDK paths after code refactor

Change-Id: I0cc83c48e0c91cdff13f78c65c521f45e551d7a3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years ago Change the bootstrap script file and test the CI-management. 21/7321/7
Fangyin Hu [Tue, 27 Jun 2017 03:34:56 +0000 (20:34 -0700)]
Change the bootstrap script file and test the CI-management.
Debug the NSH SFC functional test.
Change the test cases and not use the tcpdump.
Delete the unused code.
Change the directory structure.

Change-Id: I52486b9ba4b02e305f702ffc8cdb84e941cb18ff
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
6 years agoFix: Run-report script 14/7414/2
Peter Mikus [Tue, 4 Jul 2017 14:37:13 +0000 (14:37 +0000)]
Fix: Run-report script

Change-Id: I98afcbca606caeaf49172c968174c4868579cf6a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-702 Update static content after optimizations 02/7402/4
Peter Mikus [Mon, 3 Jul 2017 18:19:11 +0000 (20:19 +0200)]
CSIT-702 Update static content after optimizations

Update the mechanics of script for generating report to reflect the latest changes. Update some static content.

Change-Id: If60f7b74245138cc3044a49c46ff06d5850732de
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-651 Add keywords and template for memif 13/7013/33
Peter Mikus [Tue, 6 Jun 2017 05:15:29 +0000 (07:15 +0200)]
CSIT-651 Add keywords and template for memif

Add keywords and template for memif

Change-Id: I8bd5cfe345260750a74930c8ef55690be5f2dd5e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoXL710 Configure rxd/txd 2048 35/7335/7
Peter Mikus [Wed, 28 Jun 2017 20:14:51 +0000 (22:14 +0200)]
XL710 Configure rxd/txd 2048

Configure RX-desc and TX-desc to 2048 for FVL XL710 cards.

Change-Id: I1876f332bdc6100bf24f2b2317de33c0d1a4c9bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoRemove DPDK package download from vpp-csit* jobs 33/7333/4
Peter Mikus [Wed, 28 Jun 2017 17:47:05 +0000 (17:47 +0000)]
Remove DPDK package download from vpp-csit* jobs

Remove downloading if DPDK package from Nexus if
the job is vpp-csit*.

Change-Id: I37aada67c4334433618e122676fd1f50591b6742
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoFIX: TLDK bootstrap to reflect latest changes on VIRL 98/7398/2
Peter Mikus [Mon, 3 Jul 2017 17:11:53 +0000 (17:11 +0000)]
FIX: TLDK bootstrap to reflect latest changes on VIRL

Change-Id: I73017e17543bda145c470cdc474bce4eda547742
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoRemove vrf lib 69/7369/1
Tibor Frank [Fri, 30 Jun 2017 12:24:53 +0000 (14:24 +0200)]
Remove vrf lib

Change-Id: I38b8ddc7255602d71bec72dae704e69e8a3337f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-619 HC Test: Honeycomb performance testing - initial commit 85/6885/65
selias [Fri, 26 May 2017 12:51:50 +0000 (14:51 +0200)]
CSIT-619 HC Test: Honeycomb performance testing - initial commit

 - keywords and scripts for HC performance testing setup
 - basic performance suite: operational data read
 - traffic script and keywords used in tests

Change-Id: Ic0290be73a7c925ea2561f8cd2524c5cb83fcda2
Signed-off-by: selias <samelias@cisco.com>
6 years agoHC Test: bugfix for SLAAC and ODL tests 44/7344/4
selias [Thu, 29 Jun 2017 11:17:40 +0000 (13:17 +0200)]
HC Test: bugfix for SLAAC and ODL tests

Change-Id: I0a09482e8dc9ef2f9e6cd54a26c8d8492409f68c
Signed-off-by: selias <samelias@cisco.com>
6 years agovpp-verify-perf-vhost runs pdrdisc tests 59/7359/1
Tibor Frank [Fri, 30 Jun 2017 07:31:04 +0000 (09:31 +0200)]
vpp-verify-perf-vhost runs pdrdisc tests

 - Temporary solution: run pdrdisc tests instead of pdrchk for
   vpp-verify-perf-vhost trigger

Change-Id: I0a18397964db8bd2e0c5614eaee44c1208ba0abc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-687: Directory structure reorganization 21/7221/12
Tibor Frank [Tue, 20 Jun 2017 11:57:08 +0000 (13:57 +0200)]
CSIT-687: Directory structure reorganization

Change-Id: I772c9e214be2461adf58124998d272e7d795220f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
6 years agoCSIT-604: Bootstrap file for vpp-csit-verify-master-centos7-nightly 54/7054/7
Jan Gelety [Thu, 8 Jun 2017 12:30:06 +0000 (14:30 +0200)]
CSIT-604: Bootstrap file for vpp-csit-verify-master-centos7-nightly

- bootstrap file for new vpp nightly job to verify the latest available vpp
  packages from Nexus against csit functional tests

Change-Id: I376ca951925e59ff81ffcd6406447d4187c31670
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoHC Test: improve functional suite setup and teardown 57/7257/17
selias [Wed, 21 Jun 2017 16:52:10 +0000 (18:52 +0200)]
HC Test: improve functional suite setup and teardown

Restart the whole stack (VPP+Honeycomb+-ODL) in between test suites.
Add generic suite setup and suite teardown keywords for all func suites
Re-enable NSH_SFC suite, cleanup test failures

Change-Id: I71025b4ed3a7c4912dcd7b62aedef6082357990c
Signed-off-by: selias <samelias@cisco.com>
6 years agoCSIT-683: Re-organize L2 libraries - func 72/7172/9
Tibor Frank [Fri, 16 Jun 2017 07:38:28 +0000 (09:38 +0200)]
CSIT-683: Re-organize L2 libraries - func

Change-Id: I5444dfba68ea41d8190d6615e23505f3c08c377c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoUpdate of VPP_STABLE_VER files 12/7312/1
Jan Gelety [Mon, 26 Jun 2017 09:57:38 +0000 (11:57 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  17.10-rc0~2-g9f5a2b6~b2535_amd64

- use new vpp ref build - centos7:
  17.10-rc0~2_g9f5a2b6~b2532.x86_64

- builds tested by semiweekly jobs:
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/49/
  https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/49/

Change-Id: I9c725914632c1e64e730621f62f584059e24b04b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 years agoFix T-rex profile base class bug 07/7307/2
Peter Mikus [Sun, 25 Jun 2017 11:24:38 +0000 (11:24 +0000)]
Fix T-rex profile base class bug

- fixes the issue with COP whitelist and many others

Change-Id: I43962cdee19b42c316cec689336c341d30a56adf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years agoCSIT-689: Update PDR values in PDRCHK tests 54/7254/5
Tibor Frank [Wed, 21 Jun 2017 13:03:07 +0000 (15:03 +0200)]
CSIT-689: Update PDR values in PDRCHK tests

Change-Id: I703952667a2f930de56baa2e755d70889fdea3a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-614: Create PDRCHK tests 46/7246/6
Tibor Frank [Wed, 21 Jun 2017 11:54:23 +0000 (13:54 +0200)]
CSIT-614: Create PDRCHK tests

 - CSIT-630: 10Ge2P1X520-Ethip4-Ip4Scale2M-pdrchk
 - CSIT-638: 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-pdrchk

Change-Id: I314d87acbd5906946acad97224f71c39a8cf1e04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoCSIT-614: Create PDRCHK tests 38/7238/10
Tibor Frank [Wed, 21 Jun 2017 07:55:10 +0000 (09:55 +0200)]
CSIT-614: Create PDRCHK tests

 - CSIT-639: 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhost-1vm-pdrchk
 - CSIT-640: 10ge2p1x520-dot1q-l2xcbase-eth-2vhost-1vm-pdrchk
 - CSIT-641: 10ge2p1x520-ethip4-ip4base-eth-2vhost-1vm-pdrchk
 - CSIT-642: 10ge2p1x520-eth-l2xcbase-eth-2vhost-1vm-pdrchk

Change-Id: Id676c69abe34e455ca298f7225fd065fc6cc8218
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 years agoUpdate of LXCUtil library 71/7271/5
Peter Mikus [Thu, 22 Jun 2017 11:24:22 +0000 (13:24 +0200)]
Update of LXCUtil library

Change-Id: I1a095e45960ca004413c4ecbfd410e41fb621c74
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 years ago Fix the tcpdump start issue. 68/7268/3
Fangyin Hu [Thu, 22 Jun 2017 09:32:56 +0000 (02:32 -0700)]
Fix the tcpdump start issue.

Change-Id: I529899bdc031e8d5e367bad5a829857c2c83a3ba
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>