csit.git
23 months agoFail bootstrap immediately if no topology found 69/13669/1
Vratko Polak [Wed, 25 Jul 2018 10:32:40 +0000 (12:32 +0200)]
Fail bootstrap immediately if no topology found

Zero topologies might be found
if testbeds of some type are all unavailable,
or when purposedly restricted Change
is verified with a wrong trigger incantation.

The previous behavior enters an infinite cycle instead.

Change-Id: I9764a79ed4df57c6c99746438431bf1162b7f7ea
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1097: Migrate L2 to NDRPDR and edit MRR 90/13590/13
Vratko Polak [Fri, 20 Jul 2018 17:06:49 +0000 (19:06 +0200)]
CSIT-1097: Migrate L2 to NDRPDR and edit MRR

Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1202: Unify min_rate 45/13645/1
Vratko Polak [Tue, 24 Jul 2018 12:15:15 +0000 (14:15 +0200)]
CSIT-1202: Unify min_rate

20000 is the bi-directional value,
suites should use 10000.

Change-Id: I61d6e83f4f6b8f1f9b3dc9457896997f686a2b66
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1097: Unify max NIC bandwidth in ip4 41/13641/4
Peter Mikus [Tue, 24 Jul 2018 08:55:53 +0000 (08:55 +0000)]
CSIT-1097: Unify max NIC bandwidth in ip4

Also, minor fix in ip6.

Change-Id: I3a23e49d2162e34a1d2a8671ae9f7e74b832315c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoWORKAROUND: Remove broken SKX-TB out of pool 38/13638/2
Peter Mikus [Tue, 24 Jul 2018 08:55:53 +0000 (08:55 +0000)]
WORKAROUND: Remove broken SKX-TB out of pool

Currently T22 and T23 are faulty
Tracked in [FD.io Helpdesk #58059]

Change-Id: Ib8d474400a7e109a87573e33ca73946208bbb5de
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoinitial CSIT-DMM test scripts 86/11286/76
sharath reddy [Thu, 22 Mar 2018 07:12:51 +0000 (12:42 +0530)]
initial CSIT-DMM test scripts

Change-Id: I77a965751010b85d21335932baa5345a095dc4f3
Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com>
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
23 months agoCSIT-1097: Migrate Vts suite to NDRPDR 31/13531/12
Vratko Polak [Fri, 20 Jul 2018 11:13:06 +0000 (13:13 +0200)]
CSIT-1097: Migrate Vts suite to NDRPDR

Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1097: Migrate ip4 to NDRPDR and edit MRR 62/13562/10
Vratko Polak [Thu, 19 Jul 2018 17:14:26 +0000 (19:14 +0200)]
CSIT-1097: Migrate ip4 to NDRPDR and edit MRR

Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoUpdate of VPP_STABLE_VER files 01/13601/2
Jan Gelety [Mon, 23 Jul 2018 07:04:42 +0000 (09:04 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.10-rc0~50-g2a03efe~b4710

- use new vpp ref build - centos7:
  18.10-rc0~50_g2a03efe~b4619

Change-Id: I1effbb587c6d1bf2566501f70b8342b1b5260e8a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
23 months agoCSIT-1097: Edit dpdk suites for new rate and jumbo 48/13548/9
Vratko Polak [Thu, 19 Jul 2018 10:38:53 +0000 (12:38 +0200)]
CSIT-1097: Edit dpdk suites for new rate and jumbo

Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1097: Migrate vm_vhost to NDRPDR and edit MRR 37/13537/6
Vratko Polak [Wed, 18 Jul 2018 17:09:24 +0000 (19:09 +0200)]
CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRR

Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoHC Tests: remove vpp-dpdk-dkms dependency 04/13604/2
Marek Gradzki [Mon, 23 Jul 2018 07:04:20 +0000 (09:04 +0200)]
HC Tests: remove vpp-dpdk-dkms dependency

The vpp-dpdk-dkms is not needed for current VPP versions.

Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
23 months agoHC Tests: disable NSH plugin 91/13591/3
Marek Gradzki [Fri, 20 Jul 2018 06:10:24 +0000 (08:10 +0200)]
HC Tests: disable NSH plugin

Change-Id: Ic382b625e5e7201ecc2a2937c15646806c594c61
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
23 months agoCSIT-1204: Make new TC names backward compatible (trending) 05/13605/5
Tibor Frank [Mon, 23 Jul 2018 07:12:34 +0000 (09:12 +0200)]
CSIT-1204: Make new TC names backward compatible (trending)

Change-Id: I48976a21ed022f0f8d840903db4d2415be9365cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoCSIT-1097: Migrate ip4_tun to NDRPDR and edit MRR 33/13533/3
Vratko Polak [Wed, 18 Jul 2018 12:16:31 +0000 (14:16 +0200)]
CSIT-1097: Migrate ip4_tun to NDRPDR and edit MRR

Change-Id: I20fe137cfbbcea1e337fe6295818ea105953d006
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1097: Migrate memif to NDRPDR and edit MRR 32/13532/2
Vratko Polak [Wed, 18 Jul 2018 11:54:27 +0000 (13:54 +0200)]
CSIT-1097: Migrate memif to NDRPDR and edit MRR

Change-Id: I22db20ec688f1a879e82549aa7aa68dafdc71b6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1196: Add hsw/skx and 2n/3n to the report structure 89/13489/53
Tibor Frank [Mon, 16 Jul 2018 13:32:57 +0000 (15:32 +0200)]
CSIT-1196: Add hsw/skx and 2n/3n to the report structure

Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoFIX: Increase timeout for VAT for longer API calls. 80/13480/6
Peter Mikus [Mon, 16 Jul 2018 12:19:06 +0000 (12:19 +0000)]
FIX: Increase timeout for VAT for longer API calls.

Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoDRAFT: FD.io CSIT high-level development plan in .txt format. 06/13206/7
Maciek Konstantynowicz [Mon, 25 Jun 2018 13:42:49 +0000 (14:42 +0100)]
DRAFT: FD.io CSIT high-level development plan in .txt format.
Provided for reviews and reference, not for tracking.
Jira continuous to be used for CSIT work tracking.

Change-Id: I0945f0ab910f85f41d16ae402368430ef8351ee3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
23 months agoCSIT-1097: Crypto NDRPDR and missing MRR suites 20/13520/2
Vratko Polak [Tue, 17 Jul 2018 16:46:18 +0000 (18:46 +0200)]
CSIT-1097: Crypto NDRPDR and missing MRR suites

Change-Id: If40f9283ee889f85e85fad74a490252e812bbe02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1097: Ip6 NDRPDR and edited MRR suites 13/13513/7
Vratko Polak [Tue, 17 Jul 2018 15:21:52 +0000 (17:21 +0200)]
CSIT-1097: Ip6 NDRPDR and edited MRR suites

Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1201 Create L2patch perf tests 05/13505/10
Peter Mikus [Tue, 17 Jul 2018 10:14:44 +0000 (10:14 +0000)]
CSIT-1201 Create L2patch perf tests

- XL710, XXV710, X710
- 2n, 3n
- all pkt.size groups
- ndrpdr, mrr

Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoCSIT-1186: Add MRR and NDRPDR ip6_tunnels tests 84/13484/8
Vratko Polak [Tue, 17 Jul 2018 12:24:32 +0000 (14:24 +0200)]
CSIT-1186: Add MRR and NDRPDR ip6_tunnels tests

Remove the corresponding NDRPDRdisc tests.

Change-Id: Ib46f53e97f703db19bcbcb82c3db0a7f5bb61dbf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1165 Create DPDK tests for 2-node topology 87/13487/7
Peter Mikus [Mon, 16 Jul 2018 13:23:22 +0000 (13:23 +0000)]
CSIT-1165 Create DPDK tests for 2-node topology

Create DPDK tests for 2-node topology
- x710, xxv710 only
- l3fwd, testpmd
- standard pkt.size group

Change-Id: I2fbf6c38a427775da9b289faaa8fe1b8c03d5527
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoCSIT-1186: Add srv6 NDRPDR suites 11/13411/35
Vratko Polak [Mon, 16 Jul 2018 10:33:10 +0000 (12:33 +0200)]
CSIT-1186: Add srv6 NDRPDR suites

Delete the corresponding ndrpdrdisc suites.

MRR suites are also edited,
to make them less different from NDRPDR suites.

Now, there is a script to re-generate testcases of selected suites.
For that, resources/libraries/python/autogen is created,
with Regenerator holding the most of script logic.

The script looks at files matching a glob expression,
reuses a "prolog", but overwites test cases with the default template
and hardcoded set of testcase arguments.

Also, handling of overhead size has been simplified,
using new keyword Get Max Rate And Jumbo And Handle Multi Seg.

Default value for search timeout is increased to 12 minutes
to make timeout failures less frequent.

Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 00/13500/2
Jan Gelety [Tue, 17 Jul 2018 07:19:50 +0000 (09:19 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~517-g635ec3b~b4653

- use new vpp ref build - centos7:
  18.07-rc0~517_g635ec3b~b4569

- use new dpdk version:
  18.05-vpp2

Change-Id: I5fe34ea3603de136f8fe28fb8313533349257801
Signed-off-by: Jan Gelety <jgelety@cisco.com>
23 months agoRefactor DPDK testcases to new structure 63/13463/10
Peter Mikus [Fri, 13 Jul 2018 11:44:29 +0000 (11:44 +0000)]
Refactor DPDK testcases to new structure

+ RXQ refactor

Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoCSIT-1094: Change menu style 26/13426/20
Tibor Frank [Wed, 11 Jul 2018 13:11:11 +0000 (15:11 +0200)]
CSIT-1094: Change menu style

Change-Id: Idff59bc73d3444700937fc473681760a947f0f41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoCSIT-1190: Update report configuration for 18.07 41/13441/2
Tibor Frank [Thu, 12 Jul 2018 06:29:33 +0000 (08:29 +0200)]
CSIT-1190: Update report configuration for 18.07

Change-Id: Ie7644fe3069ad37c15754a07e049f479903ca59a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoAdd L2xc/L2bd/Ip4/Ip6 2-node tests for x710 81/13281/46
Peter Mikus [Thu, 28 Jun 2018 12:26:46 +0000 (12:26 +0000)]
Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710

- CSIT-1161 Add 2-node L2XC tests
- CSIT-1160 Add 2-node L2BD tests
- CSIT-1157 Add 2-node IP4 tests
- CSIT-1153 Add 2-node IP6 KW
- CSIT-1158 Add 2-node IP6 tests

Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoFIX: VTS suite 75/13475/1
Peter Mikus [Mon, 16 Jul 2018 04:51:45 +0000 (04:51 +0000)]
FIX: VTS suite

Change-Id: I1766ac51ac34b63feab80329c1ae2c62fc6d8496
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoRefactor perf test cases 01/13401/18
Peter Mikus [Tue, 10 Jul 2018 06:10:41 +0000 (06:10 +0000)]
Refactor perf test cases

- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations.
- Simplify the structure of suite to avoid large refactors in future.

Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoAdd stats segment heapsize to default config 47/13447/3
Peter Mikus [Thu, 12 Jul 2018 12:50:16 +0000 (12:50 +0000)]
Add stats segment heapsize to default config

- Scale tests (ip4, ip6) are failing due to low amount of stats segment
heapsize.

Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoUpdate skylake tesbed inventory 61/13461/1
Peter Mikus [Fri, 13 Jul 2018 07:33:16 +0000 (07:33 +0000)]
Update skylake tesbed  inventory

- Add missing topology files
- Add missing topologies to bootstrap
- Small fixes in ansible

Change-Id: I3b9ad60a0adfae9e93e5e700279f7ade81174471
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoCSIT-1168 Create bootstrap for 2-node topology 83/13383/7
Peter Mikus [Mon, 9 Jul 2018 08:16:05 +0000 (08:16 +0000)]
CSIT-1168 Create bootstrap for 2-node topology

Update existing bootstrap to recognize 2node/3node topologies

Change-Id: I2f81f9d69d824f7eea608413eac35a1598fad8c6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoFIX: PAL: input data processing 29/13429/2
Tibor Frank [Wed, 11 Jul 2018 14:48:49 +0000 (16:48 +0200)]
FIX: PAL: input data processing

Change-Id: I295ca0a991dea8104e9794d7013be908f5461ea2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoUpdate Ligato to latest dev branch 69/13069/17
Peter Mikus [Fri, 15 Jun 2018 08:22:27 +0000 (08:22 +0000)]
Update Ligato to latest dev branch

- Due to heavy modifications on vpp-agent docker images we need
to change build mechanics.

Change-Id: I26fb82ed1b2538335f7dc3dbb7f46ed2bb846583
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoCSIT-1186: Consume MLRsearch in agreed upon way 05/13405/4
Vratko Polak [Tue, 10 Jul 2018 12:07:02 +0000 (14:07 +0200)]
CSIT-1186: Consume MLRsearch in agreed upon way

+ Rename search to MLRsearch in resources/libraries/python/.
+ Make PyPI/MLRsearch/MLRsearch a symlink to the renamed directory.
+ TrafficGenerator.py to import from the renamed directory/module.
- No change to MLRsearch code.
- Version stays at 0.1.1 to point to the latest released code.

Change-Id: I4a38b0b7f8f083fbb1a93b25522560144b4ef556
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1178: Prepare for bursty MRR 71/12771/59
Vratko Polak [Tue, 10 Jul 2018 11:41:58 +0000 (13:41 +0200)]
CSIT-1178: Prepare for bursty MRR

+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL).
+ API change: Traffic should pass with maximum rate
  first argument got a default value,
  thus it needs to be moved towards the end of argument list.
+ Consequently, the value for it has been deleted from suites.
+ Test message is now compatible only with BMRR parsing.
- Reporting of transmit rate is left as TODO.
+ Global test __init__ with new way of giving defaults to global variables.
+ The new keyword is put into robot_enhancements.robot resource.
+ Number of trials and trial duration are now configurable.
- Bootstrap scripts have no support for overriding the defaults yet.

Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1183: Process the new and the old TC names 03/13403/7
Tibor Frank [Tue, 10 Jul 2018 11:23:47 +0000 (13:23 +0200)]
CSIT-1183: Process the new and the old TC names

Change-Id: I7fcecd7e23494e8fb0e70e7af00408eed16733e4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoAdd .gitattributes to make endlines automatic 04/13404/2
Vratko Polak [Tue, 10 Jul 2018 11:28:47 +0000 (13:28 +0200)]
Add .gitattributes to make endlines automatic

Change-Id: I9d58a5b0623c1b9d218e805fa619b324765f97a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1189: Add suite setup to source code documentation 09/13409/1
Tibor Frank [Tue, 10 Jul 2018 12:31:43 +0000 (14:31 +0200)]
CSIT-1189: Add suite setup to source code documentation

Change-Id: I0cc435ecacaeb5f9e8fd5c67f495166a1abd2e91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoPAL: Treat the new and the old TC names 94/13394/2
Tibor Frank [Mon, 9 Jul 2018 14:00:28 +0000 (16:00 +0200)]
PAL: Treat the new and the old TC names

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: If5999de81b4e062d38ce44871f0c4d4fa794b55c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoRemove THIS tag and use unix endlines 91/13391/2
Vratko Polak [Mon, 9 Jul 2018 13:14:36 +0000 (15:14 +0200)]
Remove THIS tag and use unix endlines

The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr
but usually it is only to be used in draft testing.

Not sure about the way non-unix endlines crept in.
Is not git supposed to perform endline conversions on text files?
Or are .robot, .rst, .yaml and .vat not recognized as text?

Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
23 months agoCSIT-1142 2-node topology - keywords DPDK 86/13386/8
Peter Mikus [Mon, 9 Jul 2018 09:55:00 +0000 (09:55 +0000)]
CSIT-1142 2-node topology - keywords DPDK

Change-Id: Ia2676a7b846bd574aa86703fce6b0e3218f98776
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoFIX: use correct match_n_vectors value in IPx iACL TC03 93/13393/1
Jan Gelety [Mon, 9 Jul 2018 13:48:57 +0000 (15:48 +0200)]
FIX: use correct match_n_vectors value in IPx iACL TC03

Change-Id: I2e454a2410ffda2673745e6415666a0f96291491
Signed-off-by: Jan Gelety <jgelety@cisco.com>
23 months agoFIX: Implement changes required by Plot.ly 3.0.0 85/13385/6
Tibor Frank [Mon, 9 Jul 2018 09:51:13 +0000 (11:51 +0200)]
FIX: Implement changes required by Plot.ly 3.0.0

 - Scatter.xaxix.autotick
 - Scatter.yaxis.range[]

Change-Id: I171e0c4a796f713985b69fae23bfb768590274b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 months agoCSIT-1142 Change thread perf test TAGs 77/13377/9
Peter Mikus [Fri, 6 Jul 2018 19:06:41 +0000 (19:06 +0000)]
CSIT-1142 Change thread perf test TAGs

Due to automatization of SMT detection this change is suppose to
remove static thread/core tags in favor of dynamic one. Leaving the
static tags for number of physical cores to be able to select TCs.

Change-Id: I7f99f605821f363e45c333f46d1dea786693521b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoCSIT-1142 2-node topology - keywords 68/13368/14
Peter Mikus [Fri, 6 Jul 2018 06:39:51 +0000 (06:39 +0000)]
CSIT-1142 2-node topology - keywords

- Clean up of 2-node setup KWs

Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85
Signed-off-by: Peter Mikus <pmikus@cisco.com>
23 months agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 80/13380/1
Jan Gelety [Mon, 9 Jul 2018 06:34:41 +0000 (08:34 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~471-g65784c1~b4600

- use new vpp ref build - centos7:
  18.07-rc0~471_g65784c1~b4520

- use new dpdk version:
  18.05-vpp1

Change-Id: Ica5f07d07b2e4893fb2ba67573a2aec5d23e1b2d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoAdd Skylake optimization to ansible 67/13367/2
Peter Mikus [Fri, 6 Jul 2018 05:18:01 +0000 (05:18 +0000)]
Add Skylake optimization to ansible

- Add kernel params
- Add TurboBoost managing

Change-Id: I9d9561290f8f6780ff41f3a418a1f335d935d843
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoVTS VXLAN vhost-user with single DUT, TG sends VXLAN 70/11070/15
Peter Ginchev [Wed, 11 Apr 2018 07:27:45 +0000 (10:27 +0300)]
VTS VXLAN vhost-user with single DUT, TG sends VXLAN

Change-Id: I63539af2cdbdbd02a67068e48d0fdf2743da3b1e
Signed-off-by: Peter Ginchev <pginchev@cisco.com>
2 years agoCSIT-1046 Make uio driver configurable from topofiles 26/13326/3
Peter Mikus [Tue, 3 Jul 2018 05:01:46 +0000 (05:01 +0000)]
CSIT-1046 Make uio driver configurable from topofiles

Currently we are configuring uio_driver from global variable.
This may not be suitable for various topologies where we need
different driver per TB. This patch is suppose to put uio_driver
into topology files.

Change-Id: I56af0697e8b2359ccb126151217976408720c1ba
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 15/13315/2
Jan Gelety [Mon, 2 Jul 2018 07:56:58 +0000 (09:56 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~449_gef8ead5~b4498

- use new vpp ref build - centos7:
  18.07-rc0~449-gef8ead5~b4575

- use new dpdk version:
  18.02.2-vpp1

Change-Id: I6b708288dbad895fcfa454b8fda62446074b32a4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCompatibility fixes with Ubuntu 18.04 09/13309/4
Peter Mikus [Sun, 1 Jul 2018 06:13:54 +0000 (06:13 +0000)]
Compatibility fixes with Ubuntu 18.04

Currently we are using ip:port socket to for VPP to listen for incoming
connections. There is only one place in code this socket is used for
detection if VPP is responding after restart. This patch is supposed to
change ip:port to sock:file which is default preffered way in VPP. This
way we can start using vppctl. netcat on the other side with ip:port
remains hanged in console for infinite time not returning back.

There is also need to check whether uio_module is loaded and eventually
load it. As uio_pci_generic is not working there, we will fallback to
main igb_uio (uio_pci_generic being only lightweight subset of igb_uio).

This patch also add additional verbose output to console during setup to
better understand if failure happens during copy/extract/setup.

Change-Id: I0b8a3b76dce3316496a3ad928f58718b6e73057d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoHC Tests: use vpp-fib-management module in dhcp tests (HC2VPP-348) 06/13306/1
Marek Gradzki [Fri, 29 Jun 2018 19:26:22 +0000 (21:26 +0200)]
HC Tests: use vpp-fib-management module in dhcp tests (HC2VPP-348)

Addaps HC DHCP tests to https://gerrit.fd.io/r/#/c/13299/

Change-Id: I874da5ee76fcfdb5039c1b3ad33aec4af80396d0
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2 years agoAdd vfio-pci support on all TB 98/13298/2
Peter Mikus [Fri, 29 Jun 2018 12:16:06 +0000 (12:16 +0000)]
Add vfio-pci support on all TB

- Add auto load of vfio-pci
- Add iommu support

Change-Id: I13611fab9db2813eeab7f90c8f961594349e561e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoCSIT-1124: Support multi-sample tests 02/13202/44
Tibor Frank [Mon, 25 Jun 2018 10:48:43 +0000 (12:48 +0200)]
CSIT-1124: Support multi-sample tests

 + Store parsed MRR results as AvgStdevMetadata
 + Modify tables and plots to use AvgStdevMetadata

Change-Id: I29bb1e492a664544e63a180055f66bb0eecfb957
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoSetupFramework to detect failures, part II 66/13266/3
Peter Mikus [Thu, 28 Jun 2018 07:29:06 +0000 (07:29 +0000)]
SetupFramework to detect failures, part II

- This patch is enforcing evaluation and aligning all __init__.robot
files to use the same logic.

Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoJumpavg: Post 0.1.3 release edits 78/13278/1
Vratko Polak [Thu, 28 Jun 2018 12:14:38 +0000 (14:14 +0200)]
Jumpavg: Post 0.1.3 release edits

+ PyPI/jumpavg version bumped to 0.1.4.
+ presentation requirements bumped to 0.1.3.
+ Added stub for change log in readme.

Change-Id: I21a606ed7d9aa2b9cc761ed20f94bda41963a1a8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFix jumpavg: No negative variance from rounding 76/13276/2
Vratko Polak [Thu, 28 Jun 2018 11:07:14 +0000 (13:07 +0200)]
Fix jumpavg: No negative variance from rounding

The algorithm for computing stdev has been changed
to a more stable one, based on Welford's algorithm.

Change-Id: I51e02d9c5c26cda0d4e998381d5011aa793e6483
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoAdd New Skylake topology files 31/13231/8
Peter Mikus [Wed, 27 Jun 2018 05:35:25 +0000 (05:35 +0000)]
Add New Skylake topology files

Change-Id: I6109729ee303806f69bba365c93b4de67b9a8c32
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFIX: SetupFramework to detect failures 18/13218/7
Peter Mikus [Tue, 26 Jun 2018 08:45:06 +0000 (08:45 +0000)]
FIX: SetupFramework to detect failures

- Fix behavior of setup framework to properly detect and raise
exception in case of any issue occurs during framework setup on any node
- General code cleanup

Change-Id: Id4cf36e221817600164b25d5551582838b0f0d5e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoSmall update to PXE installation README 16/13216/1
Peter Mikus [Tue, 26 Jun 2018 05:16:49 +0000 (05:16 +0000)]
Small update to PXE installation README

Change-Id: I1766e3cd81cfe4ed049ed3e7034fff1e367396d4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoUpdate PXE info about new Skylake machines 04/13204/1
Peter Mikus [Mon, 25 Jun 2018 12:07:17 +0000 (12:07 +0000)]
Update PXE info about new Skylake machines

Change-Id: Ide828efb0e539ae7bf9c5cfd128f35d8117f3643
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoUpdate of VPP_STABLE_VER files 00/13200/2
Jan Gelety [Mon, 25 Jun 2018 07:42:19 +0000 (09:42 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~394-ge0d2bd6~b4508

- use new vpp ref build - centos7:
  18.07-rc0~394_ge0d2bd6~b4435

Change-Id: I3b1a749cf4192321af9ec1e9d297b938092d4135
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoFIX: use correct path to vpp build packages in weekly bootstrap 01/13201/2
Jan Gelety [Mon, 25 Jun 2018 08:04:31 +0000 (10:04 +0200)]
FIX: use correct path to vpp build packages in weekly bootstrap

Change-Id: I5a92499cc7f1e475614126fcb6044d48615673ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-1043: Execute pci rescan only if needed 61/12961/10
juraj.linkes [Fri, 8 Jun 2018 08:47:27 +0000 (10:47 +0200)]
CSIT-1043: Execute pci rescan only if needed

Pci rescan is a rather invasive process, which is why it should be
executed only if needed. This patch moves the pci rescan after
pci device driver discovery, rescanning the devices for further attemps
at driver discovery.

Change-Id: I29c939b44c3f67371416a99c711e057f711ba9b4
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2 years agoFix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-func 72/13172/2
Michal Cmarada [Thu, 21 Jun 2018 08:17:40 +0000 (10:17 +0200)]
Fix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-func

Add wait for interface to be up, because it
takes some time while the interface state changes.

Change-Id: I895dea1017ac0ffd099e80d9edca0f1d127657dd
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2 years agoHC2VPP-331: Fix Honeycomb fails to assign VRF to interface 20/13120/4
Michal Cmarada [Thu, 21 Jun 2018 07:53:08 +0000 (09:53 +0200)]
HC2VPP-331: Fix Honeycomb fails to assign VRF to interface

- add configuration for FIB table management to test suite
- fix routing test suite HC2VPP-331 bugs
- fix intip4-intip6 test suite HC2VPP-331 bugs

Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2 years agoCSIT-1136: Trending: Redirect "new" to the index.html 70/13170/1
Tibor Frank [Thu, 21 Jun 2018 07:59:54 +0000 (09:59 +0200)]
CSIT-1136: Trending: Redirect "new" to the index.html

 - remove the code which generated redirection

Change-Id: Ia12ea1129724d92a6ac6e88782e562c23722ae48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-1136: Trending: Redirect "new" to the index.html 65/13165/2
Tibor Frank [Thu, 21 Jun 2018 05:26:27 +0000 (07:26 +0200)]
CSIT-1136: Trending: Redirect "new" to the index.html

Change-Id: I2480a59fb34af70d78bc7404cd380c4b4d3ea483
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: PAL - list of failed tests 56/13156/1
Tibor Frank [Wed, 20 Jun 2018 13:21:47 +0000 (15:21 +0200)]
FIX: PAL - list of failed tests

Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-1110: Replace old trending with the new one 45/13145/1
Vratko Polak [Wed, 20 Jun 2018 10:56:41 +0000 (12:56 +0200)]
CSIT-1110: Replace old trending with the new one

+ Remove /new/ folders in presentation and docs.

Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoRevert "CSIT-986: Use MLRsearch from pip" 36/13136/2
Peter Mikus [Wed, 20 Jun 2018 06:09:32 +0000 (06:09 +0000)]
Revert "CSIT-986: Use MLRsearch from pip"

This reverts commit 0c2c57d9965ab1db0d5404ad103871ac250339cb.

Reason for revert: unless you will fix this broken patch we have to revert this as it breaks several thing in the csit core ci/cd.

1) all tb are pypi offline this means no new pypi is automatically dowloaded. Everytime you change your version you have to update every tb. As this is not automated this will never work and put extreme overhead

2) this code is not pylint checked and not verified by any existing job breaking any kind of verificition mechanics in csit

3)there is no automation in terms of creating pypi (no job) this creates chicken egg problem that you cannot verify change unless new version is installed

Next time please think or consult with more seniored csit core developer
Unless above will be fixed i will revert on monday as now it breaks all jobs. I will set hard verification to framework setup (exception) so this will prevent next time merge.
Possible solution:
1)Move the directory back to resources and reference from csit directly not via pypi, leave the setup crap in dir and let users to create package on their own

Change-Id: Id530a9f19f668e45f73ffc9e7371bb453b59fd1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 27/13127/3
Jan Gelety [Tue, 19 Jun 2018 14:30:14 +0000 (16:30 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~358-ga5ee900~b4457

- use new vpp ref build - centos7:
  18.07-rc0~358_ga5ee900~b4395

- use new dpdk version:
  18.02.1-vpp2

Change-Id: Idc72e3a01dbb1b479a4a9b6404c4b01d5a7c4627
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 years agoCSIT-1110: Improve new detection methodology doc 11/13011/9
Vratko Polak [Thu, 14 Jun 2018 12:03:44 +0000 (14:03 +0200)]
CSIT-1110: Improve new detection methodology doc

Change-Id: I068fd4e9418f232ee1e1f13994e9c5c431478ec8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoUse pkg download script in bootstrap files 28/11928/39
Peter Mikus [Thu, 19 Apr 2018 12:52:50 +0000 (14:52 +0200)]
Use pkg download script in bootstrap files

Download specific version of VPP/DKMS via download script.

Change-Id: I6585790224d746a9edea7fa6624e810f389218e6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoCSIT-1133: Cosmetic improvements in trending plots 17/13117/3
Tibor Frank [Tue, 19 Jun 2018 08:46:42 +0000 (10:46 +0200)]
CSIT-1133: Cosmetic improvements in trending plots

 - Remove "outlier" from the colorbar
 - Remove anomalies from the legend

Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-986: Use MLRsearch from pip 97/13097/2
Vratko Polak [Mon, 18 Jun 2018 14:00:06 +0000 (16:00 +0200)]
CSIT-986: Use MLRsearch from pip

+ Delete resources/libraries/python/search/.
+ Add MLRsearch==0.1.1 to requirements.txt.
+ Bump PyPI/MLRsearch version to 0.1.2.

Change-Id: I1f86d75ac8eb90ee3946dbac8c56280f39302f4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCSIT-1126: Detection and reporting of failed MRR tests 28/13028/20
Tibor Frank [Wed, 13 Jun 2018 13:19:18 +0000 (15:19 +0200)]
CSIT-1126: Detection and reporting of failed MRR tests

Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-986: Implement proposed MDR improvements 61/12761/10
Vratko Polak [Mon, 28 May 2018 09:53:45 +0000 (11:53 +0200)]
CSIT-986: Implement proposed MDR improvements

+ Use first intermediate with goal in initial phase.
+ Measure above MRR if that got zero loss.
+ Always prioritizes NDR in internal search.
+ Rename classes.
+ Copy code for standalone PyPI publishing.
- Original files will be deleted after publish.

Change-Id: I5169d602d1e5e35a1894645cd52e70d791871608
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCSIT-1110: Update code after jumpavg 0.1.2 release 91/13091/1
Tibor Frank [Mon, 18 Jun 2018 06:10:54 +0000 (08:10 +0200)]
CSIT-1110: Update code after jumpavg 0.1.2 release

+ Use the released version in PAL.
+ Bump the jumpavg source to 0.1.3 for next release.
+ Add PyPI/owners.txt to track python package owner group.

Change-Id: I29284a258b24f9991379719313f30cce0349c2bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate Ansible with new Skylake machines 86/13086/2
Peter Mikus [Fri, 15 Jun 2018 12:29:07 +0000 (12:29 +0000)]
Update Ansible with new Skylake machines

Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoCSIT-1085 eth-l2xcbase-eth-1memif-1dcr 14/12614/21
Peter Mikus [Thu, 17 May 2018 07:51:35 +0000 (09:51 +0200)]
CSIT-1085 eth-l2xcbase-eth-1memif-1dcr

Test case definitions

Change-Id: I03736ef003d3839859dc450745323362b21aa75e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoRevert "CSIT-1110: Update code after jumpavg 0.1.2 release" 84/13084/1
Tibor Frank [Fri, 15 Jun 2018 12:02:22 +0000 (12:02 +0000)]
Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"

This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8.

Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-1110: Update code after jumpavg 0.1.2 release 76/13076/1
Vratko Polak [Fri, 15 Jun 2018 11:19:57 +0000 (13:19 +0200)]
CSIT-1110: Update code after jumpavg 0.1.2 release

+ Use the released version in PAL.
+ Bump the jumpavg source to 0.1.3 for next release.
+ Add PyPI/owners.txt to track python package owner group.

Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCSIT-1110: Use jumpavg library from pip 38/13038/5
Vratko Polak [Thu, 14 Jun 2018 12:04:03 +0000 (14:04 +0200)]
CSIT-1110: Use jumpavg library from pip

+ Move the jumpavg library code to separate directory.
- Bump to 0.1.2 has to be done later.

Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCSIT-1110: Add files for PyPI migration 36/13036/3
Vratko Polak [Wed, 13 Jun 2018 15:18:05 +0000 (17:18 +0200)]
CSIT-1110: Add files for PyPI migration

Change-Id: I3414d4391f339ee67066491382b59239a81db241
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCSIT-1110: Prepare for migrating the new detection 35/13035/3
Vratko Polak [Wed, 13 Jun 2018 11:04:01 +0000 (13:04 +0200)]
CSIT-1110: Prepare for migrating the new detection

+ Do not declare BitCountingClassifier.classify() as class method.
+ Make BitCountingGroupList subclass of list.
+ Inherit from abstract classes whenever possible.
+ Drop unneeded imports.
+ Add module docstrings and class docstrings anywhere.
+ Add TODOs hinting at possible improvements.

Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCSIT-PERF: New trigger design 25/13025/12
Peter Mikus [Wed, 13 Jun 2018 12:09:47 +0000 (12:09 +0000)]
CSIT-PERF: New trigger design

- CSIT-1128
- This patch is implementing processing of TAGS specified
as part of commit message

Change-Id: Iad0923d22fae369dfe923a917e1c0d47d5cbf656
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFIX: TAG processing 33/13033/1
Peter Mikus [Wed, 13 Jun 2018 14:34:06 +0000 (14:34 +0000)]
FIX: TAG processing

Change-Id: I08815de519532e8a20873f8b172d3f42ccfa33fb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoFIX: TAG processing 26/13026/4
Peter Mikus [Wed, 13 Jun 2018 12:25:51 +0000 (12:25 +0000)]
FIX: TAG processing

- Improve TAG post processing

Change-Id: I5a36f5874ea747cbcae2562fc58c9f5abe9bac02
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoCSIT-942: RCA - Option 1: Analysing Archived VPP Results 00/11400/5
Tibor Frank [Tue, 27 Mar 2018 12:37:42 +0000 (14:37 +0200)]
CSIT-942: RCA - Option 1: Analysing Archived VPP Results

 - CSIT-953: LLD

Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCSIT-1110: Fix dashboard anomaly count range 19/13019/1
Vratko Polak [Wed, 13 Jun 2018 08:23:06 +0000 (10:23 +0200)]
CSIT-1110: Fix dashboard anomaly count range

+ Dashboard tables should now report anomalies from last week only.
+ Changed handling of Nan to report regression.

Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agolink for start-testcase-DMM 88/12988/3
sharath [Mon, 11 Jun 2018 12:21:49 +0000 (17:51 +0530)]
link for start-testcase-DMM

Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2 years agoCSIT-1110 PAL: Fix warnings by moving new docs 06/13006/1
Vratko Polak [Tue, 12 Jun 2018 12:55:42 +0000 (14:55 +0200)]
CSIT-1110 PAL: Fix warnings by moving new docs

Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoCSIT-1110 PAL: Use group averages for term changes 92/12992/2
Vratko Polak [Mon, 11 Jun 2018 16:45:20 +0000 (18:45 +0200)]
CSIT-1110 PAL: Use group averages for term changes

+ Apply only to trending dashboard tables.
+ Remove outlier column.
- Dashboard description not updated yet.

Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoMask out LBOND_DPDK tags from per patch verification 98/12998/1
Peter Mikus [Tue, 12 Jun 2018 08:54:08 +0000 (08:54 +0000)]
Mask out LBOND_DPDK tags from per patch verification

Change-Id: I47a5261e9a9b590a408bda093a9310dc38c85873
Signed-off-by: Peter Mikus <pmikus@cisco.com>
2 years agoCSIT-1110: Cherry-pick edits into new detection 86/12986/2
Vratko Polak [Mon, 11 Jun 2018 12:47:50 +0000 (14:47 +0200)]
CSIT-1110: Cherry-pick edits into new detection

+ Edit methodology documentation.

Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.