csit.git
4 years agoReport: Add RC1 data 24/24524/2
Tibor Frank [Mon, 27 Jan 2020 12:41:22 +0000 (13:41 +0100)]
Report: Add RC1 data

Change-Id: I7ab49f6a910b9273b78e89096e06761ff7537ec9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 22/24522/1
Jan Gelety [Sun, 19 Jan 2020 00:36:03 +0000 (01:36 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc0~29-ga273ce62d

 - use new vpp ref build - centos7:
   20.05-rc0~29_ga273ce6~b8737

Change-Id: I57f181961796d90ee4064b3f03d7f421d382cd27
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAttempt to fix journalctl 06/24506/2
Peter Mikus [Fri, 24 Jan 2020 12:08:52 +0000 (12:08 +0000)]
Attempt to fix journalctl

- AWK
- ECHO
- pipe
+ Much simpler

Change-Id: I4876f4eae68c96571dc38fd21e53ba269f5f888e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: VTS tests 92/24492/2
Jan Gelety [Sat, 18 Jan 2020 10:03:52 +0000 (11:03 +0100)]
FIX: VTS tests

Change-Id: I594d248c58dcdcdeceea57af2dd25e2b2e08247f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: nfv_density 49/24449/4
Jan Gelety [Fri, 17 Jan 2020 17:53:27 +0000 (18:53 +0100)]
FIX: nfv_density

- use correct osi_layer=L2 (so L2 spoofing check is switched off
  in case of avf driver)
- add pci address information to eth interface in topology file
- nfv_density chain_ipsec tests work only with DPDK
  in current implementation

Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: Various issues 74/24474/7
Peter Mikus [Wed, 22 Jan 2020 13:11:14 +0000 (13:11 +0000)]
FIX: Various issues

- TrafficProfile
- IPsec jumbo
- TDLK leftover
- Trex scapy server

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0601ea75ed6e7318c46124fb02e9c61066089791

4 years agoReport: Add diagrams for testbeds 76/24476/3
Tibor Frank [Wed, 22 Jan 2020 14:27:29 +0000 (15:27 +0100)]
Report: Add diagrams for testbeds

- Diagrams for testbeds:
  - 3n-dnv
  - 3n-tsh
  - 2n-clx
- Replace s/Cascadelake/Cascade Lake

Change-Id: I77e7659a0aba4766a28577f940b7e44e60cbd82d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoGenerate tests in deterministic order 44/24444/5
Vratko Polak [Tue, 21 Jan 2020 11:47:46 +0000 (12:47 +0100)]
Generate tests in deterministic order

Change-Id: I47e45f395976fd65a8da0e93bc33588cc213c79e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agofix loadbalancer running error(Caused by code upgrades) 61/24461/2
haiyanx1.zhang [Tue, 21 Jan 2020 10:08:08 +0000 (10:08 +0000)]
fix loadbalancer running error(Caused by code upgrades)

Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
Change-Id: I39bd1d9ad59971bb8cba6e664ba5509abba6a527

4 years agoPAL: Process HDRH Latency 47/24447/2
Tibor Frank [Tue, 21 Jan 2020 13:04:01 +0000 (14:04 +0100)]
PAL: Process HDRH Latency

Change-Id: Ifc48869ccb6c05f4b5af6cd97e05f009c7632dc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoNdrpdr: Add latency trials for smaller loads 27/24427/8
Vratko Polak [Tue, 21 Jan 2020 11:02:46 +0000 (12:02 +0100)]
Ndrpdr: Add latency trials for smaller loads

Change-Id: I46bd4b58bdd02a3deed38c158214e1e9977dde05
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 25/24425/2
Jan Gelety [Fri, 17 Jan 2020 00:59:29 +0000 (01:59 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc0~14-gdb43bb6af

 - use new vpp ref build - centos7:
   20.05-rc0~14_gdb43bb6~b8721

Change-Id: I482f40023f6708908e510fa5eede391f62f68c95
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoreduce test cases for 2n-dnv and 3n-dnv mrr daily test 16/24416/2
Yulong Pei [Sun, 19 Jan 2020 12:58:07 +0000 (20:58 +0800)]
reduce test cases for 2n-dnv and 3n-dnv mrr daily test

since dnv platform is to use by low end market product, no need care
more about too much flows performance test.

Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoFIX: Hugepages should be detected also from overcommit 83/24083/11
Peter Mikus [Thu, 19 Dec 2019 19:20:20 +0000 (19:20 +0000)]
FIX: Hugepages should be detected also from overcommit

Change-Id: I36ec9d61f775791ad0632a579c4921889d1f5acf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agorevert "Report: Remove 'avf' from TC name in plots" 20/24420/1
Tibor Frank [Mon, 20 Jan 2020 07:17:02 +0000 (08:17 +0100)]
revert "Report: Remove 'avf' from TC name in plots"

Change-Id: I9b10b8f2f84daad543ac9b84671753785dfb23ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoperf: add TCP Iperf3+LDPRELOAD test suite 52/24252/20
Dave Wallace [Wed, 8 Jan 2020 20:51:43 +0000 (20:51 +0000)]
perf: add TCP Iperf3+LDPRELOAD test suite

Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoFix unreservation 08/24408/1
Vratko Polak [Fri, 17 Jan 2020 13:20:49 +0000 (14:20 +0100)]
Fix unreservation

It got broken by the previous reservation fix.

Change-Id: I5d9091b7fa4fcc37148c0223fe8eb83f7e5b6770
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Remove 'avf' from TC name in plots 03/24403/1
Tibor Frank [Fri, 17 Jan 2020 12:35:31 +0000 (13:35 +0100)]
Report: Remove 'avf' from TC name in plots

Change-Id: Ie1d04347de123032a5d424747d216f90022bc813
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily job 00/24400/1
Jan Gelety [Thu, 16 Jan 2020 22:39:05 +0000 (23:39 +0100)]
FIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily job

- not enough cpu cores reported

Change-Id: If3ddbbf4f5af741f328c45ac6b8c874e61d348ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: missing write of mac_dst for direction 0 --> 1 in cnf trex profiles 97/24397/2
Jan Gelety [Thu, 16 Jan 2020 22:22:41 +0000 (23:22 +0100)]
FIX: missing write of mac_dst for direction 0 --> 1 in cnf trex profiles

Change-Id: I3acf5220c24f77bc4bfc451919bf9b5345a988ef
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFix reservation if connect fails 93/24393/1
Vratko Polak [Fri, 17 Jan 2020 11:26:47 +0000 (12:26 +0100)]
Fix reservation if connect fails

Change-Id: I136cc51cbd5a01451e04a39c5d8e5554d6d39305
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Prepare data sets 86/24386/2
Tibor Frank [Fri, 17 Jan 2020 09:18:57 +0000 (10:18 +0100)]
Report: Prepare data sets

Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: L2XC with vhost and VLAN 82/24382/1
Jan Gelety [Thu, 16 Jan 2020 18:49:06 +0000 (19:49 +0100)]
FIX: L2XC with vhost and VLAN

Change-Id: Ia87abadba431099eeacd8b50ce5d116597a1f393
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPython3: Migration of files under traffic-profiles/trex 27/24327/6
Balaji Venkatraman [Tue, 14 Jan 2020 14:57:10 +0000 (06:57 -0800)]
Python3: Migration of files under traffic-profiles/trex

Change-Id: Iae16225d3d3daa4e1e9b177228fb89efe4aa5405
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
4 years agoReport: Latency by Percentile Distribution 70/24370/1
Tibor Frank [Thu, 16 Jan 2020 12:31:08 +0000 (13:31 +0100)]
Report: Latency by Percentile Distribution

- legend

Change-Id: I35477ce5c2cabfdcef68424854a8574bd3655e55
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Latency by Percentile Distribution 67/24367/1
Tibor Frank [Thu, 16 Jan 2020 09:53:35 +0000 (10:53 +0100)]
Report: Latency by Percentile Distribution

- Set X-axis

Change-Id: Ica300c7b1352c824bf51ac26e7485c9295ac60dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add placeholders for new TBs 83/24283/3
Tibor Frank [Fri, 10 Jan 2020 12:41:09 +0000 (13:41 +0100)]
Report: Add placeholders for new TBs

Change-Id: I92cb693343c4f96503b45a15211e0dadd6fcde5f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoRemove leftovers from previous removals 02/23602/13
Vratko Polak [Thu, 5 Dec 2019 14:37:27 +0000 (15:37 +0100)]
Remove leftovers from previous removals

- Except KubernetesUtils and its bash dependencies.
  It is a dead code currently, but we hope new tests will resurrect it.
+ Mention device tests instead of functional in Readme.

Change-Id: I6bdbea13ea9f995a06a0fb7cb5e98ae4fce29581
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Latency by Percentile Distribution 52/24352/1
Tibor Frank [Wed, 15 Jan 2020 14:48:48 +0000 (15:48 +0100)]
Report: Latency by Percentile Distribution

- Set the position of the Lagend

Change-Id: I1bcea6002bd8beeba3300c9976d1603a234c3c14
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add Latency by Percentile Distribution 44/24344/10
Tibor Frank [Wed, 15 Jan 2020 10:15:14 +0000 (11:15 +0100)]
Report: Add Latency by Percentile Distribution

Change-Id: I5291db8117da611497e910aa7cd2fbb2276bfe65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoDocs: Update report sections 49/24349/2
Peter Mikus [Wed, 15 Jan 2020 13:12:48 +0000 (13:12 +0000)]
Docs: Update report sections

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib6e9ac003c1d91673984c52baf2f3eec30c9d21d

4 years agoAnsible: Increase TG hugepages 46/24346/2
Peter Mikus [Wed, 15 Jan 2020 12:01:35 +0000 (12:01 +0000)]
Ansible: Increase TG hugepages

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa87e372ed45f6dfc883723acbb325e34fb814a8

4 years agoRemove everything related to TLDK 70/23570/16
Vratko Polak [Fri, 22 Nov 2019 13:14:15 +0000 (14:14 +0100)]
Remove everything related to TLDK

- Leftovers from kubernetes found, but not removed here.

Change-Id: If8cb9269d0f3e69f642d7fe02c59122e17925a4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoTrending: new daily set 35/24035/17
Jan Gelety [Fri, 13 Dec 2019 15:11:58 +0000 (16:11 +0100)]
Trending: new daily set

New daily sets are prepared based on information in
https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md
and previous test set definitions in
docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md
files.

- mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h
- mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h
- mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h
- mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h
- mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h
- mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h
- mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h

+ add some missing test suites
+ add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile
+ correction of TS and TC names and tags in directory
  tests/vpp/perf/nfv_density/chain_ipsec

Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoSupport suite tags in autogen 54/24054/10
Vratko Polak [Thu, 2 Jan 2020 14:30:09 +0000 (15:30 +0100)]
Support suite tags in autogen

+ Include a script to add suite tags to many suites at once.
+ Add suite tags also to device tests (not covered by autogen).

Change-Id: I514ee6178e22999b43460028fe2696738b012f04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAutogen: Generate also NIC drivers. 33/23033/34
Vratko Polak [Fri, 3 Jan 2020 15:01:30 +0000 (16:01 +0100)]
Autogen: Generate also NIC drivers.

+ Disallowed -avf- (or -rdma-) as "template" suites.
 + GBP suite switched to DPDK driver in repo.
+ Each NIC has its own list of supported drivers, in Constants.
+ Updated tag expressions for daily jobs:
 + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts
   are tested only with vfio-pci.
 + Other (base, dot1q, dot1ad) tested with all drivers.
+ Setup actions currently depend on driver, generated.
 - The performance_rdma action is trivial for now.
 - Several tests fail, to be fixed later, e.g. by performance_rdma.
+ Reconf tests are also supported.
+ Added DRV_VFIO_PCI tags missing, mainly in density tests.
 - Vhost suites (density, reconf) are failing, but suites look good.
- TCP suites do not support NIC drivers yet.
- DPDK obviously not supported.
+ Use Python 3 in regenerate scripts.
+ Fix typos binded => bound.
+ File open modes set either u"rt" or u"wt" everywhere.
+ Remove a trailing space in an environment variable name.

Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Current vs. Previous Release - NFV Tests 21/24321/4
Tibor Frank [Tue, 14 Jan 2020 12:47:18 +0000 (13:47 +0100)]
Report: Current vs. Previous Release - NFV Tests

Change-Id: I00cbde38b8f900efe3e3123a942de2288381ea3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoHoststack perf infrastructure refactoring 03/24103/26
Dave Wallace [Fri, 20 Dec 2019 22:46:51 +0000 (22:46 +0000)]
Hoststack perf infrastructure refactoring

- DUT only topology (hoststack test
  apps are co-located with vpp)
- Make vpp app specific keywords generic
  where applicable
- Add IP4 Prefix to topology file
- Support running wrk in linux namespace
- Refactor namespace cleanup
- Remove redundant namespace creation code
- Refactor test/keyword dirs: tcp -> hoststack
- Add hoststack utility keywords
- Refactor wrk suite setup/teardown
- Update tests with recent perf infra changes

Change-Id: Ia1cf07978d579393eef94923819a87c8c1f36f34
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoFIX: VXLAN scale 28/24328/2
Peter Mikus [Tue, 14 Jan 2020 15:05:22 +0000 (15:05 +0000)]
FIX: VXLAN scale

+ Another stupid arp -> neighbor rename

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia873d6c2a485659033f71cdf546782db74787d13

4 years agoFIX: NF_density tests 15/24315/2
Peter Mikus [Tue, 14 Jan 2020 07:51:12 +0000 (07:51 +0000)]
FIX: NF_density tests

+ ARP -> Neighbor

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I74044bd7db6cb4b1bd3648a424e9c8f1473be8d1

4 years agoUpdate comments in crc file. 00/24300/3
Vratko Polak [Mon, 13 Jan 2020 13:55:27 +0000 (14:55 +0100)]
Update comments in crc file.

+ L2patch is already covered.
+ RDMA is not device testable yet.

Change-Id: I1dcccfcb340a8fe61c20d3516340e26db293cfaa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add VNF Service Chains Tunnels 08/24308/2
Tibor Frank [Mon, 13 Jan 2020 14:20:12 +0000 (15:20 +0100)]
Report: Add VNF Service Chains Tunnels

Change-Id: Iafdcb543f6adc583567a05aa5a882dce17b58f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: NF_density tests 02/24302/2
Peter Mikus [Mon, 13 Jan 2020 13:22:31 +0000 (13:22 +0000)]
FIX: NF_density tests

+ Because arp->neigbor was so important to do.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I552e175b7555ebf5053d7994c0c9173c0c96fc58

4 years agoReport: Move VTS tests from 3n to 2n 95/24295/2
Tibor Frank [Mon, 13 Jan 2020 10:23:27 +0000 (11:23 +0100)]
Report: Move VTS tests from 3n to 2n

Change-Id: Ie2faa6cb611d372c4a20584f7b40f3281660f2b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1597 API cleanup: rdma 80/24280/3
Jan Gelety [Thu, 9 Jan 2020 16:22:06 +0000 (17:22 +0100)]
CSIT-1597 API cleanup: rdma

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24225
- update vpp stable to version 20.01-rc0~1011

Change-Id: Ibbfdbe867cf89715619efc5c5507859983025ece
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Add comparison tables 82/24282/1
Tibor Frank [Fri, 10 Jan 2020 12:22:00 +0000 (13:22 +0100)]
Report: Add comparison tables

CSIT-1654

Change-Id: I280195b295d4fc717cb355e78c5f1731bb1eabe5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add 2n-clx 67/24267/4
Tibor Frank [Thu, 9 Jan 2020 14:02:10 +0000 (15:02 +0100)]
Report: Add 2n-clx

Change-Id: I34dc11c28d21f0b9fed87d76942fe8b8cdd86c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Container test 68/24268/2
Peter Mikus [Thu, 9 Jan 2020 13:45:06 +0000 (13:45 +0000)]
FIX: Container test

+ We should check if container is UP
+ We should adjust privileges.

Change-Id: I3f604b7b9740943b4fd3b0574c18d2729e88b816
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: Configure Report 2001 61/24261/3
Tibor Frank [Thu, 9 Jan 2020 09:11:55 +0000 (10:11 +0100)]
Report: Configure Report 2001

Change-Id: I5ef3c37cf329b76a1a7f94d60c3563872eef3c5d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoDMM: Remove 20/23420/11
Tibor Frank [Thu, 14 Nov 2019 08:28:14 +0000 (09:28 +0100)]
DMM: Remove

Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAPI: Add collection for 24225/3 46/24246/1
Jan Gelety [Wed, 8 Jan 2020 02:11:12 +0000 (03:11 +0100)]
API: Add collection for 24225/3

Change-Id: I5c4593d05dbcb4d918611dc7520432a446dbf664
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPAL: Set y-axis for HDRHistogram 36/24236/5
Tibor Frank [Wed, 8 Jan 2020 09:41:50 +0000 (10:41 +0100)]
PAL: Set y-axis for HDRHistogram

Change-Id: Ibdee625d6d9215b18771a6348735dc6a07e9ae58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrack real(er) duration of traffic 56/24156/3
Vratko Polak [Wed, 8 Jan 2020 14:08:14 +0000 (15:08 +0100)]
Track real(er) duration of traffic

+ Print duration.
- Missing: Parse duration.
  - We do not have good formula to compensate, yet.

Change-Id: I1c76ac35ce531b1994480d6aa0638f16992231f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoT-Rex: Upgrade to 2.73 with DDP profile fix 00/23900/7
Peter Mikus [Tue, 10 Dec 2019 09:04:59 +0000 (09:04 +0000)]
T-Rex: Upgrade to 2.73 with DDP profile fix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Icaa99e0a71a19ba23697c21a4b5aa046813a718a

4 years agoVhost: Add GSO option 53/24153/8
Peter Mikus [Thu, 2 Jan 2020 13:25:01 +0000 (13:25 +0000)]
Vhost: Add GSO option

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba9af71c293645b480203af72fcf940cbe9ccb3a

4 years agoFix Trex start configuration 81/24181/11
Vratko Polak [Tue, 7 Jan 2020 09:23:23 +0000 (10:23 +0100)]
Fix Trex start configuration

Since https://gerrit.fd.io/r/c/csit/+/24056
csit-vpp perf tests are failing.

Turns out the reason is too large limit_memory value,
but other improvements applied during investigation
are included as well.

+ Cat trex.log if trex fails to start.
+ Improve trex startup command formatting (remove double spaces).
+ Reorder imports.

Change-Id: I2c1106ea6f88a1a275682e73eba212d08c7947c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoRemove leftovers related to Xenial 17/24217/2
Vratko Polak [Tue, 7 Jan 2020 11:44:19 +0000 (12:44 +0100)]
Remove leftovers related to Xenial

+ File VPP_STABLE_VER_UBUNTU.
+ Subtree docs/report/vpp_functional_tests/.

Change-Id: Ifd9dd922152199de9f1352da709b1533d6c15aba
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoRemove VIRL Func tests from Report 19/24219/1
Tibor Frank [Tue, 7 Jan 2020 13:27:39 +0000 (14:27 +0100)]
Remove VIRL Func tests from Report

Change-Id: Ic6edf1f6f6c12d8e76da76617dbf1c4e8e1e2952
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 12/24212/2
Jan Gelety [Tue, 7 Jan 2020 08:59:10 +0000 (09:59 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.01-rc0~983-g78565f38e

 - use new vpp ref build - centos7:
   20.01-rc0~983_g78565f3~b8651

  + remove EXPECTED_FAILING tag from tc01-64B-ethip4-l2patch-dev test

Change-Id: Iab47a66003926024f87e028b1b1d9136b8fb4ec4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoTrending: Move VTS tests from 3n to 2n 13/24213/1
Tibor Frank [Tue, 7 Jan 2020 09:43:08 +0000 (10:43 +0100)]
Trending: Move VTS tests from 3n to 2n

Change-Id: I420cef699d42973602f1290ccd0cc5e378d42492
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd new NIC limits 52/24152/2
Peter Mikus [Thu, 2 Jan 2020 09:58:34 +0000 (09:58 +0000)]
Add new NIC limits

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1a0d1455ae74a2ad4fdb553286aef5942f2a99

4 years agoRevert "L2Patch: Remove EXPECTED_FAILING" 55/24155/1
Peter Mikus [Thu, 2 Jan 2020 14:31:18 +0000 (14:31 +0000)]
Revert "L2Patch: Remove EXPECTED_FAILING"

This reverts commit 09c5a6b8e1c6efed8826ef34aa64809226e80edb.

Reason for revert: CSIT has not yet the latest VPP version

Change-Id: Ibaa2c00c639bacef1561898daf9485c3a68efec4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoL2Patch: Remove EXPECTED_FAILING 51/24151/1
Peter Mikus [Thu, 2 Jan 2020 09:35:02 +0000 (09:35 +0000)]
L2Patch: Remove EXPECTED_FAILING

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie950370c47403872597f8857edd651df2552ccb2

4 years agoTREX: Ability to configure from outside TrafficGenerator.py 56/24056/4
Peter Mikus [Wed, 18 Dec 2019 16:28:28 +0000 (16:28 +0000)]
TREX: Ability to configure from outside TrafficGenerator.py

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia9832e5e65dbcf2d4f99c52fd0570d456262ab9a

4 years agoVTS: Unify the tests 42/23942/7
Peter Mikus [Wed, 11 Dec 2019 14:22:14 +0000 (14:22 +0000)]
VTS: Unify the tests

- Converting to 2n as they were always 2n (with l2xc on 3rd node)
- Removing KW and converting to layered approach

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie349c50f72eb362815e7c5ede076d421ab386e76

4 years agoAdd VPP NSIM Plugin Keywords 19/24019/4
Dave Wallace [Mon, 16 Dec 2019 14:59:02 +0000 (14:59 +0000)]
Add VPP NSIM Plugin Keywords

Change-Id: I1e080a50a68ded8eebc5e6093c55d06281726684
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agopython3: fix RF 'only continuation marker' warning 63/24063/1
Dave Wallace [Wed, 18 Dec 2019 17:53:03 +0000 (17:53 +0000)]
python3: fix RF 'only continuation marker' warning

Change-Id: I250ffd196045bc623d5d38f30f16a08bcaea137c
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoTrending: Fix input data processing 45/24045/1
Tibor Frank [Wed, 18 Dec 2019 09:42:51 +0000 (10:42 +0100)]
Trending: Fix input data processing

Change-Id: I79cecd07c933cc46beb09de1ee2b4a0db5dd8a79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTelemetry: Add more operational data 33/23533/19
Peter Mikus [Tue, 19 Nov 2019 12:00:57 +0000 (12:00 +0000)]
Telemetry: Add more operational data

+ Add both NDR and PDR telemetry capture
+ Speedup sockets
+ Adjust privileges

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia6fd5d405e6fb410651d8b705c921653753aea10

4 years agoFIX: eth interfaces need numa_node information in topology file 33/24033/2
Jan Gelety [Fri, 13 Dec 2019 10:48:56 +0000 (11:48 +0100)]
FIX: eth interfaces need numa_node information in topology file

Change-Id: I9a3c6947da8ab5033e29b39833c97bcdafdc3ca9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCTPA: Improve handling pps vs Mpps 37/23937/7
Vratko Polak [Mon, 16 Dec 2019 09:49:24 +0000 (10:49 +0100)]
CTPA: Improve handling pps vs Mpps

+ Jumpavg assumes precision is around 1, so gives wrong classifications
  when fed Mpps numbers, and the classification has to be done on pps values.
+ Hover should display Mpps values properly, e.g. as floats.
+ Decided to show 3 digits after decimal point.
+ Better distinguishing between keys and indices.

Change-Id: I99bdad5b401839889463c7cf6f8b0930ec65b457
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agopython3: fix wrk traffic profile YAML load 20/24020/1
Dave Wallace [Mon, 16 Dec 2019 17:13:18 +0000 (17:13 +0000)]
python3: fix wrk traffic profile YAML load

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I3b7493221f3a0378b7f6cb0b0a21e8f18a0cc937

4 years agoVagrant: Introduce CentOS8 09/24009/4
Peter Mikus [Mon, 16 Dec 2019 12:14:44 +0000 (12:14 +0000)]
Vagrant: Introduce CentOS8

+ Full ansible compatibility
- Docker currently not working in Centos8 as it was not yet released

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I837091621db6bbebc9fee729496384cabe2f5357

4 years agoPerpatch compare: pylint fixes. 91/23991/6
Vratko Polak [Mon, 16 Dec 2019 12:18:22 +0000 (13:18 +0100)]
Perpatch compare: pylint fixes.

+ Do not execute on import.
+ Replace hack() with sorted().

Change-Id: Ic439a799ab29d42ae21faf70b2aea6dce6e89510
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoDo not execute crc check on import 92/23992/4
Vratko Polak [Mon, 16 Dec 2019 11:43:37 +0000 (12:43 +0100)]
Do not execute crc check on import

Other guilty scripts already have open changes that fix them.

Change-Id: Ife75e999d6d3f3f506b0f5dcdb679ce1f1e6bdbe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: NAT44 bug 11/24011/1
Peter Mikus [Mon, 16 Dec 2019 12:38:18 +0000 (12:38 +0000)]
FIX: NAT44 bug

+ From trending ...

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0ebb5429f0ad731d42aa43855cd99ae73b1461fc

4 years agoFIX PIP requirement packages 85/23985/8
Peter Mikus [Fri, 13 Dec 2019 12:49:21 +0000 (12:49 +0000)]
FIX PIP requirement packages

+ CSIT will only use packages installed from master
  PIP requirement.txt file
+ All CSIT subsequent code must use single function
  and PIP list for virtualenv
- Report/PAL/doc/trending will follow in next patch

Change-Id: Ia9150fb05a144182a5a163178d553370ede55cdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRemove supervisord dependency from containers 88/23988/5
Peter Mikus [Fri, 13 Dec 2019 15:06:46 +0000 (15:06 +0000)]
Remove supervisord dependency from containers

+ Startup config stream-line

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia12e48202a5fc88461d3d24ac9b9599e7175b1d8

4 years agoReduce spam from device bootstrap 94/23994/1
Vratko Polak [Fri, 13 Dec 2019 17:54:31 +0000 (18:54 +0100)]
Reduce spam from device bootstrap

It uses "declare -f" to paste the complete common.sh file. Twice.
The output from ssh remote side still remains visible,
but avoiding the spam should ease scrolling to Robot console output.

Change-Id: I746484ada7650a6dfa6794e76550757af5413a82
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAPI: Add collection for 22970/5 82/23982/1
Jan Gelety [Thu, 12 Dec 2019 19:46:12 +0000 (20:46 +0100)]
API: Add collection for 22970/5

Change-Id: If865526d833a267eba85e6ae4107e4d0da0dfd0b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPython3: refactor ':FOR' statements 76/23976/2
Dave Wallace [Thu, 12 Dec 2019 22:41:24 +0000 (22:41 +0000)]
Python3: refactor ':FOR' statements

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I76835e3d3acf6955e328f30427f9dd0098947e41

4 years agoCSIT-1597, CSIT-1647 API cleanup: gbp 77/23977/1
Jan Gelety [Thu, 12 Dec 2019 16:43:36 +0000 (17:43 +0100)]
CSIT-1597, CSIT-1647 API cleanup: gbp

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/23835
- update vpp stable to version 20.01-rc0~843

Change-Id: Idb1299cbbba578c09542c23858fb1fc55d090f26
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 23835/1 69/23969/1
Jan Gelety [Thu, 12 Dec 2019 13:31:33 +0000 (14:31 +0100)]
API: Add collection for 23835/1

- update vpp stable to version 20.01-rc0~841

Change-Id: I05fc3878a606852c8348b61b40d8000411709d33
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 23830/1 62/23962/1
Jan Gelety [Sun, 1 Dec 2019 09:43:16 +0000 (10:43 +0100)]
API: Add collection for 23830/1

- update vpp stable to version 20.01-rc0~839

Change-Id: Ic79bccf7cce384f5058218398bbef16cf1c9d40c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 23829/1 56/23956/1
Jan Gelety [Sun, 1 Dec 2019 04:43:49 +0000 (05:43 +0100)]
API: Add collection for 23829/1

Change-Id: I4b2a7bda48fba3050a35966f7a86c8dc7ba62d36
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1597 API cleanup: vhost 38/23938/2
Jan Gelety [Sun, 1 Dec 2019 00:31:13 +0000 (01:31 +0100)]
CSIT-1597 API cleanup: vhost

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22277
- update vpp stable to version 20.01-rc0~831

Change-Id: Icb3801d6a7bc738cf48bc5ecbb0767f115dde964
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-VPP-DEV: move tap tests back to critical pool 47/23947/1
Jan Gelety [Sun, 1 Dec 2019 03:38:10 +0000 (04:38 +0100)]
CSIT-VPP-DEV: move tap tests back to critical pool

Change-Id: Ic99e828588d561a07c169502dff8ca19ac98400f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 22277/5 36/23936/1
Jan Gelety [Sun, 1 Dec 2019 00:06:59 +0000 (01:06 +0100)]
API: Add collection for 22277/5

Change-Id: Icd82e53ba5836302b036dbe41070d11b2ea4d401
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1597 API cleanup: tap 11/23911/7
Jan Gelety [Sat, 30 Nov 2019 16:18:01 +0000 (17:18 +0100)]
CSIT-1597 API cleanup: tap

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
- cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887
- update vpp stable to version 20.01-rc0~828

Change-Id: I70d88741a02729421d4b31010910138838811518
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: NF_Density pipeline ip4 profile 33/23933/3
Peter Mikus [Wed, 11 Dec 2019 10:32:41 +0000 (10:32 +0000)]
FIX: NF_Density pipeline ip4 profile

- Because they are failing

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55c51bd3e4673414e5394cc6ba990257574ab002

4 years agoIntroduce VPP-IPsec container tests. 06/20706/53
Ludovit Mikula [Wed, 17 Jul 2019 14:36:21 +0000 (14:36 +0000)]
Introduce VPP-IPsec container tests.

Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
4 years agoAPI: Add collection for 23887/2 20/23920/1
Jan Gelety [Sat, 30 Nov 2019 19:04:12 +0000 (20:04 +0100)]
API: Add collection for 23887/2

Change-Id: I3c2124aebbab8cac12a7fa661e75b68b70286240
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoVPPD: Add L2patch 37/23337/14
Peter Mikus [Fri, 8 Nov 2019 13:15:23 +0000 (13:15 +0000)]
VPPD: Add L2patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407

4 years agoTrendig" Fix NFV graph 17/23917/1
Tibor Frank [Tue, 10 Dec 2019 13:07:22 +0000 (14:07 +0100)]
Trendig" Fix NFV graph

Change-Id: I92b2e6fb3ff095a16f2b8bf2b26770bb100d51ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAPI: Add collection for 21706/17 02/23902/2
Jan Gelety [Sat, 30 Nov 2019 14:33:21 +0000 (15:33 +0100)]
API: Add collection for 21706/17

Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1597 API cleanup: classify 26/22526/8
Jan Gelety [Wed, 11 Sep 2019 17:49:29 +0000 (19:49 +0200)]
CSIT-1597 API cleanup: classify

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
  https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted

Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoTrending: Add more NFV tests 05/23905/1
Tibor Frank [Tue, 10 Dec 2019 09:46:21 +0000 (10:46 +0100)]
Trending: Add more NFV tests

+ 10R2C, 6R4C
+ Tunnels

Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoPerpatch compare: avg_diff is not an int 86/23886/2
Vratko Polak [Mon, 9 Dec 2019 15:04:42 +0000 (16:04 +0100)]
Perpatch compare: avg_diff is not an int

Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: ip route config for ipsec via VAT 10/23810/21
Jan Gelety [Fri, 29 Nov 2019 13:29:53 +0000 (14:29 +0100)]
FIX: ip route config for ipsec via VAT

Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: integer divisions 73/23873/3
Jan Gelety [Sat, 30 Nov 2019 05:47:45 +0000 (06:47 +0100)]
FIX: integer divisions

Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>