Vratko Polak [Tue, 21 Jan 2020 11:02:46 +0000 (12:02 +0100)]
Ndrpdr: Add latency trials for smaller loads
Change-Id: I46bd4b58bdd02a3deed38c158214e1e9977dde05
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 17 Jan 2020 00:59:29 +0000 (01:59 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
20.05-rc0~
14-gdb43bb6af
- use new vpp ref build - centos7:
20.05-rc0~14_gdb43bb6~b8721
Change-Id: I482f40023f6708908e510fa5eede391f62f68c95
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Yulong Pei [Sun, 19 Jan 2020 12:58:07 +0000 (20:58 +0800)]
reduce test cases for 2n-dnv and 3n-dnv mrr daily test
since dnv platform is to use by low end market product, no need care
more about too much flows performance test.
Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Peter Mikus [Thu, 19 Dec 2019 19:20:20 +0000 (19:20 +0000)]
FIX: Hugepages should be detected also from overcommit
Change-Id: I36ec9d61f775791ad0632a579c4921889d1f5acf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Mon, 20 Jan 2020 07:17:02 +0000 (08:17 +0100)]
revert "Report: Remove 'avf' from TC name in plots"
Change-Id: I9b10b8f2f84daad543ac9b84671753785dfb23ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Dave Wallace [Wed, 8 Jan 2020 20:51:43 +0000 (20:51 +0000)]
perf: add TCP Iperf3+LDPRELOAD test suite
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Vratko Polak [Fri, 17 Jan 2020 13:20:49 +0000 (14:20 +0100)]
Fix unreservation
It got broken by the previous reservation fix.
Change-Id: I5d9091b7fa4fcc37148c0223fe8eb83f7e5b6770
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 17 Jan 2020 12:35:31 +0000 (13:35 +0100)]
Report: Remove 'avf' from TC name in plots
Change-Id: Ie1d04347de123032a5d424747d216f90022bc813
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 16 Jan 2020 22:39:05 +0000 (23:39 +0100)]
FIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily job
- not enough cpu cores reported
Change-Id: If3ddbbf4f5af741f328c45ac6b8c874e61d348ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Thu, 16 Jan 2020 22:22:41 +0000 (23:22 +0100)]
FIX: missing write of mac_dst for direction 0 --> 1 in cnf trex profiles
Change-Id: I3acf5220c24f77bc4bfc451919bf9b5345a988ef
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Fri, 17 Jan 2020 11:26:47 +0000 (12:26 +0100)]
Fix reservation if connect fails
Change-Id: I136cc51cbd5a01451e04a39c5d8e5554d6d39305
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 17 Jan 2020 09:18:57 +0000 (10:18 +0100)]
Report: Prepare data sets
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 16 Jan 2020 18:49:06 +0000 (19:49 +0100)]
FIX: L2XC with vhost and VLAN
Change-Id: Ia87abadba431099eeacd8b50ce5d116597a1f393
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Balaji Venkatraman [Tue, 14 Jan 2020 14:57:10 +0000 (06:57 -0800)]
Python3: Migration of files under traffic-profiles/trex
Change-Id: Iae16225d3d3daa4e1e9b177228fb89efe4aa5405
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Tibor Frank [Thu, 16 Jan 2020 12:31:08 +0000 (13:31 +0100)]
Report: Latency by Percentile Distribution
- legend
Change-Id: I35477ce5c2cabfdcef68424854a8574bd3655e55
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 16 Jan 2020 09:53:35 +0000 (10:53 +0100)]
Report: Latency by Percentile Distribution
- Set X-axis
Change-Id: Ica300c7b1352c824bf51ac26e7485c9295ac60dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 10 Jan 2020 12:41:09 +0000 (13:41 +0100)]
Report: Add placeholders for new TBs
Change-Id: I92cb693343c4f96503b45a15211e0dadd6fcde5f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 5 Dec 2019 14:37:27 +0000 (15:37 +0100)]
Remove leftovers from previous removals
- Except KubernetesUtils and its bash dependencies.
It is a dead code currently, but we hope new tests will resurrect it.
+ Mention device tests instead of functional in Readme.
Change-Id: I6bdbea13ea9f995a06a0fb7cb5e98ae4fce29581
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 15 Jan 2020 14:48:48 +0000 (15:48 +0100)]
Report: Latency by Percentile Distribution
- Set the position of the Lagend
Change-Id: I1bcea6002bd8beeba3300c9976d1603a234c3c14
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 15 Jan 2020 10:15:14 +0000 (11:15 +0100)]
Report: Add Latency by Percentile Distribution
Change-Id: I5291db8117da611497e910aa7cd2fbb2276bfe65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 15 Jan 2020 13:12:48 +0000 (13:12 +0000)]
Docs: Update report sections
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib6e9ac003c1d91673984c52baf2f3eec30c9d21d
Peter Mikus [Wed, 15 Jan 2020 12:01:35 +0000 (12:01 +0000)]
Ansible: Increase TG hugepages
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa87e372ed45f6dfc883723acbb325e34fb814a8
Vratko Polak [Fri, 22 Nov 2019 13:14:15 +0000 (14:14 +0100)]
Remove everything related to TLDK
- Leftovers from kubernetes found, but not removed here.
Change-Id: If8cb9269d0f3e69f642d7fe02c59122e17925a4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 13 Dec 2019 15:11:58 +0000 (16:11 +0100)]
Trending: new daily set
New daily sets are prepared based on information in
https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md
and previous test set definitions in
docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md
files.
- mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h
- mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h
- mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h
- mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h
- mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h
- mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h
- mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h
+ add some missing test suites
+ add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile
+ correction of TS and TC names and tags in directory
tests/vpp/perf/nfv_density/chain_ipsec
Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Thu, 2 Jan 2020 14:30:09 +0000 (15:30 +0100)]
Support suite tags in autogen
+ Include a script to add suite tags to many suites at once.
+ Add suite tags also to device tests (not covered by autogen).
Change-Id: I514ee6178e22999b43460028fe2696738b012f04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 3 Jan 2020 15:01:30 +0000 (16:01 +0100)]
Autogen: Generate also NIC drivers.
+ Disallowed -avf- (or -rdma-) as "template" suites.
+ GBP suite switched to DPDK driver in repo.
+ Each NIC has its own list of supported drivers, in Constants.
+ Updated tag expressions for daily jobs:
+ Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts
are tested only with vfio-pci.
+ Other (base, dot1q, dot1ad) tested with all drivers.
+ Setup actions currently depend on driver, generated.
- The performance_rdma action is trivial for now.
- Several tests fail, to be fixed later, e.g. by performance_rdma.
+ Reconf tests are also supported.
+ Added DRV_VFIO_PCI tags missing, mainly in density tests.
- Vhost suites (density, reconf) are failing, but suites look good.
- TCP suites do not support NIC drivers yet.
- DPDK obviously not supported.
+ Use Python 3 in regenerate scripts.
+ Fix typos binded => bound.
+ File open modes set either u"rt" or u"wt" everywhere.
+ Remove a trailing space in an environment variable name.
Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 14 Jan 2020 12:47:18 +0000 (13:47 +0100)]
Report: Current vs. Previous Release - NFV Tests
Change-Id: I00cbde38b8f900efe3e3123a942de2288381ea3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Dave Wallace [Fri, 20 Dec 2019 22:46:51 +0000 (22:46 +0000)]
Hoststack perf infrastructure refactoring
- DUT only topology (hoststack test
apps are co-located with vpp)
- Make vpp app specific keywords generic
where applicable
- Add IP4 Prefix to topology file
- Support running wrk in linux namespace
- Refactor namespace cleanup
- Remove redundant namespace creation code
- Refactor test/keyword dirs: tcp -> hoststack
- Add hoststack utility keywords
- Refactor wrk suite setup/teardown
- Update tests with recent perf infra changes
Change-Id: Ia1cf07978d579393eef94923819a87c8c1f36f34
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Peter Mikus [Tue, 14 Jan 2020 15:05:22 +0000 (15:05 +0000)]
FIX: VXLAN scale
+ Another stupid arp -> neighbor rename
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia873d6c2a485659033f71cdf546782db74787d13
Peter Mikus [Tue, 14 Jan 2020 07:51:12 +0000 (07:51 +0000)]
FIX: NF_density tests
+ ARP -> Neighbor
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I74044bd7db6cb4b1bd3648a424e9c8f1473be8d1
Vratko Polak [Mon, 13 Jan 2020 13:55:27 +0000 (14:55 +0100)]
Update comments in crc file.
+ L2patch is already covered.
+ RDMA is not device testable yet.
Change-Id: I1dcccfcb340a8fe61c20d3516340e26db293cfaa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 13 Jan 2020 14:20:12 +0000 (15:20 +0100)]
Report: Add VNF Service Chains Tunnels
Change-Id: Iafdcb543f6adc583567a05aa5a882dce17b58f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 13 Jan 2020 13:22:31 +0000 (13:22 +0000)]
FIX: NF_density tests
+ Because arp->neigbor was so important to do.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I552e175b7555ebf5053d7994c0c9173c0c96fc58
Tibor Frank [Mon, 13 Jan 2020 10:23:27 +0000 (11:23 +0100)]
Report: Move VTS tests from 3n to 2n
Change-Id: Ie2faa6cb611d372c4a20584f7b40f3281660f2b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 9 Jan 2020 16:22:06 +0000 (17:22 +0100)]
CSIT-1597 API cleanup: rdma
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24225
- update vpp stable to version 20.01-rc0~1011
Change-Id: Ibbfdbe867cf89715619efc5c5507859983025ece
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 10 Jan 2020 12:22:00 +0000 (13:22 +0100)]
Report: Add comparison tables
CSIT-1654
Change-Id: I280195b295d4fc717cb355e78c5f1731bb1eabe5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 9 Jan 2020 14:02:10 +0000 (15:02 +0100)]
Report: Add 2n-clx
Change-Id: I34dc11c28d21f0b9fed87d76942fe8b8cdd86c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 9 Jan 2020 13:45:06 +0000 (13:45 +0000)]
FIX: Container test
+ We should check if container is UP
+ We should adjust privileges.
Change-Id: I3f604b7b9740943b4fd3b0574c18d2729e88b816
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Thu, 9 Jan 2020 09:11:55 +0000 (10:11 +0100)]
Report: Configure Report 2001
Change-Id: I5ef3c37cf329b76a1a7f94d60c3563872eef3c5d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 14 Nov 2019 08:28:14 +0000 (09:28 +0100)]
DMM: Remove
Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 8 Jan 2020 02:11:12 +0000 (03:11 +0100)]
API: Add collection for 24225/3
Change-Id: I5c4593d05dbcb4d918611dc7520432a446dbf664
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 8 Jan 2020 09:41:50 +0000 (10:41 +0100)]
PAL: Set y-axis for HDRHistogram
Change-Id: Ibdee625d6d9215b18771a6348735dc6a07e9ae58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 8 Jan 2020 14:08:14 +0000 (15:08 +0100)]
Track real(er) duration of traffic
+ Print duration.
- Missing: Parse duration.
- We do not have good formula to compensate, yet.
Change-Id: I1c76ac35ce531b1994480d6aa0638f16992231f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Tue, 10 Dec 2019 09:04:59 +0000 (09:04 +0000)]
T-Rex: Upgrade to 2.73 with DDP profile fix
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Icaa99e0a71a19ba23697c21a4b5aa046813a718a
Peter Mikus [Thu, 2 Jan 2020 13:25:01 +0000 (13:25 +0000)]
Vhost: Add GSO option
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba9af71c293645b480203af72fcf940cbe9ccb3a
Vratko Polak [Tue, 7 Jan 2020 09:23:23 +0000 (10:23 +0100)]
Fix Trex start configuration
Since https://gerrit.fd.io/r/c/csit/+/24056
csit-vpp perf tests are failing.
Turns out the reason is too large limit_memory value,
but other improvements applied during investigation
are included as well.
+ Cat trex.log if trex fails to start.
+ Improve trex startup command formatting (remove double spaces).
+ Reorder imports.
Change-Id: I2c1106ea6f88a1a275682e73eba212d08c7947c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 7 Jan 2020 11:44:19 +0000 (12:44 +0100)]
Remove leftovers related to Xenial
+ File VPP_STABLE_VER_UBUNTU.
+ Subtree docs/report/vpp_functional_tests/.
Change-Id: Ifd9dd922152199de9f1352da709b1533d6c15aba
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 7 Jan 2020 13:27:39 +0000 (14:27 +0100)]
Remove VIRL Func tests from Report
Change-Id: Ic6edf1f6f6c12d8e76da76617dbf1c4e8e1e2952
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 7 Jan 2020 08:59:10 +0000 (09:59 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
983-g78565f38e
- use new vpp ref build - centos7:
20.01-rc0~983_g78565f3~b8651
+ remove EXPECTED_FAILING tag from tc01-64B-ethip4-l2patch-dev test
Change-Id: Iab47a66003926024f87e028b1b1d9136b8fb4ec4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Tue, 7 Jan 2020 09:43:08 +0000 (10:43 +0100)]
Trending: Move VTS tests from 3n to 2n
Change-Id: I420cef699d42973602f1290ccd0cc5e378d42492
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 2 Jan 2020 09:58:34 +0000 (09:58 +0000)]
Add new NIC limits
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1a0d1455ae74a2ad4fdb553286aef5942f2a99
Peter Mikus [Thu, 2 Jan 2020 14:31:18 +0000 (14:31 +0000)]
Revert "L2Patch: Remove EXPECTED_FAILING"
This reverts commit
09c5a6b8e1c6efed8826ef34aa64809226e80edb.
Reason for revert: CSIT has not yet the latest VPP version
Change-Id: Ibaa2c00c639bacef1561898daf9485c3a68efec4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 2 Jan 2020 09:35:02 +0000 (09:35 +0000)]
L2Patch: Remove EXPECTED_FAILING
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie950370c47403872597f8857edd651df2552ccb2
Peter Mikus [Wed, 18 Dec 2019 16:28:28 +0000 (16:28 +0000)]
TREX: Ability to configure from outside TrafficGenerator.py
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia9832e5e65dbcf2d4f99c52fd0570d456262ab9a
Peter Mikus [Wed, 11 Dec 2019 14:22:14 +0000 (14:22 +0000)]
VTS: Unify the tests
- Converting to 2n as they were always 2n (with l2xc on 3rd node)
- Removing KW and converting to layered approach
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie349c50f72eb362815e7c5ede076d421ab386e76
Dave Wallace [Mon, 16 Dec 2019 14:59:02 +0000 (14:59 +0000)]
Add VPP NSIM Plugin Keywords
Change-Id: I1e080a50a68ded8eebc5e6093c55d06281726684
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Dave Wallace [Wed, 18 Dec 2019 17:53:03 +0000 (17:53 +0000)]
python3: fix RF 'only continuation marker' warning
Change-Id: I250ffd196045bc623d5d38f30f16a08bcaea137c
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Tibor Frank [Wed, 18 Dec 2019 09:42:51 +0000 (10:42 +0100)]
Trending: Fix input data processing
Change-Id: I79cecd07c933cc46beb09de1ee2b4a0db5dd8a79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 19 Nov 2019 12:00:57 +0000 (12:00 +0000)]
Telemetry: Add more operational data
+ Add both NDR and PDR telemetry capture
+ Speedup sockets
+ Adjust privileges
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia6fd5d405e6fb410651d8b705c921653753aea10
Jan Gelety [Fri, 13 Dec 2019 10:48:56 +0000 (11:48 +0100)]
FIX: eth interfaces need numa_node information in topology file
Change-Id: I9a3c6947da8ab5033e29b39833c97bcdafdc3ca9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Mon, 16 Dec 2019 09:49:24 +0000 (10:49 +0100)]
CTPA: Improve handling pps vs Mpps
+ Jumpavg assumes precision is around 1, so gives wrong classifications
when fed Mpps numbers, and the classification has to be done on pps values.
+ Hover should display Mpps values properly, e.g. as floats.
+ Decided to show 3 digits after decimal point.
+ Better distinguishing between keys and indices.
Change-Id: I99bdad5b401839889463c7cf6f8b0930ec65b457
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Dave Wallace [Mon, 16 Dec 2019 17:13:18 +0000 (17:13 +0000)]
python3: fix wrk traffic profile YAML load
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I3b7493221f3a0378b7f6cb0b0a21e8f18a0cc937
Peter Mikus [Mon, 16 Dec 2019 12:14:44 +0000 (12:14 +0000)]
Vagrant: Introduce CentOS8
+ Full ansible compatibility
- Docker currently not working in Centos8 as it was not yet released
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I837091621db6bbebc9fee729496384cabe2f5357
Vratko Polak [Mon, 16 Dec 2019 12:18:22 +0000 (13:18 +0100)]
Perpatch compare: pylint fixes.
+ Do not execute on import.
+ Replace hack() with sorted().
Change-Id: Ic439a799ab29d42ae21faf70b2aea6dce6e89510
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 16 Dec 2019 11:43:37 +0000 (12:43 +0100)]
Do not execute crc check on import
Other guilty scripts already have open changes that fix them.
Change-Id: Ife75e999d6d3f3f506b0f5dcdb679ce1f1e6bdbe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Mon, 16 Dec 2019 12:38:18 +0000 (12:38 +0000)]
FIX: NAT44 bug
+ From trending ...
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0ebb5429f0ad731d42aa43855cd99ae73b1461fc
Peter Mikus [Fri, 13 Dec 2019 12:49:21 +0000 (12:49 +0000)]
FIX PIP requirement packages
+ CSIT will only use packages installed from master
PIP requirement.txt file
+ All CSIT subsequent code must use single function
and PIP list for virtualenv
- Report/PAL/doc/trending will follow in next patch
Change-Id: Ia9150fb05a144182a5a163178d553370ede55cdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Fri, 13 Dec 2019 15:06:46 +0000 (15:06 +0000)]
Remove supervisord dependency from containers
+ Startup config stream-line
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia12e48202a5fc88461d3d24ac9b9599e7175b1d8
Vratko Polak [Fri, 13 Dec 2019 17:54:31 +0000 (18:54 +0100)]
Reduce spam from device bootstrap
It uses "declare -f" to paste the complete common.sh file. Twice.
The output from ssh remote side still remains visible,
but avoiding the spam should ease scrolling to Robot console output.
Change-Id: I746484ada7650a6dfa6794e76550757af5413a82
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Thu, 12 Dec 2019 19:46:12 +0000 (20:46 +0100)]
API: Add collection for 22970/5
Change-Id: If865526d833a267eba85e6ae4107e4d0da0dfd0b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Dave Wallace [Thu, 12 Dec 2019 22:41:24 +0000 (22:41 +0000)]
Python3: refactor ':FOR' statements
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I76835e3d3acf6955e328f30427f9dd0098947e41
Jan Gelety [Thu, 12 Dec 2019 16:43:36 +0000 (17:43 +0100)]
CSIT-1597, CSIT-1647 API cleanup: gbp
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/23835
- update vpp stable to version 20.01-rc0~843
Change-Id: Idb1299cbbba578c09542c23858fb1fc55d090f26
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Thu, 12 Dec 2019 13:31:33 +0000 (14:31 +0100)]
API: Add collection for 23835/1
- update vpp stable to version 20.01-rc0~841
Change-Id: I05fc3878a606852c8348b61b40d8000411709d33
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sun, 1 Dec 2019 09:43:16 +0000 (10:43 +0100)]
API: Add collection for 23830/1
- update vpp stable to version 20.01-rc0~839
Change-Id: Ic79bccf7cce384f5058218398bbef16cf1c9d40c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sun, 1 Dec 2019 04:43:49 +0000 (05:43 +0100)]
API: Add collection for 23829/1
Change-Id: I4b2a7bda48fba3050a35966f7a86c8dc7ba62d36
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sun, 1 Dec 2019 00:31:13 +0000 (01:31 +0100)]
CSIT-1597 API cleanup: vhost
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22277
- update vpp stable to version 20.01-rc0~831
Change-Id: Icb3801d6a7bc738cf48bc5ecbb0767f115dde964
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sun, 1 Dec 2019 03:38:10 +0000 (04:38 +0100)]
CSIT-VPP-DEV: move tap tests back to critical pool
Change-Id: Ic99e828588d561a07c169502dff8ca19ac98400f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sun, 1 Dec 2019 00:06:59 +0000 (01:06 +0100)]
API: Add collection for 22277/5
Change-Id: Icd82e53ba5836302b036dbe41070d11b2ea4d401
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sat, 30 Nov 2019 16:18:01 +0000 (17:18 +0100)]
CSIT-1597 API cleanup: tap
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
- cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887
- update vpp stable to version 20.01-rc0~828
Change-Id: I70d88741a02729421d4b31010910138838811518
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 11 Dec 2019 10:32:41 +0000 (10:32 +0000)]
FIX: NF_Density pipeline ip4 profile
- Because they are failing
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55c51bd3e4673414e5394cc6ba990257574ab002
Ludovit Mikula [Wed, 17 Jul 2019 14:36:21 +0000 (14:36 +0000)]
Introduce VPP-IPsec container tests.
Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Jan Gelety [Sat, 30 Nov 2019 19:04:12 +0000 (20:04 +0100)]
API: Add collection for 23887/2
Change-Id: I3c2124aebbab8cac12a7fa661e75b68b70286240
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 8 Nov 2019 13:15:23 +0000 (13:15 +0000)]
VPPD: Add L2patch
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407
Tibor Frank [Tue, 10 Dec 2019 13:07:22 +0000 (14:07 +0100)]
Trendig" Fix NFV graph
Change-Id: I92b2e6fb3ff095a16f2b8bf2b26770bb100d51ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Sat, 30 Nov 2019 14:33:21 +0000 (15:33 +0100)]
API: Add collection for 21706/17
Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 11 Sep 2019 17:49:29 +0000 (19:49 +0200)]
CSIT-1597 API cleanup: classify
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted
Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Tue, 10 Dec 2019 09:46:21 +0000 (10:46 +0100)]
Trending: Add more NFV tests
+ 10R2C, 6R4C
+ Tunnels
Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 9 Dec 2019 15:04:42 +0000 (16:04 +0100)]
Perpatch compare: avg_diff is not an int
Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 29 Nov 2019 13:29:53 +0000 (14:29 +0100)]
FIX: ip route config for ipsec via VAT
Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sat, 30 Nov 2019 05:47:45 +0000 (06:47 +0100)]
FIX: integer divisions
Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 9 Dec 2019 12:10:07 +0000 (13:10 +0100)]
Trending: Use Mpps
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 Dec 2019 10:21:37 +0000 (11:21 +0100)]
Trending: Fix Alerts
Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 Dec 2019 08:56:32 +0000 (09:56 +0100)]
Fixes: Report
- show run
Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 5 Dec 2019 16:07:24 +0000 (17:07 +0100)]
Improve quoting of asterisks
When quoted, the asterisks are understood as literal characters.
When unquoted, so they act as globs patterns.
When used to match files already present in the filesystem,
the asterisks should be unquoted.
When used to match a package name (not a file),
the asterisks should be quoted to prevent the bash expansion,
as programs such as apt-get and yum do their own expasion afterwards.
Unquoted asterisks for matching package names
may happen to work when there are no files to match the bash expansion,
but quoted asterisks are sure to avoid accidents.
Also, we want an asterisk both before and after "vpp",
due to package names such as libvppinfra-dev and python3-vpp-api.
Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 5 Dec 2019 16:06:40 +0000 (16:06 +0000)]
FIX: Some leftovers + csit_sut image sync
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942
Vratko Polak [Fri, 29 Nov 2019 14:55:43 +0000 (15:55 +0100)]
Use new gdb commands for core dump examination
Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 5 Dec 2019 07:08:11 +0000 (07:08 +0000)]
FIX: Deal with some "pylint: disable=" comments
Same rules for all
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iaf6b6313750d19132e2f2886e676100878719690
Vratko Polak [Wed, 4 Dec 2019 12:24:07 +0000 (13:24 +0100)]
Deal with some "pylint: disable=" comments
+ When possible, fix the violation.
+ Else, add a comment:
+ An explanation (if not already present) and keep disable.
+ A TODO (if not already present) and remove the disable.
- This makes tox job report more pylint violations,
but any such violation is fixable and should be fixed.
- Although some need to be fixed in VPP, such as enum item long names.
Change-Id: I48604b5eda070083d79dff1439620dbd9e798e1f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Balaji Venkatraman [Tue, 3 Dec 2019 18:05:28 +0000 (10:05 -0800)]
Python3: IPv4 FIB scale tests with random flows
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Change-Id: Iadd9e8da655f3ccbd36167c1bbee37a774c3bc1f
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Tibor Frank [Wed, 4 Dec 2019 15:02:30 +0000 (16:02 +0100)]
Trending: Fix CLX plots
Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Code Review / csit.git / log