Jan Gelety [Sat, 30 Nov 2019 16:18:01 +0000 (17:18 +0100)]
CSIT-1597 API cleanup: tap
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
- cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887
- update vpp stable to version 20.01-rc0~828
Change-Id: I70d88741a02729421d4b31010910138838811518
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 11 Dec 2019 10:32:41 +0000 (10:32 +0000)]
FIX: NF_Density pipeline ip4 profile
- Because they are failing
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55c51bd3e4673414e5394cc6ba990257574ab002
Ludovit Mikula [Wed, 17 Jul 2019 14:36:21 +0000 (14:36 +0000)]
Introduce VPP-IPsec container tests.
Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Jan Gelety [Sat, 30 Nov 2019 19:04:12 +0000 (20:04 +0100)]
API: Add collection for 23887/2
Change-Id: I3c2124aebbab8cac12a7fa661e75b68b70286240
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 8 Nov 2019 13:15:23 +0000 (13:15 +0000)]
VPPD: Add L2patch
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407
Tibor Frank [Tue, 10 Dec 2019 13:07:22 +0000 (14:07 +0100)]
Trendig" Fix NFV graph
Change-Id: I92b2e6fb3ff095a16f2b8bf2b26770bb100d51ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Sat, 30 Nov 2019 14:33:21 +0000 (15:33 +0100)]
API: Add collection for 21706/17
Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 11 Sep 2019 17:49:29 +0000 (19:49 +0200)]
CSIT-1597 API cleanup: classify
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted
Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Tue, 10 Dec 2019 09:46:21 +0000 (10:46 +0100)]
Trending: Add more NFV tests
+ 10R2C, 6R4C
+ Tunnels
Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 9 Dec 2019 15:04:42 +0000 (16:04 +0100)]
Perpatch compare: avg_diff is not an int
Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 29 Nov 2019 13:29:53 +0000 (14:29 +0100)]
FIX: ip route config for ipsec via VAT
Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sat, 30 Nov 2019 05:47:45 +0000 (06:47 +0100)]
FIX: integer divisions
Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 9 Dec 2019 12:10:07 +0000 (13:10 +0100)]
Trending: Use Mpps
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 Dec 2019 10:21:37 +0000 (11:21 +0100)]
Trending: Fix Alerts
Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 9 Dec 2019 08:56:32 +0000 (09:56 +0100)]
Fixes: Report
- show run
Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 5 Dec 2019 16:07:24 +0000 (17:07 +0100)]
Improve quoting of asterisks
When quoted, the asterisks are understood as literal characters.
When unquoted, so they act as globs patterns.
When used to match files already present in the filesystem,
the asterisks should be unquoted.
When used to match a package name (not a file),
the asterisks should be quoted to prevent the bash expansion,
as programs such as apt-get and yum do their own expasion afterwards.
Unquoted asterisks for matching package names
may happen to work when there are no files to match the bash expansion,
but quoted asterisks are sure to avoid accidents.
Also, we want an asterisk both before and after "vpp",
due to package names such as libvppinfra-dev and python3-vpp-api.
Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 5 Dec 2019 16:06:40 +0000 (16:06 +0000)]
FIX: Some leftovers + csit_sut image sync
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942
Vratko Polak [Fri, 29 Nov 2019 14:55:43 +0000 (15:55 +0100)]
Use new gdb commands for core dump examination
Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 5 Dec 2019 07:08:11 +0000 (07:08 +0000)]
FIX: Deal with some "pylint: disable=" comments
Same rules for all
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iaf6b6313750d19132e2f2886e676100878719690
Vratko Polak [Wed, 4 Dec 2019 12:24:07 +0000 (13:24 +0100)]
Deal with some "pylint: disable=" comments
+ When possible, fix the violation.
+ Else, add a comment:
+ An explanation (if not already present) and keep disable.
+ A TODO (if not already present) and remove the disable.
- This makes tox job report more pylint violations,
but any such violation is fixable and should be fixed.
- Although some need to be fixed in VPP, such as enum item long names.
Change-Id: I48604b5eda070083d79dff1439620dbd9e798e1f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Balaji Venkatraman [Tue, 3 Dec 2019 18:05:28 +0000 (10:05 -0800)]
Python3: IPv4 FIB scale tests with random flows
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Change-Id: Iadd9e8da655f3ccbd36167c1bbee37a774c3bc1f
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Tibor Frank [Wed, 4 Dec 2019 15:02:30 +0000 (16:02 +0100)]
Trending: Fix CLX plots
Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 4 Dec 2019 12:59:50 +0000 (13:59 +0100)]
Trending: Fix CLX data set
Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 27 Sep 2019 11:02:24 +0000 (13:02 +0200)]
Trending: Reorganization
+ use selection of tests by their full names
+ finalize trending_test_groups.md
+ modify static content
+ modify anchors
+ specifications:
+ container memif
+ ip4
+ ip4 tunnels
+ ip6
+ ipsec
+ l2
+ srv6
+ vhost
+ vts
+ dpdk
+ add 2n-clx
+ hyperlinks
Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 27 Nov 2019 13:04:05 +0000 (14:04 +0100)]
Update CRC for 21551/27
The previously prepared values for 21551/12
are not matching the newer patch sets.
Change-Id: I2ddfcfc96f3f1573b20889dd52e142cf39465f65
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 24 Sep 2019 09:00:05 +0000 (11:00 +0200)]
PAL: Add HDRHistogram graphs for latency
Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
juraj.linkes [Fri, 29 Nov 2019 19:29:40 +0000 (20:29 +0100)]
Change startup show pci to show ver
When testing whether a socket is listetning, show pci results in a crash
on the Taishan platform. Temporarily work around this by changing it to
show ver.
Change-Id: Id0f995373bc2f429d59de200e51959b2da408052
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
Peter Mikus [Tue, 3 Dec 2019 12:53:24 +0000 (12:53 +0000)]
Remove: VIRL
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b
Peter Mikus [Tue, 3 Dec 2019 15:00:13 +0000 (15:00 +0000)]
FIX: Add ply also to global requirements
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fca2c05377f94e9df8c3df1d8d735c25a84e538
Tibor Frank [Wed, 20 Nov 2019 10:43:44 +0000 (11:43 +0100)]
Python3: PAL
- files renamed:
- utils.py --> pal_utils.py
- errors.py --> pal_errors.py
- functions/methods renamed:
- plot_service_density_reconf_box_name --> plot_nf_reconf_box_name
- plot_performance_box_name --> plot_perf_box_name
- plot_latency_error_bars_name --> plot_lat_err_bars_name
- plot_throughput_speedup_analysis_name --> plot_tsa_name
- plot_service_density_heatmap --> plot_nf_heatmap
- table_performance_comparison --> table_perf_comparison
- table_performance_comparison_nic --> table_perf_comparison_nic
- table_performance_trending_dashboard_html --> table_perf_trending_dash_html
- functions/methods removed:
- plot_service_density_heatmap_compare
- plot_throughput_speedup_analysis
- plot_latency_error_bars
- plot_soak_boxes
- plot_soak_bars
Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Fri, 29 Nov 2019 08:42:47 +0000 (09:42 +0100)]
API: Add collection for 21551/27
Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Fri, 29 Nov 2019 01:10:31 +0000 (02:10 +0100)]
FIX: vxlan+vlan perf tests
Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 3 Dec 2019 09:41:38 +0000 (09:41 +0000)]
Python3: Vagrant update
+ Small styling
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde
Vratko Polak [Mon, 2 Dec 2019 18:01:35 +0000 (19:01 +0100)]
Use Jumpavg 0.2.0 in PAL
+ As a side effect, PAL is now part of "resource" package tree.
- Testable only with 23558 (the rest of PAL Python 3 migration).
Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 2 Dec 2019 17:38:44 +0000 (18:38 +0100)]
Refactor jumpavg to be more readable and usable
This is the python3 change, the python2 is still used for testing bisect.
+ New version is 0.2.0 due to amount o API changes.
+ Jumpavg is now part of CSIT resource package tree.
+ Perpatch migrated to new jumpavg.
- PAL NOT updated (the update moved to a different Change).
Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Mon, 2 Dec 2019 14:22:16 +0000 (14:22 +0000)]
FIX: Perpatch PY3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab
Jan Gelety [Thu, 28 Nov 2019 20:13:26 +0000 (21:13 +0100)]
FIX: SRV6 proxy
Change-Id: I4afbb0261c21c800bf24e423e505307f596c0045
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Thu, 28 Nov 2019 18:52:52 +0000 (19:52 +0100)]
FIX: acl
Change-Id: Ieb1569a1dce9fd7c00041ba00f72c67142a581ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Sun, 1 Dec 2019 07:07:06 +0000 (07:07 +0000)]
Convert SRv6 from LXC to Docker
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7c948be40aaf2eb03434cec5548a89aaf0f1eca6
Peter Mikus [Sun, 1 Dec 2019 07:03:45 +0000 (07:03 +0000)]
FIX: VAT terminal
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I98fd62e6b5367b23694017d99a1dae7d893326c9
Peter Mikus [Sat, 30 Nov 2019 17:27:08 +0000 (17:27 +0000)]
FIX: IPsec naming creation
Change-Id: I066a8b85649654c1c575eb63722de6c51f3d4f78
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Tue, 12 Nov 2019 04:27:43 +0000 (05:27 +0100)]
Python3: resources and libraries
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Mon, 4 Nov 2019 09:27:28 +0000 (09:27 +0000)]
Python3: PIP requirement
- Install via PIP3
- Use virtualenv Python3 interpret
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3
Tibor Frank [Thu, 14 Nov 2019 09:06:03 +0000 (10:06 +0100)]
NSH_SFC: Remove
Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 11 Nov 2019 16:14:32 +0000 (16:14 +0000)]
HONEYCOMB: Remove
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e
Vratko Polak [Fri, 15 Nov 2019 16:27:43 +0000 (17:27 +0100)]
Improve test tag string parsing
Instead of just adding the missing -clx,
the new way aims to be forward compatible.
The new implementation is quite permissive,
ignoring all "word" chars sticking to the trigger word
and returning everything after that and space up to the endline.
+ Unified perftest and devicetest handling.
+ Consequently, triggers like "devicetest-1n-skx GBP" will work now.
Change-Id: I3bda6105195180d35a589a75318f569e36f03461
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Mon, 18 Nov 2019 09:13:38 +0000 (09:13 +0000)]
FIX: Ansible remove vpp
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409
Peter Mikus [Fri, 15 Nov 2019 10:52:49 +0000 (10:52 +0000)]
FIX: LXC Container directory initialization
Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Fri, 4 Oct 2019 19:26:05 +0000 (21:26 +0200)]
Doc: CSIT Python2 to Python3 migration plan proposal
Change-Id: I0046ef57744d8d09117e850b60f9d65c7495ed07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Wed, 13 Nov 2019 16:44:41 +0000 (17:44 +0100)]
CRC: Update comments after lb-nat4 tests
Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 14 Nov 2019 14:51:54 +0000 (14:51 +0000)]
FIX: AVF IP6base
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc3350acab54100f03f540397bfcbd6e7455ea2c
Peter Mikus [Wed, 13 Nov 2019 14:37:51 +0000 (14:37 +0000)]
FIX: Ipsec perf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0
Jan Gelety [Tue, 12 Nov 2019 05:58:51 +0000 (06:58 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
638-gea93e48cf
- use new vpp ref build - centos7:
20.01-rc0~
638-gea93e48cf
Change-Id: Ib3ab491df32c73ca90178dcd21c3c4e6512371d4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 13 Nov 2019 13:30:48 +0000 (13:30 +0000)]
LIGATO: Remove
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768
Jan Gelety [Mon, 11 Nov 2019 18:39:06 +0000 (19:39 +0100)]
FIX: missing param in gbp_contract_add_del
Change-Id: I5c2354911505a9d7a95bef894eda8bf7b14b8dc8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 13 Nov 2019 11:40:17 +0000 (11:40 +0000)]
FIX: Ansible container cleanup
Change-Id: I233baca48a3f01d1a206fd004b0503b0f1fad5d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 13 Nov 2019 10:46:16 +0000 (10:46 +0000)]
FIX: Ansible cleanup permission
Change-Id: Ia79558b579e70aa666e8f84230f4bd2cafb33569
Signed-off-by: Peter Mikus <pmikus@cisco.com>
haiyanx1.zhang [Thu, 10 Oct 2019 05:34:43 +0000 (05:34 +0000)]
Add vpp loadbalancer l3dsr/nat4 mode test suites
Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
Tibor Frank [Wed, 13 Nov 2019 09:12:39 +0000 (10:12 +0100)]
Trending: Input data
Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 7 Nov 2019 06:45:55 +0000 (07:45 +0100)]
New weekly mrr trigger
Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 12 Nov 2019 07:48:57 +0000 (07:48 +0000)]
FIX: Supervisor initialization
- Next step: remove supervisor entirely
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8
Vratko Polak [Mon, 11 Nov 2019 17:19:30 +0000 (18:19 +0100)]
Remove the leftovers of the old testbed cleanup
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 11 Nov 2019 13:03:16 +0000 (14:03 +0100)]
Add accidentally deleted NAT setup command
One suite was missing "And Add NAT to all DUTs".
Change-Id: I6e9c3de9f236a080cfe829db2d155a6f6ba3b3f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Wed, 30 Oct 2019 03:52:03 +0000 (04:52 +0100)]
FIX: do not use ping in vpp-device tests
Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Mon, 11 Nov 2019 08:35:03 +0000 (08:35 +0000)]
FIX: Paths for new Docker images
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50
Peter Mikus [Fri, 8 Nov 2019 16:03:49 +0000 (16:03 +0000)]
FIX: 2lbvpplacp
- These testcases are non standard so they need to be refactored
to be able to use the interface layers
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9400846ff04f1864babd6d7fa153f0c3708cb105
Vratko Polak [Fri, 8 Nov 2019 10:14:52 +0000 (11:14 +0100)]
Prevent many TC triggered by bad tag expressions
Typical example: Use multiple perftest lines in a comment.
Atypical example: Use perftest as an expression (without any ANDs).
Fix: Die if "perftest" is found in the tag expression (before prefixing).
Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Thu, 7 Nov 2019 02:30:47 +0000 (03:30 +0100)]
FIX: use correct NIC for mr-daily-master job
Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 8 Nov 2019 08:09:04 +0000 (08:09 +0000)]
FIX: Small ansible fixes
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2
Vratko Polak [Thu, 7 Nov 2019 13:13:45 +0000 (14:13 +0100)]
Source ansible.sh for entry scripts using cleanup
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 10 Oct 2019 15:31:28 +0000 (15:31 +0000)]
Cleanup via Ansible
+ Remove dependency on topo_ scripts that depends on custom SSH()
that depends on framework itself. This way the cleanup is independent
of failure in our SSH libs.
+ Simple ansible command can do cleanup of a machine:
ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \
--limit '10.32.8.18' --tags 'cleanup'
+ Add vpp_device reset and cleanup.
+ Remove historical scripts.
- Still in testing beta phase.
- Need to add SRIOV cleanup.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7
Tibor Frank [Mon, 4 Nov 2019 14:50:18 +0000 (15:50 +0100)]
Trending: Fix alerts
Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Fri, 25 Oct 2019 13:16:46 +0000 (15:16 +0200)]
New daily triggers
New daily triggers defined based on requirements defined in
https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md
Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Thu, 31 Oct 2019 17:50:19 +0000 (18:50 +0100)]
Regularize spaces in crc list
Two spaces before hash if after quote, single space otherwise
(or 4 spaces if the hash is commenting out the whole line).
Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 31 Oct 2019 16:49:06 +0000 (17:49 +0100)]
Copy missing lines to second CRC collection
Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Wed, 30 Oct 2019 14:29:49 +0000 (14:29 +0000)]
Framework: Add show log as tear down action
+ We can see what is happening when debug level is increased
+ Big caveat of VPP is that it does not allow to configure
default global level.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0
Peter Mikus [Fri, 13 Sep 2019 12:00:49 +0000 (12:00 +0000)]
Add: Use containers for shared TG
+ Ansible
+ Service for auto load during restart
+ By default created 2 instances of Docker container
+ Small modification of Trex to use prefixes
+ DNV topology to use ssh port to connect to docker
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7
Peter Mikus [Wed, 30 Oct 2019 06:59:57 +0000 (06:59 +0000)]
FIX: IPSecHW
- IPsec proto is not for GCM
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If6a9721574a72dacb4486c837100e4f2ed2bab19
Jan Gelety [Thu, 10 Oct 2019 09:50:19 +0000 (11:50 +0200)]
API: Add collection for 21551/12
Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Mon, 28 Oct 2019 12:23:58 +0000 (13:23 +0100)]
TrafficGenerator: Skip only the first equals
HRDhistogram output contains essential trailing equals.
Edit all fields even though we do not expect equals in others.
Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 2 Oct 2019 11:07:19 +0000 (13:07 +0200)]
PAL: Add sortable html table for comparisons
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 25 Oct 2019 12:41:10 +0000 (12:41 +0000)]
FIX: Limitation for NICs
Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Tue, 15 Oct 2019 08:13:29 +0000 (08:13 +0000)]
ADD: Mellanox RDMA interface support
+ Add functions for creating rdma interface
+ Fix traffic generator
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1
Peter Mikus [Mon, 21 Oct 2019 08:49:59 +0000 (08:49 +0000)]
Introduce pre-initialize driver layer
+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5
Vratko Polak [Mon, 21 Oct 2019 12:58:16 +0000 (14:58 +0200)]
CRCs: Update comments and improve CSIT checks.
+ Restore alphabetic order in yaml.
+ Mark the lisp messages verified to be covered by dev instead of virl.
+ Mark the GBP messages verified by devicetest now.
+ Mark acl_add_replace as dev and create_subif as perf.
+ Mark ip_probe_neighbor as unused L1.
+ Improve loadbalancer comments.
- Nat4 testcase is described, even if not merged yet.
+ Forget reported CRC after initial dir report,
and report them again (once) in test cases (if hit).
With this, single run (with fail on crc off) gives full info.
+ Small improvements to CRC library docstrings and messages.
Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Thu, 10 Oct 2019 05:40:49 +0000 (07:40 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
453-g349cd1a~b8252
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
453-g349cd1af7
- use new vpp ref build - centos7:
20.01-rc0~453_g349cd1a~b8066
Change-Id: I083e3b66fa52f4aab1883d0a9855d3be8c64c671
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 18 Oct 2019 14:15:32 +0000 (14:15 +0000)]
Tests: Introduce driver layer
+ Small bugfixes in various suites
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab
Vratko Polak [Fri, 18 Oct 2019 13:34:51 +0000 (15:34 +0200)]
Autogen checker: Fix difference reporting branch
Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 18 Oct 2019 10:20:18 +0000 (12:20 +0200)]
Trending: reduce input data
Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 15 Oct 2019 11:13:26 +0000 (11:13 +0000)]
FIX: Migrate VPP device Centos image
+ Migrate to new image
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib08c5169daac76b0b4c97da3faa40585aeafbc60
Peter Mikus [Wed, 16 Oct 2019 16:25:41 +0000 (16:25 +0000)]
Ansible: Role cleanup
+ Separate and reuse role (better naming)
+ Cleanup in naming
+ Introduce defaults that can be overriden
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iedaf7caba1d05a35a6f61cd21a483cdbc0073d32
Peter Mikus [Tue, 15 Oct 2019 09:43:19 +0000 (09:43 +0000)]
Core-keeper: Process files instead transfer
+ Instead of transferring large files, post-process directly
via CSIT. Extract backtrace as a start point.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I79ad760d310c95d807242ad1997dd657d5142459
Peter Mikus [Wed, 16 Oct 2019 10:56:16 +0000 (10:56 +0000)]
Ansible: Clean Python requirements
+ minor cleanup
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iff9c643f6e9b52dc6a11b04624452f115f3a834e
Peter Mikus [Fri, 9 Aug 2019 12:57:00 +0000 (12:57 +0000)]
VPPD: GBP test case
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d
Peter Mikus [Mon, 14 Oct 2019 13:13:46 +0000 (13:13 +0000)]
Ansible: Mellanox install
+ OFED
+ ibdev2netdev
- aligning few naming conventions
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4
Peter Mikus [Tue, 8 Oct 2019 12:42:35 +0000 (12:42 +0000)]
Add: Parsing of show run over PAPI
+ Add parsing of show run over PAPI STATS
+ Add missing outputs vs show run over CLI
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4
Tibor Frank [Tue, 8 Oct 2019 12:35:05 +0000 (14:35 +0200)]
Trending: Reorganization of tests in graphs
Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 10 Oct 2019 09:52:22 +0000 (11:52 +0200)]
Trending: Generate email body for regressions and progressions
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 9 Oct 2019 20:16:31 +0000 (22:16 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
375-g3ae9f5a~b8172
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
375-g3ae9f5a90
- use new vpp ref build - centos7:
20.01-rc0~375_g3ae9f5a~b7986
Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 9 Oct 2019 10:03:04 +0000 (10:03 +0000)]
FIX: Ansible
+ Cover all CSIT devices with netplan to prevent DHCP usage
+ Move netplan to common role
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846
Code Review / csit.git / log