Peter Mikus [Mon, 4 Nov 2019 09:27:28 +0000 (09:27 +0000)]
Python3: PIP requirement
- Install via PIP3
- Use virtualenv Python3 interpret
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3
Tibor Frank [Thu, 14 Nov 2019 09:06:03 +0000 (10:06 +0100)]
NSH_SFC: Remove
Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 11 Nov 2019 16:14:32 +0000 (16:14 +0000)]
HONEYCOMB: Remove
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e
Vratko Polak [Fri, 15 Nov 2019 16:27:43 +0000 (17:27 +0100)]
Improve test tag string parsing
Instead of just adding the missing -clx,
the new way aims to be forward compatible.
The new implementation is quite permissive,
ignoring all "word" chars sticking to the trigger word
and returning everything after that and space up to the endline.
+ Unified perftest and devicetest handling.
+ Consequently, triggers like "devicetest-1n-skx GBP" will work now.
Change-Id: I3bda6105195180d35a589a75318f569e36f03461
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Mon, 18 Nov 2019 09:13:38 +0000 (09:13 +0000)]
FIX: Ansible remove vpp
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409
Peter Mikus [Fri, 15 Nov 2019 10:52:49 +0000 (10:52 +0000)]
FIX: LXC Container directory initialization
Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Fri, 4 Oct 2019 19:26:05 +0000 (21:26 +0200)]
Doc: CSIT Python2 to Python3 migration plan proposal
Change-Id: I0046ef57744d8d09117e850b60f9d65c7495ed07
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Wed, 13 Nov 2019 16:44:41 +0000 (17:44 +0100)]
CRC: Update comments after lb-nat4 tests
Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 14 Nov 2019 14:51:54 +0000 (14:51 +0000)]
FIX: AVF IP6base
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc3350acab54100f03f540397bfcbd6e7455ea2c
Peter Mikus [Wed, 13 Nov 2019 14:37:51 +0000 (14:37 +0000)]
FIX: Ipsec perf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0
Jan Gelety [Tue, 12 Nov 2019 05:58:51 +0000 (06:58 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
638-gea93e48cf
- use new vpp ref build - centos7:
20.01-rc0~
638-gea93e48cf
Change-Id: Ib3ab491df32c73ca90178dcd21c3c4e6512371d4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 13 Nov 2019 13:30:48 +0000 (13:30 +0000)]
LIGATO: Remove
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768
Jan Gelety [Mon, 11 Nov 2019 18:39:06 +0000 (19:39 +0100)]
FIX: missing param in gbp_contract_add_del
Change-Id: I5c2354911505a9d7a95bef894eda8bf7b14b8dc8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 13 Nov 2019 11:40:17 +0000 (11:40 +0000)]
FIX: Ansible container cleanup
Change-Id: I233baca48a3f01d1a206fd004b0503b0f1fad5d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 13 Nov 2019 10:46:16 +0000 (10:46 +0000)]
FIX: Ansible cleanup permission
Change-Id: Ia79558b579e70aa666e8f84230f4bd2cafb33569
Signed-off-by: Peter Mikus <pmikus@cisco.com>
haiyanx1.zhang [Thu, 10 Oct 2019 05:34:43 +0000 (05:34 +0000)]
Add vpp loadbalancer l3dsr/nat4 mode test suites
Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
Tibor Frank [Wed, 13 Nov 2019 09:12:39 +0000 (10:12 +0100)]
Trending: Input data
Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 7 Nov 2019 06:45:55 +0000 (07:45 +0100)]
New weekly mrr trigger
Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Tue, 12 Nov 2019 07:48:57 +0000 (07:48 +0000)]
FIX: Supervisor initialization
- Next step: remove supervisor entirely
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8
Vratko Polak [Mon, 11 Nov 2019 17:19:30 +0000 (18:19 +0100)]
Remove the leftovers of the old testbed cleanup
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 11 Nov 2019 13:03:16 +0000 (14:03 +0100)]
Add accidentally deleted NAT setup command
One suite was missing "And Add NAT to all DUTs".
Change-Id: I6e9c3de9f236a080cfe829db2d155a6f6ba3b3f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Wed, 30 Oct 2019 03:52:03 +0000 (04:52 +0100)]
FIX: do not use ping in vpp-device tests
Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Mon, 11 Nov 2019 08:35:03 +0000 (08:35 +0000)]
FIX: Paths for new Docker images
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50
Peter Mikus [Fri, 8 Nov 2019 16:03:49 +0000 (16:03 +0000)]
FIX: 2lbvpplacp
- These testcases are non standard so they need to be refactored
to be able to use the interface layers
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9400846ff04f1864babd6d7fa153f0c3708cb105
Vratko Polak [Fri, 8 Nov 2019 10:14:52 +0000 (11:14 +0100)]
Prevent many TC triggered by bad tag expressions
Typical example: Use multiple perftest lines in a comment.
Atypical example: Use perftest as an expression (without any ANDs).
Fix: Die if "perftest" is found in the tag expression (before prefixing).
Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Thu, 7 Nov 2019 02:30:47 +0000 (03:30 +0100)]
FIX: use correct NIC for mr-daily-master job
Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 8 Nov 2019 08:09:04 +0000 (08:09 +0000)]
FIX: Small ansible fixes
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2
Vratko Polak [Thu, 7 Nov 2019 13:13:45 +0000 (14:13 +0100)]
Source ansible.sh for entry scripts using cleanup
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 10 Oct 2019 15:31:28 +0000 (15:31 +0000)]
Cleanup via Ansible
+ Remove dependency on topo_ scripts that depends on custom SSH()
that depends on framework itself. This way the cleanup is independent
of failure in our SSH libs.
+ Simple ansible command can do cleanup of a machine:
ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \
--limit '10.32.8.18' --tags 'cleanup'
+ Add vpp_device reset and cleanup.
+ Remove historical scripts.
- Still in testing beta phase.
- Need to add SRIOV cleanup.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7
Tibor Frank [Mon, 4 Nov 2019 14:50:18 +0000 (15:50 +0100)]
Trending: Fix alerts
Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Fri, 25 Oct 2019 13:16:46 +0000 (15:16 +0200)]
New daily triggers
New daily triggers defined based on requirements defined in
https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md
Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Thu, 31 Oct 2019 17:50:19 +0000 (18:50 +0100)]
Regularize spaces in crc list
Two spaces before hash if after quote, single space otherwise
(or 4 spaces if the hash is commenting out the whole line).
Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 31 Oct 2019 16:49:06 +0000 (17:49 +0100)]
Copy missing lines to second CRC collection
Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Wed, 30 Oct 2019 14:29:49 +0000 (14:29 +0000)]
Framework: Add show log as tear down action
+ We can see what is happening when debug level is increased
+ Big caveat of VPP is that it does not allow to configure
default global level.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0
Peter Mikus [Fri, 13 Sep 2019 12:00:49 +0000 (12:00 +0000)]
Add: Use containers for shared TG
+ Ansible
+ Service for auto load during restart
+ By default created 2 instances of Docker container
+ Small modification of Trex to use prefixes
+ DNV topology to use ssh port to connect to docker
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7
Peter Mikus [Wed, 30 Oct 2019 06:59:57 +0000 (06:59 +0000)]
FIX: IPSecHW
- IPsec proto is not for GCM
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If6a9721574a72dacb4486c837100e4f2ed2bab19
Jan Gelety [Thu, 10 Oct 2019 09:50:19 +0000 (11:50 +0200)]
API: Add collection for 21551/12
Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Mon, 28 Oct 2019 12:23:58 +0000 (13:23 +0100)]
TrafficGenerator: Skip only the first equals
HRDhistogram output contains essential trailing equals.
Edit all fields even though we do not expect equals in others.
Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 2 Oct 2019 11:07:19 +0000 (13:07 +0200)]
PAL: Add sortable html table for comparisons
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 25 Oct 2019 12:41:10 +0000 (12:41 +0000)]
FIX: Limitation for NICs
Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Tue, 15 Oct 2019 08:13:29 +0000 (08:13 +0000)]
ADD: Mellanox RDMA interface support
+ Add functions for creating rdma interface
+ Fix traffic generator
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1
Peter Mikus [Mon, 21 Oct 2019 08:49:59 +0000 (08:49 +0000)]
Introduce pre-initialize driver layer
+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5
Vratko Polak [Mon, 21 Oct 2019 12:58:16 +0000 (14:58 +0200)]
CRCs: Update comments and improve CSIT checks.
+ Restore alphabetic order in yaml.
+ Mark the lisp messages verified to be covered by dev instead of virl.
+ Mark the GBP messages verified by devicetest now.
+ Mark acl_add_replace as dev and create_subif as perf.
+ Mark ip_probe_neighbor as unused L1.
+ Improve loadbalancer comments.
- Nat4 testcase is described, even if not merged yet.
+ Forget reported CRC after initial dir report,
and report them again (once) in test cases (if hit).
With this, single run (with fail on crc off) gives full info.
+ Small improvements to CRC library docstrings and messages.
Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Thu, 10 Oct 2019 05:40:49 +0000 (07:40 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
453-g349cd1a~b8252
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
453-g349cd1af7
- use new vpp ref build - centos7:
20.01-rc0~453_g349cd1a~b8066
Change-Id: I083e3b66fa52f4aab1883d0a9855d3be8c64c671
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 18 Oct 2019 14:15:32 +0000 (14:15 +0000)]
Tests: Introduce driver layer
+ Small bugfixes in various suites
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab
Vratko Polak [Fri, 18 Oct 2019 13:34:51 +0000 (15:34 +0200)]
Autogen checker: Fix difference reporting branch
Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 18 Oct 2019 10:20:18 +0000 (12:20 +0200)]
Trending: reduce input data
Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 15 Oct 2019 11:13:26 +0000 (11:13 +0000)]
FIX: Migrate VPP device Centos image
+ Migrate to new image
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib08c5169daac76b0b4c97da3faa40585aeafbc60
Peter Mikus [Wed, 16 Oct 2019 16:25:41 +0000 (16:25 +0000)]
Ansible: Role cleanup
+ Separate and reuse role (better naming)
+ Cleanup in naming
+ Introduce defaults that can be overriden
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iedaf7caba1d05a35a6f61cd21a483cdbc0073d32
Peter Mikus [Tue, 15 Oct 2019 09:43:19 +0000 (09:43 +0000)]
Core-keeper: Process files instead transfer
+ Instead of transferring large files, post-process directly
via CSIT. Extract backtrace as a start point.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I79ad760d310c95d807242ad1997dd657d5142459
Peter Mikus [Wed, 16 Oct 2019 10:56:16 +0000 (10:56 +0000)]
Ansible: Clean Python requirements
+ minor cleanup
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iff9c643f6e9b52dc6a11b04624452f115f3a834e
Peter Mikus [Fri, 9 Aug 2019 12:57:00 +0000 (12:57 +0000)]
VPPD: GBP test case
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d
Peter Mikus [Mon, 14 Oct 2019 13:13:46 +0000 (13:13 +0000)]
Ansible: Mellanox install
+ OFED
+ ibdev2netdev
- aligning few naming conventions
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4
Peter Mikus [Tue, 8 Oct 2019 12:42:35 +0000 (12:42 +0000)]
Add: Parsing of show run over PAPI
+ Add parsing of show run over PAPI STATS
+ Add missing outputs vs show run over CLI
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4
Tibor Frank [Tue, 8 Oct 2019 12:35:05 +0000 (14:35 +0200)]
Trending: Reorganization of tests in graphs
Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 10 Oct 2019 09:52:22 +0000 (11:52 +0200)]
Trending: Generate email body for regressions and progressions
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 9 Oct 2019 20:16:31 +0000 (22:16 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
375-g3ae9f5a~b8172
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
375-g3ae9f5a90
- use new vpp ref build - centos7:
20.01-rc0~375_g3ae9f5a~b7986
Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 9 Oct 2019 10:03:04 +0000 (10:03 +0000)]
FIX: Ansible
+ Cover all CSIT devices with netplan to prevent DHCP usage
+ Move netplan to common role
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846
haiyanX1.zhang [Tue, 17 Sep 2019 03:00:26 +0000 (03:00 +0000)]
Add vpp loadbalancer maglev mode test suite
Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
Peter Mikus [Mon, 7 Oct 2019 13:40:49 +0000 (13:40 +0000)]
FIX: Add SRIOV cleanup
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf
Tibor Frank [Fri, 4 Oct 2019 08:41:00 +0000 (10:41 +0200)]
Trending: Send alerts when regression occurs
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 7 Oct 2019 13:37:06 +0000 (13:37 +0000)]
FIX: LXC tmpfs mount
- Should fix the read/write to socket for LXC
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98
Jan Gelety [Fri, 4 Oct 2019 03:06:06 +0000 (05:06 +0200)]
FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant
Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Thu, 26 Sep 2019 07:23:57 +0000 (09:23 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
20.01-rc0~
324-g66a332c~b8122
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~
324-g66a332cf1
- use new vpp ref build - centos7:
20.01-rc0~324_g66a332c~b7936
Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 7 Oct 2019 07:17:59 +0000 (09:17 +0200)]
Report: Set the backgroud of graphs
Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 4 Oct 2019 10:15:18 +0000 (10:15 +0000)]
FIX: Add SRIOV cleanup
If Jenkins interrupt pybot during AVF tests (that is happening
more frequently as coverage increased) the interfaces remains
in link UP state. Next run VPP cannot grab interfaces as they
are in UP state in and kernel driver. This results in testcase
failing.
Patch is supposed to do put interfaces in topology down so VPP
can bind them back to vfio-pci.
Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Thu, 3 Oct 2019 17:42:34 +0000 (19:42 +0200)]
FIX: use int of sw_if_index in call of sw_interface_set_flags api
- it will avoid situation that corresponding port is not up and
its sw_if_index value in topology file is None that is interpreted
as 0 in vpp api so it set flag for local0 interface
Change-Id: I9145077d787ddde50a29bcd4091035e95077f946
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 4 Oct 2019 08:24:53 +0000 (08:24 +0000)]
FIX: IPv6 AVF dot1q
Change-Id: Id199eb774850153fb225434d4a3d194706fdfdb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 2 Oct 2019 12:03:57 +0000 (14:03 +0200)]
Trending: Report also nr of passed tests in email
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 27 Sep 2019 08:35:51 +0000 (10:35 +0200)]
PAL: Set plot.ly version to 4.1.1
Change-Id: I137ee807a2802fa1f7b5b635e1162bf7fff07a57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 2 Oct 2019 15:08:39 +0000 (17:08 +0200)]
PAL: Accept reconf time in scientific notation
+ Otherwise "9.
58828205237e-05" is understood as "9.
58828205237".
+ Replace "[0-9]" with "\d".
Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Thu, 26 Sep 2019 17:29:02 +0000 (19:29 +0200)]
sw_interface_details api updated
- based on pending vpp api change: https://gerrit.fd.io/r/c/vpp/+/21490
Change-Id: I7d7425e8db3bf60ea3d9d7936ed3109c76247457
Signed-off-by: Jan Gelety <jgelety@cisco.com>
premkumarv [Wed, 24 Jul 2019 12:43:23 +0000 (08:43 -0400)]
CSIT-1471: Policer - VAT API to PAPI
Change-Id: I6c7eff8d9cbb196ccb684a45579ac59942351cfe
Signed-off-by: premkumarv <preym17@gmail.com>
Vratko Polak [Wed, 25 Sep 2019 14:52:35 +0000 (16:52 +0200)]
Update flag day document
Prevent false -1 from api-crc job.
Add more details on CSIT side of things.
Minimize the breakage of trending jobs.
Also: Add motivation section explaining
why earlier solutions are not good enough.
- Needs more polishing.
- VPP/CSIT, Committer/Developer can be defined in a separate section.
- VPP/CSIT trending and verify jobs can be defined in a separate section.
- The main process section should list only steps.
- Comments on which jobs are broken/fixed can be moved to a separate section.
- Name phases, so progress can be described better than "step 9".
- Emphasize that only one API change can be in the process.
All other changes need to be rebased (to clear any previous +1)
before next cycle starts.
Change-Id: Ie64a20db3f4abad3c8cddbf13705ff006e5a6382
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Dave Wallace [Mon, 18 Mar 2019 02:05:11 +0000 (22:05 -0400)]
Proposal to automate VPP-API "Flag Day"
Change-Id: I7bfce00762017b1aa8fd91ce1c8e4c0b810ee7b7
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Tibor Frank [Fri, 27 Sep 2019 07:20:27 +0000 (09:20 +0200)]
Report: Fix: Legend in reconf tests
Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Sep 2019 11:37:16 +0000 (13:37 +0200)]
Report: Reconf tests: set autorange for y axis
Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 13 Sep 2019 08:22:11 +0000 (10:22 +0200)]
Add support for HDRhistogram
+ Enable hdrh in trex server.
+ Append hdrh coded output after min/avg/max/.
+ Read (not show nor decode) hdrh value in PAL.
+ Also, remove old ndrpdrdisc code.
Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 23 Sep 2019 13:00:00 +0000 (15:00 +0200)]
Reconf tests: Fix async measurements
TRex does not zero the server counters.
It copies the values to use as reference,
and subtracts them when asked for results.
But the reference is stored in the client (not the server).
And CSIT uses different scripts to start and stop async traffic,
which means different clients.
This patch introduces a workaround.
Async start will return xstats objects to use as reference,
and async stop will use the objects to compute the correct results.
The xstats objects are stored in TrafficGenerator instance.
Sync measurement does not export the counters, to shorten logs.
Other improvements:
+ Make stop_traffic_on_tg return measurement results directly.
+ Rename --async to --async_start as "async" is reserved in Python 3.7
+ Minor pylint, docstring and typo fixes.
Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 18 Sep 2019 09:42:08 +0000 (11:42 +0200)]
PAL: Fix unit for packets lost
+ update the static content
Change-Id: I8c4852195e09d7b00555ebb4a7378743c3df45f2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Nidhy [Thu, 19 Sep 2019 17:35:33 +0000 (10:35 -0700)]
Fixing typo tag_documentation for LISP
Change-Id: Idd715cb0d3e6b60c660b95ac618e8e114419491b
Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
Vratko Polak [Fri, 20 Sep 2019 10:32:02 +0000 (12:32 +0200)]
Bump stable_vpp and fix CRC list
+ Two API merges happened on VPP side, CSIT list was prepared wrong.
+ Removed the secondary collection, as no open change is supported.
Change-Id: I2e2472c8a2fe50190c11c7441982aa2881e9b8a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Nidhy [Sat, 31 Aug 2019 12:53:12 +0000 (12:53 +0000)]
LISP: 3-node (func) to 2-node (dev) converstion
Change-Id: I0fbe4d9ef1b30a1ac1382ea43b5b52aeb8a7d39f
Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
Jan Gelety [Thu, 12 Sep 2019 21:55:37 +0000 (23:55 +0200)]
CSIT-1597 API cleanup: cop
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458
Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 18 Sep 2019 14:42:22 +0000 (16:42 +0200)]
Report: Fix formating of static content for reconf tests
Change-Id: I5b93749b13af870955c1cf9eb8053c446356c329
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 13 Sep 2019 13:40:54 +0000 (15:40 +0200)]
Fix errors found by pylint
Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 18 Sep 2019 08:40:17 +0000 (10:40 +0200)]
Report: Add disclaimer for reconf tests
+ Improve description for reconf tests
Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 17 Sep 2019 07:23:07 +0000 (09:23 +0200)]
Report: Enable pdf version
Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 17 Sep 2019 11:00:39 +0000 (13:00 +0200)]
Update CRC list and support 21997/7
- Attempt to repair IPsec LispGpe perf suite.
+ Collection name to reflect the current stable vpp.
+ Add messages found in CSIT L1 keywords.
- Uncommented (instead of deleted) untestable messages. Reasons:
- Honeycomb.
- Messages used by unused keywords.
+ Listed reasons. Honeycomb not mentioned if both reasons apply.
+ Delete CRC items for commands not found in keywords anymore.
+ Add CRCs from .json.api files (as teardown is hard to execute).
+ Define and restore alphabetical order.
+ Add hints to find used API commands (not entirely reliable).
+ Move used commands to "cmd = " form so hints find them.
+ Argument to run_cli_command changed from "cmd" to "cli_cmd".
+ Except also struct.error where IOError is excepted.
Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 17 Sep 2019 09:15:03 +0000 (11:15 +0200)]
Report: Fix Report History
Change-Id: I654677ca9252e592e635eab28577bb3bb3b8bf85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 17 Sep 2019 07:07:06 +0000 (09:07 +0200)]
Report: Update Report History
Change-Id: Ie16a2f2298eeaf0793171c7268a95abb6986246a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 16 Sep 2019 16:34:29 +0000 (18:34 +0200)]
Report: Add methodology for reconf tests
Change-Id: I833d63f4e305ba60c94aa16cbb3a31a52ee3b3bb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 16 Sep 2019 14:54:43 +0000 (16:54 +0200)]
Trending: Fix removing of old input files
Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 16 Sep 2019 10:03:52 +0000 (12:03 +0200)]
Trending: Reduce input data
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 13 Sep 2019 08:17:08 +0000 (10:17 +0200)]
Report: Add data
Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 13 Sep 2019 08:22:29 +0000 (08:22 +0000)]
Add: AVF IPv6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6cb4ef356047bdc341a70a4e7b8d0b3f54eb7f9d
Peter Mikus [Fri, 13 Sep 2019 08:13:09 +0000 (08:13 +0000)]
FIX: Pylint + Container mount
- Mount is affecting only LXC container
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84
Tibor Frank [Fri, 13 Sep 2019 11:53:23 +0000 (13:53 +0200)]
Report: Fixes
Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 12 Sep 2019 13:45:31 +0000 (15:45 +0200)]
CRC checker: Sort and indent dict output
Also, use double quotes, so the dict is shown
not only as a valid Python code, but also a valid JSON.
This should make it easier to handle big CRC changes such as:
https://logs.fd.io/production/vex-yul-rot-jenkins-1
/vpp-csit-verify-api-crc-master/646/console.log.gz
+ Log indented message about CRC conflict to console even on failure,
as in the exception, endlines are escaped.
Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 13 Sep 2019 06:56:08 +0000 (08:56 +0200)]
Report: Add data
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Code Review / csit.git / log