Tibor Frank [Tue, 27 Mar 2018 11:07:17 +0000 (13:07 +0200)]
Trending: Set the start build number to 15.
Change-Id: If1603fb8d39c339caf9c49015a63e2910f98e292
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 27 Mar 2018 08:29:52 +0000 (10:29 +0200)]
PAL trending: Trending line
Change-Id: I46309f53365b9335fc93bcecdf293bca07a0e51d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 26 Mar 2018 08:27:22 +0000 (10:27 +0200)]
FIX: Catch exeption in start-testcase
Catch all exceptions by default if removing scratch directory is not
successful. This prevents further confusion about NFS permissions as
this is not the root cause of script failure.
Change-Id: I0f775bb38e98cf69b4ce277b6e0dda4dad0a8732
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Mon, 26 Mar 2018 14:34:51 +0000 (16:34 +0200)]
Report: Fix packet_throughput_graphs/ip4
Change-Id: I3943d02dcca95ed31baaa104648589c42ef479a7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Mar 2018 13:33:31 +0000 (15:33 +0200)]
Report: Detect outliers for the comparative tables
Change-Id: Ia1be590a720df71ff51e8a7ca910ed27a4642209
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Mar 2018 12:56:57 +0000 (14:56 +0200)]
Report: Detect outliers for the comparative tables
Change-Id: I2bbb2c4e18f456da9b8d62b6654d7e23fe36ee58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Mar 2018 12:14:43 +0000 (14:14 +0200)]
Report: Detect outliers for the comparative tables
Change-Id: I87f7f239560544261e21d36d020c56dda0e601fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Mar 2018 12:01:30 +0000 (14:01 +0200)]
Add IPSec tests
Change-Id: Ie1ddc6189a68a299207fe9158d1be8409ec2bc6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 22 Mar 2018 12:21:05 +0000 (13:21 +0100)]
Optimize Qemu installation to speed up vhost tests
Currently Qemu is being installed if there is a change of qsz parameter
between tests/suites. Qemu is installed always into the same directory. This
patch changes the default behavior to install qemu over and install
pathced version to separate directory. It also disables force install.
Change-Id: I0d7493a02b026a6ae4a5ea8bacf54656de9db567
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Mon, 26 Mar 2018 09:02:54 +0000 (11:02 +0200)]
CSIT-919: Jenkins job
Change-Id: I8ed4a8e135ebbebc7799a633872a50293eb410af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Mar 2018 07:12:36 +0000 (09:12 +0200)]
Add lastCompletedBuild option to the spec
Change-Id: I4432e626a7bc81be2cede56da6a3660450f09c01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Mar 2018 06:25:30 +0000 (08:25 +0200)]
CSIT-919: Jenkons job
- return correct return value
Change-Id: I761593b90336ef3926e157c068982713ea3fe71f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 23 Mar 2018 11:10:35 +0000 (12:10 +0100)]
CSIT-1004: Generate csv and txt tables with trending and statistical data
Change-Id: I50ba76c06621a9a293a5327b5b7709e4df6a4756
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 23 Mar 2018 08:32:01 +0000 (09:32 +0100)]
CSIT-949: Data models
Change-Id: I07d0b122632c15fa07a5871dc268d654f410ef4f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 22 Mar 2018 15:48:11 +0000 (16:48 +0100)]
CSIT-1005: Add ipsec MRR tests
+ 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-aes-gcm-mrr.robot
+ 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-mrr.robot
+ 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-mrr.robot
+ 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-mrr.robot
+ 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-mrr.robot
+ 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-mrr.robot
Do not add test cases for 9000B framesize yet.
Improve other suites to keep the style consistent.
Change-Id: I03a58e8d6745083e267b9d53bb3b85efcb2ea827
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 22 Mar 2018 14:15:45 +0000 (15:15 +0100)]
CSIT-913: Continuous Trending, Analysis and Change Detection
- CSIT-949: Add new plots
- CSIT 951: Add new plots
Change-Id: I09440df5209e3207339a8a9509c084da16f06356
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 22 Mar 2018 12:57:51 +0000 (13:57 +0100)]
Update sr_steer_add_del.vat template
Change-Id: I7b7fd3a8815cf33fa50ca5f3f7a9128edef8b827
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 20 Mar 2018 15:25:31 +0000 (16:25 +0100)]
FIX: check OS on DUT instead on host
CSIT-1010
Change-Id: I21303c22a50c0fe7914f769aca61ef350287ccb5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Thu, 22 Mar 2018 06:11:04 +0000 (07:11 +0100)]
Add 78B tests to MRR trending daily
Change-Id: I73b9c505dcd28361978a075bc81db3112e308b9c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Marek Gradzki [Wed, 21 Mar 2018 15:04:14 +0000 (16:04 +0100)]
HC Tests: adapt sub-interface tests to recent api changes (HC2VPP-289)
Follows:
https://gerrit.fd.io/r/#/c/11228/
Change-Id: If1a281fc04c3b8015519c97788e1dae213e74b0e
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Tibor Frank [Thu, 1 Mar 2018 13:52:47 +0000 (14:52 +0100)]
CSIT-913: Continuous Trending, Analysis and Change Detection
- CSIT-915: LLD
- CSIT-917: Functions to evaluate the results according to the PASS / FAIL criteria
- CSIT-918: Sphinx configuration
- CSIT-948: Statistical functions
- CSIT-949: Data models for trending plots
- CSIT-950: Code trending plots
- CSIT-951: Static content
- CSIT-984: PAL Specification file
- CSIT-996: Download data from nexus
Change-Id: Icb9305945bb0f142135bb177cb8781ba0096280e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 19 Mar 2018 07:48:41 +0000 (08:48 +0100)]
CSIT-998: MRR tests
- CSIT-1001: MRR tests: IP4
- ip4
- 10ge2p1x520-ethip4-ip4base-copwhtlistbase-mrr.robot
- 10ge2p1x520-ethip4-ip4base-iacldstbase-mrr.robot
- 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-mrr.robot
- 10ge2p1x520-ethip4-ip4scale200k-mrr.robot
- 10ge2p1x520-ethip4-ip4scale20k-mrr.robot
- 10ge2p1x520-ethip4-ip4scale2m-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-nat44-mrr.robot
- 10ge2p1x520-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot
- 40ge2p1xl710-ethip4-ip4base-mrr.robot
- ip4_tunnels
- 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-mrr.robot
- 10ge2p1x520-ethip4vxlan-l2xcbase-mrr.robot
- 10ge2p1x520-ethip4lispip4-ip4base-mrr.robot
Change-Id: Ibfd03aea9b97d29a8fa05e2956f6df54603a2208
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 21 Mar 2018 07:23:24 +0000 (08:23 +0100)]
Fix bug in dpdk-testpmd-mac KW
Change-Id: I6711e186062a72700552418eeee11b031e8c8ce4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Thomas F Herbert [Sun, 18 Mar 2018 16:11:21 +0000 (12:11 -0400)]
Fix for pypcap import problem.
JIRA: CSIT-991
This fix forces the downloads of the complete package for all the pip python
packages to be installed on Centos regardless of the Python metadata on
the host.
Change-Id: I9f5b9faf75306c2b0ae34ca640bc5f36811f900c
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
Tibor Frank [Wed, 21 Mar 2018 07:34:06 +0000 (08:34 +0100)]
MRR Daily: Run only 64B tests
Change-Id: I61bb0c785fcc1407b80ce8019df69e64a3e4eb9e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 20 Mar 2018 08:54:09 +0000 (09:54 +0100)]
Add max-pkt-len parameter to dpdk testpmd start
Change-Id: I114c187f007c10223502669c2ba85c63d09cd84a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Marek Gradzki [Mon, 19 Mar 2018 20:12:03 +0000 (21:12 +0100)]
HC Tests: move honeycomb tests out of vpp directory
https://gerrit.fd.io/r/#/c/9257/ moved VPP instalation
to vpp/func/__init__.robot,
which is run before Honeycomb suite.
Instalation process starts with removing all vpp packages,
which fails because of honeycomb dependency installed by bootstrap script.
This patch fixes HC func jobs by moving them to separate dir.
The honeycomb/func/__init__.robot was updated
to include previous content of vpp/func/__init__.robot.
HC perf jobs were also moved,
but they may require additional care (CSIT-1006).
Change-Id: I99d94272c80a4c57c85ec5cf99cddfbeab7de663
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Tibor Frank [Tue, 20 Mar 2018 07:19:53 +0000 (08:19 +0100)]
Update the list of disabled pluggins
Change-Id: I089416953f5c3292358e443c806987dddce1c0d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Neale Ranns [Sun, 18 Mar 2018 14:49:25 +0000 (07:49 -0700)]
No overlapping subnets between DUT/TG and DUT/VM
Change-Id: Ib6a2921070f3524b001ecea2467b28264288fee3
Signed-off-by: Neale Ranns <nranns@cisco.com>
Tibor Frank [Mon, 19 Mar 2018 09:03:12 +0000 (10:03 +0100)]
CSIT-935: Add mrr 9000B and 4t4c tests
CSIT-1002: container_memif
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-2memif-1dcr-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-2memif-1lxc-mrr.robot
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
- 40ge2p1xl710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot
CSIT-1003: vm vhost
- 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot
- 10ge2p1x520-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot
- 10ge2p1x520-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot
- 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 40ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot
Change-Id: Idd049db6134179f0f9ed603569ec8512faca1ab9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 19 Mar 2018 12:45:47 +0000 (13:45 +0100)]
FIX: remove all vpp packages installed
Change-Id: I1a2e51fada2f16fb236499a5cbff735f5e08aae2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Mon, 19 Mar 2018 07:51:50 +0000 (08:51 +0100)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
18.04-rc0~
425-g039cbfe~b3921_amd64
- use new vpp ref build - centos7:
18.04-rc0~425_g039cbfe~b3910.x86_64
Change-Id: Id8c7e767b67b9dc8ad7c5ae129279df5d13f6466
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Thu, 15 Mar 2018 06:48:09 +0000 (07:48 +0100)]
CSIT-998: MRR tests
- CSIT-999: MRR tests: L2
- 10ge2p1x520-eth-l2xcbase-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-mrr.robot
- 10ge2p1x520-dot1q-l2bdbasemaclrn-mrr.robot
- 10ge2p1x520-dot1q-l2xcbase-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot
- 10ge2p1x520-eth-l2bdscale100kmaclrn-mrr.robot
- 10ge2p1x520-eth-l2bdscale10kmaclrn-mrr.robot
- 10ge2p1x520-eth-l2bdscale1mmaclrn-mrr.robot
- 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot
- 40ge2p1xl710-eth-l2bdbasemaclrn-mrr.robot
- 40ge2p1xl710-eth-l2xcbase-mrr.robot
- CSIT-1000: MRR tests: IPv6
─ 10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot
- 10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot
─ 10ge2p1x520-ethip6-ip6scale200k-mrr.robot
─ 10ge2p1x520-ethip6-ip6scale20k-mrr.robot
─ 10ge2p1x520-ethip6-ip6scale2m-mrr.robot
─ 40ge2p1xl710-ethip6-ip6base-mrr.robot
Change-Id: Ie42b08151b5da3ba32b972af8b6bedf313c6d29c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 14 Mar 2018 15:59:04 +0000 (16:59 +0100)]
Add vhost and memif MRR suite
Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Andrej Kilvady [Thu, 26 Oct 2017 11:46:18 +0000 (13:46 +0200)]
VPP install and verify in __init__.robot
Move VPP installation to separate test in test suite setup phase
to clearly indicate any issue with VPP installation.
Added test to check VPP responsiveness after installation.
Change-Id: Idc2c78152e23aa7301bb5dbf9b1b6f4b639c3e84
Signed-off-by: Andrej Kilvady <andrej.kilvady@pantheon.tech>
Peter Mikus [Tue, 13 Mar 2018 08:03:07 +0000 (09:03 +0100)]
Robot logs archiving for trending jobs
- Add output.xml auto-archiving to logs.fd.io.
- Cleanup from obsolete code.
Change-Id: Iafa9ef802264d2ad36ca0f556cb14d2b3ca0f179
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Marek Gradzki [Tue, 13 Mar 2018 07:19:26 +0000 (08:19 +0100)]
HC Tests: disable NSH plugin
NSH artifacts in Nexus are outdated and crash VPP.
Reenable NSH after it is fixed (CSIT-994).
Change-Id: I3a0367682d62d5ccdbf008336ed682e7ab9032a0
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Peter Mikus [Mon, 12 Mar 2018 08:16:52 +0000 (09:16 +0100)]
Optimize VPP restart after startup.conf change
Change-Id: Iabe7de5d598f904bd7e691c3ffed1d07ed0c7f68
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 12 Mar 2018 08:00:27 +0000 (09:00 +0100)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file
- use new vpp ref build - ubuntu 16.04:
18.04-rc0~
377-g03f47f1~b3869_amd64
- use new vpp ref build - centos7:
18.04-rc0~377_g03f47f1~b3862.x86_64
- use new dpdk version:
18.02-vpp1
Change-Id: Ic2bf4850caec109f7d588afedb8eec0c76ab8d3a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 7 Mar 2018 14:06:47 +0000 (15:06 +0100)]
CSIT-989 Fix: Reflect latest memif API changes
Change-Id: I0c9cb073a42a8b4b7e573023e784ab9e72d0ad55
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Tue, 6 Mar 2018 13:09:39 +0000 (13:09 +0000)]
CSIT-988: Add libmbedcrypto0 as a new vpp dependency
Add libmbedcrypto0 to the list of installed packages on Physical testbeds + VIRL images
Change-Id: Ied68b79a36d0b6c8619aa22effeac30e5f3c0cf6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 7 Mar 2018 16:03:18 +0000 (16:03 +0000)]
FIX: Bootstrap.sh for functional VIRL jobs
- Fix the path of temporary result files to workspace instead of
/run/shm
Change-Id: I4819ef5d6371412a91b6736aa36b223df38eacac
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Tue, 6 Mar 2018 13:38:44 +0000 (13:38 +0000)]
CSIT-988: Fix functional bootstrap
Change-Id: I6fb16e799e991ce01e9f997a05c4be72a26ce3af
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 7 Mar 2018 09:06:36 +0000 (09:06 +0000)]
FIX: MRR IPv6 tags
Change-Id: I2ca83b4405cd537671bf16fc57500be91455eadc
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Tue, 6 Mar 2018 12:58:42 +0000 (12:58 +0000)]
Fix: Remove api-segment from default startup config
Remove api-segment from default startup.conf for
performance tests.
Change-Id: I8f126faf3d923d36b1be2f2e0e676b07c072f1f3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sat, 10 Feb 2018 06:54:28 +0000 (07:54 +0100)]
Convert behavior-driven to data-driven IPv4
- Align test cases to data driven style for IPv4
Change-Id: Ie8fafaf7ba585e89feee417af96aa95d7ba4b4f9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 28 Feb 2018 09:13:12 +0000 (10:13 +0100)]
Performance KW optimizations II
Currently Binary Search is using TRex warmup time for every lookup
trial. This patch is suppose to optimize Binary Search to not use
warmup time for each trial apart from first one.
Change-Id: I9b914cfac3ce558557133c266335c1f550c0b52a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Thu, 8 Feb 2018 08:46:20 +0000 (09:46 +0100)]
PAL: Clean the code
Change-Id: I7aa196cdc7bf4d34c1313f8f811ab3f6dd8f10f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 27 Feb 2018 08:35:21 +0000 (09:35 +0100)]
Update of VPP_STABLE_VER files + fix Centos dep list
Change-Id: Icd149927c6b2893f8f716df29d8de475e809be49
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Fri, 23 Feb 2018 09:04:26 +0000 (10:04 +0100)]
Performance KW optimizations
- Reducing test time by removing redundant KW.
Change-Id: I03eeb0332cb88a11eff06df6f5e79d905df317a2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Marek Gradzki [Thu, 22 Feb 2018 06:46:09 +0000 (07:46 +0100)]
Adapt hc2vpp-csit bootstrap scripts to HC2VPP-285/CIMANAGE-22
Since
https://gerrit.fd.io/r/#/c/10668/
and
https://gerrit.fd.io/r/#/c/10669/
honeycomb packages from stable branches
no longer depend on single VPP version.
This patch updates download_hc_pkgs.hc script,
used by hc2vpp-csit jobs, to use the latest honeycomb package
in such case.
Change-Id: If5b006e72caa8cc905137b1bf02af7d9e927e37a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Peter Mikus [Mon, 12 Feb 2018 06:39:16 +0000 (07:39 +0100)]
FIX: LXC/DOCKER exclusive CPU
By default the cpuset cgroup is using exclusive CPU/MEM. When Docker
container is initialized a new cgroup /docker or /lxc is created under
cpuset parent tree. This newly created cgroup is inheriting parent
setting for cpu/mem exclusive parameter and thus cannot be overriden
within /docker or /lxc cgroup. This patch is supposed to set cpu/mem
exclusive parameter for both parent and subgroup.
Change-Id: I14b44db3f77c842756ec78aa60df7aca508d9545
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Tue, 20 Feb 2018 13:57:59 +0000 (14:57 +0100)]
Raw results chk keywords and initial TC
- Implementation of Display raw results
- Implementation of Traffic should pass with maximum rate
- Code optimizations
- L2BD, L2XC, IP4, IP6 TC
Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 22 Feb 2018 10:05:01 +0000 (11:05 +0100)]
FIX: Qemu path override
Currently there is bug that Qemu path is not correctly composed and
cannot be properly overriden due to race condition in code. This patch
is fixing functions to properly work with path.
Change-Id: I276458d2d23c7a14441a4de4a56eff6431242ab9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 21 Feb 2018 15:51:32 +0000 (16:51 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I0379d0e62e4ae3065fc8181e6d7140bd81858d7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 21 Feb 2018 12:20:48 +0000 (13:20 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I75fc2e4497d9cc57417c9205768c11d19403c9c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 21 Feb 2018 10:00:15 +0000 (11:00 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I1f5f7e931cdbd4eb9ede9b2cc527d975c63684ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 21 Feb 2018 08:48:39 +0000 (09:48 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Id178e852e4c94b1e093d72901689a7f7820c2c3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 21 Feb 2018 08:12:18 +0000 (09:12 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I4c22c9e82bb746917198e345409eea3e0e322bbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 20 Feb 2018 13:35:49 +0000 (14:35 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Ia798986b14330c7e70d65d6123292a7eed6e3d7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Tue, 20 Feb 2018 13:12:10 +0000 (13:12 +0000)]
rls1801: updated known issues in rls notes for vpp performance.
Change-Id: I8f4a08933dc27db8f4f2134cdd9ddadbcd790577
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Tue, 20 Feb 2018 11:43:54 +0000 (12:43 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Ifd1bcbf376e9eff9afbb578d88df377ba301cafa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Marek Gradzki [Tue, 20 Feb 2018 06:29:48 +0000 (07:29 +0100)]
HC CSIT Report: post 1801 release cleanup
This reverts https://gerrit.fd.io/r/#/c/10391/
(commit
076ad4996ca921a0fb675a8a79d1248c6fccc452).
CSIT 1801 report was published, so there is no need to keep
master and rls1801 in sync.
Change-Id: Ib2887dced4de013a459d08b5dcc2c39410e92718
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Tibor Frank [Tue, 20 Feb 2018 05:39:21 +0000 (06:39 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I86f5bcbe4c5cd12ddccba5ae6f4df73c139a359c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 19 Feb 2018 13:35:26 +0000 (14:35 +0100)]
Update report section with VPP startup conf
Change-Id: I074b557cb8dcd6013c388eed7548e170644a89d0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Mon, 19 Feb 2018 14:35:18 +0000 (15:35 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Id8a90708bf51e5c1df7bc91d3947e023d23b842a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Mon, 19 Feb 2018 14:16:30 +0000 (14:16 +0000)]
rls1801 report: edits to static content for vpp and dpdk perf sections.
Change-Id: I22a38d2704b3a414798823c1846ff12f8f69d7b7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Mon, 19 Feb 2018 14:08:10 +0000 (15:08 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Ia1a1187c468d0fb57ee6160e633adb38512f0ad7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 19 Feb 2018 11:39:50 +0000 (12:39 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I507878dba5eea9eff70336143cdcdd735b631898
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 19 Feb 2018 10:12:55 +0000 (11:12 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I632af9dafbadd12091c9063b098bb2db742780ec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 16 Feb 2018 13:48:14 +0000 (14:48 +0100)]
FIX: Ligato tests
- update binary search
- update VPP agent ver
Change-Id: If93346f43fabc8afac28b1dcfa5c44433d53a1a4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Mon, 19 Feb 2018 05:45:50 +0000 (06:45 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I2fd8fff455f419ef32a3562e77202278094482b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 16 Feb 2018 12:13:51 +0000 (13:13 +0100)]
CSIT-932: Remove outliers form statistical calculations
Change-Id: Ibd90931bdc3dd8615fe2c975935c8a54fe85e6c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 16 Feb 2018 09:52:19 +0000 (10:52 +0100)]
CSIT-932: Remove outliers form statistical calculations
Change-Id: If9b8eaa4d997ad3516c27befb4a868a948567482
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 16 Feb 2018 08:44:13 +0000 (09:44 +0100)]
CSIT-932: Remove outliers form statistical calculations
Change-Id: I95934c92b2ebc77e5e3e7696d318ee8416f848e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 16 Feb 2018 07:53:37 +0000 (08:53 +0100)]
CSIT-932: Remove outliers form statistical calculations
Change-Id: I80d412e01eef364dfd76c1961a754e787f6ca7f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 16 Feb 2018 06:58:15 +0000 (07:58 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Icda3dd888016a7074902ec6690cc7e874f46df2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 15 Feb 2018 13:47:51 +0000 (14:47 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Iaf362be95b882b23fdaf478260e058b0495bbf5d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 15 Feb 2018 12:37:55 +0000 (13:37 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I30b48ea252d11677d74daba2516a9ffbcd39bd94
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 14 Feb 2018 11:46:56 +0000 (12:46 +0100)]
FIX: Change memif API for latest master
Change-Id: I34c656c79647aece1880e64058365ecf1a9ebf56
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Dave Wallace [Fri, 19 Jan 2018 17:33:11 +0000 (12:33 -0500)]
Fix typo in container doc ref label
Change-Id: I0cd7ad0a1cc4d990d739a80bd3e611ec92d8166e
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Tibor Frank [Thu, 15 Feb 2018 11:33:25 +0000 (12:33 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I293e0df53a03fd18905ba59258fa66afa1299058
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 15 Feb 2018 09:04:34 +0000 (10:04 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Icd9a1c7bf821c54d0297ad52dabdfb345730ddc6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 15 Feb 2018 08:04:57 +0000 (09:04 +0100)]
CSIT-891: Add data sources for 1801 reportCSIT-891: Add data sources for 1801 reportCSIT-891: Add data sources for 1801 reportCSIT-891: Add data sources for 1801 report
Change-Id: I6334705f14c3515c0907b28abf468eef517a7dfa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 15 Feb 2018 07:25:48 +0000 (08:25 +0100)]
FIX: 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot
- tc17-9000B-4t4c-eth-l2bdscale100kmaclrn-ndrdisc
Change-Id: I605f4903deb07f3a29944348cb32ac0a6747cb09
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Thu, 15 Feb 2018 07:15:03 +0000 (08:15 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I3a7ec5d40756b2179426cf031e88a0e01c2833cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 15 Feb 2018 06:28:06 +0000 (07:28 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Ib5d2fce665fbc421affde4fe1500ca8cf02613f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 14 Feb 2018 14:02:17 +0000 (15:02 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I1403ec2e72f2369c39033cbf3e54070d3e854bae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 14 Feb 2018 13:18:03 +0000 (14:18 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I239a95dddcf2946a289fc4e91071fdbd6cc6573c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 14 Feb 2018 08:28:16 +0000 (09:28 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Ie47f696401ec4286ff875d7dc291251e505d0a46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 14 Feb 2018 07:28:38 +0000 (08:28 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I269a26c67b9e567007909438c221c58312458e61
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 13 Feb 2018 09:43:08 +0000 (10:43 +0100)]
Increase virl2 and virl3 servers IP capacity in bootstrap.sh
Change-Id: Ia64bfdbcc1ea5218a7b3b6708ad75662129a46cc
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Tue, 13 Feb 2018 13:26:03 +0000 (14:26 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I208ac7a2637181a0e8594845901037d31c09e602
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 13 Feb 2018 12:25:25 +0000 (13:25 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Id7b5bfef12be00dab4434a1c999c7382985b0d57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 13 Feb 2018 12:09:09 +0000 (13:09 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: Ic54ad8fc093ee37d3f972fd220d63e3b20915e28
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 13 Feb 2018 11:07:58 +0000 (12:07 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I8c37cff547c74399fde074b11972e2fb95bfac15
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 12 Feb 2018 12:36:34 +0000 (13:36 +0100)]
CSIT-891: Add data sources for 1801 report
Change-Id: I320737f2edbf74caa8f12177dcc7186a88920a9a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 12 Feb 2018 06:12:47 +0000 (07:12 +0100)]
FIX: Missing KW in suite setup
Change-Id: I278cb8a5381735694bad73031e534b080414305b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Fri, 9 Feb 2018 12:09:09 +0000 (13:09 +0100)]
Disable all plugins except DPDK by default
- enable corresponding plugin for ACL, NAT, MEMIF tests
Change-Id: Ie8bfdcbf1734283b6412ef3015215a00ce3ebdf6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 9 Feb 2018 06:47:48 +0000 (07:47 +0100)]
Update the binary steps for perf test cases.
- Reduce binary step fof:
64B -> 50Kpps
1518B -> 50Kpps
9000B -> 10Kpps
IMIX -> 50Kpps
Change-Id: Id88bff7b1c37b2a03583dd27ca3db720ec7ae4a2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Code Review / csit.git / log