csit.git
4 years agoReport: Add latency for 2n-skx 74/25874/1
Tibor Frank [Fri, 13 Mar 2020 17:17:01 +0000 (18:17 +0100)]
Report: Add latency for 2n-skx

Change-Id: I1d664531c94168f4eb135fc56e497c7c77291605
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: hide 2n-skx NDR data 66/25866/3
Tibor Frank [Fri, 13 Mar 2020 16:05:59 +0000 (17:05 +0100)]
Report: hide 2n-skx NDR data

Change-Id: Iee860b33338cfe60ba04081b9bd6cb6b685adb9b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUse separate module for ip address object 60/25860/2
Jan Gelety [Wed, 11 Mar 2020 02:16:24 +0000 (03:16 +0100)]
Use separate module for ip address object

Reason: with upcomming vpp api changes the ip object will be used
in more csit python libraries, e.g. InterfaceUtil.py, so we need
to avoid circular import issue
(e.g. InterfaceUtil.pyu <-> IPUtil.py)

Change-Id: Ia658b187d4e326f58e33019dd54f8ac7b9137d78
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Add Current vs. Previous for 2n-skx 62/25862/1
Tibor Frank [Fri, 13 Mar 2020 15:54:32 +0000 (16:54 +0100)]
Report: Add Current vs. Previous for 2n-skx

Change-Id: Iaf4a86cdc1e572b60e360540b48cf677cb7ff440
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add 2n-skx 48/25848/3
Tibor Frank [Fri, 13 Mar 2020 12:29:01 +0000 (13:29 +0100)]
Report: Add 2n-skx

- perf sel

Change-Id: I7809f2ba96a3bd1f985300482e87627dd4865c35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Remove skx NDR from detailed test results 93/25793/4
Tibor Frank [Wed, 11 Mar 2020 13:11:16 +0000 (14:11 +0100)]
Report: Remove skx NDR from detailed test results

Change-Id: I47cd491c44bd259c69c758aac600bfe94d59538f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agorls2001 perf: fix hoststack test packet sizes 24/25724/10
Dave Wallace [Fri, 6 Mar 2020 18:15:26 +0000 (18:15 +0000)]
rls2001 perf: fix hoststack test packet sizes

- TCP packet size is 1460B not 9000B
- QUIC packet size is 1280B not 9000B

Change-Id: I6604a74fa533db4ac782782c85ea54038688627a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoCSIT-1597 API cleanup: policer 17/25817/4
Jan Gelety [Tue, 10 Mar 2020 11:17:30 +0000 (12:17 +0100)]
CSIT-1597 API cleanup: policer

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25566
- update vpp stable to version 20.05-rc0~327

Change-Id: I6af2e4e21c9190e87a63c5a9c8529bbc7f8adf1a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAPI: Add collection for 25566/5 07/25807/1
Jan Gelety [Tue, 10 Mar 2020 10:50:23 +0000 (11:50 +0100)]
API: Add collection for 25566/5

Change-Id: Id5bbd395304c391493dc46a6c82fe395f14340ae
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Add 2n-clx IPv4 RND 02/25802/1
Tibor Frank [Wed, 11 Mar 2020 16:20:23 +0000 (17:20 +0100)]
Report: Add 2n-clx IPv4 RND

Change-Id: Ibe7b8ee88de2366beeadb217d6111a25483c23bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: typo in VppCounters.py 95/25795/1
Jan Gelety [Tue, 10 Mar 2020 07:16:44 +0000 (08:16 +0100)]
FIX: typo in VppCounters.py

Change-Id: I4b5955af9732dd3ef185a618ffcf939d0a05ac17
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Configure Report 2001.12 82/25782/2
Tibor Frank [Wed, 11 Mar 2020 05:09:43 +0000 (06:09 +0100)]
Report: Configure Report 2001.12

Change-Id: I3d19380a12016ee65711d4e92c3cfbc109a2e18f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Counters 83/25783/3
Peter Mikus [Wed, 11 Mar 2020 11:00:17 +0000 (11:00 +0000)]
FIX: Counters

Change-Id: Ib7eeea5338491b4bd9ecd96b30da95f5dc116937
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: Enable pdf version 74/25774/1
Tibor Frank [Tue, 10 Mar 2020 18:58:49 +0000 (19:58 +0100)]
Report: Enable pdf version

Change-Id: Icbad3b13088db197fd852b05f90b58fe7f2d8f0a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1597 API cleanup: ipsec 67/25767/2
Jan Gelety [Thu, 12 Dec 2019 22:32:05 +0000 (23:32 +0100)]
CSIT-1597 API cleanup: ipsec

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25529
- update vpp stable to version 20.05-rc0~312-g287d5e109

Change-Id: I6c7b3520f4bb306c3b0b59247b4ba2d5f170686c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoRegenerator: Fix pylint errors 72/25672/3
Tibor Frank [Thu, 5 Mar 2020 07:40:09 +0000 (08:40 +0100)]
Regenerator: Fix pylint errors

Change-Id: I91458b897003f5d8f7f7ac9214aa824c113cecea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAnsible: LTS support 51/25551/5
Peter Mikus [Fri, 28 Feb 2020 15:26:06 +0000 (15:26 +0000)]
Ansible: LTS support

- There is currently no other way to support multiple version of
playbooks.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2ade4a57d726b793e422996e83bf767ac4315488

4 years agoMake RXQs/TXQs configurable 40/25740/4
Peter Mikus [Fri, 28 Feb 2020 07:13:27 +0000 (07:13 +0000)]
Make RXQs/TXQs configurable

Change-Id: Ib30bc4697fcba93a6723ee492a59a0523425f623
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAPI: Add collection for 25529/2 48/25748/5
Jan Gelety [Thu, 12 Dec 2019 22:29:40 +0000 (23:29 +0100)]
API: Add collection for 25529/2

Change-Id: Iac159cb60d4afbc23fc7edffefd82fc3e2a64940
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoClean up long lines in nsim.robot 50/25750/3
Dave Wallace [Mon, 9 Mar 2020 17:37:04 +0000 (13:37 -0400)]
Clean up long lines in nsim.robot

Change-Id: Ic9def0376ecb49c12e63aafa747fcc524ebb79c2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoFix on 2n suite 38/25738/2
Vratko Polak [Mon, 9 Mar 2020 12:50:44 +0000 (13:50 +0100)]
Fix on 2n suite

Wrong tag said it is 3.

Change-Id: I3ea6ffbec3e38a11b721318266bcb2ea451d2d5a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoCSIT-1597 API cleanup: l2 84/23984/5
Jan Gelety [Thu, 12 Dec 2019 19:50:15 +0000 (20:50 +0100)]
CSIT-1597 API cleanup: l2

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22970
- update vpp stable to version 20.05-rc0~307

Change-Id: I3b4c69ee60b0add12edeb8d5e6ac6006b519593b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Detailed test results 15/25715/28
Tibor Frank [Fri, 6 Mar 2020 11:59:01 +0000 (12:59 +0100)]
Report: Detailed test results

- 3rd level

Change-Id: Iae8141ff64ae61711ae8e69b67a92cfcb0f3f937
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAPI: Add collection for 22970/10 36/25736/1
Jan Gelety [Mon, 9 Mar 2020 12:22:43 +0000 (13:22 +0100)]
API: Add collection for 22970/10

Change-Id: I8b635b14950ca148969831614fc7f32d52ef79d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 31/25731/2
Jan Gelety [Wed, 4 Mar 2020 07:23:07 +0000 (08:23 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc0~302-g1d94ab5f1

 - use new vpp ref build - centos7:
   20.05-rc0~302_g1d94ab5~b9022

Change-Id: Ic2078097c42200abe9ebd62e624eddd929e67e03
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoIETF: MLRsearch draft, fixed date and RFC reference. 34/25734/1
Maciek Konstantynowicz [Mon, 9 Mar 2020 11:35:32 +0000 (11:35 +0000)]
IETF: MLRsearch draft, fixed date and RFC reference.

Change-Id: Ic55406b74eb9c5ec8831faadbdde76b1c86d55fd
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoIETF: Update to PLRsearch draft. 16/25716/2
Maciek Konstantynowicz [Fri, 6 Mar 2020 12:39:26 +0000 (12:39 +0000)]
IETF: Update to PLRsearch draft.

Change-Id: Id1c9684c42c19eccfdc347e43221e097aed10514
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoIETF: Update MLRsearch draft. 53/25553/6
Vratko Polak [Fri, 6 Mar 2020 14:16:17 +0000 (15:16 +0100)]
IETF: Update MLRsearch draft.

+ Table with real data included in a formatted table.
+ Points to new version in PyPI.

Change-Id: I27489d8683b9562d0789c03ec28bb3afafcc6a8f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add data 17/25717/1
Tibor Frank [Fri, 6 Mar 2020 12:40:45 +0000 (13:40 +0100)]
Report: Add data

Change-Id: I2010fbad67a26b3729759c9bad669b268b54041b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoSKX/CLX BIOS upgrade 65/25565/6
Peter Mikus [Mon, 2 Mar 2020 12:18:15 +0000 (12:18 +0000)]
SKX/CLX BIOS upgrade

Change-Id: I3c2f9693c1571133f11fc8e2fcc7d07ff90488a3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: 2n-clx-xxv710 L2 base-scale tests 05/25705/1
Tibor Frank [Fri, 6 Mar 2020 08:07:08 +0000 (09:07 +0100)]
Report: 2n-clx-xxv710 L2 base-scale tests

Change-Id: I64dcef426516e0e1aedfd4b8c91a65c987de70f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAzure topology file MAC fix. 06/25606/3
Maros Mullner [Tue, 3 Mar 2020 10:32:36 +0000 (11:32 +0100)]
Azure topology file MAC fix.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I7eefdb5db39a0f5328c7f1a0a0a5d57c762cc21c

4 years agoAdd pciutils to trex role, to solve lspci not found. 89/25589/3
Maros Mullner [Tue, 3 Mar 2020 07:50:43 +0000 (08:50 +0100)]
Add pciutils to trex role, to solve lspci not found.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I3b1d5e61fe85b1112d4032f6e2b17b61a812e749

4 years agoReport: Hoststack - the same titles in methodology and results 86/25686/1
Tibor Frank [Thu, 5 Mar 2020 13:53:27 +0000 (14:53 +0100)]
Report: Hoststack - the same titles in methodology and results

Change-Id: I14a442ecd5f0e641171665f0615edf21cb4be286
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add 2n-clx-xxv710 L2 base-scale tests 82/25682/1
Tibor Frank [Thu, 5 Mar 2020 13:39:52 +0000 (14:39 +0100)]
Report: Add 2n-clx-xxv710 L2 base-scale tests

Change-Id: Ib30a60ef2e2c6d9a80d1ff98d1bf606d049ffc41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Fix graphs for Soak tests 68/25668/1
Tibor Frank [Thu, 5 Mar 2020 07:24:50 +0000 (08:24 +0100)]
Report: Fix graphs for Soak tests

Change-Id: Ied8b8a8e4f2087c6e53ad3f1a56bcf03346394ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure Report 2001.11 41/25641/3
Tibor Frank [Wed, 4 Mar 2020 09:16:02 +0000 (10:16 +0100)]
Report: Configure Report 2001.11

Change-Id: I5af4ef16464ee372d5ff9a41695870c22a3311bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add Soak tests 12/25612/10
Tibor Frank [Tue, 3 Mar 2020 12:42:06 +0000 (13:42 +0100)]
Report: Add Soak tests

Change-Id: I8e5ae26209358d676d1beb758d97a3bfe3a22675
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd all ports from 3n-tsh tg to topofile 46/25646/2
juraj.linkes [Wed, 4 Mar 2020 11:49:34 +0000 (12:49 +0100)]
Add all ports from 3n-tsh tg to topofile

Without it, we're running the risk of unused port being bound to linux
kernel driver when t-rex starts, preventing it from starting.

Change-Id: I3a1702e364c06809b527830bf9addacd63fb47ee
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoReport: Fix title levels in auto generated files 42/25642/2
Tibor Frank [Wed, 4 Mar 2020 11:16:20 +0000 (12:16 +0100)]
Report: Fix title levels in auto generated files

Change-Id: Ia6ffdd69ce249a2143b59e2db40b211469b51e11
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Enable pdf version 26/25626/2
Tibor Frank [Tue, 3 Mar 2020 20:21:40 +0000 (21:21 +0100)]
Report: Enable pdf version

Change-Id: Ibcf08fe0568f9e12b9ab6cf96ebeeccdfcfa2487
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Fix TCP/IP 29/25629/1
Tibor Frank [Tue, 3 Mar 2020 21:49:54 +0000 (22:49 +0100)]
Report: Fix TCP/IP

Change-Id: I0febd1e76ff01fc24be76ac1839fc6ca8b2fba39
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add TCP/IP tests 24/25624/1
Tibor Frank [Tue, 3 Mar 2020 19:53:44 +0000 (20:53 +0100)]
Report: Add TCP/IP tests

- 2n-clx

Change-Id: I5c045d539028e5f6b93799b7d59fdc203968730f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add data 20/25620/2
Tibor Frank [Tue, 3 Mar 2020 19:25:27 +0000 (20:25 +0100)]
Report: Add data

- hoststack

Change-Id: I6d62ab7a21d463d4f87365073cd491bc38b4b0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoPAL: Process Hoststack data 40/25340/27
Tibor Frank [Fri, 21 Feb 2020 09:11:01 +0000 (10:11 +0100)]
PAL: Process Hoststack data

Change-Id: Ib87ad83f3bbb7e71b51b91b9b3e8dc963a76a047
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Fixes 08/25608/1
Tibor Frank [Tue, 3 Mar 2020 12:32:51 +0000 (13:32 +0100)]
Report: Fixes

Change-Id: I1c68ce3380581c28193f8a77294285ee769d23a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoperf: Clean up Hoststack tests 19/24919/14
Dave Wallace [Tue, 11 Feb 2020 00:57:10 +0000 (00:57 +0000)]
perf: Clean up Hoststack tests

- Update test names with clients/streams
- Convert test results to JSON output
  * iperf3 results include bits_per_second
  * vpp_echo results include both client
    and server output which includes time in seconds
    and rx_data/tx_data in bytes which can be used
    to calculate the average bits per second.
    Tx and Rx data will always be the same:
    BPS = (client tx_data * 8) / ((client time + server time) / 2)
- Fix WRK test results data formatting errors

Change-Id: Ie2aeb665e3cc0739b16f97ba2628eebe6e041d22
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoImprove hoststack methodology pages 25/25425/4
Vratko Polak [Wed, 26 Feb 2020 17:19:48 +0000 (18:19 +0100)]
Improve hoststack methodology pages

+ Also update corresponding chapter names for results.
 - Kept picotls there as in future we may have others.

Change-Id: Ib8037740ebbb2a517e31cc62dfc6a423eb126cba
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
4 years agoReport: Add reconf tests for 2n-clx 96/25596/3
Tibor Frank [Tue, 3 Mar 2020 10:00:55 +0000 (11:00 +0100)]
Report: Add reconf tests for 2n-clx

Change-Id: I36ecd741b53f2db837d499ab2a5daf3bfac8c790
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add data 91/25591/1
Tibor Frank [Tue, 3 Mar 2020 08:40:26 +0000 (09:40 +0100)]
Report: Add data

- VPP performance tests 2n-clx
  - test sets IP4, IP6, L2, Memif, loadbalancer, VHost, VTS
  - all sets selected for analysis and graphs

Change-Id: Ie0e86c131927c860b0333d12cac8ef7f3c7bcb27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 68/25568/2
Jan Gelety [Wed, 26 Feb 2020 06:06:27 +0000 (07:06 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc0~272-g952ec0e0a

 - use new vpp ref build - centos7:
   20.05-rc0~272_g952ec0e~b8990

Change-Id: Icb084cd58af3de7784da4af3acd591bd0005e007
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Fix _generate_html_table 85/25585/1
Tibor Frank [Tue, 3 Mar 2020 06:57:23 +0000 (07:57 +0100)]
Report: Fix _generate_html_table

Change-Id: I711755fee488fb9ce07cd2d4dc868fc39bd07a54
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Detailed test results 41/25541/20
Tibor Frank [Fri, 28 Feb 2020 12:48:15 +0000 (13:48 +0100)]
Report: Detailed test results

- sub-chapters reorg

Change-Id: I0a90bcfde1e8be368e7ddaf9a41abbe52851cd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate PyPI metadata for MLRsearch 0.3.0 71/25571/3
Vratko Polak [Mon, 2 Mar 2020 15:05:55 +0000 (16:05 +0100)]
Update PyPI metadata for MLRsearch 0.3.0

Change-Id: I6a9c4739167f96bd2123f85ff2f6693562dce3bc
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agobash: tolerate -dev as a package name 67/25467/3
Vratko Polak [Thu, 27 Feb 2020 11:30:19 +0000 (12:30 +0100)]
bash: tolerate -dev as a package name

Misbehaving projects can create it, and apt thinks it is a cli option.

Change-Id: Icc42231e2d498f976281ce725373c6679fe61fa4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFix argument order in MLRsearch 86/24786/2
Vratko Polak [Tue, 4 Feb 2020 11:18:07 +0000 (12:18 +0100)]
Fix argument order in MLRsearch

Introduced in last refactor.
Luckily, the result were still correct, just with confusing logs
and perhaps longer search time in unstable test cases.

Change-Id: I26dd5714fb588ea07afe85583b3ab3b4bd53d9ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Detailed test results 36/25536/2
Tibor Frank [Fri, 28 Feb 2020 09:59:54 +0000 (10:59 +0100)]
Report: Detailed test results

- Data alignment

Change-Id: I0b8c15c0c1553888c65cc77e8d954d1341847945
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add data 31/25531/1
Tibor Frank [Fri, 28 Feb 2020 09:10:48 +0000 (10:10 +0100)]
Report: Add data

Change-Id: I0332a2afca7a7048e5672dc1db002d1abb55476f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add data 24/25524/1
Tibor Frank [Fri, 28 Feb 2020 06:17:29 +0000 (07:17 +0100)]
Report: Add data

Change-Id: Ida58bb38f71680e5d42b292c78e2b4cd01200b0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure Report 2001.10 20/25520/1
Tibor Frank [Fri, 28 Feb 2020 06:08:03 +0000 (07:08 +0100)]
Report: Configure Report 2001.10

Change-Id: I0d7950b1c32633c0f67589fb9a7504726de6cfad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Edit Report history 99/25499/3
Tibor Frank [Thu, 27 Feb 2020 12:44:48 +0000 (13:44 +0100)]
Report: Edit Report history

Change-Id: I9b45e16478e399ed9d4f63d5e161071864ed953e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: updated rls notes with 2n-clx for vpp and dpdk performance. 03/25503/2
Maciek Konstantynowicz [Thu, 27 Feb 2020 13:17:44 +0000 (13:17 +0000)]
Report: updated rls notes with 2n-clx for vpp and dpdk performance.

Change-Id: I3d3bfe67f7a4b438c3508543ba8f50c76f638bc5
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoReport: Do not show failed tests in "Detailed Test Results" 91/25491/7
Tibor Frank [Thu, 27 Feb 2020 10:47:55 +0000 (11:47 +0100)]
Report: Do not show failed tests in "Detailed Test Results"

Change-Id: I6019af7f0b2af29c876a39a3243fe29843e3b1da
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: check if t-rex is running at test setup of all perf tests 89/25489/3
Jan Gelety [Tue, 25 Feb 2020 07:59:57 +0000 (08:59 +0100)]
FIX: check if t-rex is running  at test setup of all perf tests

Change-Id: I9af632035a1415666b2470c62a41d1b6acbf33c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Add data 76/25476/3
Tibor Frank [Wed, 26 Feb 2020 16:06:36 +0000 (17:06 +0100)]
Report: Add data

Change-Id: I7863ce4b4493265284aed5fb5aa413b93df30fb2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCRC comments: SW crypto is enough 79/25479/3
Vratko Polak [Mon, 3 Feb 2020 12:31:45 +0000 (13:31 +0100)]
CRC comments: SW crypto is enough

Change-Id: I4ec4a56d54850a7654bdc1a6330bd473bd997608
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Compare 3n-hsw to 2n-clx 69/25469/1
Tibor Frank [Wed, 26 Feb 2020 15:19:22 +0000 (16:19 +0100)]
Report: Compare 3n-hsw to 2n-clx

Change-Id: I259d8eea5ef0a812ea47a10f2144834f0f5fad65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoPAL: Detailed test results 59/25459/5
Tibor Frank [Wed, 26 Feb 2020 12:34:04 +0000 (13:34 +0100)]
PAL: Detailed test results

Change-Id: I75ebad7874602dbc136440a3b4c6f94b095728c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Plots 48/25448/2
Tibor Frank [Wed, 26 Feb 2020 11:03:23 +0000 (12:03 +0100)]
Report: Plots

Change-Id: Ic9e771417abb2c7d66a5124d77cd8e0dbe052845
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: Meltdown report section 46/25446/2
Peter Mikus [Wed, 26 Feb 2020 10:56:34 +0000 (10:56 +0000)]
FIX: Meltdown report section

Change-Id: Ia6c76ed2a63ceccbd61d6abd8647b14e4ef1d5bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: Add data 39/25439/1
Tibor Frank [Wed, 26 Feb 2020 09:32:27 +0000 (10:32 +0100)]
Report: Add data

Change-Id: I523a92cbb33ccd7d46729cdb0a92b1fcc8272f66
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add dpdk-2n-clx-xv710 22/25422/2
Tibor Frank [Tue, 25 Feb 2020 11:30:14 +0000 (12:30 +0100)]
Report: Add dpdk-2n-clx-xv710

Change-Id: I072176298db00cbc148ad635c9179810aa53ddf3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: avoid t-rex suite tear down action to fail successfull tests 21/25421/2
Jan Gelety [Mon, 24 Feb 2020 19:20:59 +0000 (20:20 +0100)]
FIX: avoid t-rex suite tear down action to fail successfull tests

- try to kill t-rex only if it is running
- do not fail the whole test suite when t-rex test suite tear down
  action has failed

Change-Id: I3748a08a3da4dd3617cb54e8fdd344d49566fc7d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Process test msg 17/25417/1
Tibor Frank [Tue, 25 Feb 2020 10:57:07 +0000 (11:57 +0100)]
Report: Process test msg

Change-Id: I3b40fb7f6949c098612b5649b56448bca1966155
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Hoststack methodology 10/25410/2
Tibor Frank [Tue, 25 Feb 2020 09:11:10 +0000 (10:11 +0100)]
Report: Hoststack methodology

Change-Id: I105e1d4823df42522bff1af50d1bb173cd84d958
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 72/25372/2
Jan Gelety [Mon, 24 Feb 2020 09:12:46 +0000 (10:12 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc0~215-gb05249b3b

 - use new vpp ref build - centos7:
   20.05-rc0~215_gb05249b~b8928

Change-Id: I0f3d0ed1744e9635fa466c5ec07fb531c2f2baac
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: 2n-clx NFV tests 94/25394/1
Tibor Frank [Mon, 24 Feb 2020 13:52:26 +0000 (14:52 +0100)]
Report: 2n-clx NFV tests

Change-Id: I7533bb6d92af0f5ac022da548dffd9cd8b5db02b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add data 78/25378/1
Tibor Frank [Mon, 24 Feb 2020 12:08:23 +0000 (13:08 +0100)]
Report: Add data

Change-Id: I23de705fd953b6851b4012a5cb492179ce18b035
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add data 74/25374/1
Tibor Frank [Mon, 24 Feb 2020 10:29:10 +0000 (11:29 +0100)]
Report: Add data

Change-Id: I95c3026e69ce0a49073d67232058f902cf3ab2f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Edit minor details in methodology docs 68/24768/3
Vratko Polak [Mon, 3 Feb 2020 17:51:14 +0000 (18:51 +0100)]
Report: Edit minor details in methodology docs

Change-Id: I9bbb97e635b6ef438dcb8bed3f69617bb98e9779
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoTox: Add copyright year tox checker 15/24715/14
Vratko Polak [Fri, 21 Feb 2020 09:17:07 +0000 (10:17 +0100)]
Tox: Add copyright year tox checker

Only added/edited files already containing copyright notice
are checked for the correct year (and only if in first 3 lines).

Change-Id: I22c057431847fda3a7dfd4577f8346fadfe4c4f6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add data 55/25355/1
Tibor Frank [Fri, 21 Feb 2020 13:12:35 +0000 (14:12 +0100)]
Report: Add data

Change-Id: Ib4e39f135f74421fd68bf0581255741ebfd26148
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add data 46/25346/1
Tibor Frank [Fri, 21 Feb 2020 10:02:54 +0000 (11:02 +0100)]
Report: Add data

Change-Id: I5e999061f40734a3cd520199ab21d466aa8ca4bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agotopo: update topo files for DNV systems after NIC replacements 39/25339/1
Jan Gelety [Mon, 17 Feb 2020 04:24:12 +0000 (05:24 +0100)]
topo: update topo files for DNV systems after NIC replacements

Change-Id: I3d6e241f168824e7d1d99100f8e48b1bf7c0d665
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Add 2n-clx latency 5 35/25335/1
Tibor Frank [Fri, 21 Feb 2020 08:10:10 +0000 (09:10 +0100)]
Report: Add 2n-clx latency 5

Change-Id: Ia3b45ddb61accd637000318e4ea8e60c3a78b143
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add 2n-clx latency 4 30/25330/1
Tibor Frank [Fri, 21 Feb 2020 07:00:35 +0000 (08:00 +0100)]
Report: Add 2n-clx latency 4

Change-Id: I1660b3289e55e9c3da743291bebc9c95fac40822
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add 2n-clx latency 3 14/25314/1
Tibor Frank [Thu, 20 Feb 2020 12:59:06 +0000 (13:59 +0100)]
Report: Add 2n-clx latency 3

Change-Id: I91a09438347de70f7d610837ffb30b9cd51d8659
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add 2n-clx latency 2 05/25305/2
Tibor Frank [Thu, 20 Feb 2020 10:53:47 +0000 (11:53 +0100)]
Report: Add 2n-clx latency 2

Change-Id: Ib46aee4ef005aaf83153643b04b08b35c48aa758
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoSmall AWS terraform cleanup 02/25302/2
Maros Mullner [Thu, 20 Feb 2020 09:17:47 +0000 (10:17 +0100)]
Small AWS terraform cleanup

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I5acd3dd0b9e2e6beb03c94362ab739601da39443

4 years agoReport: Add 2n-clx latency 1 97/25297/1
Tibor Frank [Thu, 20 Feb 2020 08:56:32 +0000 (09:56 +0100)]
Report: Add 2n-clx latency 1

Change-Id: Iadc49e2cff4bfd0e695654aa48aaf8d2cba10f2d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Disable pdf vervion 92/25292/1
Tibor Frank [Thu, 20 Feb 2020 07:16:48 +0000 (08:16 +0100)]
Report: Disable pdf vervion

Change-Id: Ie7374ec00e834305e978fb10342fa33e92d4234e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Add 2n-clx 79/25279/2
Tibor Frank [Wed, 19 Feb 2020 16:02:14 +0000 (17:02 +0100)]
Report: Add 2n-clx

- Packet thput
- Speedup
- NFV

Change-Id: I52b840b19dbfc2b7110c64c4421008e698a15852
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure 2001.09 75/25275/2
Tibor Frank [Wed, 19 Feb 2020 15:39:22 +0000 (16:39 +0100)]
Report: Configure 2001.09

Change-Id: I4fed9ef09f80efaeac8860ced9a46ce9cb8d8629
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoRe-compile vfio-pci and igb_uio for AWS in ansible scripts. 32/25232/7
Maros Mullner [Tue, 18 Feb 2020 11:29:56 +0000 (12:29 +0100)]
Re-compile vfio-pci and igb_uio for AWS in ansible scripts.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I6f0268f510e0c07e45d41f92ae5e2d24d05d407b

4 years agoReport: Add data 64/25264/1
Tibor Frank [Wed, 19 Feb 2020 09:31:05 +0000 (10:31 +0100)]
Report: Add data

Change-Id: Ie1edeb10f5798367ed0e0c2cdcfb6fe4a25aa4d1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Sort tests in tables 60/25260/5
Tibor Frank [Wed, 19 Feb 2020 05:53:42 +0000 (06:53 +0100)]
Report: Sort tests in tables

Change-Id: I862a35270a72d66d7cc3c0eaf5fb2bff20dcac7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: Plots 35/25235/3
Tibor Frank [Tue, 18 Feb 2020 12:10:32 +0000 (13:10 +0100)]
Trending: Plots

- remove not needed params
- i40e --> dpdk

Change-Id: Ib63a66486b040b01a929f3ee0a4e80468c9d4e28
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoPerpatch: Fix bash ansible calls 38/25238/1
Vratko Polak [Tue, 18 Feb 2020 13:18:39 +0000 (14:18 +0100)]
Perpatch: Fix bash ansible calls

The function ansible_hosts got renamed to ansible_playbook
in https://gerrit.fd.io/r/c/csit/+/24511

Change-Id: Ife4e7b13f634fcdda95f80c18bc86cfded139b5d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add data 27/25227/1
Tibor Frank [Tue, 18 Feb 2020 09:54:55 +0000 (10:54 +0100)]
Report: Add data

Change-Id: I25f6a2ad739aade9bf0923767287bf803ecd0ec0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Detailed test results 22/25222/8
Tibor Frank [Tue, 18 Feb 2020 07:32:45 +0000 (08:32 +0100)]
Report: Detailed test results

Change-Id: I9af4bc9de4f4606449fd257c4321d9cd980d5f01
Signed-off-by: Tibor Frank <tifrank@cisco.com>