csit.git
6 days agotopo: update topo files for DNV systems after NIC replacements 44/25344/1 rls1908_1
Jan Gelety [Mon, 17 Feb 2020 04:24:12 +0000 (05:24 +0100)]
topo: update topo files for DNV systems after NIC replacements

Change-Id: I3d6e241f168824e7d1d99100f8e48b1bf7c0d665
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 15a04ca1f1ac7485695ac36e33deb06968e0020a)
(cherry picked from commit 984c6461e7230d0c3b141d80977eb14c76575faa)

3 months agoAdd: Use containers for shared TG 79/23079/2
Peter Mikus [Fri, 13 Sep 2019 12:00:49 +0000 (12:00 +0000)]
Add: Use containers for shared TG

+ Ansible
  + Service for auto load during restart
  + By default created 2 instances of Docker container
+ Small modification of Trex to use prefixes
+ DNV topology to use ssh port to connect to docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7
(cherry picked from commit 96eaabff284f154ca96ce823fee205bd9833043b)

4 months agoReport: Show TSH results 64/22564/1
Tibor Frank [Mon, 7 Oct 2019 08:13:42 +0000 (10:13 +0200)]
Report: Show TSH results

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ibdb2b098dfe57280ba60b0df6e4e330e44ed783a

4 months agoReport: Add data 60/22560/1
Tibor Frank [Mon, 7 Oct 2019 06:45:04 +0000 (08:45 +0200)]
Report: Add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I55abf8d6d5b35beb7af6c887e0c6d8c3d94c5f83

4 months agoPAL: Accept reconf time in scientific notation 25/22525/1
Vratko Polak [Wed, 2 Oct 2019 15:08:39 +0000 (17:08 +0200)]
PAL: Accept reconf time in scientific notation

+ Otherwise "9.58828205237e-05" is understood as "9.58828205237".
+ Replace "[0-9]" with "\d".

Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 2eb470aa8b86bd11fb6365f0fd9a77ee026dc5aa)

4 months agoReport: Add data 15/22515/1
Tibor Frank [Fri, 4 Oct 2019 07:26:07 +0000 (09:26 +0200)]
Report: Add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ia040942d3f4163377493ec6d8408766730819ad8

4 months agoReport: Add data and configure 1908.1.41 95/22495/2
Tibor Frank [Thu, 3 Oct 2019 07:35:56 +0000 (09:35 +0200)]
Report: Add data and configure 1908.1.41

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I3cad74cc1f183ba86d5e7377d68bbdd58c8ad42c

4 months agoReport: Add data 68/22468/1
Tibor Frank [Wed, 2 Oct 2019 08:31:15 +0000 (10:31 +0200)]
Report: Add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I6b361efc592985ff068bd4e4bf50595dc68d51ab

4 months agoReport: Add data 36/22436/1
Tibor Frank [Tue, 1 Oct 2019 07:18:22 +0000 (09:18 +0200)]
Report: Add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Iab81330ae8945748d9235293932de762616d624d

4 months agoReport: Add data 99/22399/2
Tibor Frank [Mon, 30 Sep 2019 10:51:22 +0000 (12:51 +0200)]
Report: Add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I89234d2a5c4aeb26c47da73943686d402374ddcc

5 months agodocs: Update content of test_select_lists 49/22349/1
Jan Gelety [Thu, 26 Sep 2019 05:34:04 +0000 (07:34 +0200)]
docs: Update content of test_select_lists

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I2e993f342920ee7516cc6e90a016ecb205b3931c

5 months agoReport: Add data 37/22337/1
Tibor Frank [Fri, 27 Sep 2019 08:29:13 +0000 (10:29 +0200)]
Report: Add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I5160f54b01e6ee002cbc49c59dd8232d338cf5c4

5 months agoReport: Reconf tests: Fix legend 22/22322/1
Tibor Frank [Thu, 26 Sep 2019 11:39:59 +0000 (13:39 +0200)]
Report: Reconf tests: Fix legend

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I6ff5505e2d33d4dc1ce7cdfd028f6c8dc8143eb8

5 months agoReport: Reconf tests: set autorange for y axis 17/22317/2
Tibor Frank [Thu, 26 Sep 2019 10:48:38 +0000 (12:48 +0200)]
Report: Reconf tests: set autorange for y axis

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I1811fb1b88e6e2c2f687d2c7adb6f744740803e2

5 months agodoc: perf release notes 80/22280/1
Jan Gelety [Wed, 25 Sep 2019 18:10:58 +0000 (20:10 +0200)]
doc: perf release notes

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I5a6a6606ec111e01408f8636074ec3695c50dc0f

5 months agoReport: Configure graphs, add data 78/22278/1
Tibor Frank [Thu, 26 Sep 2019 08:30:34 +0000 (10:30 +0200)]
Report: Configure graphs, add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Id82d3e321244e54b522ea160a688cc3398703e23

5 months agoReport: Configure 1908.1.40 76/22276/1
Tibor Frank [Thu, 26 Sep 2019 07:16:32 +0000 (09:16 +0200)]
Report: Configure 1908.1.40

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I5f92b1cf84c61ebab5606092e20361ea4c416f1a

5 months agoreport: func release notes 55/22255/1
Jan Gelety [Fri, 20 Sep 2019 21:16:36 +0000 (23:16 +0200)]
report: func release notes

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I94578bf0d70d32387dd956f5c7924976ebf362d2

5 months agoReport: Remove disclaimer from reconf tests. 53/22253/1
Tibor Frank [Wed, 25 Sep 2019 09:33:52 +0000 (11:33 +0200)]
Report: Remove disclaimer from reconf tests.

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I7127e0b0a08d0c1cebda6ad06f6d89994a1903b5

5 months agoReport: Configure 1908.1.39 63/22163/14
Tibor Frank [Fri, 20 Sep 2019 07:46:58 +0000 (09:46 +0200)]
Report: Configure 1908.1.39

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ibf041efa086e5e3965582cefc37327f32ec24dfd

5 months agoReconf tests: Fix async measurements 09/22209/1
Vratko Polak [Mon, 23 Sep 2019 13:00:00 +0000 (15:00 +0200)]
Reconf tests: Fix async measurements

TRex does not zero the server counters.
It copies the values to use as reference,
and subtracts them when asked for results.

But the reference is stored in the client (not the server).
And CSIT uses different scripts to start and stop async traffic,
which means different clients.

This patch introduces a workaround.
Async start will return xstats objects to use as reference,
and async stop will use the objects to compute the correct results.
The xstats objects are stored in TrafficGenerator instance.
Sync measurement does not export the counters, to shorten logs.

Other improvements:
+ Make stop_traffic_on_tg return measurement results directly.
+ Rename --async to --async_start as "async" is reserved in Python 3.7
+ Minor pylint, docstring and typo fixes.

Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 months agoUse vpp 19.08.1-release builds 48/22148/1
Jan Gelety [Thu, 19 Sep 2019 11:29:10 +0000 (13:29 +0200)]
Use vpp 19.08.1-release builds

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I3a35176e72e5805b39df03576c9d5b96a3875794

5 months agoReport: Fix formating of static content for reconf tests 28/22128/1
Tibor Frank [Wed, 18 Sep 2019 14:42:22 +0000 (16:42 +0200)]
Report: Fix formating of static content for reconf tests

Change-Id: I5b93749b13af870955c1cf9eb8053c446356c329
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0608915e1a87f9a5f33e61c9c7cb93c98e9fc5ba)

5 months agoReport: Add disclaimer for reconf tests 22/22122/1
Tibor Frank [Wed, 18 Sep 2019 08:40:17 +0000 (10:40 +0200)]
Report: Add disclaimer for reconf tests

+ Improve description for reconf tests

Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2fc48e8d0a4712ec99dd2bb3a814ec9cb2bc12cf)

5 months agoReport: Enable pdf version 96/22096/1
Tibor Frank [Tue, 17 Sep 2019 07:23:07 +0000 (09:23 +0200)]
Report: Enable pdf version

Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 73cabdc86a0dd86755cfa921379fc3c63142ed6e)

5 months agoReport: Fix Report History 89/22089/1
Tibor Frank [Tue, 17 Sep 2019 09:15:03 +0000 (11:15 +0200)]
Report: Fix Report History

Change-Id: I654677ca9252e592e635eab28577bb3bb3b8bf85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b61e34657e58cbe6c8476f6708d62168ffd80775)

5 months agoReport: Update Report History 83/22083/1
Tibor Frank [Tue, 17 Sep 2019 07:07:06 +0000 (09:07 +0200)]
Report: Update Report History

Change-Id: Ie16a2f2298eeaf0793171c7268a95abb6986246a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2007221103d73be24c6d547ebaf6c86dd6dff1bf)

5 months agoReport: Add methodology for reconf tests 79/22079/1
Vratko Polak [Mon, 16 Sep 2019 16:34:29 +0000 (18:34 +0200)]
Report: Add methodology for reconf tests

Change-Id: I833d63f4e305ba60c94aa16cbb3a31a52ee3b3bb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit abca97bfc198c4f947571462cc57732d187c3c20)

5 months agoReport: Add data 61/22061/1
Tibor Frank [Fri, 13 Sep 2019 08:17:08 +0000 (10:17 +0200)]
Report: Add data

Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 48b37104e999ce75069672e5b901afeb06b9312b)

5 months agoReport: Fixes 50/22050/1
Tibor Frank [Fri, 13 Sep 2019 11:53:23 +0000 (13:53 +0200)]
Report: Fixes

Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e2d15edc355f0c70df578dde0495f8ffd85d8c12)

5 months agoReport: Add data 37/22037/1
Tibor Frank [Fri, 13 Sep 2019 06:56:08 +0000 (08:56 +0200)]
Report: Add data

Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 17220bfce36c723a3ca6fdd1ef757709ab50f4eb)

5 months agoReport: Add nfv reconf 23/22023/1
Tibor Frank [Thu, 12 Sep 2019 13:16:35 +0000 (15:16 +0200)]
Report: Add nfv reconf

Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8f03b515387df1ebb7e5a7231a287f7816e57726)

5 months agoPAL: Add NFV reconf tests 17/22017/1
Tibor Frank [Wed, 11 Sep 2019 09:55:13 +0000 (11:55 +0200)]
PAL: Add NFV reconf tests

Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5979e1020d4e41e08f1fe4e6d195a0a5bc020bb1)

5 months agoReport: Temporarily remove pdf version 12/22012/1
Tibor Frank [Thu, 12 Sep 2019 07:53:49 +0000 (09:53 +0200)]
Report: Temporarily remove pdf version

Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c77230ed462b0a79ca0200fabdba41b78e8d7923)

5 months agoReport: Configure 1908.38 08/22008/1
Tibor Frank [Thu, 12 Sep 2019 06:53:21 +0000 (08:53 +0200)]
Report: Configure 1908.38

Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e248c3fd06b4126b780eca85c5aae282cf872524)

5 months agoReport: Remove NFV full data 85/21985/1
Tibor Frank [Wed, 11 Sep 2019 11:14:40 +0000 (13:14 +0200)]
Report: Remove NFV full data

Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2fe2a2c140bffa10678e3e217c8a5cba0fd4dbd0)

5 months agoReport: Add data 77/21977/1
Tibor Frank [Wed, 11 Sep 2019 08:18:49 +0000 (10:18 +0200)]
Report: Add data

Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 27cff25483728d50e0215b895c680fb88f6ffe99)

5 months agoReport: Add pdf version 72/21972/1
Tibor Frank [Tue, 10 Sep 2019 11:50:24 +0000 (13:50 +0200)]
Report: Add pdf version

Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d44bf1d08991f9698b8d02d72ecbc88fbfff9515)

5 months agoPAL: Add replacing of data in tables 51/21951/1
Tibor Frank [Fri, 6 Sep 2019 11:54:11 +0000 (13:54 +0200)]
PAL: Add replacing of data in tables

+ vhost data

Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4dc7d6cc7b695c21ef1e37fa6b754958fc50e484)

5 months agoReport: Report history 20/21920/1
Tibor Frank [Mon, 9 Sep 2019 12:55:26 +0000 (14:55 +0200)]
Report: Report history

Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fa6124e5a9ce40348a4113b7da009e99d231d437)

5 months agoReport: Add dnv mrr data 13/21913/1
Tibor Frank [Mon, 9 Sep 2019 10:58:25 +0000 (12:58 +0200)]
Report: Add dnv mrr data

Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 80fd7db87eb177b2369cd01716662c63a642a513)

5 months agoReport: Fix tsh and dnv plots 08/21908/1
Tibor Frank [Mon, 9 Sep 2019 10:16:36 +0000 (12:16 +0200)]
Report: Fix tsh and dnv plots

Change-Id: I1d40849bc15f4433117af91f71e951a61924d732
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 620774fdc9a0fa2703fcaa8e18915d65cb2b1ed3)

5 months agoReport: Add soak tests 01/21901/1
Tibor Frank [Mon, 9 Sep 2019 07:01:18 +0000 (09:01 +0200)]
Report: Add soak tests

Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ba14f2b0ac026e537c79a61e800176b3404bde4d)

5 months agoReport: Fix2 - Add 3n-dnv plots and tables 80/21880/1
Tibor Frank [Fri, 6 Sep 2019 17:41:15 +0000 (17:41 +0000)]
Report: Fix2 - Add 3n-dnv plots and tables

Change-Id: Ia182e6e52a37f9b3248eab60ffe4dd4746ed7fa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 81907979cdf2ca6ca991410e8151170deb380bc1)

5 months agodocs: add select list of tests for report - tsh and dnv 66/21866/1
Jan Gelety [Tue, 3 Sep 2019 20:33:45 +0000 (22:33 +0200)]
docs: add select list of tests for report - tsh and dnv

Change-Id: I63a69d998c80029422bae9f90e186eb2286196d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit a3da59a916817208f69cb718d00a5017d0e5c0e2)

5 months agoReport: Fix - Add 3n-dnv plots and tables 44/21844/1
Tibor Frank [Fri, 6 Sep 2019 07:43:53 +0000 (09:43 +0200)]
Report: Fix - Add 3n-dnv plots and tables

Change-Id: I5f09f1f20e532e71d6abde02111a90f5868035f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1c77031813057a50781784fc8e34019805d222b8)

5 months agoReport: Add 3n-dnv plots and tables 40/21840/1
Tibor Frank [Fri, 6 Sep 2019 06:13:09 +0000 (08:13 +0200)]
Report: Add 3n-dnv plots and tables

Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1082d79a51e3caf60586e6176ee89ac3aadf04fc)

5 months agoReport: Add 2n-dnv plots and tables 27/21827/1
Tibor Frank [Thu, 5 Sep 2019 12:01:09 +0000 (14:01 +0200)]
Report: Add 2n-dnv plots and tables

Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 99219815466588419bd6705ff2ad8a9d9fc90dff)

5 months agoReport: Add DNV data 20/21820/1
Tibor Frank [Thu, 5 Sep 2019 08:49:33 +0000 (10:49 +0200)]
Report: Add DNV data

Change-Id: I020373b1553300459654ded31d940b0a5562eb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3eb09745cc7a936dc91a68a4a723867c2311f3a1)

5 months agoReport: Fix listing order of new vs. see footnote 11/21811/1
Tibor Frank [Thu, 5 Sep 2019 07:54:39 +0000 (09:54 +0200)]
Report: Fix listing order of new vs. see footnote

Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4751baad9a204c27b0566e4faf00bf0b30f7e170)

5 months agoReport: Fix hsw vs. skx comparison table 07/21807/1
Tibor Frank [Thu, 5 Sep 2019 06:40:20 +0000 (08:40 +0200)]
Report: Fix hsw vs. skx comparison table

Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ac02e01bd4b0625e91a8eb3fa0f13f6f32f74527)

5 months agoReport: Fix fonts in release notes table 03/21803/1
Tibor Frank [Thu, 5 Sep 2019 06:27:10 +0000 (08:27 +0200)]
Report: Fix fonts in release notes table

Change-Id: I4a3486c313c4aa4754c455389b8ebb363ead469a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1a330e122eba0526960a581b32c0d7031c72f394)

5 months agoReport: Configure Report 1908.37 99/21799/1
Tibor Frank [Thu, 5 Sep 2019 06:20:32 +0000 (08:20 +0200)]
Report: Configure Report 1908.37

Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d7813d33fef48421377c7eb6f24cd3998d8b0594)

5 months agoFIX: Use vhost macs when testpmd_mac forwarding used in VM 95/21795/1
Jan Gelety [Mon, 2 Sep 2019 21:28:30 +0000 (23:28 +0200)]
FIX: Use vhost macs when testpmd_mac forwarding used in VM

Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 474034ac24ce89cdaa94a09ae4d9ebbd3fb0f219)

5 months agodocs: report vpp performance rls notes update. 82/21782/2
Maciek Konstantynowicz [Wed, 4 Sep 2019 11:56:55 +0000 (12:56 +0100)]
docs: report vpp performance rls notes update.

Change-Id: Ie4a7a80cad9ff92b9f30953096cca8a029edc687
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 1abf61ca0224226e3f39ac491b2b84e49ac6092f)

5 months agoReport methodology: PLRsearch update with graphs 83/21783/1
Vratko Polak [Wed, 4 Sep 2019 10:51:50 +0000 (12:51 +0200)]
Report methodology: PLRsearch update with graphs

Change-Id: Ib73a64c93bdba3945b8237783a24134b47d4eb99
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 55a8e9aa3a8583b46192ffdad9ef7265fa63d537)

5 months agodocs: report packet_throughput_graphs text formatting fixes. 76/21776/1
Maciek Konstantynowicz [Wed, 4 Sep 2019 11:11:54 +0000 (12:11 +0100)]
docs: report packet_throughput_graphs text formatting fixes.

Change-Id: Ibea6e70e2fcf9cfeb7627ee1cbcfa6e177c0b2c6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 32605fc1b4ff207776b6ff3f6a1975f77d8e4629)

5 months agoDoc: Report release notes (perf) 64/21764/1
Peter Mikus [Wed, 4 Sep 2019 09:04:40 +0000 (09:04 +0000)]
Doc: Report release notes (perf)

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c1667efec67febd375818bc1dfe1d9bebc70708
(cherry picked from commit b8ae239848d484cd0660fe406ae2c4a34c0551e0)

5 months agodocs: added methodology terminology section to report. 60/21760/1
Maciek Konstantynowicz [Wed, 28 Aug 2019 13:41:07 +0000 (14:41 +0100)]
docs: added methodology terminology section to report.

Change-Id: Id787d12b577165a1081dba84b610c32df57a7c44
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 622726926fc12522e439455ade436f6dfcc0da06)

5 months agodocs: report updates in physical_testbeds section. 55/21755/1
Maciek Konstantynowicz [Mon, 2 Sep 2019 18:29:05 +0000 (19:29 +0100)]
docs: report updates in physical_testbeds section.

Change-Id: Id31e6ed294dc80619a108296be580925509bb7d7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a10342c5b6d989f64bd1fe49f0edd0c7585e54ea)

5 months agodocs: updated report intro in packet_throughput_graphs 52/21752/1
Maciek Konstantynowicz [Tue, 3 Sep 2019 21:16:30 +0000 (22:16 +0100)]
docs: updated report intro in packet_throughput_graphs

Change-Id: I3bf70cc7e48ef2134841bc4bf9300cda6a118cb3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6898a7671b00c5e5c48c58fdfaeb47bb7148d4bb)

5 months agodocs: added 3n-tsh testbed tests to report_test_groups.txt 50/21750/1
Maciek Konstantynowicz [Tue, 3 Sep 2019 21:37:45 +0000 (22:37 +0100)]
docs: added 3n-tsh testbed tests to report_test_groups.txt

Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7d7d7ff65943fa370c515c5d350b141a0515a074)

5 months agoReport: ixgbe for tsh 48/21748/1
Tibor Frank [Wed, 4 Sep 2019 07:21:26 +0000 (09:21 +0200)]
Report: ixgbe for tsh

Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d53a4da7e088fa8330e851cee3c6309ef13c8360)

5 months agoReport: Add data 44/21744/1
Tibor Frank [Wed, 4 Sep 2019 06:47:28 +0000 (08:47 +0200)]
Report: Add data

Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4be26a2f7f0cf0539e198864d69bd34bd278dda4)

5 months agoReport: Comparison tables 36/21736/1
Tibor Frank [Tue, 3 Sep 2019 20:26:25 +0000 (20:26 +0000)]
Report: Comparison tables

Change-Id: I108e1292c5de8024060c220b877b668b8843c68f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6a5bc78e5fca4f43619c9199ef05ecbe2bc5d356)

5 months agoReport: Comparison tables 26/21726/1
Tibor Frank [Tue, 3 Sep 2019 17:52:02 +0000 (17:52 +0000)]
Report: Comparison tables

Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 92d09115493a50599ed5bea9126be28229b4211f)

5 months agoReport: Comparison tables 14/21714/1
Tibor Frank [Tue, 3 Sep 2019 12:08:37 +0000 (14:08 +0200)]
Report: Comparison tables

Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ac688f80adb649bd04ecbe1daa79748a439a9e19)

5 months agoReport: add data 09/21709/1
Tibor Frank [Tue, 3 Sep 2019 09:07:36 +0000 (11:07 +0200)]
Report: add data

Change-Id: I51fd0b9e07d09224452f842689925d1166246f19
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 54b25e85bf3efd1709043ded2d6a525fa0c73962)

5 months agoCSIT-1590: Performance comparison analysis 03/21703/1
Tibor Frank [Tue, 3 Sep 2019 06:56:27 +0000 (08:56 +0200)]
CSIT-1590: Performance comparison analysis

Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 259620ea6ca1c5864d4864f0f04d260e89ecb72a)

5 months agoCSIT-1590: Performance comparison analysis 99/21699/1
Tibor Frank [Tue, 3 Sep 2019 06:45:31 +0000 (08:45 +0200)]
CSIT-1590: Performance comparison analysis

Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3e5dbfab796da168865ba787382224b1b04b83a4)

5 months agoPAL: list all sel tests in table_performance_comparison 86/21686/1
Tibor Frank [Mon, 2 Sep 2019 16:48:37 +0000 (18:48 +0200)]
PAL: list all sel tests in table_performance_comparison

Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ff3201774cf904bad6c64adf11f1fae92d5f8588)

5 months agoPAL: list all sel tests in table_performance_comparison_nic 82/21682/1
Tibor Frank [Mon, 2 Sep 2019 13:52:06 +0000 (15:52 +0200)]
PAL: list all sel tests in table_performance_comparison_nic

Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0a67083bea6b5e740c89fcc6c9143e0f035eadd1)

5 months agoReport: Add data 70/21670/1
Tibor Frank [Mon, 2 Sep 2019 13:11:20 +0000 (15:11 +0200)]
Report: Add data

Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6d981f513fba8cbec434f5c10f83081034372f20)

5 months agoAdd: Testpmd VM test 61/21661/1
Peter Mikus [Sun, 1 Sep 2019 05:51:07 +0000 (05:51 +0000)]
Add: Testpmd VM test

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id39667515e304f4d92f230f82d3f1dbc1e22ac32
(cherry picked from commit 8beb22fb0a13ccc69281bb4a68b62a733d1f20e2)

5 months agoReport: functional tests static content 43/21643/3
Jan Gelety [Mon, 26 Aug 2019 03:41:53 +0000 (05:41 +0200)]
Report: functional tests static content

Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 97881b4e0142f98bbb8e1d54828bbc3c1b34d4ac)

5 months agoReport: Add 3n-tsh 59/21659/1
Tibor Frank [Mon, 2 Sep 2019 10:32:32 +0000 (12:32 +0200)]
Report: Add 3n-tsh

Change-Id: I6027b635191c7e64397915df8944699bb320daf3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a7886e481f492d996643fad5ab48944f1cd4f725)

5 months agoReport: Add data 32/21632/1
Tibor Frank [Fri, 30 Aug 2019 09:55:42 +0000 (11:55 +0200)]
Report: Add data

Change-Id: Ie9350530879fef7d2ae8c0b58f6fd799fde9fff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 603931f00dab6e4375f1ca9dff9f5877c7ed5135)

6 months agopresentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model. 04/21604/1
Maciek Konstantynowicz [Wed, 28 Aug 2019 12:38:34 +0000 (13:38 +0100)]
presentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model.

Change-Id: I90dd569ce42fe6bf29751ca29086fe458d40a095
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 25827ae5d147343408da1eb1e74bef3e2c1a8812)

6 months agoReport: Add data 99/21599/1
Tibor Frank [Wed, 28 Aug 2019 19:09:21 +0000 (21:09 +0200)]
Report: Add data

Change-Id: I5ae5fa7cb40ddc31e3fe3fd0d6182bf54c84ad00
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a907de589b3f49368b81394b4faf6f4202c1f404)

6 months agoReport: Add data 91/21591/1
Jan Gelety [Mon, 26 Aug 2019 09:03:38 +0000 (11:03 +0200)]
Report: Add data

Change-Id: I66c91e083138b50a575cbbd32d309d0c198e6a71
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit f18bab9daaa9ac4108cc7bc04213db9051c96567)

6 months agodocs: created full list of tests for report detailed results. 87/21587/1
Maciek Konstantynowicz [Tue, 20 Aug 2019 16:07:21 +0000 (17:07 +0100)]
docs: created full list of tests for report detailed results.

Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 97ff6490bbd4656e15422576556aeba8aa799345)

6 months agodocs: created select list of tests for report and trending. 83/21583/1
Maciek Konstantynowicz [Tue, 20 Aug 2019 12:51:51 +0000 (13:51 +0100)]
docs: created select list of tests for report and trending.

Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 218572c4932c47f08cb0b64b5e493ac939ce73ae)

6 months agoNEW: Added trex profiles for 60k ip4 destinations. 79/21579/1
Ludovit Mikula [Tue, 27 Aug 2019 11:51:18 +0000 (11:51 +0000)]
NEW: Added trex profiles for 60k ip4 destinations.

Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ib9e42914ad5ab6bf0febea3edbeea8d09c8918b1
(cherry picked from commit e895f7fad03c2d805c3b16ee490b51cb304f49c0)

6 months agoDOC: 1908rls release notes for VPP Hoststack TCP performance tests. 78/21578/1
Dave Wallace [Tue, 27 Aug 2019 21:02:07 +0000 (17:02 -0400)]
DOC: 1908rls release notes for VPP Hoststack TCP performance tests.

Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit f4952736d2f356cd3423c55891e133536ddc9552)

6 months agodocs: added csit tests job specs. 64/21564/1
Maciek Konstantynowicz [Sun, 25 Aug 2019 20:11:02 +0000 (21:11 +0100)]
docs: added csit tests job specs.

Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a0465dc55b2f7edfa86e7803704bdb1415fd2b8e)

6 months agoReport: Add data 49/21549/1
Tibor Frank [Tue, 27 Aug 2019 09:46:48 +0000 (11:46 +0200)]
Report: Add data

Change-Id: I534cbb4141b60609387f894e51c429e368520a23
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 823e79aca6d19531f3abb080ab6510418f6af94d)

6 months ago- Removed 9000B test cases from ipsec test suites. 42/21542/1
Ludovit Mikula [Mon, 26 Aug 2019 11:39:39 +0000 (11:39 +0000)]
- Removed 9000B test cases from ipsec test suites.
- Added new traffic profiles.

Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e
(cherry picked from commit ac37499ef8754d7ac8f6350ab80d389727bbcd03)

6 months agoReport: Comp Tables 35/21535/1
Tibor Frank [Mon, 26 Aug 2019 15:13:25 +0000 (17:13 +0200)]
Report: Comp Tables

Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7186f868f6fd24f8727e088301c4411c2a8e8a8c)

6 months agoReport: tables 28/21528/1
Tibor Frank [Mon, 26 Aug 2019 13:46:29 +0000 (15:46 +0200)]
Report: tables

Change-Id: Ideec743ae10909d91625ea5cfc7901624459f455
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 479b30c17e28e30b7c2e01e616e96b67d6ac1779)

6 months agoReport: NFV 24/21524/1
Tibor Frank [Mon, 26 Aug 2019 13:29:04 +0000 (15:29 +0200)]
Report: NFV

Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 320f82cc987dbc6d9c4ab1632de1005ac4c0077f)

6 months agoReport: Tables 18/21518/1
Tibor Frank [Mon, 26 Aug 2019 12:32:48 +0000 (14:32 +0200)]
Report: Tables

Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit af4d3ba04cddbfb198af47b2d1d74c0655e35a08)

6 months agoReport: Modify comparison tables, add data 11/21511/1
Tibor Frank [Mon, 26 Aug 2019 11:40:39 +0000 (13:40 +0200)]
Report: Modify comparison tables, add data

Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit db49a120f90f59f5277a5c812544ea0ad1592eb8)

6 months agoFIX: Copy-paste typo in 2n-10ge2p1x710-eth-l2bd-6ch-48vh-24vm1t-vppip4-ndrpdr.robot 07/21507/1
Jan Gelety [Sun, 25 Aug 2019 12:05:34 +0000 (14:05 +0200)]
FIX: Copy-paste typo in 2n-10ge2p1x710-eth-l2bd-6ch-48vh-24vm1t-vppip4-ndrpdr.robot

Change-Id: Ibe231547e26d9b379554eec8ca6a9b4d7bc1224b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit d8271912d325ca9d4dc57f0d667c26b51f70e2fd)

6 months agoReport: Select tests by name, specifications 02/21502/1
Tibor Frank [Mon, 19 Aug 2019 13:25:47 +0000 (15:25 +0200)]
Report: Select tests by name, specifications

Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 33cfe1217cb2d6bc9655b01f200b0ec8d5ccb466)

6 months agoOper: TB31 back in operation 98/21498/2
Jan Gelety [Sun, 25 Aug 2019 08:23:27 +0000 (10:23 +0200)]
Oper: TB31 back in operation

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I8a65efa632bfb095cd9ed8716ea2496288a88d0d

6 months agoIntroduce reconfig suites, for dot1q+ip4+vxlan 89/21489/2
Vratko Polak [Fri, 23 Aug 2019 15:00:29 +0000 (17:00 +0200)]
Introduce reconfig suites, for dot1q+ip4+vxlan

Ticket: CSIT-1551

+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
 + Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
 - Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
 - Only 1 additional chain.
+ Proper TAGs. Documented.
 + Clarified min framesize tags are for TG-DUT.
  + Added a TODO concerning overhead values.
 + Added 118B tag.
+ Robot performance keywords improvements.
 + Added missing return value documentation.
 + Frame size as required test variable, not an explicit argument.
 + MLRsearch keyword to store result (not into test message).
  - TODO: De-duplicate: main keyword to measure, minor to set test message.
   - But implementation uses the fact default arguments are different.
 + Keywords for starting and stopping background traffic.
  - No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
 - Support also vlan_per_chain=True?
 - Support dot1q without vxlan?
 - Support also deletion?
 - How to package config steps so -reconf can be generated from -ndrpdr?

Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)

6 months agoImprove PLRsearch yet again 75/21475/1
Vratko Polak [Thu, 22 Aug 2019 13:04:34 +0000 (15:04 +0200)]
Improve PLRsearch yet again

Logic improvements for rls1908 and post-pylint fixes:

+ Reduce search time to 30 minutes.
+ Use average instead alternating loads.
+ Rework log/exp avg/stdev from two estimates.
+ Introduce and use pessimistic variance of dual trackers.
+ Introduce safe_exp to use when None does not skip code.
+ Use dot relative imports (instead of disabling pylint).
+ Complete docstrings for simpler functions.
+ Append docstrings to named tuples.
+ Somewhat unify docstrings related to the same arguments.
+ Slightly improve intentation.
+ State named tuples as rtype where used.
+ Add returns and rtype to __repr__ where missing.
+ Return what docstring say (or update them).
+ Explicit copying for vector and matrix values.

Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit fbbc47359e3f7b59bbd5a84d85c673374933a50a)

6 months agoFramework: Refactor complex functions in PLRSearch 74/21474/1
Miroslav Los [Fri, 16 Aug 2019 13:09:39 +0000 (15:09 +0200)]
Framework: Refactor complex functions in PLRSearch

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25
(cherry picked from commit 281b230ba982f9f6ad589fb6e44f121a6a46531f)

6 months agoReport: Specify groups of tests for graphs 73/21473/1
Tibor Frank [Tue, 20 Aug 2019 08:52:11 +0000 (10:52 +0200)]
Report: Specify groups of tests for graphs

Groups of tests for graphs:
- Packet Throughput
- Packet Latency
- Speedup Multi-Core

Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 719a84662ad1482f09224543c07053d27d7b94ea)

6 months agoUse vpp 19.08-release builds 47/21447/2
Jan Gelety [Wed, 21 Aug 2019 05:54:06 +0000 (07:54 +0200)]
Use vpp 19.08-release builds

- vpp repo updated to release branch
- vpp stable builds updated to 19.08-release

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I47cdb90d2a9714d49b84648b8e3979815e4d4439

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.