Code Review / csit.git / log
? search:
summary | shortlog | log | commit | commitdiff | review | tree
first ⋅ prev ⋅ next
csit.git
4 years agoCSIT-1504: Soak tests - box plots 84/19584/1
commit | commitdiff | tree
Tibor Frank [Wed, 15 May 2019 06:53:42 +0000 (08:53 +0200)]
CSIT-1504: Soak tests - box plots

- table: stdev, round deltas to 2 dec places

Change-Id: I29cd1f7c9ba8ef73a8281d42ac9f6a06ed30bbdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fce7b4b339f7a79b80143bbd796460720489d694)

4 years agoAdd new higher density NF tests 58/19458/5
commit | commitdiff | tree
Peter Mikus [Wed, 8 May 2019 18:04:37 +0000 (18:04 +0000)]
Add new higher density NF tests

Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1ac36a9fd34043609b81901f2de37deb0a113ea5)

4 years agoCSIT-1504: Soak tests - graph 60/19560/1
commit | commitdiff | tree
Tibor Frank [Tue, 14 May 2019 08:59:45 +0000 (10:59 +0200)]
CSIT-1504: Soak tests - graph

Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0c0cf8698e0852e87feaff3a312916cce68fc482)

4 years agoReport: Remove CFS_OPT from 2n/3n-skx ndrpdr full 57/19557/1
commit | commitdiff | tree
Tibor Frank [Tue, 14 May 2019 08:14:42 +0000 (10:14 +0200)]
Report: Remove CFS_OPT from 2n/3n-skx ndrpdr full

Change-Id: If82e9c19e9d2035e62c7e455458ebdef20659adb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6cdd959d5e28e9ec4e8f0f71a1459a02a9362c89)

4 years agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 55/19555/1
commit | commitdiff | tree
Tibor Frank [Tue, 14 May 2019 08:04:41 +0000 (10:04 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

- clean-up

Change-Id: I020837a89415fdb891ffbb094c9a5edf50946dd2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6f0d055b4bd4a6cbd4d60d9f4ce422c996ebd153)

4 years agoRemove CFSRR1 VM tests 45/19545/1
commit | commitdiff | tree
Peter Mikus [Mon, 13 May 2019 14:52:18 +0000 (14:52 +0000)]
Remove CFSRR1 VM tests

- Per agreed

Change-Id: Ie955ebfe19bff8c4a8671a0f62eea5be4407caa5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 15feed7eb0164d50f189c8a5594ec126a7683a47)

4 years agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 43/19543/1
commit | commitdiff | tree
Tibor Frank [Mon, 13 May 2019 14:38:23 +0000 (16:38 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

- fix text case name

Change-Id: I01c228a920729b2e2ab3e4fb4669d68469b1c58f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 019a796394d6b8484225fe133c24c0e502b219f6)

4 years agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 40/19540/1
commit | commitdiff | tree
Tibor Frank [Mon, 13 May 2019 12:43:20 +0000 (14:43 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

 - fix model

Change-Id: Ifae4b4039c905c990dda578a620b9ffc232e5786
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c1356fb4855e23d6c939c14045a63483eba01628)

4 years agoCSIT-1500: Add comparison table for SOAK vs NDRPDR 35/19535/1
commit | commitdiff | tree
Tibor Frank [Mon, 13 May 2019 11:56:39 +0000 (13:56 +0200)]
CSIT-1500: Add comparison table for SOAK vs NDRPDR

Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit db2fcb13bab0085abaaa704e87e345d43734ac86)

4 years agoReport: Add SOAK Tests 31/19531/1
commit | commitdiff | tree
Tibor Frank [Mon, 13 May 2019 08:56:18 +0000 (10:56 +0200)]
Report: Add SOAK Tests

Change-Id: I22eec7cf8ff25958218d4b8ac6bab5a34b2f206c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 80950e65bd14f6425127f7073b960a1fb2c3c4f7)

4 years agoCSIT-1488: Add data to the Report 1904 29/19529/1
commit | commitdiff | tree
Tibor Frank [Mon, 13 May 2019 08:39:21 +0000 (10:39 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6e35ba3a89e02fa1e34e5ef637598cb6e22baaaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 36b2dffd55dee362d96aae98d563a0c2b475573e)

4 years agoReport: Configuration for 1904.20 27/19527/1
commit | commitdiff | tree
Tibor Frank [Mon, 13 May 2019 08:00:32 +0000 (10:00 +0200)]
Report: Configuration for 1904.20

Change-Id: I4bbf1ed196947cc290de943b1e39721021d9d7d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9cf8c5c4a70a478c9e74cdec398098fd8138d491)

4 years agoReport: Add pdf version 18/19518/1
commit | commitdiff | tree
Tibor Frank [Fri, 10 May 2019 14:28:50 +0000 (16:28 +0200)]
Report: Add pdf version

Change-Id: I6d4770b163844bb5b30d62b2becac13714702b06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b286895595c5d7a674e3accd2fb03810d1cd9827)

4 years agoPLRsearch: Use stat trackers to shorten Integrator 15/19515/1
commit | commitdiff | tree
Vratko Polak [Wed, 2 Jan 2019 13:18:50 +0000 (14:18 +0100)]
PLRsearch: Use stat trackers to shorten Integrator

+ Extract several tracker classes and use them in Integrator.
+ Apply next_rate workarounds to focus more on critical region.
+ Rewrite stretch function, as the previous implementation was wrong.
+ Rework logging:
++ Use injected trace() function in Integrator.
++ Inject function that skips trace logging on default initialization.
++ Use the same multiprocessing-safe passing, but separate queue.
+ Set duration to 120m in Robot, but keep at 30m in Python.
+ Apply minor changes to make computations more reproducible:
++ Attempt to log everything needed by reproducibility in one line.
++ Log samples used, and make it settable as upper limit.
++ Use repr output in TRex scripts, to avoid rounding when copypasting.
+- Numpy seems to be sharing PRNG between processes.
+-- An edit to disable one thread is needed for full reproducibility.
+-- Such an edit is prepared, but will not be merged anytime soon.

Change-Id: Icf56429b34ab6de2d18a12e6c676e2d242b3ba4c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: Add message if no oper data is present 14/19514/1
commit | commitdiff | tree
Tibor Frank [Fri, 10 May 2019 14:25:12 +0000 (16:25 +0200)]
Report: Add message if no oper data is present

Change-Id: Ic70f603a652ae1297aba29187d1f61f30678be41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 217c3803fc75fd0388b2326593447038647f28bd)

4 years agoUpdate perf release notes 1904 12/19512/1
commit | commitdiff | tree
Peter Mikus [Fri, 10 May 2019 14:13:41 +0000 (14:13 +0000)]
Update perf release notes 1904

Change-Id: Ia74d6270ef0b654efb77a369f240e7a9c53156c5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit f99ce0d330567ef331f6622559e4561485378f5f)

4 years agoReport: Hide DMM 11/19511/1
commit | commitdiff | tree
Tibor Frank [Fri, 10 May 2019 14:13:43 +0000 (16:13 +0200)]
Report: Hide DMM

Change-Id: Ib1381365b01cecb701a956a22131d2b4fe1a3b60
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4dc14417a7c412520121178dd184eecaf292c5e1)

4 years agoreport: added missing sub-section header in methodology throughput 08/19508/1
commit | commitdiff | tree
Maciek Konstantynowicz [Fri, 10 May 2019 14:07:00 +0000 (15:07 +0100)]
report: added missing sub-section header in  methodology throughput

Change-Id: Iadeaca5d39be051ef334f98e50a6a17210c503bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit c1f2df2b6f3ce5c7bbaef7749a55a79f9607bace)

4 years agoFIX: Missing show run data in NDRPDR 06/19506/1
commit | commitdiff | tree
Peter Mikus [Fri, 10 May 2019 11:59:18 +0000 (11:59 +0000)]
FIX: Missing show run data in NDRPDR

Change-Id: If4b013ef4bf4bc8f857913f3847ab3b2e2aa5a5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: NFV density - diff as integer 03/19503/1
commit | commitdiff | tree
Tibor Frank [Fri, 10 May 2019 12:31:53 +0000 (14:31 +0200)]
Report: NFV density - diff as integer

Change-Id: Iab093484375418765812707935193b35d8b07d3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 97b7e5fc8b7c1fc8127bc23b383167f04684b5ee)

4 years agoUpdate PLRsearch methodology to latest code 01/19501/1
commit | commitdiff | tree
Vratko Polak [Fri, 10 May 2019 11:33:22 +0000 (13:33 +0200)]
Update PLRsearch methodology to latest code

Deleted much of terms and generalized descriptions,
added more details on the current implementation.

- Still with old graphs

Change-Id: I9ba6b40d1d9d36d4f10382f60c756f5bc4708e4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 03363a60e2b38976aba91b110cd2040e1fda2401)

4 years agoReport: Add message if no oper data is present 00/19500/1
commit | commitdiff | tree
Tibor Frank [Fri, 10 May 2019 10:50:13 +0000 (12:50 +0200)]
Report: Add message if no oper data is present

Change-Id: I9295dd21934bf5d7f14b282ee5830056362581c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4ba1fd8d55a6fefa3349fcf221aece3a345e3ca2)

4 years agoreport: edits of methodology mlrsearch section 97/19497/1
commit | commitdiff | tree
Maciek Konstantynowicz [Fri, 10 May 2019 10:05:15 +0000 (11:05 +0100)]
report: edits of methodology mlrsearch section

Change-Id: I80b4f8223d2991e258ab422c447bdc09d92c9e9c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b4b1c9bf381c1570a15651dfb1997a657cbbcc92)

4 years agoCSIT-1488: Add data to the Report 1904 96/19496/1
commit | commitdiff | tree
Tibor Frank [Fri, 10 May 2019 10:12:37 +0000 (12:12 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I36e6b6247a213960047f48d3e1ef5b57564cf242
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e79a1eed9da5aa88e783d442743025b3fc73ba77)

4 years agoReport: VPP_func update 2 94/19494/1
commit | commitdiff | tree
Jan Gelety [Fri, 10 May 2019 09:21:46 +0000 (11:21 +0200)]
Report: VPP_func update 2

Change-Id: I840f61211bd01e26862ae7af40522a82ce8cfb25
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 24c3dd59d7a004bc6353e13d750b9ced098cf52d)

4 years agoRelease notes: 1904 86/19486/2
commit | commitdiff | tree
Peter Mikus [Fri, 10 May 2019 07:46:43 +0000 (07:46 +0000)]
Release notes: 1904

Change-Id: I3b075b210f3e3c126d049799aea15f6b75235677
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoUpdate release notes 1904 93/19493/1
commit | commitdiff | tree
Peter Mikus [Fri, 10 May 2019 09:12:07 +0000 (09:12 +0000)]
Update release notes 1904

Change-Id: Ib31d809b2c1741374fe3bd03e21adea6336bc7f5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoreport: further edits of methodology throughput sections 90/19490/1
commit | commitdiff | tree
Maciek Konstantynowicz [Thu, 9 May 2019 11:39:52 +0000 (12:39 +0100)]
report: further edits of methodology throughput sections

Change-Id: I571d1a47743eb31ee10caf3f3336ac7437daf878
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 342ba492f7066402e35654199193e20135f39b6d)

4 years agoReport: VPP_func update 89/19489/1
commit | commitdiff | tree
Jan Gelety [Thu, 9 May 2019 12:46:44 +0000 (14:46 +0200)]
Report: VPP_func update

Change-Id: I7d551e4d62b1678347c8c5c08a42201567a497cf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 7ea52a880f33af192445b3c67ec66d55e4308153)

4 years agoReport: Hide wrk 83/19483/1
commit | commitdiff | tree
Tibor Frank [Fri, 10 May 2019 06:39:10 +0000 (08:39 +0200)]
Report: Hide wrk

Change-Id: Id1902a98c9a533e87aefd1d14fd936d5c5b90f5f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ffba1abc9bcb0103f295d2593ec1ca16de826717)

4 years agoReport: hide soak tests 67/19467/1
commit | commitdiff | tree
Tibor Frank [Thu, 9 May 2019 11:43:21 +0000 (13:43 +0200)]
Report: hide soak tests

Change-Id: I0c738764aaf16b5858d70d7a9fda6752b912cc01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c4f2951030265f6b32e18d44278dbd9f59ae1383)

4 years agoReport: nfv density graphs - update static content 64/19464/1
commit | commitdiff | tree
Tibor Frank [Thu, 9 May 2019 11:36:30 +0000 (13:36 +0200)]
Report: nfv density graphs - update static content

Change-Id: Ia271330e86fdba1332bb12890458a953c4e0832c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f5319efb9812adee82aecca22ce80a7469752728)

4 years agoReport: Remove Denverton 62/19462/1
commit | commitdiff | tree
Tibor Frank [Thu, 9 May 2019 11:19:26 +0000 (13:19 +0200)]
Report: Remove Denverton

Change-Id: I1c1fa3b466feb24b647255f2b0f70c2cff4cbf0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e0db487320596ce7fbdd29bd121969878297e12a)

4 years agoReport: Remove Ligato 60/19460/1
commit | commitdiff | tree
Tibor Frank [Thu, 9 May 2019 08:16:34 +0000 (10:16 +0200)]
Report: Remove Ligato

Change-Id: Ia530ef2fb21968852a5366a1bf1c4d0521002c5b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1c207fa820cc52be70737b61090287b0eb7030af)

4 years agoCSIT-1488: Add data to the Report 1904 54/19454/1
commit | commitdiff | tree
Tibor Frank [Thu, 9 May 2019 07:13:38 +0000 (09:13 +0200)]
CSIT-1488: Add data to the Report 1904

- HoneyComb

Change-Id: I0f7d6ef4368d347c245b8962d3ce346b73d5932a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0bc47f9db5dd143e79e384ba04400138dd0fe033)

4 years agoCSIT-1492: Add NF density tests 50/19450/1
commit | commitdiff | tree
Tibor Frank [Thu, 9 May 2019 07:39:55 +0000 (09:39 +0200)]
CSIT-1492: Add NF density tests

Change-Id: I6723485ce71262de13e703b975a551d97f18e968
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 97ab320c545cb4dffd45545f1b2fa73938919406)

4 years agoCSIT-1488: Add data to the Report 1904 47/19447/1
commit | commitdiff | tree
Tibor Frank [Thu, 9 May 2019 07:01:44 +0000 (09:01 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I88ae579e6061d381c0efa5d7611c4af263ae92d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 74948cd5abd8e429705ba1c7779852d2899e6296)

4 years agoCSIT-1488: Add data to the Report 1904 46/19446/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 08:02:31 +0000 (10:02 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I36449f11d5ab22a97959ba60737cd5d01f1c0618
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 97f1661c2353b0eaf798023efe1323cc796e7a4f)

4 years agoReport: NFV Graphs 44/19444/1
commit | commitdiff | tree
Tibor Frank [Thu, 9 May 2019 06:20:56 +0000 (08:20 +0200)]
Report: NFV Graphs

Change-Id: Id27e66c62b094d1b5dc70710cc7880f06e56b907
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 936155da5e05d87ce8a247ddb744090e99d055bb)

4 years agoreport: edits to methodology_kvm_vms_vhost_user 35/19435/1
commit | commitdiff | tree
Maciek Konstantynowicz [Wed, 8 May 2019 13:57:19 +0000 (14:57 +0100)]
report: edits to methodology_kvm_vms_vhost_user

Change-Id: Iaa2cd0bbe6171ac800489b897ddae079332b48ee
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 3a5e059cfbe8961799fb5e89e716c506175332d7)

4 years agoreport: edits of methodology throughput sections 31/19431/1
commit | commitdiff | tree
Maciek Konstantynowicz [Wed, 8 May 2019 11:13:42 +0000 (12:13 +0100)]
report: edits of methodology throughput sections

Change-Id: I9ed1c2d67bc53f98d36ad17afb9153de5e944b7f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit cc7a7eea385534107bfdae744797d68782488a5e)

4 years agoReport: NFV Graphs 24/19424/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 15:44:49 +0000 (17:44 +0200)]
Report: NFV Graphs

Change-Id: I75055264a1b1bc250174eb72228a1f0d5d74b313
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 23185b233e4dd7984a404aa54d5dd0da2502074b)

4 years agoReport: NFV Graphs 23/19423/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 14:25:42 +0000 (16:25 +0200)]
Report: NFV Graphs

Change-Id: I5fd192c2e010226a3e081b3c4e66265dd9654740
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6fb043d8e4450d7db31a5f5903e84f600aa807a4)

4 years agoReport: NFV Graphs 22/19422/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 12:55:19 +0000 (14:55 +0200)]
Report: NFV Graphs

Change-Id: I62a6e2f337d198cd2c4da7ba0bd1b1b9752310ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit edc3b6e9a4668deb838c2f63d80bc0ebfe80324d)

4 years agoReport: NFV Graphs 21/19421/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 12:46:30 +0000 (14:46 +0200)]
Report: NFV Graphs

Change-Id: I8763f7977a48405787f93e34e750b47c5742c798
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d9bc2574c7b51e1f60fb061e2d57c00712fc2943)

4 years agoReport: NFV Graphs 08/19408/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 11:46:40 +0000 (13:46 +0200)]
Report: NFV Graphs

Change-Id: I0f395d4bd2ec090e55f6650ea9042a77e82ead4d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 08f078f5722d7c171ee83e92fdf8642fa441e8bd)

4 years agoReport: Fix NFV Graphs 03/19403/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 10:24:38 +0000 (12:24 +0200)]
Report: Fix NFV Graphs

Change-Id: If11ed726cb75134c24cde3a752d2e72188bbe3a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 06785b385fb4acf5fd5f20ce3ee7a46e0b863c06)

4 years agoReport: NFV Service Density - color bar tilte 94/19394/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 08:41:27 +0000 (10:41 +0200)]
Report: NFV Service Density - color bar tilte

Change-Id: I01014a5247994b5acb01c6d62d9178e4ddbcd025
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit dc85b05f17bb6d04b4c6b4126590f28b6014b9a5)

4 years agoCSIT-1488: Add data to the Report 1904 86/19386/1
commit | commitdiff | tree
Tibor Frank [Tue, 7 May 2019 06:18:45 +0000 (08:18 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I19d20c6c68b7b280c8fc7c2bba4e5ce4c660a2d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0e1bfdb3c86751226afa7417954cda54523aa2bd)

4 years agoCSIT-1492: Add NF density tests: Models and data 74/19374/1
commit | commitdiff | tree
Tibor Frank [Mon, 6 May 2019 12:58:39 +0000 (14:58 +0200)]
CSIT-1492: Add NF density tests: Models and data

Change-Id: I010fbf9acffc5a613e7b67810f66822ba2e46f42
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 11078ca1d19903e33c705e7e59f430aa8e49757c)

4 years agoCSIT-1492: Add NF density tests: Models and data 70/19370/1
commit | commitdiff | tree
Tibor Frank [Mon, 6 May 2019 12:08:55 +0000 (14:08 +0200)]
CSIT-1492: Add NF density tests: Models and data

Change-Id: Icad4c04e45224f694bc484eef6e6dd7903c2f136
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eaf112019c3501d39714d92d36e92565b4f76123)

4 years agoCSIT-1492: Add new NF density tests to report 65/19365/1
commit | commitdiff | tree
Tibor Frank [Thu, 25 Apr 2019 10:58:43 +0000 (12:58 +0200)]
CSIT-1492: Add new NF density tests to report

Change-Id: Ifdfac80f7fd25124cb08a467329d6c8c525ffc06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1f47e6144f553c7fb510c93a5b14b1b4d6c4648a)

4 years agoCSIT-1488: Add data to the Report 1904 53/19353/1
commit | commitdiff | tree
Tibor Frank [Mon, 6 May 2019 08:20:12 +0000 (10:20 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I49b1f3d9e2ac422ddae8382828756476a696a2c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1c54bfd3bdfafe2764394f6540fd35f708bf2239)

4 years agoReport: Configure the version 47/19347/1
commit | commitdiff | tree
Tibor Frank [Mon, 6 May 2019 07:13:35 +0000 (09:13 +0200)]
Report: Configure the version

Change-Id: I29240b2286f48cc8027d97c9c1895c51b2a11ca5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7d977f33e0e72db063ead4d6c33c213c114e6e26)

4 years agoreport 1904: updated methodology (nfv density, startup.conf) and vpp perf rls notes 34/19334/1
commit | commitdiff | tree
Maciek Konstantynowicz [Thu, 2 May 2019 18:20:38 +0000 (19:20 +0100)]
report 1904: updated methodology (nfv density, startup.conf) and vpp perf rls notes

Change-Id: If6d24511d5d29dcc25c21437364e0da15af3cca1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a8c3f441fa595311f60bcc634a2720f204ced733)

4 years agoUpdate KVM methodology 27/19327/1
commit | commitdiff | tree
Peter Mikus [Fri, 3 May 2019 06:32:17 +0000 (06:32 +0000)]
Update KVM methodology

Change-Id: I8be9b9295b691a1ec4b810e3a1255ad1bc6947ab
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 11173c99a4416de8970fe67cef4fff2d9119ef14)

4 years agoCSIT-1488: Add data to the Report 1904 25/19325/1
commit | commitdiff | tree
Peter Mikus [Fri, 3 May 2019 12:49:40 +0000 (12:49 +0000)]
CSIT-1488: Add data to the Report 1904

Change-Id: I7d63d16164e0cf54d74cc0b7286cde50a6e71404
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 70e8dc786c91f2d57d8fe3c3421ba2d1849dd297)

4 years agoNF density tests with dtc=0.5 and dtcr=2 89/19189/2
commit | commitdiff | tree
Peter Mikus [Fri, 19 Apr 2019 06:40:44 +0000 (06:40 +0000)]
NF density tests with dtc=0.5 and dtcr=2

Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 53/19253/1
commit | commitdiff | tree
Tibor Frank [Tue, 30 Apr 2019 10:35:18 +0000 (12:35 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ibf630b85f2e7b164847628efb9969edba753eb74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8754c3d7a7cfa6399a5d20720f483c22a43b318b)

4 years agoUpdate report static content 42/19242/1
commit | commitdiff | tree
Peter Mikus [Mon, 29 Apr 2019 09:34:59 +0000 (09:34 +0000)]
Update report static content

Change-Id: I8aef71fb2cc09d2c7862884f7ca68c9786ad5165
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit a611ee796ea6b224018953c276e67900b212dc44)

4 years agoCSIT-1488: Add data to the Report 1904 26/19226/1
commit | commitdiff | tree
Tibor Frank [Mon, 29 Apr 2019 11:21:10 +0000 (13:21 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Iec3270ccff9db2d8532f6f0d11640bf65d7f9ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ad4f18fdb7b46c3c2b95813c1fdbe428295ef61b)

4 years agoReport: Configure the version 12/19212/1
commit | commitdiff | tree
Tibor Frank [Mon, 29 Apr 2019 08:40:46 +0000 (10:40 +0200)]
Report: Configure the version

Change-Id: I064b16e0a2b7f96e4590622be340ab657d785f16
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a839a1092c783f0d94f3ab0297505832161cd584)

4 years agoFIX: Change buffers per numa base on SMT 86/19186/1
commit | commitdiff | tree
Peter Mikus [Fri, 26 Apr 2019 10:29:53 +0000 (10:29 +0000)]
FIX: Change buffers per numa base on SMT

Change-Id: I4955210e2c723d4b91d8829ac42e47937d17833f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agofix removal of build packages for honeycomb 84/19184/2
commit | commitdiff | tree
Michal Cmarada [Fri, 26 Apr 2019 10:41:14 +0000 (12:41 +0200)]
fix removal of build packages for honeycomb

Change-Id: I19be5008067067c2e7c78e7673a9ceaaf2f52c8f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 63/19163/1
commit | commitdiff | tree
Tibor Frank [Thu, 25 Apr 2019 10:51:27 +0000 (12:51 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6f787445c0f4e91e4fbde7787c49d08d412347a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d24bd1cff07fb5712c280970be02c9473cf3b8e8)

4 years agoCSIT-1489: Change graphs to display results by suite generator 59/19159/1
commit | commitdiff | tree
Tibor Frank [Tue, 23 Apr 2019 12:31:13 +0000 (14:31 +0200)]
CSIT-1489: Change graphs to display results by suite generator

Change-Id: I00fdc7ce87be5cecf5883ed2c991a8e67efd2e2a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cc7ced86fd14dcafc5e6146a2e30e630429e211c)

5 years agoUse vpp 19.04-release pacakges 55/19155/1
commit | commitdiff | tree
Jan Gelety [Sun, 14 Apr 2019 14:23:56 +0000 (16:23 +0200)]
Use vpp 19.04-release pacakges

Change-Id: I646697114732f67e8f0d382ef0310025046e619c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: Crypto tests 53/19153/1
commit | commitdiff | tree
Peter Mikus [Wed, 24 Apr 2019 05:53:02 +0000 (05:53 +0000)]
FIX: Crypto tests

- By adding crypto_ipsecmb.so into the list of loaded plugins

Change-Id: I52de9b410441422ad8e337208f40360fbdea264d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: Large number of interfaces and worker threads 43/19143/1
commit | commitdiff | tree
Peter Mikus [Mon, 8 Apr 2019 12:42:08 +0000 (12:42 +0000)]
FIX: Large number of interfaces and worker threads

Add buffers-per-numa (previously num-mbuf)

Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: TAP tests fix 2 09/19109/2
commit | commitdiff | tree
Jan Gelety [Sun, 14 Apr 2019 02:00:12 +0000 (04:00 +0200)]
FIX: TAP tests fix 2

Change-Id: Ie9591fe3d72f27be0b4cba21c7b0868ed5118de4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFIX: VTS pinning issue. 05/19105/1
commit | commitdiff | tree
Peter Mikus [Tue, 23 Apr 2019 08:43:12 +0000 (08:43 +0000)]
FIX: VTS pinning issue.

Change-Id: I12a79605a925c00d9c41b7115bc7cbb7f2cd49c1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit cfd18a4206f1bada43069d7da55f8400dcfd0c6c)

4 years agoCSIT-1488: Add data to the Report 1904 02/19102/1
commit | commitdiff | tree
Tibor Frank [Tue, 23 Apr 2019 09:57:23 +0000 (11:57 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I2ba9eeedf5668b5a99acbe0d26add2aa0a836a9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2ed4d8c5c1b039944335b3113dd053784d64d8b8)

4 years agoFIX: Create TAP interface after API change 99/19099/2
commit | commitdiff | tree
Jan Gelety [Sat, 13 Apr 2019 23:57:33 +0000 (01:57 +0200)]
FIX: Create TAP interface after API change

Change-Id: Ib39671dcb808142037c2950b8b02b9aa64d72a3b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 96/19096/1
commit | commitdiff | tree
Tibor Frank [Tue, 23 Apr 2019 08:45:46 +0000 (10:45 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Idab323612b20ae06d92bd81310abdb1d44c6c9a7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 404b2492fe828c3e1ab36b679fda7d84a727ec6e)

4 years agoCSIT-1487: Configure PAL for the Report 1904 90/19090/1
commit | commitdiff | tree
Tibor Frank [Tue, 23 Apr 2019 07:01:12 +0000 (09:01 +0200)]
CSIT-1487: Configure PAL for the Report 1904

- change the week number
- add pdf generation
- change ubuntu and centos images

Change-Id: Iadea2f3dd9cfd77b508bf16ffd154bbd4f1145bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 682304e2d3d321ba3715b21ff31549937d56cc2f)

5 years agoReport: Static content 37/19037/1
commit | commitdiff | tree
Tibor Frank [Thu, 18 Apr 2019 12:40:53 +0000 (14:40 +0200)]
Report: Static content

Change-Id: If8e2593dcaff368b2c7e191f70bab15e8974bb38
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 012b57e651e4c3fc010dea49235aafd16b3bef66)

5 years agoCSIT-1487: Configure PAL for the Report 1904 25/19025/1
commit | commitdiff | tree
Tibor Frank [Wed, 17 Apr 2019 13:54:45 +0000 (15:54 +0200)]
CSIT-1487: Configure PAL for the Report 1904

Change-Id: I4f112693a3b50665a9c53290de42d8e365c6d415
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3969bc368a73f12ab3550b87ef6102c209c66676)

5 years agoUpdate of VPP_STABLE_VER files 02/19002/2
commit | commitdiff | tree
Jan Gelety [Sat, 13 Apr 2019 17:04:44 +0000 (19:04 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.04-rc2~1-g11ee93f~b21

- use new vpp ref build - ubuntu 18.04:
  19.04-rc2~1-g11ee93f6a

- use new vpp ref build - centos7:
  19.04-rc2~1_g11ee93f~b22

Change-Id: I12afe5cbb5a0e3067c770838f983f096a19051f9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoAdd perpatch info to cpta methodology 09/19009/1
commit | commitdiff | tree
Vratko Polak [Tue, 16 Apr 2019 16:59:33 +0000 (18:59 +0200)]
Add perpatch info to cpta methodology

Also, split methodology file into multiple, per section.

Change-Id: I973b93d1a99205d7adb80996a3657215e05b8985
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4f2d0c379b50b66e70d9615fc8425cd4772f7738)

5 years agoCSIT-1482: Change trending graphs 06/19006/1
commit | commitdiff | tree
Tibor Frank [Thu, 11 Apr 2019 11:44:02 +0000 (13:44 +0200)]
CSIT-1482: Change trending graphs

- Change trending graphs to display results when using suite  generator

Change-Id: I4f822c180f9c206be19a9c75ce105c2225ad9171
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 07111b63caa5f162c0921b5a91a4de2d13505a7d)

5 years agoCentos 7.6-1810 image update. 95/18995/1
commit | commitdiff | tree
Thomas F Herbert [Sun, 14 Apr 2019 19:12:10 +0000 (15:12 -0400)]
Centos 7.6-1810 image update.

Add python36 and update qemu to 2.12.
add boost-filesystem

Change-Id: I89bba0b807be6d6c2d98b2f07faae9c31b3370e1
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
(cherry picked from commit 3384969a087da01d261c3b9e381add2c43721b6a)

5 years agoCSIT-1483: Add processing of output_info.xml as the first choice 68/18968/1
commit | commitdiff | tree
Tibor Frank [Mon, 15 Apr 2019 12:17:05 +0000 (14:17 +0200)]
CSIT-1483: Add processing of output_info.xml as the first choice

Change-Id: I27687ed6dda3a8717538653e75ad0d61c6516c7e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5aa2e158983f61df6d26129ad566b906051fc5b5)

5 years agoAdd 2n AVF tests 41/18941/1
commit | commitdiff | tree
Peter Mikus [Fri, 12 Apr 2019 17:53:29 +0000 (17:53 +0000)]
Add 2n AVF tests

- Side effect of other troubleshooting, but better to
merge then throw away.

Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUse package location for apt-cache show command 24/18924/1
commit | commitdiff | tree
Jan Gelety [Sat, 13 Apr 2019 01:23:04 +0000 (03:23 +0200)]
Use package location for apt-cache show command

Change-Id: I141baa77c78ec467a56fcafb86061efe198dca9d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit c4e29c78d3eaafc6e340390a2623d3fa55b54ea3)

5 years agoRemove obsolete QEMU installation 90/18890/1
commit | commitdiff | tree
Peter Mikus [Sat, 13 Apr 2019 06:15:25 +0000 (06:15 +0000)]
Remove obsolete QEMU installation

+Unify QEMU parameter to Contants.

Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 0e0cf38fcd1ff704293c9dd2c7a05f8682e11de9)

5 years agoAdd output.xml with only INFO logging leve 77/18877/1
commit | commitdiff | tree
Peter Mikus [Thu, 11 Apr 2019 08:36:06 +0000 (08:36 +0000)]
Add output.xml with only INFO logging leve

- Useful for post-processing.

Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit cc0c2870a18fb74a56410eca2d1870bddc945397)

5 years agoAlerts: Change the error message 67/18867/1
commit | commitdiff | tree
Tibor Frank [Thu, 11 Apr 2019 12:28:00 +0000 (14:28 +0200)]
Alerts: Change the error message

Change-Id: I0fcd6ffaf24de0f6ce95eaba3d591eddf3f16b33
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 18422fd2221c2474f07450280a7af1a06b1c2207)

5 years agoFix pylint error in PapiExecutor 64/18864/1
commit | commitdiff | tree
Vratko Polak [Fri, 12 Apr 2019 11:22:00 +0000 (13:22 +0200)]
Fix pylint error in PapiExecutor

+ Remove ret_val as it cannot be nonzero outside _execute_papi.
+ Change indentation to save vertical space.
+ Return computed values without storing them to variable.
+ Add TODO to remove duplicated method.
+ Add missing fields to docstring.
+ Minor formatting changes.

Change-Id: I8e8f41d139de8aff3b76a7fe27ee450e89e8d1de
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 5899ac744eb5f722f53151c98e5acfdbdf678d0c)

5 years agoAdd DPDK install to ansible 56/18856/1
commit | commitdiff | tree
Peter Mikus [Fri, 12 Apr 2019 20:22:05 +0000 (20:22 +0000)]
Add DPDK install to ansible

Change-Id: If838c2a008ffd5bdf458c76d729f57b47e225b41
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit de305de0b89f083037bdac86bb8f3739f5eeecf9)

5 years agoConvert existing nf_density testpmd-mac into KernelVM 55/18855/1
commit | commitdiff | tree
Peter Mikus [Mon, 8 Apr 2019 12:31:25 +0000 (12:31 +0000)]
Convert existing nf_density testpmd-mac into KernelVM

Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 96a3c5c7ace8357d26e833a46845486787aa75c3)

5 years agoUpdate of VPP_REPO_URL and VPP_STABLE_VER files 29/18829/2
commit | commitdiff | tree
Jan Gelety [Tue, 9 Apr 2019 22:02:55 +0000 (00:02 +0200)]
Update of VPP_REPO_URL and VPP_STABLE_VER files

- use vpp builds from vpp stable/1904 branch

- use new vpp ref build - ubuntu 16.04:
  19.04-rc1~b4

- use new vpp ref build - ubuntu 18.04:
  19.04-rc1~b5

- use new vpp ref build - centos7:
  19.04-rc1~b4

Change-Id: I4d44a5f0d2e2e2760e3156ffee411e1e75800358
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoUpdate defaultbranch in rls1904 13/18813/1
commit | commitdiff | tree
Vratko Polak [Thu, 11 Apr 2019 12:04:04 +0000 (14:04 +0200)]
Update defaultbranch in rls1904

Change-Id: Iae245f30f540536ca79d00396b27380979c13f40
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoTrending: Reduce input data 84/18784/8
commit | commitdiff | tree
Tibor Frank [Wed, 10 Apr 2019 07:42:13 +0000 (09:42 +0200)]
Trending: Reduce input data

Change-Id: Ia787036e4a717b9693df09fc75738369d6d39b57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agofix auth for newer ODL versions 66/18766/2
commit | commitdiff | tree
Michal Cmarada [Tue, 9 Apr 2019 14:53:46 +0000 (16:53 +0200)]
fix auth for newer ODL versions

Since oxygen we need to add also "-p karaf" argument when
starting karaf and because we are not using older versions
anymore we can remove the if condition and use new authentication
by default.

Change-Id: I458fa35b7f26222dd5562349e6859844bfb7d05f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoAdd vagrant setup for testing VPP device locally 43/17343/3
commit | commitdiff | tree
Ludovit Mikula [Wed, 6 Feb 2019 14:47:23 +0000 (15:47 +0100)]
Add vagrant setup for testing VPP device locally
Fixed trailing whitespaces
Fixed tabs vs. spaces
Removed dead code
Changed network interface naming
Changed default number of retries for VPP startup to 120
Updated number of hugepages during provisioning
Externalized CSIT related sysctl settings to 90-csit.conf
Removed hardcoded local docker image name.
Added new interface required for honeycomb device testing.

Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
5 years agoAdd support DHCP Server Support for DNV 49/18749/4
commit | commitdiff | tree
Ray Kinsella [Mon, 8 Apr 2019 15:29:59 +0000 (16:29 +0100)]
Add support DHCP Server Support for DNV

Adding DHCP Server support for 2-node and 3-node DNV setups

Change-Id: If3d3517fd91ab46308c368910c1e79f5c25cc904
Signed-off-by: Ray Kinsella <ray.kinsella@intel.com>
5 years agoUpdate of ubuntu VPP_STABLE_VER 30/18730/2
commit | commitdiff | tree
Jan Gelety [Wed, 3 Apr 2019 01:39:11 +0000 (03:39 +0200)]
Update of ubuntu VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.04-rc0~640-g05f7ca1~b6800

- use new vpp ref build - ubuntu 18.04:
  19.04-rc0~640-g05f7ca110

Change-Id: I940b044210d3a552fb2af75359f62795230cd2ad
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoupdate tests after ODL bump to Neon 16/18616/14
commit | commitdiff | tree
Michal Cmarada [Tue, 9 Apr 2019 06:12:05 +0000 (08:12 +0200)]
update tests after ODL bump to Neon

Change-Id: Ia733ad304c51b28f2a945e570120821254077189
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoFix l2 Honeycomb tests 37/18737/3
commit | commitdiff | tree
Michal Cmarada [Mon, 8 Apr 2019 10:27:32 +0000 (12:27 +0200)]
Fix l2 Honeycomb tests

Change-Id: Ic75a9279fffe3a5d11211f4e57fc635d7d33ee5f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoUpgrade autogen to NICs and search types 11/17811/84
commit | commitdiff | tree
Vratko Polak [Thu, 4 Apr 2019 11:45:11 +0000 (13:45 +0200)]
Upgrade autogen to NICs and search types

+ All perf suites updated, as autogen change is backward incompatible.
+ Only x710 -ndrpdr suites remain in git repository.
+ Removed retry feature of run_tests.
+ Renamed topology_type and traffic_type to traffic_profile.
+ Renamed framesize to frame_size; nic_model to nic_name.
+ Reordered Variables table to start with nic_name and overhead.
+ Fixed wrong overhead value in some cbc-sha1 suites.
+ Fixed some suite tags.
++ Introduced tags to distinguish suites, such as IPSECINT.
+ Bound crypto hardware to NIC name.
+ Implemented NIC limit hiding.
+ Also search and teardown related arguments are now hidden.
+ Main measurement keywords updated to new arg handling.
+ Max rate related keywords moved to performance_limits.robot
+ Teardowns unified.
+ Generated tests are archived.
++ Generated directory is .gitignore-d.
+ Regenerator raises an exception on seeing non-compatible suite.
++ Relatively helpful message should be seen in exception.
+ Suite and template Documentation has generated parts.
+- With short NIC names only.
+ Autogen checker also upgraded.
+ Tag expressions replaced with long files to ensure analogous tests.

Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
next
Integration tests