csit.git
37 hours agoAvoid ci-management archiving files twice 41/30041/7 master
Vratko Polak [Thu, 26 Nov 2020 09:25:06 +0000 (10:25 +0100)]
Avoid ci-management archiving files twice

This is a follow-up to https://gerrit.fd.io/r/c/csit/+/20394

https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).

The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directtories,
usually archives/ and archives/archive/.

This change renames copy_archives to move_archives,
with few workarounds to support multiple calls.

I also renamed ARCHIVE_DIR value from $CSIT_DIR/archive
to $CSIT_DIR/archives to make "move" operation look natural.

Finally, download_builds function is being removed,
as after recent improvements to VPP compilation speed
nobody seems to be using it.

Change-Id: I19a429e1dfdfaab7fcf32a9609963b1aebd33c6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
42 hours agoAPI: deprecated NAT APIs 52/30152/5
Jan Gelety [Wed, 25 Nov 2020 20:49:11 +0000 (21:49 +0100)]
API: deprecated NAT APIs

Jira: CSIT-1597

Change-Id: Ib48d20ba087bc9828970c3acc081ac6e4447c20c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 days agoTerraform: Nomad resource definitions 09/30209/6
pmikus [Tue, 1 Dec 2020 07:38:28 +0000 (07:38 +0000)]
Terraform: Nomad resource definitions

+ storage
  - final until more ssd arive.
+ nginx
  - final
+ vpp_device
  - untested yet (restored from EdK setups)
  - to be rewritten

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib9499fc8cfb0d9f5c5d5bbd1ccd856ecc951ec2a

2 days agoTolerate base64 encoded Gerrit comments 10/30210/3
Vratko Polak [Tue, 1 Dec 2020 10:41:18 +0000 (11:41 +0100)]
Tolerate base64 encoded Gerrit comments

+ Move "|| true" to a place that really aviods errors.
+ Attemp to parse decoded string if trigger is not found in plain one.

Change-Id: If3587229ec588f9ad41acb3050add1142032d2d8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 days agoIntel E810 hardware onboarding 98/29998/2
pmikus [Thu, 19 Nov 2020 10:29:26 +0000 (10:29 +0000)]
Intel E810 hardware onboarding

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia055011626212472f65d18a5c1a10440973ecd48

3 days agoReport: Add data 06/30206/1
Tibor Frank [Tue, 1 Dec 2020 06:22:17 +0000 (07:22 +0100)]
Report: Add data

Change-Id: Ib095788b071c74131351045df80ab373f067f1a7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 days agoansible: remove yul2 hosts from nomad server pool 46/28946/3
Dave Wallace [Fri, 18 Sep 2020 14:33:45 +0000 (14:33 +0000)]
ansible: remove yul2 hosts from nomad server pool

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Ibcbd95408fb4859a13c7f2659a9e15c5498b788b

3 days agoAnsible: Final consul.d fixes 03/30203/2
pmikus [Mon, 30 Nov 2020 15:33:33 +0000 (15:33 +0000)]
Ansible: Final consul.d fixes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2b5f2d090ac752c85508030c4dfe206023f1184f

3 days agoTrending: Fix links to NAT44 files 96/30196/1
Tibor Frank [Mon, 30 Nov 2020 11:43:41 +0000 (12:43 +0100)]
Trending: Fix links to NAT44 files

Change-Id: Ia19cfa32430c7f12e0093d0b540d23876ca9da8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 days agoTrending: Fix filenames 95/30195/1
Tibor Frank [Mon, 30 Nov 2020 11:04:00 +0000 (12:04 +0100)]
Trending: Fix filenames

Change-Id: Idf754d624443ceef1db5ea5e1d4ab2a9f1c5649b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 days agoUpdate of VPP_STABLE_VER files 89/30189/2
Jan Gelety [Thu, 26 Nov 2020 06:42:09 +0000 (07:42 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~469-g7acab3790

 - use new vpp ref build - centos7:
   21.01-rc0~469_g7acab3790~b129

Change-Id: I99a218543390fd184da4595e75f2491f2d7317b6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 days agoReport: Add data 93/30193/1
Tibor Frank [Mon, 30 Nov 2020 09:03:17 +0000 (10:03 +0100)]
Report: Add data

Change-Id: I38f4054cddf01557e8482adcdc804760ef7a9c4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 days agoTrending: Reorganize the NAT44 chapters 90/30190/1
Tibor Frank [Mon, 30 Nov 2020 08:35:18 +0000 (09:35 +0100)]
Trending: Reorganize the NAT44 chapters

Change-Id: Ifec550ae69c6454d0adbc08d3e49435c3cca380f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 days agoRe-enable 9000B tests for ipsec 07/27907/9
Vratko Polak [Tue, 24 Nov 2020 16:15:52 +0000 (17:15 +0100)]
Re-enable 9000B tests for ipsec

Ticket: CSIT-1771 VPP-1207 VPP-1675

Change-Id: I8ba2d62054361e72b833943327434ea071e7e568
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 days agoinfo: update list of fd.io csit committers 43/30143/2
Maciek Konstantynowicz [Wed, 25 Nov 2020 20:21:14 +0000 (20:21 +0000)]
info: update list of fd.io csit committers

Change-Id: Id608ce2047b7df6df2f07918a59757bb5dd927a6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
7 days agoSupport CLI command change for event logger 47/30147/2
Vratko Polak [Thu, 26 Nov 2020 09:39:01 +0000 (10:39 +0100)]
Support CLI command change for event logger

+ The old command is tried if the new one fails.

Change-Id: I0afdcd7ac699595347b42f3a7d34e1281bb0dc0e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 days agoReport: Add data 50/30150/1
Tibor Frank [Thu, 26 Nov 2020 10:52:46 +0000 (11:52 +0100)]
Report: Add data

Change-Id: If42cacf6c643d35aaa7f65d8e2f87972d23d251b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 days agoReport: Reorganize the NAT44 chapters 07/30107/2
Tibor Frank [Tue, 24 Nov 2020 13:22:32 +0000 (14:22 +0100)]
Report: Reorganize the NAT44 chapters

- packet throughput
- speed-up

Change-Id: I5d49ae2da54170e48c51db47e035d2121471be0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 days agoAnsible: Hashicorp Consul 90/30090/5
pmikus [Mon, 23 Nov 2020 13:56:20 +0000 (13:56 +0000)]
Ansible: Hashicorp Consul

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I56987d744d9143a95954d85f2557cda07220c681

8 days agoTrending: Fix build number in error message. 45/30145/1
Tibor Frank [Thu, 26 Nov 2020 07:45:44 +0000 (08:45 +0100)]
Trending: Fix build number in error message.

Change-Id: I1708ebd24a6a26db53a14192b23fe51569543333
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 days agovpp_device: disable IPv6 in containers 24/29924/6
Juraj Linkeš [Fri, 13 Nov 2020 09:10:07 +0000 (10:10 +0100)]
vpp_device: disable IPv6 in containers

Even with IPv6 nd disabled in VMs, there are IPv6 packets coming from
DuT:
--dut_if2_mac ba:dc:0f:fe:02:05
...
  dst       = 33:33:00:00:00:01
  src       = ba:dc:0f:fe:02:05

Docker disables IPv6 by default on interfaces it manages, which doesn't
include VF interfaces. Disabling IPv6 in containers using sysctl may fix
this.

Change-Id: Idba506653442a3da2cd82e69cedddb3294d92788
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
8 days agoAdd rxq_thr option 03/30103/4
pmikus [Tue, 24 Nov 2020 09:02:48 +0000 (09:02 +0000)]
Add rxq_thr option

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I46750f8571d86dc13df95252e8894c4b988efd5c

8 days agoReport: Update release notes. 11/30111/2
Vratko Polak [Wed, 25 Nov 2020 09:57:49 +0000 (10:57 +0100)]
Report: Update release notes.

+ Expand details on NAT stateless tests added.
+ Clarify situation with jumbo ipsec.

Change-Id: Id6fb7fa48b5fadca7798ec1da7e1baf44d0827aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 days agoReport: Add data 19/30119/1
Tibor Frank [Wed, 25 Nov 2020 07:49:45 +0000 (08:49 +0100)]
Report: Add data

- 2n-zn2 iter

Change-Id: I7412963c918b53e44294f4cf213a806c8435e3b5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 days agoansible: update 3n-tsh hugepages 06/30106/2
Juraj Linkeš [Tue, 24 Nov 2020 10:27:10 +0000 (11:27 +0100)]
ansible: update 3n-tsh hugepages

Fix "Not enough availablehuge pages: 1483!".
Also update 3n-tsh docs.

Change-Id: I1d37a66af1e2363f77fdbd87d238e8ff5535b011
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
9 days agolab: ThunderX2 updates 42/30042/3
Juraj Linkeš [Fri, 13 Nov 2020 08:53:25 +0000 (09:53 +0100)]
lab: ThunderX2 updates

Update after switching one 1n-tx2 and the idle ThunderX2 servers between
racks. Update the idle ThunderX2 specs to a new perf testbed, 2n-tx2.
Add Server-Type-B12 which is a modified Server-Type-B2 with one extra
NIC (needed for 2n-tx2).

Change-Id: I51af358f1feb476652eddfe82b5af1d0d70ac259
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
9 days agoUpdate of VPP_STABLE_VER files 83/30083/2
Jan Gelety [Fri, 20 Nov 2020 16:33:27 +0000 (17:33 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~425-gdc617b8df

 - use new vpp ref build - centos7:
   21.01-rc0~425_gdc617b8df~b85

Change-Id: I517dd83ec2c6f665e22a961ce8193e40896436a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
10 days agoReport: Add 2n-zn2 DPDK Latency 89/30089/1
Tibor Frank [Mon, 23 Nov 2020 13:40:23 +0000 (14:40 +0100)]
Report: Add 2n-zn2 DPDK Latency

Change-Id: Id4738b823a77e59d5efd913f770326726b8a81e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 days agoTrendig: Fix alerting for 2n-zn2 88/30088/1
Tibor Frank [Mon, 23 Nov 2020 10:58:03 +0000 (11:58 +0100)]
Trendig: Fix alerting for 2n-zn2

Change-Id: I4e4d156dcb9d93bf0c537a870e6fab6c500f5810
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 days agoReport: Configure rls2009.48 87/30087/1
Tibor Frank [Mon, 23 Nov 2020 09:44:30 +0000 (10:44 +0100)]
Report: Configure rls2009.48

Change-Id: Ib7c4bc51bea43dafa2bd788c709c800caeb75988
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 days agoReport: Add 2n-zn2 84/29984/5
Tibor Frank [Wed, 18 Nov 2020 15:07:28 +0000 (16:07 +0100)]
Report: Add 2n-zn2

Change-Id: Ifaba0d689a279ae650ae30531b21533cc6927262
Signed-off-by: Tibor Frank <tifrank@cisco.com>
13 days agoTrending: Add 2n-zn2 97/29997/4
Tibor Frank [Thu, 19 Nov 2020 10:21:38 +0000 (11:21 +0100)]
Trending: Add 2n-zn2

Change-Id: I49e2c50829af8f538155b6262ec2872a68560858
Signed-off-by: Tibor Frank <tifrank@cisco.com>
13 days agoPAL: Remove temporary pdf files 43/30043/2
Tibor Frank [Fri, 20 Nov 2020 11:11:41 +0000 (12:11 +0100)]
PAL: Remove temporary pdf files

Change-Id: I65cf505edd346fc5da240be08310064b3755e458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
13 days agoAdd and reorder methodology sections 40/30040/2
Vratko Polak [Fri, 20 Nov 2020 09:29:56 +0000 (10:29 +0100)]
Add and reorder methodology sections

+ DUT state chapter was not reachable.
+ Small reorder to put edits together and sooner.

Change-Id: I2735c522e92e277298e299176b4cdc9be4044c26
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoReport: Add data 37/30037/1
Tibor Frank [Fri, 20 Nov 2020 05:19:12 +0000 (06:19 +0100)]
Report: Add data

Change-Id: I7efb7a339e248972604b1c8027d21ea32e9f4070
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoRemove csit-nat44ed-cps-spec.md 27/29827/9
Vratko Polak [Thu, 19 Nov 2020 15:06:02 +0000 (16:06 +0100)]
Remove csit-nat44ed-cps-spec.md

If some details are still needed, re-add them to
docs/report/introduction/methodology_nat44.rst

Change-Id: I8796dcafff83407eda28719148b9527d2963e6f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoMethodology: Add profile details to nat44 doc 03/29803/12
Vratko Polak [Thu, 19 Nov 2020 15:01:21 +0000 (16:01 +0100)]
Methodology: Add profile details to nat44 doc

Change-Id: I5dc427693f78e4c712ab5cae587d7849dc2fec16
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoMethodology: Edit nat44 test spec doc 84/29784/12
Vratko Polak [Thu, 19 Nov 2020 14:14:34 +0000 (15:14 +0100)]
Methodology: Edit nat44 test spec doc

- Missing profile specifics and transaction counters.

Change-Id: I6f7378e5fe9d639599c38545b0503354a8a65198
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoMethodology: DUT state considerations 31/29731/14
Vratko Polak [Thu, 19 Nov 2020 14:03:59 +0000 (15:03 +0100)]
Methodology: DUT state considerations

Change-Id: I4bdb61cf665579c6b49d79c6fb281b4c0fb5ec89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoMethodology: Trex modes and transactions 23/29723/13
Vratko Polak [Thu, 19 Nov 2020 13:06:56 +0000 (14:06 +0100)]
Methodology: Trex modes and transactions

Change-Id: I43423dea499bce3a298dbbba752c2aee2a322836
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoUpdate of VPP_STABLE_VER files 77/29977/2
Jan Gelety [Wed, 18 Nov 2020 08:28:53 +0000 (09:28 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~414-g4b73b55d7

 - use new vpp ref build - centos7:
   21.01-rc0~414_g4b73b55d7~b75

Change-Id: Ied96aa8d2c6f5b7e764ddcf873c35914f83b9b28
Signed-off-by: Jan Gelety <jgelety@cisco.com>
2 weeks agoTrending: Add NAT44 tests 23/29823/4
Tibor Frank [Mon, 9 Nov 2020 12:48:17 +0000 (13:48 +0100)]
Trending: Add NAT44 tests

Change-Id: I2601a786f58b1d89cc9a90cb16ff20e6331abbfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoAnsible: Docker update 82/29982/1
pmikus [Wed, 18 Nov 2020 13:16:05 +0000 (13:16 +0000)]
Ansible: Docker update

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie48a96d83d37d7292d261875371e09d4b9152c7b

2 weeks agoT-Rex: 2.86 80/29980/1
pmikus [Wed, 18 Nov 2020 09:55:11 +0000 (09:55 +0000)]
T-Rex: 2.86

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id56b87ab868f2897a6563914b0beca2acc25e706

2 weeks agoReport: Add data 74/29974/1
Tibor Frank [Wed, 18 Nov 2020 06:15:08 +0000 (07:15 +0100)]
Report: Add data

Change-Id: I73a735b3e82aaa01f56c21bf91e5073f144c584f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoAnsible: Remove vpp_device snergster dependency 46/29946/3
pmikus [Mon, 16 Nov 2020 08:15:17 +0000 (08:15 +0000)]
Ansible: Remove vpp_device snergster dependency

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I145a4b5511141f1e2b4e387daa358e32dd2c8015

2 weeks agoReport: Add data 45/29945/1
Tibor Frank [Mon, 16 Nov 2020 04:43:25 +0000 (05:43 +0100)]
Report: Add data

Change-Id: I3aaf06de4ae5fb2dbeef5920987bc427bf0bb529
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: Add data 22/29922/1 oper-201118
Tibor Frank [Fri, 13 Nov 2020 05:38:52 +0000 (06:38 +0100)]
Report: Add data

Change-Id: I2027c8e0be76c119d88c966f700f9639ed4c1784
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoSwitch licenses in GPL directory 68/26668/13
Vratko Polak [Thu, 12 Nov 2020 16:22:31 +0000 (17:22 +0100)]
Switch licenses in GPL directory

To be merged after this completes:
https://wiki.fd.io/view/TSC/Relicensing_Procedure

Change-Id: I003e53a620a5f82ba2bcc65b12f9c84ae92264ef
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agoAdding Nidhyanandhan Arumugam to relicense list 17/29917/1
Ed Warnicke [Thu, 12 Nov 2020 15:15:55 +0000 (09:15 -0600)]
Adding Nidhyanandhan Arumugam to relicense list

Nidhyanandhan Arumugam was employed by Cisco as a contractor for
the work he did in CSIT.

Change-Id: Ie6cb06859b47f0ac77f6c7f42928fc742f3deda0
Signed-off-by: Ed Warnicke <hagbard@gmail.com>
3 weeks agoReport: Fix spec of latency graphs 89/29889/1
Tibor Frank [Thu, 12 Nov 2020 06:33:08 +0000 (07:33 +0100)]
Report: Fix spec of latency graphs

Change-Id: Ic2d8c66ec44b89354e4dbf4f9605c8e53bf21481
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: Add NAT44 data 88/29888/3
Tibor Frank [Thu, 12 Nov 2020 05:53:50 +0000 (06:53 +0100)]
Report: Add NAT44 data

- reorder NAT44 graphs

Change-Id: Ied762a85fb1ee69c7d12971e3e15822571a18451
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoAnsible: Remove vpp_device snergster dependency 74/29874/2
pmikus [Wed, 11 Nov 2020 10:15:33 +0000 (10:15 +0000)]
Ansible: Remove vpp_device snergster dependency

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id14c3f2f4f8689256172dc2b3ebc4fbaed5de8d3

3 weeks agoReport: Add comparison soak vs ndr 73/29873/1
Tibor Frank [Wed, 11 Nov 2020 09:12:36 +0000 (10:12 +0100)]
Report: Add comparison soak vs ndr

Change-Id: I19308ed936246be5b4e61c6e219591d16095cb56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agojob-spec: update the runs durations 72/29872/1
Tibor Frank [Wed, 11 Nov 2020 07:51:54 +0000 (08:51 +0100)]
job-spec: update the runs durations

Change-Id: I6de49b81bd4b75d40c792b044dc46024279d6651
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoASTF: Lessen L7 processing in UDP_CPS profiles 02/29802/3
Vratko Polak [Mon, 9 Nov 2020 14:58:48 +0000 (15:58 +0100)]
ASTF: Lessen L7 processing in UDP_CPS profiles

Change-Id: I8b154156120821adb24273db2a232fa82200c0fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agoTCP CPS: Count NAT sessions 40/29740/4
Vratko Polak [Wed, 4 Nov 2020 09:27:16 +0000 (10:27 +0100)]
TCP CPS: Count NAT sessions

The previous code counted full TCP connections,
which need one more packet, leading to worse results.

Change-Id: Ifcf78356b6ed54819ea0bf5aa069d7d9cb951183
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agoSpeed up test archive compression 45/29745/2
Vratko Polak [Wed, 4 Nov 2020 10:08:06 +0000 (11:08 +0100)]
Speed up test archive compression

16 times faster setting at cost of 50% larger archive.

Before:

$ time ( cat tests.tar | xz -9e > tests.9e.tar.xz )

real    0m41.640s
user    0m41.009s
sys     0m0.602s

$ wc -c tests.9e.tar.xz
913432 tests.9e.tar.xz

After:

$ time ( cat tests.tar | xz -3 > tests.3.tar.xz )

real    0m2.422s
user    0m2.294s
sys     0m0.161s

$ wc -c tests.3.tar.xz
1556080 tests.3.tar.xz

Change-Id: Ia5c86183d4e19db3cbf95dd84cf86ee720ef4051
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoUpdate of VPP_STABLE_VER files 22/29822/1
Jan Gelety [Thu, 5 Nov 2020 20:53:55 +0000 (21:53 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~353-g40aa27ef7

 - use new vpp ref build - centos7:
   21.01-rc0~353_g40aa27e~b254

Change-Id: I35bd3d39182ad5f12793424818fc4eef55638e19
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 weeks agojob-specs: Align mrr-daily with report iter for 2n-clx and 2n-skx 20/29820/1
Tibor Frank [Mon, 9 Nov 2020 10:39:36 +0000 (11:39 +0100)]
job-specs: Align mrr-daily with report iter for 2n-clx and 2n-skx

Change-Id: I783f0f055462daa1e8047c6905a17495b8473135
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoReport: Add data 18/29818/1
Tibor Frank [Mon, 9 Nov 2020 07:30:08 +0000 (08:30 +0100)]
Report: Add data

Change-Id: Id59947b8c502e4bf7b7ce66ad326f481346c98d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoPAL: Tests order in plots 92/29792/7
Tibor Frank [Fri, 6 Nov 2020 07:44:04 +0000 (08:44 +0100)]
PAL: Tests order in plots

Change-Id: Ic9342f0f3deea3d7d175c437993289c86464bb99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add NAT44 Latency 91/29791/1
Tibor Frank [Fri, 6 Nov 2020 06:10:28 +0000 (07:10 +0100)]
Report: Add NAT44 Latency

Change-Id: I2c247c5362396bcb4c8b42b1b46a2601091ca968
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add NAT44, part 2 80/29780/1
Tibor Frank [Thu, 5 Nov 2020 12:19:58 +0000 (13:19 +0100)]
Report: Add NAT44, part 2

Change-Id: I81c3b43407921ed7912b530bb93c725515d3d583
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Configure rls2009.46 76/29776/1
Tibor Frank [Thu, 5 Nov 2020 07:34:46 +0000 (08:34 +0100)]
Report: Configure rls2009.46

Change-Id: I7886285de8edbf66e03e1b22d85c2e7a4c4d7224
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agodocs: nat44ed test spec for udp and tcp cps tests using trex astf 11/28211/11
Maciek Konstantynowicz [Tue, 11 Aug 2020 13:37:06 +0000 (14:37 +0100)]
docs: nat44ed test spec for udp and tcp cps tests using trex astf

Change-Id: I277f462521273947d374e79a687e7f616ad1f13b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 weeks agojob-spec: Split mrr daily from report iterative 39/29739/2
Tibor Frank [Wed, 4 Nov 2020 08:53:06 +0000 (09:53 +0100)]
job-spec: Split mrr daily from report iterative

- enable all NAT44 tests for report iterative

Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Fix bugs in NAT44 graphs 33/29733/1
Tibor Frank [Tue, 3 Nov 2020 14:48:40 +0000 (15:48 +0100)]
Report: Fix bugs in NAT44 graphs

Change-Id: I6de094fc0cb2acdfb6eeb22e6d85a65d2e9f1478
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agojob-specs: Update the durations 22/29722/2
Tibor Frank [Mon, 2 Nov 2020 13:18:55 +0000 (14:18 +0100)]
job-specs: Update the durations

Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add data 14/29714/2
Tibor Frank [Mon, 2 Nov 2020 10:43:09 +0000 (11:43 +0100)]
Report: Add data

Change-Id: I800273d04c3f956e58be727cbf5befa61377fa2b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoUpdate of VPP_STABLE_VER files 12/29712/1
Jan Gelety [Sun, 25 Oct 2020 17:41:00 +0000 (18:41 +0100)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~324-g62877029a

 - use new vpp ref build - centos7:
   21.01-rc0~324_g6287702~b225

Change-Id: I86130eb1df9955395d4145f3ccdd0b07d6456fdf
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 weeks agoReport: Add data 10/29710/1
Tibor Frank [Mon, 2 Nov 2020 05:31:04 +0000 (06:31 +0100)]
Report: Add data

Change-Id: I99836894960f74f9dc283b812e1106ac512db3ae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: NAT44 Latency 09/29709/1
Tibor Frank [Sun, 1 Nov 2020 18:27:14 +0000 (19:27 +0100)]
Report: NAT44 Latency

Change-Id: Ifca9e4f5783eea37df30ddfedc80c988f2163ad8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add data 08/29708/1
Tibor Frank [Sun, 1 Nov 2020 18:01:33 +0000 (19:01 +0100)]
Report: Add data

Change-Id: I1cf61c523d781db3dbeccf89077c50992cb03205
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add NAT44 data 03/29703/1
Tibor Frank [Fri, 30 Oct 2020 19:18:42 +0000 (20:18 +0100)]
Report: Add NAT44 data

Change-Id: I463bf61d41484738ba5c614b473bcb5457e6abe1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add NATT44 tests 96/29696/3
Tibor Frank [Thu, 29 Oct 2020 20:07:11 +0000 (21:07 +0100)]
Report: Add NATT44 tests

Change-Id: I3920f881286565029f35bcfa700f36c6701db457
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoReport: Add data 98/29698/1
Tibor Frank [Fri, 30 Oct 2020 09:54:22 +0000 (10:54 +0100)]
Report: Add data

Change-Id: Iaa85aaa5179136281ab05325efcf0e91c234a774
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoSupport existing test types with ASTF 08/28208/179
Vratko Polak [Tue, 27 Oct 2020 18:09:44 +0000 (19:09 +0100)]
Support existing test types with ASTF

+ Add UDP_CPS, TCP_CPS, UDP_PPS and TCP_PPS suites.
 + Update existing cps traffic profiles.
 + Add missing traffic profiles.
 + UDP:
  + Single burst of 32 packets was confirmed as safe enough for TRex.
  + Maybe 64 could work, but not enough testing for that.
  + Multiple bursts have lead to reduced TRex performance,
    as overlaping bursts (from different client instances)
    tend to fill up the buffers.
 + TCP:
  + Data size set to 11111 bytes, completely arbitrarily.
  + Results look reasonable, so I have kept that.
  - MSS not set at all
 - No tested support for frame size other than 64B.
  - Frame size does not even factor into TCP profiles.
 + So other frame sizes are skipped in autogen.
+ Update tags in related suites.
 - HOSTS_{n} and SRC_USER_{n} should be unified.
 - Questionable clarification on difference between IP4BASE and SCALE.
+ Add NAT state resetters to tests that need them.
 + Resetter is called (if set) before each measurement.
 + If ramp-up is detected, resetter is not set.
+ Rename "mult" argument to "multiplier".
+ Abstracted from packets to transactions.
 + Transaction corresponds to profile.
 + TRex multiplier argument sets target rate in transactions per second.
 + The familiar STL traffic:
  + Bidirectional is considered to be 2 packets per transaction.
  + Unidirectional is considered to be 1 packet per transaction.
 + The newer ASTF traffic:
  + 4 subtypes, each has different number of packets per transaction.
 + For max rate computation:
  + Packets in the more numerous direction are considered.
+ Rely on TRex reported traffic duration for ASTF:
 + Use the server side value.
  - Client side value is higher by an overhead.
  - TRex is not sending traffic during that time.
 + Remove delays from traffic profiles.
  - Those delays would increase the reprted traffic time.
+ Support for scale lmited trials.
 + Only for ASTF profiles, each ASTF profile has limited scale.
 + Scale defined in suite variables.
 + For TRex to send all transactions provided duration value is ignored.
  + The appropriate value is computed in TrafficGenerator.
  + An ad-hoc time constant is added to match the TRex client side time overhead.
  + The profile driver receives the computed duration.
  + Measurement for PLRsearch add a sleep if the computed duration is smaller.
 + Alternative argument for search algos if scale is limited.
  + Both need higher timeout to accomodate big scales.
  + MLRsearch can afford fewer phases.
 + Added a parameter to optionally shorten the duration.
  + Use short duration for runtime stats trial and failure stats trial.
+ Use very large keepalive values in udp profiles to avoid ka packets.
+ No polling in ASTF profile driver.
 - Polling could eliminate the time overhead value.
 + But polling proved to introduce some loss, affecting the results.
+ Handle duration stretching in ASTF by stopping traffic.
 + The stop has several steps so that:
  + The traffic is really stopped entirely.
  + Late packets do not count (maybe as errors).
  + Stats are preserved to read for results (and cleared afterwards).
 + Several quantities added to ReceiveRateMeasurement:
  + Original target duration is preserved (algos need that).
  + Input estimate (tps) for early search iterations.
  + Output estimate (maybe pps) for MRR output.
  + Strict result (unsent counts as loss) for NDR.
+ Use L2 counters (opackets, ipackets) where possible.
 - TRex has trouble processing packets for the L7 ones at high loads.
+ Remove warmup from profile drivers and keywords.
 + Suites should call "Send ramp-up traffic" explicitly if needed.
+ Added parsing for few more counters.
 + Both to use in formulas or just for debug purposes.
- Only 64B cases in autogen, framesize support to be added later.
+ Latency streams during search can be enabled via PERF_USE_LATENCY env var.
+ MLRsearch improvments:
 + Rename argument names to min_rate and max_rate.
 + Use relative receive rate in initial phase.
+ PLRsearch improvements:
 + Careful computation when output (pps) does not match input (tps).
 + Use geometric distribution (instead of Poisson).
  + Helps agains math errors.
  + This should improve estimate stability.
  - But in practice big losses still lead to significant jumps.
+ Traffic generator improvements:
 + send_traffic_on_tg now calls the full set_rate_provider_defaults.
 + _send_traffic_on_tg_internal for the logic without provider defaults.
  + As the internal function is re-used by measure() without affecting defaults.
 + Move _parse_traffic_results just before get_measurement_result.
  + As the latter uses fields set bu the former, it is now easier to read.
 + Multiple sources for approximate duration.
  + Tried from more precise to more available.
 + Includes logic for _pps tests (added in later change).
 + Move explicit type conversions to earlier occurences.
+ Profile driver output field uses semicolons to simplify parsing.
+ Performance Robot lib file split to several smaller ones.
 + performance_actions.robot:
  + Hosts Additional Statistics Action For * keywords.
 + performance_display.robot:
  + Hosts keyword for displaying and verifying results.
  + Change test message to use the correct unit (pps or cps).
 + performance_limits.robot renamed to performance_vars.robot
  + Added many keywords, mostly for accessing test variables.
   + Moved variables for Policer into a new keyword there.
  + Some keywords need sophisticated logic.
  - Other are basically Get Variable Value.
   + But in future more logic can be added, without editing callers.
  + Documentation for the new keywords acts as a documentation for test variables.
 + performance_utils.robot has the rest.
  + Eliminated arguments if the value is in test variable.
  + Small improvements to documentation.
  - Still not enough cleanup with respect to arguments and test variables.
 + Keywords are sorted alphabetically now in each one.
+ Suites:
 + Unified variables table:
  + No colons in comments.
  + ${n_hosts}, ${n_ports} and use them instead hardcoded numbers.
 + Add -cps to existing cps suite names.
  + Remove "trial data overwrite".
  + Compute max rate as in STL suites.
 + Each NAT suite has ip4base suite to compare results to.
  - Those act as indirect TRex calibration.
  - VPP does not lose packets in those.
 + Latency in ASTF suites is disabled hard.
  - As we do not support latency in ASTF profiles yet.
 + Unidirectional tests governed by suite variable, not an argument.
+ Write long argument lists vertically.
 + Prefer to use argument names.
 + In Python, also the last argument is followed by comma.
 + It makes renaming and reordering easier.
 + Similarly applies to prints with long lists of values.
+ A TODO to update api crc file comments.

Change-Id: I84729355edbec051298a9de1162107f88ff5737d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agojob-spec: Add all NAT44 tests 30/29630/6
Tibor Frank [Mon, 26 Oct 2020 11:02:46 +0000 (12:02 +0100)]
job-spec: Add all NAT44 tests

- the specs:
  - docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md
  - docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md
  - docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md
  - docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md
  take too long. We should consider to remove some tests.
- the coverage specs were split to three parts

Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agotests: Add GSO enabled tests 41/28141/26
Martin Balaz [Mon, 3 Aug 2020 09:14:49 +0000 (11:14 +0200)]
tests: Add GSO enabled tests

Change-Id: I409b060f64ae7c6787448ae519fd76d8384e9ffb
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
5 weeks agoPAL: Remove debug info from result parser 47/29647/1
Tibor Frank [Wed, 28 Oct 2020 13:43:28 +0000 (14:43 +0100)]
PAL: Remove debug info from result parser

Change-Id: I9b6c2185e43ed0b33dbeafb3d2757656f9e49bc3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoPAL: Add processing of PPS and CPS tests 37/29637/19
Tibor Frank [Tue, 27 Oct 2020 09:21:58 +0000 (10:21 +0100)]
PAL: Add processing of PPS and CPS tests

Change-Id: I7b15c69c923d47e83c2dc586cdc03ed4ebaeec74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoReport: Configure rls2009.45 43/29643/1
Tibor Frank [Wed, 28 Oct 2020 05:15:16 +0000 (06:15 +0100)]
Report: Configure rls2009.45

Change-Id: I8918f09411254b64abb65a165a0e284f735b306e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoReport: Add data 42/29642/1
Tibor Frank [Wed, 28 Oct 2020 05:07:30 +0000 (06:07 +0100)]
Report: Add data

Change-Id: I2394b42e177758a8f3ce4aeeb912b264cf3b457c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoReport: Add data 25/29625/1
Tibor Frank [Mon, 26 Oct 2020 05:41:44 +0000 (06:41 +0100)]
Report: Add data

Change-Id: Ib5acc321ac7d5db7598b30b9783cee06ee8c1462
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoCSIT-1597 NAT44 API: dynamic config 29/29529/10
Jan Gelety [Wed, 16 Sep 2020 14:45:36 +0000 (16:45 +0200)]
CSIT-1597 NAT44 API: dynamic config

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/29463
- update vpp stable to version 21.01-rc0~283-g5f4f2081c

Change-Id: I079c10e4537448c3b078f22c3fe4ed266a5e2e2c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 weeks agoReport: Add data 04/29604/1
Tibor Frank [Fri, 23 Oct 2020 07:50:28 +0000 (09:50 +0200)]
Report: Add data

Change-Id: Iaa5fb969b699985da8ec3356aa32fc0cb757affb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoReport: Add data 92/29592/1
Tibor Frank [Thu, 22 Oct 2020 07:04:08 +0000 (09:04 +0200)]
Report: Add data

Change-Id: If03e4adf3672413016058fae85219ae5c7e922db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoReport: Configure 2009.44 65/29565/1
Tibor Frank [Wed, 21 Oct 2020 07:38:17 +0000 (09:38 +0200)]
Report: Configure 2009.44

Change-Id: I7f7e50610e71af7f2b0dc1eed267a421ffd8aef0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoReport: Add data 64/29564/1
Tibor Frank [Wed, 21 Oct 2020 07:27:18 +0000 (09:27 +0200)]
Report: Add data

Change-Id: I657325a2c18a1003c8825037291f1c37962e2c67
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoFIX: Namespace deletion 55/29555/1
pmikus [Tue, 20 Oct 2020 14:37:33 +0000 (14:37 +0000)]
FIX: Namespace deletion

+ Not sure who was doing code.
+ Set interface up should have namespace version

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1103cddb9dd11e25a8ab0ce3f5126b2db9444749

6 weeks agoFIX: Ansible calibration 51/29551/2
pmikus [Tue, 20 Oct 2020 12:23:57 +0000 (12:23 +0000)]
FIX: Ansible calibration

Force check is doing its job but vt.handoff was deployed later.

vt.handoff (vt = virtualterminal) is a kernel boot parameter unique to
Ubuntu, and is not an upstream kernel boot parameter. Its purpose is to
allow the kernel to maintain the current contents of video memory on a
virtual terminal. So, when the operating system is booting up, when it
moves past the boot loader, vt.handoff allows showing of an aubergine
background, with Plymouth displaying a logo and progress indicator bar
on top of this. Once the display manager comes up, it smoothly replaces
this with a login prompt.

Useless

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9d6db8833ccbef680fab2b643e9c3525bc709244

2 months agoVPP-DEVICE: Add check of vpp statistic commands 77/29477/4
Jan Gelety [Wed, 16 Sep 2020 06:42:01 +0000 (08:42 +0200)]
VPP-DEVICE: Add check of vpp statistic commands

Change-Id: I87f95c14034d89056f71ffaeccafc1d3b71ff933
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 weeks agoFIX: Ansible asserts 00/29500/4
Peter Mikus [Mon, 19 Oct 2020 18:52:49 +0000 (18:52 +0000)]
FIX: Ansible asserts

Change-Id: Ib668674a2a267d2ceed458288d21181b2a937778
Signed-off-by: Peter Mikus <pmikus@cisco.com>
6 weeks agoReport: Add data 41/29541/1
Tibor Frank [Tue, 20 Oct 2020 05:43:15 +0000 (07:43 +0200)]
Report: Add data

Change-Id: I28cd6e2bfdf6617f7590907fc114681823a2979f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate of VPP_STABLE_VER files 25/29525/1
Jan Gelety [Wed, 16 Sep 2020 14:55:58 +0000 (16:55 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc0~225-gdfffdd7fa

 - use new vpp ref build - centos7:
   21.01-rc0~225_gdfffdd7~b128

Change-Id: I20be4d66130b076abc85c24075e774e261ecd5e0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
6 weeks agoFIX: disable sending IPv6 RA messages from VMs 82/29482/3
Juraj Linkeš [Fri, 16 Oct 2020 10:57:08 +0000 (12:57 +0200)]
FIX: disable sending IPv6 RA messages from VMs

There were occasional Router Advertisement packets received in a Traffic
Generator in VM testcases. Fix by adding config that disables sending
IPv6 RA messages on interfaces in VM VPP config before enabling them.

Also rename related keywords and change descriptions based on
https://docs.fd.io/vpp/21.01/db/d4c/clicmd_src_vnet_ip6-nd.html#clicmd_ip6_nd

Change-Id: I1c2a33337ac91f6039d287b4c2aac388e3a52383
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
6 weeks agoTrending: Remove GBP tests 94/28894/7
Tibor Frank [Thu, 17 Sep 2020 07:49:00 +0000 (09:49 +0200)]
Trending: Remove GBP tests

merge after https://gerrit.fd.io/r/c/csit/+/28885

Change-Id: I657f4e219968a8d422af6f5d6fc4727facfafb20
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoTests: Remove GBP 85/28885/9
pmikus [Wed, 16 Sep 2020 15:22:10 +0000 (15:22 +0000)]
Tests: Remove GBP

- Specs
- Tests
- Library
- TODO: PAL

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8890940d56c7a9924d4a5f9365b6bb881610db14

6 weeks agoReport: Add data 21/29521/1
Tibor Frank [Mon, 19 Oct 2020 07:48:42 +0000 (09:48 +0200)]
Report: Add data

Change-Id: I17c582de8fa24ffd55b163cfeb727f2951ec647f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.