csit.git
2 years agoReport: Add per thread resources allocation methodology 85/33085/8
pmikus [Mon, 12 Jul 2021 14:47:17 +0000 (14:47 +0000)]
Report: Add per thread resources allocation methodology

Per thread resources include:
- pcores and lcores.
- RxQs.
- TxQs.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64b418a99673bf05b37a9e97be4aaa80e4ffb835
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoreport: update to rls notes and add methodology sections TODO placeholders 27/33127/3
Maciek Konstantynowicz [Wed, 14 Jul 2021 10:35:35 +0000 (11:35 +0100)]
report: update to rls notes and add methodology sections TODO placeholders

- Update VPP and DPDK rls notes.
- Added methodology sections TODO placeholders
  - IPsec with Async Crypto Feature Workers
  - IPsec Uni-Directional Tests
  - IPsec Deep SPD Policy Tests
  - GTPU Tunnels

Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Add data, set archiving and pdf version 23/33123/1
Tibor Frank [Wed, 14 Jul 2021 09:46:16 +0000 (11:46 +0200)]
Report: Add data, set archiving and pdf version

Change-Id: Iaa1ef8bd12f536723d6894fbf86acfe280929ade
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 20/33120/1
Tibor Frank [Wed, 14 Jul 2021 07:55:40 +0000 (09:55 +0200)]
Report: Add rls data

Change-Id: I6a133fd2fe99ec851d2eb0c5b5cc52a5169522c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Fix links to graphs in hoststack section 92/33092/1
Tibor Frank [Tue, 13 Jul 2021 07:19:41 +0000 (09:19 +0200)]
Report: Fix links to graphs in hoststack section

Change-Id: If75297ecb4c55b2a1c40dffbe354d77c537e905f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 90/33090/1
Tibor Frank [Tue, 13 Jul 2021 07:10:22 +0000 (09:10 +0200)]
Report: Add rls data

Change-Id: I0167c72751aa5deae576335bbf91f62557ea8526
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHoststack report content 41/32941/4
Dave Wallace [Mon, 28 Jun 2021 21:36:30 +0000 (17:36 -0400)]
Hoststack report content

- Methodology section
- Align dynamic content structure with methodology section

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I852c0f8147947dd8418de5fc2fdbd16a1c1e2057

2 years agojob-spec: Add hoststack and vsap 27/32727/8
Tibor Frank [Tue, 15 Jun 2021 08:34:51 +0000 (10:34 +0200)]
job-spec: Add hoststack and vsap

+ hoststack
+ vsap (cps, rps)
+ add e810cq to common.sh

Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoreport: add 2n-icx and 3n-icx testbed documentation 64/33064/6
Maciek Konstantynowicz [Thu, 8 Jul 2021 14:47:53 +0000 (15:47 +0100)]
report: add 2n-icx and 3n-icx testbed documentation

Add:
- Physical testbeds description in Introduction.
  - Add physical topology diagrams.
- VPP pre-release 21.06 version used in Intel labs for CSIT tests.

Change-Id: I3c17402de8c657f66ea840c9d8692212cbf0501a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoIETF: Update MLRsearch draft 70/33070/22
Vratko Polak [Mon, 12 Jul 2021 17:52:26 +0000 (19:52 +0200)]
IETF: Update MLRsearch draft

Change-Id: I591b76b72868697242cfbece8f569dc82128ed85
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTox: Move logs to archive also on -1 82/33082/2
Vratko Polak [Mon, 12 Jul 2021 14:53:50 +0000 (16:53 +0200)]
Tox: Move logs to archive also on -1

Change-Id: Id29925da9c8e0bc0a28a9f4d38c332852c687317
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Add rls data 80/33080/1
Tibor Frank [Mon, 12 Jul 2021 08:58:32 +0000 (10:58 +0200)]
Report: Add rls data

Change-Id: Id69117a538294622a9c24efc9fb41aa70d61fedd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 54/33054/2
Tibor Frank [Mon, 12 Jul 2021 05:22:52 +0000 (05:22 +0000)]
Update VPP_STABLE_VER files

Change-Id: I5cfd5539b52824176703fe34e5c79134898140ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCI-MAN: Unify backups 73/33073/5
pmikus [Fri, 9 Jul 2021 17:41:54 +0000 (17:41 +0000)]
CI-MAN: Unify backups

+ tox must follow the $WORKSPACE/archives rule

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I717afded894c3a5468bbf5013b242be5e1a9cb6e

2 years agoReport: Add rls data 68/33068/1
Tibor Frank [Fri, 9 Jul 2021 07:01:16 +0000 (09:01 +0200)]
Report: Add rls data

Change-Id: I950a9b3ba9066d1552649cbd4031a2ba1cf14ccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoInfra: Bump minio server 59/33059/2
pmikus [Thu, 8 Jul 2021 11:57:52 +0000 (11:57 +0000)]
Infra: Bump minio server

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib3cbf35c6ed1ed221c7c74e74494b188bd106a92

2 years agoPAL: Process sh run from telemetry 26/33026/3
Tibor Frank [Wed, 7 Jul 2021 09:52:02 +0000 (11:52 +0200)]
PAL: Process sh run from telemetry

Change-Id: I62ef60362f2921122c2f71e4f90c10cdc7185e1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 3n-tsh reduce number of report coverage tests 34/33034/3
Maciek Konstantynowicz [Wed, 7 Jul 2021 16:27:24 +0000 (17:27 +0100)]
job_specs: 3n-tsh reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 3n-dnv reduce number of report coverage tests 32/33032/3
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:26:41 +0000 (14:26 +0100)]
job_specs: 3n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-zn2 reduce number of report coverage tests 31/33031/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:16:40 +0000 (14:16 +0100)]
job_specs: 2n-zn2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 3n-skx reduce number of report coverage tests 33/33033/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 15:00:05 +0000 (16:00 +0100)]
job_specs: 3n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoInfra: AWS Jenkins Integration 24/33024/6
pmikus [Wed, 7 Jul 2021 06:02:57 +0000 (06:02 +0000)]
Infra: AWS Jenkins Integration

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c

2 years agoReport: Add rls data 57/33057/1
Tibor Frank [Thu, 8 Jul 2021 06:52:16 +0000 (08:52 +0200)]
Report: Add rls data

Change-Id: I336d3d291be38dbc6483386945e0edcdca4a9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 2n-tx2 reduce number of report coverage tests 30/33030/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 12:05:00 +0000 (13:05 +0100)]
job_specs: 2n-tx2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-skx reduce number of report coverage tests 28/33028/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 11:45:21 +0000 (12:45 +0100)]
job_specs: 2n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: 2n-dnv reduce number of report coverage tests 27/33027/2
Maciek Konstantynowicz [Wed, 7 Jul 2021 10:59:16 +0000 (11:59 +0100)]
job_specs: 2n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Add rls data 29/33029/1
Tibor Frank [Wed, 7 Jul 2021 11:59:35 +0000 (13:59 +0200)]
Report: Add rls data

Change-Id: I82522a17b1b3b919adc6de28772d4323c57b0b2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agojob_specs: 2n-clx reduce number of report coverage tests 52/32452/5
Maciek Konstantynowicz [Wed, 26 May 2021 13:46:14 +0000 (14:46 +0100)]
job_specs: 2n-clx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: Publish icx results 17/33017/2
Tibor Frank [Tue, 6 Jul 2021 12:36:07 +0000 (14:36 +0200)]
Report: Publish icx results

Change-Id: Iea22c61f97e62743b4a99b961290a7f722496162
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rls data 25/33025/2
Tibor Frank [Wed, 7 Jul 2021 07:29:37 +0000 (09:29 +0200)]
Report: Add rls data

Change-Id: I47f36db2b42c3d12c3173fc336fead94fe626abe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTelemetry: Add node info 16/33016/3
pmikus [Tue, 6 Jul 2021 12:31:26 +0000 (12:31 +0000)]
Telemetry: Add node info

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I428bf2628f5d6b87d335de415a82d6e94867d8c0

2 years agoDocs: DPDK release notes 11/33011/1
pmikus [Tue, 6 Jul 2021 10:47:26 +0000 (10:47 +0000)]
Docs: DPDK release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie7c009d541fbedf7513b7decac9839eb4a98e520

2 years agoDocs: Update release notes 10/33010/1
pmikus [Tue, 6 Jul 2021 10:35:09 +0000 (10:35 +0000)]
Docs: Update release notes

- Add AVF issue.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic0830df665de20466c7bd4ab80b3ea597005b4e1

2 years agoUpdate VPP_STABLE_VER files 92/32992/2
Tibor Frank [Tue, 6 Jul 2021 04:53:45 +0000 (04:53 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ie14f4f955b9e28de9c334998e4db6798734de717
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add gtpu tests 64/32964/1
Tibor Frank [Thu, 1 Jul 2021 08:39:33 +0000 (10:39 +0200)]
Report: Add gtpu tests

Change-Id: I0c48f48a927bb75554f0d9eca4f32f0a3dc30d20
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Change Throughput to Tput in graphs titles 58/32958/1
Tibor Frank [Wed, 30 Jun 2021 11:44:45 +0000 (13:44 +0200)]
Report: Change Throughput to Tput in graphs titles

Change-Id: Icbd23f4c7339765985f1614debeadf1f4332753a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Implement changes from job-specs 47/32947/2
Tibor Frank [Tue, 29 Jun 2021 11:58:59 +0000 (13:58 +0200)]
Report: Implement changes from job-specs

Change-Id: Id9497ae02eb47fed40b9e4c33b98a81c34b71964
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add re-test data 43/32943/1
Tibor Frank [Tue, 29 Jun 2021 05:08:56 +0000 (07:08 +0200)]
Report: Add re-test data

Change-Id: Ifa6bc912d4b0dd5c377ebe1654bff694c0c006e7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrendig: Change the priority of data sources 37/32937/1
Tibor Frank [Mon, 28 Jun 2021 12:15:33 +0000 (14:15 +0200)]
Trendig: Change the priority of data sources

Change-Id: Iee015d717034fd08e86037e5800fbe8231cbd89a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Hide re-test data in cmp tbls for tsh, tx2 36/32936/1
Tibor Frank [Mon, 28 Jun 2021 11:56:26 +0000 (13:56 +0200)]
Report: Hide re-test data in cmp tbls for tsh, tx2

Change-Id: I7cf8a819f5fbd84882006ec0ca1891b38b2fb58d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 14/32914/1
Tibor Frank [Mon, 28 Jun 2021 10:30:26 +0000 (12:30 +0200)]
Report: Add rc2 data

Change-Id: I71f1d3957073b5fee66cd38efde003cf19b36396
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Process sh-run from telemetry 02/32902/3
Tibor Frank [Fri, 25 Jun 2021 11:56:43 +0000 (13:56 +0200)]
PAL: Process sh-run from telemetry

Change-Id: Ia1a3427609b284d0036dfe3b2ffbb17a9b4f8a65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 21/32921/2
Tibor Frank [Mon, 28 Jun 2021 04:26:21 +0000 (04:26 +0000)]
Update VPP_STABLE_VER files

Change-Id: I4a7729a86c4ade435c8c18aba043e583c4fa16fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoMetrics: Fix timestamps, they were not epoch 83/32883/4
Vratko Polak [Thu, 24 Jun 2021 17:40:38 +0000 (19:40 +0200)]
Metrics: Fix timestamps, they were not epoch

Library documentation [0] says this about monotonic():

  The reference point of the returned value is undefined,
  so that only the difference between the results of two calls is valid.

Switching to time().

[0] https://docs.python.org/3/library/time.html

Change-Id: Ia7ef8d89119f7dc72619cac44b213611163ff054
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoPerf actions: Skip vpp-runtime in stat_pre_trial 44/32844/9
Vratko Polak [Thu, 24 Jun 2021 10:39:32 +0000 (12:39 +0200)]
Perf actions: Skip vpp-runtime in stat_pre_trial

The list of actions stat_pre_trial is executed
after the list stat_runtime, which already contains vpp-runtime.

Change-Id: If9b403f38b2f811d77f36d9cae973130f30015da
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Fix typo in spec 92/32792/2
Tibor Frank [Wed, 23 Jun 2021 08:42:51 +0000 (08:42 +0000)]
Report: Fix typo in spec

Change-Id: I19ad258be06e30bfb31e9178d646be93ac733cec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 62/32862/1
Tibor Frank [Wed, 23 Jun 2021 08:26:12 +0000 (10:26 +0200)]
Report: Add rc2 data

Change-Id: Id7fc6305c09cfc32fbeb59f723828443d70b4ab9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Do not read sh run for trending 43/32843/2
Tibor Frank [Tue, 22 Jun 2021 11:49:05 +0000 (13:49 +0200)]
PAL: Do not read sh run for trending

Change-Id: I0e142c1c3bb48ddeb0bcd2bfa11c0323461c1368
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTrending: Remove 3n-hsw from dynamic content 41/32841/1
Tibor Frank [Tue, 22 Jun 2021 11:31:29 +0000 (13:31 +0200)]
Trending: Remove 3n-hsw from dynamic content

Change-Id: I65cfc9a7730d6b154d6085d5f817a7023f994bba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoJSON: Implement latest changes 17/32817/5
Tibor Frank [Mon, 21 Jun 2021 14:34:23 +0000 (16:34 +0200)]
JSON: Implement latest changes

Change-Id: Ife5feacad6885427066a5b28978f25965394b557
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 27/32827/1
Tibor Frank [Tue, 22 Jun 2021 07:27:17 +0000 (09:27 +0200)]
Report: Add rc2 data

Change-Id: I24e16127179ebda53cf35260d436332101c79706
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFrameworkSetup: fix timeout in Arm setup 02/32802/2
Juraj Linkeš [Mon, 21 Jun 2021 06:19:06 +0000 (08:19 +0200)]
FrameworkSetup: fix timeout in Arm setup

Framework extraction in Arm jobs is taking longer than the current
timeout. Increase the timeout to fix this.

Change-Id: Iaddbbe9690eabbed47b19d5264a4f4502e5ed948
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 years agoReport: Add rc2 data 06/32806/1
Tibor Frank [Mon, 21 Jun 2021 10:29:29 +0000 (12:29 +0200)]
Report: Add rc2 data

Change-Id: I032a897f7724a978b96ec7533f505bedfa0c03d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc2 data 05/32805/2
Tibor Frank [Mon, 21 Jun 2021 10:21:30 +0000 (12:21 +0200)]
Report: Add rc2 data

Change-Id: I177c3237088c5f12288c463a2d6f1b690533079c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 77/32777/2
Tibor Frank [Mon, 21 Jun 2021 05:14:52 +0000 (05:14 +0000)]
Update VPP_STABLE_VER files

Change-Id: I7bd79638800034f4a0329a197000661ca81c1b3a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoCore: Rework CPU allocation 87/32687/12
pmikus [Fri, 11 Jun 2021 13:06:34 +0000 (13:06 +0000)]
Core: Rework CPU allocation

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6826add7b3032041632c3952c45a3c64409400b0

2 years agoTraffic scripts: Move valid_ipv* to a library 30/32730/5
Vratko Polak [Thu, 17 Jun 2021 12:03:43 +0000 (14:03 +0200)]
Traffic scripts: Move valid_ipv* to a library

No need to implement the same two functions in 5 places.

Change-Id: I7bbcfaba18030a0520aaef5dcf06ed155bcf806b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoReport: Add rc1 data 59/32759/1
Tibor Frank [Thu, 17 Jun 2021 11:22:47 +0000 (13:22 +0200)]
Report: Add rc1 data

Change-Id: Iedc10183e127167fefcfa8369e33b344b20b5d28
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoTraffic scripts: Fix docstrings 29/32729/3
Vratko Polak [Wed, 16 Jun 2021 10:58:22 +0000 (12:58 +0200)]
Traffic scripts: Fix docstrings

The IP address checking functions do not raise the exceptions listed,
they except them and return False.

Change-Id: I74e52b65bac99c8ca8679d4cc6395067ccc6a961
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoLine length: Fix recent merges 21/32421/5
Vratko Polak [Tue, 15 Jun 2021 12:35:41 +0000 (14:35 +0200)]
Line length: Fix recent merges

Not fixing .rst, .md, .yaml, conf.py, .vat, and so on.

Change-Id: Icc585d6dbebc8eb5c483b10326302571e94c614d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoip6lisp: Do not fail on string overhead value 70/32570/3
Vratko Polak [Tue, 15 Jun 2021 11:06:32 +0000 (13:06 +0200)]
ip6lisp: Do not fail on string overhead value

+ Set overhead in those suites to numeric values.
+ Change the library to tolerate string representations anyway.

Change-Id: Ic6215840f7797801c994a38db5637999eb85a034
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agojob_specs: reduce number of report coverage tests for ipsec 19/32719/3
Maciek Konstantynowicz [Mon, 14 Jun 2021 13:12:00 +0000 (15:12 +0200)]
job_specs: reduce number of report coverage tests for ipsec

Remove:
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: I1443f35b7bf852fd665e8856d05bf04b9827913f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoReport: disable reconf plots 43/32743/1
Tibor Frank [Wed, 16 Jun 2021 10:10:54 +0000 (12:10 +0200)]
Report: disable reconf plots

Change-Id: I983d521142b5725aab43d20a1bf9c8837c0e23af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add vsap 33/32733/2
Tibor Frank [Tue, 15 Jun 2021 12:24:26 +0000 (14:24 +0200)]
Report: Add vsap

Change-Id: I3e8719ab2da0d9b4ae1b24c6b8479724064c8dce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Update Infra sections 26/32726/2
pmikus [Tue, 15 Jun 2021 07:57:50 +0000 (07:57 +0000)]
Report: Update Infra sections

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I14aa6f64b2621ad306e1cd79fafefe94dd1ed85a

2 years agoReport: Add RC1 data 16/32716/1
Tibor Frank [Mon, 14 Jun 2021 11:33:20 +0000 (13:33 +0200)]
Report: Add RC1 data

Change-Id: I8bb69b896438c84cdd280e781697773b8cf91475
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: vpp_device ignore packets list 93/32693/2
pmikus [Mon, 14 Jun 2021 08:15:25 +0000 (08:15 +0000)]
FIX: vpp_device ignore packets list

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifda8fcb102661e7c585bc5fe3a16113ae629d516

2 years agoFIX: eval expression 94/32694/1
pmikus [Mon, 14 Jun 2021 08:42:02 +0000 (08:42 +0000)]
FIX: eval expression

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I746a40af0a051978706e7c696d391a051133145f

2 years agoUpdate VPP_STABLE_VER files 98/32698/2
Tibor Frank [Mon, 14 Jun 2021 05:12:35 +0000 (05:12 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia964b32f3d527e5d77a88643a2bea9b65c3307b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: reduce amount of data 84/32684/5
Tibor Frank [Fri, 11 Jun 2021 08:10:18 +0000 (10:10 +0200)]
PAL: reduce amount of data

Change-Id: If5713c01e73db72e46a863c7499cb437892a2d97
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: GSO tests 83/32683/2
pmikus [Fri, 11 Jun 2021 07:24:46 +0000 (07:24 +0000)]
FIX: GSO tests

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I00372b5528752186a814e83af092e1b0123e4683

2 years agoFIX: Ansible vpp_device typo 82/32682/2
pmikus [Fri, 11 Jun 2021 07:04:16 +0000 (07:04 +0000)]
FIX: Ansible vpp_device typo

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I902439bd078886e30bf0990647796038c36ed598

2 years agoTrenring: Reduce nr of builds to save RAM 81/32681/1
Tibor Frank [Fri, 11 Jun 2021 06:44:26 +0000 (08:44 +0200)]
Trenring: Reduce nr of builds to save RAM

Change-Id: I53e3af82a0024c8247d80e1f0401f0e9cd60e8ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoInfra: Move Nomad AARCH64 mgmt.ip via i350 77/32677/1
pmikus [Thu, 10 Jun 2021 12:52:07 +0000 (12:52 +0000)]
Infra: Move Nomad AARCH64 mgmt.ip via i350

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I358680cd165c52d1515f1542d4eb7051ac436bb4

2 years agoFIX: Pylint reduce 53/32653/4
pmikus [Thu, 10 Jun 2021 08:02:29 +0000 (08:02 +0000)]
FIX: Pylint reduce

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I909942dbb920df7f0fe15c0c92cda92c3cd8d8ad

2 years agoFIX: Add ICMPv6MLReport2 masking 54/32654/3
pmikus [Thu, 10 Jun 2021 08:51:19 +0000 (08:51 +0000)]
FIX: Add ICMPv6MLReport2 masking

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1183a0ffd13c6926b3963b78630954bb6356133b

2 years agoInfra: vpp_device -> Ubuntu 20.04 66/32566/12
pmikus [Fri, 4 Jun 2021 10:34:42 +0000 (10:34 +0000)]
Infra: vpp_device -> Ubuntu 20.04

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If24c385b93e1ba310ea258984c97494b4cab467c

2 years agoAdd gtpu sw performance test cases 25/32025/10
xinfeng zhao [Mon, 19 Apr 2021 05:21:52 +0000 (13:21 +0800)]
Add gtpu sw performance test cases

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Reviewed-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ibe4420529192559a3cdbb84e0a67859750a9e0d5

2 years agoInfra: Decommission 3n-hsw - docs 10/32510/2
pmikus [Tue, 1 Jun 2021 11:50:11 +0000 (11:50 +0000)]
Infra: Decommission 3n-hsw - docs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I782fbf2d495b915cda6c25b36ffc00e8abce32f7

2 years agoDpdk in VM: Increase num_mbufs 40/32540/10
Vratko Polak [Wed, 9 Jun 2021 11:27:41 +0000 (13:27 +0200)]
Dpdk in VM: Increase num_mbufs

Since switching to rxq ratio 1:1,
the previous value was not enough for 4c vhost tests.

+ Set the 1:1 rxq ratio also for DPDK (outside vhost) tests.
 - Still not sure why those tests were not failing.
+ Set the 1:1 rxq ratio also for VPP container tests.

Ticket: CSIT-1783

Change-Id: Id9d136a638eb212a8105a6288e7847f3c35fefb0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFIX: spectre-meltdown calibration 46/32646/1
pmikus [Wed, 9 Jun 2021 13:03:00 +0000 (13:03 +0000)]
FIX: spectre-meltdown calibration

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie162c2021d54129b48a6b3a48027b31db11d7ec6

2 years agoReport: Add data 39/32639/1
Tibor Frank [Tue, 8 Jun 2021 08:03:46 +0000 (10:03 +0200)]
Report: Add data

Change-Id: I15f0dc0b401a041e004dfa3d06081dffa8b13dd5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: Convert XML to JSON 91/32191/23
Tibor Frank [Mon, 3 May 2021 12:22:31 +0000 (14:22 +0200)]
PAL: Convert XML to JSON

Change-Id: I24f0ddc412d4353ba244c58a3068b5b0ea4349e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add data 12/32612/1
Tibor Frank [Mon, 7 Jun 2021 08:16:18 +0000 (10:16 +0200)]
Report: Add data

Change-Id: I73171b62fae718a5629d6d94f6908281175c2969
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoUpdate VPP_STABLE_VER files 16/32616/2
Tibor Frank [Mon, 7 Jun 2021 05:47:10 +0000 (05:47 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ife21683447e88b44fe47a9edceae9770bd4165f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoFIX: af_xdp L2 data paths 67/32567/4
pmikus [Fri, 4 Jun 2021 10:48:55 +0000 (10:48 +0000)]
FIX: af_xdp L2 data paths

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic5bc714b56c8bbd6884264a566eb8554a9735cba

2 years agoReport: fix data set 69/32569/1
Tibor Frank [Fri, 4 Jun 2021 11:15:07 +0000 (13:15 +0200)]
Report: fix data set

Change-Id: I3b469da641e0adcf0a859f8f47c3a7caa7d1ca24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add dpdk data 63/32563/1
Tibor Frank [Fri, 4 Jun 2021 08:19:54 +0000 (10:19 +0200)]
Report: Add dpdk data

Change-Id: Iad97217b99b25f14a85c98348d49339a4be8cec7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPerformance: Add AF_XDP tests 56/32456/23
pmikus [Wed, 26 May 2021 16:06:02 +0000 (16:06 +0000)]
Performance: Add AF_XDP tests

- enabling for fortville, columbiaville
- enabling experimental for mlx

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1b7ceb54769f4a0089ac7309350499e60c5cca0a

2 years agojob_specs: reduce number of weekly ndrpdr tests 15/32415/11
Maciek Konstantynowicz [Fri, 21 May 2021 20:03:23 +0000 (21:03 +0100)]
job_specs: reduce number of weekly ndrpdr tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 tests
  - -pps tests, replaced by -tput tests.
  - h1-p1-s1 single session tests, unessential combination.
  - h4096-p63-s258048 tests, unessential scale combination.
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: I269878218f1ff61e58f9a2d669ebdba7c8dffdbf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agojob_specs: reduce number of daily mrr tests 18/32218/10
Maciek Konstantynowicz [Wed, 5 May 2021 13:50:08 +0000 (14:50 +0100)]
job_specs: reduce number of daily mrr tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 tests
  - -pps tests, replaced by -tput tests.
  - h1-p1-s1 single session tests, unessential combination.
  - h4096-p63-s258048 tests, unessential scale combination.
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: Iccce3e20299b4ac771228a6878b4f0961b0186de
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 years agoTrending: Partially remove 3n-hsw 56/32556/1
Tibor Frank [Thu, 3 Jun 2021 11:40:13 +0000 (13:40 +0200)]
Trending: Partially remove 3n-hsw

Change-Id: I2f08d455a51f3b891b38ad82bfac47dd7b9921c5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Replace links to jobs by links to logs 43/32543/2
Tibor Frank [Wed, 2 Jun 2021 13:12:38 +0000 (15:12 +0200)]
Report: Replace links to jobs by links to logs

Change-Id: I4e44eced6ab2199f070b38a13060f4e0b7a2ef7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoHsw deprecation: Delete 3n-hsw job specs 84/32484/2
Vratko Polak [Fri, 28 May 2021 14:54:10 +0000 (16:54 +0200)]
Hsw deprecation: Delete 3n-hsw job specs

+ Verify jobs remain available for 3n-hsw.
- PAL edits are independent, will be done elsewhere.
- Autogen edits to come later.

Change-Id: I2d0d1b15cbe49627fa9c5188c70f94156b438b77
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoPAL: Fix plot_ndrpdr_box_name 42/32542/2
Tibor Frank [Wed, 2 Jun 2021 10:38:30 +0000 (12:38 +0200)]
PAL: Fix plot_ndrpdr_box_name

- if there are no values, put warning to the log.

Change-Id: Ibea99e3f4962684afefa572c46bcca157b8ab3cf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoInfra: Decommission 3n-hsw - NICs 13/32513/3
pmikus [Tue, 1 Jun 2021 12:52:34 +0000 (12:52 +0000)]
Infra: Decommission 3n-hsw - NICs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5bbb573fb75d0ee7b5e9b21591e4d6ff48df917e

2 years agoInfra: Decommission 3n-hsw - topologies 09/32509/3
pmikus [Tue, 1 Jun 2021 11:17:55 +0000 (11:17 +0000)]
Infra: Decommission 3n-hsw - topologies

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iebf8dc936f8ce44f3c9250cad35d8908aabd0f33

2 years agoReport: Configure report 98/32498/12
Tibor Frank [Mon, 31 May 2021 08:35:20 +0000 (10:35 +0200)]
Report: Configure report

+ 2101 --> 2106
+ remove 3n-hsw
+ unify data sets
+ configure data sets
- implement changes from job-specs

Change-Id: I200e7a80ebf88864ce4a7a2134f5251b557f6a3a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoASTF: Fix syntax error in stop 05/32505/2
Vratko Polak [Tue, 1 Jun 2021 09:09:58 +0000 (11:09 +0200)]
ASTF: Fix syntax error in stop

When ASTF suites were introduced,
they already edited [0] actions to avoid explicit stop.
Then a refactor [1] introduced the syntax error,
but as stop never run, we didnot see it as a failure.
Finally another refactor [2] caused the stop to be called again,
exposing the syntax error.

As a related issue, pylint script was not updated to check files
in GPL directory until [3].

[0] https://gerrit.fd.io/r/c/csit/+/28205/8/tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-ip4base-h1024-p63-s64512-ndrpdr.robot#84
[1] https://gerrit.fd.io/r/c/csit/+/28208/179/GPL/tools/trex/trex_astf_stop.py#102
[2] https://gerrit.fd.io/r/c/csit/+/32030/37/resources/libraries/robot/performance/performance_utils.robot#518
[3] https://gerrit.fd.io/r/c/csit/+/32504

Change-Id: Ibd20b43cb263170d9f17255ff1bcd20f09c42cb5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoTox: Run pylint also for GPL 04/32504/3
Vratko Polak [Tue, 1 Jun 2021 08:29:17 +0000 (10:29 +0200)]
Tox: Run pylint also for GPL

Change-Id: Ic6c5d35dc602638b06962fcad30d8517c9553552
Signed-off-by: Vratko Polak <vrpolak@cisco.com>