ci-management.git
2 years agoFix JJBINI 36/33536/1
Vanessa Rene Valderrama [Thu, 19 Aug 2021 18:27:22 +0000 (13:27 -0500)]
Fix JJBINI

This patch is to standardize with other projects and fix the credentials
mappings. We've also updated the credentials on the sandbox and
production to reflect this change.

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I2ccf4203f727e97e144ed67a965a0a63efddc2e7

2 years agoFix JJBINI syntax 35/33535/1
Vanessa Rene Valderrama [Thu, 19 Aug 2021 16:23:42 +0000 (11:23 -0500)]
Fix JJBINI syntax

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I8d937d234be2c77d7259c5695a3c3e7e361a9cab

2 years agoFix JJBINI credentials 34/33534/1
Vanessa Rene Valderrama [Thu, 19 Aug 2021 16:02:34 +0000 (11:02 -0500)]
Fix JJBINI credentials

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: Ib989c1b0a18971dc2151619f67e9332b63590fa8

2 years agoFix JJBINI managed file 30/33530/1
Vanessa Rene Valderrama [Thu, 19 Aug 2021 14:14:08 +0000 (09:14 -0500)]
Fix JJBINI managed file

Fix the JJBINI managed file to use the credentials and URLs for sandbox
and production

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I0cd0a391891a1d1e6221ce669ab81119f143e33c

2 years agoMerge "Upgrade global-jjb"
Vratko Polak [Thu, 19 Aug 2021 12:40:14 +0000 (12:40 +0000)]
Merge "Upgrade global-jjb"

2 years agoMerge "Global: Docs generation in s3"
Dave Wallace [Thu, 19 Aug 2021 12:35:12 +0000 (12:35 +0000)]
Merge "Global: Docs generation in s3"

2 years agoUpgrade global-jjb 27/33527/1
Vanessa Rene Valderrama [Thu, 19 Aug 2021 12:17:48 +0000 (07:17 -0500)]
Upgrade global-jjb

Upgrading global-jjb to pick up a bug fix for
create_jenkins_clouds_openstack_yaml.

Release notes can be found here:
https://docs.releng.linuxfoundation.org/projects/global-jjb/en/latest/release-notes.html#v0-65-1-2

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I2ae70b7c8f6619abc043503760a28476dfbd8966

2 years agoFix: Correct log credential for both jenkins 23/33523/1
Andrew Grimberg [Wed, 18 Aug 2021 22:56:45 +0000 (15:56 -0700)]
Fix: Correct log credential for both jenkins

Change-Id: Id4f7040aaa37f67ae7f4c80adcba1366a91e4484
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
2 years agoFix: Add in missing credential mappings for maven 22/33522/1
Andrew Grimberg [Wed, 18 Aug 2021 21:52:26 +0000 (14:52 -0700)]
Fix: Add in missing credential mappings for maven

The mavenSettings file type is supposed to have mapped credentials as
well. This were accidentally skipped and missed in review

Change-Id: Ie35b4997104b38b4dc73f3859116137a36a73bbc
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
2 years agoMerge "CI: Migrate to JCasC Managed Files"
Dave Wallace [Wed, 18 Aug 2021 16:01:45 +0000 (16:01 +0000)]
Merge "CI: Migrate to JCasC Managed Files"

2 years agoRelicense docker files 41/27341/2
Vratko Polak [Wed, 18 Aug 2021 11:01:17 +0000 (13:01 +0200)]
Relicense docker files

This is to address the issue raised in:
https://gerrit.fd.io/r/c/27335/1/docker/LICENSE#2

Change-Id: I534c6d2ecfd09d2046625315860424cab2057b37
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoGlobal: Docs generation in s3 18/33118/13
pmikus [Tue, 13 Jul 2021 14:18:46 +0000 (14:18 +0000)]
Global: Docs generation in s3

+ Rework report/docs/trending jobs in CSIT
  to utilize AWS S3 cloudfront

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ica2757ba8dc31792631c8d6b53b332ebf688b15e

2 years agoCI: Migrate to JCasC Managed Files 70/33170/29
Vanessa Rene Valderrama [Fri, 16 Jul 2021 19:00:51 +0000 (14:00 -0500)]
CI: Migrate to JCasC Managed Files

This patch is to migrate Jenkins settings file to JCasC managed files
enabling self service managed files for the community

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: Ief195b9feaa933a37eb36109ccd836c79c85f4be
Signed-off-by: Kevin Sandi <ksandi@contractor.linuxfoundation.org>
2 years agoMerge "Fix debian-9 docker image builder"
Vanessa Valderrama [Fri, 13 Aug 2021 19:57:15 +0000 (19:57 +0000)]
Merge "Fix debian-9 docker image builder"

2 years agoMerge "CSIT: Add AWS job"
Dave Wallace [Wed, 11 Aug 2021 13:58:13 +0000 (13:58 +0000)]
Merge "CSIT: Add AWS job"

2 years agoUpgrade global-jjb to v0.65.1 43/33443/1
Vanessa Rene Valderrama [Tue, 10 Aug 2021 15:51:09 +0000 (10:51 -0500)]
Upgrade global-jjb to v0.65.1

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I4b22df091bc57f417053c6781e4f19b92fc67e97

2 years agoCSIT: Add AWS job 67/33067/6
pmikus [Fri, 9 Jul 2021 06:42:35 +0000 (06:42 +0000)]
CSIT: Add AWS job

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I60f40a38de89234b2eed1d9f0c04f465378c6de4

2 years agocsit: Add report merge job for 2101.1 33/33433/1
Tibor Frank [Tue, 10 Aug 2021 12:18:02 +0000 (14:18 +0200)]
csit: Add report merge job for 2101.1

Change-Id: If60599d596a13404fd5ba887f70a42498e666d86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoINFO.yaml: add approval link for Peter Mikus to tsc section 18/33418/1
Dave Wallace [Fri, 6 Aug 2021 19:52:24 +0000 (15:52 -0400)]
INFO.yaml: add approval link for Peter Mikus to tsc section

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I08a2b488fb8a3c14c8257733a47bac2380cfe2a0

2 years agoMerge "INFO.yaml: Add Peter Mikus"
Dave Wallace [Fri, 6 Aug 2021 13:11:10 +0000 (13:11 +0000)]
Merge "INFO.yaml: Add Peter Mikus"

2 years agoMerge "Fix workarounds for archive paths"
Dave Wallace [Fri, 6 Aug 2021 12:04:29 +0000 (12:04 +0000)]
Merge "Fix workarounds for archive paths"

2 years agoINFO.yaml: Add Peter Mikus 93/33393/1
Vratko Polak [Fri, 6 Aug 2021 11:48:56 +0000 (13:48 +0200)]
INFO.yaml: Add Peter Mikus

link: https://ircbot.wl.linuxfoundation.org/meetings/fdio-meeting/2021/fd_io_tsc/fdio-meeting-fd_io_tsc.2021-07-22-15.01.log.html
Change-Id: I59f255c4a298ef0436adec9a97570907fde74141
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoFix workarounds for archive paths 85/33385/8
Vratko Polak [Fri, 6 Aug 2021 09:54:37 +0000 (11:54 +0200)]
Fix workarounds for archive paths

https://gerrit.fd.io/r/c/ci-management/+/33060
has introduced workarounds for jobs
which create Robot outputs outside /archives/.
It got merged without verifying the workarounds work correctly.

+ The workaround for device job does not seem to be needed.
+ Perform the copy also when robot failed.

Fixes: 37a55a05cd6ac7ca15bbb99f5ddc9ca61874d5f8

Change-Id: I5e08545bd290fa917e85a375865a130c3f2ff996
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 years agoRevert "Global: Disable Nexus for fdio-infra-ship-logs in production" 00/33400/1
Peter Mikus [Fri, 6 Aug 2021 09:48:29 +0000 (09:48 +0000)]
Revert "Global: Disable Nexus for fdio-infra-ship-logs in production"

This reverts commit 94ccf388b6317892bdd5db5c7b8a2baedaf904c4.

Reason for revert: CORS setting of S3 is corrupted. Until LF ticket is
resolved reverting.

Change-Id: I59e6196f8e3317f249aa4258435705cc8965a80c
Signed-off-by: pmikus <pmikus@cisco.com>
2 years agoGlobal: Disable Nexus for fdio-infra-ship-logs in production 87/33387/1
pmikus [Thu, 5 Aug 2021 18:59:20 +0000 (18:59 +0000)]
Global: Disable Nexus for fdio-infra-ship-logs in production

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I98521297778c2c141c393d429c15039eae16d84f

2 years agoGlobal: Disable Nexus for fdio-infra-ship-logs in sandbox 84/33084/4
pmikus [Mon, 12 Jul 2021 13:17:01 +0000 (13:17 +0000)]
Global: Disable Nexus for fdio-infra-ship-logs in sandbox

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2fe96711a2abc032410562fd38ee7e86b1039cb0

2 years agoMerge "Global: Rework archive artifacts"
Dave Wallace [Thu, 5 Aug 2021 16:34:02 +0000 (16:34 +0000)]
Merge "Global: Rework archive artifacts"

2 years agoGlobal: Rework archive artifacts 60/33060/29
pmikus [Thu, 8 Jul 2021 12:34:33 +0000 (12:34 +0000)]
Global: Rework archive artifacts

This patch removes archive-artifacts-parameter macro
and ARCHVIVE_ARTIFACTS env var from csit and vpp project.

All project specific artifacts to be uploaded with the
log files SHOULD BE copied to $WORKSPACE/archives.

The next step once this is merged will be to remove NEXUS
entirely via JCasC.

+ Remove archive-artifacts from all csit/vpp yaml files.
+ Add fdio-infra-ship-backup-logs macro
+ Remove unused jjb/include-raw-deploy-archives.sh
+ CSIT:
  - copy job artifacts to $WORKSPACE/archives
+ HC2VPP
  - remove CSIT
+ TLDK:
  - remove CSIT

Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Iada020cf269714c34f9ce32d764d991827e3b003

2 years agoFix debian-9 docker image builder 78/33378/1
Dave Wallace [Thu, 5 Aug 2021 01:33:51 +0000 (21:33 -0400)]
Fix debian-9 docker image builder

- Docker installation no longer works on debian-9
  so don't install it when building debian-9
  executor images.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I7896799bdc6cd1d683966b1f0951405d4967891b

2 years agohicn: fix broken reverse trigger for docs merge jobs 76/33376/1
Dave Wallace [Wed, 4 Aug 2021 20:24:18 +0000 (16:24 -0400)]
hicn: fix broken reverse trigger for docs merge jobs

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I833f1e084a642df0679e9abe0b38a0ca58a2dd59

2 years agoInfra: Move Nomad URL to new server master 36/33336/1
pmikus [Wed, 4 Aug 2021 13:36:28 +0000 (13:36 +0000)]
Infra: Move Nomad URL to new server master

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib4c9da7e6b64c6fd05252265e8460ba7e0ec418f

2 years agoCSIT: Set daily jobs cadence to normal 51/33251/1
Tibor Frank [Mon, 26 Jul 2021 12:53:27 +0000 (14:53 +0200)]
CSIT: Set daily jobs cadence to normal

Change-Id: I1246d18431c2f171aafa0be7fafadce098714d57
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoMerge "- Add jobs for branch stable/2101 aarch64 - Trigger checkstyle for stable...
Dave Wallace [Mon, 19 Jul 2021 20:54:22 +0000 (20:54 +0000)]
Merge "- Add jobs for branch stable/2101 aarch64 - Trigger checkstyle for stable branches"

2 years ago- Add jobs for branch stable/2101 aarch64 73/33173/2
Mauro Sardara [Mon, 19 Jul 2021 07:58:18 +0000 (09:58 +0200)]
- Add jobs for branch stable/2101 aarch64
- Trigger checkstyle for stable branches

Signed-off-by: Mauro Sardara <msardara@cisco.com>
Change-Id: I2da2147c45b2b66280880898c2f34396d7c542e8
Signed-off-by: Mauro Sardara <msardara@cisco.com>
2 years agoMerge "Add jobs for branch stable/2101"
Dave Wallace [Fri, 16 Jul 2021 14:49:38 +0000 (14:49 +0000)]
Merge "Add jobs for branch stable/2101"

2 years agoAdd jobs for branch stable/2101 61/33161/1
Mauro Sardara [Fri, 16 Jul 2021 08:59:32 +0000 (10:59 +0200)]
Add jobs for branch stable/2101

Signed-off-by: Mauro Sardara <msardara@cisco.com>
Change-Id: I2bfc80570df3e6ab0485976d276b746201d7c694

2 years agoChore: Committer management 54/33154/2
Andrew Grimberg [Thu, 15 Jul 2021 15:45:38 +0000 (08:45 -0700)]
Chore: Committer management

* Clean up the PTL record as Andrew Grimberg (myself) was listed as both
  the PTL _and_ as a named party in the committers list just under two
  different IDs
* Remove committers that haven't been active in over a year
  Those being removed: CJ Collier, Ed Kern, and Thanh Ha

Change-Id: I874dcfa3bd556f442042660531ea5b7a114288ba
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
2 years agoMerge "Add libparc verify/merge job for ubuntu 20.04-arm64"
Dave Wallace [Thu, 15 Jul 2021 13:38:58 +0000 (13:38 +0000)]
Merge "Add libparc verify/merge job for ubuntu 20.04-arm64"

2 years agoAdd libparc verify/merge job for ubuntu 20.04-arm64 43/33143/1
Mauro Sardara [Thu, 15 Jul 2021 09:23:26 +0000 (11:23 +0200)]
Add libparc verify/merge job for ubuntu 20.04-arm64

Signed-off-by: Mauro Sardara <msardara@cisco.com>
Change-Id: Ib961f3370f0279748a390d564c05265f44d90cae

2 years agoDrop AVAILABILITY_ZONE 35/33135/1
Mohammed Naser [Wed, 14 Jul 2021 17:03:28 +0000 (13:03 -0400)]
Drop AVAILABILITY_ZONE

By default, OpenStack will schedule you into the right availablity
zone that has capacity, hard coding this can potentially result in
not being able to provision new virtual machines.

This patch drops the hard-wired value and lets Nova on the
scheduling size pick the correct availability zone.

Signed-off-by: Mohammed Naser <mnaser@vexxhost.com>
Change-Id: Id87111f06ad702daedb947f7e4d67f4cbbc2ad1a

2 years agoMerge "Add Ubuntu-20.04 and Centos-8 CI jobs for VPP stable/2101."
Vanessa Rene Valderrama [Mon, 12 Jul 2021 18:37:23 +0000 (18:37 +0000)]
Merge "Add Ubuntu-20.04 and Centos-8 CI jobs for VPP stable/2101."

2 years agoAdd Ubuntu-20.04 and Centos-8 CI jobs for VPP stable/2101. 88/33088/1
Dave Wallace [Mon, 12 Jul 2021 18:18:38 +0000 (14:18 -0400)]
Add Ubuntu-20.04 and Centos-8 CI jobs for VPP stable/2101.

- Required for VPP 21.01.1 maintenance release and
  CSIT 21.06 Report comparison tables.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Ib95a4a5221000b9fe4c4f5aa9b67a5bdee9943a8

2 years agoFix docker image builder vpp-ext-deps package copy to /root/Downloads. 74/33074/1
Dave Wallace [Sat, 10 Jul 2021 01:58:29 +0000 (21:58 -0400)]
Fix docker image builder vpp-ext-deps package copy to /root/Downloads.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Ifdc95193bbf6fe4866b5abfeea33a425fa8c2e9f

2 years agoRemove hicn jobs for ubuntu 18 and centos 8 56/32956/2
Mauro Sardara [Wed, 30 Jun 2021 09:46:33 +0000 (11:46 +0200)]
Remove hicn jobs for ubuntu 18 and centos 8

Signed-off-by: Mauro Sardara <msardara@cisco.com>
Change-Id: Ic43c1cd89764be3f45f4be2f107b1f5002d0b7dc
Signed-off-by: Mauro Sardara <msardara@cisco.com>
2 years agoChange 'Downloading' to 'Retrieving' in backup_upload_archives.sh 35/32735/1
Dave Wallace [Tue, 15 Jun 2021 18:10:55 +0000 (14:10 -0400)]
Change 'Downloading' to 'Retrieving' in backup_upload_archives.sh

- To prevent false positives when searching console logs for
  jobs which are downloading content over the internet.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I0d9d1e3138380453eabab6a0fe2844311304491f

3 years agoFix typo in vpp.yaml that removed vpp*master*aarch64 jobs. 49/32649/1
Dave Wallace [Wed, 9 Jun 2021 17:58:07 +0000 (13:58 -0400)]
Fix typo in vpp.yaml that removed vpp*master*aarch64 jobs.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: If852c1a009d317b0748dde350c8c63102f38f7bf

3 years agoRemove vpp-*-master-centos8-* jobs 15/32615/1
Dave Wallace [Mon, 7 Jun 2021 16:11:10 +0000 (12:11 -0400)]
Remove vpp-*-master-centos8-* jobs

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I911a08af7bcbcd1c6e7f8db36ac3028d31425bc2

3 years agoMerge "Add stable/2106 branch to docker image builds"
Vratko Polak [Fri, 4 Jun 2021 12:12:35 +0000 (12:12 +0000)]
Merge "Add stable/2106 branch to docker image builds"

3 years agoMerge "Configure S3 logs on production"
Dave Wallace [Thu, 3 Jun 2021 22:21:50 +0000 (22:21 +0000)]
Merge "Configure S3 logs on production"

3 years agoAdd stable/2106 branch to docker image builds 60/32560/1
Dave Wallace [Thu, 3 Jun 2021 20:57:45 +0000 (16:57 -0400)]
Add stable/2106 branch to docker image builds

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: If22e9e2dd8ab5ed2008ce1baeb78721bf9035681

3 years agoMerge "JJB: Include perf analysis per job"
Dave Wallace [Thu, 3 Jun 2021 19:52:57 +0000 (19:52 +0000)]
Merge "JJB: Include perf analysis per job"

3 years agoJJB: Include perf analysis per job 03/32103/10
pmikus [Fri, 23 Apr 2021 13:12:24 +0000 (13:12 +0000)]
JJB: Include perf analysis per job

+ Useful for performance analysis before run.
  This should help to analyze machine load before starting
  payload by comparing conditions from running jobs.
- Requirements: sysstat (apt install sysstat)
- Remove extraneous python import from
  backup_upload_archives.sh
- Fix sar issue on centos-7
- Fix debian9 lftools install / upgrade issue

Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I6b61f99b9b2cde2bac3dacdefaa926e9afbb157e

3 years agoMerge "CSIT: Reduce daily jobs cadence for 2106 report data collection"
Vratko Polak [Thu, 3 Jun 2021 10:56:44 +0000 (10:56 +0000)]
Merge "CSIT: Reduce daily jobs cadence for 2106 report data collection"

3 years agoConfigure S3 logs on production 49/32549/1
Vanessa Rene Valderrama [Wed, 2 Jun 2021 19:34:17 +0000 (14:34 -0500)]
Configure S3 logs on production

Configuring Jenkins production for S3 logging

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I72e9c924e6dba6fbbf68d578bba2b64054035eff

3 years agoapi-checkstyle: do not send the notification about the successful API checks 44/32544/1
Andrew Yourtchenko [Wed, 2 Jun 2021 14:18:37 +0000 (14:18 +0000)]
api-checkstyle: do not send the notification about the successful API checks

the api-checkstyle was initially done with notification for both successful
and failed api-checkstyle runs, just as a matter of precaution.
It's time to keep the notification only for the fail case, thus
fulfilling the point of notifications.

Change-Id: I41a12e7a30bc852c9280fc08a6eae426438f7d92
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
3 years agoCSIT: Reduce daily jobs cadence for 2106 report data collection 39/32539/2
Tibor Frank [Wed, 2 Jun 2021 07:30:30 +0000 (09:30 +0200)]
CSIT: Reduce daily jobs cadence for 2106 report data collection

Change-Id: I42b60d73f5c064c63bdf3473bf9d1b3b8b1b3d0f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoMerge "CSIT: Decommission 3n-hsw - jobs"
Vratko Polak [Wed, 2 Jun 2021 08:50:19 +0000 (08:50 +0000)]
Merge "CSIT: Decommission 3n-hsw - jobs"

3 years agoCSIT: Decommission 3n-hsw - jobs 08/32508/3
pmikus [Tue, 1 Jun 2021 10:17:35 +0000 (10:17 +0000)]
CSIT: Decommission 3n-hsw - jobs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I10be9e27c125fd5524a6cb381806f18bd0514e89

3 years agocsit: Remove not needed jobs 60/32460/2
Tibor Frank [Thu, 27 May 2021 05:03:45 +0000 (07:03 +0200)]
csit: Remove not needed jobs

https://jenkins.fd.io/view/csit/job/csit-docs-merge-2005-ubuntu2004-x86_64
https://jenkins.fd.io/view/csit/job/csit-report-merge-2005-ubuntu2004-x86_64
https://jenkins.fd.io/view/csit/job/csit-verify-tox-2005-ubuntu2004-x86_64

https://jenkins.fd.io/view/csit/job/csit-docs-merge-2009-ubuntu2004-x86_64
https://jenkins.fd.io/view/csit/job/csit-*-perf-report-coverage-2009-*
https://jenkins.fd.io/view/csit/job/csit-*perf-report-iterative-2009-*
https://jenkins.fd.io/view/csit/job/csit-report-merge-2009-ubuntu2004-x86_64
https://jenkins.fd.io/view/csit/job/csit-vpp-device-2009-ubuntu2004-x86_64-*

https://jenkins.fd.io/view/csit/job/csit-*-perf-report-coverage-2101-*
https://jenkins.fd.io/view/csit/job/csit-*perf-report-iterative-2101-*

Change-Id: I54ea273cb7fb33fdbe427693a021a8b50def6223
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agocsit: Add CSIT rls2106 jobs 45/32445/2
Tibor Frank [Wed, 26 May 2021 07:09:24 +0000 (09:09 +0200)]
csit: Add CSIT rls2106 jobs

Change-Id: I6ef10c854362a58ca14c12d8a73dfb5c855aebee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoChanges for VPP 21.06 Release 32/32432/3
Andrew Yourtchenko [Tue, 25 May 2021 10:02:22 +0000 (10:02 +0000)]
Changes for VPP 21.06 Release

Change-Id: I2d20e79e621de018b94f8c8db10982730cda805b
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
3 years agoConfigure S3 logs on the sandbox 29/32429/1
Vanessa Rene Valderrama [Mon, 24 May 2021 16:33:04 +0000 (11:33 -0500)]
Configure S3 logs on the sandbox

Configuring the Jenkins sandbox for S3 logging

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I9ef48f67b97217265fdf59cb9a49247ab8e7f643

3 years agoUpgrade global-jjb to v0.64.0 27/32427/1
Vanessa Rene Valderrama [Mon, 24 May 2021 15:49:15 +0000 (10:49 -0500)]
Upgrade global-jjb to v0.64.0

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I3f0b4896568d7746a44ff8cfab4d3b2db14f7a33

3 years agoRevert "Retry VPP jobs if git clone fails." 76/32376/1
Andrew Yourtchenko [Wed, 19 May 2021 15:22:16 +0000 (15:22 +0000)]
Revert "Retry VPP jobs if git clone fails."

This reverts commit 1fb419681d9738d890e90e9ac7cd8e36cafc5d4d.

Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
Change-Id: I7993e11ab39d2f6b05c11484c68bbed0fe431b72

3 years agoMerge "Fix make test docs upload & clean up docs jobs"
Vratko Polak [Fri, 14 May 2021 08:14:24 +0000 (08:14 +0000)]
Merge "Fix make test docs upload & clean up docs jobs"

3 years agoFix make test docs upload & clean up docs jobs 05/32305/1
Dave Wallace [Thu, 13 May 2021 20:30:37 +0000 (16:30 -0400)]
Fix make test docs upload & clean up docs jobs

- make test DOCS_DIR in vpp/master changed location,
  fix upload for master and subsequent release
  branches.
- Don't archive docs build output to avoid
  stress on nexus
- Sphinx docs are generated and pushed
  to github by hand for publishing.  Therefore
  remove sphinx docs jobs and include building
  of sphinx docs in the vpp-docs-verify-* jobs.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I3b2badbf3e2b242ad6b4efcc7d6d281c8b26136b

3 years agoChange prod & sandbox to public IPs for Ingress/Gerrit 02/32302/1
Dave Wallace [Thu, 13 May 2021 16:35:25 +0000 (12:35 -0400)]
Change prod & sandbox to public IPs for Ingress/Gerrit

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Iebfee30a14297e781d2c3abfc045a2b5e7344e5d

3 years agoBackup console logs to consul. 20/32020/4
Dave Wallace [Fri, 16 Apr 2021 22:33:15 +0000 (18:33 -0400)]
Backup console logs to consul.

- Add additional executor info to console output
  for consul log storage.

Change-Id: Ifc9174ff69f26aa31f92e3680606f7a2303b5924
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoUpgrade global-jjb to v0.63.0 22/32222/1
Vanessa Rene Valderrama [Wed, 5 May 2021 15:44:06 +0000 (10:44 -0500)]
Upgrade global-jjb to v0.63.0

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: Idbf89d2d9e9e934329f45fc30f4c8650bb6ec6af

3 years agoMerge "Remove deprecated fdio-infra-shiplogs macro"
Vratko Polak [Tue, 4 May 2021 15:29:05 +0000 (15:29 +0000)]
Merge "Remove deprecated fdio-infra-shiplogs macro"

3 years agoRetry VPP jobs if git clone fails. 97/32197/1
Dave Wallace [Mon, 3 May 2021 17:34:31 +0000 (13:34 -0400)]
Retry VPP jobs if git clone fails.

- Use naginator regular-expression to only retry
  builds when logs contain git clone failure
  message.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Icb18b7c287b0ccb9d47c7c4af216b3204a720291

3 years agoMerge "Nomad: Redirect connection to different server"
Dave Wallace [Wed, 28 Apr 2021 11:35:11 +0000 (11:35 +0000)]
Merge "Nomad: Redirect connection to different server"

3 years agoIncrease nomad aarch64 memory limit for ubuntu 20.04 labels 40/32140/1
Dave Wallace [Tue, 27 Apr 2021 15:35:48 +0000 (11:35 -0400)]
Increase nomad aarch64 memory limit for ubuntu 20.04 labels

- Required to avoid OOM-Killer for CI jobs
  running 'make test' on AARCH64

Change-Id: I16e0f09dbee85fed8d256c4efd6d51d59f08ff09
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoMerge "Separate VPP stacktrace generation from artifact archiving"
Vratko Polak [Tue, 27 Apr 2021 08:25:33 +0000 (08:25 +0000)]
Merge "Separate VPP stacktrace generation from artifact archiving"

3 years agoRemove deprecated fdio-infra-shiplogs macro 06/32106/1
Dave Wallace [Fri, 23 Apr 2021 19:22:14 +0000 (15:22 -0400)]
Remove deprecated fdio-infra-shiplogs macro

- Update node labels, replacing deprecated
  'snergster' labels with equivalent
  'fdiotools' node labels

Change-Id: I1ff7d42b2c4f4f592567378b7f1fe359ff7e2a0f
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoSeparate VPP stacktrace generation from artifact archiving 78/32078/2
Dave Wallace [Wed, 21 Apr 2021 16:52:51 +0000 (12:52 -0400)]
Separate VPP stacktrace generation from artifact archiving

- Separate removal of socket files in workspace archive directory
  from archiving of artifacts
- Clean up deprecated workspace-archive-artifacts-parameter macro

Change-Id: I11c7fe55d3412fb7261da9f0cfb809a152ae1d51
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoMerge "Refactor ccache config to use per-os ccache dirs."
Vratko Polak [Fri, 23 Apr 2021 09:04:12 +0000 (09:04 +0000)]
Merge "Refactor ccache config to use per-os ccache dirs."

3 years agoNomad: Redirect connection to different server 02/32102/1
pmikus [Fri, 23 Apr 2021 06:59:26 +0000 (06:59 +0000)]
Nomad: Redirect connection to different server

+ Due to DC move we need to redirect traffic
  to hosts that are already moved.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43aba2f030fa2521aba548a43d4186333909f0ea

3 years agoMerge "Fix docker image update script"
Vratko Polak [Thu, 22 Apr 2021 14:28:45 +0000 (14:28 +0000)]
Merge "Fix docker image update script"

3 years agoFix docker image update script 16/32016/2
Dave Wallace [Fri, 16 Apr 2021 17:56:29 +0000 (13:56 -0400)]
Fix docker image update script

- Handle case where the original image has been
  deleted from dockerhub.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Ifcb34f39b36f2974d45a48754b72d33e9cfc4b06

3 years agoRefactor ccache config to use per-os ccache dirs. 14/31914/6
Dave Wallace [Wed, 7 Apr 2021 00:41:43 +0000 (20:41 -0400)]
Refactor ccache config to use per-os ccache dirs.

- Simplify ccache state output to console log by
  using ccache stats command.
- Bump max size of ccache dir to 10G (centos8 is
  approximately 5.7G)
- Clean up extraneous ccache dir after docker build
  is complete.

Change-Id: Ia2b55b7cd47212fce91b4567d0cca69d2ce892ed
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoMerge "Modify OpenStack builders"
Vanessa Rene Valderrama [Tue, 20 Apr 2021 18:12:55 +0000 (18:12 +0000)]
Merge "Modify OpenStack builders"

3 years agoMerge "Add new dev branch to the CI framework"
Vratko Polak [Tue, 20 Apr 2021 14:24:51 +0000 (14:24 +0000)]
Merge "Add new dev branch to the CI framework"

3 years agoModify OpenStack builders 17/32017/1
Vanessa Rene Valderrama [Fri, 16 Apr 2021 20:04:19 +0000 (15:04 -0500)]
Modify OpenStack builders

Modifying OpenStack builders to use V3 flavors

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I1601921bba92f9ad9519dda992846ccca586d657

3 years agoFix backup archive directory structure. 10/32010/2
Dave Wallace [Fri, 16 Apr 2021 14:06:36 +0000 (10:06 -0400)]
Fix backup archive directory structure.

Change-Id: I9fd1194bdb68239df2a6e2c4432ec1849ca12aac
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoMerge "builder: if new ansible dir doesn't exist, use old one."
Vanessa Rene Valderrama [Thu, 15 Apr 2021 16:53:42 +0000 (16:53 +0000)]
Merge "builder: if new ansible dir doesn't exist, use old one."

3 years agoUpgrade global-jjb to v0.62.0 81/31981/1
Vanessa Rene Valderrama [Wed, 14 Apr 2021 20:31:27 +0000 (15:31 -0500)]
Upgrade global-jjb to v0.62.0

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I2b5f181f32ce399d6b6091ab051562fe6e714fb6

3 years agoTesting JCasC 77/31977/1
Vanessa Rene Valderrama [Wed, 14 Apr 2021 16:45:46 +0000 (11:45 -0500)]
Testing JCasC

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: I857f42130e50c73bce2844a15c0e351d717a21fd

3 years agoAdd new dev branch to the CI framework 76/31976/1
Konstantin Ananyev [Wed, 14 Apr 2021 12:42:46 +0000 (12:42 +0000)]
Add new dev branch to the CI framework

Signed-off-by: Konstantin Ananyev <konstantin.ananyev@intel.com>
Change-Id: Icb676be654efa89792b7917c77d90c4d8092712a

3 years agobuilder: if new ansible dir doesn't exist, use old one. 68/31968/2
Dave Wallace [Tue, 13 Apr 2021 18:40:23 +0000 (14:40 -0400)]
builder: if new ansible dir doesn't exist, use old one.

Change-Id: I539fc3981b46a285bf6934d2dd13c8c660fc0e8a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoMerge "CSIT: restrict CSIT VPP Device to 32 cores"
Dave Wallace [Tue, 13 Apr 2021 18:14:27 +0000 (18:14 +0000)]
Merge "CSIT: restrict CSIT VPP Device to 32 cores"

3 years agoMerge "Use fdio-infra-publish for nomad executor based jobs"
Vanessa Rene Valderrama [Mon, 12 Apr 2021 16:03:55 +0000 (16:03 +0000)]
Merge "Use fdio-infra-publish for nomad executor based jobs"

3 years agoFix broken docker install for debian-9 executor. 51/31951/1
Dave Wallace [Fri, 9 Apr 2021 20:47:37 +0000 (16:47 -0400)]
Fix broken docker install for debian-9 executor.

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I4766dfec19de63ba6ae7dbd86ed70f696a10f117

3 years agoCSIT: restrict CSIT VPP Device to 32 cores 59/31859/2
Juraj Linkeš [Thu, 1 Apr 2021 08:52:35 +0000 (10:52 +0200)]
CSIT: restrict CSIT VPP Device to 32 cores

We're seeing frequent "Host high CPU load" alerts. The jobs are not
restricted in any way, which could lead to resource starvation or
misdirection of resources between jobs.
Mirror the VPP jobs configuration - restrict to 32 cores.

Change-Id: I6b36602df0546fedf9603dda395325199130513e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoUse fdio-infra-publish for nomad executor based jobs 12/31912/3
Dave Wallace [Tue, 6 Apr 2021 21:08:21 +0000 (17:08 -0400)]
Use fdio-infra-publish for nomad executor based jobs

- Separate post build executor info dump into its
  own script file.
- Remove backup_upload_archives.sh from
  fdio-infra-shiplogs which is now only used for
  openstack executors.
- Add setup_executor_env.sh to run first for all
  jobs which run on nomad/dockerhub images.

Change-Id: I564201b8c578e6541152e6af74537d1d007ba1a7
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoScripts: Change CSIT ansible path 26/31926/1
pmikus [Thu, 8 Apr 2021 11:07:20 +0000 (11:07 +0000)]
Scripts: Change CSIT ansible path

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I09ad51af52e9246ab4491ffd7ed03ab5c8a09268

3 years agodisable ASAN in the debug builds 04/31904/1
Andrew Yourtchenko [Tue, 6 Apr 2021 14:24:53 +0000 (14:24 +0000)]
disable ASAN in the debug builds

The move to unix sockets has broken ASAN fairly thoroughly, so disable it

Change-Id: Icf3822c5927309f8574865008173a66019a3ed55
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
3 years agoMerge "Fix hicn-docs job to use correct label."
Vratko Polak [Thu, 1 Apr 2021 14:48:00 +0000 (14:48 +0000)]
Merge "Fix hicn-docs job to use correct label."

3 years agoFix hicn-docs job to use correct label. 56/31856/1
Dave Wallace [Thu, 1 Apr 2021 01:32:14 +0000 (21:32 -0400)]
Fix hicn-docs job to use correct label.

- Also add gerrit-parameter & branch-refspec for
  testing in jenkins sandbox (same pattern as vpp.yaml).

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Ia48c7e484db78f35dffe93e78c418736c686b356

3 years agoModify OpenStack templates 33/31833/1
Vanessa Rene Valderrama [Tue, 30 Mar 2021 16:19:42 +0000 (11:19 -0500)]
Modify OpenStack templates

Switching the OpenStack templates used by CI mgmt jobs back to V2
flavors due to problems with the V3 flavors in production. Modifying the
INFO.yaml job to use a template with a V3 flavor to continue
troubleshooting the issue in production because this issue can't be
reproduced on the sandbox.

Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Change-Id: Ibc8e744e3201538122965a70ab0f23ca3fe66371