Add current nodepool configuration

This adds in the nodepool configuration that we are presently using.
This is the starting point for the community to help define what build
slave definitions are needed.

Change-Id: I1c6325869a0a411265994090f9dc754de03ea173
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Attache nodepool jobs to zuul

This attaches the ci-management-{verify,merge}-nodepool jobs up to the
proper zuul trigger points (check, post-merge)

Change-Id: I7a67affb8c27d19eabcf72704d8e65b402dc1202
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Add nodepool management jobs

Add jobs for doing nodepool management

Change-Id: I9d5b74850f51c7f950ccb3580c1aa7f981786494
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Add manual triggered csit-vpp-functional-hw-tb2 job.

This job would be create from the same template as
csit-vpp-functional-virl, but for the time being this have to be
manually triggered. I didn't find a way how to parametrize
gerrit-trigger-patch-submitted so I've created
gerrit-trigger-manually-triggered.

Change-Id: I2d4f2c6bb8ebb94cd8563132feac765d46e1b56d
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Add verify / merge zuul jobs and update layout

* Update the zuul layout.yaml with changes that are currently being hand
managed.

* Add in the verify and merge jobs for zuul (which have temporarily
  been handmanged in as well)

Change-Id: I1f86488165f384def27d03593d161a56f955e4b9
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Add new verify / merge jobs for zuul

We need jobs to be able to manage zuul layout changes. This brings those
jobs in

Change-Id: If6397b0d7f52edc7f2668a2351c35e637ef92888
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Rename ci-management-merge

Rename the ci-managment-merge job to be ci-management-merge-jjb as it is
jjb specific. This sets us up to support
ci-managment-{verify,merge}-{zuul,nodepool} job definitions as each of
these job definitions is verify specific to the tool being managed

Change-Id: I1bfcc02411af043f349ca5b62aac17bffe8df363
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Move ci-management jobs to own directory

Let's make the ci-management jobs be a little more consistent with other
projects and have them live in their own directory. Global macros will
still live at the root jjb level.

Change-Id: Ie9bd90ae049b4b83fad050b697e14aced18de4a6
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Remove unneeded ci-management weekly job

We've found that as the projects grow that having a weekly job to
refresh the JJB fails more often than it succeeds. As this can be done
as a manual process by the releng team it's better to just remove the
job than have it sit around failing.

Change-Id: I48d154d3cb459171f76526844ef6b64269982c42
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Add PYTHONPATH to pylint execution env.

Change-Id: If8a696ee812ddc0b7b3cdb262455d5b2ac4c54d0
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Merge "Add violations publisher plugin for pylint."

Add violations publisher plugin for pylint.

Change-Id: I5685d1679f0e26d87e7c704637304c6f8c5a00e5
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Remove unnecessary jclouds wrapper for pylint validation.

Change-Id: Icfbebedf1ada83a1badcec796b0b986819f265ef
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Enable robot framework jenkins plugin.

Change-Id: I506ea3dd431b559c3ce1e756f2310103da05024d
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Separate VIRL test job; Make VIRL job non-concurrent.

Rename csit-vpp-functional to csit-vpp-functional-virl to express the
tests are being run on VIRL environment. This one of first steps to
separate job runs environments - LF's multi-node VMs and VIRL.

Make the VIRL job non-concurrent, as we are working on mechanisms of
spawning of VIRL simulations and VPP installation.

Change-Id: I0c9f5a1973b7d7764bb192b91d9e8b331f4b40a2
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Rename csit validate job, add pylint installation to script.

Adding sudo apt-get install script to the pylint validation job. Will
move it to the Vagrantfile after all deps are known and fixed.

Change-Id: I17feaaf4280388088df77f8921a26c1c1c873557
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Trigger build of this project for CSIT patches.

Until CSIT is fully integrated and functional, we need to have an
option to trigger jenkins build easily by CSIT project change rather
than VPP build. This is a temporary trigger setup.

Change-Id: I0040158024cf9446b1533b04599e1912f08d3ea8
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Fix ci-management-verify not testing the submitted commit

The ci verify job was testing branch HEAD which doesn't help us verify
code submissions. This patch fixes it so that we pass a parameter
{commit} to represent the branch or commit that we should run against.
Sets the merge job to run against $ZUUL_BRANCH while the verify job
runs against $ZUUL_COMMIT.

Change-Id: I9516bfc14a9981c5e8348e0a6324a3c15b5afc32
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add make csit-vpp-validate-pylint job more descriptive

Change-Id: I409d4dced99f349e994947ae98ce9e1a4416712b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix typo in csit validate job template

Change-Id: I3fec5aaf21d165515375c9fafbb4c5830d621d33
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix pylint template name conflict

Change-Id: I9019459ecde83644e747382f84141c86b77297fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Rework CSIT jobs - 1 validates CSIT commits, 1 tests vpp debs."

Add virtualenv and pip to jenkins executor image.

Change-Id: I4315eeacff98fa4c9a41a53e608b90a68024d92f
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Rework CSIT jobs - 1 validates CSIT commits, 1 tests vpp debs.

Change-Id: I6e8b78fec5b458cfdac6864617cdbd342b6f0594
Signed-off-by: Stefan Kobza <skobza@cisco.com>

Remove the toolchain_test jobs

Toolchain test is no longer needed and the repo is currently admin
access / visible only until we can clean gerrit.

Change-Id: I891755a0411be350249a1e3966c5d66abf8165a6
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Turn down some of the spurious publishers.

Espcially the aggressive archive artifacts.

Change-Id: Ia20cfddb2ee543f000ca4d99f0462be7a740b608
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Fix Zuul failing --force-message against Gerrit 2.12

We probably don't need the "success-message" and "failure-message" but I
think adding it for clarity of which type of job is leaving a comment is
nice.

Change-Id: I7210c0281e3954f714ad5aa308ad8206f25878be
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Convert ci-management jobs to zuul

Change-Id: I58d6f956a7efdecfe537c3b6b5bdc88f29cae723
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Finish converting toolchain_test to zuul

* Migrate toolchain_test-merge to using zuul
* update toolchain_test-verify to use new scm macro
* drop the project and branch parameters as zuul doesn't honor them
  anyway

Change-Id: I678bcc3c19477fa245de99d5bc4d09d822339e09
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Add new zuul-trigger-scm macro

Add a new macro for zuul triggered scm

Change-Id: Ib23b7ba3d802339951e57a864a0fa40d954de5de
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Switch toolchain_test-verify to using zuul

Change-Id: Icf49effa5ca4a7eb75d15a93bd504dbc21d3bc17
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix commit hook url

Change-Id: Ia6f15d9cb6b95a764c0ed3c05f22da812c0352fe
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Undo switch off of Gerrit Trigger

I can't keep working on this anymore today and leaving it configured for
zuul overrnight is a broken concept.

This moves everything back to Gerrit Trigger control. We can move jobs
individually tomorrow.

Change-Id: I6943708a6001acb7c5acfe6a6746d6c056813f52
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

missed a recursive call

Change-Id: Ie0cb6b45f1ca57c4cef85f7550482f664aaa6879
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

JJB needs to be recursive from the CLI

Our puppet module doesn't properly the JJB recursive flag in the ini
file. So, let's just make sure it happens even if not set by setting the
flag in the call.

Change-Id: Ia23fd404f357db08fb3b4b39862de9ed80695319
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Migrate to Zuul configuration

Change-Id: I055731ac99ae40960ee1e6a3e5cf0595d8da4600
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Move JJB jobs to dedicated static slave

Zuul has a problem where it can't control jobs that are tied to the
master. As we need JJB jobs to also be able to actually do some work on
the the Zuul system we're statically tying it into Jenkins with a
requirement that only jobs specifically targetting it can run there.

Change-Id: I5a689056edbfa2e154b88d6b3df0a9b97fa17192
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Enabled CCACHE_DIR to persist between jobs

Change-Id: I7d7fc9c8c0dd561e4abbab481ccf4f879763e2e6
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Merge "Turn off archiving for vpp verify and merge job"

Turn off archiving for vpp verify and merge job

Change-Id: If94f2c76740c8250a403557f0ceab0f17df4ddf7
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Update build-bot toolchain to match the vpp ubuntu Vagrantfile.

Change-Id: I03c63afdd02f0082bf0bd800e0d2f3b01b151415
Signed-off-by: Dave Barach <dave@barachs.net>

Add V=0 to make command line;TAG=vpp_debug -> TAG=vpp

Change-Id: I4235334db36609be45b1e31e80659d5cda1827da
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Fix .gitreview to have correct URL

Now that we have a proper name the .gitreview file should reflect this.

Change-Id: I23902395270480b87aefe4476fc11a4ddc1524ee
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Archive target/ dirs and keep pax-exam unpack area

Change-Id: I2f9eb1ce744881da675551bef420e1ccbbf172bf
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Redirect job output to file and archive them

Also limit max artifacts to keep to 5.

Change-Id: If7603844d12e43f208817dc77b015ddc63786d99
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Change honeycomb-settings UUID

JJB doesn't handle the latest config file provider IDs for objects
properly as it expects them all to be prefixed with
org.jenkinsci.plugins.configfiles.maven.MavenSettingsConfig otherwise it
believes the information to be a file path (which doesn't work!) As
such, the honeycomb-settings ID has been fixed up to be more inline with
what JJB expects / requires (until we can get it patched). This required
a restart of Jenkins to take effect.

Change-Id: I60092b1a229d498d672b60fef9554fd7a16d5b60
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix the repo name that the project looks for

honeycomb was mispelled and we hadn't caught that previously.

Change-Id: Ib33a61b1297a4afa246d33c3091298c20999373c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Add gerrit trigger to csit job

Change-Id: I26d5f8a4431d362fa018a6073c6628101bb4a0f0
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Setup csit job to do verify

Setup the csit job to do verify and execute ./bootstrap.sh if it exists.
It will fail the job if it does not exist

Change-Id: Ie5f776009f6079693d452b299c3bc185451550ac
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Update vpp maven deployment

Update the vpp maven deployment script to use the correct repo and
namespace

Change-Id: If3da11885ea674131cc1fe5fd91d3ccaca8f5a83
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Merge "Build vpp on csit manual trigger"

Make sure that jjb jobs run on master node only

Change-Id: I2fc3110e8992c45ffcdf9758be7b9453a1b53272
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Build vpp on csit manual trigger

Change-Id: I9a8234a0fab0e13537ff5e91d542a42eefcaf287
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Rename of job

- correct repo
- jenkins regex puts in right tab

Change-Id: I314a02d90df8847178082c054f706ae74fca9639
Signed-off-by: Keith Burns (alagalah) <alagalah@gmail.com>

Robot testing framework

- please note this ties in with new CSIT repo and this change
referenced here: https://gerrit.projectrotterdam.info/r/#/c/91/

Change-Id: I6cad694155c65b7618bbb5dea5bac3888fbcbe59
Signed-off-by: Keith Burns (alagalah) <alagalah@gmail.com>

Initial Honeycomb JJB Commit

Change-Id: I50e3c7534ade3f241848df5896190038d3cc3410
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Add honeycomb settings macro

Change-Id: Iffe82075d466356e1522be20c6967abb8858184b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Allow ci-management to do concurrent verifies

Make sure that our verify jobs for ci-management are allowed to be run
in parallel

Change-Id: I7390c836f88968f3d9d2538111dba389648cb72d
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Enable concurrent verifies for vpp

Make sure that the verify job for vpp allows for concurrent runs

Change-Id: Ifb88cdba872150c2d7c67b7651728123b8ab2c25
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Some additional items needed for testing in basebuild

Change-Id: I4730136b45d79f081d9bc649025bc34af62c21a5
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Make the script fail build if mvn deploy fails

The script wasn't picking up a failed mvn deploy failure. This changes
it so that we need an definite exit code of 0 to not fail the build.

Change-Id: I094bf1e149f779061223496a0b2bc347a3705b5b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Update the deployment repo and also detect failure

A failed upload was not being detected and causing the job to fail. This
fixes it so that if the maven upload fails we'll fail the build.

Also, at Ed's request there is now a .dev repo for the regular merge
time deb files so we need to push there and not to .release

Change-Id: I08e01979c35c248f6e0fcc6c3b166f2148a9b9f0
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Do not double up the _amd64 for maven push script

Change-Id: If6f686d44442a42e98e4d5d783a4c2d869c98023
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix up push script repoId selector and classifications

The settings files use a - separator for the repoIDs so we need to make
sure that we're concatenating against a - instead of .

Additionally we're tightening up the version classification of the
pushed objects. This may not be 100% still but it should be better than
what we were attempting previously.

Change-Id: I726f9d87c3441357701ad79b7357a337c6636a42
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

ENV var test for MAVEN_SELECTOR was inverted

The script should be detecting on a null ENV var, not a non-null
variable. In other words, the test was inverted.

Change-Id: If5ee68301300ec363e171f99798c06daa1428ede
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Push artifacts

Update to support pushing jar and deb artifacts

Change-Id: I38552564e2dbf6dddfaca4a7a21cd800619829c2
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Make maven target name not have a space

Change-Id: I6cadff18eff555791e1f93ced6021a40dd70b029
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

archive artifacts for vpp

Change-Id: I323ea617b3dc40c81f93e00b08777622d9889d6d
Signed-off-by: Ed Warnicke <eaw@cisco.com>

fix bad key call

Change-Id: I2abb52da6678f31e6fbfcb5a43994b98fa5e1beb
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Port more macros over from ODL

Bring over some more macros from ODL.

Publishers:
* archive-artifacts
* email-notification (currently set to a bad address on purpose)
* jacoco-report

Builders:
* provide-maven-settings

Change-Id: I60684dbcdf87b6104f7763e7f74c48174a2355e8
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Change back to building install-deb

Change-Id: Iea348a42c289fc654c52fcddff0f05f5b01d5d71
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Merge "Fix for make target"

Fix for make target

Change-Id: Ifeb5e21203f034f479b662e20649a3d990e2741f
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Merge "Fixes for vpp JJB and vagrant file"

Fixes for vpp JJB and vagrant file

Change-Id: Iffc3076ffa2c69913fa3473d9debbe753d680883
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Add maven 3.3.9 to JJB

Change-Id: I98baa7e5d4ea3901b35263076cd1a202c1a2541b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Add maven settings macros

Add a global maven settings as well as vpp project specific settings
configuration.

Change-Id: Id60076f973c03fec4ab1ed76a6811a811e460952
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Initial commit of vpp JJB Jobs

Change-Id: I0ee210ac926bf5ffc7a5efa72b7e044e04fb6fa0
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Fix toolchain_test script to build

Change-Id: I5479a8e10aa080548c313954d64b25489450cef5
Signed-off-by: Ed Warnicke <eaw@cisco.com>

Make merge job use remerge GT

Change-Id: If3e8e9de194edd7c817487942d72fef4e8b377ee
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add slave node connections to toolchain_test jobs

Change-Id: I7c7fd273d1efdea238c2cdc419adb1fc41649ad4
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Merge "Example jobs for toolchain_test project"

Merge "Make sure verifies are recursive for trigger"

Make sure verifies are recursive for trigger

Make sure the ANT path is a recursive path lookup for the verify trigger

Change-Id: I2662cdf817f22f142bee996e4648f34be0634170
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Example jobs for toolchain_test project

Change-Id: I33fb03d605f552194f74b3e5cc37c1ae6e7b0967
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Initial build environment vagrant configuration

This is the initial load in of the Vagrantfile used to create the build
environment for Jenkins. More work should be done to break apart the
current inline shell script with external scripts so that it will be
easier to pick and choose what is to be run and that way the community
can share a single script

Change-Id: Ied7f9e29c4f20628aff3eae29335ad13f385139f
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix the jjb update script to point at gerrit

The jjb update script was copied from OpenDaylight and while I had
updated the user portion of the git URL I didn't update the host
portion.

Change-Id: I707403125826150e17ffd168587d735d0525d53c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Initial JJB self-hosting job definitions

These are the base definitions for having Jenkins validate and merge the
JJB jobs that manage the Jenkins instance.

Change-Id: Ic028248bc6cacb86d4db8c1e0f5f924640892c99
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Initial code checkin

Initial bootstrapping of the ci-management repo

Change-Id: I66d18adf113f8087c46ab1b4f9aedcb81ee1e9aa
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Initial empty repository