ci-management.git
8 years agoDocument the process of re-spinning an image 76/1176/16
C.J. Collier [Tue, 17 May 2016 19:03:02 +0000 (12:03 -0700)]
Document the process of re-spinning an image

* Document the process of respinning jcloud images in README.txt
* Create /scripts/respin-jcloud-images.sh
* Create /vagrant/lib/respin-functions.sh
* Automate the process of fetching latest base images
* Automate the process of creating new "LF upload" snapshots
* Automate process of creating jcloud image
- Boot fresh VM
- run bootstrap.sh
- run system_reseal.sh
- snapshot re-sealed system
* Unable to automate updating jcloud image regex for staging nodes
* Correct shasum to sha1sum
* Add cloud-initramfs-* to PACKAGES list
* Install cloud-init during system reseal

Change-Id: Ie70d5f1fdee0e9f06810da6f37bfc710e3e06b8e
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoUpdate ci merge job to use 4 threads 06/1206/1
Thanh Ha [Fri, 20 May 2016 00:42:11 +0000 (20:42 -0400)]
Update ci merge job to use 4 threads

JJB 1.5.0 supports the --workers flag which allows us to tell it to use
multiple thread to update jobs.

Change-Id: I4626777990ca243d93a250e05d7791319eb20ac2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoSimplify cfp jjb configuration 05/1205/1
Thanh Ha [Thu, 19 May 2016 22:04:10 +0000 (18:04 -0400)]
Simplify cfp jjb configuration

JJB 1.5.0 now allows CFP to use freeform IDs so lets use it to simplify
the yaml configuration.

Change-Id: Id64e772cb9fc1ed2f0deb11b6ba405f4ab43fe1e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoMerge "CIMANAGE-7: csit-vpp-master-verify-semiweekly scheduled job"
C.J. Collier [Wed, 18 May 2016 19:53:11 +0000 (19:53 +0000)]
Merge "CIMANAGE-7: csit-vpp-master-verify-semiweekly scheduled job"

8 years agocsit-vpp-pylint: Adjust Violations plugin values 85/1185/1
Miroslav Miklus [Wed, 18 May 2016 13:26:05 +0000 (15:26 +0200)]
csit-vpp-pylint: Adjust Violations plugin values

sunny weather: 0 - 10
stormy weather: 10 - 250
mark as unstable: 250+

Change-Id: Iac89bdcb74f2b8710597180340551386ef5cf3d8
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoCIMANAGE-7: csit-vpp-master-verify-semiweekly scheduled job 50/1150/2
Jan Gelety [Mon, 16 May 2016 14:57:14 +0000 (16:57 +0200)]
CIMANAGE-7: csit-vpp-master-verify-semiweekly scheduled job

- test vpp latest release from nexus with csit-verified test cases
- in case of success the vpp build will be used as vpp-master-verified
  build for csit-* jobs
- sheduled to run every Tuesday and Saturday at 04:00 UTC
- manual trigger possible too

- contains aslo correction of path of artifact in csit-vpp-verify-weekly job

Change-Id: Id5da3edb1b4579e6a3bd008694b9e5c754fd8729
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoUse correct server-name Primary 64/1164/1
Thanh Ha [Tue, 17 May 2016 03:04:59 +0000 (23:04 -0400)]
Use correct server-name Primary

Perhaps 'Default' was the name at one point and then got renamed to
'Primary' and we forgot to update the configuration. Default is not
currently a valid server-name so resulted in Gerrit Trigger not watching
any valid Gerrit instance for the event-stream.

The current name of the Gerrit server-name is 'Primary' as defined in
Jenkins > Manage Jenkins > Gerrit Trigger.

Change-Id: Ic9481b53424d6fc8358131d384157779a7753fb0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoCorrect init script to use sysv on 14.04 59/1159/2
C.J. Collier [Mon, 16 May 2016 20:27:08 +0000 (13:27 -0700)]
Correct init script to use sysv on 14.04

condition wrapped around code

Change-Id: I27a426504fe5786e9a45d7145d9c3332b4542860
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoMerge "Provide clarity as to when merge job fails are build or push"
C.J. Collier [Mon, 16 May 2016 20:00:10 +0000 (20:00 +0000)]
Merge "Provide clarity as to when merge job fails are build or push"

8 years agoMerge "Correct deprecated include syntax"
C.J. Collier [Mon, 16 May 2016 19:59:47 +0000 (19:59 +0000)]
Merge "Correct deprecated include syntax"

8 years agoProvide clarity as to when merge job fails are build or push 27/1127/2
Ed Warnicke [Sun, 15 May 2016 17:43:59 +0000 (12:43 -0500)]
Provide clarity as to when merge job fails are build or push

Merge jobs can fail because a build has failed, or because
a push of artifacts has failed.  This should make
it clear which occurrred in the build logs.

Change-Id: I77e2ed0c756104492ee7a16378a5445162406f40
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoInstrument Jenkins images/builds (take2) 56/1156/1
Ed Warnicke [Mon, 16 May 2016 19:50:46 +0000 (14:50 -0500)]
Instrument Jenkins images/builds (take2)

Change-Id: I167cb259fce64f96d385294268a78bf6d161c8de
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoCorrect deprecated include syntax 55/1155/1
C.J. Collier [Mon, 16 May 2016 19:46:06 +0000 (12:46 -0700)]
Correct deprecated include syntax

* perl -i -pe 's/include-raw-escape /include-raw-escape: /' vpp.yaml

Change-Id: I62d6813e71b6f915524c395b3adc328698f755ce
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoInstrument Jenkins images/builds 83/983/6
Ed Warnicke [Wed, 11 May 2016 16:44:28 +0000 (11:44 -0500)]
Instrument Jenkins images/builds

This patch instruments so we can be certain *what* bootstrap.sh
was used to build the running image and what
include-raw-vpp-build.sh was run for the Job

Change-Id: I69782c3bca71f24d24133205130be059a14a114c
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoAdd build dependencies for documentation 14/1114/3
Chris Luke [Fri, 13 May 2016 23:21:04 +0000 (19:21 -0400)]
Add build dependencies for documentation

Add doxygen and graphviz to the dependency list.

Change-Id: I546b41a7613d8492f4054b3674905f05c504fad3
Signed-off-by: Chris Luke <chrisy@flirble.org>
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoDisable things which may lock /var/lib/dpkg/lock 28/1128/4
Ed Warnicke [Sun, 15 May 2016 17:57:27 +0000 (12:57 -0500)]
Disable things which may lock /var/lib/dpkg/lock

The ubuntu1604 verify job has been failing due
to locking of /var/lib/dpkg/lock:

https://lists.fd.io/pipermail/vpp-dev/2016-May/000992.html

This appears to only happen with the first job run against
a particular Jenkins slave, and upon using:

https://gerrit.fd.io/r/#/c/1121/

to probe it, two candidates emerge:

apt.systemd.daily

and

unattended-upgrades

So this patch removes unattended-upgrades

and

stops/disables apt.systemd.daily via systemd

Change-Id: Ic2bc9e4ec54ef1f2d0ab35813c4623a67a43f00a
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoAdd capacity for honeycomb to verify images. 73/1073/3
Ed Warnicke [Wed, 11 May 2016 16:48:45 +0000 (11:48 -0500)]
Add capacity for honeycomb to verify images.

Change-Id: Ie5fe2507b760b3f681be4291f9c52bf609dbfaca
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoFix for package pushx 11/1111/1
Ed Warnicke [Fri, 13 May 2016 20:30:16 +0000 (15:30 -0500)]
Fix for package pushx

Change-Id: Iebfcd2973bb319be4db64eecc4e35b218fb25b3b
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoFix reponames 10/1110/1
Ed Warnicke [Fri, 13 May 2016 20:03:43 +0000 (15:03 -0500)]
Fix reponames

Change-Id: I44c56b3c78deefdd91b1d9febfc015d9c2e927b2
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoMerge "CIMANAGE-5: csit-vpp-verify-weekly scheduled job"
C.J. Collier [Fri, 13 May 2016 19:11:19 +0000 (19:11 +0000)]
Merge "CIMANAGE-5: csit-vpp-verify-weekly scheduled job"

8 years agoEnable jobs for throttle branches 89/1089/8
Ed Warnicke [Thu, 12 May 2016 21:47:30 +0000 (16:47 -0500)]
Enable jobs for throttle branches

Change-Id: I70cd178f52480bcab2bd84b7bdb967f1799acdbd
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoCIMANAGE-5: csit-vpp-verify-weekly scheduled job 57/1057/4
Jan Gelety [Tue, 10 May 2016 21:15:28 +0000 (23:15 +0200)]
CIMANAGE-5: csit-vpp-verify-weekly scheduled job

- test csit master branch against verified vpp build
- in case of success apply csit-verified tag to csit test cases
- sheduled to run every Sunday at 04:00 UTC
- manual trigger possible too

Change-Id: I1db550f0770681991fa1be0fa72533637ba41257
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoEnable Serial Console 27/1027/2
C.J. Collier [Fri, 6 May 2016 23:02:20 +0000 (16:02 -0700)]
Enable Serial Console

This patch will allow access to the bootloader and kernel boot
messages for debugging and maintenance

* add function deb_enable_serial_console to bootstrap-functions.sh
* call deb_enable_serial_console from bootstrap.sh

Change-Id: Ia79881a91ab4d10b1f5ed6deb3a43a7a4d037fa5
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoRevert "Changes to accomodate vpp throttle branch." 80/1080/1
Ed Warnicke [Thu, 12 May 2016 04:05:01 +0000 (04:05 +0000)]
Revert "Changes to accomodate vpp throttle branch."

This reverts commit 5d1d00330488903ae810de20bfd035fde9cdc25a.

This reverts gerrit: https://gerrit.fd.io/r/#/c/1074/

Change-Id: I5d937a4486ae7426debefdfaf85019508253c3f0
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoChanges to accomodate vpp throttle branch. 74/1074/4
Ed Warnicke [Wed, 11 May 2016 17:09:26 +0000 (12:09 -0500)]
Changes to accomodate vpp throttle branch.

Change-Id: If3ea89cbd6970a53bad8c13900c2eb8f15a7708c
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoCheck to see if a VPP patch needs rebasing 44/1044/1
Ed Warnicke [Mon, 9 May 2016 19:14:06 +0000 (14:14 -0500)]
Check to see if a VPP patch needs rebasing

Change-Id: I9eca0b820a82dac4dbe58759a47f3294c6fcb14b
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoFix for javahome update 22/1022/1
Ed Warnicke [Fri, 6 May 2016 17:32:03 +0000 (12:32 -0500)]
Fix for javahome update

Change-Id: Ifbe5962e0161ccf223baa4bb4fc03f8c86d859b1
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoMerge "Fix for java home for honeycomb"
C.J. Collier [Fri, 6 May 2016 17:00:58 +0000 (17:00 +0000)]
Merge "Fix for java home for honeycomb"

8 years agoFix for java home for honeycomb 20/1020/9
Ed Warnicke [Fri, 6 May 2016 15:50:45 +0000 (10:50 -0500)]
Fix for java home for honeycomb

Change-Id: Ib4381c10763251105ca1fc418e70c0e06905ba9a
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoRename vpp-csit-verify-perf-{type} to vpp-csit-verify-hw-perf-{type} 97/997/2
Miroslav Miklus [Thu, 5 May 2016 08:22:52 +0000 (10:22 +0200)]
Rename vpp-csit-verify-perf-{type} to vpp-csit-verify-hw-perf-{type}

The job name should not contain string from comment trigger.
If the job name contains the same string as the trigger, the verification
ends up in an endless loop because jenkins post comment with the job
name and that triggers the job again.

Change-Id: If25b8530984e047b96f4b571495ecedf586aa84f
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoMerge changes from topics 'bootstrap-refactor', '994'
Andrew Grimberg [Thu, 5 May 2016 17:36:13 +0000 (17:36 +0000)]
Merge changes from topics 'bootstrap-refactor', '994'

* changes:
  Re-factor vagrant bootstrap
  Sync bootstrap.sh with build.sh
  Cleanup vagrant

8 years agoUnlink CSIT from zuul 05/1005/1
Andrew Grimberg [Thu, 5 May 2016 17:20:54 +0000 (10:20 -0700)]
Unlink CSIT from zuul

Change-Id: If6ef9bb82f5d3fc3b78e699b2503006d5c2457e5
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoRe-factor vagrant bootstrap 91/991/8
C.J. Adams-Collier [Wed, 4 May 2016 01:46:44 +0000 (18:46 -0700)]
Re-factor vagrant bootstrap

* created new file to hold functions
* moved sections of bootstrap in to functions
* called functions from case statement block
* integrate changes from Andrew Grimberg <agrimberg@linuxfoundation.org> (change 994)
* integrate changes from Ed Warnicke <eaw@cisco.com> (change 996)
* update debian package list after installing PPA
* synchronized redhat package list with VPP Makefile

Change-Id: I3d005c0fe01211c78c8b120b266964d873ee25b7
Signed-off-by: C.J. Adams-Collier <cjac@colliertech.org>
8 years agoRemove csit-vpp-functional-nodepool job 03/1003/2
Ed Warnicke [Thu, 5 May 2016 14:23:04 +0000 (09:23 -0500)]
Remove csit-vpp-functional-nodepool job

Change-Id: I19356d04090a9db6fda294bc763142b739b42d46
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoSync bootstrap.sh with build.sh 96/996/2
Ed Warnicke [Wed, 4 May 2016 23:31:23 +0000 (18:31 -0500)]
Sync bootstrap.sh with build.sh

Change-Id: I82fd236337ef939fd28b0495b8fa0e1516a754ac
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoCleanup vagrant 94/994/1
Andrew Grimberg [Wed, 4 May 2016 23:08:01 +0000 (16:08 -0700)]
Cleanup vagrant

* Cleanup the Vagrantfile of unneeded cruft
* Cleanup the boostrap to be a bit more quiet and also give context as
  to what it's doing
* Make sure that the reseal has a sync / sleep

Change-Id: Ia1aa4e30b7a6342689c6fce30a18db1f52d27182
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoAdd jjb job to validate images 92/992/8
Ed Warnicke [Wed, 4 May 2016 20:01:30 +0000 (15:01 -0500)]
Add jjb job to validate images

Change-Id: Ib1c29c39e845d3a30c4b82ef0b590f48df466a7b
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agore-index system certificates 78/978/1
C.J. Collier [Tue, 3 May 2016 20:06:47 +0000 (13:06 -0700)]
re-index system certificates

* corrected truncation of PACKAGES file
* using headless variant of JDK
* removed -qq from apt-get commands to provide better accounting
* run update-ca-certificates -f to ensure that nexus.fd.io is trusted

Change-Id: I57f7267d6c70e40d63c86234e4e1723983170c3a
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoClean up apt package list 91/891/10
C.J. Collier [Sun, 24 Apr 2016 18:00:46 +0000 (11:00 -0700)]
Clean up apt package list

* Combine all packages in to a single call to apt-get install
* Modify /etc/apt/apt.conf
* corrected a comment
* not doing redundant edit of /etc/sysctl.conf
* adding emacs files to .gitignore
* Exercised this code while producing a new base image for each targetted platform
* install java8 from official openjdk PPA if platform is 14.04
* detect correct python package to install in CentOS
* open (and later close) stdout and stderr logs for later review

Change-Id: I669c0c3043f0c90df7af5033b8e180b0e6dc696a
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoMerge "Use build.sh for vpp build"
Andrew Grimberg [Fri, 29 Apr 2016 18:11:22 +0000 (18:11 +0000)]
Merge "Use build.sh for vpp build"

8 years agoVPP-8: use jdk8 for VPP builds 77/877/5
Marek Gradzki [Tue, 26 Apr 2016 07:35:58 +0000 (09:35 +0200)]
VPP-8: use jdk8 for VPP builds

Change-Id: Ieec25be815128e53328493700d9a3d228bceba2b
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
8 years agoUse build.sh for vpp build 52/852/3
Ed Warnicke [Sun, 24 Apr 2016 03:21:57 +0000 (22:21 -0500)]
Use build.sh for vpp build

https://gerrit.fd.io/r/#/c/765/
is refactoring the vagrant to have a separate
build.sh suitable for use outside of vagrant.
It autodetects supported distros, installs dependencies,
etc.

This patch switches vpp jenkins jobs over to using
build.sh.  This should give us a unified path where:

1) CI Builds
2) Vagrant
3) Users starting out on their own Centos/Ubuntu boxes
for the first time

are all using the same build.sh.

Change-Id: Iae7bca4e2a9e183e878d7638701e66735b388cbc
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoChange performance job name 34/834/4
pmikus [Thu, 21 Apr 2016 13:47:22 +0000 (15:47 +0200)]
Change performance job name

- JIRA: CIMANAGE-4
- Change vpp-verify-performance job name to naming convention

Change-Id: If873f29b3bb82de2bdf2e84614d132867c8d06c8
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agofix for centos merge maven push 47/847/1
Ed Warnicke [Fri, 22 Apr 2016 16:19:30 +0000 (11:19 -0500)]
fix for centos merge maven push

Change-Id: I16fd1580afa8fe229fc9ff15283f402333478fe2
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoFix push_deb 37/837/1
Ed Warnicke [Thu, 21 Apr 2016 18:23:30 +0000 (13:23 -0500)]
Fix push_deb

Change-Id: Ie33def177bca89a25f4d7a007603b3822ba7f6c5
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoEnable ubuntu1604 merge and push debs to repo 31/831/1
Ed Warnicke [Thu, 21 Apr 2016 12:54:03 +0000 (07:54 -0500)]
Enable ubuntu1604 merge and push debs to repo

Change-Id: I1d2ec5b4ac01f000fb180f1f82b6de2a6126f9e7
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoMerge "Added python3-dev dependency to support Python API bindings."
C.J. Collier [Wed, 20 Apr 2016 20:02:47 +0000 (20:02 +0000)]
Merge "Added python3-dev dependency to support Python API bindings."

8 years agoSupport for ubuntu1604 in CI verify 21/821/6
Ed Warnicke [Tue, 19 Apr 2016 21:55:58 +0000 (16:55 -0500)]
Support for ubuntu1604 in CI verify

This patch should enable ubuntu1604 verify in CI management.

Change-Id: I17b6e8addcfddf6cbbc3774205beecc00c4d3fcf
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoAdded python3-dev dependency to support Python API bindings. 74/774/5
Ole Troan [Wed, 13 Apr 2016 11:51:04 +0000 (13:51 +0200)]
Added python3-dev dependency to support Python API bindings.

Change-Id: Ie7eb3d22e81fe718d688fbd1f5ffebb282e06e17
Signed-off-by: Ole Troan <ot@cisco.com>
8 years agoMerge "Rename job to performance"
C.J. Collier [Wed, 20 Apr 2016 16:37:27 +0000 (16:37 +0000)]
Merge "Rename job to performance"

8 years agoMerge "Correction of csit-vpp-master-verify-weekly jenkins job"
C.J. Collier [Wed, 20 Apr 2016 14:12:09 +0000 (14:12 +0000)]
Merge "Correction of csit-vpp-master-verify-weekly jenkins job"

8 years agoCorrection of csit-vpp-master-verify-weekly jenkins job 07/807/1
Jan Gelety [Mon, 18 Apr 2016 14:55:55 +0000 (16:55 +0200)]
Correction of csit-vpp-master-verify-weekly jenkins job

- added archive artifact (RF log, report and output) files
  to publishers
- added manual trigger

Change-Id: I21b6798a357cb8b14371cee5f35ae259b63b384a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoAdd dependency on dh-systemd 97/797/1
Ed Warnicke [Fri, 15 Apr 2016 23:07:38 +0000 (18:07 -0500)]
Add dependency on dh-systemd

Change-Id: I9a10dd107150ba31f13a00f7faabd0cc9fe2503f
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoRename job to performance 86/786/1
pmikus [Thu, 14 Apr 2016 13:12:37 +0000 (15:12 +0200)]
Rename job to performance

- rename csit-vpp-functional-hw-tb2 job to csit-vpp-perf-hw (as testing performance) with unified trigger for performance testing
- parameterized job for future extension

Change-Id: I72d1562fad8ad188930f39374f3ebfe8ebb984aa
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoQuery RPM files directly using rpm for upload info 79/779/1
Andrew Grimberg [Wed, 13 Apr 2016 17:38:00 +0000 (10:38 -0700)]
Query RPM files directly using rpm for upload info

Instead of trying to figure out all the maven fields based upon the
filename with possible failures that this can cause, instead, use the
rpm command itself to query the built artifacts for the needed
information.

Also, .src.rpm should be the canonical name for source RPM files. Make
sure that .srpm and .src.rpm are handled properly and they normalize to
.src.rpm in nexus.

Change-Id: I6b35c15e8e6b189a2144fe3cfb991e467933ad46
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoAdd 'mock' to allow cleaner rpmbuild 78/778/1
Ed Warnicke [Wed, 13 Apr 2016 16:38:32 +0000 (11:38 -0500)]
Add 'mock' to allow cleaner rpmbuild

Change-Id: I800ae2b6be86ac54c259f952da9fb9b423a338f3
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoMake rpm push handle SRPMs 77/777/2
Andrew Grimberg [Wed, 13 Apr 2016 16:21:14 +0000 (09:21 -0700)]
Make rpm push handle SRPMs

* Fix the rpm push to search out and push SRPMs

* Fix the rpm push to actually push a file as it was referencing a bad
  variable

* Fix up some minor linting issues

Change-Id: I4d2e66ad52e593b71b969ab1b5faad254cc35e2d
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoFix virl scripts broken by {os} 76/776/3
Ed Warnicke [Wed, 13 Apr 2016 15:16:13 +0000 (10:16 -0500)]
Fix virl scripts broken by {os}

Change-Id: I9f16666cf18753ce47d74fa21c125b1375407ecf
Signed-off-by: Ed Warnicke <eaw@cisco.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoHave merge job push rpms to the yum repo 64/764/4
Ed Warnicke [Tue, 12 Apr 2016 22:27:41 +0000 (17:27 -0500)]
Have merge job push rpms to the yum repo

Change-Id: I0d16b75d8e8770894577659cd9b6ae0fc2140db9
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoTurn on multi-os merge jobs 63/763/2
Ed Warnicke [Tue, 12 Apr 2016 22:15:12 +0000 (17:15 -0500)]
Turn on multi-os merge jobs

Change-Id: Iff99c3e8b8dadc6334b33fe5aff688102273fcb5
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoEnabled centos7 build 61/761/1
Ed Warnicke [Tue, 12 Apr 2016 22:02:14 +0000 (17:02 -0500)]
Enabled centos7 build

Change-Id: I7fafacbe2fa58313e320de2e3a8a498898e89601
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoMachinery for multi-os build. 60/760/7
Ed Warnicke [Tue, 12 Apr 2016 21:08:35 +0000 (16:08 -0500)]
Machinery for multi-os build.

This patch should provide machinery for multi os build
It also provides machinery for multi-branch build

Change-Id: I29db20f159f18af2cab512ab6df6b03d9f81ff15
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoSplit vpp-verify-perfomance job 75/675/4
pmikus [Mon, 4 Apr 2016 13:17:31 +0000 (15:17 +0200)]
Split vpp-verify-perfomance job

- split job to include manual trigger keyword: verify-perf-long and
  verify-perf-short

Change-Id: Ie2048704313634cc9ea62ce67e80fc921bef2e18
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoMerge "Make vpp-csit-verify-virl patch-triggered."
C.J. Collier [Mon, 4 Apr 2016 16:23:40 +0000 (16:23 +0000)]
Merge "Make vpp-csit-verify-virl patch-triggered."

8 years agoMake vpp-csit-verify-virl patch-triggered. 63/663/2
Stefan Kobza [Fri, 1 Apr 2016 14:34:21 +0000 (16:34 +0200)]
Make vpp-csit-verify-virl patch-triggered.

Change-Id: I90855a0b7a9a0e346a83beb42ada824bebd6eff6
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoVPP performance check job 58/658/1
pmikus [Fri, 1 Apr 2016 06:27:52 +0000 (08:27 +0200)]
VPP performance check job

- add job-template into jenkins layout view

Change-Id: I41a9e865713100b63913b9f5e4a3ea6d97bb3231
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoVPP performance check job 53/653/2
pmikus [Thu, 31 Mar 2016 09:37:14 +0000 (11:37 +0200)]
VPP performance check job

- vpp-csit-hw-perf job to check performance of proposed patch
- build, copy, install, start perf tests

Change-Id: I2ae4cee916532c4d57715e2bd739d3109ab7ccf6
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoMerge "Use tagging instead of branching for csit-verified"
C.J. Collier [Tue, 29 Mar 2016 15:13:17 +0000 (15:13 +0000)]
Merge "Use tagging instead of branching for csit-verified"

8 years agoUse tagging instead of branching for csit-verified 39/639/1
Jan Gelety [Tue, 29 Mar 2016 14:24:47 +0000 (16:24 +0200)]
Use tagging instead of branching for csit-verified

- use tags instead of branches in case of
  job "csit-vpp-master-verify-weekly"

Change-Id: Icbdcc2a57e1ab17d634ce3b8deedbc481f8f313c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoMake robot framework output-path parametrizable. 33/633/1
Stefan Kobza [Tue, 29 Mar 2016 12:11:23 +0000 (14:11 +0200)]
Make robot framework output-path parametrizable.

csit-vpp-verify-virl job is blocked now, because output-path is not a
variable in robot-framework macro. This patch changes that.

Change-Id: I1c31342af6dfae66ce3e21e751470e476cc5be39
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoFix rh_systems shell function 18/618/1
Andrew Grimberg [Fri, 25 Mar 2016 23:44:57 +0000 (16:44 -0700)]
Fix rh_systems shell function

The rh_systems shell function was not properly defined. This corrects it
so that the bootstrapping can work

Change-Id: Ic5f03feac7deb5c8da54f3db4b0fb6a599ff0d85
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoAdd basebuild for centos 06/606/4
Ed Warnicke [Thu, 24 Mar 2016 14:27:20 +0000 (09:27 -0500)]
Add basebuild for centos

Change-Id: I8a8ba3fe1fd3fb12ed3f3004bbc863cb7b2c9872
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoRefactor basebuild in prep to add Centos image 04/604/4
Ed Warnicke [Thu, 24 Mar 2016 13:33:44 +0000 (08:33 -0500)]
Refactor basebuild in prep to add Centos image

Change-Id: I9583a1e3a64c40460d5196ce28261230234ff80b
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoUpdate of the job 'vpp-csit-verify-virl' 97/597/2
Jan Gelety [Wed, 23 Mar 2016 12:58:30 +0000 (13:58 +0100)]
Update of the job 'vpp-csit-verify-virl'

Job is updated to be run manually and to use
csit-verified branch to test vpp.

Change-Id: I7a56594cb840c374bc849c095241655290e6b0bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoCSIT: new job 'csit-vpp-verify-master' 90/590/1
Miroslav Miklus [Tue, 22 Mar 2016 17:32:41 +0000 (18:32 +0100)]
CSIT: new job 'csit-vpp-verify-master'

This job is aimed to test latest csit master code against
latest stable vpp release. If the verification is successfull
then push curent master to master-verified branch

Change-Id: I18316f6f96e793721ee78c3b83a18ff74778cabf
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoAdd job parameters to csit jenkins jobs. 71/571/1
Stefan Kobza [Fri, 18 Mar 2016 17:39:09 +0000 (18:39 +0100)]
Add job parameters to csit jenkins jobs.

Change-Id: Ibe5d4c527eb773acfc5283584a2c4d72df6bd335
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoRemove standard csit jobs from Zuul. 58/558/2
Stefan Kobza [Thu, 17 Mar 2016 17:50:27 +0000 (18:50 +0100)]
Remove standard csit jobs from Zuul.

Until OpenStack issues with L2 transparency are resolved, make csit
jobs Jenkins triggered again.

Change-Id: Ie82357275b91804e64a194a8de5c51acf9c27743
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoFix typo for git-scm 18/518/1
Thanh Ha [Wed, 9 Mar 2016 19:03:03 +0000 (14:03 -0500)]
Fix typo for git-scm

Change-Id: Ibb8ddd694792ba82545d9d0abc25f3080ee6c3b3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoAdd new networks for multilink testing 09/509/1
Andrew Grimberg [Tue, 8 Mar 2016 22:24:43 +0000 (14:24 -0800)]
Add new networks for multilink testing

Switch to Interlink1-6 networks for multilink labs

Change-Id: I119a9751e96ebf787e23234cc53a5882b419976b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoFix merge/integration jobs to build master, not gerrit 06/506/3
Ed Warnicke [Tue, 8 Mar 2016 17:47:51 +0000 (10:47 -0700)]
Fix merge/integration jobs to build master, not gerrit

Change-Id: I72afb24d177b3b81e9427d43c3adb4a0a80fd240
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoRemove system pylint installation from pylint job. 89/489/3
Stefan Kobza [Fri, 4 Mar 2016 21:12:36 +0000 (22:12 +0100)]
Remove system pylint installation from pylint job.

Change-Id: Ic4894018ffa10e7742bd798c17bdbe6de7945a0a
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoAdd honeycomb-integration job 97/497/1
Ed Warnicke [Mon, 7 Mar 2016 13:47:11 +0000 (06:47 -0700)]
Add honeycomb-integration job

Because we need the up-to-date vpp-japi.jar, its important
to rebuild when vpp rebuilds that jar.

Change-Id: Ifdfc93cd4274be1ceb8f92a5daf9084b9d9ed174
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoAdd new nodepool CSIT job trigger to zuul. 88/488/1
Stefan Kobza [Fri, 4 Mar 2016 20:21:11 +0000 (21:21 +0100)]
Add new nodepool CSIT job trigger to zuul.

Change-Id: Ie57378604ed1d2ca7d0ac20304da9f97bb909ab6
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoAdd new nodepool csit-vpp-functional job. 82/482/2
Stefan Kobza [Fri, 4 Mar 2016 15:31:03 +0000 (16:31 +0100)]
Add new nodepool csit-vpp-functional job.

Make new job in csit project that gets triggered on CSIT changeset. This
is an entry-point to integrate CSIT functionality with LF's VM infra.
The actual integration is going to happen in CSIT, where we can tune the
bootstrap script and then move it into ci-management.

Change-Id: Icbfaf0a7b27899af4bea97d80a1883c7dd2df52e
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoFix csit-vpp-functional-hw-tb2 job 87/487/1
Thanh Ha [Fri, 4 Mar 2016 17:54:54 +0000 (12:54 -0500)]
Fix csit-vpp-functional-hw-tb2 job

Regular JJB "- job:" sections do not parse variables. This patch changes
it to use a "- job-template:" section which do parse variables.

Change-Id: Idd1753f9596ec67a9cf86096ff0416db4c07407e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoMerge "Add vpp jenkins job to build vpp and run csit tests."
Andrew Grimberg [Mon, 29 Feb 2016 14:23:07 +0000 (14:23 +0000)]
Merge "Add vpp jenkins job to build vpp and run csit tests."

8 years agoAdd vpp jenkins job to build vpp and run csit tests. 31/431/4
Stefan Kobza [Thu, 25 Feb 2016 13:36:26 +0000 (14:36 +0100)]
Add vpp jenkins job to build vpp and run csit tests.

To start integrating with VPP verify job, start csit tests for each VPP
verify run. Until artifacts passing is solved between jenkins upstream
and downstream jobs, build the VPP project again in this job. Then
check out csit project, copy the deb packages to the cloned dir and
start the testcase.

Prevent the job non-voting, so that it does not polute VPP reviews with
erroneous results. We'll switch to normal voting after all potential
problems are ironed out, and the job is stable.

Change-Id: I9e35e19a1d8b2a64b8e65473fef93e0b537eded2
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoMove csit-vpp-functional-virl to zuul. 32/432/3
Stefan Kobza [Thu, 25 Feb 2016 13:36:26 +0000 (14:36 +0100)]
Move csit-vpp-functional-virl to zuul.

Change-Id: I240b93105039e8838f711f545eafd95f354bee16
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoRemove parameters from csit-vpp-functional-hw-tb2. 28/428/1
Stefan Kobza [Thu, 25 Feb 2016 21:00:05 +0000 (22:00 +0100)]
Remove parameters from csit-vpp-functional-hw-tb2.

Zuul has SKIPping this job, and parameters are the only difference when
comparing the job to other zuul jobs.

Change-Id: I529577170797bd7cb2fc00f3ac1c483eba97e2de
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoMake subnodes easily identifiable 16/416/1
Andrew Grimberg [Thu, 25 Feb 2016 16:47:51 +0000 (08:47 -0800)]
Make subnodes easily identifiable

When nodepool brings online a node and subnodes they are presently all
named the same way. This makes it difficult to pinpoint the leader node
of a set if we need to do any work directly against OpenStack. This
change will cause sub-nodes to have the prefix of np-sub- and the rest
of the name from the leader node making it clear.

Change-Id: I536b2e4437a93f118436e8eeb6869a2f691be0f6
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoMove csit-vpp-functional-hw-tb2 to zuul. 03/403/3
Stefan Kobza [Wed, 24 Feb 2016 14:45:21 +0000 (15:45 +0100)]
Move csit-vpp-functional-hw-tb2 to zuul.

The job should be started only by adding 'hw-tb2-check' comment to gerrit.

Change-Id: I219568fc6756838939f74ed62f14d1a07b117e37
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoAdd current nodepool configuration 89/389/1
Andrew Grimberg [Tue, 23 Feb 2016 17:01:03 +0000 (09:01 -0800)]
Add current nodepool configuration

This adds in the nodepool configuration that we are presently using.
This is the starting point for the community to help define what build
slave definitions are needed.

Change-Id: I1c6325869a0a411265994090f9dc754de03ea173
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoAttache nodepool jobs to zuul 88/388/1
Andrew Grimberg [Tue, 23 Feb 2016 16:55:08 +0000 (08:55 -0800)]
Attache nodepool jobs to zuul

This attaches the ci-management-{verify,merge}-nodepool jobs up to the
proper zuul trigger points (check, post-merge)

Change-Id: I7a67affb8c27d19eabcf72704d8e65b402dc1202
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoAdd nodepool management jobs 87/387/1
Andrew Grimberg [Tue, 23 Feb 2016 16:44:34 +0000 (08:44 -0800)]
Add nodepool management jobs

Add jobs for doing nodepool management

Change-Id: I9d5b74850f51c7f950ccb3580c1aa7f981786494
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoAdd manual triggered csit-vpp-functional-hw-tb2 job. 73/373/2
Stefan Kobza [Mon, 22 Feb 2016 15:26:45 +0000 (16:26 +0100)]
Add manual triggered csit-vpp-functional-hw-tb2 job.

This job would be create from the same template as
csit-vpp-functional-virl, but for the time being this have to be
manually triggered. I didn't find a way how to parametrize
gerrit-trigger-patch-submitted so I've created
gerrit-trigger-manually-triggered.

Change-Id: I2d4f2c6bb8ebb94cd8563132feac765d46e1b56d
Signed-off-by: Stefan Kobza <skobza@cisco.com>
8 years agoAdd verify / merge zuul jobs and update layout 79/379/1
Andrew Grimberg [Mon, 22 Feb 2016 19:53:16 +0000 (11:53 -0800)]
Add verify / merge zuul jobs and update layout

* Update the zuul layout.yaml with changes that are currently being hand
managed.

* Add in the verify and merge jobs for zuul (which have temporarily
  been handmanged in as well)

Change-Id: I1f86488165f384def27d03593d161a56f955e4b9
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoAdd new verify / merge jobs for zuul 78/378/2
Andrew Grimberg [Mon, 22 Feb 2016 19:43:14 +0000 (11:43 -0800)]
Add new verify / merge jobs for zuul

We need jobs to be able to manage zuul layout changes. This brings those
jobs in

Change-Id: If6397b0d7f52edc7f2668a2351c35e637ef92888
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoRename ci-management-merge 77/377/1
Andrew Grimberg [Mon, 22 Feb 2016 17:44:44 +0000 (09:44 -0800)]
Rename ci-management-merge

Rename the ci-managment-merge job to be ci-management-merge-jjb as it is
jjb specific. This sets us up to support
ci-managment-{verify,merge}-{zuul,nodepool} job definitions as each of
these job definitions is verify specific to the tool being managed

Change-Id: I1bfcc02411af043f349ca5b62aac17bffe8df363
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoMove ci-management jobs to own directory 76/376/1
Andrew Grimberg [Mon, 22 Feb 2016 17:43:38 +0000 (09:43 -0800)]
Move ci-management jobs to own directory

Let's make the ci-management jobs be a little more consistent with other
projects and have them live in their own directory. Global macros will
still live at the root jjb level.

Change-Id: Ie9bd90ae049b4b83fad050b697e14aced18de4a6
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoRemove unneeded ci-management weekly job 74/374/2
Andrew Grimberg [Mon, 22 Feb 2016 17:06:18 +0000 (09:06 -0800)]
Remove unneeded ci-management weekly job

We've found that as the projects grow that having a weekly job to
refresh the JJB fails more often than it succeeds. As this can be done
as a manual process by the releng team it's better to just remove the
job than have it sit around failing.

Change-Id: I48d154d3cb459171f76526844ef6b64269982c42
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>