ci-management.git
7 years agoHave vpp-lite jobs also shortcircuit on checkstyle 66/2366/1
Ed Warnicke [Fri, 12 Aug 2016 20:19:26 +0000 (13:19 -0700)]
Have vpp-lite jobs also shortcircuit on checkstyle

Change-Id: Ie12ea84996c8c82cfbfe0c1e7bc5586d8b1e4385
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoMerge "CSIT-311 Ph3: remove perf tests from semiweekly"
C.J. Collier [Tue, 9 Aug 2016 19:46:39 +0000 (19:46 +0000)]
Merge "CSIT-311 Ph3: remove perf tests from semiweekly"

7 years agoAdd checkstyle shortcircuit to csit job 90/2290/2
Ed Warnicke [Tue, 9 Aug 2016 16:37:30 +0000 (09:37 -0700)]
Add checkstyle shortcircuit to csit job

Change-Id: Iac038684c6bee054058190889d8657f27ab71e10
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoCSIT-311 Ph3: remove perf tests from semiweekly 87/2287/1
Miroslav Miklus [Tue, 9 Aug 2016 14:39:53 +0000 (16:39 +0200)]
CSIT-311 Ph3: remove perf tests from semiweekly

Change-Id: I7ea16fe5c407456e5a4bb8a8fc63dae7eb582a83
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoFIX: Plot data file in csit-vpp-verify-perf-master-nightly-all 50/2250/1
pmikus [Mon, 8 Aug 2016 10:07:26 +0000 (11:07 +0100)]
FIX: Plot data file in csit-vpp-verify-perf-master-nightly-all

Fix file path for plot data file

Change-Id: I28f72aa14e83f961beb7f4c7a55b071dffff7850
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoAdd indent to the build servers 36/2236/1
Ed Warnicke [Fri, 5 Aug 2016 20:15:34 +0000 (13:15 -0700)]
Add indent to the build servers

Change-Id: I3a55f0c9630fc83beff6c68c4bbf62f74abc495f
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoAdding support of checkstyle for vpp 33/2233/4
Ed Warnicke [Fri, 5 Aug 2016 18:16:51 +0000 (11:16 -0700)]
Adding support of checkstyle for vpp

Change-Id: Ia5398ea7a6b6ba598d30c77556d8fbe992a2ed47
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoCSIT-311 New Nightly CSIT perf job 62/2162/3
Miroslav Miklus [Mon, 1 Aug 2016 13:44:14 +0000 (15:44 +0200)]
CSIT-311 New Nightly CSIT perf job

CSIT-311: PHASE 1 - create new nightly job

Change-Id: I1c7389d83d391abe5f1a48fb51593539ba41b773
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoIgnoring failure in update-java-alternatives 50/2050/1
C.J. Collier [Thu, 21 Jul 2016 20:33:56 +0000 (13:33 -0700)]
Ignoring failure in update-java-alternatives

* The script fails, though the failure can be ignored.

http://askubuntu.com/questions/599105/using-alternatives-with-java-7-and-java-8-on-14-04-2-lts

Change-Id: Ie7b70fb189505a46b6640f1a961001f0c75a21b5
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoUse maven from /opt 46/2046/3
C.J. Collier [Thu, 21 Jul 2016 15:15:48 +0000 (08:15 -0700)]
Use maven from /opt

Change-Id: I6173e24be1efbabf9b9507af593210803f8fff21
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoMerge "prefetch maven"
Andrew Grimberg [Thu, 21 Jul 2016 13:22:19 +0000 (13:22 +0000)]
Merge "prefetch maven"

7 years agoprefetch maven 25/2025/3
C.J. Collier [Tue, 19 Jul 2016 22:15:09 +0000 (15:15 -0700)]
prefetch maven

* call maven install function
* maven install function installs from file in /vagrant

Jenkins will be modified to point to this pre-installed maven.  This
will eliminate many problems caused by an inability to fetch common
files.

Another solution would be to host a caching proxy within Vexxhost and
set the http_proxy and https_proxy environment variables to use this
host.

Change-Id: I76d1f3c2526b45dbe0fa4b2a17d3e30d434092ce
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoImprovements to re-spin scripts 23/2023/2
C.J. Collier [Tue, 19 Jul 2016 22:00:27 +0000 (15:00 -0700)]
Improvements to re-spin scripts

* Skip tasks which have already been completed
* correct bugs in variable definition order
* Respin::latest_src_age being called with arguments to perl -e to
  ease interpolation
* Writing environment changes to .bashrc instead of .bash_profile

Change-Id: I95b07d4ccb510fb5cc0afdefc6b7521f9992463b
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoprefetch maven 24/2024/1
C.J. Collier [Tue, 19 Jul 2016 22:15:09 +0000 (15:15 -0700)]
prefetch maven
* install maven at basebuild respin time
* jenkins will be modified to point to pre-installed maven
* this will eliminate many problems caused by an inability to fetch
  common files

Change-Id: I93032bb08e8ce6ffc50cd89ce4c5f5d080e60726
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoMerge "CIMANAGE-12: csit-vpp-verify-master-semiweekly job uses wrong CSIT branch"
Andrew Grimberg [Wed, 13 Jul 2016 15:02:43 +0000 (15:02 +0000)]
Merge "CIMANAGE-12: csit-vpp-verify-master-semiweekly job uses wrong CSIT branch"

7 years agoImprove respin scripts 25/1825/11
C.J. Collier [Thu, 30 Jun 2016 13:56:43 +0000 (06:56 -0700)]
Improve respin scripts

In order to create a new OpenStack basebuild Images, a multi-phase
process must be executed.

The first phase is to configure the system for use with dynamic
language environments.

Due to security precautions, We do not currently have the ability to
automate the process of respinning a new Image.  We have a goal of
fully automating the process so that a new Image will be generated on
every commit.  Until the process is self-hosted, we must manually
fetch credentials from the OpenStack provider's web UI in order to
make use of the python openstack bindings and to complete the
basebuild re-spin process using Vagrant.

The more generic portions of the Image are imported once every two to
three weeks from upstream distributors.  This duration is computed
thus:

  $(perl -I${CI_MGMT}/vagrant/lib -MRespin -e 'Respin::latest_src_age( "${NOW_TS}", "${SRC_TS}" )') | jq .week

Once fetched, these qcow2 Images are pushed to OpenStack using glance
and labelled as:

  "$(lsb_release -i) $(lsb_release -r) (YYYYMMDDTHHMMSS) - LF upload"

The generated basebuild Images are pushed to OpenStack with glance
labelled as:

  "$(lsb_release -i) $(lsb_release -r) - basebuild - YYYYMMDDTHHMMSS"

====

This patch makes it possible to perform the above multi-phase
processes by executing a single script:

  bash scripts/respin-jcloud-images.sh

This script sources a function library from the following file:

  vagrant/lib/respin-functions.sh

Defined in this library are (among others):

  # Fetch latest image from upstream distributor
  download_deb_image( $dist, $version, $arch )
  download_rh_image( $dist, $version, $arch )

  # Fetch latest image from upstream distributor
  create_deb_image( $dist, $version, $arch )
  create_rh_image( $dist, $version, $arch )

  # Run Vagrant provisioning on upstream image
  respin_deb_image( $dist, $version, $arch )
  respin_rh_image( $dist, $version, $arch )

The following script initializes vagrant and the following dynamic language environments:

  * python-virtualenv
  * pip
  * setuptools
  * python-{cinder,glance,keystone,neutron,nova,openstack}client

  * rbenv
  * Vagrant
  * vagrant-openstack-provider

  * nodejs
  * jq

  * local::lib
  * JSON::XS
  * DateTime
  * DateTime::Format::Duration
  * DateTime::Duration

  scripts/init-respin-env.sh

The following module compares ISO 8601 dates (as included in Image labels) with
the current time and prints to STDOUT the count of weeks, days, hours,
minutes and seconds in JSON:

  vagrant/lib/Respin.pm

Change-Id: I434cf2882e5e337ae4b55a4a7acb774a62b528b7
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoFix merge job to not try to push artifacts (yet) for vpp-lite 25/1925/1
Ed Warnicke [Fri, 8 Jul 2016 16:26:20 +0000 (11:26 -0500)]
Fix merge job to not try to push artifacts (yet) for vpp-lite

Change-Id: I752040595646c98a6d5e23f5e1fb4a7377ba16f1
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoAdded vpp-lite verify and merge jobs. 50/1850/8
Ed Warnicke [Fri, 8 Jul 2016 14:58:09 +0000 (09:58 -0500)]
Added vpp-lite verify and merge jobs.

* Added a vpp-lite.yaml

Change-Id: I9aa16968dac9067a92bc272f1cfa4315c0eec4ad
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoCIMANAGE-12: csit-vpp-verify-master-semiweekly job uses wrong CSIT branch 92/1892/1
Jan Gelety [Thu, 7 Jul 2016 12:06:48 +0000 (14:06 +0200)]
CIMANAGE-12: csit-vpp-verify-master-semiweekly job uses wrong CSIT branch

- use proper regex in grep command to choose correct csit branch

Change-Id: I683e31e19d2eec556180c810cc1509abe6bfe4f4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoTurn on timestampe for CSIT jobs 78/1878/1
Ed Warnicke [Wed, 6 Jul 2016 14:27:07 +0000 (09:27 -0500)]
Turn on timestampe for CSIT jobs

Change-Id: I43c381f68c29405d8c3b34bdee6f69c2b115ebf4
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoMerge "Add Jenkins job to run Honeycomb tests"
C.J. Collier [Mon, 4 Jul 2016 13:32:36 +0000 (13:32 +0000)]
Merge "Add Jenkins job to run Honeycomb tests"

7 years agoCIMANAGE-11: Correction of the date string format for CSIT branches 43/1843/3
Jan Gelety [Mon, 4 Jul 2016 08:58:17 +0000 (10:58 +0200)]
CIMANAGE-11: Correction of the date string format for CSIT branches

- change date string from YYYY-MM-DD to shorter one: YYMMDD

Change-Id: I7ed3728ff6392aef23d7c6094f7aead255fcb7bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoAdd Jenkins job to run Honeycomb tests 22/1822/7
Tibor Frank [Thu, 30 Jun 2016 10:44:04 +0000 (12:44 +0200)]
Add Jenkins job to run Honeycomb tests

JIRA: CSIT-185

Change-Id: Ib113f55e2ed6f3dbb42728abebcbd5107216fdb5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 years agoCIMANAGE-11: Change of CSIT branch names 37/1837/1
Jan Gelety [Fri, 1 Jul 2016 20:36:55 +0000 (22:36 +0200)]
CIMANAGE-11: Change of CSIT branch names

- change csit-verified-master-YYYY-MM-DD to
  oper-YYMMDD
- change csit-verified-stable1606-YYYY-MM-DD to
  oper-rls1606-YYMMDD

Change-Id: Idcf889e1703d54ff33855ceb528ced54035e036d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoMove from rpm push in merge to rpm push in integration 18/1818/2
Ed Warnicke [Wed, 29 Jun 2016 22:00:54 +0000 (17:00 -0500)]
Move from rpm push in merge to rpm push in integration

It turns out that doing rpm push in both merge and integration
job leads to collisions because they have two separate
sequences of BUILD_NUMBERs and those BUILD_NUMBERS are used
for the rpm release number.

So... this patch makes the merge job *stop* pushing rpms,
and should cause the integration job to trigger on both
vpp *and* honeycomb merge job success.

Change-Id: I12fe582ea8a1444096b86c214b3cd3c412bc7591
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoCIMANAGE-10 Add plots into semiweekly job 87/1787/2
pmikus [Tue, 28 Jun 2016 11:56:59 +0000 (12:56 +0100)]
CIMANAGE-10 Add plots into semiweekly job

Change-Id: I7f77bfa138428e825a203a31b8dd27e83f84807b
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoAdd : to end of include-raw-escape commands 82/1782/1
C.J. Collier [Mon, 27 Jun 2016 23:46:23 +0000 (16:46 -0700)]
Add : to end of include-raw-escape commands

Missing it is deprecated syntax

Change-Id: Ib8a03206154e28c2a11abeea4df3b0cd1d7aac3b
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoCorrect jjb and mvn parameters for honeycomb deployment 92/1692/1
C.J. Collier [Tue, 21 Jun 2016 22:16:15 +0000 (15:16 -0700)]
Correct jjb and mvn parameters for honeycomb deployment

* remove deprecated MaxPermSize argument from mvn
* add repo-name parameter to job template definition

Change-Id: Ic202a8cbf56df52970c22996980206ce3849e1a3
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoDeclare maven-project-parameter for honeycomb-integration-* job 90/1690/1
Thanh Ha [Tue, 21 Jun 2016 20:03:28 +0000 (16:03 -0400)]
Declare maven-project-parameter for honeycomb-integration-* job

Change-Id: I7e792a561e8bf45f7b011b4dd85a69b96db4361d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Branching for csit-vpp-verify-semiweekly job"
C.J. Collier [Tue, 21 Jun 2016 16:00:09 +0000 (16:00 +0000)]
Merge "Branching for csit-vpp-verify-semiweekly job"

7 years agoRe-endable centos7 build 74/1674/1
Ed Warnicke [Tue, 21 Jun 2016 01:51:09 +0000 (03:51 +0200)]
Re-endable centos7 build

Change-Id: Ia3a342e96349fc7c3cfd7448fce3e20e957bebff
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoDisable centos7 jobs 71/1671/1
Ed Warnicke [Mon, 20 Jun 2016 21:17:04 +0000 (23:17 +0200)]
Disable centos7 jobs

Change-Id: I33ab63dc4870054253d8310c5fbc381e786e05f5
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoUse honeycomb-settings for push of rpms to centos 70/1670/1
Ed Warnicke [Mon, 20 Jun 2016 20:37:28 +0000 (22:37 +0200)]
Use honeycomb-settings for push of rpms to centos

Change-Id: I13e35fcaf764db0c81dc335c0adb7e31ce7f8f42
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoDisable centos7 builds for now 52/1652/1
Ed Warnicke [Sat, 18 Jun 2016 01:59:10 +0000 (20:59 -0500)]
Disable centos7 builds for now

Change-Id: Iebb012635d1eb2d428c6859d4cf6d7d962203995
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoFurther fixes for maven push of rpm for honeycomb 51/1651/1
Ed Warnicke [Sat, 18 Jun 2016 00:09:50 +0000 (19:09 -0500)]
Further fixes for maven push of rpm for honeycomb

Change-Id: I3c2a3650f30bd5d2bd49df30e78c57c5eb6d2ca8
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoFix honeycomb merge and integration job to have the correct maven settings 50/1650/2
Ed Warnicke [Fri, 17 Jun 2016 23:29:56 +0000 (18:29 -0500)]
Fix honeycomb merge and integration job to have the correct maven settings

Change-Id: I0d341f1cc96c3d8a35a127f7cd6f667126dac9d7
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoBranching for csit-vpp-verify-semiweekly job 09/1609/3
Jan Gelety [Thu, 16 Jun 2016 22:09:01 +0000 (00:09 +0200)]
Branching for csit-vpp-verify-semiweekly job

- introduce per branch semiweekly jobs: master, stable/1606
- check remote verified branches and use the latest one of
  the desired branch

Change-Id: I715ee9e9c4732033bf7fd6a1fd25cdabe2c62e1d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
7 years agoAlso have the -integration job push rpms for honeycomb. 43/1643/1
Ed Warnicke [Fri, 17 Jun 2016 18:46:04 +0000 (13:46 -0500)]
Also have the -integration job push rpms for honeycomb.

Change-Id: If0c4bfaf9aeb650b5fb13f4c1ac64bc4919b7c5f
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoRevert "Create script to automate deployment" 35/1635/2
Ed Warnicke [Fri, 17 Jun 2016 17:24:47 +0000 (17:24 +0000)]
Revert "Create script to automate deployment"

https://gerrit.fd.io/r/#/c/1606/

This reverts commit afd303bc155a27d1ddccfc8add7d510c731decf5.

Change-Id: Ie169e3cad3433953d6f21064ec90b33d6b2dc49a
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoMerge "Create script to automate deployment"
Thanh Ha [Fri, 17 Jun 2016 16:25:45 +0000 (16:25 +0000)]
Merge "Create script to automate deployment"

7 years agoMerge "Re-enable centos7 homeycomb verify and merge builds"
C.J. Collier [Fri, 17 Jun 2016 16:23:38 +0000 (16:23 +0000)]
Merge "Re-enable centos7 homeycomb verify and merge builds"

7 years agoMerge "CSIT: Do not autogenerate csv persistance plot file names."
C.J. Collier [Fri, 17 Jun 2016 16:23:04 +0000 (16:23 +0000)]
Merge "CSIT: Do not autogenerate csv persistance plot file names."

7 years agoRe-enable centos7 homeycomb verify and merge builds 27/1627/1
Ed Warnicke [Fri, 17 Jun 2016 15:43:46 +0000 (10:43 -0500)]
Re-enable centos7 homeycomb verify and merge builds

Change-Id: Ibf5610b0607001178791bd9b56bcd0427e5ffee8
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoAdd -{os} to node selector 26/1626/1
Ed Warnicke [Fri, 17 Jun 2016 15:39:30 +0000 (10:39 -0500)]
Add -{os} to node selector

Change-Id: I10da36d45ff8ea3d4b5c3a17e68d5ee89d3132de
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoCreate script to automate deployment 06/1606/4
C.J. Collier [Thu, 16 Jun 2016 21:20:28 +0000 (14:20 -0700)]
Create script to automate deployment

* as per #24343
* re-factored to use common code from include-raw-vpp-maven-push and maven_push_functions.sh

Change-Id: I197c114bcf61b0dd2ea81e2be0505793cf594e49
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoTemporarily remove centos7 build as there is some issue there 10/1610/2
Ed Warnicke [Thu, 16 Jun 2016 23:23:23 +0000 (18:23 -0500)]
Temporarily remove centos7 build as there is some issue there

Change-Id: I1dd82bb2a8c5f7c19aa8905a24133e5805f31ae2
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoMerge "Remove spurious and mistaken pegging of jdk: {jdk}"
C.J. Collier [Thu, 16 Jun 2016 21:46:27 +0000 (21:46 +0000)]
Merge "Remove spurious and mistaken pegging of jdk: {jdk}"

7 years agoCSIT: Do not autogenerate csv persistance plot file names. 08/1608/2
Miroslav Miklus [Thu, 16 Jun 2016 21:29:19 +0000 (23:29 +0200)]
CSIT: Do not autogenerate csv persistance plot file names.

History of plotss is lost when JJB generates new file names
on every commit to ci-management.

plot:
 csv-file-name (str) â€“ Use for choosing the file name in which the
 data will be persisted. If none specified and random name is
 generated as done in the Jenkins Plot plugin. (default: random
 generated .csv filename, same behaviour as the Jenkins Plot plugin)

Change-Id: I1fe55eb035c168f489437f4617c41f877b9a9bc1
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoMerge "FIX: Get CSIT branch from build-root/scripts/csit-test-branch"
C.J. Collier [Thu, 16 Jun 2016 21:30:29 +0000 (21:30 +0000)]
Merge "FIX: Get CSIT branch from build-root/scripts/csit-test-branch"

7 years agoRemove spurious and mistaken pegging of jdk: {jdk} 07/1607/2
Ed Warnicke [Thu, 16 Jun 2016 21:29:43 +0000 (16:29 -0500)]
Remove spurious and mistaken pegging of jdk: {jdk}

Change-Id: Ie1f34c60b256588281e70b835b7bbd797265db3a
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoSetup honeycomb to build and push rpms on merge 75/1575/6
Ed Warnicke [Wed, 15 Jun 2016 16:45:51 +0000 (11:45 -0500)]
Setup honeycomb to build and push rpms on merge

This patch depends on the merging of https://gerrit.fd.io/r/#/c/1574/
which must merge before it.

Please also note, while there is a first step to getting the package
pushing scripts into a common sharable place, the vpp script
for pushing has *intentionally* not been changed to use
it yet because of the release later this week as a matter
of risk management.

Change-Id: Ifad185d35f582a62bb750ece3c022a24d2153b4e
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoFIX: Get CSIT branch from build-root/scripts/csit-test-branch 99/1599/1
Miroslav Miklus [Thu, 16 Jun 2016 14:47:34 +0000 (16:47 +0200)]
FIX: Get CSIT branch from build-root/scripts/csit-test-branch

JIRA: CSIT-167

Change-Id: I1a1d2cfd696228ec8558ba0a81c31d4c9d2c09b1
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoSimplify README 70/1270/8
C.J. Collier [Thu, 26 May 2016 04:56:54 +0000 (21:56 -0700)]
Simplify README

* configurable options have been moved to environment variables
* processes have been simplified
* Added a script to bootstrap openstack vagrant environment
* Added an example openstack dummy box Vagrantfile

Change-Id: I5dd850e9456ad205fe3a655ca9e16a9bb14f32e2
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
7 years agoAdd refs/heads/ prefix for git publisher 62/1562/1
Miroslav Miklus [Wed, 15 Jun 2016 11:50:08 +0000 (13:50 +0200)]
Add refs/heads/ prefix for git publisher

ERROR: Failed to push branch csit-verified-master-2016-06-15 to origin
hudson.plugins.git.GitException: Command "git -c core.askpass=true push
 ssh://rotterdam-jobbuilder@gerrit.fd.io:29418/csit HEAD:csit-verified-master-2016-06-15" returned status code 1:
stdout:
stderr: error: unable to push to unqualified destination: csit-verified-master-2016-06-15
The destination refspec neither matches an existing ref on the remote nor
begins with refs/, and we are unable to guess a prefix based on the source ref.

Change-Id: I98a3b0bb77ce9e845f63f9e32d8e8bf1f63832a6
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoCSIT jobs - branching 27/1527/5
Miroslav Miklus [Mon, 13 Jun 2016 14:56:28 +0000 (16:56 +0200)]
CSIT jobs - branching

- introduce per branch jobs: master, stable/1606
- weekly job to create csit-stable branch
- archive artifacts for last 10 jobs

Change-Id: Ib3eb7320fad365017d82a5a594123f0c68076151
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
7 years agoAdd more Plots into csit-vpp-verfiy-perf-all 93/1493/1
pmikus [Fri, 10 Jun 2016 12:51:15 +0000 (13:51 +0100)]
Add more Plots into csit-vpp-verfiy-perf-all

- Add more Plots (1c,2c,4c) into csit-vpp-verfiy-perf-all

Change-Id: Idcc0892a65e1b28e8c0d7216eba8301cd1f9844b
Signed-off-by: pmikus <pmikus@cisco.com>
7 years agoMerge "Get CSIT branch from build-root/scripts/csit-test-branch"
C.J. Collier [Thu, 9 Jun 2016 06:21:01 +0000 (06:21 +0000)]
Merge "Get CSIT branch from build-root/scripts/csit-test-branch"

7 years agoMerge "Add simple plot into csit/perf job"
C.J. Collier [Thu, 9 Jun 2016 06:20:01 +0000 (06:20 +0000)]
Merge "Add simple plot into csit/perf job"

7 years agoAdd common setup for vpp plugin verifies 57/1457/2
Ed Warnicke [Wed, 8 Jun 2016 20:15:52 +0000 (15:15 -0500)]
Add common setup for vpp plugin verifies

Change-Id: Iac8b1d5408a9187fd39276881e21501c247c2231
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoFix issue in cleanup script 58/1458/1
Ed Warnicke [Wed, 8 Jun 2016 20:26:34 +0000 (15:26 -0500)]
Fix issue in cleanup script

Change-Id: I06c1b51a423fac735767abf6c5f5ffdc602b0126
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoProvide common cleanup script to be used across projects 54/1454/4
Ed Warnicke [Wed, 8 Jun 2016 19:58:27 +0000 (14:58 -0500)]
Provide common cleanup script to be used across projects

Change-Id: Iebafbd25bee5cbf9c09fe0183b5d7e4c1eef8bb8
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoFix for nsh_sfc jjb 51/1451/1
Ed Warnicke [Wed, 8 Jun 2016 13:35:11 +0000 (08:35 -0500)]
Fix for nsh_sfc jjb

Change-Id: I871c8723dd443e4472e851b2ecda76f53cdd530d
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoInitial nsh_sfc jjb 42/1442/3
Ed Warnicke [Tue, 7 Jun 2016 22:46:04 +0000 (17:46 -0500)]
Initial nsh_sfc jjb

Change-Id: If77fdd4778eb54b3cba683a94b3cb84d1203fd00
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoGet CSIT branch from build-root/scripts/csit-test-branch 44/1344/3
Ed Warnicke [Wed, 1 Jun 2016 15:00:06 +0000 (10:00 -0500)]
Get CSIT branch from build-root/scripts/csit-test-branch

If build-root/scripts/csit-test-branch exists, run
it to get the CSIT branch from which to run CSIT
tests.  Otherwise, default to csit-verified.

Related to patches vpp patches:
https://gerrit.fd.io/r/#/c/1343/ (master branch)
https://gerrit.fd.io/r/#/c/1345/ (stable/1606 branch)

Change-Id: I1146c322c1948076ead4639263f9b25e965009f2
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoRevert "Turn on debugging" 22/1422/1
Ed Warnicke [Mon, 6 Jun 2016 20:35:48 +0000 (20:35 +0000)]
Revert "Turn on debugging"

This reverts commit cfaf0bf146c2c9e7598faf6c9efb044b8b7dba33.

https://gerrit.fd.io/r/#/c/1399/
As it bore no resemblance to the original gerrit submitted and currently has broken all of tldk verify.

Change-Id: If9914f8ade100b56c3a979adda1107f21b9c3c3f
Signed-off-by: Ed Warnicke <eaw@cisco.com>
7 years agoAdd simple plot into csit/perf job 19/1419/4
pmikus [Mon, 6 Jun 2016 11:35:11 +0000 (12:35 +0100)]
Add simple plot into csit/perf job

- Use plot plugin for 64B framesize, single core with NDR/PDR

Change-Id: Iea0697f31db3e4e0242c638bc1ebf0603081c8fd
Signed-off-by: pmikus <pmikus@cisco.com>
8 years agoTurn on debugging 99/1399/3
Ed Warnicke [Sat, 4 Jun 2016 00:22:28 +0000 (19:22 -0500)]
Turn on debugging

* sourcing a debug script if DEBUG is set
* echo command before executing (set -x)
* reduce duplicate code
* give more information about uptime

Change-Id: Ic8409ea3a819f2070eac01ac84e2b3a6fe975592
Signed-off-by: Ed Warnicke <eaw@cisco.com>
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoAdding verify and merge jobs for tldk 98/1398/11
Ed Warnicke [Fri, 3 Jun 2016 21:49:55 +0000 (16:49 -0500)]
Adding verify and merge jobs for tldk

Change-Id: I527e3b58038b20380fef03dcc4c8db7cced71658
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoUse branching instead of tagging in csit-vpp-verify-weekly job 93/1393/1
Jan Gelety [Fri, 3 Jun 2016 20:45:04 +0000 (22:45 +0200)]
Use branching instead of tagging in csit-vpp-verify-weekly job

- branch name in format 'csit-verified-YYMMDD'

Change-Id: I87ee7d3af417f0c2d9022ed914ec978b96c973e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoBe less agressive with the set 75/1375/2
Ed Warnicke [Thu, 2 Jun 2016 23:38:53 +0000 (18:38 -0500)]
Be less agressive with the set

Change-Id: I221374b6515e145f4fc5a31e3c30192732e6aeab
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoFix propogation of build errors. 74/1374/1
Ed Warnicke [Thu, 2 Jun 2016 23:29:22 +0000 (18:29 -0500)]
Fix propogation of build errors.

Change-Id: I3e600ab74f5290008489cdbaa1624559067ad8b2
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoRevert "Add timestamps to console logs for vpp verify jobs" 73/1373/1
Ed Warnicke [Thu, 2 Jun 2016 22:57:27 +0000 (17:57 -0500)]
Revert "Add timestamps to console logs for vpp verify jobs"

This reverts commit 233f45d3fc425cde64c2615c2f36025f61374451.
https://gerrit.fd.io/r/#/c/1282/

Change-Id: I7b65a3d60c17c832d88caa47a46a788984c358f0
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoMerge "Sonar analysis added to Honeycomb jobs"
Andrew Grimberg [Thu, 2 Jun 2016 16:37:05 +0000 (16:37 +0000)]
Merge "Sonar analysis added to Honeycomb jobs"

8 years agoSonar analysis added to Honeycomb jobs 02/1302/6
Tibor Frank [Mon, 30 May 2016 09:08:38 +0000 (11:08 +0200)]
Sonar analysis added to Honeycomb jobs

The configuration is based on information from:
http://docs.openstack.org/infra/jenkins-job-builder/builders.html
and
http://docs.sonarqube.org/display/SCAN/Analyzing+with+SonarQube+Scanner+for+Jenkins#AnalyzingwithSonarQubeScannerforJenkins-Job-levelConfiguration

This setting should be tested on the actual infrastructure.

Change-Id: I7416c84881d8cf36330f81318e178140dbce755b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 years agoUpdate of artifact directory in csit-vpp-master-verify-semiweekly job. 12/1312/1
Jan Gelety [Mon, 30 May 2016 15:15:07 +0000 (17:15 +0200)]
Update of artifact directory in csit-vpp-master-verify-semiweekly job.

- artifact directory set to csit/archive
- artifacts set to *.* to keep all files we need
  in the archive direcotry

Change-Id: I3d862f06e3bb6deb6a208ba0e410299d99e8d4f6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoMerge "Replace obsolete bootstrap file"
C.J. Collier [Fri, 27 May 2016 20:02:21 +0000 (20:02 +0000)]
Merge "Replace obsolete bootstrap file"

8 years agoReplace obsolete bootstrap file 79/1279/2
Peter Mikus [Thu, 26 May 2016 13:56:24 +0000 (15:56 +0200)]
Replace obsolete bootstrap file

- JIRA: CIMANAGE-8
- Replace bootstrap-hw-tb2.sh with bootstrap-verify-perf.sh

Change-Id: I33ed6ff596faf46ec45e2483b0f60a6707d30056
Signed-off-by: Peter Mikus <pmikus@cisco.com>
8 years agoAdd timestamps to console logs for vpp verify jobs 82/1282/2
Ed Warnicke [Thu, 26 May 2016 18:13:09 +0000 (13:13 -0500)]
Add timestamps to console logs for vpp verify jobs

Change-Id: I811483179ac6c80c8d90690ce672d3a49b4cdeae
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoMerge "Switch to using {stream} for honeycomb"
C.J. Collier [Fri, 20 May 2016 19:04:43 +0000 (19:04 +0000)]
Merge "Switch to using {stream} for honeycomb"

8 years agoMerge "Fix honeycomb integration to trigger from current vpp merge job"
C.J. Collier [Fri, 20 May 2016 19:04:17 +0000 (19:04 +0000)]
Merge "Fix honeycomb integration to trigger from current vpp merge job"

8 years agoDocument the process of re-spinning an image 76/1176/16
C.J. Collier [Tue, 17 May 2016 19:03:02 +0000 (12:03 -0700)]
Document the process of re-spinning an image

* Document the process of respinning jcloud images in README.txt
* Create /scripts/respin-jcloud-images.sh
* Create /vagrant/lib/respin-functions.sh
* Automate the process of fetching latest base images
* Automate the process of creating new "LF upload" snapshots
* Automate process of creating jcloud image
- Boot fresh VM
- run bootstrap.sh
- run system_reseal.sh
- snapshot re-sealed system
* Unable to automate updating jcloud image regex for staging nodes
* Correct shasum to sha1sum
* Add cloud-initramfs-* to PACKAGES list
* Install cloud-init during system reseal

Change-Id: Ie70d5f1fdee0e9f06810da6f37bfc710e3e06b8e
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoUpdate ci merge job to use 4 threads 06/1206/1
Thanh Ha [Fri, 20 May 2016 00:42:11 +0000 (20:42 -0400)]
Update ci merge job to use 4 threads

JJB 1.5.0 supports the --workers flag which allows us to tell it to use
multiple thread to update jobs.

Change-Id: I4626777990ca243d93a250e05d7791319eb20ac2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoSimplify cfp jjb configuration 05/1205/1
Thanh Ha [Thu, 19 May 2016 22:04:10 +0000 (18:04 -0400)]
Simplify cfp jjb configuration

JJB 1.5.0 now allows CFP to use freeform IDs so lets use it to simplify
the yaml configuration.

Change-Id: Id64e772cb9fc1ed2f0deb11b6ba405f4ab43fe1e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoSwitch to using {stream} for honeycomb 94/1194/1
Ed Warnicke [Thu, 19 May 2016 11:42:16 +0000 (06:42 -0500)]
Switch to using {stream} for honeycomb

Change-Id: Id91f825463bad7d8f48bb2efe1c5ac300e06a45e
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoFix honeycomb integration to trigger from current vpp merge job 93/1193/1
Ed Warnicke [Thu, 19 May 2016 11:40:24 +0000 (06:40 -0500)]
Fix honeycomb integration to trigger from current vpp merge job

Change-Id: I911e6f366b4831dc87523b6b0529353f233f0791
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoMerge "CIMANAGE-7: csit-vpp-master-verify-semiweekly scheduled job"
C.J. Collier [Wed, 18 May 2016 19:53:11 +0000 (19:53 +0000)]
Merge "CIMANAGE-7: csit-vpp-master-verify-semiweekly scheduled job"

8 years agocsit-vpp-pylint: Adjust Violations plugin values 85/1185/1
Miroslav Miklus [Wed, 18 May 2016 13:26:05 +0000 (15:26 +0200)]
csit-vpp-pylint: Adjust Violations plugin values

sunny weather: 0 - 10
stormy weather: 10 - 250
mark as unstable: 250+

Change-Id: Iac89bdcb74f2b8710597180340551386ef5cf3d8
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
8 years agoCIMANAGE-7: csit-vpp-master-verify-semiweekly scheduled job 50/1150/2
Jan Gelety [Mon, 16 May 2016 14:57:14 +0000 (16:57 +0200)]
CIMANAGE-7: csit-vpp-master-verify-semiweekly scheduled job

- test vpp latest release from nexus with csit-verified test cases
- in case of success the vpp build will be used as vpp-master-verified
  build for csit-* jobs
- sheduled to run every Tuesday and Saturday at 04:00 UTC
- manual trigger possible too

- contains aslo correction of path of artifact in csit-vpp-verify-weekly job

Change-Id: Id5da3edb1b4579e6a3bd008694b9e5c754fd8729
Signed-off-by: Jan Gelety <jgelety@cisco.com>
8 years agoUse correct server-name Primary 64/1164/1
Thanh Ha [Tue, 17 May 2016 03:04:59 +0000 (23:04 -0400)]
Use correct server-name Primary

Perhaps 'Default' was the name at one point and then got renamed to
'Primary' and we forgot to update the configuration. Default is not
currently a valid server-name so resulted in Gerrit Trigger not watching
any valid Gerrit instance for the event-stream.

The current name of the Gerrit server-name is 'Primary' as defined in
Jenkins > Manage Jenkins > Gerrit Trigger.

Change-Id: Ic9481b53424d6fc8358131d384157779a7753fb0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
8 years agoCorrect init script to use sysv on 14.04 59/1159/2
C.J. Collier [Mon, 16 May 2016 20:27:08 +0000 (13:27 -0700)]
Correct init script to use sysv on 14.04

condition wrapped around code

Change-Id: I27a426504fe5786e9a45d7145d9c3332b4542860
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoMerge "Provide clarity as to when merge job fails are build or push"
C.J. Collier [Mon, 16 May 2016 20:00:10 +0000 (20:00 +0000)]
Merge "Provide clarity as to when merge job fails are build or push"

8 years agoMerge "Correct deprecated include syntax"
C.J. Collier [Mon, 16 May 2016 19:59:47 +0000 (19:59 +0000)]
Merge "Correct deprecated include syntax"

8 years agoProvide clarity as to when merge job fails are build or push 27/1127/2
Ed Warnicke [Sun, 15 May 2016 17:43:59 +0000 (12:43 -0500)]
Provide clarity as to when merge job fails are build or push

Merge jobs can fail because a build has failed, or because
a push of artifacts has failed.  This should make
it clear which occurrred in the build logs.

Change-Id: I77e2ed0c756104492ee7a16378a5445162406f40
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoInstrument Jenkins images/builds (take2) 56/1156/1
Ed Warnicke [Mon, 16 May 2016 19:50:46 +0000 (14:50 -0500)]
Instrument Jenkins images/builds (take2)

Change-Id: I167cb259fce64f96d385294268a78bf6d161c8de
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoCorrect deprecated include syntax 55/1155/1
C.J. Collier [Mon, 16 May 2016 19:46:06 +0000 (12:46 -0700)]
Correct deprecated include syntax

* perl -i -pe 's/include-raw-escape /include-raw-escape: /' vpp.yaml

Change-Id: I62d6813e71b6f915524c395b3adc328698f755ce
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoInstrument Jenkins images/builds 83/983/6
Ed Warnicke [Wed, 11 May 2016 16:44:28 +0000 (11:44 -0500)]
Instrument Jenkins images/builds

This patch instruments so we can be certain *what* bootstrap.sh
was used to build the running image and what
include-raw-vpp-build.sh was run for the Job

Change-Id: I69782c3bca71f24d24133205130be059a14a114c
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoAdd build dependencies for documentation 14/1114/3
Chris Luke [Fri, 13 May 2016 23:21:04 +0000 (19:21 -0400)]
Add build dependencies for documentation

Add doxygen and graphviz to the dependency list.

Change-Id: I546b41a7613d8492f4054b3674905f05c504fad3
Signed-off-by: Chris Luke <chrisy@flirble.org>
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
8 years agoDisable things which may lock /var/lib/dpkg/lock 28/1128/4
Ed Warnicke [Sun, 15 May 2016 17:57:27 +0000 (12:57 -0500)]
Disable things which may lock /var/lib/dpkg/lock

The ubuntu1604 verify job has been failing due
to locking of /var/lib/dpkg/lock:

https://lists.fd.io/pipermail/vpp-dev/2016-May/000992.html

This appears to only happen with the first job run against
a particular Jenkins slave, and upon using:

https://gerrit.fd.io/r/#/c/1121/

to probe it, two candidates emerge:

apt.systemd.daily

and

unattended-upgrades

So this patch removes unattended-upgrades

and

stops/disables apt.systemd.daily via systemd

Change-Id: Ic2bc9e4ec54ef1f2d0ab35813c4623a67a43f00a
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoAdd capacity for honeycomb to verify images. 73/1073/3
Ed Warnicke [Wed, 11 May 2016 16:48:45 +0000 (11:48 -0500)]
Add capacity for honeycomb to verify images.

Change-Id: Ie5fe2507b760b3f681be4291f9c52bf609dbfaca
Signed-off-by: Ed Warnicke <eaw@cisco.com>
8 years agoFix for package pushx 11/1111/1
Ed Warnicke [Fri, 13 May 2016 20:30:16 +0000 (15:30 -0500)]
Fix for package pushx

Change-Id: Iebfcd2973bb319be4db64eecc4e35b218fb25b3b
Signed-off-by: Ed Warnicke <eaw@cisco.com>