Continuous Integration With Jenkins Docker SQL Server

chris@exadat.com exadat.co.ukChris Adkin chrisadkin.ioChris Adkin cadkin@purestorage.com CI With Jenkins, Docker and SQL Server

Build Pipeline 101 2. Build code into a deployable artefact 1. Check code out of source code control 3. Deploy code to test target 4. Run Tests  Apache Ant  Apache Maven  Gradle  Microsoft msbuild  Git  GitHub  Bitbucket  Team Foundation Server  Containers  Web servers  Databases  Public cloud PaaS  JUnit  Selenium  Mocha  Pester

Build Pipeline As Code !!! 2. Build code into a deployable artefact 1. Check code out of source code control 3. Deploy code to test target 4. Run Tests  Jenkins  Groovy DSL (DSL = Domain specific language)  Jenkins script  Jenkins declarative pipeline  TFS / VSTS  Pipeline as YAML in VSTS preview  Coming to TFS sometime next year

The ‘New’ Build Pipeline 2. Build code into a deployable artefact 1. Check code out of source code control 5. Deploy container image to a registry 4. Run Tests 3. Deploy code to test target

Builds Can Be Event Triggered 1. Checkout code 2. Build artefact 3. Deploy to target 4. Run Tests Git/GitHub webhooks Visual studio online project service hooks Wouldn’t it be nice if we could have event driven builds and spin-up and then tare down the deployment target ?

Containers To The Rescue !!!  We can fully container-ise the build environment  Scale-out the build infrastructure elastically using containers  Spin-up “Side car” containers as deployment targets  The “Builder pattern”

The ‘Builder’ Pattern Spin-up a container to ‘Build’ the artefact here Deploy artefact to ‘Run’ container here Rationale: keep the size of the ‘Run’ container image as small as possible by not including the build tool chain

Build Engines – There Are Lots To Choose From !!!  Jenkins:  Great open-source plugin support  Free  Light weight  Can be fully container-ised and scaled out with containers  Strong build-pipeline-as-code support  Multi-branch build pipelines

Jenkins Pipeline As Code: The Two Flavours Scripted Pipeline Syntax node { stage('Example') { try { sh 'exit 1' } catch (exc) { echo ‘Failure, sound the alarm!' throw } } } Declarative Pipeline syntax pipeline { agent any stages { stage('Example') { steps { echo 'Hello World' } } } post { always { echo 'I will always say Hello again!' } } } https://jenkins.io/doc/book/pipeline/syntax/

Store Your Pipeline Alongside Your Code Your pipeline code goes in here, this is for multi-branch pipelines

“Syntactic sugar” For Working With Containers node('docker') { docker.withServer('tcp://docker.beedemo.net:2376', 'docker-beedemo-creds') { stage('Build Docker Image’) { def image = docker.build "cloudbees/mobile-deposit-api:${buildVersion}” } stage('Publish Docker Image’) { docker.withRegistry('https://registry.beedemo.net/', 'docker-registry-login') { image.push() } } stage('Deploy Docker Image’) { def container = image.run('--name mobile-deposit-api -p 8080:8080') } } }

Demonstrations May the demonstration gods smile upon me

Demonstration: A Simple Web hook sqlproj DACPAC 1. Open visual studio project, make a change and perform a commit 2. Check code out of git 3. Build DACPAC from visual studio project 4. Deploy code to SQL Server GitHub repo: https://github.com/chrisadkin/SsdtDevOpsDemo, Blog Post

Demonstration: A Multi-branch Build Pipeline Master HotFix Feature Jenkins creates a pipeline for each branch created from the master GitHub repo: https://github.com/chrisadkin/SelfBuildPipeline, Blog Post

Demonstration: Using A Jenkins Build Slave Jenkins Build Master ( orchestrate build here ) Jenkins Build Slave ( deploy to container here ) GitHub repo: https://github.com/chrisadkin/SelfBuildPipelineDV, Blog Post

Demonstration: Image Layering Base Image Intermediate images Final Image

Pro Tip #1 Constructing Dockerfiles Put slow and time consuming operations as close to the top of the file as possible Put fast operations toward the bottom of the Dockerfile

Pro Tip #2 Use of FROM Clauses In Dockerfiles The Dockerfile should only contain 1 FROM clause

Pro Tip #3 Use Timeout Wrappers timeout(time:2, unit:'MINUTES') { bat "docker run -d -e ACCEPT_EULA=Y -e SA_PASSWORD=P@ssword1 --name SQLLinuxmaster -d -i -p 15565:1433 microsoft/mssql-server-linux" } My samples do not use this feature, but you may wish to consider this for pipelines used in actual production

Demonstration: A Fully Containerised Build Environment Jenkins Master SQL Server “Side car” Deployment target GitHub repo: https://github.com/chrisadkin/SsdtJenkinsCiInDocker, Blog Post

Demonstration: Adding tSQLt Unit Testing To The Pipeline sqlproj DACPAC 1. Open visual studio project, make a change and perform a commit 2. Check code out of git 3. Build DACPAC from visual studio project 4. Deploy code to SQL Server GitHub repo: https://github.com/chrisadkin/SelfBuildPipelineDV_tSQLt, Blog post coming soon . . . 5. Run tSQLt tests

Want To Get More Adventurous ?  Scale out your build platform with build slaves as containers  Deploy Jenkins to Kubernetes  Build shared groovy script libraries to share code across pipelines  Invoke builds from the REST API

Some Final Words  Linux images tend to be smaller, faster and more stable than their windows counterparts:  windowsservercore 10.4 GB  ubuntu 123 MB  Alpine 3.97 MB ( .Net core 2.1 will run on this)  Docker community edition can be temperamental  People including myself have had difficulty getting the docker SQL Server lab to work  Jenkins is open source, things can break from one release to the next !!!

Further Reading  Top 10 Jenkins best practices from CloudBees  Jenkins Pipeline as code from Jenkins.io, includes:  Demos  Downloadable examples  Articles  Blogposts  Recordings

Continuous Integration With Jenkins Docker SQL Server

More Related Content

What's hot

Similar to Continuous Integration With Jenkins Docker SQL Server

More from Chris Adkin

Recently uploaded

Continuous Integration With Jenkins Docker SQL Server