jenkins as a code
play

Jenkins as a code ukasz Szczsny & Marcin Zajczkowski FOSDEM, - PowerPoint PPT Presentation

Apr 10, 2023 •173 likes •766 views

Jenkins as a code ukasz Szczsny & Marcin Zajczkowski FOSDEM, 30-31th January 2016 ukasz Szczsny & Marcin Zajczkowski @wybczu & @SolidSoftBlog About ukasz Software engineer @ Uber FOSS and Open Hardware lover

  1. Jenkins as a code Łukasz Szczęsny & Marcin Zajączkowski FOSDEM, 30-31th January 2016 Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  2. About Łukasz Software engineer @ Uber FOSS and Open Hardware lover Co-organizer of the Warsaw Linux User Group Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  3. About Marcin Areas of expertise Automatic Testing / TDD Software Craftsmanship / Code Quality Java8 / Groovy Concurrency / Parallel Computing / Reactive Systems Deployment Automation / Continuous Delivery FOSS projects author and contributor, blogger Leads a small software house - Codearte targeted at clients who care about the quality Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  4. Agenda Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  5. Agenda Manual Jenkins maintenance Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  6. Agenda Manual Jenkins maintenance Job configuration as code Jenkins Job DSL Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  7. Agenda Manual Jenkins maintenance Job configuration as code Jenkins Job DSL Infrastructure as code Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  8. Agenda Manual Jenkins maintenance Job configuration as code Jenkins Job DSL Infrastructure as code Case study - Continuous Delivery in Jenkins Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  9. Manual Jenkins maintenance Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  10. Manual Jenkins maintenance Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  11. Manual Jenkins maintenance configuration via GUI does not scale slow, error prone, and boring Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  12. Manual Jenkins maintenance configuration via GUI does not scale slow, error prone, and boring problematic with dozens of jobs and plugins Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  13. Manual Jenkins maintenance configuration via GUI does not scale slow, error prone, and boring problematic with dozens of jobs and plugins mission impossible with several microservices deployed in several countries for multiple products using deployment pipeline with several steps each Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  14. Automation to the rescue! Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  15. Jenkins Job DSL Job configuration in code Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  16. (Jenkins) Job DSL - 2 parts Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  17. (Jenkins) Job DSL - 2 parts Domain Specific Language to specify job configuration Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  18. (Jenkins) Job DSL - 2 parts Domain Specific Language to specify job configuration Jenkins plugin to transform configuration DSL into real jobs in Jenkins Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  19. Job DSL - part 1 - configuration Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  20. Job DSL - part 1 - configuration Groovy based DSL (Domain Specific Language) job/view/dashboard configuration developed as "normal" code in IDE with auto-completion type check Groovy magic if needed outside Jenkins instance Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  21. Job DSL - simple example Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  22. Job DSL - simple example job( 'FOSDEM-website-publish' ) { scm { github( 'FOSDEM/website' ) } triggers { scm( '*/15 * * * *' ) } steps { rake( 'publish' ) } } Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  23. Job DSL - dynamic example String repo = 'FOSDEM/mobile-app' URL branchUrl = "https://api.github.com/repos/$repo/branches" .toURL() List branches = new JsonSlurper().parseText(branchUrl.text) branches.each { branch -> String safeBranchName = branch.name.replaceAll( '/' , '-' ) job( "$repo-$safeBranchName-build" ) { scm { github repo, branch.name } triggers { scm 'H/10 * * * *' } steps { gradle 'check' } } } Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  24. Job DSL - features Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  25. Job DSL - features comprehensive support for Jenkins Core stuff extensive support for additional plugins 177 plugins in version 1.42 active community - continuous flow of new pull requests Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  26. Job DSL - features comprehensive support for Jenkins Core stuff extensive support for additional plugins 177 plugins in version 1.42 active community - continuous flow of new pull requests powerful configuration block for not yet supported features custom stuff virtually everything possible in XML should be achievable Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  27. Job DSL - part 2 - Jenkins plugin Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  28. Job DSL - part 2 - Jenkins plugin installed in Jenkins instance used in seed jobs on Jenkins leverages DSL configuration updates jobs & views in Jenkins to bring them to desired state by XML configuration files modification Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  29. Job DSL - benefits Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  30. Job DSL - benefits source code instead of XML or GUI single source of truth manageable jobs and views backed by SCM reviewable - possibly with pull requests Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  31. Job DSL - benefits source code instead of XML or GUI single source of truth manageable jobs and views backed by SCM reviewable - possibly with pull requests testable automatic "unit" testing pre-production environment Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  32. Job DSL - benefits source code instead of XML or GUI single source of truth manageable jobs and views backed by SCM reviewable - possibly with pull requests testable automatic "unit" testing pre-production environment scalable hundreds of jobs created/modified in seconds* Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  33. Job DSL - drawbacks/limitations Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  34. Job DSL - drawbacks/limitations quite steep learning curve can become hard to understand for complex configurations Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  35. Job DSL - drawbacks/limitations quite steep learning curve can become hard to understand for complex configurations small error in DSL can remove all jobs can be easily recreated, but without execution history Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  36. Job DSL - drawbacks/limitations quite steep learning curve can become hard to understand for complex configurations small error in DSL can remove all jobs can be easily recreated, but without execution history occasional backward compatibility issues with new versions Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  37. Job DSL - drawbacks/limitations quite steep learning curve can become hard to understand for complex configurations small error in DSL can remove all jobs can be easily recreated, but without execution history occasional backward compatibility issues with new versions very old Groovy 1.8.9 - version bundled in Jenkins 1.x Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  38. Job DSL - drawbacks/limitations quite steep learning curve can become hard to understand for complex configurations small error in DSL can remove all jobs can be easily recreated, but without execution history occasional backward compatibility issues with new versions very old Groovy 1.8.9 - version bundled in Jenkins 1.x not suitable for global Jenkins configuration management credentials, machine provisioning, Jenkins and plugin update, ... Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  39. Infrastructure Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  40. Infrastructure challenges Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  41. Infrastructure challenges install and configure Jenkins master install and configure all required dependencies install and configure plugins create and connect slaves add JDK installation configure authentication create credentials ... Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

  42. Infrastructure toolbelt configuration management tools Ansible Puppet Chef Salt etc. Groovy console Jenkins CLI Łukasz Szczęsny & Marcin Zajączkowski @wybczu & @SolidSoftBlog

Recommend

40 Jenkins features and plugins you wished you had known about before! Joep Weijers (TOPdesk)

40 Jenkins features and plugins you wished you had known about before! Joep Weijers (TOPdesk)

40 Jenkins features and plugins you wished you had known about before! Joep Weijers (TOPdesk) Which CI server do you use? https://snyk.io/blog/jvm-ecosystem-report-2018-tools https://wiki.jenkins.io/display/JENKINS/Logo

1.54k views • 132 slides
ZAP JENKINS PLUGIN Goran Sarenkapa ZAP Jenkins Plugin Project Lead WHAT IS ZAP? An easy to

ZAP JENKINS PLUGIN Goran Sarenkapa ZAP Jenkins Plugin Project Lead WHAT IS ZAP? An easy to

ZAP JENKINS PLUGIN Goran Sarenkapa ZAP Jenkins Plugin Project Lead WHAT IS ZAP? An easy to use webapp pentest tool Completely free and open source An OWASP flagship project Ideal for beginners But also used by professionals

386 views • 21 slides
Mitigating and Preventing Vulnerabilities with ELFbac Ira Ray Jenkins, Dartmouth College Funded

Mitigating and Preventing Vulnerabilities with ELFbac Ira Ray Jenkins, Dartmouth College Funded

Mitigating and Preventing Vulnerabilities with ELFbac Ira Ray Jenkins, Dartmouth College Funded by the U.S. Department of Energy and the U.S. Department of Homeland Security | cred-c.org Code to Process Common object file formats source

394 views • 14 slides
80% of Code Red 2 Code Red 2 re-re- Code Red 1 and Code Red 2 Code Red 2 re- cleaned up

80% of Code Red 2 Code Red 2 re-re- Code Red 1 and Code Red 2 Code Red 2 re- cleaned up

Slammer s Bandwidth-Limited Growth 80% of Code Red 2 Code Red 2 re-re- Code Red 1 and Code Red 2 Code Red 2 re- cleaned up due to released Jan 2004 Nimda endemic dies off released with Oct. onset of Blaster (and 2005; not since

450 views • 34 slides
Inequality and Poverty: the longitudinal perspective Stephen P. Jenkins London School of

Inequality and Poverty: the longitudinal perspective Stephen P. Jenkins London School of

1 Inequality and Poverty: the longitudinal perspective Stephen P. Jenkins London School of Economics and Political Science Email: s.jenkins@lse.ac.uk EIB, Luxembourg, 26 March 2014 2 Longitudinal perspectives rather than cross-sectional ones

670 views • 47 slides
Box-Jenkins Forecasting

Box-Jenkins Forecasting

Department of Logistics Management Box-Jenkins Forecasting Trend, seasonal factors, causal forecasting

355 views • 24 slides
Name of the Speaker : Karan kural Co-Speaker : Deepshikha Singh Company Name : Srijan

Name of the Speaker : Karan kural Co-Speaker : Deepshikha Singh Company Name : Srijan

Name of the Speaker : Karan kural Co-Speaker : Deepshikha Singh Company Name : Srijan Technologies Pvt. Ltd. Place: New Delhi. GitHub Pull Request Builder Plugin for Jenkins Tools We will going to use: What is Jenkins? Jenkins is an

219 views • 20 slides
GitOps, Jenkins & Jenkins X Tracy Miranda, Director of Open Source Community | CloudBees

GitOps, Jenkins & Jenkins X Tracy Miranda, Director of Open Source Community | CloudBees

GitOps, Jenkins & Jenkins X Tracy Miranda, Director of Open Source Community | CloudBees tmiranda@cloudbees.com | @tracymiranda @tracymiranda What is DevOps? @tracymiranda DevOps is the new legacy @tracymiranda Cloud Native

435 views • 31 slides
Begin by enabling sonarqube functionality from within jenkins plugin manager Sonarqube should be

Begin by enabling sonarqube functionality from within jenkins plugin manager Sonarqube should be

Begin by enabling sonarqube functionality from within jenkins plugin manager Sonarqube should be installed on the same machine as jenkins. Sonarqube could take a few minutes to start. THe default login is admin/admin. We need to create a token

222 views • 10 slides
Building a (resumable and extensible) DSL with Apache Groovy Jesse Glick CloudBees, Inc.

Building a (resumable and extensible) DSL with Apache Groovy Jesse Glick CloudBees, Inc.

Building a (resumable and extensible) DSL with Apache Groovy Jesse Glick CloudBees, Inc. Introduction About Me Longtime Jenkins core contributor Primary developer on Jenkins Pipeline Meet Jenkins Pipeline A new project

518 views • 33 slides
Evolving Technique: Drip, Drip! The CSF Leak in Anterior Spine Surgery Arthur L. Jenkins,

Evolving Technique: Drip, Drip! The CSF Leak in Anterior Spine Surgery Arthur L. Jenkins,

Evolving Technique: Drip, Drip! The CSF Leak in Anterior Spine Surgery Arthur L. Jenkins, III MD FACS Founder, Jenkins NeuroSpine Disclosures: None, other than. I get paid to fix spinal fluid leaks Dr. Dura 180

588 views • 10 slides
Your CI/CD Infrastructure is a Monolith Too @LachlanEvenson Thank You! Joseph Sandoval Michael

Your CI/CD Infrastructure is a Monolith Too @LachlanEvenson Thank You! Joseph Sandoval Michael

Your CI/CD Infrastructure is a Monolith Too @LachlanEvenson Thank You! Joseph Sandoval Michael Tougeron Michael Leong Mark Ward Our Philosophy - Everything-as-Code Jenkins is an app Pipeline-as-Code State of our build infrastructure The

317 views • 7 slides
CI/CD with OpenShift and Jenkins Michal Fojtik < mfojtik@redhat.com > @mfojtik Agenda

CI/CD with OpenShift and Jenkins Michal Fojtik < mfojtik@redhat.com > @mfojtik Agenda

CI/CD with OpenShift and Jenkins Michal Fojtik < mfojtik@redhat.com > @mfojtik Agenda Intro to containers and CI/CD Deploying Jenkins in OpenShift Kubernetes plugin Defining CI/CD workflow Demo! Containers

519 views • 16 slides
World Income Inequality Databases: an assessment of WIID and SWIID Stephen P. Jenkins Email:

World Income Inequality Databases: an assessment of WIID and SWIID Stephen P. Jenkins Email:

1 World Income Inequality Databases: an assessment of WIID and SWIID Stephen P. Jenkins Email: s.jenkins@lse.ac.uk Note. The full paper (long) will be available shortly as a discussion paper in the ISER (U of Essex) and IZA series. This talk

379 views • 17 slides
SCALING JENKINS WITH DOCKER AND APACHE MESOS Carlos Sanchez @csanchez csanchez.org Watch online

SCALING JENKINS WITH DOCKER AND APACHE MESOS Carlos Sanchez @csanchez csanchez.org Watch online

CI AND CD AT SCALE SCALING JENKINS WITH DOCKER AND APACHE MESOS Carlos Sanchez @csanchez csanchez.org Watch online at carlossg.github.io/presentations ABOUT ME Senior Soware Engineer @ CloudBees Contributor to the Jenkins Mesos plugin and

667 views • 63 slides
USA Site Report: DOSAR C.M. Jenkins 9/23/2009 DOSAR Site Report - C M Jenkins 1 Condor Cluster

USA Site Report: DOSAR C.M. Jenkins 9/23/2009 DOSAR Site Report - C M Jenkins 1 Condor Cluster

USA Site Report: DOSAR C.M. Jenkins 9/23/2009 DOSAR Site Report - C M Jenkins 1 Condor Cluster with Colinux Working! First got a mini Condor & Condor/colinux cluster working: Two PCs running Scientific Linux 3.0.9 (Fermi)

399 views • 14 slides
A central database for the Australian Dairy Industry S. Jenkins, T. Francis Speaker: Simon

A central database for the Australian Dairy Industry S. Jenkins, T. Francis Speaker: Simon

A central database for the Australian Dairy Industry S. Jenkins, T. Francis Speaker: Simon Jenkins A Central Database for the Australian Dairy Industry Simon Jenkins (Contributing authors) How Data has been viewed in our Industry The

372 views • 21 slides
RefWorks for Historians Bethan Jenkins & Rachel DArcy -Brown

RefWorks for Historians Bethan Jenkins & Rachel DArcy -Brown

RefWorks for Historians Bethan Jenkins & Rachel DArcy -Brown bethan.jenkins@bodleian.ox.ac.uk rachel.darcy-brown@bodleian.ox.ac.uk Aims of this session To enable you to: Use the basic features of RefWorks; Import references from

771 views • 55 slides
Use Cases for ALTO within CDNs

Use Cases for ALTO within CDNs

Use Cases for ALTO within CDNs dra6-jenkins-alto-cdn-use-cases-01 Ben Niven-Jenkins Grant Watson, Nabil Bitar, Jan Medved, Stevano Previdi,

419 views • 5 slides
Herschel V. Jenkins High School Class of 2021 Junior Parent Information Night February 18,

Herschel V. Jenkins High School Class of 2021 Junior Parent Information Night February 18,

Herschel V. Jenkins High School Class of 2021 Junior Parent Information Night February 18, 2020-6:00pm-Cafetorium jenkins.sccpss.com Alan Berrong Alan.berrong@sccpss.com Guidance 912-395-6999 Ext 729403 9 th Grade A-Z Theresa Horace

705 views • 31 slides
MakeCode: Types, Games, and Machine Code Micha Moskal Microsoft Research Redmond Joint work

MakeCode: Types, Games, and Machine Code Micha Moskal Microsoft Research Redmond Joint work

MakeCode: Types, Games, and Machine Code Micha Moskal Microsoft Research Redmond Joint work with: Thomas Ball, Peli de Halleux, Abhijith Chatra, James Devine, Sam El-Husseini, Joe Finney, Caitlin Hennessy, Steve Hodges, Guillaume Jenkins,

620 views • 36 slides
Jenkins Continuous Build System Jesse Bowes CSCI-5828 Spring 2012 Executive summary

Jenkins Continuous Build System Jesse Bowes CSCI-5828 Spring 2012 Executive summary

Jenkins Continuous Build System Jesse Bowes CSCI-5828 Spring 2012 Executive summary Continuous integration systems are a vital part of any Agile team because they help enforce the ideals of Agile development Jenkins, a continuous

564 views • 31 slides
Algebraic Structure of Lepton and Quark Flavor Invariants Elizabeth Jenkins Department of

Algebraic Structure of Lepton and Quark Flavor Invariants Elizabeth Jenkins Department of

Algebraic Structure of Lepton and Quark Flavor Invariants Elizabeth Jenkins Department of Physics University of California, San Diego GGI, Firenze, July 5, 2012 E. Jenkins Algebraic Structure of Lepton and Quark Flavor Invariants

546 views • 41 slides
Does your Jenkins speak Gerrit? Functional testing for your pipelines, JobDSL and more Szymon

Does your Jenkins speak Gerrit? Functional testing for your pipelines, JobDSL and more Szymon

Does your Jenkins speak Gerrit? Functional testing for your pipelines, JobDSL and more Szymon Datko Roman Dobosz szymon.datko@corp.ovh.com rdobosz@redhat.com 5th November 2019 Sz. Datko, R. Dobosz Does your Jenkins speak Gerrit? - Functional

537 views • 27 slides

More recommend