You build it, you run it Matthias Rampke, SoundCloud You build it, - PowerPoint PPT Presentation

Sep 30, 2022 •242 likes •583 views

You build it, you run it Matthias Rampke, SoundCloud You build it, you run it Operating SoundCloud's microservice architecture GOTO Berlin 2016 Intro: me Who I am and where I work Engineer in Production Engineering (platform, monitoring,

You build it, you run it Matthias Rampke, SoundCloud
You build it, you run it Operating SoundCloud's microservice architecture GOTO Berlin 2016
Intro: me Who I am and where I work Engineer in Production Engineering (platform, monitoring, availability) previously in Systems Engineering (ops remnant catch-all)
Intro: SoundCloud Who I am and where I work a cloud full of sounds 135M tracks, 12M artists, 175M listeners 300+ employees no ops team
Intro: Agenda Where we came from Where we are today Why we did it How you can do it How does this compare to…?
⋁ Where we came from ⋁
In the beginning … the early days One team One table One codebase
2009/2010 growing pains 20-50 engineers hired an ops team, 24/7 on-call app team deploys the monolith first separate "micro"services
2011/2012 the fork in the road more microservices deployment platform SRE/platforms team multiple on-call rotations
2013-2015 maturing cambrian explosion of microservices feature teams and collectives client specific APIs shared components & libraries continuous delivery
⋁ Where we are today ⋁
Org chart simplified
Ownership You buildown it, you run it every feature • service • codebase is owned by a team
On Call owners are on call for what they own groups of teams work together to reduce load remove alerts • write documentation
Shared Components avoid shared infrastructure be flexible don't duplicate work
Production Engineering run the systems that run systems monitoring & availability internal consulting
⋁ Why we did it ⋁
Delivery get more done, consistently autonomy predictability velocity
Personal growth learn something new every day no pure specialists internal mobility
Better systems simple resilient operable
⋁ How you can do it ⋁
Prerequisites basic automation openness pride trust
Expanding ownership testing & deployment on-call provisioning dependencies
Checks & Balances internal moves escalation paths documentation tooling
Postmortems learn improve commiserate
⋁ How does this compare to …? ⋁
Site Reliability Engineering as Google describes it no assignment to SWE teams no on-call handoff no deploy blocks
Radical agility as Zalando describe it more shared code more communication infrastructure & core teams
DevOps as described by Etsy no Ops team less shared infrastructure less standardization deploys spread in a different dimension
Slides: https://bit.ly/gotober16-sc Please rate! . soundcloud.com Berlin New York San Francisco London

Recommend

self build housing Ted Stevens NaSBA Chair What is Self/Custom Build? Who does it/what is

New ways of delivering self build housing Ted Stevens NaSBA Chair What is Self/Custom Build? Who does it/what is changing? The New Self Build Policy Why Support Self Build? The Self Build Revolution so Far Some Case Studies What is Self

960 views • 56 slides

Build-Finance or Design-Build-Finance Transportation Projects Types of P3s Design-Build (DB)

Build-Finance or Design-Build-Finance Transportation Projects Types of P3s Design-Build (DB) D B Asset Management Contract R M Design-Build-Finance (DBF) F Design-Build-Operate-Maintain (DBOM) Increasing Private Sector Role

218 views • 19 slides

Build Build Build Build System building The process of compiling and linking software

Build Build Build Build System building The process of compiling and linking software components into an executable system Different systems are built from different combinations of components Invariably supported by automated

557 views • 20 slides

Build it, Break it, Fix it Build-it Lecture Prof. Eric Bodden Build It, Break It, Fix It SS

Build it, Break it, Fix it Build-it Lecture Prof. Eric Bodden Build It, Break It, Fix It SS 17 Today Introduction n Theoretical Part: How to Build Secure Software n Brief Problem Overview n Setup HowTo for Phase I n 2 Prof. Eric

610 views • 50 slides

Heapsort Build-Max-Heap Next we build a full heap from an unsorted sequence Build-Max-Heap(A)

Heapsort Build-Max-Heap Next we build a full heap from an unsorted sequence Build-Max-Heap(A) for i = floor( A.length/2 ) to 1 Max-Heapify(A, i) Build-Max-Heap Red part is already Heapified Build-Max-Heap Correctness: Base: Each alone

429 views • 23 slides

Best Practices and lessons learned about the Design Build process 2 3 Includes the

Design Build versus the traditional Design Bid Build process The benefits of using the Design Build process Maximizing DBE Program participation under the Design Build process Required special provisions and DBE goal setting

460 views • 35 slides

BUILD BUILD BUILD Nigerias Infrastructure Space Opportunities & Challenges PRESENTATION

BUILD BUILD BUILD Nigerias Infrastructure Space Opportunities & Challenges PRESENTATION BY THE INFRASTRUCTURE CONCESSION REGULATORY COMMISSION AT THE 1ST ISTANBUL PPP WEEK, 2015. ISTANBUL, TURKEY Engr. Chidi Izuwah Ag. DIRECTOR

774 views • 46 slides

Can we build a complete set of tools ? RT Can we build a complete set of tools ? RT Spectra,

Can we build a complete set of tools ? RT Can we build a complete set of tools ? RT Spectra, Images Channel maps Interfero: nIR + mm (CASA) SEDs Herschel, ALMA, PIONIER/Gravity, JWST, SPICA ALMA, SPHERE/GPI Can we build a

756 views • 28 slides

Media actions to increase the visibility of BUILD UP and its Partners Gilles VAILLE BUILD UP

Media actions to increase the visibility of BUILD UP and its Partners Gilles VAILLE BUILD UP Users and Stakeholders Committee Brussels, 25 June 2010 BUILD UP Public Relations Desk Table of contents Webvertising actions Promotional

403 views • 16 slides

Build Engineering Build Engineering Evolution in Managing OS Pete Garcin , Senior Product

Build Engineering Build Engineering Evolution in Managing OS Pete Garcin , Senior Product Manager, ActiveState Shaun Lowry , Build Engineering Lead, ActiveState Build Engineering and its Role in Managing Open Source Build Engineering

688 views • 36 slides

We cant always build the fvture for our youth, but we can build our youth for the fvture.

We cant always build the fvture for our youth, but we can build our youth for the fvture. - Franklin D. Roosevelt Student Interest in AT/PT TOP 10 CAREER CHOICET FOR GENERATION Z As a society, we must take the question of, What

483 views • 35 slides

Design-Build Presentation Objectives- Why Design-Build? What is the rush? What is the

22420 US 550-US160 Connection South Design-Build Presentation Objectives- Why Design-Build? What is the rush? What is the Difference How does that affect How I contribute My insurance Methods of Project Delivery CDOTs

321 views • 20 slides

WE BUILD & WEB APP We build elegant and functional solutions We deliver apps essentials at

WE BUILD & WEB APP We build elegant and functional solutions We deliver apps essentials at your fjnger using Ruby on Rails, node.js, Angular JS and tips. Functional, fmawless and easy to use. more. SEO APP We build elegant and

410 views • 10 slides

Build a Geant4 application Geant4 tutorial Application build process 1) Properly organize your

JUNO GEANT4 SCHOOL Beijing ( ) 15-19 May 2017 Build a Geant4 application Geant4 tutorial Application build process 1) Properly organize your code into directories 2) Prepare a CMakeLists.txt file 3) Create a build directory and run

384 views • 10 slides

ABF as a Development Framework with ARM-powered Build Nodes by the example of OpenMandriva

ABF as a Development Framework with ARM-powered Build Nodes by the example of OpenMandriva 2014.0 / Cooker armv7hl Alexander Khryukin (OpenMandriva) ABF - Automated Build Farm Main purposes: Build packages and ISO images for various

172 views • 13 slides

Validate Configuration against Build Artifacts: An Essential Step for your Build Process by

Validate Configuration against Build Artifacts: An Essential Step for your Build Process by Harold Fortuin, Ph.D. Principal Software Engineer Fortuitous Consulting Services, Inc. JavaEE projects rely on (XML) config files which reference

609 views • 28 slides

WELCOME BUILD APPS & EXTEND DREAM IT THEN BUILD IT ON DOMO Trevor Tingey Chris Jones

WELCOME BUILD APPS & EXTEND DREAM IT THEN BUILD IT ON DOMO Trevor Tingey Chris Jones Director of Engineering Co-founder, Chief Solutions Guru Domo, App Platform Data JoNZ 3 DREAM IT, THEN BUILD IT ON DOMO. St Store 4 A FOCUS ON

854 views • 38 slides

Industrialisation of applications build in embedded environment How to build AGL (Automotive

Industrialisation of applications build in embedded environment How to build AGL (Automotive Grade Linux) applications with Jenkins pipeline and X(cross) Development System (XDS)? AMM Feb/2018 Frederic Marec Embedded Engineer

508 views • 25 slides

DESIGN BID BUILD CSD HDR Contractor Sub Sub Sub DESIGN-BID-BUILD Most common approach in

DESIGN BID BUILD CSD HDR Contractor Sub Sub Sub DESIGN-BID-BUILD Most common approach in the US Entirely sequential Can be single-prime or multi-prime District holds all contracts Cost is the only criteria for selection

286 views • 16 slides

CPSC 102 Build Tools Z A IN R IZ V I What Are Build Tools? Automate the compiling of

CPSC 102 Build Tools Z A IN R IZ V I What Are Build Tools? Automate the compiling of executable applications from source code. Why is this important? Compilation Order Computer Scientists are lazy 1 2 3 4 Specify the order in

481 views • 8 slides

Java build system by Zoltn Jakab zoltan.jakab@ericsson.com Contents Build a Java program

Java build system by Zoltn Jakab zoltan.jakab@ericsson.com Contents Build a Java program Ant Concept Language elements Reuse and extension Other Java build tools Hello world package demo; public class HelloWorld {

798 views • 50 slides

Opportunities offered by the BUILD UP interactive web portal Timothe Nol BUILD UP Users and

Opportunities offered by the BUILD UP interactive web portal Timothe Nol BUILD UP Users and Stakeholders Committee Brussels, 15 December 2009 Project Officer EACI Unit 2 Energy Efficiency Goals Improve the energy performance of

338 views • 6 slides

Where we're at: Syntax analysis of VSL Things needed to Submit homework (pdfs and

Where we're at: Syntax analysis of VSL Things needed to Submit homework (pdfs and tarballs) Build programs (make, cc) Build scanners (Lex/flex) Build parsers (Yacc/bison) Build symbol tables (hashtables/libghthash)

588 views • 25 slides

Emer Emerging ging Tec echnologies hnologies in in Design Design-Build Build And How Can

Emer Emerging ging Tec echnologies hnologies in in Design Design-Build Build And How Can They Help You?. . . Moderator: Jim Haughey , PE, LEED AP Vice President Michael Baker International Presenters: Casey Mahon , AIA Digital

715 views • 32 slides