How SoundCloud scales Alexander Grosse @klangberater Freitag, 5. - PowerPoint PPT Presentation

How SoundCloud scales Alexander Grosse @klangberater Freitag, 5. April 13

“Youtube for Audio” Freitag, 5. April 13

Fakten Freitag, 5. April 13

Fakten • Alexa Ranking (233) Freitag, 5. April 13

Fakten • Alexa Ranking (233) • Employees (190) - 80 engineers Freitag, 5. April 13

Fakten • Alexa Ranking (233) • Employees (190) - 80 engineers • 4 office locations (Berlin, London, San Francisco, Sofia) Freitag, 5. April 13

Fakten • Alexa Ranking (233) • Employees (190) - 80 engineers • 4 office locations (Berlin, London, San Francisco, Sofia) • >35 million registered users Freitag, 5. April 13

Fakten • Alexa Ranking (233) • Employees (190) - 80 engineers • 4 office locations (Berlin, London, San Francisco, Sofia) • >35 million registered users • partners (BBC, CNN) Freitag, 5. April 13

Fakten • Alexa Ranking (233) • Employees (190) - 80 engineers • 4 office locations (Berlin, London, San Francisco, Sofia) • >35 million registered users • partners (BBC, CNN) • > 10.000 Apps Freitag, 5. April 13

Freitag, 5. April 13

How SoundCloud scales Freitag, 5. April 13

? Freitag, 5. April 13

Organization Technology Freitag, 5. April 13

What is the foundation? Freitag, 5. April 13

Freitag, 5. April 13

Principles Freitag, 5. April 13

Principles Top-Down vs. Bottom-Up Freitag, 5. April 13

Principles Top-Down vs. Bottom-Up Trust Freitag, 5. April 13

Principles Top-Down vs. Bottom-Up Trust How to react to mistakes Freitag, 5. April 13

Principles Top-Down vs. Bottom-Up Trust How to react to mistakes Continuous Improvement Freitag, 5. April 13

Principles Top-Down vs. Bottom-Up Trust How to react to mistakes Continuous Improvement Innovation Freitag, 5. April 13

Top-Down vs. Bottom-Up • Flat Hierarchies? Everybody has them... • Engineering teams responsible for architecture (not architecture teams) • Influence on the product Freitag, 5. April 13

Trust • Deployment • Change Management • Process • Time for “technical debt” Freitag, 5. April 13

Reaction to mistakes • What will be changed if a mistake happens? Freitag, 5. April 13

Innovation • R&D Department? • Only Product? Freitag, 5. April 13

SoundCloud‘s basic principles Freitag, 5. April 13

SoundCloud‘s basic principles • No dedicated QA roles Freitag, 5. April 13

SoundCloud‘s basic principles • No dedicated QA roles • “You build it - you run it” Freitag, 5. April 13

SoundCloud‘s basic principles • No dedicated QA roles • “You build it - you run it” • Team Building (Rotation, constant changes) Freitag, 5. April 13

SoundCloud‘s basic principles • No dedicated QA roles • “You build it - you run it” • Team Building (Rotation, constant changes) • Hacker Time Freitag, 5. April 13

SoundCloud‘s basic principles • No dedicated QA roles • “You build it - you run it” • Team Building (Rotation, constant changes) • Hacker Time • Continuous Improvement Freitag, 5. April 13

SoundCloud‘s basic principles • No dedicated QA roles • “You build it - you run it” • Team Building (Rotation, constant changes) • Hacker Time • Continuous Improvement • Move fast and break things Freitag, 5. April 13

No QA Does that mean we don‘t test? Freitag, 5. April 13

“You build it - you run it” Freitag, 5. April 13

Flat Hierarchy Freitag, 5. April 13

Innovation Hacker Time Freitag, 5. April 13

Freitag, 5. April 13

Continuous Improvement Retrospectives Post Mortems (Projekte) Freitag, 5. April 13

Mistakes... Freitag, 5. April 13

Scrum? Kanban? Process? Freitag, 5. April 13

What is the most important thing you have to do so that this works? Freitag, 5. April 13

Freitag, 5. April 13

??? Freitag, 5. April 13

??? Initial Culture Freitag, 5. April 13

??? Initial Culture Hiring!!! Freitag, 5. April 13

Freitag, 5. April 13

SoundCloud Hiring Process Freitag, 5. April 13

How does it look like in reality? Freitag, 5. April 13

Organisation Freitag, 5. April 13

HTML5 Mobile (native) other V1 API Search T&S Payment Partner Tools Data Activ. Delivery Platform System Engineering (Berlin / SF) Freitag, 5. April 13

How do we structure teams? cross functional? Freitag, 5. April 13

Do teams stay the same? Change! Freitag, 5. April 13

Technology Freitag, 5. April 13

Ruby/Scala/Go/Clojure/ Javascript Freitag, 5. April 13

Scale Horizontally/ Vertically? Freitag, 5. April 13

Rails->Mysql RabbitMQ->Cassandra http://backstage.soundcloud.com/2012/08/ evolution-of-soundclouds-architecture/ Freitag, 5. April 13

MySQL • 7 Master, 9 slaves, 900GB data • Additional slaves in EC2 • Master Peak is 15K IOPS writes, 45k reads • one slave lags intentionally 1 hour behind • Je nach Konsistenzanforderung wird Slave oder Master gewählt (für reads - unterstützt read-only mode) Freitag, 5. April 13

Cassandra • 3 Cluster • 88 Nodes • 15 TB of data • up to 70K reads/sec Freitag, 5. April 13

Hadoop Elastic Search Proprietary Spam Detection Freitag, 5. April 13

ElasticSearch 80 Mio Docs (gaining 1 Mio every 6 days) 175 QPS (gaining 15 QPS every month) Freitag, 5. April 13

Hosted in S3/EC2 and physical DCs Freitag, 5. April 13

Outages Freitag, 5. April 13

Freitag, 5. April 13

Post Mortems Freitag, 5. April 13

Summary • Move fast and break things • Don‘t get slow because you fear to make mistakes Freitag, 5. April 13

backstage.soundcloud.com Freitag, 5. April 13

Alexander Grosse alexandergrosse.com @klangberater We are hiring! www.soundcloud.com/jobs Freitag, 5. April 13