Architecting for High Availability Attila Narin AWS Solutions - PowerPoint PPT Presentation

Architecting for High Availability Attila Narin AWS Solutions Architecture QCon London, March 2013 Session Feedback ID 1927

1. DESIGN FOR FAILURE 2. MULTIPLE AVAILABILITY ZONES 3. SCALING 4. SELF-HEALING 5. LOOSE COUPLING

LET’S BUILD A SYSTEM

HIGHLY AVAILABLE LET’S BUILD A SYSTEM

AWS BUILDING BLOCKS Inherently Highly Available Highly Available with and Fault Tolerant Services the right architecture  Amazon S3  Amazon SQS Amazon EC2    Amazon Amazon SNS Amazon EBS  DynamoDB  Amazon SES Amazon RDS   Amazon  Amazon SWF Amazon VPC CloudFront   …  Amazon Route53  Elastic Load Balancing

DESIGN FOR FAILURE ●○○○○ #

« Everything fails all the time » Werner Vogels CTO of Amazon

AVOID SINGLE POINTS OF FAILURE

AVOID SINGLE POINTS OF FAILURE ASSUME EVERYTHING FAILS, AND WORK BACKWARDS

YOUR GOAL Applications should continue to function

AMAZON EBS ELASTIC BLOCK STORE

AMAZON ELB ELASTIC LOAD BALANCING

HEALTH CHECKS

AVAILABILITY MULTIPLE ZONES ●●○○○ #

AVAILABILITY ZONES

US-WEST (N. California) EU-WEST (Ireland) GOV CLOUD ASIA PAC (Tokyo) US-EAST (Virginia) ASIA PAC (Sidney) US-WEST (Oregon) ASIA PAC (Singapore) SOUTH AMERICA (Sao Paulo)

AMAZON RDS MULTI-AZ

AMAZON ELB AND MULTIPLE AZs

SCALING ●●●○○ #

AUTO SCALING SCALE UP/DOWN EC2 CAPACITY

UNEXPECTED SPIKES

EXPECTED SPIKES

DATA TIER

AMAZON S3 SIMPLE STORAGE SERVICE

99.999999999 % DURABILITY

SCALABLE & AVAILABLE NO CAPACITY PLANNING REQUIRED

ZERO ADMINISTRATION

AMAZON DYNAMODB HIGH-PERFORMANCE, FULLY MANAGED NoSQL DATABASE SERVICE

LOW LATENCY AVERAGE READS < 5 MS , WRITES < 10 MS

PREDICTABLE PERFORMANCE PROVISIONES THROUGHPUT

SEAMLESS SCALABILITY LIVE REPARTITIONING

ZERO ADMINISTRATION

SELF-HEALING ●●●●○ #

HEALTH CHECKS + AUTO SCALING

HEALTH CHECKS + AUTO SCALING = SELF- HEALING

DEGRADED MODE

AMAZON S3 STATIC WEBSITE + AMAZON ROUTE53 WEIGHTED RESOLUTION

COUPLING LOOSE ●●●●● #

BUILD LOOSELY COUPLED SYSTEMS The looser they are coupled, the bigger they scale, the more fault tolerant they get…

AMAZON SQS SIMPLE QUEUE SERVICE

PUBLISH RECEIVE TRANSCODE & NOTIFY

Architecting for High Availability Attila Narin AWS Solutions - PowerPoint PPT Presentation

Architecting for High Availability Attila Narin AWS Solutions Architecture QCon London, March 2013 Session Feedback ID 1927 1. DESIGN FOR FAILURE 2. MULTIPLE AVAILABILITY ZONES 3. SCALING 4. SELF-HEALING 5. LOOSE COUPLING LETS BUILD A SYSTEM

for High Availability Martin Thompson - @mjpt777 What Is High Availability ?

Chapter 4: Implementing High Availability and Redundancy in a Campus Network CCNP-RS SWITCH

Architecting HBM as a High Bandwidth, High Capacity, Self-Managed Last-Level Cache Tyler

High Availability and Automatic Failover in PostgreSQL Using Open Source Solutions Avinash

Drupal High Availability High Performance Samstag, 3. November 12 Drupal High Availability

High Availability High Performance How to sleep without the server-crash-fear Michael Schmid

High Availability using virtualization Federico Calzolari Scuola Normale Superiore - INFN Pisa

Virtualization and High Availability Mika Karlstedt AMICT'08 May 2008 Faculty of Science

Microsoft Azure and SUSE High Availability TUT1134 When Availability Matters Mark Gonnelly

Storage agnostic end to end storage information for long distance high availability Vijay Kumar

A MAZON S3 Simple storage service Launched: March 14, 2006 Simple key/value storage

High Availability with the openais project Prepared by: Steven Dake 7/12/05 Agenda Service

MySQL High Availability Solutions Alex Poritskiy Percona The Five 9s of Availability

Artifactory High Availability By Rajesh Kumar From version 3.1, Artifactory supports a High

Contents Introduction Basic Model High Availability, Scalable Storage, Availability

High Availability with a minimal Cluster 29. October 2009 Thorsten Frauf Availability

High availability and analysis of PostgreSQL Sergey Kalinin 18-19 of April 2012, dCache

ProxySQL Tutorial High Performance & High Availability Proxy for MySQL With a GPL license!

High-speed Checkpointing for High Availability Brendan Cully brendan@cs.ubc.ca Department of

Building a Lightweight High Availability Cluster Using RepMgr Stephan M uller June 29, 2018

ProxySQL Tutorial High Performance & High Availability Proxy for MySQL With a GPL license!

High Availability with the openais project Prepared by: Steven Dake October 2005 Agenda

Evolve or Die High-Availability Design Principles Drawn from Googles Network Infrastructure

Symmetric Active/Active High Availability for High-Performance Computing System Services:

Architecting for High Availability Attila Narin AWS Solutions - PowerPoint PPT Presentation

Architecting for High Availability Attila Narin AWS Solutions Architecture QCon London, March 2013 Session Feedback ID 1927 1. DESIGN FOR FAILURE 2. MULTIPLE AVAILABILITY ZONES 3. SCALING 4. SELF-HEALING 5. LOOSE COUPLING LETS BUILD A SYSTEM

for High Availability Martin Thompson - @mjpt777 What Is High Availability ?

Chapter 4: Implementing High Availability and Redundancy in a Campus Network CCNP-RS SWITCH

Architecting HBM as a High Bandwidth, High Capacity, Self-Managed Last-Level Cache Tyler

High Availability and Automatic Failover in PostgreSQL Using Open Source Solutions Avinash

Drupal High Availability High Performance Samstag, 3. November 12 Drupal High Availability

High Availability High Performance How to sleep without the server-crash-fear Michael Schmid

High Availability using virtualization Federico Calzolari Scuola Normale Superiore - INFN Pisa

Virtualization and High Availability Mika Karlstedt AMICT'08 May 2008 Faculty of Science

Microsoft Azure and SUSE High Availability TUT1134 When Availability Matters Mark Gonnelly

Storage agnostic end to end storage information for long distance high availability Vijay Kumar

A MAZON S3 Simple storage service Launched: March 14, 2006 Simple key/value storage

High Availability with the openais project Prepared by: Steven Dake 7/12/05 Agenda Service

MySQL High Availability Solutions Alex Poritskiy Percona The Five 9s of Availability

Artifactory High Availability By Rajesh Kumar From version 3.1, Artifactory supports a High

Contents Introduction Basic Model High Availability, Scalable Storage, Availability

High Availability with a minimal Cluster 29. October 2009 Thorsten Frauf Availability

High availability and analysis of PostgreSQL Sergey Kalinin 18-19 of April 2012, dCache

ProxySQL Tutorial High Performance &amp; High Availability Proxy for MySQL With a GPL license!

High-speed Checkpointing for High Availability Brendan Cully brendan@cs.ubc.ca Department of

Building a Lightweight High Availability Cluster Using RepMgr Stephan M uller June 29, 2018

ProxySQL Tutorial High Performance &amp; High Availability Proxy for MySQL With a GPL license!

High Availability with the openais project Prepared by: Steven Dake October 2005 Agenda

Evolve or Die High-Availability Design Principles Drawn from Googles Network Infrastructure

Symmetric Active/Active High Availability for High-Performance Computing System Services:

ProxySQL Tutorial High Performance & High Availability Proxy for MySQL With a GPL license!

ProxySQL Tutorial High Performance & High Availability Proxy for MySQL With a GPL license!