Cost-Benefit Analysis of Cloud Computing versus Desktop Grids - PowerPoint PPT Presentation

Cost-Benefit Analysis of Cloud Computing versus Desktop Grids Derrick Kondo, Bahman Javadi, Paul Malécot, Franck Cappello INRIA, France David P. Anderson UC Berkeley, USA

Cloud Background • Vision • Hide complexity of hardware and software management from a user by offering computing as a service • Benefits • Pay as you go • Scale up or down dynamically • No hardware management, less software management

Platform Performance vs. Costs high Cost low low high Performance

Platform Performance vs. Costs high Supercomputer Grid Cluster Cost low low high Performance

Platform Performance vs. Costs high Supercomputer Grid Cluster Cost Desktop Grids (DG) low low high Performance

Platform Performance vs. Costs high Supercomputer Grid Cluster Cost What is the relationship? Cloud Desktop Grids (DG) low low high Performance

Platform Performance vs. Costs high Supercomputer Grid Cluster Cost What is the relationship? Cloud Desktop Grids (DG) low DG + Cloud? low high Performance

Outline • Performance tradeoffs • Monetary tradeoffs • Client hosting • Server hosting

Apples to Apples Loosely-coupled, Tightly-coupled, high-throughput, data-intensive compute-intensive applications real-time applications low complexity high complexity

Apples to Apples Loosely-coupled, Tightly-coupled, high-throughput, data-intensive compute-intensive applications real-time applications low complexity high complexity DG’s

Apples to Apples Loosely-coupled, Tightly-coupled, high-throughput, data-intensive compute-intensive applications real-time applications low complexity high complexity DG’s Clouds

Apples to Apples Loosely-coupled, Tightly-coupled, high-throughput, data-intensive compute-intensive applications real-time applications low complexity high complexity DG’s Clouds Comparison assuming embarrassingly parallel, compute-intensive applications

Method • Use real performance measurements • Exported BOINC (middleware for desktop grids) project data • Use real costs • Large/small BOINC projects (SETI@home / XtremLab) • Amazon Elastic Computing Cloud (EC2)

Stages of Project & Application Platform Construction

Stages of Project & Application Platform Application Construction Deployment

Stages of Project & Application Platform Application Application Construction Deployment Execution

Stages of Project & Application Platform Application Application Application Construction Deployment Execution Completion

Platform Application Application Application Construction Deployment Execution Completion How long before I get X TeraFLOPS?

Platform Application Application Application Construction Deployment Execution Completion How long before I 6 10 3 10 get X TeraFLOPS? Number of cloud nodes 5 10 2 10 TeraFLOPS 4 10 1 10 3 10 0 0 5 5 10 10 15 15 20 20 25 25 30 30 Months for registration

Platform Application Application Application Construction Deployment Execution Completion How long before I 6 10 3 10 get X TeraFLOPS? Can get over 20 TeraFLOPS within 6 months Number of cloud nodes 5 10 2 10 TeraFLOPS 4 10 1 10 3 10 0 0 5 5 10 10 15 15 20 20 25 25 30 30 Months for registration

Platform Application Application Application Construction Deployment Execution Completion How long before I 6 10 3 10 get X TeraFLOPS? Can get over 20 TeraFLOPS within 6 months Number of cloud nodes 5 10 2 10 TeraFLOPS Strategy: Add to BOINC project list 4 10 1 10 Press releases Forum Announcements 3 10 Google Ad Sense 0 0 5 5 10 10 15 15 20 20 25 25 30 30 Months for registration Respond to users (leverage volunteers)

Platform Application Application Application Construction Deployment Execution Completion How long to deploy my batch of tasks needing faster response time?

Platform Application Application Application Construction Deployment Execution Completion How long to deploy . my batch of tasks ' !" needing 7,82/9*,34.4:*,.;*:3)4,6< & faster response time? !" ! !" " !" !"".4=6>6 !""".4=6>6 ! ! !" !"""".4=6>6 . # $ % !" !" !" ()*+,-./0.1/2)34,,-.3/5,6

Platform Application Application Application Construction Deployment Execution Completion How long to deploy . For 1000 tasks, my batch of tasks ' !" ~10 minutes with 10 5 hosts needing 7,82/9*,34.4:*,.;*:3)4,6< & faster response time? !" ! !" " !" !"".4=6>6 !""".4=6>6 ! ! !" !"""".4=6>6 . # $ % !" !" !" ()*+,-./0.1/2)34,,-.3/5,6

Platform Application Application Application Construction Deployment Execution Completion How long to deploy . For 1000 tasks, my batch of tasks ' !" ~10 minutes with 10 5 hosts needing 7,82/9*,34.4:*,.;*:3)4,6< & faster response time? !" ! !" Strategy: " Specify lower !" !"".4=6>6 latency bounds !""".4=6>6 ! ! !" !"""".4=6>6 . [Heien et al.] # $ % !" !" !" ()*+,-./0.1/2)34,,-.3/5,6

Platform Application Application Application Construction Deployment Execution Completion

Platform Application Application Application Construction Deployment Execution Completion How many volunteer nodes are equivalent to 1 cloud node?

Platform Application Application Application Construction Deployment Execution Completion How many volunteer nodes are equivalent to 1 cloud node?

Platform Application Application Application Construction Deployment Execution Completion How many volunteer nodes 2.8 active volunteer hosts are equivalent to 1 per 1 cloud node. cloud node? (Total performance still orders of magnitude better)

Platform Application Application Application Construction Deployment Execution Completion How many volunteer nodes 2.8 active volunteer hosts are equivalent to 1 per 1 cloud node. cloud node? (Total performance still orders of magnitude better) Strategy: Use statistical prediction of availability

Platform Application Application Application Construction Deployment Execution Completion

Platform Application Application Application Construction Deployment Execution Completion How long should I wait for task completion?

Platform Application Application Application Construction Deployment Execution Completion How long should I wait for task completion?

Platform Application Application Application Construction Deployment Execution Completion How long should I wait for task Median project latency bound: 9 days completion? for 3.7 hour work unit (on 3GHz host). Ratio of lat. bound / exec time > 5. Good success rates: 96.1% of WCG tasks met out of 227,000 tasks

Platform Application Application Application Construction Deployment Execution Completion How long should I wait for task Median project latency bound: 9 days completion? for 3.7 hour work unit (on 3GHz host). Ratio of lat. bound / exec time > 5. Good success rates: 96.1% of WCG tasks met out of 227,000 tasks Strategy: See BOINC Catalog for typical deadlines and compute/comm/mem ratios.

Monetary Tradeoffs • Client hosting on cloud • Not worth it and never will • Server hosting on the cloud • Possible solution

Monthly Project Costs

EC2 Pricing

What about Client Hosting on the Cloud?

Cost of Clouds versus DG How long until DG’s more cost effective than Clouds?

Cost of Clouds versus DG ! ## #! / =.),>;0? @ABCDE*>, A7$ ! #$ How long #! F#'!'/G*HI8.,,)/8*3,5 2'J&/-H*I3/8*3,56 until DG’s 7,8./9,)/:;<( '"&$/G*HI8.,,)/8*3,5 ! #% #! more cost 2#&#$/-H*I3/8*3,56 effective than ! #' #! Clouds? ! #" #! ! #& #! / ! " #! #" $! $" %! ()*+,-./01,/230456

Cost of Clouds versus DG ! ## #! / =.),>;0? @ABCDE*>, A7$ ! #$ How long #! F#'!'/G*HI8.,,)/8*3,5 2'J&/-H*I3/8*3,56 until DG’s 7,8./9,)/:;<( '"&$/G*HI8.,,)/8*3,5 ! #% #! more cost 2#&#$/-H*I3/8*3,56 effective than ! #' #! Clouds? ! #" #! After ~13 days ! #& #! / ! " #! #" $! $" %! ()*+,-./01,/230456

Cost of Clouds versus DG (2) What are total costs over time?

Cost of Clouds versus DG (2) 4 8 x 10 What are 7 total costs 6 over time? 5 Total cost 4 EC2 100n 3 EC2 1000n EC2 10000n 2 XtremLab SETI@home 1 0 0 5 10 15 20 Platform age (days)

Cost of Clouds versus DG (2) 4 8 x 10 What are After 3 days, DG 7 total costs is cheaper 6 over time? 5 Total cost 4 EC2 100n 3 EC2 1000n EC2 10000n 2 XtremLab SETI@home 1 0 0 5 10 15 20 Platform age (days)

Cost of Clouds versus DG (3) How many months of DG can X months of Cloud buy me?