lecture 21 grids and clouds
play

Lecture 21: Grids and Clouds David Bindel 11 Nov 2011 Logistics - PowerPoint PPT Presentation

Jul 28, 2023 •141 likes •294 views

Lecture 21: Grids and Clouds David Bindel 11 Nov 2011 Logistics Project 3 due Monday at midnight I will be traveling Sunday ask questions soon! Final project: 12/1: Short presentation 12/16: Final reports Today: Joint

  1. Lecture 21: Grids and Clouds David Bindel 11 Nov 2011

  2. Logistics ◮ Project 3 due Monday at midnight ◮ I will be traveling Sunday – ask questions soon! ◮ Final project: 12/1: Short presentation 12/16: Final reports ◮ Today: Joint presentation with Tao Zao

  3. Project 3 comments ◮ Second MPI implementation should be memory scalable! ◮ May want to think about how to do initialization... ◮ 1D ring doesn’t save on communication volume ◮ 2D layout would be better – see dense LA lecture ◮ But this exercises what I want you to learn! ◮ And you overlap communication with computation ◮ Be careful to communicate about termination! ◮ MPI_Allreduce works...

  4. Grids http://en.wikipedia.org/wiki/File: Electric_transmission_lines.jpg

  5. Clouds http://en.wikipedia.org/wiki/File:Cloud_in_nepal.jpg

  6. Portals http://en.wikipedia.org/wiki/File: Portal_standalonebox.jpg

  7. Watch out, little guy!

  8. Utility computing Names change, but the concept is attractive: ◮ Flexible access to compute time and data storage ◮ Maybe not in a single administrative domain ◮ Using simple, standardized interface ◮ Maybe with nice high-level interfaces

  9. Cycle scavenging ◮ Condor project (1988-present) ◮ Idea: Use idle cycles on networked computers ◮ Support for transparent checkpointing and migration ◮ Now managing EC2 Spot Instances! ◮ Volunteer computing ◮ SETI@Home (1999-present) ◮ Folding@Home (2000-present) ◮ BOINC (2003-present) ◮ Good for high throughput in embarrassingly parallel settings ◮ Not so good for solving PDEs...

  10. Globus (1996-present) Dream: uniform access to distributed ◮ Compute power ◮ Data storage ◮ Data sources (satellites, instruments, etc) Used by Teragrid / XSEDE. Some components: ◮ Grid Security Interface (GSI) ◮ Grid Resource Allocation and Management (GRAM) ◮ MPIg (aka MPICH-G4)

  11. Gateways / portals Remote access interfaces (often via web) to science-specific tools: ◮ XSEDE (NSF) lists several ◮ hpc2 (NYSTAR – NY state) hosts several ◮ Nanohub hosts several ◮ NERSC hosts several ◮ ...

  12. M&MEMS: A personal recollection (2000)

  13. Cloudy prospects Why not run lots of HPC on EC2? ◮ Have to start worrying about individual node failures ◮ Will be a worry for anyone if we succeed at exascale... ◮ Communication costs are a killer Partial solutions: ◮ Better algorithms (communication avoiding) ◮ New programming frameworks?

  14. “Mid-range” computing on clouds http://www.nersc.gov/assets/StaffPresentations/2011/ MoabCon-Canon-Cloud-presented.pdf Paper: www.lbl.gov/cs/CSnews/cloudcomBP.pdf

Recommend

Advanced 3D segmentation Sigmund Rolfsjord Todays lecture Different ways to work with 3D

Advanced 3D segmentation Sigmund Rolfsjord Todays lecture Different ways to work with 3D

Advanced 3D segmentation Sigmund Rolfsjord Todays lecture Different ways to work with 3D data: Curriculum: - Point clouds - Grids SEGCloud: Semantic Segmentation of 3D Point Clouds - Graphs Multi-view Convolutional Neural Networks for

1.07k views • 70 slides
When you look up into the sky, you will often see clouds. No two clouds are the same, and there

When you look up into the sky, you will often see clouds. No two clouds are the same, and there

When you look up into the sky, you will often see clouds. No two clouds are the same, and there are many different types of clouds. Different kinds of clouds lead to different types of weather. Cirrus clouds are the highest group of clouds that

271 views • 5 slides
OpenStack Amir Rahafrouz rahafrouz@gmail.com Clusters, Grids, Clouds course @ ITMO ITMO

OpenStack Amir Rahafrouz rahafrouz@gmail.com Clusters, Grids, Clouds course @ ITMO ITMO

OpenStack Amir Rahafrouz rahafrouz@gmail.com Clusters, Grids, Clouds course @ ITMO ITMO University, St. Petersburg by Prof. Andrey Shevel June 5th, 2018 Agenda Cloud Computing Scaling Virtualization History of

331 views • 17 slides
Scheduling and Resource Management in Grids and Clouds Dick Epema Parallel and Distributed

Scheduling and Resource Management in Grids and Clouds Dick Epema Parallel and Distributed

Scheduling and Resource Management in Grids and Clouds Dick Epema Parallel and Distributed Systems Group Delft University of Technology Delft, the Netherlands may 10, 2011 1 Outline Resource Management Introduction A framework

457 views • 42 slides
CEPH FileSystem Course: Computing Clusters, Computing Grids, Computing Clouds Presenter: An Pham

CEPH FileSystem Course: Computing Clusters, Computing Grids, Computing Clouds Presenter: An Pham

CEPH FileSystem Course: Computing Clusters, Computing Grids, Computing Clouds Presenter: An Pham (ptan1991@gmail.com) Professor: Andrey Y Shevel ITMO University, St. Petersburg, Russia June 2018. 1 An Pham - ITMO - Summer 2018 Outlines 1.

408 views • 17 slides
Grids and Clouds Interoperation: Development of e-Science Applications Data Manager on Grid

Grids and Clouds Interoperation: Development of e-Science Applications Data Manager on Grid

Grids and Clouds Interoperation: Development of e-Science Applications Data Manager on Grid Application Platform WeiLong Ueng Academia Sinica Grid Computing wlueng@twgrid.org Outline Introduction to GAP (Grid Application Platform).

785 views • 50 slides
Enhancing the Efficiency of Resource Usage on Opportunistic Grids 7th International Workshop on

Enhancing the Efficiency of Resource Usage on Opportunistic Grids 7th International Workshop on

INSTITUTE OF INFORMATICS - UFG Enhancing the Efficiency of Resource Usage on Opportunistic Grids 7th International Workshop on Middleware for Grids, Clouds and e-Science MGC 2009 Raphael de A. Gomes Fbio M. Costa Fouad J. Georges

665 views • 27 slides
Virtualizing the Philippine e-Science Grid International Symposium on Grids and Clouds 2011 25

Virtualizing the Philippine e-Science Grid International Symposium on Grids and Clouds 2011 25

Virtualizing the Philippine e-Science Grid International Symposium on Grids and Clouds 2011 25 March 2011 Rene Mendoza rene@asti.dost.gov.ph Advanced Science and Technology Institute Outline Who we are ASTI's initiatives on Cluster and

528 views • 20 slides
XtreemFS a Distributed File System for Grids and Clouds Jan Stender Zuse Institute Berlin

XtreemFS a Distributed File System for Grids and Clouds Jan Stender Zuse Institute Berlin

XtreemFS a Distributed File System for Grids and Clouds Jan Stender Zuse Institute Berlin XtreemFS Overview Jan Stender / Bjrn Kolbeck 1 The XtreemOS Project Research project funded by the Euopean Comission 19 partners from

494 views • 27 slides
Lecture 09: VMs and VCS head in the clouds Hands-on Unix system administration DeCal 2012-10-29

Lecture 09: VMs and VCS head in the clouds Hands-on Unix system administration DeCal 2012-10-29

Lecture 09: VMs and VCS head in the clouds Hands-on Unix system administration DeCal 2012-10-29 1 / 20 Projects groups of four people Projects Virtualization submit one form per group with OCF Head in the clouds usernames,

578 views • 20 slides
Lecture 10: Point Clouds, Eigenvectors, PCA COMPSCI/MATH 290-04 Chris Tralie, Duke University

Lecture 10: Point Clouds, Eigenvectors, PCA COMPSCI/MATH 290-04 Chris Tralie, Duke University

Lecture 10: Point Clouds, Eigenvectors, PCA COMPSCI/MATH 290-04 Chris Tralie, Duke University 2/16/2016 COMPSCI/MATH 290-04 Lecture 10: Point Clouds, Eigenvectors, PCA Announcements Group Assignment 1 Part 1, Due This Sunday 11:55 PM

660 views • 64 slides
Updates on Grid and Cloud Initiatives in the Philippines International Symposium on Grids and

Updates on Grid and Cloud Initiatives in the Philippines International Symposium on Grids and

Updates on Grid and Cloud Initiatives in the Philippines International Symposium on Grids and Clouds 2011 24 March 2011 Peter Banzon peterb@asti.dost.gov.ph Saturday, April 9, 2011 About ASTI R&D agency of the Philippine Government

517 views • 23 slides
UPM DAY 1: SMART GRIDS TABLE 1: TECHNOLOGICAL CHALLENGES RELATED WITH SMART GRIDS DEVELOPMENT

UPM DAY 1: SMART GRIDS TABLE 1: TECHNOLOGICAL CHALLENGES RELATED WITH SMART GRIDS DEVELOPMENT

Guillermo del Campo UPM DAY 1: SMART GRIDS TABLE 1: TECHNOLOGICAL CHALLENGES RELATED WITH SMART GRIDS DEVELOPMENT INTERNATIONAL SUMMER SCHOOL SMART GRIDS AND SMART CITIES Barcelona, 6-8 June 2017 Context Dramatic growth of energy

618 views • 16 slides
CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2

CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2

1 CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2 Gene Spafford, famous for warning that the emperor has no clothes fears that moving critical information to the cloud could be a catastrophe

637 views • 40 slides
CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2

CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2

CS5412 Sping 2014 1 CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2 Gene Spafford, famous for warning that the emperor has no clothes fears that moving critical information to the cloud

623 views • 49 slides
CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2

CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2

CS5412 Sping 2015 1 CS5412: DANGERS OF CONSOLIDATION Lecture XXIII Ken Birman Are Clouds Inherently Dangerous? 2 Gene Spafford, famous for warning that the emperor has no clothes fears that moving critical information to the cloud

585 views • 57 slides
Social Clouds Creating a research agenda Andrew Lippman MIT Media Lab October, 2010 Clouds and

Social Clouds Creating a research agenda Andrew Lippman MIT Media Lab October, 2010 Clouds and

Social Clouds Creating a research agenda Andrew Lippman MIT Media Lab October, 2010 Clouds and Mists: 1 st Cloud Defined by access Familiar as the internet Result of a nexus: PC, backbone, ISPs Web Opened vast doors to creativity Clouds and

592 views • 24 slides
Session 3: Hydrology & Clouds 3:00- 5:30 PM Session 3: Hydrology & Clouds 3:00- 5:30 PM

Session 3: Hydrology & Clouds 3:00- 5:30 PM Session 3: Hydrology & Clouds 3:00- 5:30 PM

Session 3: Hydrology & Clouds 3:00- 5:30 PM Session 3: Hydrology & Clouds 3:00- 5:30 PM Session 3: Hydrology & Clouds 3:00- 5:30 PM Session 3: Hydrology & Clouds 3:00- 5:30 PM Theme: Basically a continuation of climate talks

453 views • 19 slides
Scientific Computing I Grids Strcutured Grids Unstrcutured Grids Module 7: Grid Generation

Scientific Computing I Grids Strcutured Grids Unstrcutured Grids Module 7: Grid Generation

Scientific Computing I Michael Bader Grid Generation and Refinement Basic Types of Scientific Computing I Grids Strcutured Grids Unstrcutured Grids Module 7: Grid Generation Grid Operations Structured Grids Unstructured Michael Bader

513 views • 19 slides
RESOURCE MANAGEMENT RESOURCE MANAGEMENT STRATEGIES FOR SDR CLOUDS STRATEGIES FOR SDR CLOUDS Vuk

RESOURCE MANAGEMENT RESOURCE MANAGEMENT STRATEGIES FOR SDR CLOUDS STRATEGIES FOR SDR CLOUDS Vuk

Department of Signal Theory and Communications UNIVERSITAT POLITCNICA DE CATALUNYA RESOURCE MANAGEMENT RESOURCE MANAGEMENT STRATEGIES FOR SDR CLOUDS STRATEGIES FOR SDR CLOUDS Vuk Marojevic Ismael Gomez Pere Gilabert Gabriel Montoro

399 views • 27 slides
Communication Technologies and Standards for Smart Grids EE 772 : Smart Grids Prof. S. A.

Communication Technologies and Standards for Smart Grids EE 772 : Smart Grids Prof. S. A.

Communication Technologies and Standards for Smart Grids EE 772 : Smart Grids Prof. S. A. Khaparde Indian Institute of Technology Bombay Smart Grid Communications 1. Bi-directional flow of information (along with electricity) for effective

647 views • 32 slides
Visualization of 3D data: - 3D objects Is there an alternative to N x 2D slices ? Clouds,

Visualization of 3D data: - 3D objects Is there an alternative to N x 2D slices ? Clouds,

Visualization of 3D data: - 3D objects Is there an alternative to N x 2D slices ? Clouds, fire, smoke, fog, and dust are difficult to model with lecture 21 vertices and polygons. Volumetric models assume that light is emitted, absorbed, and

318 views • 5 slides
Q-Clouds: Managing Performance Interference Effects for QoS-Aware Clouds Ripal Nathuji Aman

Q-Clouds: Managing Performance Interference Effects for QoS-Aware Clouds Ripal Nathuji Aman

Q-Clouds: Managing Performance Interference Effects for QoS-Aware Clouds Ripal Nathuji Aman Kansal Alireza Ghaffarkhah Presented by Joshua Davis Motivation and Background Cloud computing Off load processing and storage Charged per

549 views • 28 slides
CS5412: REPLICATION, CONSISTENCY AND CLOCKS Lecture X Ken Birman Recall that clouds have tiers

CS5412: REPLICATION, CONSISTENCY AND CLOCKS Lecture X Ken Birman Recall that clouds have tiers

CS5412 Spring 2016 (Cloud Computing: Birman) 1 CS5412: REPLICATION, CONSISTENCY AND CLOCKS Lecture X Ken Birman Recall that clouds have tiers 2 Up to now our focus has been on client systems and the network, and the way that the cloud

1.01k views • 71 slides

More recommend