An Interoperable & Optimal Data Grid Solution for Heterogeneous and SOA based Grid- GARUDA Payal Saluja, Prahlada Rao B.B., ShashidharV, Neetu Sharma, Paventhan A. HPGC Workshop, IEEE’s IPDPS 2010, Atlanta Dr. B.B Prahlada Rao prahladab@cdacb.ernet.in 19 April 2010 IPDPS10 System Software Development Group Centre for Development of Advanced Computing C-DAC Knowledge Park, Bangalore, India 1 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
Presentation Outline Grid Storage Requirements • Various Data Grid Solutions • Comparision of Grid data Solutions • I ndian National Grid –GARUDA • Data Management Challenges for GARUDA • HPGC Workshop, IEEE’s IPDPS 2010, Atlanta GARUDA Data Storage Solution - GSRM • GSRM Highlights • GSRM Architecture I ntegration with GARUDA • middleware components GSRM Usage Scenario for Par. applications • Conclusions • 2 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
Grid Storage Requirem ents • Data Availability • Security • Performance & Latency • Scalability HPGC Workshop, IEEE’s IPDPS 2010, Atlanta • Fault Tolerance GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
Data Grid Solutions & Supported Storage System s Data Grid Storage Systems Storage Storage Grid File Resource System WS-DAI Resource iRODS Grid Storage Manager Broker Gfarm Solutions StoRM HPGC Workshop, IEEE’s IPDPS 2010, Atlanta GPFS DPM Lustre dCache Xtreemf s Bestman NFSv4 1.File Systems 1.File systems 1. File systems 1.File Systems AMG 2. Archives 2.Parallel File 2. Parallel File 2. Archives A WS- Supported Systems 3. Storage Area Systems 3. Storage DAI Systems Storage 3.Object storage Network (SAN) 3.Object Area Network device 4. Data Bases storage (SAN) WS- 4. Mass storage 5. CAS 4. Data Bases devices DAIX systems 6. Mass Storage 5. CAS systems 6. MSS Hierarchy of Data Grid Solutions and Supported Storage Systems GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
Survey of Data Grid Solutions • Storage Resource Broker (Nirvana SRB) • iRODS (I ntegrated Rule Oriented Data System) • GFS (Grid File Systems) HPGC Workshop, IEEE’s IPDPS 2010, Atlanta • WS-DAI (Web Service-data Access & I ntegration) • SRM (Storage Resource manager) GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
Feature com parison of Grid Data Solutions SRB iRODS SRM GFS WS- Features (Nirvana) DAI SDSC, GFS-WG Organization SDSC EGEE OGSA group Nirvana (GGF) Tool Tool Spec Spec Spec Tool/ Spec Storage File system, MSS, File File systems,, File systems database Database, system MSS, HPGC Workshop, IEEE’s IPDPS 2010, Atlanta Support Object based Yes Yes Yes Yes Yes Global Namespace GSI, GSI, GSI, VOMS GSI WS-Security Security Unix Auth, Unix auth, kerberos kerberos Proprietary tool No OGF OGF GGF Standardization No No Yes Yes Interoperability No No Yes No No Space Management yes yes yes Replication GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
I ndian National Grid Com puting I nitiative-GARUDA HPGC Workshop, IEEE’s IPDPS 2010, Atlanta Website : www.garudaindia.in 7 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
GARUDA- I ndian National Grid Com puting I nitiative - Objectives Share High-end Computational Resources with the larger • Scientific and Engineering community across I ndia. Emerging High Performance Computing (HPC) Applications • require integration of geographically distributed resources Collaborative Frameworks for solving applications that are • HPGC Workshop, IEEE’s IPDPS 2010, Atlanta interdisciplinary, experts participation from multiple domains and distributed locations Universal (location-independence , ubiquitous) access to • resources 8 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
Com ponents Evolution in GARUDA Project Phases GARUDA PoC GARUDA Found GARUDA Main Phase Phase Phase Phase Features Middleware Globus 2.4.3 Globus 4.0.7 Globus + Clouds (Stable release) (Stable release) Web Pre WS Web Service Based Web Service Based compliance SOA Support Not supported Service Oriented Grid Supported HPGC Workshop, IEEE’s IPDPS 2010, Atlanta Architecture Centralized Peer to Peer Peer to Peer Grid Meta Moab Gridway NA Scheduler QOS Rudimentary Advanced Reservation Yes Compliance Storage SRB-Commercial SRM- Open source S/W NA Solutions Virtual Virtual Community Enabling Virtual Fully Supported Community Groups formed. Communities through Support VOMS 9 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
GARUDA Partners ( Currently - 4 5 ) Institute of Plasma Re se ar c h, Ahme dabad Unive r sity of Hyde r abad, Hyde r abad Physic al Re se ar c h L abor ator y, Ahme dabad Ce ntr e for DNA F inge r pr inting and Diagnostic s, Hyde r abad Spac e Applic ations Ce ntr e , Ahme dabad Jawahar lal Ne hr u T e c hnologic al Unive r sity, Har ish Chandr a Re se ar c h Institute , Allahabad Hyde r abad Motilal Ne hr u National Institute of T e c hnology, Indian Institute of T e c hnology, Kanpur Allahabad Indian Institute of T e c hnology, Khar agpur Jawahar lal Ne hr u Ce ntr e for Advanc e d Sc ie ntific Re se ar c h, Bangalor e Saha Institute of Nuc le ar Physic s, Kolkatta Indian Institute of Astr ophysic s, Bangalor e Ce ntr al Dr ug Re se ar c h Institute , L uc know Indian Institute of Sc ie nc e , Bangalor e Sanjay Gandhi Post Gr aduate Institute of Me dic al HPGC Workshop, IEEE’s IPDPS 2010, Atlanta Sc ie nc e s, L uc know Institute of Mic r obial T e c hnology, Chandigar h Bhabha Atomic Re se ar c h Ce ntr e , Mumbai Punjab E ngine e r ing Colle ge , Chandigar h Indian Institute of T e c hnology, Mumbai Madr as Institute of T e c hnology, Che nnai T ata Institute of F undame ntal Re se ar c h, Mumbai Indian Institute of T e c hnology, Che nnai IUCCA, Pune Institute of Mathe matic al Sc ie nc e s, Che nnai National Ce ntr e for Radio Astr ophysic s, Pune Indian Institute of T e c hnology, De lhi National Che mic al L abor ator y, Pune Jawahar lal Ne hr u Unive r sity, De lhi Pune Unive r sity, Pune Institute for Ge nomic s and Inte gr ative Biology, De lhi Indian Institute of T e c hnology, Roor ke e Indian Institute of T e c hnology, Guwahati Re gional Canc e r Ce ntr e , T hir uvananthapur am Guwahati Unive r sity, Guwahati Vikr am Sar abhai Spac e Ce ntr e , T hir uvananthapur am Institute of T e c hnology, Banar as Hindu Unive r sity, Var anasi 10 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
Cyber I nfrastructure – Resources • PARAM Padma (Aix, Bangalore), Linux Clusters at Pune, Hyderabad & Chennai • Grid Labs have been setup at Bangalore, Pune & Hyderabad • Fourteen of the partner institutions HPGC Workshop, IEEE’s IPDPS 2010, Atlanta contributed resources including Satellite Terminals (compute aggregating to 1600+ CPUs) 11 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
GARUDA Component Architecture Access Methods Management, Monitoring • Access Portal for & Accounting SOA • Paryaveekshanam • Problem Solving • Web MDS Environments • GARUDA Information Service • GARUDA Accounting HPGC Workshop, IEEE’s IPDPS 2010, Atlanta Security Framework • IGCA Certificates • MyProxy GARUDA Resources • VOMS • Compute, Data, Storage, • Scientific Instruments, Resource Mgmt & Scheduling • Software,.. • GridWay Meta-scheduler • Resource Reservation • Torque, Load Leveler • Globus 4.x (WS Components) 12 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
• Indian Grid Certification Authority (IGCA): HPGC Workshop, IEEE’s IPDPS 2010, Atlanta Located at C-DAC, Knowledge Park, Bangalore, India. • IGCA is the first CA in India for the purpose of Grid research. • Managed by GARUDA -Grid Operation Centre . • Issues X.509 Certificates to support the secure environment in Grid ( to institutes doing grid research in India and Internationaly collaborating with GARUDA). 13 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
GARUDA current Phase: Objectives Provide an Operational Stable Cyber I nfrastructure with • Service oriented technologies for scientific/ Commercial applications Deliver A Service Level Architecture ie usable by a wide range • of scientific disciplines I ntegrate GARUDA with other I nternational Grids • HPGC Workshop, IEEE’s IPDPS 2010, Atlanta Address long-term research issues in Grid Computing • Deliverables: • Grid Technologies & Research • SOA based Infrastructure • Applications • Capacity and Community Building 14 GARUDA DataGrid Solutions:GSRM – Prahlada Rao.. et all
Recommend
More recommend
