The APAC National Grid Program in Australia “providing advanced computing, information and grid infrastructure for eResearch” Glenn Moloney University of Melbourne for the Australian Partnership for Advanced Computing Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 1
APAC National Grid Darwin Internet2 Canarie Geant APAN • 10 Gbps • IPv6 Brisbane QPSF • Multicast Canberra ANU Sydney Perth ac3 IVEC CSIRO Adelaide APAC SAPAC National Facility GrangeNet Backbone Melbourne Hobart Centie/GrangeNet Link VPAC TPAC CSIRO AARNet Links CSIRO Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 2
Australian Partnership for Advanced Computing “providing advanced computing, information and grid infrastructure for eResearch” The APAC Partners: AC3: Australian Centre for Advanced Computing and • Communications in NSW CSIRO: Commonwealth Science and Industry Research • Organisation QPSF: Queensland Parallel Supercomputing Foundation • IVEC: Interactive Virtual Environments Centre in WA • SAPAC: South Australian Partnership for Advanced • Computing ANUSF: The Australian National University • TPAC: The University of Tasmania • VPAC: Victorian Partnership for Advanced Computing • Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 3
National Role of APAC Advanced Computing Infrastructure – peak computing facilities Information Infrastructure – support for community-based data collections – management of large-scale data collections (archiving) Grid Infrastructure – access to national computing and information infrastructure • access to federated computing and information systems – advanced collaborative services for research groups • collaborative visualisation, computational steering, tele-presence, virtual organisation support – support Australian participation in international research programs • eg, astronomy, high-energy physics, earth systems, geosciences Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 4
The APAC Grid Program Australian government provided AU$29m for stage 2 of APAC: Providing the advanced computing and grid infrastructure for eresearch · AU$12.5m for upgrade of National Facility Canberra · Commisioned mid 2005 · National grid infrastructure projects: · Computing infrastructure · Information infrastructure · User Interface and Visualisation · Application support projects: · Astronomy (Virtual Observatory) · Computational chemistry · Theoretical and experimental high energy physics · International LatticeGrid, ATLAS, Belle · Geosciences · Bioinformatics Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 5
APAC National Facility Usage • mainly biology, chemistry, physics • currently 247 projects and 722 users (27 universities) Computing Systems • SGI Altix 3700 Bx2 system: 1680 processors • Dell Linux cluster: 150 processors Mass Data Storage System (MDSS) • Storagetek (robotic silo) HSM tape library – Petabyte capable storage Visualisation Systems • Virtual reality systems, Access Grid rooms Staff • User support, Systems support • Computational tools and techniques Large-scale data collection management http://nf.apac.edu.au • Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 6
Global Connectivity 10Gbps ring Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 7
APAC National Grid one virtual system of computational facilities QPSF ac3 iVEC APAC ANU NATIONAL SAPAC FACILITY CSIRO TPAC VPAC • Basic Services – single ‘sign-on’ to the facilities – portals to the computing and data systems – access to software on the most appropriate system – resource discovery and monitoring Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 8
APAC Grid Deployment APAC National Grid.v1 – Single Sign-on, data sharing Base: VDT (GT2.4.3, Monalisa, Ganglia), GridSphere, SRB, OpenDAP, Nimrod, LCG VO model: follow Grid3 Use APAC CA Manually configured solutions Use National CAs Auto configuration APAC National Grid.v2 – Add portals and workflow support APAC National Grid.v3 Base: VDT-> GT4, Gridsphere, SRB Interoperability: OpenDAP, Nimrod, LCG Align with OSG, EGEE VO Model: not yet determined Use aarnet3 backbone 2005 2006 Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 9
APAC Grid Gatekeeper Machines Each partner site has a 'gateway' machine which 'hosts' Grid front-ends to the available resources Xen Virtual Machine Monitor University of Cambride Computer Laboratory Hardware: VM VM VM Dual Xeon 2.8GHz, 4Gb RAM, (domU) (domU) (domU) 300Gb mirrored SCSI disk, 5 GigE network cards (1 mgmt, 2 data VM, 2 other VM's) Linux (2.6) dom0 Xen hypervisor Physical Hardware CPU, disk, network Grid front-ends: •Globus 2 (VDT-1.2.4), Globus 4 (VDT-1.4 ??), •Storage Resource Broker 3.3.1, LCG, Nimrod/G Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 10
National Grid Infrastructure Portal Tools: a virtual system of GridSphere computing, QPSF Workflow Tools: data storage (JCU) Kepler? and visualisation facilities Security: APAC CA QPSF MyProxy APAC IVEC VOMRS National Facility ac3 Systems: ANU Gateways SAPAC Partners’ Facilities VPAC CSIRO Network: TPAC GrangeNet APAC VPN (AARNet) Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 11
APAC National Grid Computing Grid Infrastructure Resource Discovery: APAC Software Registry MDS INCA? QPSF (JCU) Job Submission: Command Line Portals Job Monitoring: QPSF APAC Scope IVEC MonaLisa? National Facility ac3 Job Management: Globus, Nimrod, PBS ANU SAPAC CSIRO VPAC Computing Systems: Peak TPAC Mid-range Special Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 12
APAC National Grid Data Management Infrastructure Data Access: OGSA-DAI Web services OPenDAP QPSF (JCU) Data Management: Globus SRB SRM QPSF APAC IVEC National Data Transfer: Facility RFT ac3 GridFTP Global File System ANU SAPAC CSIRO VPAC Mass Data Storage Systems: TPAC Tape – based (silos) Disc-based Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 13
APAC National Grid Collaboration Support Infrastructure Visualisation Services: Prism and VisServer Visualisation Software QPSF (JCU) Collaboration Tools: AG Whiteboard QPSF APAC National Facility ac3 IVEC ANU SAPAC VPAC CSIRO Facilities: Access Grids TPAC Virtual Reality Systems Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 14
Delivering National Grid Services Research Teams Data Centres grid-based portals Sensor distributed computation Networks federated data access remote control collaboratories Other Grids: Institutional National International Instruments Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 15
Astronomy and Astrophysics • MACHO Project Data – Largest online astro data set in Australia (~10TB) – Hosted by APAC as part of IVO collection – Mapping metadata to VOTable 1.0 standard • Australian Virtual Observatory – Provide uniform access to key data collections • 2dFGRS, HIPASS, ATCA-OA, SUMSS, MACHO, TNO… – Grids for theoretical astrophysics simulations • Portals for job configuration, submission and monitoring • MLAPM, GCD+, Zeus-MP, LensView, (x)oopic, Swift, • International Virtual Observatory – SIAP service for ATCA Phoenix Deep Field Survey • SIAP is an International Virtual Observatory protocol Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 16
Bioinformatics Accelerate progress on genome annotation, for genomes of national economic significance Support lead discovery through molecular docking • Data update and synchronisation services, including the BioMirror • Grid-wide compute services for Ensembl, Blast, RepeatMasker and Glimmer • Grid-wide compute services for molecular docking including support for analysis workflows Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 17
Computational Chemistry Unified Grid-based portal to chemistry software Portal to computational chemistry software on APAC Grid • Uniform access to software on a computer system • Gaussian, Amber, Gamess-US, Gromacs, Mopac and Molpro • QPSF AC3 IVEC APAC ANU NATIONAL SAPAC FACILITY CSIRO TPAC VPAC Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 18
Earth Systems Science Access to Data Products • Inter-governmental Panel Climate Change scenarios of future climate (3TB) • Ocean Colour Products of Australasian and Antarctic region (10TB) • 1/8 degree ocean simulations (4TB) • Weather research products (4TB) • Earth Systems Simulations • Terrestrial Land Surface Data Grid Services – Globus based version of OPeNDAP (UCAR/NCAR/URI) – Server side analysis tools for data sets: GRADS, NOMADS – Client side visualisation from on-line servers – THREDDS (catalogues of OPeNDAP repositories) Glenn Moloney The APAC Grid Program in Australia ISGC, Taipei, 2006 19
Recommend
More recommend
