USQCD regional grid USQCD regional grid Report to ILDG 14 Report to ILDG 14
US Grid Usage US Grid Usage Growing usage of gauge configurations in ILDG file Growing usage of gauge configurations in ILDG file format. format. Fermilab repository contains 26,200 configurations in Fermilab repository contains 26,200 configurations in ILDG format (total MILC and anisotropic clover). ILDG format (total MILC and anisotropic clover). Ensembles accessible to members of the “ILDG” VO Ensembles accessible to members of the “ILDG” VO (read only) and the “LQCD” VO (read/write). (read only) and the “LQCD” VO (read/write). Many consumers of the US lattices have accounts at Many consumers of the US lattices have accounts at Fermilab and access configurations by means other than Fermilab and access configurations by means other than SRM/grid-ftp. SRM/grid-ftp. Demand is growing for grid file transfers among US Demand is growing for grid file transfers among US facilities. facilities. Working with developers at Argonne LCF (Blue Genes) Working with developers at Argonne LCF (Blue Genes) and Open Science Grid to enable grid file transfers. and Open Science Grid to enable grid file transfers. 05/28/09 ILDG14, June 5, 2009 2 05/28/09 ILDG14, June 5, 2009 2
US infrastructure US infrastructure • ILDG Metadata catalog located at JLab ILDG Metadata catalog located at JLab • File catalog also at JLab File catalog also at JLab – Simple mapping of LFNs to transfer URLs Simple mapping of LFNs to transfer URLs – DB will be needed to manage replicas DB will be needed to manage replicas • Single storage element is one of the Single storage element is one of the Fermilab tape robots. Fermilab tape robots. • ILDG portal http://usqcd.jlab.org/mdc-web- ILDG portal http://usqcd.jlab.org/mdc-web- client/index.jsp client/index.jsp • Info page http://www.usqcd.org/ildg/ Info page http://www.usqcd.org/ildg/ 05/28/09 05/28/09
US ILDG Status US ILDG Status http://www.sapac.edu.au/inca/index.jsp 05/28/09 05/28/09
Gauge Connection Gauge Connection • Web portal to share gauge configurations Web portal to share gauge configurations (MILC initially) (MILC initially) • Gauge archive format predating ILDG. Gauge archive format predating ILDG. • Managed by Jim Hetrick (MILC). Managed by Jim Hetrick (MILC). • Hosted by NERSC. Hosted by NERSC. NERSC has proposed modernizing the GC NERSC has proposed modernizing the GC in order to create a “Science Gateway” in order to create a “Science Gateway” useful to scientists doing HPC computing. useful to scientists doing HPC computing. http://www.nersc.gov/nusers/services/Grid/SG/sg.php http://www.nersc.gov/nusers/services/Grid/SG/sg.php 05/28/09 05/28/09
Gauge Connection Upgrade Gauge Connection Upgrade NERSC developers working with Jim Hetrick NERSC developers working with Jim Hetrick to gather requirements. to gather requirements. • New user interface New user interface • Dynamic html content + RDBMS. Dynamic html content + RDBMS. • Add upload and downloads via grid tools. Add upload and downloads via grid tools. • ILDG presence ILDG presence – Storage element Storage element – File catalog replication / ILDG search File catalog replication / ILDG search – Replication of files stored elsewhere Replication of files stored elsewhere 05/28/09 05/28/09
Recommend
More recommend
