dCache for Photon Science Outline: Overview and Resources Photon dCache Monitoring Birgit Lewendel for the dCache operations team Summary DESY IT 6th dCache Workshop
dCache at DESY DESY National Analysis Facility Zeuthen 0.7 PB CTA XFEL H1 Atlas Atlas ILC, Calice ILDG, Pitz Olympus IceCube Belle 1500 TB 900 TB 300 TB 2000 TB 670 TB 180 TB GRID 3.5 PB Local Batch HERA /usr Local 900 TB Farm Batch Photon Farm 450 TB HZG, Petra III, Flash, CFEL Birgit Lewendel | 6 th dCache WS | 19.04.2012 | Page 2
Photon Science Data Data Sources • Flash FEL • PetraIII Synchroton radiation • Doris Synchroton radiation • XFEL components • Accelerator simulation • External (LCLS, ESRF, …..) Data volume: GB to PB Requests • ACLs for NFS4.1 • Container for small files Photon scientists work in small groups. Experiments often record small size images. Birgit Lewendel | 6 th dCache WS | 19.04.2012 | Page 3
Photon dCache dcap dcache-dir-photon dcache-door- clients NFS4.1 NFS4.1 server photon01 clients pnfsManager NFS3 server SL6.2 PoolManager,gPlazma dcap idmapping dcache-se-photon dcache-door- 10+ WGS admin, statistics, photon02 different http gridftp photon sources 2.1 and accelerator physics pools disk-only write dcache-photon01 – dcache-photon30 Birgit Lewendel | 6 th dCache WS | 19.04.2012 | Page 4
Monitoring > Why • 5 instances with ~400 pool nodes • History • Repeat any time • Run tests at different frequencies • Compare to last result > How cron and scripts with input from admin interface, postgres DB, web page Birgit Lewendel | 6 th dCache WS | 19.04.2012 | Page 5
Monitoring Birgit Lewendel | 6 th dCache WS | 19.04.2012 | Page 6
Summary > dCache operations team monitoring > Data management for photon science > dCache NFS4.1 server in production Birgit Lewendel | 6 th dCache WS | 19.04.2012 | Page 7
Recommend
More recommend