dCache dCache seminar at FERMIlab dCache.ORG Patrick Fuhrmann et al. dCache.ORG and slides stolen from nearly everywhere additional funding, support or contributions by d-grid DGI II P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Roadmap for today Preliminaries dCache.ORG Who is behind dCache ? What is dCache.org ? Market share and support model. Open Science Grid -> Tanya Selected Topics Chimera NFS 4.1 dCache.ORG NDGF Approach -> Gerd What's the plan ? NOW 1 – 2 Months ½ Year 1 Year P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Who is behind dCache ? dCache.ORG No Not yet dCache.ORG But .... P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
The Team Head of dCache.ORG Head of Development FNAL : dCache.ORG Timur Perelmutov Patrick Fuhrmann Head of Development DESY : Core Team (Desy, Fermi, NDGF) Tigran Mkrtchyan Andrew Baranovski Head of Development NDGF : Gerd Behrmann Gerd Behrmann Bjoern Boettscher External Ted Hesselroth Development Alex Kulyavtsev Iryna Koslova dCache.ORG Abhishek Singh Rana, SDSC Tanya Levshina Jonathan Schaeffer, IN2P3 Dmitri Litvintsev Support and Help David Melkumyan German HGF Support Team Paul Millar Greig Cowan, gridPP Martin Radicke Stijn De Weirdt (Quattor) Owen Synge Flavia Donno, CERN Neha Sharma Vladimir Podstavkov P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Need a job ? 2 job positions offered at DESY dCache.ORG (Europe,Germany, Hamburg), starting end of October. dCache.ORG P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
dCache.ORG What is dCache.org ? dCache.ORG P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
What is dCache.org ? High level overview dCache.ORG Development Code management System verification dCache.ORG Deployment dCache.ORG gLite Europe Asia US South America P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
What is dCache.org ? Customer interactions Customer interactions Customer interactions dCache.ORG ➢ User helping user : user-forum@dCache.org ➢ SRM 2.2 deployment : srm-deployment@dCache.org ➢ Ticket system : support@dCache.org ➢ Regular phone conference with some big sites (on request) ➢ Wiki/SVN area for customers feedback and contributions dCache.ORG ➢ Weekly phone conferences with dCache Tier I's ➢ Organisation of dCache workshops and tutorials ➢ e.g. gridKa school two weeks ago. P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
What is dCache.org ? The infrastructure - dCache.ORG is an infrastructure dCache.ORG - dCache.ORG is the door into the dCache team dcache.org dcache.org Developers Developers The Book Automated Internal Build The Wiki SVN System Including Customers Area @ Code Review Download DESY Regression dCache.ORG Source, RPM Test FERMI and YUM System NDGF Ticket System support@dCache.org IN2P3 Mailing lists user-forum@dCache.org srm-deployment@dCache.org The The dCache.org dCache.org framework is operated framework is operated by by DESY DESY and funded and funded by by EGGE EGGE and and d-Grid d-Grid P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
What is dCache.org ? The distribution dCache.ORG dCache distribution dCache is distributed (YUM at DESY and CERN) and configured through YAIM for the Tier II's in Europa. dCache is distributed and configured through VDT for OSG supported Tier II's dCache is distributed through dCache.org for the Tier I's and configured manually due to the complexity of the Tier I setups. dCache.ORG P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Market share and support model dCache.ORG Market Share Support Model Open Science Grid : covered by Tanya dCache.ORG P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
7 out of 11 Tier I's and more than 70 Tier II's using dCache dCache.ORG Dresden Dortmund Berlin Aachen Juelich DESY UK, RAL Italy, CNAF Tier Tier I's I's Munich Amsterdam Taiwan Karlsruhe (11) (11) Tier 0 NDGF CERN dCache.ORG Barcelona OSG OSG BNL Land Land Lyon Fermilab Leave Leave this this to to Tanya Tanya P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Current support model dCache.ORG Tier I's FERMI(Timur), BNL(Tigran), NDGF(Gerd), gridKa(Patrick),SARA,Pic,In2P3 Tanya support@dCache.org US Tier II's dCache.ORG GGUS German Flavia, Giancinto, Greig Support C. Jung et al. Other Tier II's Distributed Storage Support German Tier II's P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
dCache.ORG Selected Topics Chimera ACL's : will be covered by a dCache seminar NFS 4.1 dCache.ORG The NDGF approach : covered by Gerd P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
dCache.ORG Chimera dCache.ORG P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
What is Chimera (Basics) ? dCache.ORG Chimera provides the same functionality to dCache as Pnfs does. Only the pnfs manager driver within the PnfsManager has to be adjusted. Chimera is a Java API, a library and a database table layout. There is nothing like a Chimera server. Consequently it can make use of any DB performance improvements. dCache.ORG Chimera is a Library and a DB table layout Postgres ● Chimera API : Oracle Jdbc Name Space mySql Chimera Chimera mkdir, touch, rmdir, mv ... *** Meta Data Library ACL P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
How does dCache interact with Chimera ? Any other client Any other client dCache.ORG shell (ls, shell (ls, mkdir mkdir ...) ...) OS OS File File System System V-Node V-Node Interface Interface Web File Web File System System NFS 3 NFS 3 client driver client driver dCache dCache View View core core http(s) NSF 3/4 NFS NFS 3 3 / 4 / 4 server server Web/http server Web/http server PnfsManager PnfsManager Tcp/IP Tcp/IP Chimera API Chimera API Chimera API dCache.ORG Chimera Lib Chimera Lib Chimera Lib JDBC JDBC JDBC Postgres Postgres Chimera Chimera Table Table Oracle Oracle Layout Layout mySql mySql *** *** P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
What does Chimera provide ? dCache.ORG The dCache PnfsManager talks directly to Chimera. (no intermediate layers). Performance independent of number of files per directory. Chimera can distinguish between dCache core and the various client interfaces. Chimera allows ACLs to be plugged in (Posix implementation already av.) Chimera takes advantage of the performance of the chosen database back-end. If the database back-end can span various hosts, Chimera can do as well. dCache.ORG No central database table locks. Customised SQL queries can easily be applied. (e.g. Space Usage by uid, group time....) Chimera allows at least 10 times more dCache file access operations per second than pnfs (using postgres and similar hardware) P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Status of Chimera dCache.ORG Chimera is ready (in 1.8.0-15 and higher dcache.org now provides a fast conversion mechanism. 100 – 400 records per second Goal : largest site should be able to migrate within one day. We are investigating in a 'way back' as well. dCache.ORG Based on the production installations in DESY Hamburg and Zeuthen, minor issues could be resolved. BNL is preparing to move the Phenix dCache to chimera (using Oracle) The 6 month delay of LHC possibly allows NDGF to move to chimera as well. P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
dCache.ORG NFS 4.1 dCache.ORG P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Motivation Space/Protocol Management dCache.ORG OGF SRM Storage Resource Management Wide Area Transport Protocol In use : gsiFtp IETF Storage Discussed : http(s) Element dCache.ORG Information Service Protocol IETF Transport : LDAP OGF Content : GLUE Schema Local Access Protocol (gsi)dCap or rfio and xRoot These is not at all a standard P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
And another project : NFS 4 within CITI dCache.ORG “We are developing an implementation of NFSv4 and NFSv4.1 for Linux.” University of Michigan Introduction of RFC 3530 dCache.ORG The Network File System (NFS) version 4 is a distributed filesystem protocol which owes heritage to NFS protocol version 2, RFC 1094, and version 3, RFC 1813. Unlike earlier versions, the NFS version 4 protocol supports traditional file access while integrating support for file locking and the mount protocol. In addition, support for strong security (and its negotiation), compound operations, client caching, and internationalization have been added. Of course, attention has been applied to making NFS version 4 operate well in an Internet environment. P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Why is NFS 4.1 : technical perspective dCache.ORG ➢ NFS 4.1 is aware of distributed data ➢ Faster (optimized) e.g.: ➢ Compound RPC calls ➢ e.g. : 'Stat' produces 3 RPC calls in v3 but only one in v4 ➢ GSS authentication ➢ Built-in mandatory security on file system level ➢ ACL's dCache.ORG ➢ dCache can keep track on client operations ➢ OPEN / CLOSE semantic (so system can keep track on open files) ➢ 'DEAD' client discovery (by client to server pings) ➢ smart client caching. P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab
Recommend
More recommend
