StAR in dCache Storage Accounting Record definition found here: - PowerPoint PPT Presentation

Oct 27, 2023 •28 likes •58 views

StAR in dCache Storage Accounting Record definition found here: https://cdsweb.cern.ch/record/1452920 dcache-star script (find script here:code) writing record every star.polling-period (seconds, default=90000 (25h)) rotating

StAR in dCache • Storage Accounting Record definition found here: • https://cdsweb.cern.ch/record/1452920 • dcache-star script (find script here:code) • writing record every star.polling-period (seconds, default=90000 (25h)) • rotating directories every star.spool.dir-granularity (minutes, default=60) • cron job, but for first run values needed to have a reference point • Mapping <GID> = <group-identifier>, group ownership of files used for accounting • one group-identifier can be mapped to many GIDs • GIDs unique • Files on tape • URI in dCache stating the tape location "osm://tape- pool.site-2.example.org/?volume=512&bfid=11221" • Grouping pools or tape locations: Mapping <host> = <StorageShare> • pool1.site-1.example.org = site-1, \ • pool2.site-1.example.org = site-1, \ • tape-pool.site-2.example.org = site-2, \ dCache ¡Team 1 Chris-an ¡Bernardt
StAR in dCache Space used Time dCache ¡Team 2 Chris-an ¡Bernardt
StAR in dCache <sr:StorageUsageRecords xmlns:sr="http://eu-emi.eu/namespaces/2011/02/storagerecord"> <sr:StorageUsageRecord> <sr:RecordIdentity sr:createTime="2010-11-09T09:06:52Z" sr:recordId="host.example.org/sr/87912469269276"/> <sr:StorageSystem>host.example.org</sr:StorageSystem> <sr:Site>ACME-University</sr:Site> <sr:StorageShare>pool-003</sr:StorageShare> <sr:StorageMedia>disk</sr:StorageMedia> <sr:StorageClass>replicated</sr:StorageClass> <sr:FileCount>42</sr:FileCount> <sr:DirectoryPath>/home/projectA</sr:DirectoryPath> <sr:SubjectIdentity> <sr:LocalUser>johndoe</sr:LocalUser> <sr:LocalGroup>projectA</sr:LocalGroup> <sr:UserIdentity>/O=Grid/OU=example.org/CN=John Doe</sr:UserIdentity> <sr:Group>binarydataproject.example.org</sr:Group> <sr:GroupAttribute sr:attributeType="subgroup">ukusers</sr:GroupAttribute> </sr:SubjectIdentity> <sr:StartTime>2010-10-11T09:31:40Z</sr:StartTime> <sr:EndTime>2010-10-12T09:29:42Z</sr:EndTime> <sr:ResourceCapacityUsed>14728</sr:ResourceCapacityUsed> <sr:LogicalCapacityUsed>13617</sr:LogicalCapacityUsed> <sr:ResourceCapacityAllocated>14624</sr:ResourceCapacityAllocated> </sr:StorageUsageRecord> </sr:StorageUsageRecords> dCache ¡Team 3 Chris-an ¡Bernardt

Recommend

dCache dCache seminar at FERMIlab dCache.ORG Patrick Fuhrmann et al. dCache.ORG and slides

dCache dCache seminar at FERMIlab dCache.ORG Patrick Fuhrmann et al. dCache.ORG and slides stolen from nearly everywhere additional funding, support or contributions by d-grid DGI II P. Fuhrmann Sep 26, 2008 dCache seminar, FERMIlab

375 views • 34 slides

dCache Beginners Course Introducing dCache An overview to dCache and how it is deployed in grid

dCache Beginners Course Introducing dCache An overview to dCache and how it is deployed in grid environments. Karlsruhe Institute of Technology (KIT), Steinbuchcentre for Computing (SCC) KIT University of the State of Baden-Wuerttemberg and

297 views • 12 slides

dCache in Use at DESY dCache in Use DESY DV/IT 5.7.2010 Overview grid gridFTP, (gsi)dcap,

Andreas Haupt, Birgit Lewendel dCache in Use at DESY dCache in Use DESY DV/IT 5.7.2010 Overview grid gridFTP, (gsi)dcap, SRM dcache-se-desy dcache-se-cms dcache-se-atlas lcg-se1 lcg-se0 Calice, CFEL, GKSS, ILC, Olympus, Petra3,

417 views • 7 slides

dCache for Photon Science Outline: Overview and Resources Photon dCache Monitoring Birgit

dCache for Photon Science Outline: Overview and Resources Photon dCache Monitoring Birgit Lewendel for the dCache operations team Summary DESY IT 6th dCache Workshop dCache at DESY DESY National Analysis Facility Zeuthen 0.7 PB CTA

100 views • 7 slides

Whats new since 2016 Tigran Mkrtchyan for dCache Team dCache User Workshop, Ume, Sweden

Whats new since 2016 Tigran Mkrtchyan for dCache Team dCache User Workshop, Ume, Sweden What will be NOT covered with talks Changes in REST API New functionality in dCache-view CEPH HA-dCache Macaroons and OpenID-connect

267 views • 25 slides

dCache NFSv4.1 Tigran Mkrtchyan Zeuthen, 13.04.12 dCache NFSv4.1 | Tigran Mkrtchyan | 4/13/12 |

dCache NFSv4.1 Tigran Mkrtchyan Zeuthen, 13.04.12 dCache NFSv4.1 | Tigran Mkrtchyan | 4/13/12 | Page 1 Outline NFSv41 basics NFSv4.1 concepts PNFS Id mapping Industry standard dCache implementation dCache NFSv4.1 |

1.14k views • 46 slides

dCache - delegated storage solutions Tigran Mkrtchyan for dCache Team ISGC 2016, Taiwan dCache

dCache - delegated storage solutions Tigran Mkrtchyan for dCache Team ISGC 2016, Taiwan dCache on one slide JVM JVM JVM Message passing layer Door(s) Pool Manager Name Space Pools (clients entry point) Door Pools (requests scheduler)

254 views • 21 slides

CMS Subgroups in dCache 2.2 CMS T3 requirements for dCache We manage a CMS T3 cluster financed

CMS Subgroups in dCache 2.2 CMS T3 requirements for dCache We manage a CMS T3 cluster financed by 3 Swiss Institutes: PSI , UniZ , ETHZ ; during 2013 we will run 700TB net based on 2*NetApp E5400 + 4*Sun X4500 + 5*Sun X4540 ; Our user

210 views • 10 slides

Effjcient Message Serialization for Inter-Service Communication in dCache Evaluating a Replacement

Effjcient Message Serialization for Inter-Service Communication in dCache Evaluating a Replacement for Java Serialization in dCache Lea Morschel for dCache Team, November 7 2019 About dCache A distributed petabyte-scale storage system for

713 views • 42 slides

dCache: Powerful Storage Made Easy Paul l Milla illar (on behalf of the dCache.org team)

dCache: Powerful Storage Made Easy Paul l Milla illar (on behalf of the dCache.org team) dCache dCache is powerful storage system, providing what people need, now. We're also pushing the envelope of what storage systems can do.

1.04k views • 25 slides

dCache dCache in the in the NDGF Distributed Tier 1 NDGF Distributed Tier 1 Gerd Behrmann

dCache dCache in the in the NDGF Distributed Tier 1 NDGF Distributed Tier 1 Gerd Behrmann Second dCache Workshop Hamburg, 18 th of January 2007 NORDUnet A/S NORDUnet A/S The Nordic Regional Research and Educational Network (RREN)

520 views • 18 slides

dCache, selected topics (LCG MB) Patrick Fuhrmann dCache.ORG additional funding, support or

dCache.ORG dCache, selected topics (LCG MB) Patrick Fuhrmann dCache.ORG additional funding, support or contributions by d-grid DGI II Phone Meeting 4.8.2009 LCG MB Patrick Fuhrmann Content Chimera and the Pnfs to Chimera Migration

176 views • 15 slides

Integra(on of Billing (Accoun(ng) Plots ( dCache 2.1+) Albert L.

Integra(on of Billing (Accoun(ng) Plots ( dCache 2.1+) Albert L. Rossi Fermi Na(onal Accelerator Laboratory Accoun(ng ( dCache Book , Chpt. 24) For dCache

401 views • 10 slides

US CMS Tier 1 dCache Timur Perelmutov, Fermilab dCache Workshop, DESY, January 19, 2007 1

US CMS Tier 1 dCache Timur Perelmutov, Fermilab dCache Workshop, DESY, January 19, 2007 1 Stage Area Stage Area -11 nodes-10TB Pools for staging files from tapes managed by dCache File Hopping Pool-to-Pool copy to read pools

407 views • 13 slides

The ! !dCache ! !labs 7 th !International !dCache !Workshop Patrick !Fuhrmann Welcome !to !7 th

The ! !dCache ! !labs 7 th !International !dCache !Workshop Patrick !Fuhrmann Welcome !to !7 th !International !dCache !Workshop !| !HTW !Berlin, !Berlin !| !Patrick !Fuhrmann !| !27 !May !2013 !| !1 Content CMS Disk / Tape separation

551 views • 27 slides

Chimera and NFS 4.1 in dCache dCache.ORG Patrick Fuhrmann Tigran Mkrtchyan presented by Peter

Chimera and NFS 4.1 in dCache dCache.ORG Patrick Fuhrmann Tigran Mkrtchyan presented by Peter van der Reest, DESY at HEPiX, Fall 2007 dCache.ORG Fuhrmann, Mkrtchyan, v.d.Reest HEPiX, Fall 2007 Nov 6, 2007 Content Motivation dCache.ORG

621 views • 16 slides

SRM Dmitry Litvintsev 7th international dCache workshop, May 27-29,2013 dCache Team Dmitry

SRM Dmitry Litvintsev 7th international dCache workshop, May 27-29,2013 dCache Team Dmitry Litvintsev Wednesday, May 29, 13 Plan SRM, a reminder SRM parameters SRM troubleshooting dCache Team 2 Dmitry Litvintsev

827 views • 34 slides

The Tivoli Storage Manager in the Large Hardron Patrick Collider Grid world Fuhrmann for the

dCache.ORG dCache.ORG The Tivoli Storage Manager in the Large Hardron Patrick Collider Grid world Fuhrmann for the dCache people TSM Symposium, Oxford Sep 27, 2005 Patrick Fuhrmann dCache.ORG dCache.ORG LCG Tier Center Mechanism Tier

573 views • 20 slides

dCache Storage Resource Manager introduction Timur Perelmutov For the dCache team Edinburgh,

dCache Storage Resource Manager introduction Timur Perelmutov For the dCache team Edinburgh, November 2007 Nov 13-14, 2007, Edinburgh SRM 2.2 Workshop 1 Project Topology : The Team Head of dCache.ORG Head of Development FNAL : Timur

281 views • 11 slides

7th International dCache Workshop Berlin Bits and Pieces 2013 Christian Bernardt (at DESY)

7th International dCache Workshop Berlin Bits and Pieces 2013 Christian Bernardt (at DESY) Berlin, 28.05.2013 dCache Team dCache Team Chris&an Bernardt Content New webpage IPv6 (OS, JVM, dCache) No PinManager for Tier 2

503 views • 33 slides

BNL dCache Status and Plan dCache Workshop: January 18-19, 2007 dCache Workshop: January 18-19,

BNL dCache Status and Plan dCache Workshop: January 18-19, 2007 dCache Workshop: January 18-19, 2007 Carlos Gamboa, Zhenping (Jane) Liu, Ofer Rind, Carlos Gamboa, Zhenping (Jane) Liu, Ofer Rind, Jason Smith & Yingzi (Iris) Wu &

294 views • 15 slides

dCache Beginners Course Pool Management and Selection Get to know the scientifics behind the

dCache Beginners Course Pool Management and Selection Get to know the scientifics behind the dCache pools. Karlsruhe Institute of Technology (KIT), Steinbuch Centre for Computing (SCC) KIT University of the State of Baden-Wuerttemberg and

131 views • 10 slides

Xrootd/dCache Implementation Martin Radicke File transfer methods in 1.7.0 wide-area transfer

dCache Workshop DESY 18.- 19.01.2007 Hamburg Xrootd/dCache Implementation Martin Radicke File transfer methods in 1.7.0 wide-area transfer (stream-based) GridFTP (GSI authentification) HTTP local-area transfer (random access) dCap (dCache

428 views • 10 slides

dCache: status update and future directions Paul Millar TERENA Storage TF Uppsala, Sweden What

dCache: status update and future directions Paul Millar TERENA Storage TF Uppsala, Sweden What is dCache? Introducing dCache OpenSource software for aggregating heterogeneous storage Immutable filesystem with its own namespace

571 views • 43 slides