RAL Report for DUNE-UK meeting Fergus Wilson Chris Brew Raja - PowerPoint PPT Presentation

Jan 07, 2024 •227 likes •294 views

RAL Report for DUNE-UK meeting Fergus Wilson Chris Brew Raja Nandakumar 1 Workload management system (WMS) DUNE currently uses fife / poms as WMS Aim : Test out DIRAC as an alternative WMS for DUNE For now, only proof-of-concept

RAL Report for DUNE-UK meeting Fergus Wilson Chris Brew Raja Nandakumar 1
Workload management system (WMS) ➢ DUNE currently uses fife / poms as WMS ➢ Aim : Test out DIRAC as an alternative WMS for DUNE ➔ For now, only proof-of-concept ● Run DUNE jobs on “the WLCG grid” using a DIRAC system – WLCG : Computing grid originally developed for LHC ● Talk to various file catalog databases – SAM – RUCIO – DFC (Dirac File Catalog) ● Also run a full production chain for a Monte Carlo simulation – Generation, reconstruction … ● Any other interesting feature considered potentially useful ➢ Following slides in chronogical order of work done 2
DUNE on WLCG grid ➢ DUNE job definition ➔ “lar” jobs for everything ● Do the same on the grid ➢ Pick up fcl files as needed ➔ All software on cvmfs ➢ Run some generic analysis job ● Use SAM to find a DUNE file while running on the grid ● Read the file ➢ Use DIRAC instance at Imperial 3
Dirac as WMS ➢ Run a full chain MC simulation ➔ Use old simulation production ● mcc11_DP_RITM0761645 ➔ 4 steps ● Generation, Geant4, Detector simulation, Reconstruction ➔ 5 events / job ➔ Retain only final root file for output ● At RAL-PPD (Tier-2) storage ➔ Register file in DFC and SAM ● Easy and automatic in DIRAC ➔ Able to perform basic rucio operations ➢ Automatically recovered from various site failures ➔ No application failures seen so far 4
DIRAC and SAM ➢ Integrated SAM delivery into DIRAC jobs ➔ Run lar jobs for processing data ➔ Query SAM for input data at Run time ➔ Used test dataset present at FNAL ● Ran over 1426 files – All jobs ran overnight ● Also tested separately with data at RAL 5
Summary ➢ Demonstrated usability of DIRAC as a WMS for DUNE ➔ Run simple user jobs ● https://indico.fnal.gov/event/21328/session/0/contribution/7/material/slides/0.pdf ➔ Full chain MC test “production” ● https://indico.fnal.gov/event/21506/session/0/contribution/8/material/slides/0.pdf ➔ Use SAM for delivering data ● http://samweb.fnal.gov:8480/station_monitor/dune/stations/dune/projects/test_nraja-5770 ● https://docs.dunescience.org/cgi-bin/sso/RetrieveFile? docid=12982&filename=DUNE_MonthlyReport_201909.pdf&version=10 ➔ Rucio also usable ➢ Awaiting metrics to be defined for comparing different WMS systems 6

Recommend

DUNE Project Status Eric James DUNE PMG Meeting March 21, 2017 Outline ES&H Update

DUNE Project Status Eric James DUNE PMG Meeting March 21, 2017 Outline ES&H Update QA Update Schedule & Budget Status PM Update Far Detector Report ProtoDUNE-SP Report Design & Construction reports by

194 views • 18 slides

SBND (UK)* software and physics report Dom Brailsford on behalf of SBND UK DUNE UK meeting at

SBND (UK)* software and physics report Dom Brailsford on behalf of SBND UK DUNE UK meeting at Manchester 06/03/19 Covers topics not already presented at this meeting* The Short Baseline Near Detector (SBND) Serves as near detector of the

533 views • 24 slides

DUNE APA Requirements study Yichen Li Brookhaven National Laboratory DUNE APA Consortium

DUNE APA Requirements study Yichen Li Brookhaven National Laboratory DUNE APA Consortium Meeting 04/30/2018 DUNE-doc-7899-v1 DUNE APA Technical Requirements The Deep Underground Neutrino Experiment (DUNE) is planning for one or more of

558 views • 19 slides

Comments on DUNE DAQ Challenges Architecture Ba Babak Abi DUNE DAQ Simulations Meeting 16 16

Comments on DUNE DAQ Challenges Architecture Ba Babak Abi DUNE DAQ Simulations Meeting 16 16 Oct 20 2017 17 Review : Alternative DAQ Architectures DUNE DAQ data fellow More about GPU based Architectures 1 DAQ

276 views • 11 slides

Thoughts on alternate DUNE DAQ design Georgia Karagiorgi DUNE DAQ Meeting Oct. 16, 2017

Thoughts on alternate DUNE DAQ design Georgia Karagiorgi DUNE DAQ Meeting Oct. 16, 2017 Introduction What is presented in this talk is a conceptual DAQ design & architecture for the DUNE FD ; I will advocate it should be explored

222 views • 18 slides

Summary of Joint DUNE/SBN Lessons Learned Meeting Meeting Overview Summaries and

Summary of Joint DUNE/SBN Lessons Learned Meeting Meeting Overview Summaries and Highlights Josh Klein, Penn Overview Representatives from MicroBooNE, DUNE 35t, and DUNE Two sessions: Detector Operations Detector

735 views • 41 slides

DUNE Fitter Validation Daniel Cherdack Colorado State University DUNE LBPWG Meeting Monday July

DUNE Fitter Validation Daniel Cherdack Colorado State University DUNE LBPWG Meeting Monday July 3 rd , 2017 1 Motivation DUNE now has access to several Fitters GloBES/MGT LOAF VALOR Cafana Lfit Major benefit of many

278 views • 9 slides

DUNE Electrical Review Guidelines Theresa Shaw DUNE Technical Board Meeting November 7, 2018

DUNE Electrical Review Guidelines Theresa Shaw DUNE Technical Board Meeting November 7, 2018 Expectations of review materials for electrical aspects of a project Guidance document in DUNE DocDB 11269 This is a general list to be

279 views • 8 slides

Opportunities for international DUNE communication and outreach Kurt Riesselmann kurtr@fnal.gov

Opportunities for international DUNE communication and outreach Kurt Riesselmann kurtr@fnal.gov DUNE IB Meeting 30 Jan 2018 Example: Global coverage of LBNF/DUNE groundbreaking 23 DUNE member institutions wrote articles and press releases

469 views • 10 slides

Deep Underground Neutrino Experiment (DUNE) 2 DRAFT Technical Design Report 3 Volume n/a: 4

https://v1.overleaf.com/15790648swrpvqxhkshy 1 Deep Underground Neutrino Experiment (DUNE) 2 DRAFT Technical Design Report 3 Volume n/a: 4 (Calibration Information for SP volumes) 5 March 8, 2019 6 The DUNE Collaboration 7 8 Contents

793 views • 43 slides

DUNE timing system Stoyan Trilov, University of Bristol DUNE UK Meeting 11/12/2019 1 Outline

DUNE timing system Stoyan Trilov, University of Bristol DUNE UK Meeting 11/12/2019 1 Outline DUNE timing system Requirements Design Hardware CCM Summary 11/12/2019 2 DUNE timing requirements Clock alignment within

402 views • 8 slides

DUNE Beyond Standard Model Physics Group Meeting Nonstandard Interactions Subgroup Recent

DUNE Beyond Standard Model Physics Group Meeting Nonstandard Interactions Subgroup Recent activities report March 15 th , 2016 Clio Moura (UFABC Brazil) Group participants (or that expressed interest) Omar Miranda (Cinvestav

425 views • 19 slides

Usefulness of a Carbon target in DUNE ND : first thoughts DUNE ND meeting 15 May 2019

Usefulness of a Carbon target in DUNE ND : first thoughts DUNE ND meeting 15 May 2019 S.Bolognesi IRFU/CEA Why neutrino-nucleus interactions are important Modeling of neutrino-nucleus interactions is needed for ND FD extrapolation

688 views • 13 slides

Physics in DUNE UK WP1 Steve Dennis DUNE UK Meeting University of Manchester 05/03/2019 Steve

Physics in DUNE UK WP1 Steve Dennis DUNE UK Meeting University of Manchester 05/03/2019 Steve Dennis 1 Introduction An important time for DUNE physics as much as anything else. The physics TDR is due in May. Final analysis should

439 views • 20 slides

An Expression of Interest to hold a DUNE Collaboration Meeting at Manchester Stefan

An Expression of Interest to hold a DUNE Collaboration Meeting at Manchester Stefan Sldner-Rembold, on behalf of the DUNE universities in the North of England The City - Founded in Roman times - Birthplace of Industrial Revolution (cotton

525 views • 9 slides

DUNE Project Status Jolie Macier DUNE PMG Meeting 17 April 2018 Outline ES&H Update

DUNE Project Status Jolie Macier DUNE PMG Meeting 17 April 2018 Outline ES&H Update QA Update Schedule & Budget Status PM Update DUNE Update FD Engineering FD Installation FD TPC Electronics FD

441 views • 26 slides

DUNE FD DAQ Firmware Status (October DAQ Sprint Summary) David Cussans DUNE Upstream DAQ Meeting

DUNE FD DAQ Firmware Status (October DAQ Sprint Summary) David Cussans DUNE Upstream DAQ Meeting 29/Oct/19 Outline What did we try to do? How much did we get done? Outstanding items? - What can we get done in Monday DAQ Days?

300 views • 19 slides

Status of DUNE DAQ Hardware/Firmware Development Status David Cussans DUNE DAQ Meeting 15 th

Status of DUNE DAQ Hardware/Firmware Development Status David Cussans DUNE DAQ Meeting 15 th October, 2018 Introduction Concentrating on firmware Agnostic of where it is implemented For TDR firmware will be demonstrated on

661 views • 14 slides

A summary of FBK tests in view of the TDR Francesco Terranova DUNE Photosensor Meeting

A summary of FBK tests in view of the TDR Francesco Terranova DUNE Photosensor Meeting (DUNE-SP-PDS) 9 Apr 2019 Main items We have been testing two technologies from FBK: NUV-HD-SF: lower breakdown voltage, higher DCS NUV-HD-LF:

336 views • 7 slides

LBNF/DUNE Beam & Target System John Back, University of Warwick DUNE UK Meeting March 5,

LBNF LBNF/DUNE Beam & Target System John Back, University of Warwick DUNE UK Meeting March 5, 2019 Introduction Neutrinos from decays of secondary particles ( , ,K): - 120 GeV proton collisions with graphite target, 1.2 MW then

299 views • 15 slides

35-T Prototype M. Zuckerbrot Joint DUNE/SBN Meeting: Lessons Learned Fermilab, 15 May 2017

Cryogenics: Experience from MicroBooNE and the DUNE 35-T Prototype M. Zuckerbrot Joint DUNE/SBN Meeting: Lessons Learned Fermilab, 15 May 2017 Presentation Outline Modes of Operation Cryogenic System Process Flow Diagram

369 views • 20 slides

Physics TDR Assessment NDK Group Jen Raaf and Michel Sorel DUNE Physics Conveners Meeting

Physics TDR Assessment NDK Group Jen Raaf and Michel Sorel DUNE Physics Conveners Meeting December 13th, 2016 1 Part 1: CDR 2 CDR assumptions Signal efficiency and background rates for NDK modes considered promising in DUNE: Table 4.1: E

415 views • 18 slides

Proposal for DUNE 2018 Collaboration Meeting at the University of Minnesota Proposal for DUNE

Proposal for DUNE 2018 Collaboration Meeting at the University of Minnesota Proposal for DUNE 2018 Collaboration Meeting at the University of Minnesota When? Mid-May to Mid-August, 2018 Where? Tate Hall Newly renovated for

249 views • 5 slides

Proposal to hold a DUNE Collaboration Meeting at the University of Manchester The University of

Proposal to hold a DUNE Collaboration Meeting at the University of Manchester The University of Manchesters Particle Physics Group proposes to hold a DUNE Collaboration Meeting in the North West of England, at the University of Manchester.

253 views • 3 slides