DAQ @ LHC: ATLAS Upgrade overview q What has been written in these - - PowerPoint PPT Presentation

daq lhc atlas upgrade overview
SMART_READER_LITE
LIVE PREVIEW

DAQ @ LHC: ATLAS Upgrade overview q What has been written in these - - PowerPoint PPT Presentation

DAQ @ LHC: ATLAS Upgrade overview q What has been written in these Documents? q Well at least for what has a direct impact on DAQ . . . 201 201 2011 2011 2011 2011 1 2012 2012 2012 2012 2012 2012 2013 2013 2013 2013 2014


slide-1
SLIDE 1

DAQ @ LHC: ATLAS Upgrade overview

qWhat has been written in these Documents?

q Well at least for what has a direct impact on DAQ

201 201 2011 2011 2011 2011 1 2012 2012 2012 2012 2012 2012 2013 2013 2013 2013 2014 2014 2014 2014 2015 2015 2015 2015 2016 2016 2016 2016 2017 2017 2017 2017

. . .

Le Letter etter of r of Inte f Intent tent (Lo t (LoI)

  • I)

Phas Phase I ase I Up e I Upgra Upgrade rade o ade of e of the f the AL the ALICE LICE Ex CE Expe E Experim periment, iment, CER nt, CERN CERN-L ERN-LHCC

  • LHCC-2

CC-2012

  • 2012-01

12-012

  • 012

AT ATL ATLA ATLA ATLAS LAS Ph LAS Pha S Phase– Phase–I U e–I Upgr I Upgrad grade, C ade, CER e, CER , CERN-L ERN-LHC N-LHCC-2 HCC-201 C-2011-0 011-012

  • 012

2 Te Tech Techn Technic chnica hnical nical Pr ical Pr ical Prop l Prop l Proposa

  • posal fo

sal for th l for the r the upg e upgrad pgrade grade o rade of th e of the C f the CMS e CMS d MS detec MS detector tector th tor throu through

  • ugh 202

h 2020, 020, CER 0, CERN-L ERN-LH N-LHCC HCC-2011-006 LHC LHC LHCb Ph Cb Ph Cb Phas Phas Phase– Phase–I ase–I ase–I Lo e–I Lo –I LoI LoI ATLA ATLAS LAS Pha S Phas S Phase Phase–II se–II Upg II Upgrad pgrade, rade, CER e, CERN ERN-LH N-LHCC

  • LHCC-20

C-2012-0

  • 2012-022

2-022 22 CMS CMS Ph MS Phas Phase–II ase–II Te –II Techn Technica hnical pr ical prop proposa

  • posal

sal l Te Techn echnic hnica nical D al Desi esign ign Rep Repor ports (T rts (TDR (TDR) R) LH LHCb LHCb Ph Cb Phas Phase–I ase–I Fra –I Frame Framew amewo mework work TD rk TDR DR ALIC ALICE Ph ICE Pha E Phase– Phase–I T e–I TDR I TDR R ATLA ATLAS TLAS LAS TDA S TDAQ DAQ Ph Q Phase Phase–I T se–I TDR I TDR DR CMS CMS CMS Ph MS Phas Phase–I ase–I Trig –I Trigge rigger T ger TDR TDR R LHCb Online TDR LHCb Online TDR LHCb Online TDR LHCb Online TDR LHCb Online TDR LHCb Online TDR ATLA ATLAS LAS TD S TDAQ DAQ Ph Q Phase–I TDR CMS CMS Ph MS Phas Phase–II TDRs

slide-2
SLIDE 2

DAQ @ LHC: ATLAS Upgrade overview

qMachine evolution

...

2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 ... 2030 Ph Phase 0 se 0 LS1 LS1 LS2 Ph Phase I ase I LS3 LS3 Phase Phase II Run 1 Run 1 Run 1 LS1 LS1 Run 2 Run 2 Run 2 LS2 Run 3 Run 3 Run 3 LS3 LS3 Run 4 Run 4 (Prepa (Prepare Run re Run 2) 2) (Pre (Prepare Ph are Phase I) ase I) (Pre (Prepare (Prepare Phase Phase II) II)

Conso

  • nsolidatio

idation Ultima ltimate lumi te luminosit minosity HL-L HL-LHC HC √ s = √ s = 13~1 13~14 TeV TeV 25 ns b 5 ns bunch unch spacin spacing g Linst 1 x1 1 x1034 cm 034 cm-2s-1

  • 2s-1

Linst 2-3

st 2-3 x1034

x1034 cm-2s cm-2s-1 Linst 5 x1 5 x1034 cm 034 cm-2s-1

  • 2s-1

μ ~ 27 ~ 27 μ ~ 55– ~ 55–81 81 μ ~ 140 ~ 140 [with [with levelli levelling] g] ∫Linst ~ 5

st ~ 50 fb-1

0 fb-1 ∫ Linst >

nst > 350 fb

350 fb-1

  • 1

Linst 6-7 6-7 x1034 x1034 cm-2s cm-2s-1 μ ~ 192 ~ 192 [witho [without leve ut levelling] lling] ∫Linst ~ 3

st ~ 3000 f

000 fb-1

  • 1
slide-3
SLIDE 3

DAQ @ LHC: ATLAS Upgrade overview

qMachine evolution

...

2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 ... 2030 Ph Phase 0 se 0 LS1 LS1 LS2 Ph Phase I ase I LS3 LS3 Phase Phase II Run 1 Run 1 Run 1 LS1 LS1 Run 2 Run 2 Run 2 LS2 Run 3 Run 3 Run 3 LS3 LS3 Run 4 Run 4 (Prepa (Prepare Run re Run 2) 2) (Pre (Prepare Ph are Phase I) ase I) (Pre (Prepare (Prepare Phase Phase II) II)

Conso

  • nsolidatio

idation Ultima ltimate lumi te luminosit minosity HL-L HL-LHC HC √ s = √ s = 13~1 13~14 TeV TeV 25 ns b 5 ns bunch unch spacin spacing g Linst 1 x1 1 x1034 cm 034 cm-2s-1

  • 2s-1

Linst 2-3

st 2-3 x1034

x1034 cm-2s cm-2s-1 Linst 5 x1 5 x1034 cm 034 cm-2s-1

  • 2s-1

μ ~ 27 ~ 27 μ ~ 55– ~ 55–81 81 μ ~ 140 ~ 140 [with [with levelli levelling] g] ∫Linst ~ 5

st ~ 50 fb-1

0 fb-1 ∫ Linst >

nst > 350 fb

350 fb-1

  • 1

Linst 6-7 6-7 x1034 x1034 cm-2s cm-2s-1 μ ~ 192 ~ 192 [witho [without leve ut levelling] lling] ∫Linst ~ 3

st ~ 3000 f

000 fb-1

  • 1
slide-4
SLIDE 4

DAQ @ LHC: ATLAS Upgrade overview

qATLAS evolution at a glance

...

2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 ... 2030 Ph Phase 0 se 0 LS1 LS1 LS2 Ph Phase I ase I LS3 LS3 Phase Phase II Run 1 Run 1 Run 1 LS1 LS1 Run 2 Run 2 Run 2 LS2 Run 3 Run 3 Run 3 LS3 LS3 Run 4 Run 4 (Prepa (Prepare Run re Run 2) 2) (Pre (Prepare Ph are Phase I) ase I) (Pre (Prepare (Prepare Phase Phase II) II)

Conso

  • nsolidatio

idation Ultima ltimate lumi te luminosit minosity HL-L HL-LHC HC √ s = √ s = 13~1 13~14 TeV TeV 25 ns b 5 ns bunch unch spacin spacing g Linst 1 x1 1 x1034 cm 034 cm-2s-1

  • 2s-1

Linst 2-3

st 2-3 x1034

x1034 cm-2s cm-2s-1 Linst 5 x1 5 x1034 cm 034 cm-2s-1

  • 2s-1

μ ~ 27 ~ 27 μ ~ 55– ~ 55–81 81 μ ~ 140 ~ 140 [with [with levelli levelling] g] ∫Linst ~ 5

st ~ 50 fb-1

0 fb-1 ∫ Linst >

nst > 350 fb

350 fb-1

  • 1

Linst 6-7 6-7 x1034 x1034 cm-2s cm-2s-1 μ ~ 192 ~ 192 [witho [without leve ut levelling] lling] ∫Linst ~ 3

st ~ 3000 f

000 fb-1

  • 1

New inse w insertable rtable Pixel b Pixel b-layer

  • layer

New µ Sma w µ Small W Small Wheel eel New Tra w Tracking d cking detecto tector New alu w aluminium minium beam beam pipe ipe New Leve w Level-1 C l-1 Calorime lorimeter Upgrade grade of Ca

  • f Calo. elect

. electronics ronics New eva w evaporative

  • rative cool

cooling g Fast Tra st Tracking (F cking (FTK) TK) Upgrade grade of Mu

  • f Muon elect

n electronics ronics 1 kHz to kHz to storag storage Level-1 vel-1 Topolo

  • pological

ical New Leve w Level–0/L l–0/Level–1 vel–1 trigger rigger 5 kHz to kHz to storag storage Other Other Other Other Other Other

ATLAS

slide-5
SLIDE 5

DAQ @ LHC: ATLAS Upgrade overview

qATLAS evolution at a glance

...

2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 ... 2030 Ph Phase 0 se 0 LS1 LS1 LS2 Ph Phase I ase I LS3 LS3 Phase Phase II Run 1 Run 1 Run 1 LS1 LS1 Run 2 Run 2 Run 2 LS2 Run 3 Run 3 Run 3 LS3 LS3 Run 4 Run 4 (Prepa (Prepare Run re Run 2) 2) (Pre (Prepare Ph are Phase I) ase I) (Pre (Prepare (Prepare Phase Phase II) II)

Conso

  • nsolidatio

idation Ultima ltimate lumi te luminosit minosity HL-L HL-LHC HC √ s = √ s = 13~1 13~14 TeV TeV 25 ns b 5 ns bunch unch spacin spacing g Linst 1 x1 1 x1034 cm 034 cm-2s-1

  • 2s-1

Linst 2-3

st 2-3 x1034

x1034 cm-2s cm-2s-1 Linst 5 x1 5 x1034 cm 034 cm-2s-1

  • 2s-1

μ ~ 27 ~ 27 μ ~ 55– ~ 55–81 81 μ ~ 140 ~ 140 [with [with levelli levelling] g] ∫Linst ~ 5

st ~ 50 fb-1

0 fb-1 ∫ Linst >

nst > 350 fb

350 fb-1

  • 1

Linst 6-7 6-7 x1034 x1034 cm-2s cm-2s-1 μ ~ 192 ~ 192 [witho [without leve ut levelling] lling] ∫Linst ~ 3

st ~ 3000 f

000 fb-1

  • 1

New inse w insertable rtable Pixel b Pixel b-layer

  • layer

New µ Sma w µ Small W Small Wheel eel New Tra w Tracking d cking detecto tector New alu w aluminium minium beam beam pipe ipe New Leve w Level-1 C l-1 Calorime lorimeter Upgrade grade of Ca

  • f Calo. elect

. electronics ronics New eva w evaporative

  • rative cool

cooling g Fast Tra st Tracking (F cking (FTK) TK) Upgrade grade of Mu

  • f Muon elect

n electronics ronics 1 kHz to kHz to storag storage Level-1 vel-1 Topolo

  • pological

ical New Leve w Level–0/L l–0/Level–1 vel–1 trigger rigger at least least 5 kHz t kHz to stora storage e Other Other Other Other Other Other

ATLAS

slide-6
SLIDE 6

DAQ @ LHC: ATLAS Upgrade overview

qPrepare for Run 2–3

q Peak luminosity of 2–3 x 1034 cm-2s-1 q µ up to 80 q Level-1 rate 100 kHz

  • TDAQ TDR design values

q Targeting average physics rate to storage of 1 kHz

q No change to data flow architecture

Fract Fraction of tota

  • f total

µ Pixel SCT TRT LAr Tile Muon TDAQ Total/MB 30 6% 6% 13% 58% 7% 5% 3% ~1.2 80 10% 10% 17% 49% 6% 4% 4% ~2.4 LS3 New S3 New Inner det er detector 200 ~3 ~3 Mbyte yte 5

slide-7
SLIDE 7

DAQ @ LHC: ATLAS Upgrade overview

qATLAS TDAQ ... to first order

ROS1 ROS153

...

Event building nodes SFOs nodes

DAQ network

(Multi-layered data network)

Level-2 nodes Event Filter nodes

12 x 12 x

... detector backend ...

ReadOut Links (ROLs)

slide-8
SLIDE 8

DAQ @ LHC: ATLAS Upgrade overview

qROS input bandwidth

q TDR (2003): 100 kHz and 1.6 kbyte ROD fragments at design luminosity q No particular issues

  • Detectors will de-multiplex
  • i.e. deploy more ROLs
  • DAQ deploy more ROSs
  • New detector (IBL) and upgraded CSC RODs compatible with current ROL
  • interface & bandwidth
slide-9
SLIDE 9

DAQ @ LHC: ATLAS Upgrade overview

qROS request rate and output bandwidth

q Defined by the Trigger menu q Requirements

  • 25% readout fraction per ROL @ 100 kHz for 12 ROLs @ 160 Mbyte/s
  • Level-1 accept rate up to 120 kHz
  • > 200 Mbyte buffer per ROL

q Targeting

  • 50% readout fraction per ROL @ 100 kHz for 12 ROLs @ 160 Mbyte/s

q Next generation ROS

  • New ROBIN: use ALICE Common Readout Receiver Card (C-RORC)
  • New ROS PC: More performant; 2x10 Gbit Eth.
slide-10
SLIDE 10

DAQ @ LHC: ATLAS Upgrade overview

qATLAS TDAQ ... to first order

ROS1 ROS153

...

Event building nodes SFOs nodes

DAQ network

(Multi-layered data network)

Level-2 nodes Event Filter nodes

12 x 12 x

... detector backend ...

ReadOut Links (ROLs)

slide-11
SLIDE 11

qLast month ...

SFI HLT HLT ROS

DAQ @ LHC: ATLAS Upgrade overview

L2S

...

2x1 Gbps 2x1 Gbps

SFOs

slide-12
SLIDE 12

qAs of last week (and in progress) ...

ROS

DAQ @ LHC: ATLAS Upgrade overview

...

New SFOs Legacy SFOs

8x10 Gbps

To Mass Storage HLT HLT

slide-13
SLIDE 13

qAs of last week ...

ROS

DAQ @ LHC: ATLAS Upgrade overview

...

10 Gbps 10 Gbps 10 Gbps 8x10 Gbps 10 Gbps 10 Gbps 10 Gbps 1 G b p s 10 Gbps 10 Gbps 1 G b p s

New SFOs

8x10 Gbps

To Mass Storage

2x1 Gbps

Legacy SFOs HLT HLT

slide-14
SLIDE 14

qIncreased connectivity—as required up to 2018

ROS

DAQ @ LHC: ATLAS Upgrade overview

...

New SFOs To Mass Storage Legacy SFOs HLT HLT

slide-15
SLIDE 15

DAQ @ LHC: ATLAS Upgrade overview

qATLAS evolution at a glance

...

2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 ... 2030 Ph Phase 0 se 0 LS1 LS1 LS2 Ph Phase I ase I LS3 LS3 Phase Phase II Run 1 Run 1 Run 1 LS1 LS1 Run 2 Run 2 Run 2 LS2 Run 3 Run 3 Run 3 LS3 LS3 Run 4 Run 4 (Prepa (Prepare Run re Run 2) 2) (Pre (Prepare Ph are Phase I) ase I) (Pre (Prepare (Prepare Phase Phase II) II)

Conso

  • nsolidatio

idation Ultima ltimate lumi te luminosit minosity HL-L HL-LHC HC √ s = √ s = 13~1 13~14 TeV TeV 25 ns b 5 ns bunch unch spacin spacing g Linst 1 x1 1 x1034 cm 034 cm-2s-1

  • 2s-1

Linst 2-3

st 2-3 x1034

x1034 cm-2s cm-2s-1 Linst 5 x1 5 x1034 cm 034 cm-2s-1

  • 2s-1

μ ~ 27 ~ 27 μ ~ 55– ~ 55–81 81 μ ~ 140 ~ 140 [with [with levelli levelling] g] ∫Linst ~ 5

st ~ 50 fb-1

0 fb-1 ∫ Linst >

nst > 350 fb

350 fb-1

  • 1

Linst 6-7 6-7 x1034 x1034 cm-2s cm-2s-1 μ ~ 192 ~ 192 [witho [without leve ut levelling] lling] ∫Linst ~ 3

st ~ 3000 f

000 fb-1

  • 1

New inse w insertabl sertable Pixe Pixel b-laye l b-layer New µ Sma w µ Small Small Whee heel

New Tra ew Tracking cking detecto etector r

New be w beam pip m pipe e Level-1 vel-1 Calori Calorimeter meter

Upgrad pgrade of Ca

  • f Calo. ele
  • lo. electronics

ctronics

New eva w evapora porative co ive cooling ling Fast Tra st Tracking cking (FTK) (FTK)

Upgrad pgrade of Mu

  • f Muon ele
  • n electronics

ctronics

1 kHz to kHz to stora storage ge

Level-1 evel-1 Topolo Topological gical New Le ew Level–0/L vel–0/Level–1 evel–1 trigge trigger

5 kHz to kHz to stora storage ge Other Other Other Other Other Other

ATLAS

slide-16
SLIDE 16

DAQ @ LHC: ATLAS Upgrade overview

qPrepare for Phase II, i.e. Run 4

q ATLAS Phase II LoI: Level-1 base line proposal

  • Two-stage synchronous First Level Trigger
  • Level-0 accept rate and latency of 500 kHz & ~3 µs respectively
  • Level-1 accept rate and latency of 200 kHz & ~17 µs respectively
  • Event size at µ 200 ~5 Mbyte

q Level-0 is the Level-1 Trigger used in Run 2–3

  • Calorimeter trigger: Digital Electron & Jet Feature extractor
  • Including associated changes to calorimeter electronics
  • Excluding today’s Level-1 calorimeter trigger system
  • Muon trigger: today’s L1Muon and use of New Small Wheel track segment
  • Exception: new Level-0 CTP

q Level-1

  • RoI based Track Finding seeded by Level-0 calorimeter and muon RoIs
  • Central trigger processor (including selection based on event topology)
  • Subject to further study, increased granularity calorimeter data (seeded by Level-0)
  • Subject to further study, use of MDT’s in the End-cap (and Barrel?)
slide-17
SLIDE 17

DAQ @ LHC: ATLAS Upgrade overview

Level-1 muon Level-1 calo.

Central trigger

Level-1 CTP

Muon trigger Calorimeter trigger

~2 Time (µs) ~100 Rate (kHz)

slide-18
SLIDE 18

DAQ @ LHC: ATLAS Upgrade overview

Level-0 muon Level-0 calo.

Central trigger

Level-0 CTP

Muon trigger Calorimeter trigger

~3 Time (µs) ~500 Rate (kHz)

slide-19
SLIDE 19

DAQ @ LHC: ATLAS Upgrade overview

Level-0 muon Level-0 calo.

Central trigger

Level-1 muon Level-1 calo. Level-1 Track Level-0 CTP Level-1 CTP

Muon trigger Calorimeter trigger

~3 20 Time (µs)

Maximum MDT readout Latency

~500 ~200 Rate (kHz)

Inner Detector constraint MDT rate constraint

slide-20
SLIDE 20

DAQ @ LHC: ATLAS Upgrade overview

qSummary

q From 2014–2022

  • 100 kHz * 2.4 Mbyte from detector into read-out buffers
  • HLT selection requires up to 50% through network
  • —> 1 Tbit/s
  • At least 1 kHz x 2.4 Mbyte to storage

q From 2022

  • Detector Readout: at least 200 kHz * 5 Mbyte into read-out buffers
  • New detector readout architecture ... blank paper
  • Assume HLT selection still only requires up to 50% through network
  • –> 5 Tbit/s

q TDAQ stresses that 200 kHz is a minimal requirement

  • After all, full readout @ 200 kHz ... still only 10 Tbit/s
  • ... 200 kHz –> 500 kHz –> 1 MHz?

q Challenge is reading out detector at higher (Level-1) rates

  • (Potentially) legacy on-detector electronics
  • Front-end link bandwidth, i.e. LoI based on today’s GBT