CERN and the LHC Computing Challenge by Wolf gang von Rden Head, - PowerPoint PPT Presentation

where the Web was born CERN and the LHC Computing Challenge by Wolf gang von Rüden Head, I T Department HP DutchWorld 12 th October 2004 October 2004 HP DutchWorld 2004 1

CERN is also: What is CERN? - 2500 staff (physicists, engineers, technicians, …) - Some 6500 visiting scientists (half of the • CERN is the world's largest particle physics centre world's particle physicists) • Particle physics is about: They come from 500 universities - elementary particles, the constituents all matter representing in the Universe is made of 80 nationalities. - fundamental forces which hold matter together • Particles physics requires: - special tools to create and study new particles October 2004 HP DutchWorld 2004 2

What is CERN? • Physicists smash particles into each other to: - identify their components - create new particles - reveal the nature of the interactions between them - recreate the environment present at the origin of our Universe (big bang) • What for? To answer fundamental questions like: how did the Universe begin? What is the origin of mass? What is the nature of antimatter? October 2004 HP DutchWorld 2004 3

What is CERN? The special tools for particle physics are: • ACCELERATORS, huge machines able to speed up particles to very high energies before colliding them into other particles • DETECTORS, massive instruments which register the particles produced when the accelerated particles collide • COMPUTING, to re-construct the collisions, to extract the physics data and perform the analysis October 2004 HP DutchWorld 2004 4

What is CERN? • CERN has made many important discoveries, but our current understanding of the Universe is still incomplete! • Higher energy collisions are the key to further discoveries of more massive particles (E=mc 2 ) • One particle predicted by theorists remains elusive: the Higgs boson October 2004 HP DutchWorld 2004 5

What is CERN? • To answer some of the still open questions, CERN is building a new accelerator, the Large Hadron Collider (LHC) • The LHC will be the most powerful instrument ever built to investigate elementary particles • Four very large experiments matching this machine are under construction, ready to make new discoveries in 2007 and beyond • If the Higgs boson exists, then we will most certainly find it October 2004 HP DutchWorld 2004 6

CERN’s accelerator complex Experiment A Experiment B • PS – Proton Synchrotron • SPS – Super Proton Synchrotron • LHC – Large Hadron Collider October 2004 HP DutchWorld 2004 7

The CERN Site Mont Blanc, 4810 m Downtown Geneva LHCb ATLAS CERN sites CMS ALICE October 2004 HP DutchWorld 2004 8

What is LHC? LHC is due to switch on in 2007 Four experiments, • LHC will collide beams of protons at an energy of 14 TeV with detectors as ‘big as cathedrals’: ALICE • Using the latest super-conducting technologies, it will ATLAS CMS operate at about – 270 º C, just above the absolute zero of LHCb temperature • With its 27 km circumference, the accelerator will be the largest superconducting installation in the world. October 2004 HP DutchWorld 2004 9

Typical Experiment Layout • Complex system of detectors centred around the beam interaction point October 2004 HP DutchWorld 2004 10

Particle Detection Techniques Multiple layers of increasing density to identify particles October 2004 HP DutchWorld 2004 11

ATLAS, one of the four LHC experiments ATLAS has 150 million measurement channels As tall as our main building ! October 2004 HP DutchWorld 2004 12

1 Megabyte (1MB) LHC data (simplified) A digital photo 1 Gigabyte (1GB) = 1000MB A DVD movie Per experiment: 1 Terabyte (1TB) = 1000GB • 40 million collisions per second World annual book production • After filtering, 100 collisions of interest per second 1 Petabyte (1PB) = 1000TB • A Megabyte of digitised information for each 10% of the annual collision = recording rate of 0.1 Gigabytes/sec production by LHC experiments • 1 billion collisions recorded = 1 Petabyte/year 1 Exabyte (1EB) = 1000 PB Total: ~10.000.000.000.000.000 bytes/year = 1% of World annual information production CMS LHCb ATLAS ALICE October 2004 HP DutchWorld 2004 13

Balloon ( 3 0 Km ) LHC data (simplified) CD stack w ith 1 year LHC data! ( ~ 2 0 Km ) LHC data correspond to about 20 million CDs each year Concorde ( 1 5 Km ) Where will the experiments store all of these data? Mt. Blanc ( 4 .8 Km ) October 2004 HP DutchWorld 2004 14

LHC data processing LHC data analysis requires a computing power equivalent to ~ 70,000 of today's fastest PC processors Where will the experiments find such a computing power? October 2004 HP DutchWorld 2004 15

Data Handling and Computation for Physics Analysis detector selection & selection & reconstruction reconstruction reconstruction processed event data summary data raw data batch batch physics event physics event reprocessing analysis reprocessing analysis analysis analysis objects (extracted by physics topic) event les.robert son@cern.ch event simulation simulation simulation interactive physics analysis

High Throughput Computing WAN application servers mass storage data cache simple, flexible architecture • easy to integrate mass market components • easy evolution to new technologies October 2004 HP DutchWorld 2004 17

High Throughput Computing WAN application servers Large aggregate capacity, performance � price sensitive on acquisition, cost sensitive on operation Open solutions and standards, simplified architecture � have worked well for the past 15 years in mass sustaining high growth of capacity and performance storage while containing/reducing costs data cache simple, flexible architecture • easy to integrate mass market components • easy evolution to new technologies October 2004 HP DutchWorld 2004 18

Computing at CERN today • High-throughput computing based on reliable “commodity” technology • About 2000 dual processor PCs • More than 3 Petabyte of data on disk (10%) and tapes (90%) Nowhere near enough! October 2004 HP DutchWorld 2004 19

Building up LHC computing at CERN Estimated CPU Capacity at CERN 6,000 Networking by 2007: 5,000 ~ 70 Gb/s to external centres 4,000 Moore’s law (based ~ 100 Gb/s general networking K SI95 3,000 on 2000) 2,000 1,000 0 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 year Estimated DISK Capacity at CERN Estimated Mass Storage at CERN today 7000 140 6000 120 5000 100 PetaBytes 80 TeraBytes 4000 Other 60 experiments 3000 40 LHC 2000 20 0 1000 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 0 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 Year year October 2004 HP DutchWorld 2004 20

Preparing for 7,000 boxes in 2008 Preparing for 7,000 boxes in 2008 New electrical substation 2.5 MW power October 2004 HP DutchWorld 2004 21

Preparing for 7,000 boxes in 2008 Preparing for 7,000 boxes in 2008 October 2004 HP DutchWorld 2004 22

Preparing for 7,000 boxes in 2008 Preparing for 7,000 boxes in 2008 Today: 400 TB Disk Storage 2000 CPUs 50’000 Tape Slots October 2004 HP DutchWorld 2004 23

Computing for LHC Europe: ~270 institutes ~4500 users Elsewhere: ~200 institutes • Problem: even with computer centre upgrade, CERN ~1600 users can only provide a fraction of the necessary resources • Solution: computing centres, which were isolated in the past, will now be connected, uniting the computing resources of particle physicists in the world using GRID technologies! October 2004 HP DutchWorld 2004 24

Grid @ CERN • LHC Computing Grid (LCG) – the flagship project • Enabling Grids for E-Science in Europe (EGEE) • Has started in April 2004 with 70 partners and 32M€ EU funding • Will provide the next generation middleware • Will run a 24/7 Grid service together with LCG • CERN openlab for DataGrid applications • Funded by CERN and Industry • Main project: opencluster • New project: openlab security (under preparation) October 2004 HP DutchWorld 2004 25

26 HP DutchWorld 2004 LCG-2 October 2004

27 HP Puerto Rico HP DutchWorld 2004 LCG-2 October 2004

28 HP DutchWorld 2004 Grid3 4 National Labs 25 Universities 2800 CPUs LCG-2 October 2004

29 3200 cpus 30 sites HP DutchWorld 2004 Grid3 4 National Labs 25 Universities 2800 CPUs LCG-2 October 2004

LCG-2 30 sites 3200 cpus Soon to come: HP Labs Palo Alto and Bristol 25 Universities 4 National Labs HP supported sites in Singapore and China 2800 CPUs HP Puerto Rico Grid3 October 2004 HP DutchWorld 2004 30

In partnership with and sponsored by October 2004 HP DutchWorld 2004 31

CERN openlab • IT Department’s main R&D focus • Framework for collaboration with industry • Evaluation, integration, validation – of cutting-edge technologies that can serve LCG • Initially a 3-year lifetime – As of 1.1.2003 – Later: Annual prolongations • Slogan: “You make it, we break it”. LCG LCG CERN openlab CERN openlab 02 03 04 05 06 07 08 October 2004 HP DutchWorld 2004 32