introduction
play

Introduction June 2005 openlab Workshop 2 1 Grid @ CERN LCG: - PDF document

Oct 10, 2023 •686 likes •837 views

where the Web was born Experience of Adding New Architectures to the LCG Production Environment Andreas Unterkircher, openlab fellow Sverre Jarp, CTO CERN openlab Industrializing the Grid openlab Workshop 13 June 2005 June

  1. “where the Web was born” Experience of Adding New Architectures to the LCG Production Environment Andreas Unterkircher, openlab fellow Sverre Jarp, CTO CERN openlab “Industrializing the Grid” – openlab Workshop 13 June 2005 June 2005 openlab Workshop 1 Introduction June 2005 openlab Workshop 2 1

  2. Grid @ CERN LCG: LHC Computing Grid – the deployment project • • Will run the 24/7 Grid service • EGEE: Enabling Grids for E-Science in Europe • Started in April 2004 with 70 partners and 32M€ EU funding • Will provide the next generation middleware for LCG • CERN openlab for DataGrid applications • Started in 2003 - Funded by Industry and CERN • Main project: opencluster (including 100 Itanium nodes) • R&D aimed at deployment in LCG June 2005 openlab Workshop 3 Computing for LHC Europe: ~270 institutes ~4500 users Elsewhere: ~200 institutes • Problem: even with an upgraded computer centre, ~1600 users CERN can only provide a fraction of the necessary resources • Solution: computing centres, which were isolated in the past, will now be connected, uniting the computing resources of particle physicists in the world using GRID technologies! June 2005 openlab Workshop 4 2

  3. LCG-2 As of March 2005: • biggest Grid project in the world • 130 sites in 31 countries • 12’000 processors • 10 millions Gigabytes storage June 2005 openlab Workshop 5 Openlab: Tight integration with the LCG testbed 10GE WAN connection 4 * GE connections to the backbone 4 *ENTERASYS N7 10 GE Switches 2 * Enterasys “new” Series 36 Disk Server 10 GE per node (dual P4, IDE disks, ~ 1TB disk space each) 10 GE per node 2 * 100 IA32 CPU Server 10GE (dual 2.4 GHz P4, 1 GB mem.) 1 GE per node 2 * 50 Itanium Server (dual 1.3/1.5 GHz Itanium2, 2 GB mem) 28 TB , IBM 12 Tape Server StorageTank STK 9940B High Througput High Througput Prototype (openlab + LCG prototype) Prototype (openlab + LCG prototype) June 2005 openlab Workshop 6 3

  4. Service Challenge 3 • 20 Itanium nodes: June 2005 openlab Workshop 7 64-bit porting project Itanium / Itanium Processor Family (IPF) / IA-64 June 2005 openlab Workshop 8 4

  5. The 64-bit issue • What exactly is meant? • Simple: – Linux on 32-bit hardware uses “ILP32” • Int = Long = Pointer (32 bit) – Linux on 64-bit hardware uses I32LP64 • Int stays 32-bit • Pointer = Long (64 bit) • As a result: – For instance: • Any attempt to cast a pointer to Int (and back) � Fatal error !!! June 2005 openlab Workshop 9 LCG components Soon: gLite, FTS from EGEE EDG middleware: workload, monitoring, LCG/HEP specific: LFC, information mgmt, dCache, CASTOR ... resource mgmt, ... VDT 1.2 Globus (2.x) External software: MySQL, batch system, perl modules, xerces, tomcat,... Scientific Linux 3 (SL3) June 2005 openlab Workshop 10 5

  6. LCG architecture Minimal LCG site: User Interface Computing Element, Worker Node(s), Storage Element, site BDII, R-GMA producer Resource Broker Further LCG nodes: •File Catalog (LFC) •MyProxy Server •Monitoring •Higher level BDIIs June 2005 openlab Workshop 11 Timeline 1 st CE & WN available Start manual VDT port LCG-2_4_0 with YAIM 1 st Itanium grid job support on Start manual EDG port submitted (EIS testbed) IPF Development of Itanium specific installation method (SmartFrog) VDT releases IPF rpms LCG build machine on Itanium Sept 2004 Feb May Dec 2005 March April July Installation at CNIC Installation at HP Bristol Installation Installation at Poznan at HP Puerto Supercomputing Center Rico Start HEP porting (SEAL,...) IPF modifications start to get into CVS June 2005 openlab Workshop 12 6

  7. Original LCG build model Check out from source CVS: • EDG software • LCG specific code Everything else is “external”. A “build machine” automatically does the build after the checkout (uses GNU autotools) June 2005 openlab Workshop 13 Initial status (2003) • LCG build machine supported only IA-32 with specific version of Red Hat • No binaries available for Itanium/IA-64 • Hardly any documentation • Installation of LCG only via LCFGng (fully automatic, IA-32 only) – manual installation was considered to be “extremely difficult“ (EDG manual) June 2005 openlab Workshop 14 7

  8. Initial strategy • Started to port everything on our own • One doctoral student & one fellow – Stephen Eccles (now: Lancaster University) – Andreas Unterkircher (CERN) • After 6 months we were able to install a minimal (CE,WN,SE) Itanium LCG site and successfully submit jobs. June 2005 openlab Workshop 15 Initial obstacles (1) • VDT has its own (not documented) build procedure. We had to do “reverse engineering“. • It was often difficult to find the original sources of rpms. EDG used sometimes “special“ versions of well known libraries (e.g. Boost). June 2005 openlab Workshop 16 8

  9. Initial obstacles (2) • EDG build procedure was hard-coded for IA-32 on RH 7.3. • As our changes did not get back into the CVS it was difficult for us to keep track with the latest releases • The code had, indeed, several 64-bit issues but the complicated build procedures (EDG as well as VDT) caused us much more trouble. June 2005 openlab Workshop 17 Lessons learnt (1) • Initial effort was necessary to get noticed by the community. – E.g. when VDT saw that we are serious they started to provide Itanium rpms on their own. • Vital: Always get changes back into the CVS on a regular basis. June 2005 openlab Workshop 18 9

  10. Lessons learnt (2) • Support for different compilers, OS‘s and architectures should be considered in the build procedure from the beginning and used for testing on a regular basis. • From a first proof of concept to a fully supported official release can take a long time: – In our case: ~1 year June 2005 openlab Workshop 19 Lessons learnt (3) • Porting LCG to Itanium was a “chicken and egg problem“: – LCG was not considering porting as there is no HEP software for Itanium – Physicists did not port to Itanium as there were no such resources in LCG. • Thus we also started porting of major HEP software (SEAL, POOL, etc.) • Note that ALICE has all its software 64-bit clean! – Mainly an issue of “initial mindset“ June 2005 openlab Workshop 20 10

  11. Porting to EM64T/AMD64 (1) • Should be much easier as IA64 (64bit) code changes are also valid for these platforms. – Exactly the same “I32LP64“ model • First one has to ensure that the basic packages (VDT, external software) are available. • Getting modifications back to CVS immediately will be important. June 2005 openlab Workshop 21 Porting to EM64T/AMD64 (2) • Build procedures not recognizing the architecture could be again the source of much trouble – this must be addressed immediately. • Hopefully EGEE/gLite will prove to be better in this respect than EDG – We (and others) are providing platforms for testing • Finally worth mentioning: – Some ports of EDG to other platforms (e.g. PowerPC) are available on the Grid-Ireland homepage. June 2005 openlab Workshop 22 11

  12. Overview of 64-bit porting • Phase 1 Completed: – ROOT (Data analysis framework) • http://root.cern.ch/ – Geant4 (Physics simulation framework) • http://cern.ch/geant4 – CLHEP (C++ Class Library) • http://proj-clhep.web.cern.ch/proj-clhep/ – CASTOR (CERN Hierarchical Storage Manager) • http://cern.ch/castor – LCG-2 Grid middleware • Originated from EDG (European Data Grid) – http://lcg.web.cern.ch/LCG/Sites/releases.html • Itanium version: – http://openlab-mu-internal.web.cern.ch/openlab-mu- internal/Projects/LCGonIA64/LCGonIA64.asp June 2005 openlab Workshop 23 64-bit porting (cont’d) • Next aim: – Allow the simulation stack of one of the LHC experiments (LHCb) to work on Itanium • Set of external packages (Boost, etc.): OK • Base set of CERN packages (Geant4, ROOT, CLHEP): OK • HEP/LCG packages (SEAL, POOL, PI): In progress • Specific packages from the experiment (Gaudi, Gauss, Ganga): In progress – Once this experiment’s stack is complete, ATLAS and CMS frameworks should also be within range – By the way, Intel, Munich is apparently also working on the ATLAS software June 2005 openlab Workshop 24 12

  13. Virtualization project June 2005 openlab Workshop 25 Virtualization • Our history – Xen benchmarked with CERN simulation workload on IA-32 • Work done by summer student 2004 – Project work on IO workloads under Xen • Two students – Project work on Xen on Itanium • One of the two students (Master thesis in this semester) – Collaboration with HP Labs – Additionally: • One openlab fellow is continuing the work on IA32 w/Linux Fedora version – Aim at IO intensive workloads (ROOT analysis, etc.) • Rationale: next generation processors (such as IPF Montecito) will have hardware support for virtualization • Question: Will virtualization be one of the underpinnings of future Grid security? June 2005 openlab Workshop 26 13

  14. Conclusions • The 64-bit port to Itanium has laid the foundation for: • The inclusion of Itanium systems in LCG-2 • A new architectural dimension in the Grid – Heterogeneity • A foundation for porting other 64-bit/Linux systems • A multi-platform strategy for Grid middleware development June 2005 openlab Workshop 27 BACKUP June 2005 openlab Workshop 28 14

Recommend

INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION

INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION

TRAINING COURSE ON SOCIAL PROTECTION & FORMALIZATION TRINIDAD AND TOBAGO MARCH 15, 2017 INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION Design of the NIS Assistance from the

547 views • 23 slides
INTRODUCTION Introduction 2/42 INTRODUCTION Alternations I am giving bread to the

INTRODUCTION Introduction 2/42 INTRODUCTION Alternations I am giving bread to the

Patterns of variation in the expression of case and agreement Andrs Brny Leiden University Centre for Linguistics 9 November 2019, BaSIS Workshop a.barany@hum.leidenuniv.nl INTRODUCTION Introduction 2/42 INTRODUCTION

1.37k views • 42 slides
Introduction Introduction Introduction Introduction Outline Motivation Failures

Introduction Introduction Introduction Introduction Outline Motivation Failures

Introduction Introduction Introduction Introduction Outline Motivation Failures Definition and concepts Process and product properties Principles SE Approaches Motivation Software and the economy The economies of

1.03k views • 49 slides
Introduction Introduction Introduction Nationwide Cause for Concern 1

Introduction Introduction Introduction Nationwide Cause for Concern 1

Introduction Introduction Introduction Nationwide Cause for Concern 1 https://www.cdc.gov/std/stats17/infographic.htm Introduction Epidemiology in Western Colorado CPHE Surveillance Data Report, May 2018 Chlamydia Epidemiology in Western

977 views • 39 slides
DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every

DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every

DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every meeting (2) Some ideas of diagrams for section 7.1 (Introduction) of TP. Giles Barr 25 Jan 2018, Pembroke College On DUNE, the reality is there is a

474 views • 10 slides
INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT

INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT

ADVANCED COMPUTER SECURITY INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT IS SECURITY? A systems security policies describe What the system is supposed to do Store and provide access

479 views • 16 slides
Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL

Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL

Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL Writing a SMIL file Adding Media Objects Martin Halvey Clipping media files January 2008 Timing and Synchronising Layout World Wide

387 views • 14 slides
14 Introduction Introduction Bad guys can put malware into Example: hosts

14 Introduction Introduction Bad guys can put malware into Example: hosts

Introduction Introduction source Encapsulation ISO/OSI reference model message M application segment H t H t M transport network datagram H n H n H t M presentation: allow applications to frame link H l H n H t M interpret

583 views • 4 slides
Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL

Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL

Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL Writing a SMIL file Adding Media Objects Martin Halvey Clipping media files January 2008 Timing and Synchronising Layout

322 views • 8 slides
Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL

Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL

Introduction Zynq Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL Processing System Processor Peripherals Data Buses AXI Bus Conclusion BTE5380 - Embedded Systems Octobre 2014 Andreas Habegger

1.81k views • 30 slides
2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04

2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04

2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04 Project References S E 5 PART.1 SMILE5 Introduction M I L Introduction STORION-SMILE5 Residential Energy Storage System Inverter 5kW Output Input

1.06k views • 25 slides
Introduction to CICS Course introduction Course introduction What is CICS? What is an

Introduction to CICS Course introduction Course introduction What is CICS? What is an

Introduction to CICS Course introduction Course introduction What is CICS? What is an application server? Why use an application server? Course introduction Services provided by CICS How CICS applications are defined Scaling CICS to meet

1.84k views • 146 slides
Network Visualization Introduction Presented by Shahed Introduction Introduction Basic

Network Visualization Introduction Presented by Shahed Introduction Introduction Basic

Network Visualization Introduction Presented by Shahed Introduction Introduction Basic building blocks Node Links (relationship between nodes) Spatial information Network data

584 views • 9 slides
Introduction Introduction (1) Main argument of the paper: universities are not only

Introduction Introduction (1) Main argument of the paper: universities are not only

Le jugement des pairs comme outil de management des universits Peer-review as a management tool Christine Musselin (CSO, Sciences Po et CNRS) Avril 2013, Lirrsistible ascension du capitalisme acadmique Introduction Introduction (1)

590 views • 28 slides
Introduction Introduction to storage and to storage and filesystems filesystems Introduction

Introduction Introduction to storage and to storage and filesystems filesystems Introduction

Moreno Baricevic Gilberto Daz Axel Kohlmeyer Stefano Cozzini ULA ICTP CNR-IOM DEMOCRITOS Merida, VENEZUELA Trieste, ITALY Trieste, ITALY Introduction Introduction to storage and to storage and filesystems filesystems Introduction

1.19k views • 51 slides
JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of

JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of

JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of the brand new JA-100 alarm system Visions Basic architecture System components Setting Help us with final validations You are the FIRST ones

1.69k views • 111 slides
1 Introduction Introduction Communication System Baseband an adjective that describes

1 Introduction Introduction Communication System Baseband an adjective that describes

Introduction Introduction Physical Layer Mobile network Global ISP Provides the means to transmit bits Basic Concepts of from sender to receiver, Data Transmission Defines the mechanical, electrical, and Home network timing

463 views • 7 slides
Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical

Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical

INFOGR Computer Graphics Jacco Bikker - April-July 2015 - Lecture 1: Introduction Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical Details Assignments Field Study State of

869 views • 62 slides
Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction

Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction

Virtual and Augmented Reality Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction Who am I? What do I do here? 2 About me Short research bio: - 2014 - finished PhD at FMFI UK - 2014 2016 -

1.3k views • 39 slides
PRESENTATION The Introduction What is the Introduction ? The introduction prepares the audience

PRESENTATION The Introduction What is the Introduction ? The introduction prepares the audience

PRESENTATION The Introduction What is the Introduction ? The introduction prepares the audience for your presentation. It tells them what your presentation is about, why it is important, and finally, what to listen for in your speech. Get the

505 views • 3 slides
How to make a presentation with L A T EX? Introduction to L A T EX Introduction to Beamer

How to make a presentation with L A T EX? Introduction to L A T EX Introduction to Beamer

Introduction to Beamer Hafida Benhidour How to make a presentation with L A T EX? Introduction to L A T EX Introduction to Beamer Introduction to Beamer Hafida Benhidour Department of computer science King Saud University November

732 views • 49 slides
Shenzhen Cuilu jewelry Co., Ltd was founded in 1996 and its a large private enterprise

Shenzhen Cuilu jewelry Co., Ltd was founded in 1996 and its a large private enterprise

Introduction Introduction - - Brief Brief Introduction Introduction of of Cuilu Cuilu Group Group Introduction Introduction - - Brief Brief Introduction Introduction of of Cuilu Cuilu Group Group Shenzhen Cuilu jewelry Co., Ltd

147 views • 14 slides
Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org

Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org

V olunteer C ommunications N etwork (V-C-N.org) Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org Academy Course - 2012-02.24-2208 262: Introduction to ICS-214 : V-C-N.org : Slide: 1 V olunteer C

735 views • 34 slides
Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org

Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org

V olunteer C ommunications N etwork (V-C-N.org) Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org Academy Course - 2012-02.24-2208 262: Introduction to ICS-214 : V-C-N.org : Slide: 1 V olunteer C

558 views • 18 slides

More recommend