Enabling Grids for E-sciencE Virtualisation and Grid Computing: Procedures and Usage Scenarios Volker Büge Volker.Buege@iwr.fzk.de Institut für Experimentelle Kernphysik Institut für Wissenschaftliches Rechnen Universität Karlsruhe Forschungszentrum Karlsruhe www.eu-egee.org EGEE and gLite are registered trademarks EGEE-II INFSO-RI-031688
Outline Enabling Grids for E-sciencE • Introduction • Virtualisation - Products and Principles – VMware GSX Server – VMware ESX Server – Xen – Processors • Applications: – Hardware Consolidation at a WLCG Tier3 Centre – Deployment of this school’s training environment – Virtualisation of Batch Systems – Gathering Resources from idle Desktop PCs • Conclusion & Outlook Volker Büge GridKA School 2006 2 EGEE-II INFSO-RI-031688
The Concept of Virtualisation Enabling Grids for E-sciencE A definition of virtualisation: Possibility to share resources of one physical machine between different independent operating systems (OS) in Virtual Machines (VM) Server 1 Server 1 Server 1 Server 2 Server 2 Server 2 Requirements should be: OS OS OS OS OS OS – Support of commodity Hardware Hardware Hardware Hardware Hardware Hardware OS like Linux and One server One server Windows VM1 VM1 VM2 VM2 – Virtual Machines have to VM3 VM3 VM4 VM4 be isolated Hardware Hardware – Acceptable performance Server 3 Server 3 Server 3 Server 4 Server 4 Server 4 overhead OS OS OS OS OS OS Hardware Hardware Hardware Hardware Hardware Hardware Volker Büge GridKA School 2006 3 EGEE-II INFSO-RI-031688
Virtualisation – Products Enabling Grids for E-sciencE There is a plenty of existing products for virtualisation: and many more … Volker Büge GridKA School 2006 4 EGEE-II INFSO-RI-031688
Virtualisation – Products Enabling Grids for E-sciencE There is a plenty of existing products for virtualisation: and many more … Volker Büge GridKA School 2006 5 EGEE-II INFSO-RI-031688
Virtualisation – VMware GSX Enabling Grids for E-sciencE Full Virtualisation, e.g. VMware GSX • The host OS emulates all hardware components except for the CPU for the VM � VM becomes independent from host configuration and can be used on different host systems • VM is stored and run in files • VMs contain native OS and are completely isolated … … but such hardware emulations Schematic overview of cost performance VMware GSX-Server Volker Büge GridKA School 2006 6 EGEE-II INFSO-RI-031688
Virtualisation – VMware GSX Enabling Grids for E-sciencE WindowsXP host OS with a ScientificLinux Cern 3 VM Volker Büge GridKA School 2006 7 EGEE-II INFSO-RI-031688
Virtualisation – VMware ESX Enabling Grids for E-sciencE Full Virtualisation, e.g. VMware ESX • Virtualisation Layer is directly installed on the server hardware • It is optimized for some certified hardware components • Provides advanced administration tools • Allows emulation of hardware components for the VMs at near-native performance • Provides features like memory ballooning, over-commitment of RAM, live migration … • Supports up to 128 powered-on Virtual Machines Schematic overview of • Relatively expensive VMware ESX-Server Volker Büge GridKA School 2006 8 EGEE-II INFSO-RI-031688
Virtualisation – VMware ESX Enabling Grids for E-sciencE ESX Server on a Blade Centre Volker Büge GridKA School 2006 9 EGEE-II INFSO-RI-031688
Virtualisation - XEN Enabling Grids for E-sciencE Para Virtualisation, e.g. XEN – Different hardware components are not fully emulated by the host OS. It only organises the usages � Small loss of performance – Layout of a Xen based system: Privileged host system (Dom0) and unprivileged guest systems (DomUs) – DomUs are working cooperatively! – Guest-OS has to be adapted to XEN (Kernel-Patch), but not the applications – this changes with processors supporting virtualisation Volker Büge GridKA School 2006 10 EGEE-II INFSO-RI-031688
Virtualisation - XEN Enabling Grids for E-sciencE VM names Memory Images for disk and swap XEN host running four virtual machines Volker Büge GridKA School 2006 11 EGEE-II INFSO-RI-031688
Virtualisation - Performance Enabling Grids for E-sciencE Standard application benchmark: Linux kernel compilation (4 in parallel; make –j4 ) ) P M Both CPUs in the native OS S used for one compilation 2 n Opteron-SMP Only one CPU in the VM ro XEN 3 0 1 te 1,75 p XEN 2 0 7 O Commercial = 1,5 Product x (2 UML 1,25 e d In 1 ce Slightly smaller performance n a 0,75 of the Xen based VM rm compared to the native OS. rfo 0,5 e P 0,25 tive la 0 e 1 2 3 4 5 6 7 8 10 12 14 16 R Amount of parallel benchmarks Volker Büge GridKA School 2006 12 EGEE-II INFSO-RI-031688
Virtualisation – Hardware Enabling Grids for E-sciencE New processor generation has extension for virtualisation, e.g. Vanderpool (Intel) and Pacifica (AMD) • Per definition, x86 platforms do not support virtualisation • OS is executed in Ring 0, Applications in Ring 3 – What about VMM? • The new processor generation provides a Ring -1 for the VMM 3 • Guest OS is executed in Ring 0 and 0 moderated by privileged Virtual -1 Machine Monitor Virtual Machine Monitor • Application remains in Ring 3 Ring Applications • Overhead for translation reduced Guest OS Volker Büge GridKA School 2006 13 EGEE-II INFSO-RI-031688
Advantages through virtualisation I Enabling Grids for E-sciencE Reduction of hardware overhead – Different isolated operating systems share the same hardware. – Only few high-performant machines needed to host many different systems – Deploying a new server means to create a new VM on existing hardware – Only ordering new hardware if existing is fully loaded � cheaper and easier to maintain Load Balancing – Balanced load and efficient use of the server machine � Better distribution of peak usage Volker Büge GridKA School 2006 14 EGEE-II INFSO-RI-031688
Advantages through virtualisation II Enabling Grids for E-sciencE Easy and fast setup of new machines: – Often identical installation of basic OS are needed � Deployment of a new machine by copying VMs image files Migration “on the fly”: – Possibility of migrating VMs to other host machines – If the VM image is stored on a SAN � Migration without interruption Backup: – Easy backup of whole OS by archiving VM image files Volker Büge GridKA School 2006 15 EGEE-II INFSO-RI-031688
Advantages through virtualisation III Enabling Grids for E-sciencE Cloning of virtual machines: – Cloning of VMs before upgrades enable tests and easy roll back � Less service interrupts and a more effective administration Independence of the host OS – Free choice of host OS – Possibility to run different guest OS on one machine – The user's needs are decoupled from the administrator's needs � More flexible administration as requirements concerning the OS of different groups can be satisfied easily Volker Büge GridKA School 2006 16 EGEE-II INFSO-RI-031688
Applications Enabling Grids for E-sciencE These advantages are not academic … … today virtualisation is used in many fields • Hardware Consolidation at a WLCG Tier3 Centre • Virtualisation in the training environment • Dynamic partitioning of a shared computing cluster • Harvest computing power of idle desktop PCs • and many more … Volker Büge GridKA School 2006 17 EGEE-II INFSO-RI-031688
Hardware Consolidation at a WLCG Tier3 Centre I Enabling Grids for E-sciencE Site-wide services: • Computing Element – portal to the local batch system of a site • Storage Element – offering disk space to a VO – portal to the local storage • Monitoring Box – collects and publishes information on grid jobs executed at a site Volker Büge GridKA School 2006 18 EGEE-II INFSO-RI-031688
Hardware Consolidation at a WLCG Tier3 Centre II Enabling Grids for E-sciencE Typical situation at a university’s Tier 2/3 centre: • For reasons of stability we recommend to run each service in an isolated OS instance. CE SE MON • Varying load on the different machines � No full usage of resources � “Recycling” of older machines leads to a heterogeneous hardware CE SE MON structure Host (XEN) � High administrative effort for installation and maintenance of the system Virtualisation of these machines leads to one single machine to be maintained and to homogeneous OS installations Volker Büge GridKA School 2006 19 EGEE-II INFSO-RI-031688
Hardware Consolidation at a WLCG Tier3 Centre IIII Enabling Grids for E-sciencE Realisation of a full LCG environment in Virtual Machines • Host system with Virtual Machine Monitor (VMM) Xen – AMD Dual Opteron with 4GB RAM, 600GB Raid10 – OS: Debian with Xen 3.0 patched 2.6.16 kernel • Hosted Virtual Machines: – Production environment gLite 3.0: CE, SE and MON on SLC3.06 – Test environment for gLite 3.0: CE, SE and MON on SLC3.06 – Two machines for the CDF grid SAM on SLF3.05 • All environments are fully integrated into the batch and storage system Contribution to eScience 2006 conference: V. Büge, Y. Kemp, M. Kunze, G. Quast Application of Virtualisation Techniques at a University Grid Center 3 complete grid infrastructures on one machine is working Volker Büge GridKA School 2006 20 EGEE-II INFSO-RI-031688
Recommend
More recommend
