CernVM[FS] and CMS Open Data Pilot Jakob Blomer, Gerardo Ganis, Adam Huffman, Kati Lassila-Perini, Tom McCauley, Andreas Pfeiffer DPHEP Implementation Board 11. March 2014 1 / 6
CMS Open Data Pilot Purpose: Provide an easy-to-use virtual machine of CMS computing environment for CMS Open Data Data: • Frozen data set • Remote data access Initially through XrootD, eventually DPHEP portal Software: • Frozen CMS software framework (CMSSW.4.2.8.patch7) • Complete analysis environment required (compile + run) • Requires Scientific Linux 5 compatible virtual machine Virtual machine, user interface: • Graphical environment, easy-to-install and easy-to-use • Deviate as little as possible from production CernVM 2 / 6
Scientific Linux 5 on µ CernVM Note: CernVM 2.X is based on SL5 but this technology reaches end-of-life this year due to vendor lock-in Like SL4 exercise: SL5 template installation on CernVM-FS JIRA CVM-586 CernVM Online HTTP (Amazon EC2) cms.cern.ch OS + Extras Scratch HD AUFS R/W Overlay SLC5 initrd: CernVM-FS + µ Contextualization ISO Image AUFS Fuse Kernel Prototype ≈ 1 day of work, estimate for shippable state ≈ 1-2 weeks 3 / 6
Deployment I • VirtualBox is a free and open source hypervisor for Windows, Linux, Mac 4 / 6
Deployment I • VirtualBox is a free and open source hypervisor for Windows, Linux, Mac Deployment option 1 : WebAPI (I. Charalampidis, CERN theory group) 4 / 6
Deployment I • VirtualBox is a free and open source hypervisor for Windows, Linux, Mac Deployment option 1 : WebAPI (I. Charalampidis, CERN theory group) 4 / 6
Deployment I • VirtualBox is a free and open source hypervisor for Windows, Linux, Mac Deployment option 1 : WebAPI (I. Charalampidis, CERN theory group) 4 / 6
Deployment II Deployment option 2 : as OVF/OVA bundle 1 • open specification for bundling VMs, stable since 2009 • OVA: tarball containing hard disk image and an XML specification 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6
Deployment II Deployment option 2 : as OVF/OVA bundle 1 • open specification for bundling VMs, stable since 2009 • OVA: tarball containing hard disk image and an XML specification • OVA packaging added to CernVM build process JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6
Deployment II Deployment option 2 : as OVF/OVA bundle 1 • open specification for bundling VMs, stable since 2009 • OVA: tarball containing hard disk image and an XML specification • OVA packaging added to CernVM build process JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6
Deployment II Deployment option 2 : as OVF/OVA bundle 1 • open specification for bundling VMs, stable since 2009 • OVA: tarball containing hard disk image and an XML specification • OVA packaging added to CernVM build process JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6
Fine-tuning, first test, and open issues Fine-tuning: • Fine-tuning through contextualization : JIRA CVM-587 , “getting preset environment variables, auto-login started” documentation, . . . • Ensure that data access tools are disentangled from grid dependencies First test: produce event display format from the AOD files JIRA CVM-588 Open issues: • SL5 support ends March 2017; can we provide an outdated operating system to users outside the collaboration? • Should we pre-load CernVM-FS caches in order to speed up the initial VM boot? 6 / 6
Recommend
More recommend
