Helix Nebula, the Science Cloud CloudCom SCC-Computing Summer - PowerPoint PPT Presentation

Helix Nebula, the Science Cloud CloudCom SCC-Computing Summer Symposium on EU-China- North America Collaboration on HPC, Cloud and Big Data Stavanger, 20-21 June 2013 Maryline Lengert, ESA

Why is Helix Nebula relevant for HPC? • Started with 3 “extreme” labs with global user community – Instrumentation : • Earth Observation satellites and archives, • LHC • Next Generation DNA sequencing and high-throughput 4-dimensional microscopy/imaging technologies – Models : • Climate change, Earthquakes, … • LHC: Interactive data analysis, simulation of physics detectors • Helps biomedical researchers to better understand the concepts of life (aging, diseases…) and it also helps developing new drugs or treatments CloudCom 2013, Stavanger 20-21 June 2013 2 Maryline Lengert, ESA

Example: Humans in the loop: A vicious circle of positive feedback loops Source: Tyndall Centre for Climate Change research & EC “Towards a ‘ Global Systems Science ’ ” - Ralph Dum CloudCom 2013, Stavanger 20-21 June 2013 3 Maryline Lengert, ESA

Helix Nebula, the Science Cloud initiative is a Partnership between big science and big business to implement the Strategic Plan for a Scientific Cloud Computing Infrastructure in Europe CloudCom 2013, Stavanger 20-21 June 2013 4 Maryline Lengert, ESA

http :// cdsweb.cern.ch/record/1374172/files/CERN-OPEN-2011-036.pdf 1. Set up a sustainable multi-tenant cloud computing infrastructure in Europe, initially based on the needs of the European Research Area & Space agencies 2. Identify and adopt policies for trust, security and privacy on a European-level 3. Create a light-weight governance structure involving all stakeholders 4. Define a short and medium term funding scheme CloudCom 2013, Stavanger 20-21 June 2013 5 Maryline Lengert, ESA

What is Infrastructure? • Infrastructure consists of common resources used for deployment of platforms . • Physical infrastructure includes the copper, fiber, silicon, and wireless switching fabric of the internet. • DNS is an infrastructure service for the Internet. Source: http://iot-datamodels.blogspot.fr/2012/12/the-internet-of-things-needs-open.html CloudCom 2013, Stavanger 20-21 June 2013 6 Maryline Lengert, ESA

Helix Nebula, the Science Cloud • It is NOT a project! • It doesn’t have a paying customer: it is meeting strategic interest of each participant preparing the future • It has been set up by “Extreme Labs”, IT & T-Com industry, SMEs (application & computing) to create something new by bringing together a fragmented landscape and building on strength from sustainable diversity CloudCom 2013, Stavanger 20-21 June 2013 7 Maryline Lengert, ESA

Strategic Objective • The European Research Area shall drive the development and implementation of a secure and globally recognised European Cloud Computing Infrastructure , initially targeting science users. This infrastructure will become THE platform for Europe, under public governance, ensuring open standard and interoperability and adhering to European policies, norms and requirements . CloudCom 2013, Stavanger 20-21 June 2013 8 Maryline Lengert, ESA

Long Term Goal • To create a multi-tenant ‘ Open Market Place for Science ’, where data, scientists, funding bodies, SMEs and downstream industry are meeting to work along common interests. This ecosystem should implement many-to-many relationships, quickly being established, to transform data into valuable information CloudCom 2013, Stavanger 20-21 June 2013 9 Maryline Lengert, ESA

Operating as an Ecosystem An ecosystem is a community of living organisms (plants, animals and microbes) in conjunction with the nonliving components of their environment (things like air, water and mineral soil), interacting as a system. An ecosystem is a community of living organisms (plants, animals and microbes) in conjunction with the nonliving components of their environment (things like air, water and mineral soil), interacting as a system. CloudCom 2013, Stavanger 20-21 June 2013 10 Maryline Lengert, ESA

What is an Ecosystem? • An ecosystem is a system of systems that all share resources and protocols, and interact and influence the outcome of each other . • In a healthy ecosystem there is a natural interdependence that is balanced against competition . • An ecosystem needs multiple competing platforms to be contained within a single company or institution. • The sustainable ecosystem seems to be based on open participation at all levels . Source: http://iot-datamodels.blogspot.fr/2012/12/the-internet-of-things-needs-open.html CloudCom 2013, Stavanger 20-21 June 2013 11 Maryline Lengert, ESA

Contributors to the Ecosystem Funding Bodies IT Suppliers R&D Labs SME’s Data providers Downstream industry Scientists CloudCom 2013, Stavanger 20-21 June 2013 12 Maryline Lengert, ESA

Final Ecosystem: Discovery driven Funding Supplier A Scientist bodies SME (€/$/£) Demand Skills Skills Brokerage brokerage: Dynamic Data & tools Discovery team oriented approach building IT Brokerage based on discovery Supplier Data Supplier Supplier X Supplier Y SME provider CloudCom 2013, Stavanger 20-21 June 2013 13 Maryline Lengert, ESA

Timeline 2011 2012-2013 2014 … Endorse the Common Pilot Phase Towards an open market • • Strategy • Deploy flagships, for Science • Agree on the Partnership • Analysis of functionality, • Select flagships use cases performance & financial • Define governance model model CloudCom 2013, Stavanger 20-21 June 2013 14 Maryline Lengert, ESA

Initial Flagship Use Cases • Scientific challenges with societal impact • Sponsored by user organisations • Stretch what is possible with the cloud today CloudCom 2013, Stavanger 20-21 June 2013 15 Maryline Lengert, ESA

New flagships • 3 selected from 15 proposals : – European Center for Medium Range Weather Forecasts (ECMWF) • Weather Data Information Supersite (WDIS) with 100 years of weather data – UNESCO (Intergovernmental Oceanographic Commission) • Ocean and Coastal Information Supersite (OCIS) – Port d’Informació Científica (PIC), Barcelona • Reduce costs and improve speed of delivery, increase volume and accuracy for Neuroimaging • Foresee to deploy the new flagships in 2H 2013 CloudCom 2013, Stavanger 20-21 June 2013 16 Maryline Lengert, ESA

Helix Nebula, GEANT & GRID • Connections of Helix Nebula partners is ensured through private and/or GEANT network (100 Gbit/s) • EGI ( European Grid Infrastructure ) is part of Helix Nebula consortium and will also be accessible through the Blue Box thanks to an hybrid model CloudCom 2013, Stavanger 20-21 June 2013 17 Maryline Lengert, ESA

Helix Nebula and EGI supply: proposed hybrid model Academic Other market sectors Government Manufacturing Oil & gas, etc. Big Science Long tail Network Commercial/GEANT HN as supplier to research Blue Box Fed Cloud Task Force Helix Nebula EGI Cloud T- Atos Sigma Systems Front-end Front-end Front-end Public Front-end Front-end Commercial funded CloudCom 2013, Stavanger 20-21 June 2013 18 Maryline Lengert, ESA

Helix Nebula and HPC • The expertise developed by the HPC community in efficient parallel programming paradigms and optimising software for a range of architectures is directly relevant. • As well as sharing expertise, the services offered by structures such as Helix Nebula and the HPC centres should be integrated to form part of the overall ecosystem To participate in the federated identity management scheme and data sharing services. CloudCom 2013, Stavanger 20-21 June 2013 19 Maryline Lengert, ESA

Mutual Benefits • Increase the HPC user community with relevant capability needs and possibility to off load capacity to Helix Nebula (commodity hardware) • Bringing HPC resources within this heterogeneous and federated Science Cloud Infrastructure would significantly enhance the performance of the overall infrastructure and its ability to solve next generation of scientific problems (in the field of bioinformatics, climate change, …) CloudCom 2013, Stavanger 20-21 June 2013 20 Maryline Lengert, ESA

https://cds.cern.ch/record/1537032 CloudCom 2013, Stavanger 20-21 June 2013 21 Maryline Lengert, ESA

A European cloud computing partnership: big science teams up with big business To support the Setting up a new To create an Earth Strategic Plan computing capacity service to simplify Observation platform, needs for the ATLAS analysis of large focusing on  Establish multi-tenant, experiment genomes, for a deeper earthquake and multi-provider cloud insight into evolution volcano research infrastructure and biodiversity  Identify and adopt policies for trust, security and privacy  Create governance structure  Define funding schemes Adopters http://www.helix-nebula.eu /