Handling time-critical service applications with EGI - PowerPoint PPT Presentation

Handling time-critical service applications with EGI e-Infrastructure Joao Pina, EGI Foundation Portuguese NGI representative INCD / LIP www.egi.eu This work by EGI.eu is licensed under a Creative Commons Attribution 4.0 International License.

EGI: advanced computing for research EGI… …delivers advanced computing services to support scientists, multinational projects, research infrastructures and industry www.egi.eu 2016/11/29 2

EGI Federation, 2016 QR3 The largest distributed compute e-Infra worldwide 2016/11/29 3

Service Catalogue 2016/11/29 4

The list of services that EGI as a federation EGI service offers for research & innovation portfolio IT4RIs workshop @RTSS 2016, 29 Nov - 02 Dec, Porto 2016/11/29 5

● EGI Federated Cloud 2016/11/29 6

EGI Federated Cloud • • • • • → → 2016/11/29 7

EGI Federated Cloud • • • • • 2016/11/29 8

Architecture of EGI FedCloud 23/11/29 9

Access to the Federated Cloud: Virtual Organisations Generic VOs → Incubator for new users Sector-specific VOs → Dedicated environments 23/11/29 10

23/11/29 11

Who Use EGI? 23/11/29 12

SLA negotiation ● EGI Foundation is acting as negotiator for communities ○ Finds and arranges resources that ‘fit for purpose’ ● Process is facilitated by ○ E-GRANT, Council surveys, broadcasting tool for sites ● SLA agreed with ○ BILS, MoBrain, DRIHM, EXTraS, DARIAH-CC, Terradue (ESA TEPs), LSGC and Peachnote, Bioisi, EMSO_DEV ● Finalising requests of D4Science … 23/11/29 13

FedCloud Typical usage models ● ○ ○ ● ○ ● ○ ● ○ 23/11/29 14

Support of RealTime Applications ● ○ ○ ■ ■ ● ○ ○ ● ○ ■ 2016/11/29 15

● 2016/11/29 16

Near-real time earthquake simulations 23/11/16 17

● Building the EMSODEV Data Management Platform (DMP) using EGI Federated Cloud ○ Push Transfer Flow : data is sent to a DMP service which “listens” to near-real time updates on XML files describing sensors data and measurements ○ Pull Transfer Flow : data is retrieved via API exposed by an OGC SOS server available at the OBSEA observatory located in Vilanova and managed by Universitat Politecnica De Catalunya. 2016/11/29 18

DATA MANAGEMENT PLATFORM Production VO: vo.emsodev.eu Cloud Compute: ~10 VMs (8 CPUs + 16GB RAM + 40GB HD) File Storage: 5 TB 2016/11/29 19

● 2016/11/29 20

● ● ● ● ● 2016/11/29 21

● ● ● ● ● 2016/11/29 22

But: Cloud Challenges ● It’s new ! ● Security / your intellectual property ● Traditional software licensing ● Data transfer ● Cloud expertise is needed ● Losing control over your jobs and data ● First access to clouds is often cumbersome 2016/11/29 23

● 2016/11/29 24

Software Containers remove or reduce cloud challenges ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ Beta phase ✓ 2016/11/29 25

Thank you for your attention Questions? 2016/11/29 26