The Brokering Approach STEFANO NATIVI (CNR-IIA), MAX CRAGLIA - PowerPoint PPT Presentation

Citizens ’ Science and Smart Cities JRC – Ispra 5-7 February 2014 The Brokering Approach STEFANO NATIVI (CNR-IIA), MAX CRAGLIA (EC-JRC) AND MATTIA SANTORO (CNR-IIA)

Rationale  Build «Network of Networks»  Large or complex networks  Heterogeneous networks  Independent networks  Evolving networks  Reuse/share of (open) data  Heterogeneity  Technology  Domain/Goal  Organization  Maturity level  Policy nativi@iia.cnr.it nativi@iia.cnr.it

nativi@iia.cnr.it

Network of Networks Principles Build on existing (Community) network/system/ infrastructures Supplement but not supplant network/system (i.e. Community) mandates and governance arrangements Address heterogeneity to lower barriers avoiding to impose any common (federal) technology Be flexible and extensible to ◦ Interconnect new network/system (Community) ◦ Sustain and advance the achieved interoperability ◦ Allow each network/system (i.e. Community) to evolve nativi@iia.cnr.it nativi@iia.cnr.it

Network of Networks Interoperability THE EUROGEOSS LEGACY

Interoperability Approaches Two main ( complementary ) approaches ◦ Standardization Controlled and mature environments ◦ Intermediation (i.e. System Brokering ) ◦ Heterogeneous and rapidly-evolving environments nativi@iia.cnr.it

The Brokerage Approach INTERMEDIATION OF EXISTING NETWORKS AND COMMUNITIES

Network interoperability nativi@iia.cnr.it

Network service bus Network service bus Network service bus Network service bus .. .

Interoperability with «Authoritative Systems» .. .

Network service bus Network service bus Brokering Infrastructure Network service bus Network service bus .. .

Brokering Framework empowered by nativi@iia.cnr.it

Brokering Benefits Lowers barriers to participation in distributed systems for both users and resource providers ◦ minimal burden or cost impact on existing systems; Accelerates interconnection of disparate systems; Facilitates sustainability, reusability, extensibility, and flexibility of the infrastructure Enhances cross-domain interoperability via introduction of new capabilities across multiple domains; Removes need to impose common (e.g. federal, “top - down”) specifications and software components enabling a more adaptive “bottom - up” evolution of the infrastructure nativi@iia.cnr.it

Brokering Challenges Scalability ◦ Intermediation services introduce a overhead Governance ◦ A new service layer is introduced: it must be a third party infrastructure ◦ Brokering agreements ◦ Trustiness Sustainability ◦ A Bokering layer is a complex piece of technology ◦ Evolve along with Community standards and Best Practices ◦ Business model nativi@iia.cnr.it

Projects dealing with Brokering technology APPLYING, ADVANCING AND BUILDING ON A BROKERING FRAMEWORK

Facin ing Scala labilit bility

Current Assets GEO Home Page GEOSS Portal nativi@iia.cnr.it

Current Assets About 20 brokered data providers – .. . capacities, systems, Communities Publish More than 7 Million (1.2 Million GEOSS Data Core) Discoverable and potentially Accessible .. . aggregated resources (mix of data collections, datasets and individual images) .. . Contain [source: data providers] More than 65 Million (50 Million GEOSS Data Core) Discoverable and potentially Accessible individual resources (e.g. satellite scenes, rain gauge records) nativi@iia.cnr.it

GEO DAB in the Cloud … nativi@iia.cnr.it

GEO DAB Cloud capabilities Load Balancing Elastic Load ◦ Each DAB component is replicated on multiple machines Balancing ◦ Amazon Load Balancers take care of routing requests to machines with lighter loads ◦ New machine can be added on-the-fly as needed Tiles and Data Caches ◦ DAB makes use of Hadoop-based solutions for storing and retrieving maps and data. Monitoring system usage and resource consuming (number of queries, use of CPU, memory, etc.) Instance with CloudWatch Store user’s queries and selections to improve ranking of results (under development) nativi@iia.cnr.it nativi@iia.cnr.it

Typical Configuration nativi@iia.cnr.it

Ranking Metrics applied by DAB • A weight-based algorithm rewarding a set of criteria belonging to four high-level principles • Data accessibility & quality of service • GEOSS SBA Essential Variables • GEOSS Data Core • Metadata Completeness • The solution applied by DAB is configurable and flexible nativi@iia.cnr.it nativi@iia.cnr.it

Study dyin ing g G Governance ance & & Sustain inabili ability ty

nativi@iia.cnr.it

BC BC UBE BE