interoperability challenges
play

interoperability challenges Stefano Nativi Italian National - PowerPoint PPT Presentation

Seminar at UNIDATA ----- Boulder (CO) USA, 10 Dec 2010 Multi-disciplinary interoperability challenges Stefano Nativi Italian National Research Council and PIN -University of Florence ESSI Lab Outline System of Systems approach and


  1. Three Interoperability phases WP3: Forestry WP4: Biodiversity WP5: Drought WP6: Cost benefit I. Enable thematic analysis interoperability & connections local to global II. Enable multi-disciplinary WP2: Multi-disciplinary interoperability interoperability EuroGEOSS contribution to the Global EO SoS – Krakow, 24 June 2010

  2. Three Interoperability phases WP3: Forestry WP4: Biodiversity WP5: Drought WP6: Cost benefit I. Enable thematic analysis interoperability & connections local to global II. Enable multi-disciplinary WP2: Multi-disciplinary interoperability interoperability ... GolbalSoilMap III. Extend interoperability to other SBAs & systems AEGOS WP7: Capacity building EuroGEOSS contribution to the Global EO SoS – Krakow, 24 June 2010

  3. Multi-disciplinary Functionalities Discover Evaluate Access Use EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  4. Multi-disciplinary Functionalities Discover Evaluate Access Use • Discovery broker • Augmented (semantic) Discovery • Web 2.0 resources discovery EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  5. Multi-disciplinary Functionalities Discover Evaluate Access Use • Discovery broker • Augmented (semantic) Discovery • Web 2.0 resources discovery Support to multiple clients EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  6. Multi-disciplinary Functionalities Discover Evaluate Access Use • Discovery broker • Augmented (semantic) Discovery • Web 2.0 resources discovery Common Grid data access Support to multiple clients EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  7. Multi-disciplinary Functionalities Discover Evaluate Access Use • Discovery broker • Augmented (semantic) Discovery • Web 2.0 resources discovery Common Grid data access Support to multiple clients • To lower GCI entry barrier • Use scenarios (AIP-3) EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  8. TO LOWER ENTRY BARRIER FOR MULTI-DISCIPLINARY CAPACITY EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  9. Step 1: Discovery «Service Providers» «Service Providers» Geospatial Resources .. . «Broker» «Broker» «Advanced Module» «Advanced Module» «Semantic Resources» «Advanced Module» (edit Mask) Event – place - date «Service Providers»

  10. Step 1: Discovery Implement Interoperability Arrangements «Service Providers» «Service Providers» Geospatial Resources .. . «Broker» «Broker» «Advanced Module» «Advanced Module» «Semantic Resources» «Advanced Module» (edit Mask) Event – place - date «Service Providers»

  11. Step 1: Discovery «Service Providers» «Service Providers» «Service Providers» «Service Providers» «Broker» Geospatial Resources .. . CSW «Broker» «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker SPARQL «Semantic Resources» «Advanced Module» «Broker» «Advanced Module» «Advanced Module» «Service Providers» «Semantic Resources» «Advanced Module» (edit Mask) Event – place - date «Service Providers»

  12. Step 1: Discovery «Service Providers» «Service Providers» «Service Providers» «Service Providers» «Broker» Geospatial Resources .. . CSW «Broker» «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker SPARQL «Semantic Resources» Implement «Advanced Module» Multi-disciplinary «Broker» «Advanced Module» «Advanced Module» Interoperability Arrangements «Service Providers» «Semantic Resources» «Advanced Module» (edit Mask) Event – place - date «Service Providers»

  13. Step 1: Discovery «Service Providers» «Service Providers» Implement Subsetting & Transformation services «Service Providers» «Service Providers» «Broker» Geospatial Resources .. . CSW «Broker» «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker SPARQL «Semantic Resources» Implement «Advanced Module» Multi-disciplinary «Broker» «Advanced Module» «Advanced Module» Interoperability Arrangements «Service Providers» «Semantic Resources» «Advanced Module» (edit Mask) Event – place - date «Service Providers»

  14. Step 2: Access «Service Providers» «Service Providers» Geospatial Resources .. . «Broker» Geospatial Data Access Broker CSW «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker SPARQL «Semantic Resources» «Advanced Module» «Service Providers» (edit Mask) Event – place - date

  15. Step 2: Access Implement «Service Providers» «Service Providers» Geospatial Resources Subsetting & Transformation services .. . «Broker» Geospatial Data Access Broker CSW «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker SPARQL «Semantic Resources» «Advanced Module» «Service Providers» (edit Mask) Event – place - date

  16. Step 2: Access Implement «Service Providers» «Service Providers» Geospatial Resources Subsetting & Transformation services .. . «Broker» Geospatial Data Access Broker CSW Underpin «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker a common grid environment SPARQL «Semantic Resources» «Advanced Module» «Service Providers» (edit Mask) Event – place - date

  17. Step 2: Access Implement «Service Providers» «Service Providers» Geospatial Resources Subsetting & Transformation Geospatial Web services resources. .. . What about Web «Broker» 2.0 resources ? Geospatial Data Access Broker CSW Underpin «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker a common grid environment SPARQL «Semantic Resources» «Advanced Module» «Service Providers» (edit Mask) Event – place - date

  18. Step 3: Web 2.0 Resources «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Service Providers» «Service Providers» Geospatial Resources «Broker» Geospatial Data Access Broker «Broker» Geospatial Data Access Broker CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Adapters «Broker» «Advanced Module» «Advanced Module» SPARQL «Semantic Resources» «Advanced Module» «Semantic Resources» «Advanced Module» «Service Providers» «Service Providers» (edit Mask) Event – place - date

  19. Step 3: Web 2.0 Resources «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Service Providers» «Service Providers» Geospatial Resources «Broker» Geospatial Data Access Broker «Broker» Geospatial Data Access Broker CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Adapters «Broker» «Advanced Module» «Advanced Module» SPARQL «Semantic Resources» Implement «Advanced Module» «Semantic Resources» Web 2.0 «Advanced Module» Interoperability Arrangements «Service Providers» «Service Providers» (edit Mask) Event – place - date

  20. Step 3: Web 2.0 Resources «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Service Providers» «Service Providers» Geospatial Resources «Broker» Geospatial Data Access Broker «Broker» Geospatial Data Access Broker CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Adapters «Broker» «Advanced Module» «Advanced Module» SPARQL «Semantic Resources» Implement «Advanced Module» Implement «Semantic Resources» Web 2.0 Web 2.0 discovery «Advanced Module» Interoperability Interfaces Arrangements «Service Providers» «Service Providers» (edit Mask) Event – place - date

  21. Step 3: Web 2.0 Resources «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Service Providers» «Service Providers» Geospatial Resources Well-structured geospatial queries «Broker» Geospatial Data Access Broker «Broker» What about Semantic Geospatial Data Access Broker discovery for EO ? CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Adapters «Broker» «Advanced Module» «Advanced Module» SPARQL «Semantic Resources» Implement «Advanced Module» Implement «Semantic Resources» Web 2.0 Web 2.0 discovery «Advanced Module» Interoperability Interfaces Arrangements «Service Providers» «Service Providers» (edit Mask) Event – place - date

  22. Step 4: Augmented Discovery «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Broker» Geospatial Data Access Broker CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Semantic Discovery Broker Adapters SPARQL «Semantic Resources» Thesauri «Advanced Module» Semantic engine «Service Providers» Gazzetters WFS (edit Mask) Event – place - date

  23. Step 4: Augmented Discovery «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Broker» Geospatial Data Access Implement Broker Semantic discovery CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Semantic Discovery Broker Adapters SPARQL «Semantic Resources» Thesauri «Advanced Module» Semantic engine «Service Providers» Gazzetters WFS (edit Mask) Event – place - date

  24. Step 4: Augmented Discovery «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Broker» Augment the Geospatial Data Access Implement Broker Discovery Broker Semantic discovery capacities CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Semantic Discovery Broker Adapters SPARQL «Semantic Resources» Thesauri «Advanced Module» Semantic engine «Service Providers» Gazzetters WFS (edit Mask) Event – place - date

  25. Step 4: Augmented Discovery «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Broker» Augment the Geospatial Data Access Implement Broker Discovery Broker Semantic discovery capacities CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Semantic Discovery Broker Adapters SPARQL «Semantic Resources» Thesauri «Advanced Module» Semantic engine Publish Semantic Discovery standard «Service Providers» interface(s) Gazzetters WFS (edit Mask) Event – place - date

  26. Step 4: Augmented Discovery «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Broker» Augment the Geospatial Data Access Implement Broker Discovery Broker Semantic discovery capacities CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Semantic Discovery Broker Adapters SPARQL «Semantic Resources» Thesauri «Advanced Module» Semantic engine Connect and Publish Semantic Mediate Discovery standard heterogeneous «Service Providers» interface(s) Gazzetters WFS Semantic resources (edit Mask) Event – place - date

  27. «Service Providers» «Service Providers» Web 2.0 resources Geospatial Resources «Broker» Geospatial Data Access Broker CSW OpenSearch «Broker» «Advanced Module» «Advanced Module» Catalog Discovery Broker Semantic Discovery Broker Adapters SPARQL «Semantic Resources» Thesauri «Advanced Module» Semantic engine «Service Providers» Gazzetters WFS (edit Mask) Event – place - date

  28. Empowered by DISCOVERY (& ACCESS) BROKER EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  29. Provided Interfaces & Supported Resource types Discovery (& acess) Brokering Platform (GeoRSS support) (edit Mask) Event – place - date

  30. Accessors Harvesters OWS Distributor Accessors Profilers CS-W AP Asynchronous Common Accessors messaging OpenSearch Data Model GBIF Accessor CS-W(T)/ ISO AP OpenSearch Accessor CS-W/ ISO 19115 ebRIM-CIM AP … . THREDDS/ Core profile OPeNDAP +Extensions( Accessor CS-W/ eb-RIM/CIM CDI ebRIM-EO AP /EO) Accessor OAI-PMH Accessor OAI-PMH GeoRSS Accessor Extended netCDF Interface Accessor .. . RIM-EO, RIM-CIM, ISO Local Repositories EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  31. Brokering framework: new Resource types supported • OAI-PMH 2.0 • DublinCore • ISO 19139 .. . • DIF 9.7.1 (Data Interchange Format) • netCDF-CF 1.4 • THREDDS (1.0.1, 1.0.2) • GDACS (Global Disaster Alert and Coordination System) • WAF (Web Application Firewalls/FTP) EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  32. In collaboration with GENESIS AUGMENTED (SEMANTIC) DISCOVERY EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  33. Semantic Augmentation (Mediator) Semantic Client Augmentation Component OpenSearch Extended Interface (semantic) EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  34. Semantic Augmentation (Mediator) Semantic Client Augmentation Component OpenSearch Extended Interface (semantic) EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  35. Semantic Augmentation (Mediator) Semantic ? SKOS/RDF Client Augmentation Thesaurus A Adapter Component ? OpenSearch Extended Thesaurus B Adapter Interface .. . (semantic) ? Gazetteer EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  36. Semantic Augmentation ? ? ? CSW/ISO Discovery ? Broker ? (Mediator) Adapter Semantic ? SKOS/RDF Client Augmentation Thesaurus A Adapter Component ? OpenSearch Extended Thesaurus B Adapter Interface .. . (semantic) ? Gazetteer EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  37. Concepts discovery by semantic network browsing EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  38. Concepts discovery by semantic network browsing EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  39. COMMON GRID DATA ACCESS EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  40. Data Access • Data Access functionality is composed of: – Data pre- processing functionalities to “normalize” data • Sub-setting (i.e. trimming, slicing) • Format conversion • CRS transformation • Data Interpolation • …. – Data Download functionalities • Synchronous and asynchronous downloads • RESTful and SOAP bindings EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  41. EuroGEOSS IOC WMS WCS Client WFS (edit Mask) Event – place - date

  42. EuroGEOSS IOC Sub-setting, Format conversion , CRS transformation, Interpolation WMS WCS Client WFS (edit Mask) Event – place - date

  43. EuroGEOSS IOC Sub-setting, Format conversion , CRS transformation, Interpolation WMS WCS Client WFS (edit Mask) Event – place - date

  44. EuroGEOSS IOC WMS WCS Client WFS (edit Mask) Event – place - date

  45. EuroGEOSS IOC WMS WCS Client Sub-setting, Interpolation WFS (edit Mask) Event – place - date

  46. EuroGEOSS IOC WMS WCS Client Sub-setting, Interpolation WFS (edit Mask) Event – place - date

  47. EuroGEOSS IOC WMS WCS Client WFS (edit Mask) Event – place - date

  48. EuroGEOSS IOC WMS WCS Client WFS Sub-setting, Format conversion , Interpolation (edit Mask) Event – place - date

  49. EuroGEOSS IOC WMS WCS Client WFS Sub-setting, Format conversion , Interpolation (edit Mask) Event – place - date

  50. EuroGEOSS IOC WMS WCS Client WFS (edit Mask) Event – place - date

  51. AOC: Requirements and Objective • To develop an access framework which does not supplant but complete existing access systems/services • A flexible framework to allow CoPs to use their pre- processing components/services – where required • To be compliant with the INSPIRE transformation implementing rules EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  52. AOC: Requirements and Objective • To develop an access framework which does not supplant but complete existing access systems/services • A flexible framework to allow CoPs to use their pre- processing components/services – where required • To be compliant with the INSPIRE transformation implementing rules A broker system which implements the necessary mediations to make use of existing and future data pre- processing services –to “normalize” discovered data EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  53. Sub-setting, Format conversion , CRS transformation, Interpolation WMS Access WCS Client Broker WFS (edit Mask) Event – place - date

  54. Sub-setting, Format conversion , CRS transformation, Interpolation WMS Access WCS Client Broker WFS WPS reprojection (edit Mask) Event – place - date

  55. WMS Access WCS Client Broker Sub-setting, Interpolation WFS (edit Mask) Event – place - date

  56. WMS Access WCS Client Broker WFS (edit Mask) Event – place - date

  57. WMS Sub-setting, Format conversion , Interpolation Access WCS Client Broker WFS (edit Mask) Event – place - date

  58. WMS Sub-setting, Format conversion , Interpolation Access WCS Client Broker WFS MATLAB Web Service (edit Mask) Event – place - date

  59. WMS Access WCS Client Broker WFS (edit Mask) Event – place - date

  60. AOC: Client  Access Broker  Access Services IOC: Client  Access Services (edit Mask) Event – place - date

  61. Access Broker: the Context Registry WMS Access getData Access request Discovery request WCS Client Broker Broker CSW / INSPIRE OpenSearch Transformation Service WFS Reprojection Workflow Workflow Format conversion Kepler ... . Taverna WPS WPS Forecasting Subsetting Reprojection Interpolation Open MATLAB Modeller WCTS WPS Web Service EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  62. Access Broker: the Context Registry WMS Access getData Access request Discovery request WCS Client Broker Broker CSW / INSPIRE OpenSearch Transformation Service WFS Specific CoP Reprojection Workflow Workflow Format conversion Reseampling Kepler MATLAB ... . Taverna WPS WPS Web Forecasting Service Subsetting Reprojection Interpolation Open MATLAB Modeller WCTS WPS Web Service EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  63. WEB 2.0 RESOURCES DISCOVERY EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  64. Web 2.0 services considered Service Name Available content type Twitter short texts Google Search API Vector data (KML format) Panoramio Raster data (photographs) Picasa Raster data (photographs) Flickr Raster data (photographs) OpenStreetMap Vector data (OSM format) Wikimapia Text (place names & descriptions) Geonames Text (place names) Geocommons Raster and vector data (maps) Wikipedia Through Geonames [Source: EuroGEOSS D2.6.1 (L. Díaz, C. Granell, O. Fonts, J. Gil)] EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  65. Web 2.0 services considered Service Name Available content type Twitter short texts Google Search API Vector data (KML format) Panoramio Raster data (photographs) Picasa Raster data (photographs) Flickr Raster data (photographs) OpenStreetMap Vector data (OSM format) Wikimapia Text (place names & descriptions) Geonames Text (place names) Geocommons Raster and vector data (maps) Wikipedia Through Geonames [Source: EuroGEOSS D2.6.1 (L. Díaz, C. Granell, O. Fonts, J. Gil)] EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  66. Web 2.0 service Adaptors Common Interface [Source: EuroGEOSS D2.6.1 (L. Díaz, C. Granell, O. Fonts, J. Gil)] EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  67. Web 2.0 service Adaptors Common Interface Common interface: OpenSearch(-geo) interface [Source: EuroGEOSS D2.6.1 (L. Díaz, C. Granell, O. Fonts, J. Gil)] EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  68. Adaptors capabilities [Source: EuroGEOSS D2.6.1 (L. Díaz, C. Granell, O. Fonts, J. Gil)] Web 2.0 Service Features Wikipedia through Geonames JSON Wikipedia Search Web Service: Response format: KML Filter: Text search. Paged results: NO Geonames through JSON Search Web Service: Response format: KML Filter: Text search Paged results: YES Twitter through search API: Response format: Atom + GeoRSS (Supported natively by API). Filter: Text search Paged results: NO Flickr through REST search API: Response format: KML Filter: Text search and bbox Paged results: YES OpenStreetMap through nominatim API: Response format: KML Filter: Text search and bbox Paged results: NO EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  69. Web 2.0 resources support Geonames Adaptor Twitter Adaptor OpenSearch(-geo) Flickr Adaptor CSW/ISO Discovery Broker OpenStreet Map Adaptor Wikipedia Adaptor OpenSearch(-geo) Geocommons EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  70. ADVANCED PREVIEW EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  71. Flexibility: support heterogeneous Clients • Any “standard” CSW or OpenSearch Client can be used to access the discovery capacity – GEO-portal – Geonetwork – ArcGIS / ArcExplorer – Web Browsers (via OpenSearch) – WorldWind – GI-go (thick) and its thin version: GI-portal – …… EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  72. USE SCENARIOS (AIP-3) EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  73. GEO Clearighouse Catalogs GCI EuroGEOSS AOC GEO Portal GEO Workflow Registries Modeling Workflows Model Services Model BP Ontology Semantic-enabled Discovery and Processing EuroGEOSS Brokering Platform (GeoRSS support) DISTRIBUTED METADATA Common geographical Grid framework CATALOG EDITOR(S) knowledge Catalogs Registries Inventory Services Data Web 2.0 Servers Data Resources Structured Resources Data Data (edit Mask) Event – place - date

  74. GEOSS AIP-3 Use Scenarios – In collaboration with the FP7 GENESIS project – Biodiversity & Climate Change WG • e-Habitat & Species Occurrences Use Scenario – A web based decision-making tool for assessing environmental changes due to anthropogenic activities, including climate change – The development of the modeling web service for computing habitat similarities and irreplaceability allows the community to assess possible environmental consequences. • Scientific patron: Gregoire Dubois (JRC) – Water (Drought) WG • European Drought Observatory (EDO) Use Scenario – Assessment of the drought situation in Europe – Multi-scale approach based on subsidiarity that integrates drought information from various scales • Scientific patron: Stefan Niemeyer (JRC) EuroGEOSS Meeting – JRC Ispra – 4-6 oct 2010

  75. Related Challanges: From ncML to ncML-G+

  76. Encoding Field View Content abstract realization Conceptual Conceptual Model & Encoding Approach Metadata Model Schema ISO 19139 ISO 19115 ISO 19123 FieldView GML- (Coverage Coverage types) netCDF CF ncML /CDM stefano.nativi@cnr.it ESSI Lab

Recommend


More recommend