Official Statistics meets the Semantic Web: How SDMX and RDF can live together Raffaella Maria Aracri, Stefano De Francisci, Andrea Pagano, Monica Scannapieco Istituto Nazionale di Statistica Istat, Italy
Objective Designing and implementing translation from SDMX data into RDF data Format and Model translation Integration of SDMX dissemination architecture with Semantic Web technologies “Horizontal [Part of Eurostat: and vertical integration: implementing technical and statistical standards in ESS”] Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 2
Agenda Background: RDF, RDF Schema, RDF QB SDMX Reference Infrastructure (SDMX-RI) and SDMXSource.NET Methods and Results: Modeling: from SDMX to RDF Data Cube Vocabulary Adding structure and data format to SdmxSource.NET Testing • Conclusions Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 3
BACKGROUND
Semantic Web Standards: Data Models World Wide Web Consortium (W3C) data models RDF (Resource Description Framework): RDF 1.1 Suite, W3C Recommendation February 2014 RDF-QB: RDF Data Cube Vocabulary, W3C Recommendation January 2014, to represent multidimensional data structures Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 5
SDMX-RI and NSI Web Services • .NET and Java implementation • Open Source. SDMX.Source.NET as the Off-line implementation of SDMX code mapping of source on which RI tools are built. NSI’s data Web Services to make data available as generic or structured format according to client requirement Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 6
? Speci alized RDF Specializ Write r ed DAT RDF A Writer METADA TA METHODS & RESULTS
? The problem Given a Client request to Web Services of the SDMX- RI… returning an RDF Structure and Data NSI-DATA user .txt through Query Gesmes a client REST file Excel SDMX DB data RDF data Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 8
Mapping SDMX data model to RDF-QB data model The translation step from SDMX to RDF is not only a “format” translation, but it involves a “model” translation. qb:componentnt qb:DataStructureDefinition qb:ComponentSpecification qb:componentProperty qb:structure qb:DataSet qb:ComponentProperty qb:dataSet qb:DimensionProperty qb:Observation qb:AttributeProperty qb:MeasureProperty RDF Data Cube Model qb:CodedProperty Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 9
Example: RDF Data Cube Model - Data Structure Definition “ Environment and energy – Air” datiopen.istat.it/property/UNIT_MEAS datiopen.istat.it/property/TIME_FORMAT datiopen.istat.it/property/OBS_VALUE qb:componentProperty qb:componentProperty qb:componentProperty qb:attribute qb:measure qb:attribute qb:component qb:component qb:component datiopen.istat.it/property/REF_AREA qb:component qb:componentProperty qb:component datiopen .istat.it/ structure /1.0/CONS_ENERGIA_LOMB datiopen.istat.it/property/TIME_PERIOD qb:dimension qb:componentProperty rdf:type qb:codedProperty, qb:codList: purl.org/linked-ata/sdmx# DataStructureDefinition qb:dimension datiopen .istat.it/code/1.0/CL_PROV_LOMB qb:component qb:component qb:component datiopen .istat.it/property/IND_TYPE datiopen.istat.it/property/FREQ datiopen.istat.it/property/USO_ENERGIA qb:componentProperty qb:componentProperty qb:componentProperty qb:dimension qb:dimension qb:dimension qb:codedProperty, qb:codList: qb:codedProperty, qb:codList: qb:codedProperty, qb:codList: datiopen .istat.it datiopen .istat.it/code/1.0/CL_FREQ datiopen .istat.it /code/1.0/CL_AMBIENTE_INDICATOR /code/1.0/CL_USO_ENERGIA Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 10
Example: RDF Data Cube Model - Observation of DataSet “ Environment and energy – Air ” datiopen.istat.it/ structure /1.0/CONS_ENERGIA_LOMB qb:structure 1194 datiopen.istat.it/dataset/DS_ENERGY_ITC41 property:OBS_VALUE qb:dataset property:REF_AREA property:TIME_PERIOD rdf:type purl.org/linked-data/cube# Observation datiopen.istat.it /code/1.0/CL_PROV_LOMB/ ITC41 reference.data.gov.uk/id/year/ 2000 dataset/DS_ENERGY_ITC41/ITC41/EE_DOM_XAB/1/A/2000 property:IND_TYPE property:FREQ property:USO-ENERGIAENERGIA datiopen.istat.it /code/1.0/CL_AMBIENTE_INDICATOR/ EE_DOM_XAB datiopen.istat.it /code/1.0/CL_USO_ENERGIA/ 1 datiopen.istat.it /code/1.0/code/1.0/CL_FREQ/ A Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 11
Implementation of the Speci alized RDF Specializ Write ed r DAT RDF A Writer METADA RDF «writer» TA Leverage SdmxSource.NET source code where possible Specific ‘add - on’ to be included in future SDMXSource.Net releases user Request NSI through a Web Services client Specialized RDF V2.1 RDF Writer DATA Structure & Data Specialized RDF Writer METADATA Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 12
Testing To validate the results we leverage the “ Sdmx- RI Test Client”. The Test Client is a tool to test the SDMX Reference Infrastructure building blocks and to expose/browse the dissemination environment of an NSI. Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 13
Testing Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 14
! CONCLUSIONS
! Conclusions Translating SDMX into RDF is possible! Working solution has been implemented Integration of the solution with Linked Open Data dissemination channel based on a SPARQL Endpoint: datiopen.istat.it Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 16
Questions? Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 17
Recommend
More recommend