In and out: Work flows between library data and linked- data at the - PowerPoint PPT Presentation

BIBLIOTECA NACIONAL DE ESPAÑA In and out: Work flows between library data and linked- data at the National Library of Spain Semantic Web in Libraries November, 25-27th, 2019, Hamburg Ricardo Santos National Library of Spain @3186Ricardo #datosbne

2 WHAT IS DATOS.BNE? A fully functioning linked-data based gateway into the library resources. - Library resources (as any other catalogue) - Data about authors - Data about vocabularies - Data about items - Connected to usual library services (digital library items, loan services, document reproduction services) @3186Ricardo BIBLIOTECA NACIONAL DE ESPAÑA #datosbne

3 MAIN FEATURES FRBR-Based Entity based Entity driven search Entity-based search results ranking Linked and enriched Interlinks between FRBR entities Linked to prominent equivalent concepts Enriched with outside data @3186Ricardo BIBLIOTECA NACIONAL DE ESPAÑA #datosbne

4 BASIC DATA MODEL BIBLIOTECA NACIONAL DE ESPAÑA

From MARC to FRBR entities 5 From a 2-D structure to…. BIBLIOTECA NACIONAL DE ESPAÑA

From MARC to FRBR entities 6 BIBLIOTECA NACIONAL DE ESPAÑA

7 Behind the scenes Data (Marc) Data Data analysis generation Mapping & sorting MARiMbA Linked Data generation Linking and enrichment Ranking based in FRBR Indexing (1) relationships Publication Front-end (2) pipeline Double storing Triple store (3) (1) Elasticsearch (2) MongoDB (3) Virtuoso BIBLIOTECA NACIONAL DE ESPAÑA

8 Peeking inside Marimba Ingestion and analysis of MARC21 records Mapping 1: sorting Mapping 2: model entity linking Mapping 3: data properties Sorting is based on records : RDF generation Ex: An authority record with a given tag and a given subfield Data properties are based on Object properties are based on combination is an entity XX subfields : internal keys or inferred 100 $a $d  C1005 260 $a  P3003 (place of publication) BIBLIOTECA NACIONAL DE ESPAÑA

9 Dataflows MARC21 Digital (95%) Library (2%) Other sources DATOS.BNE.ES BIBLIOTECA NACIONAL DE ESPAÑA

1 0 Dataflows Links: sameAs Other sources Identifiers from VIAF BIBLIOTECA NACIONAL DE ESPAÑA

1 1 Dataflows Other sources Identifiers from VIAF THEY REMAIN ONLY IN DATOS.BNE Dbpedia BIBLIOTECA NACIONAL DE ESPAÑA

1 2 Enrichments and data imports Main enrichment: EVERYDAY JOB Other enrichments and imports: Library Source Datos.bne system Sources: Libraries and beyond Data imported: identifiers, equivalencies and attributes BIBLIOTECA NACIONAL DE ESPAÑA

1 3 2019: Wikidata Achievement: more than 80.000 persons authority records enriched with data from Wikidata Mapping BNE Ids with Wikidata IDs, using VIAF identifier datadump Extracting selected properties (in Spanish where available), using the Wikidata API: - Retrieved selected properties from every ID in JSON - Sorting and grouping - Convert to MARC21 fields according to mapping Performed by datosbne technological partner, Memorandum Multimedia BIBLIOTECA NACIONAL DE ESPAÑA

1 4 2019: Wikidata Quality check-ups: General overview  disregard property P737 (influenced by) Work on property Occupation (P106) : - Sorting, grouping and arranging for revision by vocabulary experts. - Decision on every value: o Keep it o Align it with BNE Subject Vocabulary o Disregard it. BIBLIOTECA NACIONAL DE ESPAÑA

1 5 2019: Wikidata Occupation quality check-up: BIBLIOTECA NACIONAL DE ESPAÑA

1 6 From Wikidata to datosbne A funny thing happened on my way to datos.bne BIBLIOTECA NACIONAL DE ESPAÑA

1 7 From Wikidata to datosbne A funny thing happened on my way to datos.bne BIBLIOTECA NACIONAL DE ESPAÑA

1 8 From Wikidata to datosbne A funny thing happened on my way to datos.bne BIBLIOTECA NACIONAL DE ESPAÑA

1 9 From Wikidata to datosbne A funny thing happened on my way to datos.bne BIBLIOTECA NACIONAL DE ESPAÑA

2 0 From Wikidata to datosbne A funny thing happened on my way to datos.bne BIBLIOTECA NACIONAL DE ESPAÑA

2 1 From Wikidata to datosbne A funny thing happened on my way to datos.bne datos.bne Persons’ advanced search BIBLIOTECA NACIONAL DE ESPAÑA

2 2 From Wikidata to datosbne A funny thing happened on my way to datos.bne BIBLIOTECA NACIONAL DE ESPAÑA

2 3 Wikidata : concerns PROVENANCE Provenance is explicit in the library side of the data No mapping or device has been implement in the RDF side BIBLIOTECA NACIONAL DE ESPAÑA

2 4 Wikidata : concerns QUALITY Wikidata is exposed to data vandalism Keep calm and Don’t be afraid of errors BIBLIOTECA NACIONAL DE ESPAÑA

Ricardo Santos Head of Technical Services Department ricardo.santos@bne.es @3186ricardo Pº de Recoletos 20-22 28071 Madrid España T +34 915 807 800 www.bne.es BIBLIOTECA NACIONAL DE ESPAÑA NATIONAL LIBRARY OF SPAIN