Graph Data Processing M. Tamer Ozsu 1 / 75 Outline Introduction - PowerPoint PPT Presentation

Graph Data Processing M. Tamer ¨ Ozsu 1 / 75

Outline Introduction RDF Graph Querying General Graph Processing Offline analytics Online querying 2 / 75

Graph Data are Very Common Internet 3 / 75

Graph Data are Very Common Social networks 4 / 75

Graph Data are Very Common Trade volumes and connections 5 / 75

Graph Data are Very Common Biological networks 6 / 75

Graph Data are Very Common Linked Audio LOV User Slideshare tags2con delicious Scrobbler Feedback 2RDF Moseley Bricklink Sussex GTAA Folk (DBTune) Reading St. Magna- Lists Andrews tune Klapp- Resource stuhl- NTU DB Lists Lotico club Semantic yovisto Resource Tropes John Music Man- Lists Music Tweet Hellenic Peel Brainz chester NDL Brainz Reading FBD (DBTune) (Data subjects EUTC (zitgist) Lists Open Hellenic Incubator) Linked t4gm Produc- Crunch- Library Open PD tions Surge RDF Library info Radio Discogs base ohloh Ontos Source Code Plymouth (Talis) Crime (Data News LEM Reports Ecosystem Reading RAMEAU business Incubator) Portal Linked Data Lists SH UK Crime data.gov. Music Jamendo (En- uk Brainz (DBtune) LinkedL Ox AKTing) FanHubz gnoss CCN ntnusc (DBTune) SSW Points Last.FM Thesaur Thesau- Poké- Popula- artists pédia Didactal us rus W LIBRIS tion (En- patents (DBTune) Last.FM ia theses. LCSH Rådata reegle AKTing) research MARC data.gov. data.go (rdfize) my fr nå! NHS Good- Experi- Codes Ren. uk v.uk Classical List (En- win flickr ment Energy (DB Pokedex Norwe- Genera- AKTing) Mortality BBC Family wrappr Sudoc PSH (En- Tune) gian tors Program MeSH AKTing) semantic educatio mes BBC IdRef GND CO 2 OpenEI web.org SW ndlna Energy Emission n.data.g Music Sudoc EEA (En- Chronic- Linked Dog VIAF (En- ov.uk Portu- UB AKTing) ling Event MDB Food AKTing) guese Mann- Europeana BBC America Media DBpedia Calames heim Recht- Wildlife Deutsche Open Ord- Revyu DDC nance Openly spraak. Finder Bio- lobid Election RDF graphie Data legislation Survey Local nl data Ulm Resources NSZL Swedish EU Tele- New Book Catalog Project data.gov.uk graphis bnf.fr Open Insti- York Open Mashup tutions Times URI Greek P20 Cultural UK Post- Burner Calais Heritage DBpedia codes statistics ECS Wiki lobid Taxon South- GovWILD data.gov. LOIUS iServe BNB Organi- uk Concept ampton Brazilian Geo World BibBase ECS sations STW GESIS Poli- OS South- ECS ESD Names Fact- Linked data ticians stan- reference ampton (RKB data.gov.uk book Freebase Explorer) Budapest dards data.gov. NASA EPrints intervals Project OAI Lichfield uk transport (Data DBpedia data Spen- Incu- Guten- Pisa data.gov. dcs RESEX Scholaro- ISTAT ding bator) Fishes berg DBLP DBLP uk Geo meter Immi- Scotland of Texas Uberblic (FU (L3S) Pupils & Species Berlin) DBLP gration data- IRIT Exams Euro- dbpedia (RKB London stat lite TCM open- ACM Gene Explorer) IBM NVD Traffic Gazette (FUB) Geo ac-uk TWC LOGD Eurostat Daily DIT Scotland Linked UN/ Data UMBEL Med ERA Data YAGO LOCODE DEPLOY Gov.ie CORDIS Disea- New- lingvoj (RKB some SIDER RAE2001 castle LOCAH Explorer) Linked Eurécom CORDIS Drug Roma Eurostat Sensor Data CiteSeer (FUB) (Ontology Bank GovTrack (Kno.e.sis) riese Open Pfam Course- Central) Cyc Enipedia LinkedCT Lexvo ware Linked UniProt PDB VIVO EDGAR dotAC EURES US SEC Indiana ePrints IEEE (Ontology totl.net (rdfabout) Central) WordNet RISKS Taxono UniProt US Census EUNIS Twarql (VUA) HGNC Semantic (rdfabout) Cornetto my (Bio2RDF) VIVO PRO- FTS XBRL ProDom STITCH Cornell LAAS SITE Scotland KISTI NSF GeoWord LODE Geo- graphy Net WordNet WordNet JISC (W3C) Climbing (RKB Affy- KEGG Linked Pub VIVO UF SMC GeoData Explorer) SISVU metrix Drug Finnish Piedmont Journals PubMed Gene SGD Chem ECCO- Accomo- El TCP Media Munici- AGROV Ontology dations Viajero Alpine bible palities OC Tourism Ski KEGG ontology Austria Geographic Ocean GEMET Enzyme PBAC Metoffice ChEMBL Italian Drilling OMIM KEGG public Codices AEMET Weather Open Linked MGI Data Pathway Publications schools Forecasts Open InterPro GeneID KEGG Turismo EARTh Thesau- rus Colors Reaction de Zaragoza Product User-generated content Smart KEGG Weather DB Link Medi Janus Glycan Stations Product UniParc UniRef Care KEGG AMP UniSTS Government Yahoo! Types Italian Homolo Com- Airports Ontology Museums Google pound Geo Gene Art Planet National Chem2 Cross-domain wrapper Radio- Bio2RDF activity UniPath Open way Life sciences JP Sears Amster- Linked OGOLOD Corpo- Reactome dam medu- Open rates Numbers Museum cator As of September 2011 Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/ 7 / 75

Graph Types RDF graph “The Passenger” “The Last Tycoon” refs:label refs:label mdb:film/3418 mdb:film/1267 bm:offers/0743424425amazonOffer “United Kingdom” 62348447 scam:hasOffer movie:actor movie:actor gn:name gn:population bm:books/0743424425 geo:2635167 mdb:actor/29704 rev:rating movie:actor name movie:relatedBook 4.7 foaf:based near movie:actor “Jack Nicholson” refs:label “The Shining” mdb:film/2014 “Stanley Kubrick” movie:director movie:director name movie:actor mdb:director/8476 movie:initial release date mdb:actor/30013 movie:director movie:director mdb:film/2685 mdb:film/424 “1980-05-23” refs:label refs:label “A Clockwork Orange” “Spartacus” 8 / 75

Graph Types Property graph film 3418 film 1267 (label, “The Passenger”) (label, “The Last Tycoon”) offers 0743424425amazonOffer (hasOffer) (actor) (actor) geo 2635167 books 0743424425 (name, “United Kingdom”) (rating, 4.7) actor 29704 (population, 62348447) (actor name, “Jack Nicholson”) (relatedBook) (based near) (actor) film 2014 (initial release date, “1980-05-23”) (label, “The Shining”) (director) (actor) director 8476 (director name, “Stanley Kubrick”) actor 30013 (director) (director) film 2685 film 424 (label, “A Clockwork Orange”) (label, “Spartacus”) 9 / 75

Graph Types RDF graph Property graph film 3418 film 1267 “The Passenger” “The Last Tycoon” (label, “The Passenger”) (label, “The Last T offers 0743424425amazonOffer refs:label refs:label (hasOffer) (actor) (actor) geo 2635167 books 0743424425 (name, “United Kingdom”) mdb:film/3418 mdb:film/1267 (rating, 4.7) (population, 62348447) actor 29704 (actor name, “Jack Nicholson”) bm:offers/0743424425amazonOffer “United Kingdom” (relatedBook) 62348447 (based near) (actor) scam:hasOffer movie:actor movie:actor gn:name gn:population film 2014 (initial release date, “1980-05-23”) bm:books/0743424425 geo:2635167 (label, “The Shining”) mdb:actor/29704 (director) rev:rating (actor) director 8476 movie:actor name (director name, “Stanley Kubrick”) movie:relatedBook actor 30013 4.7 foaf:based near movie:actor (director) (director) “Jack Nicholson” refs:label film 2685 film 424 “The Shining” mdb:film/2014 “Stanley Kubrick” (label, “A Clockwork Orange”) (label, “Spartacus”) movie:director name movie:director movie:actor mdb:director/8476 movie:initial release date mdb:actor/30013 movie:director movie:director mdb:film/2685 mdb:film/424 “1980-05-23” refs:label refs:label “A Clockwork Orange” “Spartacus” ◮ Workload: SPARQL ◮ Workload: Online queries queries and analytic workloads ◮ Query execution: subgraph ◮ Query execution: Much matching by more varied homomorphism 10 / 75

Outline Introduction RDF Graph Querying General Graph Processing Offline analytics Online querying 11 / 75

RDF Graph “The Passenger” “The Last Tycoon” refs:label refs:label mdb:film/3418 mdb:film/1267 bm:offers/0743424425amazonOffer “United Kingdom” 62348447 scam:hasOffer movie:actor movie:actor gn:name gn:population bm:books/0743424425 geo:2635167 mdb:actor/29704 rev:rating movie:actor name 4.7 movie:relatedBook foaf:based near movie:actor “Jack Nicholson” refs:label “The Shining” mdb:film/2014 “Stanley Kubrick” movie:director movie:director name movie:actor mdb:director/8476 movie:initial release date mdb:actor/30013 movie:director movie:director mdb:film/2685 mdb:film/424 “1980-05-23” refs:label refs:label “A Clockwork Orange” “Spartacus” 12 / 75

SPARQL Queries SELECT ?name WHERE { ?m r d f s : l a b e l ?name . ?m movie : d i r e c t o r ?d . ?d movie : director name ” Stanley Kubrick ” . ?m movie : relatedBook ?b . ?b rev : r a t i n g ? r . FILTER (? r > 4.0) } FILTER(?r > 4.0) rev:rating ?b ?r “Stanley Kubrick” ?name movie:relatedBook rdfs:label movie:director name ?m ?d movie:director 13 / 75