nifify towards better quality entity linking
play

NIFify: Towards Better Quality Entity Linking Datasets Henry - PowerPoint PPT Presentation

Sep 23, 2022 •135 likes •405 views

NIFify: Towards Better Quality Entity Linking Datasets Henry Rosales-M endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl May 14, 2019 LA-WEB 2019 - 10th Latin American Web Congress

  1. NIFify: Towards Better Quality Entity Linking Datasets † Henry Rosales-M´ endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl May 14, 2019 † LA-WEB 2019 - 10th Latin American Web Congress

  2. Example

  3. Example - Entity Recognition

  4. Example - Entity Disambiguation

  5. Name Variations in Entity Linking Michael Joseph Jackson Michael J. Jackson King of Pop

  6. Name Variations in Entity Linking Michael Jackson

  7. Are there benchmark datasets to measure Entity Linking results?

  8. Overview of popular EL datasets Dataset Mn Typ Format MSNBC MSNBC ✗ ✗ IITB ✓ ✗ IITB AIDA/CoNLL ✓ ✗ AIDA ACE2004 MSNBC ✗ ✗ AQUAINT ✗ ✗ MSNBC DBpedia Spotlight ✓ ✗ Lexvo KORE50 AIDA ✓ ✗ N3-RSS 500 ✓ ✗ NIF Reuters 128 ✓ ✗ NIF News-100 ✓ ✗ NIF Wes2015 NIF ✓ ✗ SemEval 2015 Task 13 ✓ ✗ SemEval Thibaudet ✗ ✓ RENDEN Bergson RENDEN ✗ ✓ DBpedia Abstracts ✗ ✗ NIF MEANTIME ✓ ✓ CAT VoxEL NIF ✓ ✗

  9. Overview of popular EL datasets Dataset Mn Typ Format MSNBC MSNBC ✗ ✗ IITB ✓ ✗ IITB AIDA/CoNLL ✓ ✗ AIDA ACE2004 MSNBC ✗ ✗ AQUAINT ✗ ✗ MSNBC DBpedia Spotlight ✓ ✗ NIF KORE50 ✓ ✗ NIF N3-RSS 500 ✓ ✗ NIF Reuters 128 ✓ ✗ NIF News-100 ✓ ✗ NIF Wes2015 NIF ✓ ✗ SemEval 2015 Task 13 ✓ ✗ SemEval Thibaudet ✗ ✓ RENDEN Bergson RENDEN ✗ ✓ DBpedia Abstracts ✗ ✗ NIF MEANTIME ✓ ✓ CAT VoxEL NIF ✓ ✗

  10. Proposal NIFify: a tool that simultaneously supports the creation, visualization, and validation of NIF datasets, as well as the comparison of EL systems.

  11. Related Work • NIF-Dataset creation QRTool BENGAL Automatic NIF Creation Demo Source Code

  12. Related Work • NIF-Dataset creation QRTool BENGAL Automatic NIF Creation Demo Source Code • NIF-Dataset validation Eaglet Demo Source Code NIF-Dataset Validation

  13. Related Work • NIF-Dataset creation QRTool BENGAL Automatic NIF Creation Demo Source Code • NIF-Dataset validation Eaglet Demo Source Code NIF-Dataset Validation • Benchmarking GERBIL Benchmark Demo Source Code Visualization NIF-Dataset Creation Orbis Benchmark Demo Source Code Visualization

  14. Related Work • NIF-Dataset creation QRTool BENGAL Automatic NIF Creation Demo Source Code • NIF-Dataset validation Eaglet Demo Source Code NIF-Dataset Validation • Benchmarking GERBIL Benchmark Demo Source Code Visualization NIF-Dataset Creation Orbis Benchmark Demo Source Code Visualization NIF-Dat

  15. NIFify - Creation

  16. NIFify - Creation

  17. NIFify - Creation

  18. NIFify - Creation

  19. NIFify - Validation

  20. NIFify - Validation

  21. Errors found in current NIF datasets Spelling Error Link Error Format Error Dataset DBpedia Spotlight 8 23 4 N3-RSS 500 1 34 – Reuters 128 4 71 – News-100 9 1515 – Wes2015 – 609 – VoxEL – 8 – • https://users.dcc.uchile.cl/~hrosales/dataset_errors.html

  22. Errors found in current NIF datasets

  23. NIFify - Benchmarking

  24. NIFify - Benchmarking

  25. Conclusion • NIFify: Creation/Validation/Visualization/Benchmark • Demo: https://users.dcc.uchile.cl/~hrosales/NIFify_v2.html • Source Code: https://github.com/henryrosalesmendez/NIFify_v2

  26. NIFify: Towards Better Quality Entity Linking Datasets † Henry Rosales-M´ endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl May 14, 2019 † LA-WEB 2019 - 10th Latin American Web Congress

Recommend

Entity Linking and Coreference Resolution CSCI 699 Instructor: Xiang Ren USC Computer Science

Entity Linking and Coreference Resolution CSCI 699 Instructor: Xiang Ren USC Computer Science

Entity Linking and Coreference Resolution CSCI 699 Instructor: Xiang Ren USC Computer Science Entity Linking: CSCI 699 Entity Linking: The Problem Query Entity NIL Given a source document, identify entities mentioned in text, and find

2.26k views • 126 slides
(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation Entity linking

(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation Entity linking

(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation Entity linking Reflector overview Represent the data A bit code Learnings MOTIVATION practicing Clojure How will the backend &

739 views • 25 slides
Entity Linking Enityt Linking Laura Dietz dietz@cs.umass.edu University of Massachusetts Use

Entity Linking Enityt Linking Laura Dietz dietz@cs.umass.edu University of Massachusetts Use

Entity Linking Enityt Linking Laura Dietz dietz@cs.umass.edu University of Massachusetts Use cursor keys to fl ip through slides. Problem: Entity Linking Query Entity NIL Given query mention in a source document, identify which Wikipedia

938 views • 59 slides
linking, cross-lingual entity linking) TAC 2011 Summarization Track Guided Summarization task

linking, cross-lingual entity linking) TAC 2011 Summarization Track Guided Summarization task

Overview of the TAC2011 Summarization (Guided, AESOP, MultiLing) RTE (within a corpus including novelty detection and ablation testing) Knowledge Base Population (monolingual entity linking, cross-lingual entity linking) TAC 2011 Summarization

596 views • 10 slides
Cross-Lingual Cross-Document Coreference with Entity Linking Sean Monahan, John Lehmann, Timothy

Cross-Lingual Cross-Document Coreference with Entity Linking Sean Monahan, John Lehmann, Timothy

Cross-Lingual Cross-Document Coreference with Entity Linking Sean Monahan, John Lehmann, Timothy Nyberg, Jesse Plymale, Arnold Jung 2010 Entity Linking Task Link entity mentions in text to Knowledge Base (KB) Each entity mention is

390 views • 28 slides
Entity Linking with Multiple Knowledge Bases Bianca Pereira MSc. / PhD Day November 2015

Entity Linking with Multiple Knowledge Bases Bianca Pereira MSc. / PhD Day November 2015

Entity Linking with Multiple Knowledge Bases Bianca Pereira MSc. / PhD Day November 2015 Motivation Entity Linking is the task of grounding entity mentions in text with Knowledge Base entries.

439 views • 17 slides
MedLinker Medical Entity Linking with Neural Representations and Dictionary Matching *Daniel

MedLinker Medical Entity Linking with Neural Representations and Dictionary Matching *Daniel

MedLinker Medical Entity Linking with Neural Representations and Dictionary Matching *Daniel Loureiro and Alpio Mrio Jorge Medical Entity Linking Medical literature is growing rapidly. This information is extremely important, but

612 views • 19 slides
Design Challenges for Entity Linking Xiao Ling , Sameer Singh, Daniel S. Weld Entity Linking

Design Challenges for Entity Linking Xiao Ling , Sameer Singh, Daniel S. Weld Entity Linking

Design Challenges for Entity Linking Xiao Ling , Sameer Singh, Daniel S. Weld Entity Linking Seattle beat Portland yesterday. 2 Entity Linking Seattle beat Portland yesterday. 3 Entity Linking Seattle beat Portland yesterday. Seattle

724 views • 69 slides
Entity Linking via Low-rank Subspaces Akhil Arora , Alberto Garca-Durn, and Bob West SMLD

Entity Linking via Low-rank Subspaces Akhil Arora , Alberto Garca-Durn, and Bob West SMLD

Entity Linking via Low-rank Subspaces Akhil Arora , Alberto Garca-Durn, and Bob West SMLD November 13, 2019 What is Entity Linking? Michael Jordan is one of the leading figures in machine learning, and in 2016 reported him

568 views • 44 slides
CROSS-LANGUAGE ENTITY LINKING PAUL MCNAMEE JAMES MAYFIELD* DOUGLAS W. OARD TAN XU KE WU

CROSS-LANGUAGE ENTITY LINKING PAUL MCNAMEE JAMES MAYFIELD* DOUGLAS W. OARD TAN XU KE WU

CROSS-LANGUAGE ENTITY LINKING PAUL MCNAMEE JAMES MAYFIELD* DOUGLAS W. OARD TAN XU KE WU VESELIN STOYANOV DAVID DOERMANN * TODAYS DESIGNATED BLOWHARD CROSS-LANGUAGE ENTITY LINKING KNOWLEDGE BASE QUERY !" " # $ % & ' ( '#

452 views • 26 slides
Full-document Entity Extraction and Disambiguation Silviu Cucerzan Microsoft Research Machine

Full-document Entity Extraction and Disambiguation Silviu Cucerzan Microsoft Research Machine

TAC Entity Linking by Performing Full-document Entity Extraction and Disambiguation Silviu Cucerzan Microsoft Research Machine Learning Group Gaithersburg, MD November 15, 2011 KBP Entity Linking - Task Description For a name string and a

738 views • 38 slides
FOFE-based Deep Neural Networks for Entity Discovery and Linking Nargiza Nosirova Mingbin Xu ,

FOFE-based Deep Neural Networks for Entity Discovery and Linking Nargiza Nosirova Mingbin Xu ,

Overview What is FOFE? Entity Discovery methods FOFE-based Entity Linking Results and Conclusion FOFE-based Deep Neural Networks for Entity Discovery and Linking Nargiza Nosirova Mingbin Xu , Nargiza Nosirova , Kelvin Jiang , Feng Wei and Hui

379 views • 18 slides
The MSR System for Entity Linking at TAC 2013 Silviu Cucerzan Microsoft Research Machine

The MSR System for Entity Linking at TAC 2013 Silviu Cucerzan Microsoft Research Machine

The MSR System for Entity Linking at TAC 2013 Silviu Cucerzan Microsoft Research Machine Learning and Intelligence / MS_MLI Gaithersburg, MD 11/19/2013 Task Description For a string at a given offset in a document, determine which entity

368 views • 25 slides
Fine-Grained Evaluation for Entity Linking Henry Rosales-M endez, Aidan Hogan and Barbara

Fine-Grained Evaluation for Entity Linking Henry Rosales-M endez, Aidan Hogan and Barbara

Fine-Grained Evaluation for Entity Linking Henry Rosales-M endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl Nov 5, 2019 EMNLP-IJCNLP 2019, Hong Kong Example Example - Entity

720 views • 52 slides
Using Hospital Data to Measure Quality of Care and Linking it to DRG of Care and Linking it to

Using Hospital Data to Measure Quality of Care and Linking it to DRG of Care and Linking it to

Using Hospital Data to Measure Quality of Care and Linking it to DRG of Care and Linking it to DRG (Case-Mix) Payments Presented by Jugna Shah, MPH President, Nimitt Consulting Inc. Nordic Case-Mix Conference Helsinki, Finland J ne 2010

450 views • 21 slides
Lecture 24: NER & Entity Linking Kai-Wei Chang CS @ University of Virginia kw@kwchang.net

Lecture 24: NER & Entity Linking Kai-Wei Chang CS @ University of Virginia kw@kwchang.net

Lecture 24: NER & Entity Linking Kai-Wei Chang CS @ University of Virginia kw@kwchang.net Couse webpage: http://kwchang.net/teaching/NLP16 CS6501-NLP 1 Organizing knowledge Its a version of Chicago the Chicago was used by default

322 views • 14 slides
HITS at TAC 2015 Entity Discovery and Linking Benjamin Heinzerling 1 , 2 and Michael Strube 2 1

HITS at TAC 2015 Entity Discovery and Linking Benjamin Heinzerling 1 , 2 and Michael Strube 2 1

HITS at TAC 2015 Entity Discovery and Linking Benjamin Heinzerling 1 , 2 and Michael Strube 2 1 AIPHES, 2 Heidelberg Institute for Theoretical Studies Joint Global Disambiguation and NIL Clustering Our previous years system (Fahrni et

525 views • 19 slides
Unsupervised Entity Linking with Abstract Meaning Representation Xiaoman Pan, Taylor Cassidy,

Unsupervised Entity Linking with Abstract Meaning Representation Xiaoman Pan, Taylor Cassidy,

Unsupervised Entity Linking with Abstract Meaning Representation Xiaoman Pan, Taylor Cassidy, Ulf Hermjakob, Heng Ji, Kevin Knight Intro Natural Language Processing (NLP) o Interactions between computers and human languages o Machine

422 views • 25 slides
Overview of TAC-KBP2017 13 Languages Entity Discovery and Linking Heng Ji, Xiaoman Pan, Boliang

Overview of TAC-KBP2017 13 Languages Entity Discovery and Linking Heng Ji, Xiaoman Pan, Boliang

Overview of TAC-KBP2017 13 Languages Entity Discovery and Linking Heng Ji, Xiaoman Pan, Boliang Zhang, Joel Nothman, James Mayfield, Paul McNamee and Cash Costello jih@rpi.edu Thanks to KBP2016 Organizing Committee Overview Paper:

801 views • 40 slides
Multilingual Entity Linking: Comparing English and Spanish Henry Rosales-M endez, Barbara

Multilingual Entity Linking: Comparing English and Spanish Henry Rosales-M endez, Barbara

1 / 36 Multilingual Entity Linking: Comparing English and Spanish Henry Rosales-M endez, Barbara Poblete and Aidan Hogan University of Chile { hrosales,bpoblete,ahogan } @dcc.uchile.cl October 22nd, 2017 LD4IE - Linked Data for

623 views • 36 slides
Entity Linking via Joint Encoding of Types, Descriptions, and Context Author: Nitish Gupta,

Entity Linking via Joint Encoding of Types, Descriptions, and Context Author: Nitish Gupta,

Entity Linking via Joint Encoding of Types, Descriptions, and Context Author: Nitish Gupta, Sameer Singh, Dan Roth Source: EMNLP17 Speaker: Ya-Wen Yu Date: 2018/7/31 1 Outline Introduction Method Experiment Conclusion

3.39k views • 23 slides
Exploring Neural Networks for Entity Discovery and Linking (EDL) Dan Liu 1 , Wei Lin 1 , Shiliang

Exploring Neural Networks for Entity Discovery and Linking (EDL) Dan Liu 1 , Wei Lin 1 , Shiliang

Exploring Neural Networks for Entity Discovery and Linking (EDL) Dan Liu 1 , Wei Lin 1 , Shiliang Zhang 2 , Si Wei 1 , Hui Jiang 3 1 i FLYTEK Research, Hefei, Anhui, China 2 University of Science and Technology of China, Hefei, Anhui, Mingbin Xu 3

673 views • 39 slides
Entity Linking to Knowledge Graphs to Infer Column Types and Properties Avijit Thawani , Minda Hu,

Entity Linking to Knowledge Graphs to Infer Column Types and Properties Avijit Thawani , Minda Hu,

Entity Linking to Knowledge Graphs to Infer Column Types and Properties Avijit Thawani , Minda Hu, Erdong Hu, Husain Zafar, Naren Teja Divvala, Amandeep Singh, Ehsan Qasemi, Pedro Szekely, and Jay Pujara About Us Team ISI: Information

877 views • 64 slides
VoxEL: A Benchmark Dataset for Multilingual Entity Linking Henry Rosales-M endez, Aidan

VoxEL: A Benchmark Dataset for Multilingual Entity Linking Henry Rosales-M endez, Aidan

VoxEL: A Benchmark Dataset for Multilingual Entity Linking Henry Rosales-M endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl October 10, 2018 ISWC 2018 - The 17th Internationl

859 views • 54 slides

More recommend