Joint Posterior Revision of NLP Annotations via Ontological - PowerPoint PPT Presentation

#4479 Joint Posterior Revision of NLP Annotations via Ontological Knowledge Marco Rospocher Francesco Corcoglioniti

Context: Knowledge Extraction Kia has hired Peter Schreyer as chief design officer. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Context: Knowledge Extraction Kia has hired Peter Schreyer as chief design officer. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Context: Knowledge Extraction Organization Kia has hired Peter Schreyer as chief design officer. NLP Tasks: - Named Entity Recognition and Classification (NERC) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Context: Knowledge Extraction Organization dbpedia:Kia_Motors Kia has hired Peter Schreyer as chief design officer. NLP Tasks: - Named Entity Recognition and Classification (NERC) - Entity Linking (EL) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Context: Knowledge Extraction Organization dbpedia:Kia_Motors Kia has hired Peter Schreyer as chief design officer. framenet:employer NLP Tasks: - Named Entity Recognition and Classification (NERC) - Entity Linking (EL) - Semantic Role Labeling (SRL) … Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Motivating Examples Mr. Washington was runner-up at Wimbledon in 1996. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Motivating Examples Mr. Washington was runner-up at Wimbledon in 1996. http://nlp.stanford.edu:8080/corenlp Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Motivating Examples Mr. Washington was runner-up at Wimbledon in 1996. http://nlp.stanford.edu:8080/corenlp http://demo.dbpedia-spotlight.org http://dbpedia.org/resource/ Washington_(state) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Motivating Examples Mr. Washington was runner-up at Wimbledon in 1996. http://nlp.stanford.edu:8080/corenlp http://demo.dbpedia-spotlight.org http://dbpedia.org/resource/ Washington_(state) The GW Bridge is a double-decked suspension bridge over the Hudson. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Motivating Examples Mr. Washington was runner-up at Wimbledon in 1996. http://nlp.stanford.edu:8080/corenlp http://demo.dbpedia-spotlight.org http://dbpedia.org/resource/ Washington_(state) The GW Bridge is a double-decked suspension bridge over the Hudson. http://demo.dbpedia-spotlight.org http://dbpedia.org/resource/ George_Washington_Bridge Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Motivating Examples Mr. Washington was runner-up at Wimbledon in 1996. http://nlp.stanford.edu:8080/corenlp http://demo.dbpedia-spotlight.org http://dbpedia.org/resource/ Washington_(state) The GW Bridge is a double-decked suspension bridge over the Hudson. http://demo.dbpedia-spotlight.org http://nlp.stanford.edu:8080/corenlp http://dbpedia.org/resource/ George_Washington_Bridge Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Abstracting … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Abstracting … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Abstracting Task 1 Task n Task 2 … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Abstracting a 1,1 a 2,1 a n,1 a 1,2 a 2,2 a n,2 … … … a 1,k a 2,i a n,j Task 1 Task n Task 2 … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Abstracting a 1,1 a 2,1 a n,1 a 1,2 a 2,2 a n,2 … … … a 1,k a 2,i a n,j Task 1 Task n Task 2 … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Abstracting a 1,1 a 2,1 a n,1 a 1,2 a 2,2 a n,2 … … … a 1,k a 2,i a n,j Task 1 Task n Task 2 … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

RESEARCH PROBLEM How can we assess and improve the coherence of the various NLP annotations on an entity mention?

In a nutshell ontological background knowledge a 1,1 a 2,1 a n,1 a 1,2 a 2,2 a n,2 … … … a 1,k a 2,i a n,j Task 1 Task n Task 2 … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

In a nutshell ontological background knowledge a 1,1 a 2,1 a n,1 a 1,2 a 2,2 a n,2 … … … a 1,k a 2,i a n,j Task 1 Task n Task 2 … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

In a nutshell ontological background knowledge a 1,1 a 2,1 a n,1 a 1,2 a 2,2 a n,2 … … … a 1,k a 2,i a n,j Task 1 Task n Task 2 … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

In a nutshell ontological background knowledge a 1,1 a 2,1 a n,1 a 1,2 a 2,2 a n,2 … … … a 1,k a 2,i a n,j Task 1 Task n Task 2 … token 1 token 2 token 3 token 4 token 5 token 6 …. Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Contributions 1. JPARK: a probabilistic model capable to estimate a posteriori the overall confidence of NLP annotations 2. A concrete instantiation of the model for NERC and EL (using YAGO as ontological knowledge) 3. Application of the NERC and EL model to revise the annotations of Stanford NER and DBpedia Spotlight Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

The Model P ( a | m , B , K ) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

The Model entity mention NLP Background Knowledge ( a i , … , a n ) NLP Annotations “The” Ontological Knowledge P ( a | m , B , K ) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

The Model entity mention NLP Background Knowledge ( a i , … , a n ) NLP Annotations “The” Ontological Knowledge P ( a | m , B , K ) set of classes from K P ( a ,C | m , B , K ) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

The Model entity mention NLP Background Knowledge ( a i , … , a n ) NLP Annotations “The” Ontological Knowledge P ( a | m , B , K ) set of classes from K P ( a ,C | m , B , K ) P ( a i | m , B ) P ( C | a i , K ) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

The Model entity mention NLP Background Knowledge ( a i , … , a n ) NLP Annotations “The” Ontological Knowledge P ( a | m , B , K ) set of classes from K P ( a ,C | m , B , K ) confidence score P ( a i | m , B ) P ( C | a i , K ) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

The Model entity mention NLP Background Knowledge ( a i , … , a n ) NLP Annotations “The” Ontological Knowledge P ( a | m , B , K ) set of classes from K P ( a ,C | m , B , K ) confidence score learned from data P ( a i | m , B ) P ( C | a i , K ) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

The Model entity mention NLP Background Knowledge ( a i , … , a n ) NLP Annotations “The” Ontological Knowledge = arg max a P ( a | m , B , K ) set of classes from K P ( a ,C | m , B , K ) confidence score learned from data P ( a i | m , B ) P ( C | a i , K ) Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

NERC and EL Model

Ingredients • Ontological Knowledge • P ( C | a NERC , K ) Estimating Estimating P ( C | a EL , K ) • Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti

Ingredients • Ontological Knowledge • P ( C | a NERC , K ) Estimating Estimating P ( C | a EL , K ) • Joint Posterior Revision of NLP Annotations via Ontological Knowledge - M. Rospocher & F. Corcoglioniti