jointly predicting predicates and arguments in neural
play

Jointly Predicting Predicates and Arguments in Neural Semantic Role - PowerPoint PPT Presentation

Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Luheng He*, Kenton Lee*, Omer Levy + , Luke Zettlemoyer University of Washington *Now at Google + Now at Facebook AI Research 1 Semantic Role Labeling (SRL) Find


  1. Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Luheng He*, Kenton Lee*, Omer Levy + , Luke Zettlemoyer University of Washington *Now at Google + Now at Facebook AI Research 1

  2. Semantic Role Labeling (SRL) • Find out “ who did what to whom ” in text • Capture predicate-argument structures ARG0 eater ARG1 meal I ate pizza with friends AM-COM comitative 2

  3. Semantic Role Labeling (SRL) • Find out “ who did what to whom ” in text • Capture predicate-argument structures ARG0 eater ARG1 meal I ate pizza with friends AM-COM comitative ARG0 eater ARG1 meal I ate pizza with friends 2

  4. SRL as BIO Tagging Output1 ARG0 V ARG1 AM-PRP B-AM- I-AM- I-AM- I-AM- I-AM- I-AM- B-A0 I-A0 B-V B-A1 PRP PRP PRP PRP PRP PRP Many tourists visit Disney to meet their favorite cartoon characters Input1 Needs target predicate as input! (Prior works typically used gold predicates) Collobert et al., 2011, Zhou and Xu, 2015, He et. al, 2017, inter alia 3

  5. SRL as BIO Tagging Output1 ARG0 V ARG1 AM-PRP B-AM- I-AM- I-AM- I-AM- I-AM- I-AM- B-A0 I-A0 B-V B-A1 PRP PRP PRP PRP PRP PRP Many tourists visit Disney to meet their favorite cartoon characters Input1 Output2 ARG0 V ARG1 Needs to re-run the tagger for each predicate B-A0 I-A0 O O B-V B-A1 I-A1 I-A1 I-A1 O Many tourists visit Disney to meet their favorite cartoon characters Input2 4

  6. SRL as Predicting Word-Span Relations AM-PRP ARG0 ARG1 Many tourists visit Disney to meet their favorite cartoon characters ARG1 ARG0 � 5

  7. SRL as Predicting Word-Span Relations AM-PRP ARG0 ARG1 Many tourists visit Disney to meet their favorite cartoon characters ARG1 ARG0 Advantages: * Jointly predict predicates * Span-level features 
 (similar to Punyakanok08, FitzGerald15, inter alia) 
 Challenge: * Too many possible edges (n 2 argument spans x n predicates) � 5

  8. Our Model 6

  9. Our Model: Overview Highway BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters No predicate input! 7

  10. Our Model: Overview tourists visit Disney their favorite cartoon Many tourists Disney to meet their cartoon characters Span Representation (1) Construct span representations Highway for all n 2 spans! BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters 8

  11. Our Model: Overview (2) Local classifier over labels (including NULL) Labeling for all possible (predicate, argument) pairs Softmax … Node & Edge Scores Span Representation (1) Construct span representations Highway for all n 2 spans! BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters 9

  12. Our Model: Overview (2) Local classifier over labels (including NULL) Labeling for all possible (predicate, argument) pairs Softmax … Node & Edge (3) Greedy beam Scores pruning for spans Span Representation (1) Construct span representations Highway for all n 2 spans! BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters 10

  13. (2) Local Label (3) Span (1) Span Representations Classifiers Pruning their favorite cartoon Span Representation Highway BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters (Same as Lee et al., 2017) 11

  14. (2) Local Label (3) Span (1) Span Representations Classifiers Pruning [ BiLstm ( w 1 : w n ) Start , BiLstm ( w 1 : w n ) End ] LSTM boundary points their favorite cartoon Span Representation left context right context Highway BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters (Same as Lee et al., 2017) 11

  15. (2) Local Label (3) Span (1) Span Representations Classifiers Pruning [ BiLstm ( w 1 : w n ) Start , BiLstm ( w 1 : w n ) End ] LSTM boundary points X End i = Start SoftMax ( a Start : a End ) i w i Attention over words their favorite cartoon Span Representation Highway BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters (Same as Lee et al., 2017) 12

  16. <latexit sha1_base64="nvU6K7Xlec9J/cWdW16/i7BwDY=">ACHicbVDLSsNAFL2pr1pfVZdugkVwVRIRdFlw02UL9gFtKJPJTt0Mgkzk2IJ/QHd6n+4E7f+hb/hFzhts7CtBwYO59zLPXP8hDOlHefbKmxt7+zuFfdLB4dHxyfl07O2ilNJsUVjHsuTxRyJrClmebYTSyOfY8cPc78zQalYLB71NEvIkPBQkaJNlJTDMoVp+osYG8SNycVyNEYlH/6QUzTCIWmnCjVc51EexmRmlGOs1I/VZgQOiZD7BkqSITKyxZBZ/aVUQI7jKV5QtsL9e9GRiKlpFvJiOiR2rdm4v/eb1gwhKV3paHltNosN7L2MiSTUKugwSptzWsT1vxQ6YRKr51BCJTN/semISEK16a5kSnLXK9k7Zuq61Td5m2lVs/rKsIFXMI1uHAHNahDA1pAeEFXuHNerberQ/rczlasPKdc1iB9fULDneauA=</latexit> <latexit sha1_base64="nvU6K7Xlec9J/cWdW16/i7BwDY=">ACHicbVDLSsNAFL2pr1pfVZdugkVwVRIRdFlw02UL9gFtKJPJTt0Mgkzk2IJ/QHd6n+4E7f+hb/hFzhts7CtBwYO59zLPXP8hDOlHefbKmxt7+zuFfdLB4dHxyfl07O2ilNJsUVjHsuTxRyJrClmebYTSyOfY8cPc78zQalYLB71NEvIkPBQkaJNlJTDMoVp+osYG8SNycVyNEYlH/6QUzTCIWmnCjVc51EexmRmlGOs1I/VZgQOiZD7BkqSITKyxZBZ/aVUQI7jKV5QtsL9e9GRiKlpFvJiOiR2rdm4v/eb1gwhKV3paHltNosN7L2MiSTUKugwSptzWsT1vxQ6YRKr51BCJTN/semISEK16a5kSnLXK9k7Zuq61Td5m2lVs/rKsIFXMI1uHAHNahDA1pAeEFXuHNerberQ/rczlasPKdc1iB9fULDneauA=</latexit> <latexit sha1_base64="nvU6K7Xlec9J/cWdW16/i7BwDY=">ACHicbVDLSsNAFL2pr1pfVZdugkVwVRIRdFlw02UL9gFtKJPJTt0Mgkzk2IJ/QHd6n+4E7f+hb/hFzhts7CtBwYO59zLPXP8hDOlHefbKmxt7+zuFfdLB4dHxyfl07O2ilNJsUVjHsuTxRyJrClmebYTSyOfY8cPc78zQalYLB71NEvIkPBQkaJNlJTDMoVp+osYG8SNycVyNEYlH/6QUzTCIWmnCjVc51EexmRmlGOs1I/VZgQOiZD7BkqSITKyxZBZ/aVUQI7jKV5QtsL9e9GRiKlpFvJiOiR2rdm4v/eb1gwhKV3paHltNosN7L2MiSTUKugwSptzWsT1vxQ6YRKr51BCJTN/semISEK16a5kSnLXK9k7Zuq61Td5m2lVs/rKsIFXMI1uHAHNahDA1pAeEFXuHNerberQ/rczlasPKdc1iB9fULDneauA=</latexit> <latexit sha1_base64="nvU6K7Xlec9J/cWdW16/i7BwDY=">ACHicbVDLSsNAFL2pr1pfVZdugkVwVRIRdFlw02UL9gFtKJPJTt0Mgkzk2IJ/QHd6n+4E7f+hb/hFzhts7CtBwYO59zLPXP8hDOlHefbKmxt7+zuFfdLB4dHxyfl07O2ilNJsUVjHsuTxRyJrClmebYTSyOfY8cPc78zQalYLB71NEvIkPBQkaJNlJTDMoVp+osYG8SNycVyNEYlH/6QUzTCIWmnCjVc51EexmRmlGOs1I/VZgQOiZD7BkqSITKyxZBZ/aVUQI7jKV5QtsL9e9GRiKlpFvJiOiR2rdm4v/eb1gwhKV3paHltNosN7L2MiSTUKugwSptzWsT1vxQ6YRKr51BCJTN/semISEK16a5kSnLXK9k7Zuq61Td5m2lVs/rKsIFXMI1uHAHNahDA1pAeEFXuHNerberQ/rczlasPKdc1iB9fULDneauA=</latexit> <latexit sha1_base64="Cl3SwRPAtZyFQe08H+ihuTViBc=">ACnicbVDLSsNAFL2pr1pfVZduBovgqiRF0GXBTZcV7QPaWCaTSTt0Mgkzk2IJ/QPd6n+4E7f+hL/hFzhNs7CtBwYO59zLPXO8mDOlbfvbKmxsbm3vFHdLe/sHh0fl45O2ihJaItEPJdDyvKmaAtzTSn3VhSHqcdrzx7dzvTKhULBIPehpTN8RDwQJGsDbSvXisDcoVu2pnQOvEyUkFcjQH5Z+H5EkpEITjpXqOXas3RLzQins1I/UTGZIyHtGeowCFVbpFnaELo/goiKR5QqNM/buR4lCpaeiZyRDrkVr15uJ/Xs+fsFjlt54Wx5aT6ODGTZmIE0FWQJEo50hOa9IJ9JSjSfGoKJZOYviIywxESb9kqmJGe1knXSrlUdu+rcXVXqjbyuIpzBOVyCA9dQhwY0oQUEhvACr/BmPVv1of1uRgtWPnOKSzB+voFRgqbXA=</latexit> <latexit sha1_base64="Cl3SwRPAtZyFQe08H+ihuTViBc=">ACnicbVDLSsNAFL2pr1pfVZduBovgqiRF0GXBTZcV7QPaWCaTSTt0Mgkzk2IJ/QPd6n+4E7f+hL/hFzhNs7CtBwYO59zLPXO8mDOlbfvbKmxsbm3vFHdLe/sHh0fl45O2ihJaItEPJdDyvKmaAtzTSn3VhSHqcdrzx7dzvTKhULBIPehpTN8RDwQJGsDbSvXisDcoVu2pnQOvEyUkFcjQH5Z+H5EkpEITjpXqOXas3RLzQins1I/UTGZIyHtGeowCFVbpFnaELo/goiKR5QqNM/buR4lCpaeiZyRDrkVr15uJ/Xs+fsFjlt54Wx5aT6ODGTZmIE0FWQJEo50hOa9IJ9JSjSfGoKJZOYviIywxESb9kqmJGe1knXSrlUdu+rcXVXqjbyuIpzBOVyCA9dQhwY0oQUEhvACr/BmPVv1of1uRgtWPnOKSzB+voFRgqbXA=</latexit> <latexit sha1_base64="Cl3SwRPAtZyFQe08H+ihuTViBc=">ACnicbVDLSsNAFL2pr1pfVZduBovgqiRF0GXBTZcV7QPaWCaTSTt0Mgkzk2IJ/QPd6n+4E7f+hL/hFzhNs7CtBwYO59zLPXO8mDOlbfvbKmxsbm3vFHdLe/sHh0fl45O2ihJaItEPJdDyvKmaAtzTSn3VhSHqcdrzx7dzvTKhULBIPehpTN8RDwQJGsDbSvXisDcoVu2pnQOvEyUkFcjQH5Z+H5EkpEITjpXqOXas3RLzQins1I/UTGZIyHtGeowCFVbpFnaELo/goiKR5QqNM/buR4lCpaeiZyRDrkVr15uJ/Xs+fsFjlt54Wx5aT6ODGTZmIE0FWQJEo50hOa9IJ9JSjSfGoKJZOYviIywxESb9kqmJGe1knXSrlUdu+rcXVXqjbyuIpzBOVyCA9dQhwY0oQUEhvACr/BmPVv1of1uRgtWPnOKSzB+voFRgqbXA=</latexit> <latexit sha1_base64="Cl3SwRPAtZyFQe08H+ihuTViBc=">ACnicbVDLSsNAFL2pr1pfVZduBovgqiRF0GXBTZcV7QPaWCaTSTt0Mgkzk2IJ/QPd6n+4E7f+hL/hFzhNs7CtBwYO59zLPXO8mDOlbfvbKmxsbm3vFHdLe/sHh0fl45O2ihJaItEPJdDyvKmaAtzTSn3VhSHqcdrzx7dzvTKhULBIPehpTN8RDwQJGsDbSvXisDcoVu2pnQOvEyUkFcjQH5Z+H5EkpEITjpXqOXas3RLzQins1I/UTGZIyHtGeowCFVbpFnaELo/goiKR5QqNM/buR4lCpaeiZyRDrkVr15uJ/Xs+fsFjlt54Wx5aT6ODGTZmIE0FWQJEo50hOa9IJ9JSjSfGoKJZOYviIywxESb9kqmJGe1knXSrlUdu+rcXVXqjbyuIpzBOVyCA9dQhwY0oQUEhvACr/BmPVv1of1uRgtWPnOKSzB+voFRgqbXA=</latexit> (1) Span (3) Span (2) Local Label Classifiers Representations Pruning ARG0 Labeling ARG1 Softmax ARG2 … Node & Edge AM-TMP n 2 Scores … n 𝜗 (No Edge) Span argument predicate Representation Highway BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters 13

  17. (1) Span (3) Span (2) Local Label Classifiers Representations Pruning ARG0 Labeling ARG1 Softmax ARG2 … Node & Edge AM-TMP Scores … 𝜗 (No Edge) Span many tourists meet Representation Highway BiLSTMs Word & Char Embeddings Input sentence Many tourists visit Disney to meet their favorite cartoon characters 14

Recommend


More recommend