arc hybrid non projective dependency parsing with a
play

Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic - PowerPoint PPT Presentation

Nov 17, 2022 •178 likes •1.04k views

Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle Miryam de Lhoneux , Sara Stymne and Joakim Nivre @ mdlhx 22 September 2017 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic

  1. Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle Miryam de Lhoneux , Sara Stymne and Joakim Nivre @ mdlhx 22 September 2017 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 1

  2. Outline 1 System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs 2 Experiments 3 Conclusion and Future Work Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 2

  3. Outline 1 System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs 2 Experiments 3 Conclusion and Future Work Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 3

  4. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  5. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  6. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  7. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  8. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC RIGHT−ARC Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  9. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC RIGHT−ARC Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  10. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC RIGHT−ARC Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  11. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC RIGHT−ARC SHIFT Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  12. Transition-Based Parsing with Arc-Hybrid Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC RIGHT−ARC SHIFT Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

  13. Static Oracle for Arc-Hybrid Drive your friend home **root** Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  14. Static Oracle for Arc-Hybrid Drive your friend home **root** [ ] [ Drive your friend home **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  15. Static Oracle for Arc-Hybrid SHIFT Drive your friend home **root** [ Drive ] [ your friend home **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  16. Static Oracle for Arc-Hybrid SHIFT Drive your friend home **root** [ Drive your ] [ friend home **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  17. Static Oracle for Arc-Hybrid LEFT-ARC Drive your friend home **root** [ Drive ] [ friend home **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  18. Static Oracle for Arc-Hybrid SHIFT Drive your friend home **root** [ Drive friend ] [ home **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  19. Static Oracle for Arc-Hybrid RIGHT-ARC Drive your friend home **root** [ Drive ] [ home **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  20. Static Oracle for Arc-Hybrid SHIFT Drive your friend home **root** [ Drive home ] [ **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  21. Static Oracle for Arc-Hybrid RIGHT-ARC Drive your friend home **root** [ Drive ] [ **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  22. Static Oracle for Arc-Hybrid LEFT-ARC Drive your friend home **root** [ ] [ **root** ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

  23. Outline 1 System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs 2 Experiments 3 Conclusion and Future Work Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 6

  24. Dynamic Oracle for Arc-Hybrid Drive your friend home **root** [ Drive your ] [ friend home **root** ] Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

  25. Dynamic Oracle for Arc-Hybrid RIGHT-ARC Drive your friend home **root** [ Drive your ] [ friend home **root** ] Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

  26. Dynamic Oracle for Arc-Hybrid RIGHT-ARC Drive your friend home **root** [ Drive ] [ friend home **root** ] Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

  27. Dynamic Oracle for Arc-Hybrid RIGHT-ARC Drive your friend home **root** [ Drive ] [ friend home **root** ] Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

  28. Dynamic Oracle for Arc-Hybrid SHIFT Drive your friend home **root** [ Drive your ] [ friend home **root** ] Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

  29. Dynamic Oracle for Arc-Hybrid SHIFT Drive your friend home **root** [ Drive your friend ] [ home **root** ] Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

  30. Dynamic Oracle for Arc-Hybrid SHIFT Drive your friend home **root** [ Drive your friend ] [ home **root** ] Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

  31. Outline 1 System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs 2 Experiments 3 Conclusion and Future Work Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 8

  32. Arc-Hybrid Parsing with Reordering Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC RIGHT−ARC SHIFT Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9

  33. Arc-Hybrid Parsing with Reordering Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC RIGHT−ARC SHIFT SWAP Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9

  34. Arc-Hybrid Parsing with Reordering Configuration: STACK BUFFER Drive your friend home root Transitions: LEFT−ARC RIGHT−ARC SHIFT SWAP Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9

  35. Arc-Hyrid Parsing with Reordering found best example ever 1 2 4 3 Thanks Carlos Gomez-Rodriguez for the example! Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

  36. Arc-Hyrid Parsing with Reordering found best example ever 1 2 4 3 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

  37. Arc-Hyrid Parsing with Reordering found best example ever 1 2 4 3 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

  38. Arc-Hyrid Parsing with Reordering SHIFT found best example ever 1 2 4 3 [ ] [ found 1 best 2 example 4 ever 3 ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

  39. Arc-Hyrid Parsing with Reordering SHIFT found best example ever 1 2 4 3 [ found 1 ] [ best 2 example 4 ever 3 ] Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

Recommend

Projective Dependency Parsing with Perceptron Xavier Carreras , Mihai Surdeanu, and Llus

Projective Dependency Parsing with Perceptron Xavier Carreras , Mihai Surdeanu, and Llus

Projective Dependency Parsing with Perceptron Xavier Carreras , Mihai Surdeanu, and Llus Mrquez Technical University of Catalonia {carreras,surdeanu,lluism}@lsi.upc.edu 8th June 2006 Outline Introduction Parsing and Learning Parsing

356 views • 22 slides
Dependency Parsing Lecture 2 Overview Nivre's Arc-Eager / Arc-Standard Algorithm

Dependency Parsing Lecture 2 Overview Nivre's Arc-Eager / Arc-Standard Algorithm

Dependency Parsing Lecture 2 Overview Nivre's Arc-Eager / Arc-Standard Algorithm Covington's Parsing Strategy Pseudo-projective Parsing Java ML Libraries - OpenNLP MaxEnt - Mallet - Liblinear Arc-Standard Algorithm Two

1.21k views • 92 slides
Statistical Parsing Dependency parsing ar ltekin University of Tbingen Seminar fr

Statistical Parsing Dependency parsing ar ltekin University of Tbingen Seminar fr

Statistical Parsing Dependency parsing ar ltekin University of Tbingen Seminar fr Sprachwissenschaft November 2016 Recap/background Dependency grammar Dependency parsing Evaluation Summary Ingredients of a parser

1.44k views • 89 slides
Transforming Projective Bilexical Dependency Grammars into efficiently-parsable CFGs with

Transforming Projective Bilexical Dependency Grammars into efficiently-parsable CFGs with

Transforming Projective Bilexical Dependency Grammars into efficiently-parsable CFGs with Unfold-Fold Mark Johnson Microsoft Research Brown University ACL 2007 1 / 22 Motivation and summary Whats the relationship between CKY parsing

752 views • 22 slides
Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP

Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP

Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP February 2, 2015 Roadmap Dependency parsing Graph-based dependency parsing Maximum spanning tree CLE Algorithm Learning

899 views • 87 slides
Dependency Parsing 2 CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre,

Dependency Parsing 2 CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre,

Dependency Parsing 2 CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre, Dan Jurafsky & James Martin Dependency Parsing Formalizing dependency trees Transition-based dependency parsing Shift-reduce parsing

1.02k views • 52 slides
Dependency Parsing CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre, Dan

Dependency Parsing CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre, Dan

Dependency Parsing CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre, Dan Jurafsky & James Martin Dependency Parsing Formalizing dependency trees Transition-based dependency parsing Shift-reduce parsing

676 views • 24 slides
Natural Language Processing Other Syntactic Models Parsing IV Dan Klein UC Berkeley Dependency

Natural Language Processing Other Syntactic Models Parsing IV Dan Klein UC Berkeley Dependency

Natural Language Processing Other Syntactic Models Parsing IV Dan Klein UC Berkeley Dependency Parsing Dependency Parsing Pure dependency parsing is only cubic [Eisner 99] Lexicalized parsers can be seen as producing dependency trees

314 views • 5 slides
Last class Dependency parsing and logistic regression Dependency parsing: a fully lexicalized

Last class Dependency parsing and logistic regression Dependency parsing: a fully lexicalized

Last class Dependency parsing and logistic regression Dependency parsing: a fully lexicalized formalism; tree edges connect words in the Shay Cohen sentence based on head-dependent relationships. (based on slides by Sharon Goldwater) a

359 views • 11 slides
Robust Incremental Neural Semantic Graph Parsing Jan Buys and Phil Blunsom Dependency Parsing vs

Robust Incremental Neural Semantic Graph Parsing Jan Buys and Phil Blunsom Dependency Parsing vs

Robust Incremental Neural Semantic Graph Parsing Jan Buys and Phil Blunsom Dependency Parsing vs Semantic Parsing Dependency parsing models the syntactic structure between words in a sentence. Dependency Parsing vs Semantic Parsing

637 views • 31 slides
Dependency Parsing II CMSC 470 Marine Carpuat Graph-based Dependency Parsing Slides credit:

Dependency Parsing II CMSC 470 Marine Carpuat Graph-based Dependency Parsing Slides credit:

Dependency Parsing II CMSC 470 Marine Carpuat Graph-based Dependency Parsing Slides credit: Joakim Nivre Directed Spanning Trees Dependency Parsing as Finding the Maximum Spanning Tree Views parsing as finding the best directed spanning

981 views • 61 slides
Dependency Grammars and Parsing CMSC 473/673 UMBC Outline Review: PCFGs and CKY Dependency

Dependency Grammars and Parsing CMSC 473/673 UMBC Outline Review: PCFGs and CKY Dependency

Dependency Grammars and Parsing CMSC 473/673 UMBC Outline Review: PCFGs and CKY Dependency Grammars Dependency Parsing (Shift-reduce) From syntax to semantics Probabilistic Context Free Grammar 1.0 S NP VP 1.0 PP P NP .4 NP Det

862 views • 75 slides
Algorithms for NLP CS 11-711 Fall 2020 Lecture 14: Graph-based dependency parsing Emma

Algorithms for NLP CS 11-711 Fall 2020 Lecture 14: Graph-based dependency parsing Emma

Algorithms for NLP CS 11-711 Fall 2020 Lecture 14: Graph-based dependency parsing Emma Strubell Announcements No recitation on Friday (Tartan Community Day). 2 Dependency parsing 3 Dependency parsing Input buffer Transition-based

1.15k views • 77 slides
Thoughts on Learner Data and Motivation Learner Language Dependency Parsing and Dependency

Thoughts on Learner Data and Motivation Learner Language Dependency Parsing and Dependency

Thoughts on Learner Data and Dependency Parsing Niels Ott, Ramon Ziai, Julia Krivanek, Detmar Meurers Introduction and Thoughts on Learner Data and Motivation Learner Language Dependency Parsing and Dependency Annotation Approximated

812 views • 53 slides
Marina Valeeva Outline 2 1. Introduction What is Dependency Parsing? What is a

Marina Valeeva Outline 2 1. Introduction What is Dependency Parsing? What is a

GRAPH-BASED DEPENDENCY PARSING Marina Valeeva Outline 2 1. Introduction What is Dependency Parsing? What is a Dependency Tree? Projectivity vs. Non-Projectivity 2. Graph-Based Dependency Parsing 3. Models Edge Based Factorization

572 views • 40 slides
Statistical Dependency Parsing in Korean: From Corpus Generation To Automatic Parsing Workshop on

Statistical Dependency Parsing in Korean: From Corpus Generation To Automatic Parsing Workshop on

Statistical Dependency Parsing in Korean: From Corpus Generation To Automatic Parsing Workshop on Statistical Parsing of Morphologically-Rich Languages 12th International Conference on Parsing Technologies Jinho D. Choi & Martha Palmer

199 views • 19 slides
Graph-based Dependency Parsing (Chu-Liu-Edmonds algorithm) Sam Thomson (with thanks to Swabha

Graph-based Dependency Parsing (Chu-Liu-Edmonds algorithm) Sam Thomson (with thanks to Swabha

Graph-based Dependency Parsing (Chu-Liu-Edmonds algorithm) Sam Thomson (with thanks to Swabha Swayamdipta) University of Washington, CSE 490u February 22, 2017 Outline Dependency trees Three main approaches to parsing

648 views • 54 slides
Lecture 19: Dependency Grammars and Dependency Parsing Julia Hockenmaier juliahmr@illinois.edu

Lecture 19: Dependency Grammars and Dependency Parsing Julia Hockenmaier juliahmr@illinois.edu

CS447: Natural Language Processing http://courses.engr.illinois.edu/cs447 Lecture 19: Dependency Grammars and Dependency Parsing Julia Hockenmaier juliahmr@illinois.edu 3324 Siebel Center Todays lecture Dependency Grammars Dependency

792 views • 54 slides
Non-projective Dependency-based Pre-Reordering with Recurrent Neural Network for Machine

Non-projective Dependency-based Pre-Reordering with Recurrent Neural Network for Machine

Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Non-projective Dependency-based Pre-Reordering with Recurrent Neural Network for Machine Translation Antonio Valerio Miceli Barone Giuseppe

1.57k views • 80 slides
Dependency Parsing Joakim Nivre Uppsala University Department of Linguistics and Philology

Dependency Parsing Joakim Nivre Uppsala University Department of Linguistics and Philology

Dependency Parsing Joakim Nivre Uppsala University Department of Linguistics and Philology joakim.nivre@lingfil.uu.se Dependency Parsing 1(14) 1. Dependency Trees 2. Arc-Factored Models 3. Online Learning 4. Eisners Algorithm 5.

726 views • 14 slides
Dependency Parsing CMSC 470 Marine Carpuat Dependency Grammars Syntactic structure = lexical

Dependency Parsing CMSC 470 Marine Carpuat Dependency Grammars Syntactic structure = lexical

Dependency Parsing CMSC 470 Marine Carpuat Dependency Grammars Syntactic structure = lexical items linked by binary asymmetrical relations called dependencies Example Dependency Parse Dependencies (usually) form a tree: - Connected -

593 views • 23 slides
Dependency Parsing and Feature-based Parsing Ling 571 Deep Processing Techniques for

Dependency Parsing and Feature-based Parsing Ling 571 Deep Processing Techniques for

Dependency Parsing and Feature-based Parsing Ling 571 Deep Processing Techniques for NLP October 21, 2019 Shane Steinert-Threlkeld 1 Announcements Thanks for the feedback! HW3: mean 92 Handling ungrammaticality:

1.3k views • 70 slides
Soft Cross lingual Syntax Projection for Dependency Parsing Zhenghua Li, Min Zhang, Wenliang

Soft Cross lingual Syntax Projection for Dependency Parsing Zhenghua Li, Min Zhang, Wenliang

Soft Cross lingual Syntax Projection for Dependency Parsing Zhenghua Li, Min Zhang, Wenliang Chen {zhli13, minzhang, wlchen}@suda.edu.cn Soochow University, China Dependency parsing A bilingual example pmod root obj obj det subj

437 views • 41 slides
Advanced Dependency Parsing Joakim Nivre Uppsala University Linguistics and Philology Based on

Advanced Dependency Parsing Joakim Nivre Uppsala University Linguistics and Philology Based on

Advanced Dependency Parsing Joakim Nivre Uppsala University Linguistics and Philology Based on tutorials with Ryan McDonald Advanced Dependency Parsing 1(36) Introduction Plan for the Lecture 1. Graph-based vs. transition-based dependency

1.61k views • 109 slides

More recommend