Stack-Pointer Networks for Dependency Parsing Xuezhe Ma 1 , Zecong - PowerPoint PPT Presentation

Dec 01, 2022 •217 likes •562 views

Stack-Pointer Networks for Dependency Parsing Xuezhe Ma 1 , Zecong Hu 2 , Jingzhou Liu 1 , Nanyun Peng 3 , Graham Neubig 1 and Eduard Hovy 1 1 Carnegie Mellon University 2 Tsinghua University 3 University of Southern California

Stack-Pointer Networks   for Dependency Parsing Xuezhe Ma 1 , Zecong Hu 2 , Jingzhou Liu 1 , Nanyun Peng 3 , Graham Neubig 1 and Eduard Hovy 1 1 Carnegie Mellon University 2 Tsinghua University 3 University of Southern California https://github.com/XuezheMax/NeuroNLP2
Dependency Parsing $ But there were no buyers $ But there were no buyers � 2
      Transition-based Parsing • Process the input sequentially in order   • Use actions that build up a tree   • Choose which actions to apply with a classifier � 3
                Example: Arc-standard Parsing [Yamada+ 2003, Nivre 2004] • Order: Left-to-right • Actions: Shift, reduce-right, reduce-left   shift right ROOT I saw a girl ROOT I saw a girl ∅ left ROOT I saw a girl • Classifier: • Support vector machines [Nivre+ 2004] • Feed-forward neural networks [Chen+ 2014] • Recurrent neural networks [Dyer+ 2015] � 4
Our Proposal: Stack-pointer Networks (StackPtr) 2 2 3 3 4 $ But there were no buyers 0 0 0 0 0 there but were were were were $ $ $ $ $ • Order: Top-down, depth-first • Actions: "Point" to the next word to choose as a child • Model: A neural network, based on "pointer networks" • Advantages: • Top-down parsing maintains a global view of the sentence • High accuracy • Can maintain full history, low asymptotic running time (c.f. graph-based) � 5

Recommend

Statistical Parsing Dependency parsing ar ltekin University of Tbingen Seminar fr

Statistical Parsing Dependency parsing ar ltekin University of Tbingen Seminar fr Sprachwissenschaft November 2016 Recap/background Dependency grammar Dependency parsing Evaluation Summary Ingredients of a parser

1.44k views • 89 slides

A Fast and Accurate Dependency Parser using Neural Networks Danqi Chen & Christopher D.

A Fast and Accurate Dependency Parser using Neural Networks Danqi Chen & Christopher D. Manning Qiming Chen qc2195 Apr. 8. 2015 Dependency Parsing Parsing: He has good control . Dependency Parsing Parsing: He has good control .

743 views • 35 slides

Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP

Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP February 2, 2015 Roadmap Dependency parsing Graph-based dependency parsing Maximum spanning tree CLE Algorithm Learning

899 views • 87 slides

Dependency Parsing CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre, Dan

Dependency Parsing CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre, Dan Jurafsky & James Martin Dependency Parsing Formalizing dependency trees Transition-based dependency parsing Shift-reduce parsing

676 views • 24 slides

Dependency Parsing 2 CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre,

Dependency Parsing 2 CMSC 723 / LING 723 / INST 725 Marine Carpuat Fig credits: Joakim Nivre, Dan Jurafsky & James Martin Dependency Parsing Formalizing dependency trees Transition-based dependency parsing Shift-reduce parsing

1.02k views • 52 slides

Natural Language Processing Other Syntactic Models Parsing IV Dan Klein UC Berkeley Dependency

Natural Language Processing Other Syntactic Models Parsing IV Dan Klein UC Berkeley Dependency Parsing Dependency Parsing Pure dependency parsing is only cubic [Eisner 99] Lexicalized parsers can be seen as producing dependency trees

314 views • 5 slides

Word Embeddings in Feedforward Networks; Tagging and Dependency Parsing using Feedforward

Word Embeddings in Feedforward Networks; Tagging and Dependency Parsing using Feedforward Networks Michael Collins, Columbia University Overview Introduction Multi-layer feedforward networks Representing words as vectors (word

878 views • 38 slides

Last class Dependency parsing and logistic regression Dependency parsing: a fully lexicalized

Last class Dependency parsing and logistic regression Dependency parsing: a fully lexicalized formalism; tree edges connect words in the Shay Cohen sentence based on head-dependent relationships. (based on slides by Sharon Goldwater) a

359 views • 11 slides

Transition-Based Dependency Parsing with Stack Long Short-Term Memory Chris Dyer, Miguel

Transition-Based Dependency Parsing with Stack Long Short-Term Memory Chris Dyer, Miguel Ballesteros, Wang Ling, Austin Matthews, Noah A. Smith Association for Computational Linguistics (ACL), 2015 Presented By: Lavisha Aggarwal (lavisha2)

253 views • 23 slides

Robust Incremental Neural Semantic Graph Parsing Jan Buys and Phil Blunsom Dependency Parsing vs

Robust Incremental Neural Semantic Graph Parsing Jan Buys and Phil Blunsom Dependency Parsing vs Semantic Parsing Dependency parsing models the syntactic structure between words in a sentence. Dependency Parsing vs Semantic Parsing

637 views • 31 slides

Dependency Parsing II CMSC 470 Marine Carpuat Graph-based Dependency Parsing Slides credit:

Dependency Parsing II CMSC 470 Marine Carpuat Graph-based Dependency Parsing Slides credit: Joakim Nivre Directed Spanning Trees Dependency Parsing as Finding the Maximum Spanning Tree Views parsing as finding the best directed spanning

981 views • 61 slides

Natural Language Understanding Lecture 9: Dependency Parsing with Neural Networks Frank Keller

Introduction Transition-based Parsing with Neural Nets Results and Analysis Natural Language Understanding Lecture 9: Dependency Parsing with Neural Networks Frank Keller School of Informatics University of Edinburgh keller@inf.ed.ac.uk

356 views • 23 slides

Dependency Grammars and Parsing CMSC 473/673 UMBC Outline Review: PCFGs and CKY Dependency

Dependency Grammars and Parsing CMSC 473/673 UMBC Outline Review: PCFGs and CKY Dependency Grammars Dependency Parsing (Shift-reduce) From syntax to semantics Probabilistic Context Free Grammar 1.0 S NP VP 1.0 PP P NP .4 NP Det

862 views • 75 slides

Algorithms for NLP CS 11-711 Fall 2020 Lecture 14: Graph-based dependency parsing Emma

Algorithms for NLP CS 11-711 Fall 2020 Lecture 14: Graph-based dependency parsing Emma Strubell Announcements No recitation on Friday (Tartan Community Day). 2 Dependency parsing 3 Dependency parsing Input buffer Transition-based

1.15k views • 77 slides

Thoughts on Learner Data and Motivation Learner Language Dependency Parsing and Dependency

Thoughts on Learner Data and Dependency Parsing Niels Ott, Ramon Ziai, Julia Krivanek, Detmar Meurers Introduction and Thoughts on Learner Data and Motivation Learner Language Dependency Parsing and Dependency Annotation Approximated

812 views • 53 slides

Marina Valeeva Outline 2 1. Introduction What is Dependency Parsing? What is a

GRAPH-BASED DEPENDENCY PARSING Marina Valeeva Outline 2 1. Introduction What is Dependency Parsing? What is a Dependency Tree? Projectivity vs. Non-Projectivity 2. Graph-Based Dependency Parsing 3. Models Edge Based Factorization

572 views • 40 slides

Statistical Dependency Parsing in Korean: From Corpus Generation To Automatic Parsing Workshop on

Statistical Dependency Parsing in Korean: From Corpus Generation To Automatic Parsing Workshop on Statistical Parsing of Morphologically-Rich Languages 12th International Conference on Parsing Technologies Jinho D. Choi & Martha Palmer

199 views • 19 slides

Dependency Parsing II CMSC 470 Marine Carpuat Arc Standard Transition System defines 3

Dependency Parsing II CMSC 470 Marine Carpuat Arc Standard Transition System defines 3 transition operators [Covington, 2001; Nivre 2003] SHIFT Remove word at head of input buffer Push it on the stack LEFT-ARC create head-dependent

605 views • 36 slides

Graph-based Dependency Parsing (Chu-Liu-Edmonds algorithm) Sam Thomson (with thanks to Swabha

Graph-based Dependency Parsing (Chu-Liu-Edmonds algorithm) Sam Thomson (with thanks to Swabha Swayamdipta) University of Washington, CSE 490u February 22, 2017 Outline Dependency trees Three main approaches to parsing

648 views • 54 slides

Lecture 19: Dependency Grammars and Dependency Parsing Julia Hockenmaier juliahmr@illinois.edu

CS447: Natural Language Processing http://courses.engr.illinois.edu/cs447 Lecture 19: Dependency Grammars and Dependency Parsing Julia Hockenmaier juliahmr@illinois.edu 3324 Siebel Center Todays lecture Dependency Grammars Dependency

792 views • 54 slides

Dependency Parsing Joakim Nivre Uppsala University Department of Linguistics and Philology

Dependency Parsing Joakim Nivre Uppsala University Department of Linguistics and Philology joakim.nivre@lingfil.uu.se Dependency Parsing 1(14) 1. Dependency Trees 2. Arc-Factored Models 3. Online Learning 4. Eisners Algorithm 5.

726 views • 14 slides

Dependency Parsing CMSC 470 Marine Carpuat Dependency Grammars Syntactic structure = lexical

Dependency Parsing CMSC 470 Marine Carpuat Dependency Grammars Syntactic structure = lexical items linked by binary asymmetrical relations called dependencies Example Dependency Parse Dependencies (usually) form a tree: - Connected -

593 views • 23 slides

Dependency Parsing and Feature-based Parsing Ling 571 Deep Processing Techniques for

Dependency Parsing and Feature-based Parsing Ling 571 Deep Processing Techniques for NLP October 21, 2019 Shane Steinert-Threlkeld 1 Announcements Thanks for the feedback! HW3: mean 92 Handling ungrammaticality:

1.3k views • 70 slides

Soft Cross lingual Syntax Projection for Dependency Parsing Zhenghua Li, Min Zhang, Wenliang

Soft Cross lingual Syntax Projection for Dependency Parsing Zhenghua Li, Min Zhang, Wenliang Chen {zhli13, minzhang, wlchen}@suda.edu.cn Soochow University, China Dependency parsing A bilingual example pmod root obj obj det subj

437 views • 41 slides