introduction to ling571
play

Introduction to Ling571 Scott Farrar CLMA, University of Washington - PowerPoint PPT Presentation

Feb 07, 2023 •574 likes •954 views

Ling571 in the CLMA Program Linguistic Structure Introduction to Ling571 Scott Farrar CLMA, University of Washington farrar@u.washington.edu January 4, 2010 Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to

  1. Ling571 in the CLMA Program Linguistic Structure Introduction to Ling571 Scott Farrar CLMA, University of Washington farrar@u.washington.edu January 4, 2010 Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  2. Ling571 in the CLMA Program Linguistic Structure Today’s lecture 1 Ling571 in the CLMA Program Shallow processing Deep processing Cross-cutting themes 2 Linguistic Structure Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  3. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Shallow processing Shallow processing means less reliance on linguistic structures, more reliance on surface (textual/signal) patterns in the data. Some tasks for shallow processing. speech recognition using hidden Markov models part-of-speech tagging using n-gram techniques information extraction based on text patterns (making minimal use of linguistic knowledge) Shallow � = easy or simple (cf. Ling570). Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  4. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Shallow processing Shallow processing means less reliance on linguistic structures, more reliance on surface (textual/signal) patterns in the data. Some tasks for shallow processing. speech recognition using hidden Markov models part-of-speech tagging using n-gram techniques information extraction based on text patterns (making minimal use of linguistic knowledge) Shallow � = easy or simple (cf. Ling570). Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  5. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Shallow processing Shallow processing means less reliance on linguistic structures, more reliance on surface (textual/signal) patterns in the data. Some tasks for shallow processing. speech recognition using hidden Markov models part-of-speech tagging using n-gram techniques information extraction based on text patterns (making minimal use of linguistic knowledge) Shallow � = easy or simple (cf. Ling570). Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  6. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Shallow processing Shallow processing means less reliance on linguistic structures, more reliance on surface (textual/signal) patterns in the data. Some tasks for shallow processing. speech recognition using hidden Markov models part-of-speech tagging using n-gram techniques information extraction based on text patterns (making minimal use of linguistic knowledge) Shallow � = easy or simple (cf. Ling570). Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  7. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Shallow processing Shallow processing means less reliance on linguistic structures, more reliance on surface (textual/signal) patterns in the data. Some tasks for shallow processing. speech recognition using hidden Markov models part-of-speech tagging using n-gram techniques information extraction based on text patterns (making minimal use of linguistic knowledge) Shallow � = easy or simple (cf. Ling570). Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  8. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Shallow processing task Morpheme identification testing, fling, going, bling, go, test Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  9. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Shallow processing task Morpheme identification testing, fling, going, bling, go, test Morphemes test, *fl, go, *bl, ing Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  10. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Shallow processing task Morpheme identification testing, fling, going, bling, go, test Morphemes test, *fl, go, *bl, ing In fact, shallow processing is often used to derive structure for further deeper processing. Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  11. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Deep processing Deep processing means utilizing elaborated linguistic structures. Some tasks for deep processing: deriving structural descriptions of natural language sentences (NL parsing) deriving meaning representations from speech (NL understanding) generating accurate NL based on meaning representations (NL generation) clustering documents based on extracted meaning Deep processing requires more linguistic knowledge than shallow processing. Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  12. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Deep processing Deep processing means utilizing elaborated linguistic structures. Some tasks for deep processing: deriving structural descriptions of natural language sentences (NL parsing) deriving meaning representations from speech (NL understanding) generating accurate NL based on meaning representations (NL generation) clustering documents based on extracted meaning Deep processing requires more linguistic knowledge than shallow processing. Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  13. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Deep processing Deep processing means utilizing elaborated linguistic structures. Some tasks for deep processing: deriving structural descriptions of natural language sentences (NL parsing) deriving meaning representations from speech (NL understanding) generating accurate NL based on meaning representations (NL generation) clustering documents based on extracted meaning Deep processing requires more linguistic knowledge than shallow processing. Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  14. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Deep processing Deep processing means utilizing elaborated linguistic structures. Some tasks for deep processing: deriving structural descriptions of natural language sentences (NL parsing) deriving meaning representations from speech (NL understanding) generating accurate NL based on meaning representations (NL generation) clustering documents based on extracted meaning Deep processing requires more linguistic knowledge than shallow processing. Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  15. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Deep processing Deep processing means utilizing elaborated linguistic structures. Some tasks for deep processing: deriving structural descriptions of natural language sentences (NL parsing) deriving meaning representations from speech (NL understanding) generating accurate NL based on meaning representations (NL generation) clustering documents based on extracted meaning Deep processing requires more linguistic knowledge than shallow processing. Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  16. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Deep processing Deep processing means utilizing elaborated linguistic structures. Some tasks for deep processing: deriving structural descriptions of natural language sentences (NL parsing) deriving meaning representations from speech (NL understanding) generating accurate NL based on meaning representations (NL generation) clustering documents based on extracted meaning Deep processing requires more linguistic knowledge than shallow processing. Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  17. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Linguistic structure Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  18. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes End-to-end system Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

  19. Shallow processing Ling571 in the CLMA Program Deep processing Linguistic Structure Cross-cutting themes Focus of Ling571 Scott Farrar CLMA, University of Washington farrar@u.washington.edu Introduction to Ling571

Recommend

Discourse Structure & Wrap-up: Q-A Ling571 Deep Processing Techniques for NLP March 9, 2016

Discourse Structure & Wrap-up: Q-A Ling571 Deep Processing Techniques for NLP March 9, 2016

Discourse Structure & Wrap-up: Q-A Ling571 Deep Processing Techniques for NLP March 9, 2016 TextTiling Segmentation Depth score: Difference between position and adjacent peaks E.g., (y a1 -y a2 )+(y a3 -y a2 ) Evaluation

783 views • 40 slides
Coreference & Coherence Ling571 Deep Processing Techniques for NLP March 9, 2015 Roadmap

Coreference & Coherence Ling571 Deep Processing Techniques for NLP March 9, 2015 Roadmap

Coreference & Coherence Ling571 Deep Processing Techniques for NLP March 9, 2015 Roadmap Coreference algorithms: Machine learning Deterministic sieves Discourse structure Cohesion Topic segmentation

1.25k views • 96 slides
Word Sense Disambiguation Ling571 Deep Processing Techniques for NLP March 3, 2014

Word Sense Disambiguation Ling571 Deep Processing Techniques for NLP March 3, 2014

Word Sense Disambiguation Ling571 Deep Processing Techniques for NLP March 3, 2014 Distributional Similarity Questions What is the right neighborhood? What is the context? How should we weight the features? How can we

744 views • 26 slides
Discourse: Reference Ling571 Deep Processing Techniques for NLP March 2, 2011 What is a

Discourse: Reference Ling571 Deep Processing Techniques for NLP March 2, 2011 What is a

Discourse: Reference Ling571 Deep Processing Techniques for NLP March 2, 2011 What is a Discourse? Discourse is: Extended span of text Spoken or Written One or more participants Language in Use Goals of

845 views • 52 slides
Lexical Semantics & WSD Ling571 Deep Processing Techniques for NLP February 15, 2017

Lexical Semantics & WSD Ling571 Deep Processing Techniques for NLP February 15, 2017

Lexical Semantics & WSD Ling571 Deep Processing Techniques for NLP February 15, 2017 Roadmap Distributional models Representation Compression Integration Dictionary-based models Thesaurus-based similarity

548 views • 41 slides
Lexical Semantics Ling571 Deep Processing Techniques for NLP February 23, 2015 What is a plant?

Lexical Semantics Ling571 Deep Processing Techniques for NLP February 23, 2015 What is a plant?

Lexical Semantics Ling571 Deep Processing Techniques for NLP February 23, 2015 What is a plant? There are more kinds of plants and animals in the rainforests than anywhere else on Earth. Over half of the millions of known species of plants and

854 views • 82 slides
Lexical Semantics & WSD Ling571 Deep Processing Techniques for NLP February 24, 2016

Lexical Semantics & WSD Ling571 Deep Processing Techniques for NLP February 24, 2016

Lexical Semantics & WSD Ling571 Deep Processing Techniques for NLP February 24, 2016 Roadmap Distributional models Compression Integration Dictionary-based models Thesaurus-based similarity models WordNet

472 views • 35 slides
Discourse: Structure Ling571 Deep Processing Techniques for NLP March 7, 2011 Roadmap

Discourse: Structure Ling571 Deep Processing Techniques for NLP March 7, 2011 Roadmap

Discourse: Structure Ling571 Deep Processing Techniques for NLP March 7, 2011 Roadmap Reference Resolution Wrap-up Discourse Structure Motivation Theoretical and applied Linear Discourse Segmentation Text

837 views • 46 slides
Question-Answering: Shallow & Deep Techniques for NLP Ling571 Deep Processing Techniques

Question-Answering: Shallow & Deep Techniques for NLP Ling571 Deep Processing Techniques

Question-Answering: Shallow & Deep Techniques for NLP Ling571 Deep Processing Techniques for NLP March 9, 2011 Examples from Dan Jurafsky) Roadmap Question-Answering: Definitions & Motivation Basic pipeline:

993 views • 84 slides
Dependency Grammars and Parsers Deep Processing for NLP Ling571 January 28, 2015 Roadmap

Dependency Grammars and Parsers Deep Processing for NLP Ling571 January 28, 2015 Roadmap

Dependency Grammars and Parsers Deep Processing for NLP Ling571 January 28, 2015 Roadmap PCFGs: Efficiencies and Reranking Dependency Grammars Definition Motivation: Limitations of Context-Free Grammars

906 views • 77 slides
Feature-Based Grammar Ling571 Deep Processing Techniques for NLP February 3, 2016 Features in

Feature-Based Grammar Ling571 Deep Processing Techniques for NLP February 3, 2016 Features in

Feature-Based Grammar Ling571 Deep Processing Techniques for NLP February 3, 2016 Features in CFGs: Agreement Goal: Support agreement of NP/VP , Det Nominal Approach: Augment CFG rules with features Employ head

208 views • 18 slides
Discourse Structure & Wrap-up: Q-A Ling571 Deep Processing Techniques for NLP March 8, 2017

Discourse Structure & Wrap-up: Q-A Ling571 Deep Processing Techniques for NLP March 8, 2017

Discourse Structure & Wrap-up: Q-A Ling571 Deep Processing Techniques for NLP March 8, 2017 Roadmap Discourse cohesion: Topic segmentation evaluation Discourse coherence: Shallow and deep discourse parsing

958 views • 46 slides
Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP

Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP

Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP February 2, 2015 Roadmap Dependency parsing Graph-based dependency parsing Maximum spanning tree CLE Algorithm Learning

899 views • 87 slides
Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP February 29, 2016

Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP February 29, 2016

Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP February 29, 2016 Roadmap Lexical Semantics Thesaurus-based Word Sense Disambiguation Taxonomy-based similarity measures Disambiguation strategies

911 views • 25 slides
Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP February 22, 2017

Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP February 22, 2017

Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP February 22, 2017 Roadmap Lexical Semantics Thesaurus-based Word Sense Disambiguation Taxonomy-based similarity measures Disambiguation strategies

1.08k views • 37 slides
Semantic Role Labeling Deep Processing Techniques for NLP Ling571 February 27, 2017 Semantic

Semantic Role Labeling Deep Processing Techniques for NLP Ling571 February 27, 2017 Semantic

Semantic Role Labeling Deep Processing Techniques for NLP Ling571 February 27, 2017 Semantic Role Labeling Aka Thematic role labeling, shallow semantic parsing Form of predicate-argument extraction Task: For each

846 views • 27 slides
Lexical Semantics Ling571 Deep Processing Techniques for NLP February 13, 2017 Roadmap

Lexical Semantics Ling571 Deep Processing Techniques for NLP February 13, 2017 Roadmap

Lexical Semantics Ling571 Deep Processing Techniques for NLP February 13, 2017 Roadmap Lexical semantics Motivation & definitions Word senses Tasks: Word sense disambiguation Word sense similarity

711 views • 19 slides
Lexical Semantics Ling571 Deep Processing Techniques for NLP February 22, 2016 Roadmap

Lexical Semantics Ling571 Deep Processing Techniques for NLP February 22, 2016 Roadmap

Lexical Semantics Ling571 Deep Processing Techniques for NLP February 22, 2016 Roadmap Lexical semantics Motivation & definitions Word senses Tasks: Word sense disambiguation Word sense similarity

1.05k views • 28 slides
Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP March 2, 2015 Roadmap

Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP March 2, 2015 Roadmap

Thesaurus-Based Similarity Ling571 Deep Processing Techniques for NLP March 2, 2015 Roadmap Lexical Semantics Thesaurus-based Word Sense Disambiguation Taxonomy-based similarity measures Disambiguation strategies

678 views • 25 slides
Semantic Roles & Semantic Role Labeling Ling571 Deep Processing Techniques for NLP February

Semantic Roles & Semantic Role Labeling Ling571 Deep Processing Techniques for NLP February

Semantic Roles & Semantic Role Labeling Ling571 Deep Processing Techniques for NLP February 17, 2016 Roadmap Semantic role labeling (SRL): Motivation: Between deep semantics and slot-filling Thematic roles

490 views • 35 slides
INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION

INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION

TRAINING COURSE ON SOCIAL PROTECTION & FORMALIZATION TRINIDAD AND TOBAGO MARCH 15, 2017 INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION Design of the NIS Assistance from the

547 views • 23 slides
INTRODUCTION Introduction 2/42 INTRODUCTION Alternations I am giving bread to the

INTRODUCTION Introduction 2/42 INTRODUCTION Alternations I am giving bread to the

Patterns of variation in the expression of case and agreement Andrs Brny Leiden University Centre for Linguistics 9 November 2019, BaSIS Workshop a.barany@hum.leidenuniv.nl INTRODUCTION Introduction 2/42 INTRODUCTION

1.37k views • 42 slides
Introduction Introduction Introduction Introduction Outline Motivation Failures

Introduction Introduction Introduction Introduction Outline Motivation Failures

Introduction Introduction Introduction Introduction Outline Motivation Failures Definition and concepts Process and product properties Principles SE Approaches Motivation Software and the economy The economies of

1.03k views • 49 slides
Introduction Introduction Introduction Nationwide Cause for Concern 1

Introduction Introduction Introduction Nationwide Cause for Concern 1

Introduction Introduction Introduction Nationwide Cause for Concern 1 https://www.cdc.gov/std/stats17/infographic.htm Introduction Epidemiology in Western Colorado CPHE Surveillance Data Report, May 2018 Chlamydia Epidemiology in Western

977 views • 39 slides

More recommend