Universal Decompositional Semantic Parsing Elias Stengel-Eskin - PowerPoint PPT Presentation

Universal Decompositional Semantic Parsing Elias Stengel-Eskin Aaron Steven White Sheng Zhang Benjamin Van Durme ACL 2020

Aaron White Sheng Zhang Ben Van Durme University of Rochester JHU Microsoft Research Johns Hopkins University

Key Takeaways Subspace Attribute Val Subspace Attribute Val factuality factual 1.038 genericty pred-dynamic 1.418 protoroles awareness -0.110 genericity pred-hypothetical -0.892 protoroles change-of-loc -0.039 genericity pred-particular 1.418 protoroles change-of-poss 0.000 time dur-days -1.062 protoroles change-of-state -0.104 time dur-minutes -0.912 protoroles existed-before 1.402 time dur-seconds 1.260 … … Node Edge attribute attribute module module TOP Subspace Attribute Val to name Bush (1) leaders … asked Hiller Bush (1) SOMETHING factuality factual 1.038 genericty pred-dynamic 1.418 Subspace Attribute Val genericity pred-hypothetical -0.892 protoroles awareness -0.110 genericity Subspace Attribute Val pred-particular 1.418 protoroles change-of-loc -0.039 time dur-days -1.062 genericity arg-abstract -1.112 change-of-poss protoroles 0.000 time dur-minutes -0.912 genericity arg-kind 1.195 protoroles change-of-state -0.104 time dur-seconds 1.260 genericity arg-particular -1.112 protoroles existed-before 1.402 … word-sense noun.act -3.000 … word-sense noun.cognition -3.000 word-sense noun.food -3.000 Relation Embedder … TOP asked Hiller Bush (1) SMTH to name Bush (1) TOP asked asked asked SMTH SMTH name Encoder Encoder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan arg. edge semantic head edge predicate node argument node syntax node syntax edge instance edge nonhead edge Embedder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Hiller Bush to name the leaders of Chechnya , Taiwan , India and Pakistan asked Unique task: graph First parsing model Pipeline and end- structure + scalar for UDS to-end prediction values, jointly

Universal Decompositional Semantics (UDS) • Semantics representations (often) • Hard to annotate • Brittle to non-prototypical instances • UDS: decompose into simple questions • Scalar-valued, feature-based • Easy to annotate • Flexible

LREC 2020

Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan

Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan syntax node syntax edge

relation event participant Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan arg. edge semantic head edge predicate node argument node syntax node syntax edge

relation event participant Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan arg. edge semantic head edge predicate node argument node syntax node syntax edge instance edge nonhead edge

Subspace Attribute Val factuality factual 1.038 genericty pred-dynamic 1.418 Subspace Attribute Val genericity pred-hypothetical -0.892 protoroles awareness -0.110 Subspace Attribute Val genericity pred-particular 1.418 change-of-loc protoroles -0.039 time dur-days -1.062 genericity arg-abstract -1.112 protoroles change-of-poss 0.000 time genericity arg-kind dur-minutes -0.912 1.195 change-of-state protoroles -0.104 time dur-seconds 1.260 genericity arg-particular -1.112 protoroles existed-before 1.402 … word-sense noun.act -3.000 … word-sense noun.cognition -3.000 word-sense noun.food -3.000 … Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan arg. edge semantic head edge predicate node argument node syntax node syntax edge instance edge nonhead edge

Universal Decompositional Semantics • Factuality Cole thought that Jo had left Jo didn’t leave Jo left -3 3

Universal Decompositional Semantics • Factuality • Genericity • E.g. pred-particular I ate pizza every day I ate pizza today -3 3

Universal Decompositional Semantics • Factuality • Genericity • Time • E.g. dur-minutes Tom left Tom was singing -3 3

Universal Decompositional Semantics • Factuality • Genericity • Time Sandy led Rufus Sandy led Rufus • Wordsense by a leash by a leash • E.g. sup.person -3 3

Universal Decompositional Semantics • Factuality • Genericity • Time Derek broke his Derek broke the • Wordsense arm wishbone • Semantic proto-roles -3 3 • E.g. volition

Why UDS? Was the Hmmm, Patient? participant Or Theme? changed during • Annotation flexibility the event? • Crowdsourced 🤕 😋 • Simple questions • Rich meaning representation • Flexible inferences • Richer analysis

What’s Transductive Parsing? Subspace Attribute Val Subspace Attribute Val factuality factual 1.038 genericty pred-dynamic 1.418 protoroles awareness -0.110 genericity pred-hypothetical -0.892 protoroles change-of-loc -0.039 genericity pred-particular 1.418 protoroles change-of-poss 0.000 time change-of-state dur-days -1.062 protoroles -0.104 time dur-minutes -0.912 protoroles existed-before 1.402 time dur-seconds 1.260 … … Node Edge attribute attribute module module TOP to name leaders … Bush (1) asked Hiller Bush (1) SOMETHING Relation Embedder TOP asked Hiller Bush (1) SMTH to name Bush (1) TOP asked asked asked SMTH SMTH name Encoder Encoder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Embedder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Hiller Bush to name the leaders of Chechnya , Taiwan , India and Pakistan asked

Arborescence Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan arg. edge semantic head edge predicate node argument node syntax node syntax edge instance edge nonhead edge Assign head labels Copy re-entrant nodes Explicitly represent embedded predicates Flatten syntax graphs asked SOMETHING Hiller Bush (1) name leaders to Bush (1) the of Che. Tai. Ind. and Pak.

Linearization asked SOMETHING Hiller Bush (1) name leaders to Bush (1) the of Che. Tai. Ind. and Pak. Pre-order linearization to name Bush (1) leaders … asked Hiller Bush (1) SOMETHING

TOP asked Relation Embedder TOP Encoder Encoder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Embedder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Hiller Bush to name the leaders of Chechnya , Taiwan , India and Pakistan asked

TOP asked Hiller Relation Embedder TOP asked TOP Encoder Encoder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Embedder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan

TOP asked Hiller Relation Embedder TOP asked TOP Encoder Encoder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Embedder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Hiller Bush to name the leaders of Chechnya , Taiwan , India and Pakistan asked

TOP to name leaders … Bush (1) asked Hiller Bush (1) SOMETHING Relation Embedder TOP asked Hiller Bush (1) SMTH to name Bush (1) TOP asked asked asked SMTH SMTH name Encoder Encoder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Embedder Hiller asked Bush to name the leaders of Chechnya , Taiwan , India and Pakistan Hiller Bush to name the leaders of Chechnya , Taiwan , India and Pakistan asked