Broad-coverage CCG Semantic Parsing with AMR Yoav Artzi Kenton Lee - PowerPoint PPT Presentation

Combinatory Abstract Categorial Meaning Grammar Representation Broad-coverage CCG Semantic Parsing with AMR Yoav Artzi Kenton Lee Luke Zettlemoyer Cornell University University of Washington Cornell Tech

Semantic Parsing Show me all papers about semantic parsing Grammar λ x. paper( x ) ∧ topic( x, SEMANTIC PARSING) Less More Domains Situated Parsing Supervision Answers Databases Spatial Observations Demonstrations Large Knowledge-bases Linguistic Context Conversations Instructions Database Content Web Tables Time

Semantic Parsing Show me all papers about semantic parsing Grammar λ x. paper( x ) ∧ topic( x, SEMANTIC PARSING) Less Non-compositional Supervision Semantics More Domains Situated Parsing Broad-coverage Grammar Induction

Abstract Meaning Representation Pyongyang officials denied their involvement ARG1 instance instance involve-01 ARG1 ARG0 deny-01 instance ARG0-of person ARG1 instance name ARG2 instance have-org-role-91 instance instance city op1 official name “Pyongyang”

AMR: Instances Pyongyang officials denied their involvement ARG1 instance instance involve-01 ARG1 ARG0 deny-01 instance ARG0-of person ARG1 instance name ARG2 instance have-org-role-91 instance instance city op1 official name “Pyongyang”

AMR: Instances Pyongyang officials denied their involvement ARG1 instance instance involve-01 ARG1 ARG0 deny-01 instance ARG0-of person ARG1 instance name ARG2 instance have-org-role-91 instance instance city op1 official name “Pyongyang”

AMR: Relations Pyongyang officials denied their involvement ARG1 instance instance involve-01 ARG1 ARG0 deny-01 instance ARG0-of person ARG1 instance name ARG2 instance have-org-role-91 instance instance city op1 official name “Pyongyang”

AMR: Relations Pyongyang officials denied their involvement ARG1 instance instance involve-01 ARG1 ARG0 deny-01 instance ARG0-of person ARG1 instance name ARG2 instance have-org-role-91 instance instance city op1 official name “Pyongyang”

AMR: Relations Pyongyang officials denied their involvement ARG1 instance instance involve-01 ARG1 ARG0 deny-01 instance ARG0-of person ARG1 instance name ARG2 instance have-org-role-91 instance instance city op1 official name “Pyongyang”

AMR and Combinatory Categorial Grammar Great opportunity study CCG semantic parsing at scale Challenges: • Distant non-compositional dependencies • Longer sentences • Higher syntactic variability

Parsing Approach • Use CCG to recover compositional parse structure • Second stage to resolve non-compositional phenomena, such as co-reference resolution

Combinatory Categorial Grammar S \ NP/NP : λ x. λ y. λ d. deny-01( d ) ∧ ARG0( d, y ) ∧ ARG1( d, x ) Category Syntax Semantics Assign category S \ NP/NP : λ x. λ y. λ d. deny-01( d ) ∧ denied Lexicon to words ARG0( d, y ) ∧ ARG1( d, x ) Unary and binary operators Combinators to combine categories

CCG Entries from Lexicon CCG is fun NP S \ NP/ADJ ADJ CCG λ f. λ x.f ( x ) λ x. fun( x ) > S \ NP λ x. fun( x ) < S fun(CCG) Parse Steps Logical Form Lexicon Combinators Learned

AMR to Lambda Calculus Pyongyang officials denied their involvement ARG1 instance instance involve-01 ARG1 ARG0 deny-01 instance ARG0-of person ARG1 instance name ARG2 instance have-org-role-91 instance instance city op1 official name “Pyongyang”

AMR to Lambda Calculus Pyongyang officials denied their involvement A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ ARG1 instance instance involve-01 ARG1 ARG0 deny-01 ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ instance ARG0-of person ARG1 instance name ARG2 have-org-role-91 instance ARG1( h, A 4 ( λ c. city( c ) ∧ instance instance city op1 official name “Pyongyang” name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2)))))) AMR Lambda Calculus Deterministic Conversion

AMR Lambda Calculus: Instances Pyongyang officials denied their involvement A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ ARG1( h, A 4 ( λ c. city( c ) ∧ name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2))))))

AMR Lambda Calculus: Relations Pyongyang officials denied their involvement A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ ARG1( h, A 4 ( λ c. city( c ) ∧ name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2))))))

AMR Lambda Calculus: Instances Pyongyang officials denied their involvement A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ d, A 2 ( ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ ARG1( h, A 4 ( λ c. city( c ) ∧ name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2)))))) Skolem ID Instance Quantifier

AMR Lambda Calculus: References Reference Predicate Pyongyang officials denied their involvement i, R (2)) A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ d, A 2 ( ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ ARG1( h, A 4 ( λ c. city( c ) ∧ name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2)))))) Skolem ID Instance Quantifier

Model Pyongyang officials denied their involvement CCG? A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ ARG1( h, A 4 ( λ c. city( c ) ∧ name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2))))))

Model Pyongyang officials denied their involvement CCG Parse A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ REL-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ Underspecified ARG1( h, A 4 ( λ c. city( c ) ∧ Logical Form name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ REL( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (ID)))))) Constant Mapping A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ ARG1( h, A 4 ( λ c. city( c ) ∧ name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2))))))

Model Pyongyang officials denied their involvement A Passive relation REL-of( placeholder A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ REL-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ Underspecified ARG1( h, A 4 ( λ c. city( c ) ∧ Logical Form name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ REL( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (ID)))))) Reference 1( i, R (ID)))))) placeholder A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ Active relation ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ REL( ARG1( h, A 4 ( λ c. city( c ) ∧ placeholder name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2))))))

Model A Pyongyang officials denied their involvement A ARG0-of( REL-of( A A 1 ( λ d. deny-01( d ) ∧ cause-of( ARG0( d, A 2 ( λ p. person( p ) ∧ REL-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ Underspecified ARG1( h, A 4 ( λ c. city( c ) ∧ Logical Form name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ REL( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG2( ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (ID)))))) unit( A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ REL( frequency( ARG1( h, A 4 ( λ c. city( c ) ∧ name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2))))))

Model A Pyongyang officials denied their involvement A ARG0-of( REL-of( A A 1 ( λ d. deny-01( d ) ∧ cause-of( ARG0( d, A 2 ( λ p. person( p ) ∧ REL-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ Underspecified ARG1( h, A 4 ( λ c. city( c ) ∧ Logical Form name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ REL( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG2( ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (ID)))))) unit( A 1 ( λ d. deny-01( d ) ∧ ARG0( d, A 2 ( λ p. person( p ) ∧ ARG0-of( p, A 3 ( λ h. have-org-role-91( h ) ∧ REL( frequency( ARG1( h, A 4 ( λ c. city( c ) ∧ name( c, A 5 ( λ n. name( n ) ∧ op1( n, PYONGYANG))))) ∧ ARG2( h, A 6 ( λ o. o ffi cial( o )))))) ∧ ARG1( d, A 7 ( λ i. involve-01( i ) ∧ ARG1( i, R (2))))))