Concept-to-text Generation via Discriminative Reranking Ioannis - PowerPoint PPT Presentation

Concept-to-text Generation via Discriminative Reranking Ioannis Konstas and Mirella Lapata School of Informatics Institute for Language, Cognition and Computation University of Edinburgh ACL 2012, Jeju Island Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 1 / 26

Introduction Introduction Concept-to-text generation refers to the task of automatically producing textual output from nonlinguistic input (Reiter and Dale, 2000) Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 2 / 26

Introduction Introduction Concept-to-text generation refers to the task of automatically producing textual output from nonlinguistic input (Reiter and Dale, 2000) Flight Day Number Month month dep/ar from to number dep/ar july departure edinburgh jeju 7 departure Condition Search arg1 arg2 type type what arrival_time 1600 query flight < Give me the flights leaving Edinburgh July seventh coming back to Jeju Island before 4pm Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 2 / 26

Introduction Traditional NLG Pipeline Communicative Goal Input Data Content Selection Surface Realisation Text Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 3 / 26

Introduction Traditional NLG Pipeline Communicative Goal Input Data Content Selection Surface Realisation Text Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 4 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Our Approach Flight Day Number Give me the flights leaving Month Edinburgh July seventh coming back from to number dep/ar month dep/ar to Jeju Island before 4pm july departure edinburgh jeju 7 departure Condition Search Please show me the flights from arg1 arg2 type type what Edinburgh on July seventh to Jeju arrival_time 1600 < query flight Island before 16:00 Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 5 / 26

Introduction Joint Discriminative Reranking with Hypergraphs Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 6 / 26

Introduction Joint Discriminative Reranking with Hypergraphs ? ? S Flight Day Number ? S from to number dep/ar ... edinburgh jeju 7 departure Give me the flights leaving ... S Training S Edinburgh July seventh Month Search coming back to Jeju Island S ... month dep/ar type what ... july departure query flight ... F 0 , 1 (query 1 ,type) S → R ( start ) f ( e ) : Φ = (Φ 1 , . . . , Φ m ) R ( r i . t ) → FS ( r j , start ) R ( r j . t ) FS 0 , 1 (query 1 ,start) Train using Perceptron R ( r i . t ) → FS ( r j , start ) F 0 , 1 (query 1 ,what) FS ( r , r . f i ) → F ( r , r . f j ) FS ( r , r . f j ) FS ( r , r . f i ) → F ( r , r . f j ) F 0 , 2 (query 1 ,type) F ( r , r . f ) → W ( r , r . f ) F ( r , r . f ) FS 0 , 2 (query 1 ,start) F ( r , r . f ) → W ( r , r . f ) F 0 , 2 (query 1 ,what) W ( r , r . f ) → α W ( r , r . f ) → g( f . v ) FS 1 , 2 (query 1 ,start)  show me ⋆ the flights [ type what ]  show me ⋆ what flights [ type what ] k-best decoding  show me ⋆ all flights [ type what ]  FS 0 , 5 (search 1 . t ,start) via reranking · · ·  show me [ type ]  show the [ type ] F 0 , 2 (search 1 . t ,type) W 4 , 5 (search 1 . t ,what)   what are [ type ] Testing · · ·  flights [ ∅ ]  [ ∅ ] W 0 , 1 (search 1 . t ,type) W 1 , 2 (search 1 . t ,type) flight  airline [ ∅ ]  [ ∅ ] [ ∅ ] · · ·  show   show  me [ ∅ ] me [ ∅ ]  what [ ∅ ]   what [ ∅ ]  · · · · · · Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 6 / 26

Introduction Joint Discriminative Reranking with Hypergraphs ? ? S Flight Day Number ? S from to number dep/ar ... edinburgh jeju 7 departure Give me the flights leaving ... S Training S Edinburgh July seventh Month Search coming back to Jeju Island S ... month dep/ar type what ... july departure query flight ... F 0 , 1 (query 1 ,type) S → R ( start ) f ( e ) : Φ = (Φ 1 , . . . , Φ m ) R ( r i . t ) → FS ( r j , start ) R ( r j . t ) FS 0 , 1 (query 1 ,start) Train using Perceptron R ( r i . t ) → FS ( r j , start ) F 0 , 1 (query 1 ,what) FS ( r , r . f i ) → F ( r , r . f j ) FS ( r , r . f j ) FS ( r , r . f i ) → F ( r , r . f j ) F 0 , 2 (query 1 ,type) F ( r , r . f ) → W ( r , r . f ) F ( r , r . f ) FS 0 , 2 (query 1 ,start) F ( r , r . f ) → W ( r , r . f ) F 0 , 2 (query 1 ,what) W ( r , r . f ) → α W ( r , r . f ) → g( f . v ) FS 1 , 2 (query 1 ,start)  show me ⋆ the flights [ type what ]  show me ⋆ what flights [ type what ] k-best decoding  show me ⋆ all flights [ type what ]  FS 0 , 5 (search 1 . t ,start) via reranking · · ·  show me [ type ]  show the [ type ] F 0 , 2 (search 1 . t ,type) W 4 , 5 (search 1 . t ,what)   what are [ type ] Testing · · ·  flights [ ∅ ]  [ ∅ ] W 0 , 1 (search 1 . t ,type) W 1 , 2 (search 1 . t ,type) flight  airline [ ∅ ]  [ ∅ ] [ ∅ ] · · ·  show   show  me [ ∅ ] me [ ∅ ]  what [ ∅ ]   what [ ∅ ]  · · · · · · Konstas, Lapata (ILCC) Concept-to-text Generation ACL 2012, Jeju Island 6 / 26