Answering Complex Questions by Joining Multi-Document Evidence with Quasi Knowledge Graphs Xiaolu Lu 1 , Soumajit Pramanik 2 , Rishiraj Saha Roy 2 , Abdalghani Abujabal 3 , Yafang Wang 4 and Gerhard Weikum 2 1 RMIT University, 2 Max Planck Institute for Informatics , 3 Amazon Alexa, 4 Ant Financial SIGIR 2019, Paris
Question Answering: Vital for Search ★ Direct answers to questions ★ Saves time and effort ★ Natural in voice UI ★ Fact-centric, entity-seeking ★ Relies on knowledge graphs 2
Question Answering: Vital for Search ★ Direct answers to questions ★ Saves time and effort ★ Natural in voice UI ★ Fact-centric, entity-seeking ★ Relies on knowledge graphs 3
Question Answering: Vital for Search ★ Direct answers to questions ★ Saves time and effort ★ Natural in voice UI ★ Fact-centric, entity-seeking ★ Relies on knowledge graphs 4
Question Answering: Vital for Search ★ Direct answers to questions ★ Saves time and effort ★ Natural in voice UI ★ Fact-centric, entity-seeking ★ Relies on knowledge graphs 5
Question Answering: Vital for Search ★ Direct answers to questions ★ Saves time and effort ★ Natural in voice UI ★ Fact-centric, entity-seeking ★ Relies on knowledge graphs 6
Question Answering: Vital for Search ★ Direct answers to questions ★ Saves time and effort ★ Natural in voice UI ★ Fact-centric, entity-seeking ★ Relies on knowledge graphs 7
Direct Answers Today ★ Works for simple questions ★ Misses additional conditions ★ Depends upon KG completeness 8
What’s new? ★ Entity answers to complex questions directly from text ★ Unsupervised method using Group Steiner Trees ★ Handles ungrammatical constructs ★ Robust to high degrees of noise ★ Provides explanatory evidence 9
Approach Outline Graph construction 1. Construct noisy quasi-KG on-the-fly 2. Augment with alignments and types 3. Spot question cornerstones 4. Compute Group Steiner Tree Graph algorithm 5. Rank answer candidates QUEST: Question Answering with Steiner Trees 10
Multi-document Evidence Question: Which Nolan films won an Oscar but missed a Golden Globe? The 2011 Oscar award just announced that Inception is the winner of the Best Sound Editing award. Other winners of the day... Nolan directed the movie Inception and other science thrillers ... Inception narrowly lost to The Social Network for Best Screenplay at the 68th Golden Globe Awards, which were declared in the afternoon.. This illustrates “joining evidence” 11
Semi-structuring Text with Open IE <Nolan, directed, Inception> <Inception, won, Best Sound> <2011 Oscars, announced, Best Sound> <Inception, nominated, Best Actor> <The movie Inception, missed out, Golden Globe Awards> <Chris Nolan, director of, The movie Inception> <Inception’s script, edited by, Chris Nolan> <Inception, lost to, The Social Network> <Best Actor, declared at, 83rd Academy Awards> <The Social Network, winner of, Best Screenplay> <Golden Globes, announced, Best Screenplay> 12
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan won Golden Globe Awards directed announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network Best Actor winner of 13
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan won Golden Globe Awards directed announced director of Form noisy quasi-KG that joins missed out Inception edited by 2011 Oscars evidence from multiple documents Golden Globes Inception’s script 83rd Academy Awards on-the-fly announced The movie Inception lost to declared at Best Screenplay nominated The Social Network Best Actor winner of 14
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan won Golden Globe Awards directed announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network Best Actor winner of 15
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller won type Golden Globe Awards directed announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network type Best Actor film winner of 16
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller won type Golden Globe Awards Add types: directed announced director of ★ Hearst patterns missed out Inception edited by 2011 Oscars X and other <TYPE> Golden Globes Inception’s script <TYPE> such as X 83rd Academy Awards ... announced The movie Inception lost to ★ From KG declared at Best Screenplay nominated The Social Network type Best Actor film winner of 17
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller won type Golden Globe Awards directed announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network type Best Actor film winner of 18
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller won type Golden Globe Awards directed announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network type Best Actor film winner of 19
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller Insert alignment edges won type Golden Globe Awards directed using lexicons and similarity announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network type Best Actor film winner of 20
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller won type Golden Globe Awards directed announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network type Best Actor film winner of 21
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller won type Golden Globe Awards directed announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network type Best Actor film winner of 22
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller won type Golden Globe Awards directed announced director of Simplify by considering edges as missed out Inception edited by 2011 Oscars Golden Globes Inception’s script homogeneous and undirected 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network type Best Actor film winner of 23
Question: Which Nolan films won an Oscar but missed a Golden Globe? Best Sound Nolan Chris Nolan science thriller won type Golden Globe Awards directed announced director of missed out Inception edited by 2011 Oscars Golden Globes Inception’s script 83rd Academy Awards announced The movie Inception lost to declared at Best Screenplay nominated The Social Network type Best Actor film winner of 24
Question: Which Nolan films won an Oscar but missed a Golden Globe? 0.3 1.0 0.9 0.6 Best Sound Nolan Chris Nolan science thriller 1.0 0.1 won type 0.4 0.3 Golden Globe Awards directed 0.9 announced director of 1.0 0.2 1.0 missed out Inception edited by 1.0 0.2 2011 Oscars Golden Globes Inception’s script 0.9 0.4 83rd Academy Awards 0.2 0.9 announced The movie Inception 0.4 lost to 0.3 0.4 declared at Best Screenplay 0.1 nominated 0.1 The Social Network 0.3 0.9 1.0 type Best Actor film winner of 25
Recommend
More recommend