Natural Language Processing Fall 2018 Frank Ferraro Natural - PowerPoint PPT Presentation

Garden Path Sentences [The rat [the cat [the dog chased] killed] ate the malt]. Language can have recursive patterns Syntactic parsing can help identify those

Syntactic Parsing Syntactic parsing: perform a “meaningful” structural analysis according to grammatical rules I ate the meal with friends VP NP PP NP VP S

Syntactic Parsing Can Help Disambiguate I ate the meal with friends VP NP PP NP VP S

Syntactic Parsing Can S Help Disambiguate NP VP VP NP NP PP I ate the meal with friends VP NP PP NP VP S

Clearly Show Ambiguity… But Not Necessarily All Ambiguity I ate the meal with a fork I ate the meal with gusto I ate the meal with friends VP NP PP NP VP S

Discourse Processing John stopped at the donut store. Courtesy Jason Eisner

Discourse Processing John stopped at the donut store. Courtesy Jason Eisner

Discourse Processing John stopped at the donut store before work . Courtesy Jason Eisner

Discourse Processing John stopped at the donut store on his way home . Courtesy Jason Eisner

Discourse Processing John stopped at the donut shop. John stopped at the trucker shop. John stopped at the mom & pop shop. John stopped at the red shop. Courtesy Jason Eisner

Discourse Processing through Coreference I spread the cloth on the table to protect it. I spread the cloth on the table to display it. Courtesy Jason Eisner

Discourse Processing through Coreference I spread the cloth on the table to protect it . I spread the cloth on the table to display it . Courtesy Jason Eisner

Discourse Processing through Coreference I spread the cloth on the table to protect it. I spread the cloth on the table to display it. Courtesy Jason Eisner

http://www.qwantz.com/index.php?comic=170

Three people have been fatally shot, and five people, including a mayor, were seriously wounded as a result of a Shining Path attack today.

Three people have been fatally shot, score( ) and five people, including a mayor, were seriously wounded as a result of a Shining Path attack today.

Three people have been fatally shot, p θ ( ) and five people, including a mayor, were seriously wounded as a result of a Shining Path attack today.

p θ (X) probabilistic model F( θ ) objective

Gradient Ascent θ 2 θ 1