machine translation contd
play

Machine Translation Contd Prof. Sameer Singh CS 295: STATISTICAL - PowerPoint PPT Presentation

Dec 31, 2022 •467 likes •1.04k views

Machine Translation Contd Prof. Sameer Singh CS 295: STATISTICAL NLP WINTER 2017 March 2, 2017 Based on slides from Dan Klein, Philipp Koehn, Jacob Eisenstein, and everyone else they copied from. Omer Levy AI/ML Seminar Monday, March 6 th

  1. Machine Translation Contd Prof. Sameer Singh CS 295: STATISTICAL NLP WINTER 2017 March 2, 2017 Based on slides from Dan Klein, Philipp Koehn, Jacob Eisenstein, and everyone else they copied from.

  2. Omer Levy AI/ML Seminar Monday, March 6 th 1pm-2pm DBH 4011 Understanding Word Embeddings Meeting with Graduate Students 4:00-4:45pm Room TBA (email me) CS 295: STATISTICAL NLP (WINTER 2017) 2

  3. Upcoming… Status report due in 1 weeks: March 7, 2017 • Project Instructions coming today! • Almost final report, only 5 pages • Paper summaries: March 14 • Summaries • Summary 1 graded Homework 4 is due on March 13 • Homework Write-up and data releasing soon. • CS 295: STATISTICAL NLP (WINTER 2017) 3

  4. Outline EM-Algorithm for Alignments Phrase-Based MT Decoding Algorithms Syntax-Based MT CS 295: STATISTICAL NLP (WINTER 2017) 4

  5. Outline EM-Algorithm for Alignments Phrase-Based MT Decoding Algorithms Syntax-Based MT CS 295: STATISTICAL NLP (WINTER 2017) 5

  6. Parameters of the IBM Models CS 295: STATISTICAL NLP (WINTER 2017) 6

  7. Parameters of the IBM Models CS 295: STATISTICAL NLP (WINTER 2017) 7

  8. Translation from Alignments CS 295: STATISTICAL NLP (WINTER 2017) 8

  9. Alignments from Translation CS 295: STATISTICAL NLP (WINTER 2017) 9

  10. Expectation Maximization Expectation Maximization CS 295: STATISTICAL NLP (WINTER 2017) 10

  11. Example CS 295: STATISTICAL NLP (WINTER 2017) 11

  12. Example CS 295: STATISTICAL NLP (WINTER 2017) 12

  13. Word-based MT: Problems Multi-word Alignments Non-compositionality Phrasal Translations CS 295: STATISTICAL NLP (WINTER 2017) 13

  14. Outline EM-Algorithm for Alignments Phrase-Based MT Decoding Algorithms Syntax-Based MT CS 295: STATISTICAL NLP (WINTER 2017) 14

  15. The Vauquios Triangle CS 295: STATISTICAL NLP (WINTER 2017) 15

  16. Phrase-based MT Mary did not slap the green witch CS 295: STATISTICAL NLP (WINTER 2017) 16

  17. Phrase Lexicon CS 295: STATISTICAL NLP (WINTER 2017) 17

  18. Learning Phrasal Alignments CS 295: STATISTICAL NLP (WINTER 2017) 18

  19. Learning Phrasal Alignments CS 295: STATISTICAL NLP (WINTER 2017) 19

  20. Learning Phrasal Alignments CS 295: STATISTICAL NLP (WINTER 2017) 20

  21. Phrasal Alignments Should contain all the alignment points for covered words CS 295: STATISTICAL NLP (WINTER 2017) 21

  22. Learning Phrasal Alignments (Maria, Mary), (no, did not), (slap, daba una bofetada), (a la, the), (bruja, witch), (verde, green) CS 295: STATISTICAL NLP (WINTER 2017) 22

  23. Learning Phrasal Alignments (Maria, Mary), (no, did not), (slap, daba una bofetada), (a la, the), (bruja, witch), (verde, green) (Maria no, Mary did not), (no daba una bofetada, did not slap), (daba una bofetada a la, slap the), (bruja verde, green witch) CS 295: STATISTICAL NLP (WINTER 2017) 23

  24. Learning Phrasal Alignments (Maria, Mary), (no, did not), (slap, daba una bofetada), (a la, the), (bruja, witch), (verde, green) (Maria no, Mary did not), (no daba una bofetada, did not slap), (daba una bofetada a la, slap the), (bruja verde, green witch) (Maria no daba una bofetada, Mary did not slap), (no daba una bofetada a la, did not slap the), (a la bruja verde, the green witch) CS 295: STATISTICAL NLP (WINTER 2017) 24

  25. Learning Phrasal Alignments (Maria, Mary), (no, did not), (slap, daba una bofetada), (a la, the), (bruja, witch), (verde, green) (Maria no, Mary did not), (no daba una bofetada, did not slap), (daba una bofetada a la, slap the), (bruja verde, green witch) (Maria no daba una bofetada, Mary did not slap), (no daba una bofetada a la, did not slap the), (a la bruja verde, the green witch) (Maria no daba una bofetada a la, Mary did not slap the), (daba una bofetada a la bruja verde, slap the green witch) CS 295: STATISTICAL NLP (WINTER 2017) 25

  26. Phrase Translation Scores CS 295: STATISTICAL NLP (WINTER 2017) 26

  27. Phrases for a Sentence wir müssen auch diese kritik ernst nehmen (wir müssen, we must) (wir müssen auch, we must also) (ernst, seriously) …. CS 295: STATISTICAL NLP (WINTER 2017) 27

  28. Derivations for a Sentence CS 295: STATISTICAL NLP (WINTER 2017) 28

  29. Distortion Limits CS 295: STATISTICAL NLP (WINTER 2017) 29

  30. Distortion Scores CS 295: STATISTICAL NLP (WINTER 2017) 30

  31. Scoring Derivations CS 295: STATISTICAL NLP (WINTER 2017) 31

  32. The Translation Problem CS 295: STATISTICAL NLP (WINTER 2017) 32

  33. A Secret of Statistical MT CS 295: STATISTICAL NLP (WINTER 2017) 33

  34. Outline EM-Algorithm for Alignments Phrase-Based MT Decoding Algorithms Syntax-Based MT CS 295: STATISTICAL NLP (WINTER 2017) 34

  35. The Decoding Task CS 295: STATISTICAL NLP (WINTER 2017) 35

  36. Monotonic Word Decoding CS 295: STATISTICAL NLP (WINTER 2017) 36

  37. Monotonic Word Decoding CS 295: STATISTICAL NLP (WINTER 2017) 37

  38. Monotonic Word Decoding Mary CS 295: STATISTICAL NLP (WINTER 2017) 38

  39. Monotonic Word Decoding Mary did not CS 295: STATISTICAL NLP (WINTER 2017) 39

  40. Monotonic Word Decoding Mary did not give CS 295: STATISTICAL NLP (WINTER 2017) 40

  41. Monotonic Word Decoding Mary did not give a CS 295: STATISTICAL NLP (WINTER 2017) 41

  42. Monotonic Word Decoding Mary did not give a slap CS 295: STATISTICAL NLP (WINTER 2017) 42

  43. Monotonic Word Decoding Mary did not give a slap to CS 295: STATISTICAL NLP (WINTER 2017) 43

  44. Monotonic Word Decoding Mary did not give a slap to the CS 295: STATISTICAL NLP (WINTER 2017) 44

  45. Monotonic Word Decoding Mary did not give a slap to the witch CS 295: STATISTICAL NLP (WINTER 2017) 45

  46. Monotonic Word Decoding Mary did not give a slap to the witch green CS 295: STATISTICAL NLP (WINTER 2017) 46

  47. Monotonic Word Decoding CS 295: STATISTICAL NLP (WINTER 2017) 47

  48. Phrase Decoding: Stacks CS 295: STATISTICAL NLP (WINTER 2017) 48

  49. Phrase Decoding: Stacks CS 295: STATISTICAL NLP (WINTER 2017) 49

  50. Monotonic Phrase Decoding CS 295: STATISTICAL NLP (WINTER 2017) 50

  51. Monotonic Phrase Decoding CS 295: STATISTICAL NLP (WINTER 2017) 51

  52. Monotonic Phrase Decoding (Mary) CS 295: STATISTICAL NLP (WINTER 2017) 52

  53. Monotonic Phrase Decoding (Mary) (did not) CS 295: STATISTICAL NLP (WINTER 2017) 53

  54. Monotonic Phrase Decoding (Mary) (did not) (slap) CS 295: STATISTICAL NLP (WINTER 2017) 54

  55. Monotonic Phrase Decoding (Mary) (did not) (slap) (the) CS 295: STATISTICAL NLP (WINTER 2017) 55

  56. Monotonic Phrase Decoding (Mary) (did not) (slap) (the) (green witch) CS 295: STATISTICAL NLP (WINTER 2017) 56

Recommend

Machine Translation Contd Prof. Sameer Singh CS 295: STATISTICAL NLP WINTER 2017 March 7, 2017

Machine Translation Contd Prof. Sameer Singh CS 295: STATISTICAL NLP WINTER 2017 March 7, 2017

Machine Translation Contd Prof. Sameer Singh CS 295: STATISTICAL NLP WINTER 2017 March 7, 2017 Based on slides from Richard Socher, Chris Manning, Philipp Koehn, and everyone else they copied from. Upcoming Status report due tonight: March

553 views • 52 slides
Statistical Machine Translation Nadir Durrani 21-November-2014 Machine Translation

Statistical Machine Translation Nadir Durrani 21-November-2014 Machine Translation

Statistical Machine Translation Nadir Durrani 21-November-2014 Machine Translation www.uni-stuttart.de Problem: Automatic translation the foreign text: 2 Open Problems in Machine Translation www.uni-stuttart.de Ambiguity in translation

939 views • 44 slides
Machine Translation 2 Wikipedia Machine translation, often referred to by the acronym MT, is a

Machine Translation 2 Wikipedia Machine translation, often referred to by the acronym MT, is a

Machine Translation 2 Wikipedia Machine translation, often referred to by the acronym MT, is a sub-field of computational linguistics that investigates the use of computer software to translate text or speech from one natural language to

782 views • 24 slides
Machine Translation (M2M) Machine Translation (M2M) SNMP MIB to CIM MOF SNMP MIB to CIM MOF

Machine Translation (M2M) Machine Translation (M2M) SNMP MIB to CIM MOF SNMP MIB to CIM MOF

Machine Translation (M2M) Machine Translation (M2M) SNMP MIB to CIM MOF SNMP MIB to CIM MOF WIMS Working Group CIM Project 19 February 2007 PWG Maui Ira McDonald (High North) M2M Background Background M2M DMTF/PWG

437 views • 7 slides
Natural Language Processing Machine Translation Dan Klein UC Berkeley 1 Machine Translation 2

Natural Language Processing Machine Translation Dan Klein UC Berkeley 1 Machine Translation 2

Natural Language Processing Machine Translation Dan Klein UC Berkeley 1 Machine Translation 2 Machine Translation: Examples 3 Levels of Transfer 4 Word Level MT: Examples la politique de la haine . (Foreign Original) politics

675 views • 43 slides
Introd u ction to machine translation MAC H IN E TR AN SL ATION IN P YTH ON Th u shan

Introd u ction to machine translation MAC H IN E TR AN SL ATION IN P YTH ON Th u shan

Introd u ction to machine translation MAC H IN E TR AN SL ATION IN P YTH ON Th u shan Ganegedara Data Scientist and A u thor Machine translation MACHINE TRANSLATION IN PYTHON Machine translation MACHINE TRANSLATION IN PYTHON Co u rse o u

839 views • 38 slides
Natural Language Processing Machine Translation Machine Translation Dan Klein UC Berkeley

Natural Language Processing Machine Translation Machine Translation Dan Klein UC Berkeley

Natural Language Processing Machine Translation Machine Translation Dan Klein UC Berkeley Machine Translation: Examples Levels of Transfer Word Level MT: Examples Phrasal MT: Examples la politique de la haine . (Foreign Original)

223 views • 8 slides
Use of the Machine Translation Module within Dj Vu X2 Quick Guidance Introduction Machine

Use of the Machine Translation Module within Dj Vu X2 Quick Guidance Introduction Machine

Use of the Machine Translation Module within Dj Vu X2 Quick Guidance Introduction Machine Translation has now become incontrovertible in the translation industry. We at Atril put efforts in providing best help to the translation actors. In

393 views • 6 slides
Machine Translation Machine Translation February 13, 2008 Andreas Eisele UdS Computerlinguistik

Machine Translation Machine Translation February 13, 2008 Andreas Eisele UdS Computerlinguistik

Machine Translation Machine Translation February 13, 2008 Andreas Eisele UdS Computerlinguistik & DFKI eisele@dfki.de Foundations of Language Science and Technology WS 2007/8 Machine Translation: Overview Machine Translation: Overview

216 views • 21 slides
Machine Translation Machine Translation Berlin Chen 2003 References: 1. Natural Language

Machine Translation Machine Translation Berlin Chen 2003 References: 1. Natural Language

Machine Translation Machine Translation Berlin Chen 2003 References: 1. Natural Language Understanding, chapter 13 2. W. A. Gale and K. W. Church, A Program for Aligning Sentences in Bilingual Corpora, Computational Linguistics 1993 1

731 views • 34 slides
Machine Translation 12: (Non-neural) Statistical Machine Translation Rico Sennrich University of

Machine Translation 12: (Non-neural) Statistical Machine Translation Rico Sennrich University of

Machine Translation 12: (Non-neural) Statistical Machine Translation Rico Sennrich University of Edinburgh R. Sennrich MT 2018 12 1 / 27 Todays Lecture So far, main focus of lecture was on: neural machine translation research

740 views • 46 slides
Neural Machine Translation Gongbo Tang 8 October 2018 Outline Neural Machine Translation 1

Neural Machine Translation Gongbo Tang 8 October 2018 Outline Neural Machine Translation 1

Neural Machine Translation Gongbo Tang 8 October 2018 Outline Neural Machine Translation 1 Advances and Challenges 2 Gongbo Tang Neural Machine Translation 2/52 Neural Machine Translation Figure Recurrent neural network based NMT

906 views • 73 slides
Semi-supervised Learning for Neural Machine Translation Yong Cheng joint work with Wei Xu,

Semi-supervised Learning for Neural Machine Translation Yong Cheng joint work with Wei Xu,

Semi-supervised Learning for Neural Machine Translation Yong Cheng joint work with Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu 1 Machine Translation Automated translation using computer software 2 Machine Translation Rule-based

650 views • 26 slides
History & Evaluation CMSC 470 Marine Carpuat T odays topics Machine Translation

History & Evaluation CMSC 470 Marine Carpuat T odays topics Machine Translation

Machine Translation History & Evaluation CMSC 470 Marine Carpuat T odays topics Machine Translation Context: Historical Background Machine Translation is an old idea Machine Translation Evaluation 1947 When I look at an

825 views • 40 slides
Learning Non-Isomorphic Tree Mappings for Machine Translation Syntax-Based Machine Translation

Learning Non-Isomorphic Tree Mappings for Machine Translation Syntax-Based Machine Translation

Learning Non-Isomorphic Tree Mappings for Machine Translation Syntax-Based Machine Translation Jason Eisner - Johns Hopkins Univ. Previous work assumes essentially isomorphic trees Wu 1995, Alshawi et al. 2000, Yamada & Knight 2000

306 views • 5 slides
Introduction to Machine Translation CMSC 723 / LING 723 / INST 725 Marine Carpuat Slides &

Introduction to Machine Translation CMSC 723 / LING 723 / INST 725 Marine Carpuat Slides &

Introduction to Machine Translation CMSC 723 / LING 723 / INST 725 Marine Carpuat Slides & figure credits: Philipp Koehn mt-class.org T odays topics Machine Translation Historical Background Machine Translation is an old idea

1.17k views • 43 slides
CRF Word Alignment & Noisy Channel Translation Machine Translation Lecture 6 Instructor:

CRF Word Alignment & Noisy Channel Translation Machine Translation Lecture 6 Instructor:

CRF Word Alignment & Noisy Channel Translation Machine Translation Lecture 6 Instructor: Chris Callison-Burch TAs: Mitchell Stern, Justin Chiu Website: mt-class.org/penn Last Time ... X Translation Translation Alignment p ( p ( ) = )

937 views • 48 slides
Machine Translation CMSC 723 / LING 723 / INST 725 M ARINE C ARPUAT marine@cs.umd.edu T oday:

Machine Translation CMSC 723 / LING 723 / INST 725 M ARINE C ARPUAT marine@cs.umd.edu T oday:

Machine Translation CMSC 723 / LING 723 / INST 725 M ARINE C ARPUAT marine@cs.umd.edu T oday: an introduction to machine translation The noisy channel model decomposes machine translation into Word alignment Language modeling

1.05k views • 45 slides
What can Statistical Machine Translation teach Neural Machine Translation about Structured

What can Statistical Machine Translation teach Neural Machine Translation about Structured

What can Statistical Machine Translation teach Neural Machine Translation about Structured Prediction? Graham Neubig @ ICLR Workshop on Deep Reinforcement Learning Meets Structured Prediction 5/6/2019 Types of Prediction Types of

1.73k views • 127 slides
Social Translation: How Massive Online Collaboration Could Take Machine Translation to the Next

Social Translation: How Massive Online Collaboration Could Take Machine Translation to the Next

Social Translation: How Massive Online Collaboration Could Take Machine Translation to the Next Level Juan Antonio Prez-Ortiz Transducens Research Group Department of Software and Computing Systems University of Alacant, Spain This work is

776 views • 28 slides
Statistical Machine Translation George Foster George Foster Statistical Machine Translation A

Statistical Machine Translation George Foster George Foster Statistical Machine Translation A

Statistical Machine Translation George Foster George Foster Statistical Machine Translation A Brief History of MT Origins (1949): WW II codebreaking success suggests statistical approach to MT George Foster Statistical Machine Translation A

840 views • 54 slides
Global Translation Services Website translation using post-edited machine translation and

Global Translation Services Website translation using post-edited machine translation and

Global Translation Services Website translation using post-edited machine translation and crowdsourcing David Grunwald davidg@gts-translation.com twitter: @davegrun LinkedIn: davegrun March 31, 2011 David Grunwald, GTS About GTS Small

211 views • 17 slides
Machine Translation: Going Deep Philipp Koehn 4 June 2015 Philipp Koehn Machine Translation:

Machine Translation: Going Deep Philipp Koehn 4 June 2015 Philipp Koehn Machine Translation:

Machine Translation: Going Deep Philipp Koehn 4 June 2015 Philipp Koehn Machine Translation: Going Deep 4 June 2015 How do we Improve Machine Translation? 1 More data Better linguistically motivated models Better machine learning

1.21k views • 67 slides
Sequence to Sequence Models for Machine Translation CMSC 723 / LING 723 / INST 725 Marine

Sequence to Sequence Models for Machine Translation CMSC 723 / LING 723 / INST 725 Marine

Sequence to Sequence Models for Machine Translation CMSC 723 / LING 723 / INST 725 Marine Carpuat Slides & figure credits: Graham Neubig Machine Translation 3 problems Translation system Input: source sentence F Output:

349 views • 20 slides

More recommend