Machine Reading and Reasoning with Neural Program Interpreters - PowerPoint PPT Presentation

Machine Reading & Comprehension Which function do I call for storing items in cape? … … Archiving Inbox Items Archiving Inbox Items cape.client.CapeClient.archive_inbox() Once an inbox item has been archived it will no longer Once an inbox item has been archived it will no longer appear in the list of inbox items returned appear in the list of inbox items returned by cape.client.CapeClient.get_inbox(). To archive an by cape.client.CapeClient.get_inbox(). To archive an item call cape.client.CapeClient.archive_inbox() with item call cape.client.CapeClient.archive_inbox() with the ID of the inbox item to archive: the ID of the inbox item to archive: from cape.client import CapeClient from cape.client import CapeClient cc = CapeClient() cc = CapeClient() cc.login('username', 'password') cc.login('username', 'password') cc.archive_inbox('4123') cc.archive_inbox('4123') � 7

How to read and reason end-to-end ? � 8

Learning to Read and Aggregate Which medical specialty deals with pituitary ACTH hypersecretion? � 9

Learning to Read and Aggregate Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … � 9

Learning to Read and Aggregate Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... � 9

Learning to Read and Aggregate Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. � 9

Learning to Read and Aggregate Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … Endocrinology A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. � 9

Part 1 Learning to Read and Aggregate Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … Endocrinology A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. � 9

Part 1 Learning to Read and Aggregate Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … Endocrinology A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders NIPS 2017, TACL 2018 is endocrinology , a branch of internal medicine. � 9

Learning to Read and Calculate Isabel uploaded 2 pictures from her phone and 4 How many pictures were in each of the albums? from her camera to facebook. She sorted the pics into 3 different albums with the same amount of pics in each album. � 10

Learning to Read and Calculate Isabel uploaded 2 pictures from her phone and 4 How many pictures were in each of the albums? from her camera to facebook. She sorted the pics into 3 different albums with the same amount of pics in each album. 2 � 10

Part 2 Learning to Read and Calculate Isabel uploaded 2 pictures from her phone and 4 How many pictures were in each of the albums? from her camera to facebook. She sorted the pics into 3 different albums with the same amount of pics in each album. 2 � 10

Part 2 Learning to Read and Calculate Isabel uploaded 2 pictures from her phone and 4 How many pictures were in each of the albums? from her camera to facebook. She sorted the pics into 3 different albums with the same amount of pics in each album. 2 ICML 2017 � 10

Learning to Interpret Rules I am working for an employer in Canada since If you’re self-employed December 2017. Do I need to carry on paying UK You might be able to carry on paying National national insurance? Insurance if you’re: - usually self-employed in the UK - working abroad temporarily If you do, you won’t have to pay social security contributions in the country where you’re working. You can check this by completing form CA9107. Working in any other country You’ll carry on paying National Insurance for the first 52 weeks you’re abroad if you’re working for an employer outside the EEA. � 11

Learning to Interpret Rules I am working for an employer in Canada since If you’re self-employed December 2017. Do I need to carry on paying UK You might be able to carry on paying National national insurance? Insurance if you’re: - usually self-employed in the UK - working abroad temporarily Yes If you do, you won’t have to pay social security contributions in the country where you’re working. You can check this by completing form CA9107. Working in any other country You’ll carry on paying National Insurance for the first 52 weeks you’re abroad if you’re working for an employer outside the EEA. � 11

Part 3 Learning to Interpret Rules I am working for an employer in Canada since If you’re self-employed December 2017. Do I need to carry on paying UK You might be able to carry on paying National national insurance? Insurance if you’re: - usually self-employed in the UK - working abroad temporarily Yes If you do, you won’t have to pay social security contributions in the country where you’re working. You can check this by completing form CA9107. Working in any other country You’ll carry on paying National Insurance for the first 52 weeks you’re abroad if you’re working for an employer outside the EEA. � 11

Part 3 And Ask Clarification Questions I am working for an employer in Canada since If you’re self-employed December 2017. Do I need to carry on paying UK You might be able to carry on paying National national insurance? Insurance if you’re: - usually self-employed in the UK - working abroad temporarily If you do, you won’t have to pay social security contributions in the country where you’re working. You can check this by completing form CA9107. Working in any other country You’ll carry on paying National Insurance for the first 52 weeks you’re abroad if you’re working for an employer outside the EEA. � 12

Part 3 And Ask Clarification Questions I am working for an employer in Canada since If you’re self-employed December 2017. Do I need to carry on paying UK You might be able to carry on paying National national insurance? Insurance if you’re: - usually self-employed in the UK - working abroad temporarily Have you been working abroad 52 weeks or less? If you do, you won’t have to pay social security contributions in the country where you’re working. You can check this by completing form CA9107. Working in any other country You’ll carry on paying National Insurance for the first 52 weeks you’re abroad if you’re working for an employer outside the EEA. � 12

Part 3 And Ask Clarification Questions I am working for an employer in Canada since If you’re self-employed December 2017. Do I need to carry on paying UK You might be able to carry on paying National national insurance? Insurance if you’re: - usually self-employed in the UK - working abroad temporarily Have you been working abroad 52 weeks or less? If you do, you won’t have to pay social security contributions in the country where you’re working. You can check this by completing form CA9107. Working in any other country Yes You’ll carry on paying National Insurance for the first 52 weeks you’re abroad if you’re working for an employer outside the EEA. � 12

Part 3 And Ask Clarification Questions I am working for an employer in Canada since If you’re self-employed December 2017. Do I need to carry on paying UK You might be able to carry on paying National national insurance? Insurance if you’re: - usually self-employed in the UK - working abroad temporarily Have you been working abroad 52 weeks or less? If you do, you won’t have to pay social security contributions in the country where you’re working. You can check this by completing form CA9107. Working in any other country Yes You’ll carry on paying National Insurance for the first 52 weeks you’re abroad if you’re working for an employer outside the EEA. Yes � 12

Part 3 And Ask Clarification Questions I am working for an employer in Canada since If you’re self-employed December 2017. Do I need to carry on paying UK You might be able to carry on paying National national insurance? Insurance if you’re: - usually self-employed in the UK - working abroad temporarily Have you been working abroad 52 weeks or less? If you do, you won’t have to pay social security contributions in the country where you’re working. You can check this by completing form CA9107. Working in any other country Yes You’ll carry on paying National Insurance for the first 52 weeks you’re abroad if you’re working for an employer outside the EEA. Yes ONGOING � 12

Pontus Stenetorp Johannes Welbl Tim Rocktäschel Part 1: Learning to Aggregate � 13

Neural Theorem Provers Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. � 14

Neural Theorem Provers Pituitary ACTH hypersecretion ... is a form of Which medical specialty deals with pituitary hyperpituitarism characterized by an abnormally high ACTH hypersecretion? level of ACTH produced by the anterior pituitary … Agent A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. Rocktäschel and Riedel NIPS 2017 � 15

Neural Theorem Provers Pituitary ACTH hypersecretion ... is a form of Which medical specialty deals with pituitary hyperpituitarism characterized by an abnormally high ACTH hypersecretion? level of ACTH produced by the anterior pituitary … Agent A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... Program Interpreter The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. Rocktäschel and Riedel NIPS 2017 � 15

Neural Theorem Provers Pituitary ACTH hypersecretion ... is a form of Which medical specialty deals with pituitary hyperpituitarism characterized by an abnormally high ACTH hypersecretion? level of ACTH produced by the anterior pituitary … Agent A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... Program Interpreter The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. Reader Rocktäschel and Riedel NIPS 2017 � 15

Neural Theorem Provers Pituitary ACTH hypersecretion ... is a form of Which medical specialty deals with pituitary hyperpituitarism characterized by an abnormally high ACTH hypersecretion? level of ACTH produced by the anterior pituitary … Agent A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... Program Interpreter The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders Code Question is endocrinology , a branch of internal medicine. [translates questions] Reader Rocktäschel and Riedel NIPS 2017 � 15

Neural Theorem Provers Pituitary ACTH hypersecretion ... is a form of Which medical specialty deals with pituitary hyperpituitarism characterized by an abnormally high ACTH hypersecretion? level of ACTH produced by the anterior pituitary … Agent A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... Program Interpreter The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders Code Question is endocrinology , a branch of internal medicine. What is ACTH [translates questions] hypersecretion created by? Reader Rocktäschel and Riedel NIPS 2017 � 16

Neural Theorem Provers Pituitary ACTH hypersecretion ... is a form of Which medical specialty deals with pituitary hyperpituitarism characterized by an abnormally high ACTH hypersecretion? level of ACTH produced by the anterior pituitary … Agent A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... Program Interpreter The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders Question Code Question is endocrinology , a branch of internal medicine. Which specialty deals What is the pituitary a with pituitary ACTH [translates questions] part of? hypersecretion? Reader Rocktäschel and Riedel NIPS 2017 � 17

Neural Theorem Provers Pituitary ACTH hypersecretion ... is a form of Which medical specialty deals with pituitary hyperpituitarism characterized by an abnormally high ACTH hypersecretion? level of ACTH produced by the anterior pituitary … Agent A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... Program Interpreter The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders Question Question Code Question is endocrinology , a branch of internal medicine. Which specialty deals What is the pituitary a with pituitary ACTH What topic covers the [translates questions] part of? hypersecretion? endocrine system? Reader Rocktäschel and Riedel NIPS 2017 � 18

Vectors Correspond to Interpretable Rules Pituitary ACTH hypersecretion ... is a form of Which medical specialty deals with pituitary hyperpituitarism characterized by an abnormally high ACTH hypersecretion? level of ACTH produced by the anterior pituitary … Agent A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... Program Interpreter The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders Question Question Code Question is endocrinology , a branch of internal medicine. Which specialty deals X deals with Y if What is the pituitary a with pituitary ACTH What topic covers the Y produced by Z part of? Z is a part of U hypersecretion? endocrine system? X deals with U Reader Rocktäschel and Riedel NIPS 2017 � 19

Catch: Currently only Works on Relational Data dealsWith( hypersecretion , X) createdBy( hypersecretion, anterior pituitary ) Agent partOf( endocrine system , anterior pituitary ) Program Interpreter dealsWith( endocrine system , endocrinology ) Question Question Code Question Which specialty deals X deals with Y if What is the pituitary a with pituitary ACTH Y produced by Z covers( endocrine part of? Z is a part of U hypersecretion? system , X ) X deals with U Reader Rocktäschel and Riedel NIPS 2017 � 20

Why Program Interpreter/Theorem Prover? dealsWith( hypersecretion , X) createdBy( hypersecretion, anterior pituitary ) Agent partOf( endocrine system , anterior pituitary ) Amounts the Backward dealsWith( endocrine system , endocrinology ) Chaining algorithm used in Prolog Interpreters Rocktäschel and Riedel NIPS 2017 � 21

Why Neural? Supports Soft Unification dealsWith( hypersecretion , X) createdBy( hypersecretion, anterior pituitary ) Agent partOf( endocrine system , anterior pituitary ) Program Interpreter dealsWith ( endocrine system , endocrinology ) Question Question Code Question Which specialty deals X deals with Y if What is the pituitary a with pituitary ACTH Y produced by Z covers ( endocrine part of? Z is a part of U hypersecretion? system , X ) X covers U Reader Rocktäschel and Riedel NIPS 2017 � 22

Learn Rules by Learning Symbol Representations dealsWith( hypersecretion , X) createdBy( hypersecretion, anterior pituitary ) Agent partOf( endocrine system , anterior pituitary ) Program Interpreter dealsWith ( endocrine system , endocrinology ) Question Question Code Question Which specialty deals X rel32 Y if What is the pituitary a with pituitary ACTH Y rel42 Z rel62 ( endocrine part of? Z rel51 U hypersecretion? system , X ) X rel62 U Reader Rocktäschel and Riedel NIPS 2017 � 23

Before Learning X rel32 Y if Y rel42 Z Z rel51 U is a part of rel32 X rel62 U produced by rel62 covers rel51 X deals with Y if rel42 Y produced by Z Z is a part of U deals with X deals with U � 24

After Learning X rel32 Y if Y rel42 Z Z rel51 U X rel62 U produced by rel42 is a part of rel51 rel32 rel62 X deals with Y if Y produced by Z covers deals with Z is a part of U X deals with U � 25

Results on Benchmark (Rank of Correct Answer) Rocktäschel and Riedel NIPS 2017 � 26

Results on Benchmark (Rank of Correct Answer) 100 75 50 25 0 Complex NTP Complex NTP Complex NTP Countries S3 UMLS Nations Rocktäschel and Riedel NIPS 2017 � 26

Results on Benchmark (Rank of Correct Answer) 100 96 86 75 50 48.4 25 0 Complex NTP Complex NTP Complex NTP Countries S3 UMLS Nations Rocktäschel and Riedel NIPS 2017 � 26

Results on Benchmark (Rank of Correct Answer) 100 99 96 89 86 75 77.3 50 48.4 25 0 Complex NTP Complex NTP Complex NTP Countries S3 UMLS Nations Rocktäschel and Riedel NIPS 2017 � 26

Results on Benchmark (Rank of Correct Answer) 100 99 96 89 86 75 77.3 50 48.4 25 0 Complex NTP Complex NTP Complex NTP Countries S3 UMLS Nations Comparable or Better than Baselines, and interpretable Rocktäschel and Riedel NIPS 2017 � 26

Limitations Scalability Currently only works for KBs with < 10k facts (solved!) Small proof depth (getting there) Still requires relational representation (ongoing) � 27

Pontus Stenetorp Johannes Welbl How to create Datasets for Multihop Reading and Reasoning? � 28

Dataset Construction Method TACL 2018 � 29

Dataset Construction Method Unlabelled Text Knowledge Base TACL 2018 � 29

Dataset Construction Method Unlabelled Text Dataset Construction Method Knowledge Base TACL 2018 � 29

Dataset Construction Method Unlabelled Text Dataset Construction Method Multihop Dataset Knowledge Base TACL 2018 � 29

Dataset Construction Method KB Triple Documents Instance Entities � 30

Dataset Construction Method KB Triple Documents Instance Entities Jamie Burnett, citizenship, Scotland � 30

Dataset Construction Method KB Triple Documents Instance Entities What is the nationality of Jamie Burnett? Jamie Burnett, citizenship, Scotland � 30

Dataset Construction Method KB Triple Documents Instance Entities What is the nationality of Jamie Burnett? Jamie Burnett Jamie Burnett, citizenship, Scotland � 30

Dataset Construction Method KB Triple Documents Instance Entities described in What is the nationality of Jamie Burnett? Jamie Burnett Jamie Burnett, citizenship, Scotland � 30

Dataset Construction Method KB Triple Documents Instance Entities described in What is the nationality of Jamie Burnett? Jamie Burnett mentions Jamie Burnett, citizenship, Scotland � 30

Dataset Construction Method KB Triple Documents Instance Entities described in What is the nationality of Jamie Burnett? Jamie Burnett mentions Hamilton Jamie Burnett, citizenship, Scotland � 30

Dataset Construction Method KB Triple Documents Instance Entities described in What is the nationality of Jamie Burnett? Jamie Burnett mentions Hamilton Jamie Burnett, citizenship, Scotland described in � 30

Dataset Construction Method KB Triple Documents Instance Entities described in What is the nationality of Jamie Burnett? Jamie Burnett mentions Hamilton Jamie Burnett, citizenship, Scotland described in mentions � 30

Dataset Construction Method KB Triple Documents Instance Entities described in What is the nationality of Jamie Burnett? Jamie Burnett mentions Hamilton Jamie Burnett, citizenship, Scotland Scotland Scotland described in mentions � 30

Dataset Construction Method KB Triple Documents Instance Entities described in What is the nationality of Jamie Burnett? Jamie Burnett mentions Hamilton Jamie Burnett, citizenship, Scotland Scotland Scotland described in Yixing Open mentions � 30

Dataset Construction Method KB Triple Documents Instance Entities described in What is the nationality of Jamie Burnett? Jamie Burnett mentions Hamilton Jamie Burnett, citizenship, Scotland Scotland Scotland described in China Yixing Open mentions China � 30

Dataset Construction Method Unlabelled Text Dataset Construction Method Multihop Dataset Knowledge Base [Conditionally Accepted to TACL] � 31

Dataset Construction Method Unlabelled Text Dataset Construction Method WikiHop Knowledge Base � 32

Dataset Construction Method Unlabelled Text Dataset Construction Method MedHop Knowledge Base � 33

Baseline Results � 34

Baseline Results 50 Random TF-IDF BiDAF 41.667 33.333 Accuracy [%] 25 16.667 8.333 0 WikiHop MedHop � 34

Baseline Results 50 Random TF-IDF BiDAF 41.667 33.333 Accuracy [%] 25 16.667 13.9 11.5 8.333 0 WikiHop MedHop � 34

Baseline Results 50 Random TF-IDF BiDAF 41.667 33.333 Accuracy [%] 25 25.6 16.667 13.9 11.5 8.333 9 0 WikiHop MedHop � 34

Baseline Results 50 Random 47.8 TF-IDF BiDAF 42.9 41.667 33.333 Accuracy [%] 25 25.6 16.667 13.9 11.5 8.333 9 0 WikiHop MedHop � 34

Reduction to Traditional Machine Comprehension Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … Endocrinology A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. � 35

Reduction to Traditional Machine Comprehension Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … Endocrinology A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. � 36

Do Neural Reading Models Aggregate? Which medical specialty deals with pituitary ACTH Pituitary ACTH hypersecretion ... is a form of hypersecretion? hyperpituitarism characterized by an abnormally high level of ACTH produced by the anterior pituitary … Endocrinology A major organ of the endocrine system , the anterior pituitary is the glandular, anterior lobe that ... The endocrine system is ... ... The field of study dealing with the endocrine system and its disorders is endocrinology , a branch of internal medicine. � 37

Removing Relevant Documents, Keep Answer Documents 55 54.5 BIDAF 10% BIDAF doc-rem 50 45 44.6 Accuracy [%] 40 35 33.7 30 30.4 25 WikiHop MedHop � 38

TACL 2018 � 39

Machine Reading and Reasoning with Neural Program Interpreters - PowerPoint PPT Presentation

Machine Reading and Reasoning with Neural Program Interpreters Sebastian Riedel @riedelcastro Machine Reading Collaborators Pontus Stenetorp Marzieh Saeidi Max Bartolo Johannes Welbl (Bloomsbury AI) (UCL) (UCL) (Bloomsbury AI)

Machine Reading and Reasoning with Neural Program Interpreters Sebastian Riedel @riedelcastro

Machine Reading and Reasoning with Neural Program Interpreters Sebastian Riedel @riedelcastro

Automated Reasoning (what this course is about) AUTOMATED REASONING machine does 'thinking'

2nd Session Machine learning: feed-forward neural networks and self-organizing maps 1

Neural Machine Translation Gongbo Tang 8 October 2018 Outline Neural Machine Translation 1

Overfitting, Cross-Validation Recommended reading: Neural nets: Mitchell Chapter 4

Convolutional Neural Nets 4-25-16 Reading Quiz Convolutional neural networks are most commonly

Probabilistic Reasoning; Probabilistic Reasoning; Network-based reasoning Network-based

Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and

Neural Networks for Machine Learning Lecture 2a An overview of the main types of neural network

Automated Reasoning (what this course is about) machine does 'thinking' user does 'thinking'

Neural Machine Translation Philipp Koehn 6 October 2020 Philipp Koehn Machine Translation:

Convolutional over Recurrent Encoder for Neural Machine Translation Praveen Dakwale and Christof

10601 Machine Learning Hierarchical clustering Reading: Bishop: 9-9.2 Second half: Overview

Machine Learning for NLP Neural networks and neuroscience Aurlie Herbelot 2018 Centre for

Reasoning with Neural Networks Rodrigo Toro Icarte (rntoro@cs.toronto.edu) March 08, 2016

Neural Module Networks for Reasoning Over Text Nitish Gupta , Kevin Lin , Dan Roth , Sameer Singh

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan

Neural Program Synthesis with Priority Queue Training Daniel A. Abolafia, Mohammad Norouzi,

Part II: Enhancing ATPs with Machine Learning Course Machine Learning and Reasoning 2020 MLR 2020

Deep Neural Networks for PDEs Philipp Grohs DL and Vis, September 2018 Short Reading List 1 Ian

Sparse and Constrained Attention for Neural Machine Translation Chaitanya Malaviya 1 ,

Fundamentals of Machine Learning for Neural Machine Translation Dr. John D. Kelleher ADAPT

Adaptive Multi-pass Decoder for Neural Machine Translation EMNLP 2018