Learning Household Task Knowledge from WikiHow Descriptions Yilun - PowerPoint PPT Presentation

Learning Household Task Knowledge from WikiHow Descriptions Yilun Zhou, Julie A. Shah, Steven Schockaert

Introduction Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Introduction Can you bring me the bread and milk? Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Introduction Can you bring me the scissors? Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Introduction Can you make a cup of coffee for me? Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Related Work ● Knowledge representation ○ ConceptNet [Speer, Chin, and Havasi] ○ KnowRob ● Script knowledge learning ● WikiHow mining Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Related Work ● Knowledge representation ○ ConceptNet ○ KnowRob [Tenorth and Beetz] ● Script knowledge learning ● WikiHow mining Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Related Work ● Knowledge representation ● Script knowledge learning ○ [Chambers and Jurafsky] ○ [Modi and Tidov] ○ [Pichotta and Mooney] ● WikiHow mining Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Related Work ● Knowledge representation ● Script knowledge learning ● WikiHow mining ○ [Chu, Tandon, and Weikum] ○ [Park and Nezhad] Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Dataset Description Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Dataset Description Title Step gist Step explanation Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Dataset Description Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Architecture Prediction task 1 Prediction task 2 Embedding A Embedding B Text A Text B Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Results Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Ambiguous Ordering Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Integer Programming for Ordering ● x ij = 1 represents that step i occurs strictly before step j ● w ij = log Pr (i before j) Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Integer Programming for Ordering Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Embedding Visualization Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Conclusion and Future work ● Learn embedding representation from unstructured natural language ● Integer programming for order inference Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Conclusion and Future work ● Learn embedding representation from unstructured natural language ● Integer programming for order inference ● Consider more problems to learn jointly ○ Predict if a certain tool is needed for a certain task ○ Predict if two steps are from two tasks are equivalent ● Text grounding ○ Map from steps/tasks to images/videos ○ Generate 3D trajectories for step execution Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert

Learning Household Task Knowledge from WikiHow Descriptions Yilun - PowerPoint PPT Presentation

Learning Household Task Knowledge from WikiHow Descriptions Yilun Zhou, Julie A. Shah, Steven Schockaert Introduction Learning Household Task Knowledge from WikiHow Descriptions. Y. Zhou, J. A. Shah, S. Schockaert Introduction Learning

Learning Summary Given a task, use data/experience bias/background knowledge measure

Adaptive Knowledge Sharing in Multi-Task Learning: Improving Low-Resource Neural Machine

AI2 - Module 3 Task 5: Learning from Data Overview Task 5: Learning from Data Task 6: Coping

Academia: no learning without knowledge, no knowledge without learning TRPC6, NEP Van den Berg,

Multi-Task Active Learning Yi Zhang Outline Active Learning Multi-Task Active Learning

Active Learning Passive Learning Active Learning 1. Think 1. Acquisition of knowledge Ability

Knowledge Development Task Force I: Progress in Assessing the Literature George Smeaton 1 ,

Interpretable and Compositional Relation Learning by Joint Training with an Autoencoder Ryo

Financial Knowledge and Financial Literacy at the Household Level Alan L. Gustman Thomas L.

Household Safety Household Safety Objectives Statistics on household safety Common

Household Safety Household Safety Objectives Statistics on household safety Common

YAM++ - A combination of graph matching and machine learning approach to ontology alignment task

Multi-Task Learning and Matrix Regularization Andreas Argyriou TTI Chicago Outline

Discovering, Visualizing and Sharing Knowledge through Personalized Learning Knowledge Maps The

b What are household projections and why are they important? Household projections are the

Proposal of Household Economy- Environment Accounts by Household Type 13 th AIM International

Global Knowledge Management Process Integration of Business, Learning, and Knowledge Processes

ence The Expeditionary Learning Public Knowledge Public Knowledge E X 1+1= P 1+1=2 E R

The logic of learning: The logic of learning: logic and knowledge representation logic and

Randomness Task 6: Coping with Incomplete Knowledge: Overview You flip a coin. It either

The standard for personalized learning We focus on the how in learning We want to help

26:198:722 Expert Systems I Knowledge representation I Knowledge acquisition I Machine learning I

Do Now! Take out Lesson 4.1-4.3 Practice and a pencil and IMN. Learning Target: I can

Time on task in collaborative learning. Influence of learning goal orientation and group