Few-shot learning of weak supervision sources in Snorkel (or, - PowerPoint PPT Presentation

Mar 19, 2023 •232 likes •364 views

Few-shot learning of weak supervision sources in Snorkel (or, learning weakly supervised weak supervisors) Jesse Mu Project Outline Replicate Snorkel causal relation extraction system Learn weak supervision sources from tiny sets of

Few-shot learning of weak supervision sources in Snorkel (or, learning weakly supervised weak supervisors) Jesse Mu
Project Outline ● Replicate Snorkel causal relation extraction system ● Learn weak supervision sources from tiny sets of annotated examples, and compare performance to (1)
“We don’t have better algorithms than anyone else; we just have more data” Peter Norvig Chief Scientist, Google
NIPS 2016
Extension: from examples to labeling functions ● Labeling functions (LFs) require programming experience and abstraction. ● Can we learn noisy labelers from few examples, without a single line of code? ● Given sentences and relations, generate many candidate LFs that distinguish LF from surrounding sentences Several diseases that appear to be heritable, but not genetically causes(e1=genetics, e2=retinal atrophy) defined, have been observed at low frequency in the breed. 11 , 12 , 13 causes(e1=genetics, e2=glomerulopathy) Many of these disorders have evolved with the domestic dog over time and inherited by descent as breeds have been created [3]. Except for hip dysplasia, which is considered one of the more serious disorders of Samoyed, most heritable and potentially def candidate_lf1(s, e1, e2): heritable disease traits of the breed have been of minor return 'causes' in s importance. 11 There are only three simple deleterious genetic disorders in Samoyed with defined causes, X-linked s def candidate_lf2(s, e1, e2): glomerulopathy [4], X-linked progressive retinal atrophy [5], and an incomplete dominant short-limbed defect with ocular return 'deleterious' in s abnormalities [6, 7].
Extension: from examples to labeling functions ● Labeling functions (LFs) require programming experience and abstraction. ● Can we learn noisy labelers from few examples, without a single line of code? ● Given sentences and relations, generate many candidate LFs that distinguish LF from surrounding sentences 2 questions: ● How dumb are LFs generated in this way? ● How dumb can LFs be before Snorkel begins to break down?
Few-shot learning of weak supervision sources in Snorkel (or, learning weakly supervised weak supervisors) Jesse Mu

Recommend

Weak Supervised Learning on Ray using Snorkel British Sentiment Analysis with LSTM Using Noisy

Weak Supervised Learning on Ray using Snorkel British Sentiment Analysis with LSTM Using Noisy Crowd Sami (sa894) - R244 Large-Scale Data Processing and Optimisation Snorkel generating training label Generating training labels with weak-

219 views • 8 slides

Weak Supervision Vincent Chen and Nish Khandwala Outline Motivation We want more

Weak Supervision Vincent Chen and Nish Khandwala Outline Motivation We want more labels! We want to program our data! #Software2.0 Weak Supervision Formulation Landscape of Noisy Labeling Schemes Snorkel

837 views • 29 slides

Snorkel DryBell: A Case Study in Deploying Weak Supervision at Industrial Scale Stephen Bach

Snorkel DryBell: A Case Study in Deploying Weak Supervision at Industrial Scale Stephen Bach (Brown University); Daniel Rodriguez (Google); Yintao Liu (Google); Chong Luo (Google); Haidong Shao (Google); Cassandra Xia (Google); Souvik Sen

566 views • 41 slides

Concepts with Few-shot Supervision Xuming He ShanghaiTech University

Learning Structured Visual Concepts with Few-shot Supervision Xuming He ShanghaiTech University hexm@shanghaitech.edu.cn 1 12/5/2019 Outline Introduction Learning from very limited annotated data Background in few-shot

807 views • 52 slides

Learning Dependency Structures for Weak Supervision Models Fred Sala , Paroma Varma, Ann He, Alex

Learning Dependency Structures for Weak Supervision Models 6:30-9:00 PM, Pacific Ballroom #119 Learning Dependency Structures for Weak Supervision Models Fred Sala , Paroma Varma, Ann He, Alex Ratner, Chris R Learning Dependency Structures for

375 views • 15 slides

Weak Supervision in High Dimensions Machine Learning for Jet Physics Workshop, 2017 Eric M.

Weak Supervision in High Dimensions Machine Learning for Jet Physics Workshop, 2017 Eric M. Metodiev Center for Theoretical Physics Massachusetts Institute of Technology Work with Patrick T. Komiske, Francesco Rubbo, Benjamin Nachman, and

236 views • 19 slides

Weak Supervision, noisy labels, and error propagation Marat Freytsis hep-ai journal club

Weak Supervision, noisy labels, and error propagation Marat Freytsis hep-ai journal club December 11, 2018 based on Yu et al. [arXiv:1402.5902], Cohen, MF, Osdiek [arXiv:1706.09451] + bits of others Why Weak supervision? Fully supervised

222 views • 18 slides

Model-Agnostic Meta-Learning Universality, Inductive Bias, and Weak Supervision Chelsea Finn

Model-Agnostic Meta-Learning Universality, Inductive Bias, and Weak Supervision Chelsea Finn Why Learn to Learn? - e ff ectively reuse data on other tasks - replace manual engineering of architecture, hyperparameters, etc. - learn to quickly

915 views • 30 slides

Learning Matching Models with Weak Supervision for Response Selection in Retrieval-based Chatbots

Learning Matching Models with Weak Supervision for Response Selection in Retrieval-based Chatbots Wei Wu Yu Wu Microsoft Corporation SKLSDE, Beihang University wuwei@microsoft.com wuyu@buaa.edu.cn Zhoujun Li Ming Zhou SKLSDE, Beihang

301 views • 17 slides

Object Detection in Snorkel Michael Chi Ian Tang 1 Snorkel 2 Data Programming Labelling

R244 Object Detection in Snorkel Michael Chi Ian Tang 1 Snorkel 2 Data Programming Labelling functions Express knowledge as labelling functions Can have unknown accuracies and correlations Assign a class label or abstain 3

470 views • 16 slides

Zero-Shot Learning for Word Translation: Successes and Failures Ndapa Nakashole, University of

Zero-Shot Learning for Word Translation: Successes and Failures Ndapa Nakashole, University of California, San Diego 05 June 2018 Outline Introduction Successes Limitations 2 Zero-shot learning Zero-shot learning: ) at test

881 views • 49 slides

Co-Representation Network for Generalized Zero-Shot Learning Fei Zhang, Guangming Shi XIDIAN

Co-Representation Network for Generalized Zero-Shot Learning Fei Zhang, Guangming Shi XIDIAN UNIVERSITY ICML 2019 In Intr troduct oduction ion Classic Deep CNN Data requirements decrease Predict Transfer Learning Few-Shot

456 views • 11 slides

Siamese Network & Matching Network for one-shot learning Reference Papers Siamese Neural

Reading Group 2016.11.22 Siamese Network & Matching Network for one-shot learning Reference Papers Siamese Neural Networks for One-Shot Image Recognition (Gregory Koch, Ruslan Salakhutdinov) Matching Network for One-shot Learning (Oriol

802 views • 16 slides

Infinite Mixture Prototypes for Few-Shot Learning Adaptively inferring model capacity for simple

Infinite Mixture Prototypes for Few-Shot Learning Adaptively inferring model capacity for simple and complex tasks Kelsey Allen, Evan Shelhamer*, Hanul Shin*, Josh Tenenbaum Few-Shot Learning by Deep Metric Learning Given few instances of a few

369 views • 12 slides

Visual Parsing with Weak Supervision Jia Xu Department of Computer Sciences University of

Visual Parsing with Weak Supervision Jia Xu Department of Computer Sciences University of Wisconsin-Madison 2015-07-30 Introduction Object Segmentation Scene Parsing Video Parsing Discussion Research Goal Teach Computer to See at/beyond

1.13k views • 100 slides

Representing and Explaining Novel Concepts with Minimal Supervision Dr. Zeynep Akata 2 April

Representing and Explaining Novel Concepts with Minimal Supervision Dr. Zeynep Akata 2 April 2019 1 Outline Motivating the Importance of Side Information (Generalized) Zero-Shot Learning with Side Information Deeply Explainable Artificial

884 views • 76 slides

APPLYING WEAK SUPERVISION TO MOBILE SENSOR DATA: EXPERIENCES WITH TRANSPORT MODE DETECTION

APPLYING WEAK SUPERVISION TO MOBILE SENSOR DATA: EXPERIENCES WITH TRANSPORT MODE DETECTION JONATHAN FRST 1 , MAURICIO FADEL ARGERICH 1 , KALYANARAMAN SHANKARI 2 , GRKAN SOLMAZ 1 , BIN CHENG 1 JONATHAN.FUERST@NECLAB.EU,

294 views • 13 slides

Supervision Strengthening Our Practice The plan Supervision what is it? Benefits

Mhuri Ttara Supervision Strengthening Our Practice The plan Supervision what is it? Benefits of supervision What can go wrong? Supervision in Action strengths based supervision Life is too short to make all

787 views • 27 slides

Natural language processing and weak supervision L eon Bottou COS 424 4/27/2010

Natural language processing and weak supervision L eon Bottou COS 424 4/27/2010 Introduction Natural language processing from scratch Natural language processing systems are heavily engineered. How much engineering can we

819 views • 43 slides

Laplacian Regularized Few Shot Learning (LaplacianShot) Imtiaz Masud Ziko, Jose Dolz, Eric

Laplacian Regularized Few Shot Learning (LaplacianShot) Imtiaz Masud Ziko, Jose Dolz, Eric Granger and Ismail Ben Ayed ETS Montreal 1 Overview Few-Shot Proposed Experiments Learning LaplacianShot - Experimental Setup - What and Why ?

1.22k views • 55 slides

Meta-transfer Learning for Few-shot Learning Yaoyao Liu Tianjin University and NUS School of

NUS-Tsinghua-Southampton Centre for Extreme Search Meta-transfer Learning for Few-shot Learning Yaoyao Liu Tianjin University and NUS School of Computing OUTLINE Research Background Methods Meta-transfer Learning Hard-task

455 views • 33 slides

Non-Parametric Few-Shot Learning CS 330 1 Logistics Homework 1 due tonight, Homework 2 out soon

Non-Parametric Few-Shot Learning CS 330 1 Logistics Homework 1 due tonight, Homework 2 out soon Fill out project group form if you havent already. Project suggestions & project spreadsheet posted 2 Plan for Today Non-Parametric Few-Shot

676 views • 34 slides

CS839 Special Topics in AI: Deep Learning Learning with Less Supervision Sharon Yixuan Li

CS839 Special Topics in AI: Deep Learning Learning with Less Supervision Sharon Yixuan Li University of Wisconsin-Madison October 29, 2020 Overview Weakly Supervised Learning Flickr100M JFT300M (Google) Instagram3B (Facebook)

714 views • 60 slides

Foundations of Machine Learning Boosting Weak Learning (Kearns and Valiant, 1994) Definition:

Foundations of Machine Learning Boosting Weak Learning (Kearns and Valiant, 1994) Definition: concept class is weakly PAC-learnable C if there exists a (weak) learning algorithm and L > 0 such that: for all , for all

527 views • 41 slides