Active Online Domain Adaptation Yining Chen (Stanford) , Haipeng Luo - PowerPoint PPT Presentation

Jan 01, 2024 •302 likes •390 views

Active Online Domain Adaptation Yining Chen (Stanford) , Haipeng Luo (USC), Tengyu Ma (Stanford), Chicheng Zhang (University of Arizona) Domain shift: challenge for ML system Time Online learning: a classical framework for domain shift At

Active Online Domain Adaptation Yining Chen (Stanford) , Haipeng Luo (USC), Tengyu Ma (Stanford), Chicheng Zhang (University of Arizona)
Domain shift: challenge for ML system Time
Online learning: a classical framework for domain shift • At timestep t = 1, …, T: • Input is revealed. • Learner predicts , suffers some loss. • Label is revealed. Expensive! -> This work: active online learning Learner can decide whether to query the label.
Active online regression: Setup • Hypothesis class • Realizable setting: • At timestep t = 1, …, T: is revealed. • • Learner predicts , suffers loss . • Learner decides whether to query . • Metrics: (1) # queries (2) Regret • Goal: Minimize R subject to .
Linear regression • Hypothesis class: • Prediction strategy: • Follow the regularized leader on all queried examples till t-1: • What’s the query strategy? • Uniformly random queries are optimal without domain structure.
Can we do better if the data is structured? • Domain structure: D 1 D 2 D 1 D 2 D 3 domains • • Domain : support dimension , duration
Main contribution: optimal tradeoff with unk unkno nown wn domain structure • QuFUR (Query in the Face of Uncertainty for Regression): • Query uncertain examples • Linear Regression: For any domain partition, with high probability: • Matching lower bound. • Generalize to general hypothesis classes w/ bounded Eluder Dimension.

Recommend

What is domain adaptation?

A Two-Stage Approach to Domain Adaptation for Statistical Classifiers Jing Jiang & ChengXiang Zhai Department of Computer Science University of Illinois at Urbana-Champaign What is domain adaptation?

523 views • 20 slides

Combining Active Learning and Partial Annotation for Domain Adaptation of a Japanese Dependency

Combining Active Learning and Partial Annotation for Domain Adaptation of a Japanese Dependency Parser Daniel FLANNERY 1 Shinsuke MORI 2 1 Vitei Inc. (work at Kyoto University) 2 Kyoto University IWPT 2015, July 22nd 1 / 29 IWPT95 at Prague

571 views • 29 slides

discrepancy for unsupervised domain adaptation Hongliang Yan 2017/06/21 Domain Adaptation DA

Mind the class weight bias: weighted maximum mean discrepancy for unsupervised domain adaptation Hongliang Yan 2017/06/21 Domain Adaptation DA Training Test Problem: (Source (Target) Training and test sets are related but under

495 views • 21 slides

Domain Adaptation with Asymmetrically Relaxed Distribution Alignment Yifan Wu , Ezra Winston,

Domain Adaptation with Asymmetrically Relaxed Distribution Alignment Yifan Wu , Ezra Winston, Divyansh Kaushik, Zachary Lipton Carnegie Mellon University ICML 2019 1 / 8 Background - Unsupervised Domain Adaptation Unsupervised Domain

332 views • 8 slides

Implicit Class-Conditioned Domain Alignment for Unsupervised Domain Adaptation 1,2 1,4 Xiang

Implicit Class-Conditioned Domain Alignment for Unsupervised Domain Adaptation 1,2 1,4 Xiang Jiang Qicheng Lao 1,3 1 Stan Matwin Mohammad Havaei 1 Imagia 2 Dalhousie University 3 Polish Academy of Sciences 4 Mila, Universit e de Montr

1.02k views • 43 slides

Towards Assumption-free Unsupervised Domain Adaptation for Visual recognition

Towards Assumption-free Unsupervised Domain Adaptation for Visual recognition Outline Background and Motivations Unsupervised Domain Adaptation - Estimating label information in

1.51k views • 47 slides

Instance Weighting for Domain Adaptation in NLP Jing Jiang & ChengXiang Zhai University of

Instance Weighting for Domain Adaptation in NLP Jing Jiang & ChengXiang Zhai University of Illinois at Urbana-Champaign June 25, 2007 Domain Adaptation Many NLP tasks are cast into classification

582 views • 20 slides

Domain adaptation model for retinopathy detection from cross-domain OCT images Jing Wang 1;2 ,

Domain adaptation model for retinopathy detection from cross-domain OCT images Jing Wang 1;2 , Yiwei Chen 2 , Wanyue Li1; 2 , Wen Kong 1;2 , Yi He 2 , Chuihui Jiang *3 , Guohua Shi *2;4 1 University of Science and technology of China, Hefei 230026,

348 views • 9 slides

Adaptation Philipp Koehn 27 October 2020 Philipp Koehn Machine Translation: Adaptation 27

Adaptation Philipp Koehn 27 October 2020 Philipp Koehn Machine Translation: Adaptation 27 October 2020 Adaptation 1 Better quality when system is adapted to a task Domain adaptation to a specific domain, e.g., information technology

962 views • 46 slides

Few-shot Domain Adaptation 1/12 by Causal Mechanism Transfer Domain adaptation Causal mechanism

Few-shot Domain Adaptation 1/12 by Causal Mechanism Transfer Domain adaptation Causal mechanism Q. When is it possible? A. Common causal Transfer assumption (TA)? mechanism as the relation. Summary Common data generating (causal) mechanism

1.03k views • 15 slides

Theoretical Analysis of Domain Adaptation Current state of the art Shai Ben-David September 14,

Theoretical Analysis of Domain Adaptation Current state of the art Shai Ben-David September 14, 2012 Domain Adaptation Most of the statistical learning guarantees are based on assuming that the learning environment is unchanged throughout the

685 views • 64 slides

Lightweight Unsupervised Domain Adaptation by Convolutional Filter Reconstruction Rahaf Aljundi,

Lightweight Unsupervised Domain Adaptation by Convolutional Filter Reconstruction Rahaf Aljundi, Tinne Tuytelaars Unsupervised Domain Adaptation When you expect the test data (Target) to be different from your training data (Source) DA in the

683 views • 39 slides

Unsupervised Clustering Approaches for Domain Adaptation in Speaker Recognition Systems Stephen

Unsupervised Clustering Approaches for Domain Adaptation in Speaker Recognition Systems Stephen H. Shum Douglas A. Reynolds Daniel Garcia-Romero Alan McCree Unsupervised Clustering Approaches for Domain Adaptation in Speaker Recognition

437 views • 25 slides

Getting Online Getting Online Domain Names Email Google My Business Listing

Getting Online Getting Online Domain Names Email Google My Business Listing Websites Selling Online Why do you need to be online? People are searching for you online. The majority of people research and engage with

507 views • 28 slides

for Domain Adaptation in Chest X-ray Classification Matthias Lenga, Heinrich Schulz, Axel

MIDL 2020 Continual Learning for Domain Adaptation in Chest X-ray Classification Matthias Lenga, Heinrich Schulz, Axel Saalbach Philips Research Hamburg arxiv.org/abs/2001.05922 Domain shift in CXR classification For Chest X-ray

445 views • 7 slides

Unsupervised Domain Adaptation Based on Source-guided Discrepancy 23 th Sep. Han Bao (The

Unsupervised Domain Adaptation Based on Source-guided Discrepancy 23 th Sep. Han Bao (The University of Tokyo / RIKEN AIP) Research interests 2 Classification from Pairwise Similarity and Unlabeled Data [BNS18] (ICML2018) Weak

919 views • 30 slides

Transfer learning/Domain adaptation: Methods and

Transfer learning/Domain adaptation: Methods and Application Lei Zhang ( ) Website:

1.19k views • 104 slides

Unsupervised Domain Adaptation by Backpropagation Chih-Hui Ho, Xingyu Gu, Yuan Qi Outline

Unsupervised Domain Adaptation by Backpropagation Chih-Hui Ho, Xingyu Gu, Yuan Qi Outline Introduction Related works Proposed solution Experiments Conclusions Problems Deep network : requires massive labeled

457 views • 35 slides

Domain adaptation with optimal transport from mapping to learning with joint distribution R.

Domain adaptation with optimal transport from mapping to learning with joint distribution R. Flamary - Lagrange, OCA, CNRS, Universit e C ote dAzur Joint work with N. Courty, A. Habrard, A. Rakotomamonjy and B. Bushan Damodoran Data

618 views • 51 slides

Action Segmentation with Jo Join int Self-Superv rvised Temporal Domain Adaptation Min-Hung

ghassanalregib.info/ Action Segmentation with Jo Join int Self-Superv rvised Temporal Domain Adaptation Min-Hung Chen 1 Baopu Li 2 Yingze Bao 2 Ghassan AlRegib 1 Zsolt Kira 1 1 Georgia Institute of Technology 2 Baidu USA June 17, 2020

416 views • 13 slides

Two Methods for Domain Adaptation of Bilingual Tasks: Delightfully Simple and Broadly Applicable

Two Methods for Domain Adaptation of Bilingual Tasks: Delightfully Simple and Broadly Applicable Viktor Hangya 1 , Fabienne Braune 1 , 2 , Alexander Fraser 1 , Hinrich utze 1 Sch 1 Center for Information and Language Processing LMU Munich,

791 views • 30 slides

Dictionaries, Manifolds and Domain Adaptation for Image and Video- based Recognition Rama

Dictionaries, Manifolds and Domain Adaptation for Image and Video- based Recognition Rama Chellappa University of Maryland Student and the teachers Major points Training and testing data come from different distributions.

780 views • 53 slides

Robust Causal Domain Adaptation in a Simple Diagnostic Setting Thijs van Ommen Ghent, July 4,

Robust Causal Domain Adaptation in a Simple Diagnostic Setting Thijs van Ommen Ghent, July 4, 2019 Thijs van Ommen (UU) Robust Causal Domain Adaptation July 4, 2019 1 / 8 Background Thijs van Ommen (UU) Robust Causal Domain Adaptation

551 views • 18 slides

Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation Min-Hung Chen 1 Baopu

Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation Min-Hung Chen 1 Baopu Li 2 Yingze Bao 2 Ghassan AlRegib 1 Zsolt Kira 1 1 Georgia Institute of Technology 2 Baidu USA Abstract Source Video Inputs Target Labels

136 views • 10 slides