active learning for decision making
play

Active Learning for Decision-Making from Imbalanced Observational - PowerPoint PPT Presentation

Feb 10, 2024 •457 likes •527 views

Active Learning for Decision-Making from Imbalanced Observational Data 11.06.2019 Iiris Sundin 1 , Peter Schulam 2 , Eero Siivola 1 , Aki Vehtari 1 , Suchi Saria 2 , Samuel Kaski 1 1. Department of Computer Science, Aalto University, Helsinki,

  1. Active Learning for Decision-Making from Imbalanced Observational Data 11.06.2019 Iiris Sundin 1 , Peter Schulam 2 , Eero Siivola 1 , Aki Vehtari 1 , Suchi Saria 2 , Samuel Kaski 1 1. Department of Computer Science, Aalto University, Helsinki, Finland 2. Department of Computer Science, Johns Hopkins University, Baltimore, USA Poster #239

  2. Problem and setup • Decision-making task: Choose treatment to a new, previously unseen unit ෤ 𝑦 • Learn individual treatment effect 𝜐 = 𝔽[𝑧 1 − 𝑧 0 ∣ 𝑦] Treated • Imbalance Control (=not treated) • Different covariate distributions in treated and control groups 𝑞(𝜐 ∣ 𝑦, 𝐸) • Causes uncertainty to Ƹ 𝑦 11.6.2019 Poster #239 2

  3. Decision-making performance • Type S error rate • Probability that the model infers the sign of the treatment effect wrong True treatment effects Effect Estimated treatment effects correct decision wrong decision 0 Type S error 11.6.2019 Poster #239 3

  4. Contributions • Conditions when imbalance increases Type S error rate • Estimate for Type S error rate • Active learning to minimize estimated Type S error rate Semi-synthetic medical data * Decision-making aware (this work) Expected targeted information gain Expected information gain Uncertainty sampling * Infant Health and Development Program (IHDP) data (Hill 2011). 11.6.2019 Poster #239 4

  5. Summary • Imbalance impairs decision-making performance • Type S error rate • A natural measure for decision-making performance • Bayesian estimate of Type S error rate • Active learning that targets the Type S error rate the most effective in improving decisions • Code available at https://github.com/IirisSundin/active-learning-for-decision-making Poster #239 Twitter: @iirisSun

Recommend

Active Learning Passive Learning Active Learning 1. Think 1. Acquisition of knowledge Ability

Active Learning Passive Learning Active Learning 1. Think 1. Acquisition of knowledge Ability

Active Learning Passive Learning Active Learning 1. Think 1. Acquisition of knowledge Ability 2. Decision making 2. Application of knowledge 3. Explain/communicate 1. Deep learning Approach to Uni-directional 2. Interactive Learning

282 views • 5 slides
Course outline Online decision making 1. Statistical active learning 2. Combinatorial

Course outline Online decision making 1. Statistical active learning 2. Combinatorial

Active Learning and Optimized Information Gathering Lecture 3 Reinforcement Learning CS 101.2 Andreas Krause Announcements Homework 1: out tomorrow Due Thu Jan 22 Project Proposal due Tue Jan 27 (start soon!) Office hours Come to

573 views • 23 slides
Background & Prerequisites Basic probability and statistics Algorithms Helpful but not

Background & Prerequisites Basic probability and statistics Algorithms Helpful but not

Active Learning and Optimized Information Gathering Lecture 1 Introduction CS 101.2 Andreas Krause Overview Research-oriented special topics course 3 main topics Sequential decision making / bandit problems Statistical active learning

413 views • 26 slides
Steve Kroon PLEASED: Planning, Learning, and Search for Decision-making.

Steve Kroon PLEASED: Planning, Learning, and Search for Decision-making.

Steve Kroon PLEASED: Planning, Learning, and Search for Decision-making. http://www.cs.sun.ac.za/~kroon/decision.html Maties Machine Learning: 25 October 2019 This group considers almost any aspect of the general decision-making problem,

716 views • 12 slides
DECISION MAKING readysetpresent.com Decision Making Program Objectives ( 1 of 2 ) To examine

DECISION MAKING readysetpresent.com Decision Making Program Objectives ( 1 of 2 ) To examine

DECISION MAKING readysetpresent.com Decision Making Program Objectives ( 1 of 2 ) To examine different decision making models. To maximize creativity and logic in decision making. To acquire decision making tips and techniques that

2.35k views • 175 slides
MI MI and Shared MI MI and Shared and Shared Decision Making and Shared Decision Making

MI MI and Shared MI MI and Shared and Shared Decision Making and Shared Decision Making

The project PRECIOUS has received funding from the European Union s Seventh Framework Programme under Grant Agreement n 611366" MI MI and Shared MI MI and Shared and Shared Decision Making and Shared Decision Making Decision Making

412 views • 20 slides
Decision Making 1 Decision Making Skills Establishing a positive decision-making environment.

Decision Making 1 Decision Making Skills Establishing a positive decision-making environment.

Decision Making 1 Decision Making Skills Establishing a positive decision-making environment. Generating potential solutions. Evaluating the solutions. Deciding. How did you score? Checking the decision. Communicating and

938 views • 50 slides
Module 2 Probability Theory CS 886 Sequential Decision Making and Reinforcement Learning

Module 2 Probability Theory CS 886 Sequential Decision Making and Reinforcement Learning

Module 2 Probability Theory CS 886 Sequential Decision Making and Reinforcement Learning University of Waterloo 1 CS886 (c) 2013 Pascal Poupart A Decision Making Scenario You are considering to buy a used car Is it in good

784 views • 41 slides
Module 4 Markov Processes CS 886 Sequential Decision Making and Reinforcement Learning

Module 4 Markov Processes CS 886 Sequential Decision Making and Reinforcement Learning

Module 4 Markov Processes CS 886 Sequential Decision Making and Reinforcement Learning University of Waterloo Sequential Decision Making In general: exponentially large decision tree s1 a b . 9 . 1 . 2 . 8 s2 s3 s12 s13 a b a b

364 views • 12 slides
Overview of Robot Decision Making Prof. Yuke Zhu Fall 2020 CS391R: Robot Learning (Fall 2020) 1

Overview of Robot Decision Making Prof. Yuke Zhu Fall 2020 CS391R: Robot Learning (Fall 2020) 1

Overview of Robot Decision Making Prof. Yuke Zhu Fall 2020 CS391R: Robot Learning (Fall 2020) 1 Todays Agenda What is Robot Decision Making? Mathematical Framework of Sequential Decision Making Learning for Decision Making

382 views • 35 slides
Module 6 Value Iteration CS 886 Sequential Decision Making and Reinforcement Learning

Module 6 Value Iteration CS 886 Sequential Decision Making and Reinforcement Learning

Module 6 Value Iteration CS 886 Sequential Decision Making and Reinforcement Learning University of Waterloo Markov Decision Process Definition Set of states: Set of actions (i.e., decisions): Transition model: Pr

423 views • 21 slides
Module 3 Utility Theory CS 886 Sequential Decision Making and Reinforcement Learning University

Module 3 Utility Theory CS 886 Sequential Decision Making and Reinforcement Learning University

Module 3 Utility Theory CS 886 Sequential Decision Making and Reinforcement Learning University of Waterloo 1 CS886 (c) 2013 Pascal Poupart Decision Making under Uncertainty I give planning problem to robot: I want coffee but coffee

477 views • 30 slides
Module 11 Introduction to Reinforcement Learning CS 886 Sequential Decision Making and

Module 11 Introduction to Reinforcement Learning CS 886 Sequential Decision Making and

Module 11 Introduction to Reinforcement Learning CS 886 Sequential Decision Making and Reinforcement Learning University of Waterloo Machine Learning Supervised Learning Teacher tells learner what to remember Reinforcement Learning

401 views • 29 slides
$ Lesson One Making Decisions 04/09 the decision-making process The decision-making process

$ Lesson One Making Decisions 04/09 the decision-making process The decision-making process

Presentation Slides $ Lesson One Making Decisions 04/09 the decision-making process The decision-making process Identify the problem Gather information and list possible alternatives Consider consequences of each

314 views • 7 slides
6 Decision- -Making Making MVC (revisited) 6 Decision MVC (revisited) decision

6 Decision- -Making Making MVC (revisited) 6 Decision MVC (revisited) decision

6 Decision- -Making Making MVC (revisited) 6 Decision MVC (revisited) decision decision - - m m a a king and games king and games model state instance core structures levels of decision levels of decision- -making

148 views • 4 slides
Medical Decision Making Learning: Decision Trees Artificial Intelligence CSPP 56553 February

Medical Decision Making Learning: Decision Trees Artificial Intelligence CSPP 56553 February

Medical Decision Making Learning: Decision Trees Artificial Intelligence CSPP 56553 February 11, 2004 Agenda Decision Trees: Motivation: Medical Experts: Mycin Basic characteristics Sunburn example From trees to rules

578 views • 28 slides
S C DECISION E N C E decision science SDS CMU What is Decision Science? Behavioral

S C DECISION E N C E decision science SDS CMU What is Decision Science? Behavioral

S C DECISION E N C E decision science SDS CMU What is Decision Science? Behavioral and analytical approaches to understanding decision making Understand and improve human decision making Based in Psychology + integrates

571 views • 10 slides
Defensible Decision Making Susan Moore - Learning and Development Manager Leicester City Council

Defensible Decision Making Susan Moore - Learning and Development Manager Leicester City Council

Defensible Decision Making Susan Moore - Learning and Development Manager Leicester City Council Helen Pearson Partnership/Board Officer Leicestershire and Rutland SCP/SAB Case Reviews and Audits Look for defensible decision making

411 views • 9 slides
Agenda Intro to Active Learning Activity Design Resources for Active Learning Lunch with Active

Agenda Intro to Active Learning Activity Design Resources for Active Learning Lunch with Active

Agenda Intro to Active Learning Activity Design Resources for Active Learning Lunch with Active Learning Veterans Wrap Up Introduction to Active Learning What is active learning? Brainstorm your ideas with your group and generate a

855 views • 42 slides
Multi-Task Active Learning Yi Zhang Outline Active Learning Multi-Task Active Learning

Multi-Task Active Learning Yi Zhang Outline Active Learning Multi-Task Active Learning

Multi-Task Active Learning Yi Zhang Outline Active Learning Multi-Task Active Learning Linguistic Annotations (ACL 08) Image Classification (CVPR 08) Current Work and Discussions Constraint-Driven Active Learning

945 views • 47 slides
Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend

Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend

IE 545, Human Factors Engineering Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend Remember Observe Think Act calculate decide solve develop alternatives choose alternative responses stimuli

751 views • 29 slides
Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend

Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend

IE 545, Human Factors Engineering Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend Remember Observe Think Act calculate decide solve develop alternatives choose alternative responses stimuli

526 views • 30 slides
Sequential Decision Making AIMA Chapters: 17.1, 17.2, 17.3. Sutton and Barto, Reinforcement

Sequential Decision Making AIMA Chapters: 17.1, 17.2, 17.3. Sutton and Barto, Reinforcement

Sequential Decision Making Sequential Decision Making AIMA Chapters: 17.1, 17.2, 17.3. Sutton and Barto, Reinforcement Learning: an Introduction, 2nd Edition: Chapters 3 and 4 Outline Sequential Decision Making Sequential decision

690 views • 41 slides
Combining Crowd and Expert Labels using Decision Theoretic Active Learning An T. Nguyen 1 Byron

Combining Crowd and Expert Labels using Decision Theoretic Active Learning An T. Nguyen 1 Byron

Combining Crowd and Expert Labels using Decision Theoretic Active Learning An T. Nguyen 1 Byron C. Wallace Matthew Lease University of Texas at Austin HCOMP, 2015 1 Presenter The Problem: Label Collection Have some unlabeled data. Want

679 views • 46 slides

More recommend