Characterizing Uncertainty in Decision Trees through Imprecise - PowerPoint PPT Presentation

Mar 11, 2023 •155 likes •234 views

Characterizing Uncertainty in Decision Trees through Imprecise Splitting Rules ISIPTA 2019 Malte Nalenz & Thomas Augustin July 6, 2019 Malte Nalenz & Thomas Augustin Characterizing Uncertainty in Decision Trees through Imprecise

Characterizing Uncertainty in Decision Trees through Imprecise Splitting Rules ISIPTA 2019 Malte Nalenz & Thomas Augustin July 6, 2019 Malte Nalenz & Thomas Augustin Characterizing Uncertainty in Decision Trees through Imprecise Splitting Rules July 6, 2019 1 / 5
2 1 0 x2 −1 −2 −3 −2 −1 0 1 2 x1 Malte Nalenz & Thomas Augustin Characterizing Uncertainty in Decision Trees through Imprecise Splitting Rules July 6, 2019 2 / 5
2 1 0 x2 −1 −2 −3 −2 −1 0 1 2 x1 Oberservations close to the decision boundarie(s) more uncertain, as small perturbations lead to different prediction Malte Nalenz & Thomas Augustin Characterizing Uncertainty in Decision Trees through Imprecise Splitting Rules July 6, 2019 2 / 5
Instead of using a single splitpoint x ≤ t 0 we propose to consider a neighbourhood: T = { t − k = x − k , · · · , t 0 , · · · , t k = x k } , where t 0 is the candidate split and t k and t − k the k’th datapoints with higher and lower ordered covariate values as reasonable alternative splitting values. Malte Nalenz & Thomas Augustin Characterizing Uncertainty in Decision Trees through Imprecise Splitting Rules July 6, 2019 3 / 5
3 2 1 x2 0 -1 -2 -2 -1 0 1 2 3 x1 Malte Nalenz & Thomas Augustin Characterizing Uncertainty in Decision Trees through Imprecise Splitting Rules July 6, 2019 4 / 5

Recommend

Decision Trees (Ch. 18.1-18.3) Learning We will (finally) move away from uncertainty (for a

Decision Trees (Ch. 18.1-18.3) Learning We will (finally) move away from uncertainty (for a bit) and instead focus on learning Learning algorithms benefit from flexibility to solver a wide range of problems, especially: (1) Cannot explicitly

647 views • 40 slides

Decision Trees Lecture 22 To left or to right 1 Decision Trees 2 Decision Trees A different

Decision Trees Lecture 22 To left or to right 1 Decision Trees 2 Decision Trees A different complexity measure 2 Decision Trees A different complexity measure Number of bits of input read 2 Decision Trees A different complexity measure

1.62k views • 107 slides

Decision Trees Lecture 23 To left or to right 1 Decision Trees 2 Decision Trees A different

Decision Trees Lecture 23 To left or to right 1 Decision Trees 2 Decision Trees A different complexity measure 2 Decision Trees A different complexity measure Number of bits of input read 2 Decision Trees A different complexity measure

1.3k views • 107 slides

Lecture 23: Decision Trees Decision trees Prof. Julia Hockenmaier

CS440/ECE448: Intro to Artificial Intelligence Lecture 23: Decision Trees Decision trees Prof. Julia Hockenmaier juliahmr@illinois.edu http://cs.illinois.edu/fa11/cs440 Decision trees Decision tree

338 views • 7 slides

Decision Making Under Uncertainty Making Decisions Under Uncertainty AI C LASS 10 (C H .

Todays Class Decision Making Under Uncertainty Making Decisions Under Uncertainty AI C LASS 10 (C H . 15.1-15.2.1, 16.1-16.3) Tracking Uncertainty over Time Decision Making under Uncertainty sensors Decision Theory ?

229 views • 8 slides

Decision Tree R Greiner Cmput 466 / 551 Learning Decision Trees Def'n: Decision Trees

HTF: 9.2 B: 14.4 R N , C h a p t e r 1 8 1 8 . 3 Decision Tree R Greiner Cmput 466 / 551 Learning Decision Trees Def'n: Decision Trees Algorithm for Learning Decision Trees Entropy, Inductive Bias (Occam's

1.43k views • 87 slides

1 Baysian networks for decision analysis The TV show problem as a BN Problems More than

Several names Decision graphs Decision trees Influence diagrams Decision graphs I A certain kind of strictly symmetric decision trees Decisions and utilities No forgetting assumption LIMIDs Limited Memory

596 views • 6 slides

1 Baysian networks for decision analysis The TV show problem as a BN Problems Choice 1

185 views • 6 slides

Learning Decision Trees Representation is a decision tree. Bias is towards simple decision

Learning Decision Trees Representation is a decision tree. Bias is towards simple decision trees. Search through the space of decision trees, from simple decision trees to more complex ones. Decision trees A decision tree is

484 views • 10 slides

Decision Tree Decision Trees A decision tree is a decision support tool that uses a tree-like

Decision Tree Decision Trees A decision tree is a decision support tool that uses a tree-like graph or model of decisions and their possible MSE 2400 EaLiCaRA consequences, including chance event Dr. Tom Way outcomes, resource costs, and

568 views • 8 slides

Tree Computation for Ranking and Classification CS240A, T. Yang, 2016 Outlines Decision Trees

Tree Computation for Ranking and Classification CS240A, T. Yang, 2016 Outlines Decision Trees Learning Assembles: Random forest, boosted trees Decision Trees Decision trees can express any function of the input attributes.

452 views • 31 slides

Decision Making Privacy-Motivated . . . under Uncertainty: Uncertainty Leads to . . .

Quantitative . . . The Notion of Utility Traditional Approach: . . . Need for Distributed . . . Decision Making Privacy-Motivated . . . under Uncertainty: Uncertainty Leads to . . . Uncertainty in . . . Algorithmic Approach Uncertainty in

668 views • 62 slides

15-388/688 - Practical Data Science: Decision trees and interpretable models J. Zico Kolter

15-388/688 - Practical Data Science: Decision trees and interpretable models J. Zico Kolter Carnegie Mellon University Spring 2018 1 Outline Decision trees Training (classification) decision trees Interpreting predictions Boosting

381 views • 37 slides

Machine Learning III: Beyond Decision Trees Extensions to Decision Trees AI Class 15 (Ch.

Todays Class Machine Learning III: Beyond Decision Trees Extensions to Decision Trees AI Class 15 (Ch. 20.120.2) Sources of error Evaluating learned models B E Bayesian Learning E [1] B [1] A [1] C [1]

137 views • 3 slides

Medical Decision Making Learning: Decision Trees Artificial Intelligence CSPP 56553 February

Medical Decision Making Learning: Decision Trees Artificial Intelligence CSPP 56553 February 11, 2004 Agenda Decision Trees: Motivation: Medical Experts: Mycin Basic characteristics Sunburn example From trees to rules

578 views • 28 slides

Decision Trees 2-26-16 Reading Quiz Decision trees are an algorithm for which machine learning

Decision Trees 2-26-16 Reading Quiz Decision trees are an algorithm for which machine learning task? a) clustering b) dimensionality reduction c) classification d) regression Reading Quiz Which error metric is most appropriate for

483 views • 14 slides

Machine Learning and Data Mining Decision Trees Kalev Kask Decision trees Functional form

+ Machine Learning and Data Mining Decision Trees Kalev Kask Decision trees Functional form f(x; ): nested if -then- else statements Discrete features: fully expressive (any function) Structure: Internal nodes: check

303 views • 27 slides

Wrap Up! Lecture 25 Decision Trees & Branching Programs Many Topics Not Covered! Decision

Wrap Up! Lecture 25 Decision Trees & Branching Programs Many Topics Not Covered! Decision Trees Another model of non-uniform computation A full binary tree with each internal Q 0 node labelled with an elementary boolean function of

490 views • 19 slides

Characterizing uncertainty of the exposure point concentration based on left-censored data

1 Characterizing uncertainty of the exposure point concentration based on left-censored data Niloofar Shoari PhD candidate Jean-Sbastien Dub, Ph.D Department of Construction Engineering 27 April 2016 Montreal, Canada 2 What are

767 views • 18 slides

IAML: Decision Trees Chris Williams and Victor Lavrenko School of Informatics Semester 1 1 / 17

IAML: Decision Trees Chris Williams and Victor Lavrenko School of Informatics Semester 1 1 / 17 Outline Decision trees: the idea Examples Top-down induction of decision trees Entropy Information gain Overfitting and

205 views • 17 slides

CSC 411 Lecture 3: Decision Trees Roger Grosse, Amir-massoud Farahmand, and Juan Carrasquilla

CSC 411 Lecture 3: Decision Trees Roger Grosse, Amir-massoud Farahmand, and Juan Carrasquilla University of Toronto UofT CSC 411: 03-Decision Trees 1 / 33 Today Decision Trees Simple but powerful learning algorithm One of the most

1.09k views • 33 slides

Dynamic Bayesian Networks and Hidden Markov Models Decision Trees Marco Chiarandini Deptartment

Lecture 11 Dynamic Bayesian Networks and Hidden Markov Models Decision Trees Marco Chiarandini Deptartment of Mathematics & Computer Science University of Southern Denmark Slides by Stuart Russell and Peter Norvig Exercise Uncertainty

2.18k views • 85 slides

Optimal Sparse Decision Trees Xiyang Hu Cynthia Rudin Margo Seltzer Carnegie Mellon Duke

Optimal Sparse Decision Trees Xiyang Hu Cynthia Rudin Margo Seltzer Carnegie Mellon Duke University University of British University Columbia Decision Trees Decision Trees Decision Trees Should I click on the link in this email? Do I

589 views • 35 slides

Decision Trees Thomas Schwarz, SJ Decision Trees One of many machine learning methods

Decision Trees Thomas Schwarz, SJ Decision Trees One of many machine learning methods Used to learn categories Example: The Iris Data Set Four measurements of flowers Learn how to predict species from measurement Iris Data

405 views • 40 slides