Introduction to Machine Learning Classification and Regression Trees - PowerPoint PPT Presentation

Oct 12, 2023 •338 likes •415 views

Introduction to Machine Learning Classification and Regression Trees (CART): Basics compstat-lmu.github.io/lecture_i2ml TREE MODEL AND PREDICTION Classification and Regression Trees, introduced by Breiman Binary splits are constructed top-down

Introduction to Machine Learning Classification and Regression Trees (CART): Basics compstat-lmu.github.io/lecture_i2ml
TREE MODEL AND PREDICTION Classification and Regression Trees, introduced by Breiman Binary splits are constructed top-down Constant prediction in each terminal node (leaf): either a numerical value, a class label or a probability vector over class labels. � c Introduction to Machine Learning – 1 / 5
TREE MODEL AND PREDICTION For predictions, observations are passed down the tree, according to the splitting rules in each node An observation will end up in exactly one leaf node All observations in a leaf node are assigned the same prediction for the target � c Introduction to Machine Learning – 2 / 5
TREE MODEL AND PREDICTION For predictions, observations are passed down the tree, according to the splitting rules in each node An observation will end up in exactly one leaf node All observations in a leaf node are assigned the same prediction for the target -1.20 -0.42 0.98 -0.20 -0.01 � c Introduction to Machine Learning – 3 / 5
TREES AS AN ADDITIVE MODEL Each point in X is assigned to exactly one leaf, and each leaf has a set of input points leading to it, through axis-parallel splits. Hence, trees divide the feature space X into rectangular regions : M � f ( x ) = c m I ( x ∈ Q m ) , m = 1 where a tree with M leaf nodes defines M “rectangles” Q m . c m is the predicted numerical response, class label or class distribution in the respective leaf node. Iris Data 2.5 Species 2.0 Petal.Width ● setosa 1.5 versicolor 1.0 virginica ● 0.5 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0.0 2 4 6 Petal.Length � c Introduction to Machine Learning – 4 / 5
TREES The hypothesis space of a CART is the set of all step functions over rectangular partitions of X : M � f ( x ) = c m I ( x ∈ Q m ) , m = 1 Classification: Regression: Iris Data 2.5 -1.20 -0.42 0.98 -0.20 -0.01 2.0 Species Petal.Width 1.5 ● setosa versicolor 1.0 virginica ● 0.5 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0.0 2 4 6 Petal.Length � c Introduction to Machine Learning – 5 / 5

Recommend

Introduction to Machine Learning Classification: Tasks Sonar Learning goals 0.20 Understand

Introduction to Machine Learning Classification: Tasks Sonar Learning goals 0.20 Understand the main difference between regression and 0.15 classification Response V2 M R 0.10 Know that classification can be binary or multiclass 0.05

510 views • 8 slides

Introduction to Machine Learning: Classification and The Noisy Channel Model CMSC 473/673 UMBC

Introduction to Machine Learning: Classification and The Noisy Channel Model CMSC 473/673 UMBC Some slides adapted from 3SLP Outline Classification Why incorporate uncertainty Classification with Bayes Rule Example: Email Classifier

1.68k views • 89 slides

1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

What is Learning? Herbert Simon: Learning is any process by which a system improves performance from CS 391L: Machine Learning experience. Introduction What is the task? Classification Problem solving / planning /

603 views • 6 slides

Classification and Machine Learning techniques for CBIR: introduction to the RETIN system

Classification and Machine Learning techniques for CBIR: introduction to the RETIN system Matthieu Cord ETIS CNRS UMR 8051 Classification and Machine Learning techniques for CBIR: introduction to the RETIN system p.1/81 Content-Based Image

1.37k views • 81 slides

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 18 Outline 1 Classification, Regression, Unsupervised Learning 2 About Dimensionality 3 Drawings and

701 views • 18 slides

Introduction to machine learning COMS 4721 Learning from data Machine learning : the study

Introduction to machine learning COMS 4721 Learning from data Machine learning : the study of computational mechanisms that learn from data in order to make predictions and decisions. Example 1: image classification A birdwatcher

932 views • 14 slides

Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

MACHINE LEARNING MACHINE LEARNING Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult Children Detecting facial attributes He & Zhang, Pattern Recognition, 2011 Sony (Make Believe) Training set

914 views • 80 slides

Introduction to Machine Learning Session 2a: Introduction to Classification and Regression Trees

Introduction to Machine Learning Session 2a: Introduction to Classification and Regression Trees Reto West Department of Political Science and International Relations University of Geneva Outline 1 The Basics of Decision Trees 2 Regression

754 views • 29 slides

Introduction to Machine Learning Evaluation: Simple Measures for Classification Learning goals

Introduction to Machine Learning Evaluation: Simple Measures for Classification Learning goals Know the definitions of misclassification error rate (MCE) and accuracy (ACC) Understand the entries of a confusion matrix Understand the idea of

704 views • 10 slides

Introduction to Machine Learning Classification: Logistic Regression

Introduction to Machine Learning Classification: Logistic Regression compstat-lmu.github.io/lecture_i2ml MOTIVATION A discriminant approach for directly modeling the posterior probabilities ( x | ) of the labels is logistic regression . For

484 views • 9 slides

Machine Learning Classification: Introduction Hamid R. Rabiee Jafar Muhammadi, Nima Pourdamghani

Machine Learning Classification: Introduction Hamid R. Rabiee Jafar Muhammadi, Nima Pourdamghani Spring 2015 http://ce.sharif.edu/courses/93-94/2/ce717-1/ Agenda Agenda Introduction Classification: A Two-Step Process Evaluating

1k views • 76 slides

Decision tree learning Introduction to Machine Learning Task of classification Automatically

INTRODUCTION TO MACHINE LEARNING Decision tree learning Introduction to Machine Learning Task of classification Automatically assign class to observations with features Observation: vector of features , with a class Automatically

1.08k views • 80 slides

Learning Objectives SIRE503:Intro Med Bioinformatics What & Why? Classification

10/30/18 30 Oct 2018 Learning Objectives SIRE503:Intro Med Bioinformatics What & Why? Classification problems Introduction to Examples from Netflix Machine Learning 3 common types of Machine Learning Related

195 views • 16 slides

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides

Introduction to Machine Learning CMU-10701 2. MLE, MAP, Bayes classification Barnabs Pczos

Introduction to Machine Learning CMU-10701 2. MLE, MAP, Bayes classification Barnabs Pczos & Aarti Singh 2014 Spring Administration http://www.cs.cmu.edu/~aarti/Class/10701_Spring14/index.html Blackboard manager & Peer grading:

1.08k views • 41 slides

Linear classification Course of Machine Learning Master Degree in Computer Science University of

Linear classification Course of Machine Learning Master Degree in Computer Science University of Rome Tor Vergata Giorgio Gambosi a.a. 2018-2019 1 Introduction 2 Classification most common case: disjoint classes, each input has

742 views • 59 slides

Introduction to Machine Learning Classification: Discriminant Analysis

Introduction to Machine Learning Classification: Discriminant Analysis compstat-lmu.github.io/lecture_i2ml LINEAR DISCRIMINANT ANALYSIS (LDA) LDA follows a generative approach k ( x ) = P ( y = k | x ) = P ( x | y = k ) P ( y = k ) p ( x | y

492 views • 11 slides

Machine Learning Classification over Encrypted Data Raphal Bost Raluca Ada Popa,

Machine Learning Classification over Encrypted Data Raphal Bost Raluca Ada Popa, Universit Rennes 1 ETH Zrich MIT MIT Stephen Tu Shafi Goldwasser MIT MIT Classification (Machine Learning) Supervised learning (training)

1.3k views • 29 slides

Introduction to Big Data and Machine Learning Classification Dr. Mihail September 19, 2019 (Dr.

Introduction to Big Data and Machine Learning Classification Dr. Mihail September 19, 2019 (Dr. Mihail) Intro Big Data September 19, 2019 1 / 3 Linear models for classification Goal Goal of classification: take an input vector x and assign

511 views • 17 slides

Multiclass Classification Machine Learning So far: Binary Classification We have seen linear

Multiclass Classification Machine Learning So far: Binary Classification We have seen linear models Learning algorithms for linear models Perceptron, Winnow, Adaboost, SVM We will see more soon: Nave Bayes, Logistic Regression

635 views • 24 slides

Machine learning strikes from below, a mining application: Material Classification by Drilling

Machine learning strikes from below, a mining application: Material Classification by Drilling Machine Learning 2005 Johan Larsson Papers Material Classification by Drilling Diana LaBelle, John Bares, Illah Nourbakhsh Robotics Institute,

509 views • 29 slides

Machine learning and event classification SOTARRIVA ALVAREZ ISAI ROBERTO Advisor Dr. Antonio

Machine learning and event classification SOTARRIVA ALVAREZ ISAI ROBERTO Advisor Dr. Antonio Ortiz Velasquez 1 MACHINE LEARNING APPLIED TO EVENT CLASSIFICATION Motivation Jet like Sphere like OR Machine learning (low spherocity) (High

301 views • 14 slides

Introduction to Machine Learning Non-linear prediction with kernels Prof. Andreas Krause

Introduction to Machine Learning Non-linear prediction with kernels Prof. Andreas Krause Learning and Adaptive Systems (las.ethz.ch) Solving non-linear classification tasks How can we find nonlinear classification boundaries? Similar as in

994 views • 56 slides

Decision Trees TJ Machine Learning Club Classification vs. Regression Classification

Decision Trees TJ Machine Learning Club Classification vs. Regression Classification Classifying photos of fruits Determining whether tumor is benign or malignant Regression Predicting COVID-19 cases given demographic data

505 views • 26 slides