Support Vector Machine (Part 2) OUTLINE Multi-class classification - PowerPoint PPT Presentation

Sep 26, 2023 •1.11k likes •1.53k views

Support Vector Machine (Part 2) OUTLINE Multi-class classification Nonlinear mapping Kernel The Solution of Quiz-2 The maximum margin weight vector will be parallel to the shortest line connecting points of the two classes, that

Support Vector Machine (Part 2)
OUTLINE • Multi-class classification • Nonlinear mapping • Kernel
The Solution of Quiz-2 • The maximum margin weight vector will be parallel to the shortest line connecting points of the two classes, that is, the line between (1,1) and (2,3), giving a weight vector of (1,2) • Working algebraically, with the standard constraint that: Minimize ||w|| subject to  • For some a; a+2a + b = -1 2a + 6a + b = 1 a= 2/5, b=- 11/5, so the optimal hyperplane is given by w = (2/5 , 4/5) and b = -11/5. 4 16 The large margin M is 2/ ||w||  2/ 25 + 25 = 5
Multi-class Classification
Multi-class Classification
Multi-class Classification Source code example: http://scikit-learn.org/stable/modules/multiclass.html
Source: [http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf]
Source: [http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf]
Source: [http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf]
Source: [http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf]
Source: [http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf]
Source: [http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf]
Source: [http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf]
Source: [http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf]
Source: [http://sli.ics.uci.edu/Classes/2016W-178?action=download&upname=07_svm.pdf]
Source: [https://class.coursera.org/ml-005/lecture/74]
Source: [https://class.coursera.org/ml-005/lecture/74]
Source: [https://class.coursera.org/ml-005/lecture/74]
Source: [https://class.coursera.org/ml-005/lecture/74]
Source: [https://class.coursera.org/ml-005/lecture/74]
Gaussian Kernel Example (1) Source: [https://class.coursera.org/ml-005/lecture/74]
Gaussian Kernel Example (2) Source: [https://class.coursera.org/ml-005/lecture/74]
Gaussian Kernel Example (3) Source: [https://class.coursera.org/ml-005/lecture/74]
Source: [https://class.coursera.org/ml-005/lecture/74]
Source: [https://class.coursera.org/ml-005/lecture/74]
Source: [https://class.coursera.org/ml-005/lecture/74]
Source: [https://class.coursera.org/ml-005/lecture/74]
Demo • http://scikit-learn.org/stable/modules/svm.html • http://scikit-learn.org/stable/auto_examples/plot_multilabel.html#example- plot-multilabel-py • http://scikit-learn.org/stable/auto_examples/svm/plot_svm_nonlinear.html • http://scikit-learn.org/stable/auto_examples/svm/plot_svm_kernels.html • http://scikit-learn.org/stable/auto_examples/svm/plot_custom_kernel.html
References • http://cs229.stanford.edu/notes/cs229-notes3.pdf • https://class.coursera.org/ml-005/lecture/74 • http://www.cs.stevens.edu/~mordohai/classes/cs559_s10/Week10.pdf • http://nlp.stanford.edu/IR-book/html/htmledition/support-vector-machines-the- linearly-separable-case-1.html • http://www.holehouse.org/mlclass/12_Support_Vector_Machines.html

Recommend

Lecture 6: Support Vector Machine (Part 1) Feb 10 2020 Lecturer: Steven Wu Scribe: Steven Wu We

CSCI 5525 Machine Learning Fall 2019 Lecture 6: Support Vector Machine (Part 1) Feb 10 2020 Lecturer: Steven Wu Scribe: Steven Wu We will now derive a different method for linear classification Support Vector Machine (SVM) that is based on

535 views • 4 slides

Support Vector Machine w T x + b = 0 b || w || Support Vector Support Vector w X i y i ( x

Lecture 2: The SVM classifier C4B Machine Learning Hilary 2011 A. Zisserman Review of linear classifiers Linear separability Perceptron Support Vector Machine (SVM) classifier Wide margin Cost

982 views • 18 slides

Support Vector Machines Preview What is a support vector machine? The perceptron revisited

Support Vector Machines Preview What is a support vector machine? The perceptron revisited Kernels Weight optimization Handling noisy data What Is a Support Vector Machine? 1. A subset of the training examples x (the support

971 views • 19 slides

Support Vector Machines This set of notes presents the Support Vector Machine (SVM) learning al-

CS229 Lecture notes Andrew Ng Part V Support Vector Machines This set of notes presents the Support Vector Machine (SVM) learning algorithm. SVMs are among the best (and many believe are indeed the best) off-the-shelf supervised

563 views • 25 slides

What is a What are Support Vector Machines Support Vector Machine? Used For? An optimally

What is a What are Support Vector Machines Support Vector Machine? Used For? An optimally defined surface Classification Typically nonlinear in the input space Regression and data-fitting Linear in a higher dimensional

577 views • 8 slides

Support Vector Machines Part 1 CS 760@UW-Madison Goals for the lecture you should understand

Support Vector Machines Part 1 CS 760@UW-Madison Goals for the lecture you should understand the following concepts the margin the linear support vector machine the primal and dual formulations of SVM learning support vectors

631 views • 45 slides

Multi-class Support Vector Machine Rizal Zaini Ahmad Fathony November 10, 2016 University of

Multi-class Support Vector Machine Rizal Zaini Ahmad Fathony November 10, 2016 University of Illinois at Chicago Introduction Support Vector Machine The Support Vector Machine is a classification algorithm developed based on a geometric

1.65k views • 129 slides

Introduction to Machine Learning 5. Support Vector Classification Alex Smola Carnegie Mellon

Introduction to Machine Learning 5. Support Vector Classification Alex Smola Carnegie Mellon University http://alex.smola.org/teaching/cmu2013-10-701 10-701 Outline Support Vector Classification Large Margin Separation, optimization

1.56k views • 114 slides

Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

MACHINE LEARNING MACHINE LEARNING Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult Children Detecting facial attributes He & Zhang, Pattern Recognition, 2011 Sony (Make Believe) Training set

914 views • 80 slides

Support Vector Machines October 16, 2018 Support Vector Machines October 16, 2018 1 / 31

Support Vector Machines October 16, 2018 Support Vector Machines October 16, 2018 1 / 31 Introduction General information support vector machine (SVM) is an approach for classification that was developed in the computer science community in

654 views • 27 slides

Support Vector Machine Machine Learning 10-601B Seyoung Kim

Support Vector Machine Machine Learning 10-601B Seyoung Kim Many of these slides are derived fromTom Mitchell, Ziv Bar-Joseph. Thanks! Types of

608 views • 30 slides

SUPPORT VECTOR MACHINE ACTIVE LEARNING CS 101.2 Caltech, 03 Feb 2009 Paper by S. Tong, D.

SUPPORT VECTOR MACHINE ACTIVE LEARNING CS 101.2 Caltech, 03 Feb 2009 Paper by S. Tong, D. Koller Presented by Krzysztof Chalupka OUTLINE SVM intro Geometric interpretation Primal and dual form Convexity, quadratic programming

535 views • 38 slides

COMP24111: Machine Learning and Optimisation Chapter 4: Support Vector Machines Dr. Tingting Mu

COMP24111: Machine Learning and Optimisation Chapter 4: Support Vector Machines Dr. Tingting Mu Email: tingting.mu@manchester.ac.uk Outline Geometry concepts: hyperplane, distance, parallel hyperplane, margin. Basic idea of support

671 views • 36 slides

Support Vector Machines: Training with Stochastic Gradient Descent Machine Learning 1 Support

Support Vector Machines: Training with Stochastic Gradient Descent Machine Learning 1 Support vector machines Training by maximizing margin The SVM objective Solving the SVM optimization problem Support vectors, duals and

1.16k views • 69 slides

Support Vector Machine II Machine Learning 10-601B Seyoung

Support Vector Machine II Machine Learning 10-601B Seyoung Kim Many of these slides are derived fromTom 1 Mitchell, Ziv Bar-Joseph. Thanks! Max

680 views • 33 slides

CS145: INTRODUCTION TO DATA MINING 5: Vector Data: Support Vector Machine Instructor: Yizhou Sun

CS145: INTRODUCTION TO DATA MINING 5: Vector Data: Support Vector Machine Instructor: Yizhou Sun yzsun@cs.ucla.edu October 18, 2017 Announcements Homework 1 Due end of the day of this Thursday (11:59pm) Reminder of late submission

2k views • 44 slides

Machine Learning Support Vector Machines Rui Xia T ext M ining Group N anjing U niversity of S

Machine Learning Support Vector Machines Rui Xia T ext M ining Group N anjing U niversity of S cience & T echnology rxia@njust.edu.cn Outline Maximum Margin Linear Classifier Duality Optimization Soft-margin SVM Kernel

666 views • 62 slides

Support vector machine prediction of signal peptide cleavage site using a new class of kernels

1 Support vector machine prediction of signal peptide cleavage site using a new class of kernels for strings Jean-Philippe Vert Bioinformatics Center, Kyoto University, Japan 2 Outline 1. SVM and kernel methods 2. New kernels for

928 views • 50 slides

Why Deep Learning Is More Natural Questions Efficient than Support Support Vector . . . Support

Main Objectives of . . . Need for Machine . . . Support Vector . . . Deep Learning: a Brief . . . Why Deep Learning Is More Natural Questions Efficient than Support Support Vector . . . Support Vector . . . Vector Machines, and How What

556 views • 33 slides

Machine Learning for NLP Support Vector Machines Aurlie Herbelot 2019 Centre for Mind/Brain

Machine Learning for NLP Support Vector Machines Aurlie Herbelot 2019 Centre for Mind/Brain Sciences University of Trento 1 Support Vector Machines: introduction 2 Support Vector Machines (SVMs) SVMs are supervised algorithms for

1.04k views • 57 slides

Maldonado-Bascon et al. et al. Presented by Dara Nyknahad ECG 789 Outline Introduction

Road-Sign Detection and Recognition Based on Support Vector Machines Maldonado-Bascon et al. et al. Presented by Dara Nyknahad ECG 789 Outline Introduction Support Vector Machine (SVM) Algorithm Results Conclusions

587 views • 38 slides

Structured Multicategory Support Vector Machine with ANOVA decomposition

Structured Multicategory Support Vector Machine with ANOVA decomposition www.stat.ohio-state.edu/ yklee Yoonkyung Lee Department of Statistics The Ohio State University Structured Multicategory Support Vector Machine with ANOVA

629 views • 15 slides

The Support Vector Machine (Ken Kreutz-Delgado) ) Nuno Vasconcelos g UC San Diego (

The Support Vector Machine (Ken Kreutz-Delgado) ) Nuno Vasconcelos g UC San Diego ( Classification a Classification Problem has two types of variables X - vector of observations (features) in the world Y - state (class) of the

422 views • 38 slides

MACHINE LEARNING Linear and Weighted Regression Support Vector Regression 1 APPLIED MACHINE

APPLIED MACHINE LEARNING MACHINE LEARNING Linear and Weighted Regression Support Vector Regression 1 APPLIED MACHINE LEARNING Classification (reminder) Maps N -dimensions input x N to discrete values y E.g.: x = [ Length , Color ]

931 views • 68 slides