9 5 520 6 860 statistical learning theory ry and
play

9.5 .520/6.860: : Statistical Learning Theory ry and Applications - PowerPoint PPT Presentation

Feb 22, 2024 •160 likes •324 views

9.5 .520/6.860: : Statistical Learning Theory ry and Applications Class: Tue, Thu 11:00 - 12:30 pm , 46-3002 (Singleton) Office Hours: Friday 1:00 pm - 2:00 pm, 46-5156 (Poggio lab lounge) and/or 46-5165 (MIBR Reading Room) Web:

  1. 9.5 .520/6.860: : Statistical Learning Theory ry and Applications • Class: Tue, Thu 11:00 - 12:30 pm , 46-3002 (Singleton) Office Hours: Friday 1:00 pm - 2:00 pm, 46-5156 (Poggio lab lounge) and/or 46-5165 (MIBR Reading Room) • Web: http://www.mit.edu/~9.520/ • Contact: 9.520@mit.edu • Mailing list: 9.520students@mit.edu (?) • Live Stream: CBMM Youtube channel • 9.520/6.860 will use Stellar • Also check web (announcements) for updates

  2. Material Slides — will be posted (for most Videos — check CBMM Notes — lectures) on the website L. Rosasco and T. Poggio, Machine Learning: a Regularization Approach, MIT-9.520 Lectures Notes , Manuscript, (will be provided) For feedback on book (typos, errors, ...) https://goo.gl/forms/pQcewnsAV3lCNoyr1

  3. Faces ● Instructors:

  4. Faces • Instructors: • Lorenzo Rosasco

  5. Faces • Instructors: • Lorenzo Rosasco • Sasha Rakhlin

  6. Faces • Instructors: • Lorenzo Rosasco • Sasha Rakhlin • Tomaso Poggio

  7. Faces • Instructors: • Lorenzo Rosasco • Sasha Rakhlin • Tomaso Poggio • Andy Banburski (also head TA?)

  8. Faces • Instructors: • Lorenzo Rosasco • Sasha Rakhlin • Tomaso Poggio • Andy Banburski (also head TA?) • TAs: • Michael Lee

  9. Faces • Instructors: • Lorenzo Rosasco • Sasha Rakhlin • Tomaso Poggio • Andy Banburski (also head TA?) • TAs: • Michael Lee • Qianli Liao

  10. Faces • Instructors: • Lorenzo Rosasco • Sasha Rakhlin • Tomaso Poggio • Andy Banburski (also head TA?) • TAs: • Michael Lee • Qianli Liao • Morteza Sarafyazd

  11. Faces • Instructors: • Lorenzo Rosasco • Sasha Rakhlin • Tomaso Poggio • Andy Banburski (also head TA?) • TAs: • Michael Lee • Qianli Liao • Morteza Sarafyazd • Abhimanyu Dubey

  12. Syllabus at t a gla lance

  13. Problem sets (0.6) • 4 problem sets (0.15 each) • 2 - 3 questions (exercises and/or MATLAB) • 1 week due • Late policy on next slide • typeset in LaTeX (template will be provided) Grading • Online submission by due date policies Project (0.3) • See later Participation (0.1) • Attending class lectures is required! • Sign-in sheet will be circulated on random lectures

  14. • Problem sets (0.6) • 4 problem sets (0.15 each) • 2 - 3 questions (demonstrations/exercises + short MATLAB) • 7 days due! • typeset in LaTeX (template provided) • online submission by due date • Late policy • All students have 4 free late days (to be used on psets and project proposal) • You may use up to 2 late days per assignment with no penalty Problem sets • Beyond this, we will deduct a late penalty of 50% of the grade per additional late day • Dates (due times are 11:59 pm). Submission online (on Stellar). Problem Set 1 , out: Sep. 19, due: Wed., Sep. 25 (Class 07). Problem Set 2 , out: Oct. 03, due: Wed., Oct. 09 (Class 10). Problem Set 3 , out: Oct. 31, due: Wed., Nov. 06 (Class 18). Problem Set 4 , out: Nov. 14, due: Wed., Nov. 20 (Class 21). • Collaboration policy: You may discuss with others but need to work out your own solution.

  15. Theory Algorithms Application • This is not a data science Projects Review course, so we will not consider data preparation as contributing to the grade. Dates • Abstract and title: Nov. 1 report (NIPS format): 5 • Feedback and approval: Nov. pages + references 8 • Report submission: Dec. 11

Recommend

COMPLETE STATISTICAL THEORY OF LEARNING LEARNING USING STATISTICAL INVARIANTS Vladimir Vapnik

COMPLETE STATISTICAL THEORY OF LEARNING LEARNING USING STATISTICAL INVARIANTS Vladimir Vapnik

COMPLETE STATISTICAL THEORY OF LEARNING LEARNING USING STATISTICAL INVARIANTS Vladimir Vapnik 1 PART I VC THEORY OF GENERALIZATION 2 THE MAIN QUESTION OF LEARNING THEORY QUESTION: When in set of functions { f ( x ) } we can minimize

1.18k views • 59 slides
MIT 9.520/6.860, Fall 2019 Statistical Learning Theory and Applications Class 02: Statistical

MIT 9.520/6.860, Fall 2019 Statistical Learning Theory and Applications Class 02: Statistical

MIT 9.520/6.860, Fall 2019 Statistical Learning Theory and Applications Class 02: Statistical Learning Setting Lorenzo Rosasco Learning from examples rather than being explicitly programmed. theory. L.Rosasco, 9.520/6.860 Fall 2018

582 views • 32 slides
Statistical Learning Theory Real-World Process and PAC-Learning Training Set New

Statistical Learning Theory Real-World Process and PAC-Learning Training Set New

Learning Classifiers Statistical Learning Theory Real-World Process and PAC-Learning Training Set New Examples CS678 Advanced Topics in Machine Learning Thorsten Joachims Classifier Learner Spring

96 views • 5 slides
Overview of statistical learning theory Daniel Hsu Columbia TRIPODS Bootcamp 1 Statistical

Overview of statistical learning theory Daniel Hsu Columbia TRIPODS Bootcamp 1 Statistical

Overview of statistical learning theory Daniel Hsu Columbia TRIPODS Bootcamp 1 Statistical model for machine learning 2 Basic goal of machine learning Goal : Predict outcome y from set of possible outcomes Y , on the basis of observation x

362 views • 32 slides
Statistical Learning Theory and Applications 9.520/6.860 in Fall 2017 Class Times:

Statistical Learning Theory and Applications 9.520/6.860 in Fall 2017 Class Times:

Statistical Learning Theory and Applications 9.520/6.860 in Fall 2017 Class Times: Monday and Wednesday 1pm-2:30pm in 46-3310 Units: 3-0-9 H,G Web site: http://www.mit.edu/~9.520/ Email Contact : 9.520@mit.edu 9.520: Statistical

1.53k views • 149 slides
9.520/6.860: Statistical Learning Theory and Applications Class: Mon., Wed. 1:00 - 2:30 pm,

9.520/6.860: Statistical Learning Theory and Applications Class: Mon., Wed. 1:00 - 2:30 pm,

9.520/6.860: Statistical Learning Theory and Applications Class: Mon., Wed. 1:00 - 2:30 pm, 46-3310 (PILM Seminar Room) Office Hours: Friday 1:00 pm - 2:00 pm, 46-5156 (Poggio lab lounge) and/or 46-5165 (MIBR Reading Room) Web:

847 views • 5 slides
MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications Class 06: Learning with

MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications Class 06: Learning with

MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications Class 06: Learning with Stochastic Gradients Sasha Rakhlin A. Rakhlin, 9.520/6.860 2018 Why Optimization? Much (but not all) of Machine Learning: write down objective

481 views • 24 slides
Statistical and Computational Statistical and Computational Learning Theory Learning Theory

Statistical and Computational Statistical and Computational Learning Theory Learning Theory

Statistical and Computational Statistical and Computational Learning Theory Learning Theory Fundamental Question: Predict Error Rates Fundamental Question: Predict Error Rates Given: Given: The space H of hypotheses The space H of

497 views • 29 slides
Learning to Reconstruct Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs,

Learning to Reconstruct Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs,

Learning to Reconstruct Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs, Marie-Sarah Lacharit, Brice Minaud, Kenny Paterson CASYS team seminar, Grenoble, December 2018 Outsourcing Data with Search Capabilities Data

534 views • 38 slides
Statistical Learning Theory Machine Learning Summer School, Kyoto, Japan Alexander (Sasha)

Statistical Learning Theory Machine Learning Summer School, Kyoto, Japan Alexander (Sasha)

Statistical Learning Theory Machine Learning Summer School, Kyoto, Japan Alexander (Sasha) Rakhlin University of Pennsylvania, The Wharton School Penn Research in Machine Learning (PRiML) August 27-28, 2012 1 / 130 References Parts of these

1.69k views • 149 slides
Learning to Reconstruct: Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs ,

Learning to Reconstruct: Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs ,

Learning to Reconstruct: Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs , Marie-Sarah Lacharit, Brice Minaud, Kenny Paterson pag225@cornell.edu, @pag_crypto Outsourced Databases Database Encrypting Outsourced

705 views • 23 slides
A Geometric Approach to Statistical Learning Theory Shahar Mendelson Centre for Mathematics and

A Geometric Approach to Statistical Learning Theory Shahar Mendelson Centre for Mathematics and

A Geometric Approach to Statistical Learning Theory Shahar Mendelson Centre for Mathematics and its Applications The Australian National University Canberra, Australia What is a learning problem A class of functions F on a probability

562 views • 32 slides
Computational and Statistical Learning Theory TTIC 31120 Prof. Nati Srebro Lecture 7:

Computational and Statistical Learning Theory TTIC 31120 Prof. Nati Srebro Lecture 7:

Computational and Statistical Learning Theory TTIC 31120 Prof. Nati Srebro Lecture 7: Computational Complexity of Learning Hardness of Improper Learning (continued) Agnostic Learning Hardness of Learning via Crypto Easy to generate

433 views • 24 slides
Statistical Learning Theory and Applications 9.520/6.860 in Fall 2018 Class Times:

Statistical Learning Theory and Applications 9.520/6.860 in Fall 2018 Class Times:

Statistical Learning Theory and Applications 9.520/6.860 in Fall 2018 Class Times: Tomaso Poggio Tuesday and Thursday 11am-12:30pm in 46-3002 Singleton Auditorium (TP), Lorenzo Rosasco Units: 3-0-9 H,G (LR), Sasha Rakhlin (SR) Web

1.41k views • 86 slides
Learning to Reconstruct Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs,

Learning to Reconstruct Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs,

Learning to Reconstruct Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs, Marie-Sarah Lacharit, Brice Minaud, Kenny Paterson eprint 2019/011 and IEEE S&P 2019. C2 seminar, Rennes, 2019 Outsourcing Data Data upload

646 views • 39 slides
Statistical Learning Theory and Applications 9.520/6.860 in Fall 2016 Class Times:

Statistical Learning Theory and Applications 9.520/6.860 in Fall 2016 Class Times:

Statistical Learning Theory and Applications 9.520/6.860 in Fall 2016 Class Times: Monday and Wednesday 1pm-2:30pm in 46-3310 Units: 3-0-9 H,G Web site: http://www.mit.edu/~9.520/ Email Contact : 9.520@mit.edu Instructors: Tomaso

1.35k views • 90 slides
MIT 9.520/6.860 Statistical Learning Theory and Applications Class 0: Mathcamp Lorenzo Rosasco

MIT 9.520/6.860 Statistical Learning Theory and Applications Class 0: Mathcamp Lorenzo Rosasco

MIT 9.520/6.860 Statistical Learning Theory and Applications Class 0: Mathcamp Lorenzo Rosasco Vector Spaces Hilbert Spaces Functionals and Operators (Matrices) Linear Operators Probability Theory R D We like R D because we can add

513 views • 34 slides
Statistical Learning Theory and Support Vector Machines Gert Cauwenberghs Johns Hopkins

Statistical Learning Theory and Support Vector Machines Gert Cauwenberghs Johns Hopkins

Statistical Learning Theory and Support Vector Machines Gert Cauwenberghs Johns Hopkins University gert@jhu.edu 520.776 Learning on Silicon http://bach.ece.jhu.edu/gert/courses/776 G. Cauwenberghs 520.776 Learning on Silicon Statistical

758 views • 38 slides
SVM AND STATISTICAL LEARNING THEORY W. RYAN LEE CS109/AC209/STAT121 ADVANCED SECTION

SVM AND STATISTICAL LEARNING THEORY W. RYAN LEE CS109/AC209/STAT121 ADVANCED SECTION

SVM AND STATISTICAL LEARNING THEORY W. RYAN LEE CS109/AC209/STAT121 ADVANCED SECTION INSTRUCTORS: P. PROTOPAPAS, K. RADER FALL 2017, HARVARD UNIVERSITY In the last chapter, we introduced GLMs and, in particular, logistic regression, which was

394 views • 5 slides
Foundations of AI Why learning works 1 6 . Statistical Machine Learning Bayesian Learning and

Foundations of AI Why learning works 1 6 . Statistical Machine Learning Bayesian Learning and

Contents Statistical learning Foundations of AI Why learning works 1 6 . Statistical Machine Learning Bayesian Learning and Why Learning Works W olfram Burgard, Bernhard Nebel, and Andreas Karw ath 10/ 1 10/ 2 Statistical Learning

305 views • 5 slides
Introduction to Statistical Learning Theory Olivier Bousquet 1 , St ephane Boucheron 2 , and G

Introduction to Statistical Learning Theory Olivier Bousquet 1 , St ephane Boucheron 2 , and G

Introduction to Statistical Learning Theory Olivier Bousquet 1 , St ephane Boucheron 2 , and G abor Lugosi 3 1 Max-Planck Institute for Biological Cybernetics Spemannstr. 38, D-72076 T ubingen, Germany olivier.bousquet@m4x.org WWW home

744 views • 39 slides
Class 1 Introduction to Statistical Learning Theory Carlo Ciliberto Department of Computer

Class 1 Introduction to Statistical Learning Theory Carlo Ciliberto Department of Computer

Class 1 Introduction to Statistical Learning Theory Carlo Ciliberto Department of Computer Science, UCL October 5, 2018 Administrative Info Class times : Fridays 14:00 - 15:30 1 Location : Ground Floor Lecture Theater, Wilkins Building

476 views • 43 slides
Statistical Machine Learning Lecture 05: Bayesian Decision Theory Kristian Kersting TU Darmstadt

Statistical Machine Learning Lecture 05: Bayesian Decision Theory Kristian Kersting TU Darmstadt

Statistical Machine Learning Lecture 05: Bayesian Decision Theory Kristian Kersting TU Darmstadt Summer Term 2020 K. Kersting based on Slides from J. Peters Statistical Machine Learning Summer Term 2020 1 / 36 Todays Objectives Make

369 views • 36 slides
MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

JACOPO DI IORIO, MATTEO FONTANA, DANIELE OCCHIUTO, CLAUDIA VOLPETTI MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING STATISTICAL LEARNING Separate evolutions, but with shared methodologies MERGE

565 views • 55 slides

More recommend