machine learning
play

Machine learning Jacques van Helden ORCID 0000-0002-8799-8584 - PowerPoint PPT Presentation

Nov 07, 2022 •285 likes •1.23k views

DUBii - Module - Statistics with R Machine learning Jacques van Helden ORCID 0000-0002-8799-8584 Institut Franais de Bioinformatique ( IFB ) French node of the European ELIXIR bioinformatics infrastructure Aix-Marseille Universit (AMU) Lab.

  1. DUBii - Module - Statistics with R Machine learning Jacques van Helden ORCID 0000-0002-8799-8584 Institut Français de Bioinformatique ( IFB ) French node of the European ELIXIR bioinformatics infrastructure Aix-Marseille Université (AMU) Lab. Theory and Approaches of Genomic Complexity ( TAGC )

  2. Brain-learning exercise : assign individuals to groups based on their features

  3. Conceptual illustration with two predictor variables In the next slides, we will n provide you with a higher- resolution of the plots, which represent represent a study case. Exercise: assign intuitively n each individual (black dot) to one of the two groups (A, B). At each step, ask yourself q the following questions. Which criterion did you use q to assign an individual to a group? How confident do you feel q for each of your predictions? What is the effect of the q respective means? What is the effect of the q respective standard deviations? What is the effect of the q correlations between the 3 two variables?

  4. Conceptual illustration with two variables – Study case 1 Inspect the distribution of points for the two groups n of individuals (pink, blue) on the 2-dimensional feature space. X2 (Feature 1) X1 (Feature 1) 4

  5. Conceptual illustration with two variables – Study case 2 Effect of the group centre location . n X2 (Feature 1) X1 (Feature 1) 5

  6. Conceptual illustration with two variables – Study case 3 Effect of the group variance . n X2 (Feature 1) X1 (Feature 1) 6

  7. Conceptual illustration with two variables – Study case 4 Effect of the group variance . n X2 (Feature 1) X1 (Feature 1) 7

  8. Conceptual illustration with two variables – Study case 5 Impact of the group-specific variances n (heteroscedasticity of the data) X2 (Feature 1) X1 (Feature 1) 8

  9. Conceptual illustration with two variables – Study case 6 Impact of the group-specific n variances (heteroscedasticity of the data) X2 (Feature 1) X1 (Feature 1) 9

  10. Conceptual illustration with two variables – Study case 7 Effect of the co variance between n features. X2 (Feature 1) X1 (Feature 1) 10

  11. Conceptual illustration with two variables – Study case 8 Effect of the co variance between n features X2 (Feature 1) X1 (Feature 1) 11

  12. Conceptual illustration with two variables – Study case 9 Group-specific co variances between n features. q The two groups have different covariance matrices: the clouds of points are elongated in different directions. q How does this difference affects group assignments ? X2 (Feature 1) X1 (Feature 1) 12

  13. Statistics Applied to Bioinformatics Multivariate analysis Introduction Jacques van Helden ORCID 0000-0002-8799-8584 Institut Français de Bioinformatique ( IFB ) French node of the European ELIXIR bioinformatics infrastructure Aix-Marseille Université (AMU) Lab. Theory and Approaches of Genomic Complexity ( TAGC )

  14. Multivariate data n Each row represents one object (also called unit) n Each column represents one variable variable 1 variable 2 ... variable p individual 1 x 11 x 21 ... x p1 individual 2 x 12 x 22 ... x p2 individual 3 x 13 x 23 ... x p3 individual 4 x 14 x 24 ... x p4 individual 5 x 15 x 25 ... x p5 individual 6 x 16 x 26 ... x p6 individual 7 x 17 x 27 ... x p7 individual 8 x 18 x 28 ... x p8 ... ... ... ... ... individual n x 1n x 2n ... x pn

  15. Multivariate data with an outcome variable n The outcome variable (also called criterion variable) can be q qualitative (nominal) : classes (e.g. cancer type) q quantitative (e.g. survival expectation for a cancer patient) Predictor variables Outcome variable variable 1 variable 2 ... variable p variable p+1 individual 1 x 11 x 21 ... x p1 y 1 individual 2 x 12 x 22 ... x p2 y 2 individual 3 x 13 x 23 ... x p3 y 3 individual 4 x 14 x 24 ... x p4 y 4 individual 5 x 15 x 25 ... x p5 y 5 individual 6 x 16 x 26 ... x p6 y 6 individual 7 x 17 x 27 ... x p7 y 7 individual 8 x 18 x 28 ... x p8 y 8 ... ... ... ... ... ... individual n x 1n x 2n ... x pn y n

  16. Predictive approaches - Training set n The training set is used to build a predictive function n This function is used to predict the value of the outcome variable for new objects Predictor variables Outcome variable variable 1 variable 2 ... variable p variable p+1 Training set individual 1 x 11 x 21 ... x p1 y 1 individual 2 x 12 x 22 ... x p2 y 2 individual 3 x 13 x 23 ... x p3 y 3 ... ... ... ... ... ... individual N_train x 1n x 2n ... x pn y n Predictor variables Outcome variable variable 1 variable 2 ... variable p variable p+1 Set to predict individual 1 x 11 x 21 ... x p1 ? individual 2 x 12 x 22 ... x p2 ? individual 3 x 13 x 23 ... x p3 ? ... ... ... ... ... ... individual N_pred x 1n x 2n ... x pn ?

  17. Predictor variables Outcome variable Evaluation of prediction with a testing set variable 1 variable 2 ... variable p variable p+1 Training set individual 1 x 11 x 12 ... x 1p y 1 individual 2 x 21 x 22 ... x 2p y 2 individual 3 x 31 x 32 ... x 3p y 3 ... ... ... ... ... ... individual ntrain x n1 x n2 ... x np y n Predictor variables Outcome variable variable 1 variable 2 ... variable p variable p+1 variable p+1 (known value) (predicted) Testing set individual 1 x 11 x 12 ... x 1p y 1 y' 1 individual 2 x 21 x 22 ... x 2p y 2 y' 2 individual 3 x 31 x 32 ... x 3p y 3 y' 3 ... ... ... ... ... ... ... individual ntest x n1 x n2 ... x np y ntest y' ntest Predictor variables Outcome variable variable 1 variable 2 ... variable p variable p+1 Set to predict individual 1 x 11 x 12 ... x 1p ? individual 2 x 21 x 22 ... x 2p ? individual 3 x 31 x 32 ... x 3p ? ... ... ... ... ... ...

  18. Flowchart of the approaches in multivariate analysis Multidimensional multivariate table X distance matrix scaling Reduction of dimensions outcome - variable selection variable Y? - principal component analysis none quantitative nominal Exploratory analysis Visualisation Cluster analysis Regression analysis Supervised classification Predicted value of Discovered classes Assignment of individuals Graphical a quantitative variable + individual assignment to predefined classes representations y est = f(x) g=f(x)

  19. Quizz Check your understanding of the concepts presented in the previous slides by applying them to your own data. 1. Describe in one sentence a typical case of multidimensional data that is handled in your domain. 2. Explain how you would organise this dataset into a multivariate structure q What would correspond to the individuals? q What would correspond to the variables? q How many individuals (n) would you have? q How many variables (p) would you have? q Do you dispose of one or several outcome variable(s)? q If so, are these quantitative, qualitative or both? 3. Based on the conceptual framework defined above, which kind of approaches would be you envisage to extract which kind of relevant information from this data? Note that several approaches can be combined to address different questions.

  20. Historical (vintage) examples

  21. Historical example of clustering heat map Spellman et al. (1998). n Systematic detection of genes regulated in a n periodic way during the cell cycle. Several experiments were regrouped, with n various ways of synchronization (elutriation, cdc mutants, …) ~800 genes showing a periodic patterns of n expression were selected (by Fourier analysis) Spellman, P. T., Sherlock, G., Zhang, M. Q., Iyer, V. R., Anders, K., Eisen, M. B., Brown, P. O., Botstein, D. & Futcher, B. (1998). Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. Mol Biol Cell 9, 3273-97.Time profiles of yeast cells followed during cell cycle.

  22. Stress response in yeast Gasch et al. (2000) tested the transcriptional n response of yeast genome to q Various stress conditions (heat shock, osmotic shock, …) q Drugs q Alternative carbon sources q … The heatmap shows clusters of genes having n similar profiles of responses to the different types of stress. Gasch, A. P., Spellman, P. T., Kao, C. M., Carmel-Harel, O., Eisen, M. B., Storz, G., Botstein, D. & Brown, P. O. 22 (2000). Genomic expression programs in the response of yeast cells to environmental changes. Mol Biol Cell 11, 4241- 57.

  23. Cancer types (Golub, 1999) Compared the profiles of n expression of ~7000 human genes in patients suffering from two different cancer types: ALL or AML, respectively. Selected the 50 genes most n correlated with the cancer type. Goal: use these genes as n molecular signatures for the diagnostic of new patients. Golub, T. R., Slonim, D. K., Tamayo, P., n Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., Bloomfield, C. D. & Lander, E. S. (1999). Molecular classification of cancer: class discovery and class prediction by gene 23 expression monitoring. Science 286, 531-7.

Recommend

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides
Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

559 views • 17 slides
Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

872 views • 29 slides
Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

401 views • 26 slides
CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

1/22/19 CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine Learning? A Simple Task: Recognize Obama How do you program a computer to Recognize faces? Recommend movies? Decide which web

582 views • 5 slides
Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their performance We use machine learning in situations where it is very challenging (or impossible) to define the rules by hand: e.g. face detection

1.04k views • 28 slides
Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 12 Outline 1 Nearest Neighbor Prediction 2 Complexity Considerations 3 The Voronoi Diagram 4 Overfitting

565 views • 12 slides
1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

What is Learning? Herbert Simon: Learning is any process by which a system improves performance from CS 391L: Machine Learning experience. Introduction What is the task? Classification Problem solving / planning /

603 views • 6 slides
MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

JACOPO DI IORIO, MATTEO FONTANA, DANIELE OCCHIUTO, CLAUDIA VOLPETTI MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING STATISTICAL LEARNING Separate evolutions, but with shared methodologies MERGE

565 views • 55 slides
Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine Learning? What is Machine Learning? Examples of machine learning applications: Facial recognition software E-mail spam detectors Automated

302 views • 17 slides
Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning 11.1 Learning agents 11.2 Inductive learning 11.3 Deep learning 11.4 Statistical learning 11.5 Reinforcement learning 11.6 Transfer learning

1.7k views • 159 slides
Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides
Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine learning refers to any system where the performance of a machine in performing a task improves by gaining more experience in performing that task .

394 views • 27 slides
MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING 2012 MACHINE LEARNING MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How to separate the red class from the grey class? x 2 360 r x 1 Polar coordinates Data

1.04k views • 44 slides
BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

photo:@rewardyfahmi // Unsplash BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest Neighbor Classifier Aykut Erdem // Hacettepe University // Fall 2019 When Do We Use Machine Learning? ML is

1.33k views • 110 slides
Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

553 views • 27 slides
Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in Practise Probabilities Finite Resource Machine Learning @ Amazon Forecasting Machine Translation Visual Systems Conclusions

348 views • 34 slides
Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

CS6501: Deep Learning for Visual Recognition Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning? Supervised Learning: Classification with K-nearest neighbors Unsupervised Learning: Clustering with

1.36k views • 91 slides
Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton

Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton

Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton with Nitish Srivastava Kevin Swersky What is Machine Learning? It is very hard to write programs that solve problems like recognizing a

514 views • 48 slides
MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am

MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am

MACHINE LEARNING MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am and last until 12h30 2 MACHINE LEARNING Exam Format The exam lasts a total of 40 minutes: -Upon entering the room, you pick at

919 views • 57 slides
Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell

Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell provided a widely accepted definition: A computer program is said to learn from

595 views • 24 slides
Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

MACHINE LEARNING TOOLBOX Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret R package Automates supervised learning (a.k.a. predictive modeling ) Target variable Machine Learning Toolbox

634 views • 16 slides
Overview CS 446 What is machine learning? Machine learning : study of computational

Overview CS 446 What is machine learning? Machine learning : study of computational

Overview CS 446 What is machine learning? Machine learning : study of computational mechanisms that learn from data to make predictions and decisions. 1 / 21 Application 1: image classification Birdwatcher takes photos of birds,

1.08k views • 83 slides
Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

MACHINE LEARNING MACHINE LEARNING Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult Children Detecting facial attributes He & Zhang, Pattern Recognition, 2011 Sony (Make Believe) Training set

914 views • 80 slides

More recommend