machine learning
play

Machine Learning /////////// Introduction May 2018 / Katja Gla - PowerPoint PPT Presentation

Nov 30, 2023 •581 likes •984 views

Machine Learning /////////// Introduction May 2018 / Katja Gla Agenda Overview Neural Networks CTCAE Grading as Example Use Cases Summary Machine Learning May 2018 Katja Gla Page 2 Overview Machine learning is a field of

  1. Machine Learning /////////// Introduction May 2018 / Katja Glaß

  2. Agenda Overview Neural Networks CTCAE Grading as Example Use Cases Summary Machine Learning • May 2018 • Katja Glaß Page 2

  3. Overview Machine learning is a field of computer science that gives computers the ability to learn without being explicitly programmed. Machine Learning • May 2018 • Katja Glaß Page 3

  4. Overview Different approaches for different purposes Big data / high complexity Deep Neural Networks Recurrent Neural Networks Reinforcement Learning Machine Learning • May 2018 • Katja Glaß Page 4

  5. Overview Different approaches for different purposes Artificial Neural Networks Classification Logic Regression Support Vector Machines Supervised Random Forest … Artificial Neural Networks Regresssion Linear Regression ML Decision Trees Bayesian Networks … Clustering Unsupervised Dimension Reduction Machine Learning • May 2018 • Katja Glaß Page 5

  6. Overview Neural Networks Current Hype are Neural Networks & Deep Neural Networks Extremly powerful Image recognition Natural language processing Machine Learning • May 2018 • Katja Glaß Page 6

  7. Neural Networks Rough understanding 1) Transform issues to numeric representation Number of inputs (neurons) Value of each input Example: Example Neurons Neuron Values Grey Image Each pixel one neuron Grey value Text Each word a neuron Frequency Lab analysis Each numeric variable Numeric value Each characteristic of 0 / 1 appearance character variable Machine Learning • May 2018 • Katja Glaß Page 7

  8. Neural Networks Rough understanding 1) Transform issues to numeric representation Number of inputs (neurons) Value of each input Example: Example Neurons Neuron Values Elephant? (image) One Elephant 0 .. 1 (probability) Text classification (SDTM, Each characteristic one ADAM 0 .. 1 (probability) ADAM, TLF?) neuron SDTM 0 .. 1 (probability) TLF 0 .. 1 (probability) Grading value? 0..4 Classification -> one neuron Grade 0 0 .. 1 (prob) … per classification Machine Learning • May 2018 • Katja Glaß Page 8

  9. Neural Networks Rough understanding 2) Structure Weight & Bias (optimized by algorithm) Number of neurons (5,3,4,1) Number of layers (3 with output layer) Machine Learning • May 2018 • Katja Glaß Page 9

  10. Neural Networks Rough understanding 3) Mathematics Structure Activation Function (A) (output = f(input(s)) A A A A A A A A Machine Learning • May 2018 • Katja Glaß Page 10

  11. Neural Networks Rough understanding 3) Mathematics Structure Activation Function (A) (output = f(input(s)) A Success-Function (B) A Cost / Utility A A A Accuracy A B Square Error … A A Machine Learning • May 2018 • Katja Glaß Page 11

  12. Neural Networks Rough understanding 3) Mathematics Structure Activation Function (A) (output = f(input(s)) C A Success-Function (B) A Cost / Utility A A A Accuracy A B Square Error … A A Optimization function (C) – updates weights & bias Gradient Decent … Machine Learning • May 2018 • Katja Glaß Page 12

  13. Neural Network Recommended Literature Free EBook “Neural Networks and Deep Learning” (http://neuralnetworksanddeeplearning.com/) Introduction & Statistical insights MNIST Example, large database with labeled handwritten digits Video Introduction “ Tensorflow and deep learning - without a PhD” (https://www.youtube.com/watch?v=vq2nnJ4g6N0&list=LL3uReggFn2MOSMZlG69vzEw) 2,5h video introduction on Tensorflow (free Google machine learning toolset) Top for first hands-on experiences, implementation complexity low Cool real world applications in a nutshell (~4 minutes each) https://www.youtube.com/watch?v=Bui3DWs02h4 https://www.youtube.com/watch?v=aKSILzbAqJs Machine Learning • May 2018 • Katja Glaß Page 13

  14. Neural Network Machine Learning Crash Course Machine Learning Crash Course with TensorFlow APIs 40+ exercises 25 lessons 15 hours Lectures from Google researchers Real-world case studies Interactive visualizations of algorithms in action Machine Learning • May 2018 • Katja Glaß Page 14

  15. CTCAE Grading as Example Anemia – simple test case First hands-on-experiences See how / why it is working Student (4 weeks) with Phython, Keras & TensorFlow experiences Two input parameters (Limit, Lab value) One output parameter (Grading 0 .. 3) Machine Learning • May 2018 • Katja Glaß Page 15

  16. CTCAE Grading as Example Anemia – simple test case Input : LBSTNRLO (low), LBSTRESN (value) Ideal curve for LBSTNRLO = 12 XTTEST XTTESTCD XTSTRESN LBTEST LBTESTCD LBCAT LBSTRESU RANGE_LOW RANGE_HIG H 3 XTTEST XTTESTCD XTSTRESN LBTEST LBTESTCD LBCAT LBSTRESU lower end upper end Grading Value 2 Anemia BLANE 0 Hemoglobin HGB HEMATOLOGY g/dL GE LBSTNRLO 1 Anemia BLANE 1 Hemoglobin HGB HEMATOLOGY g/dL GE 10.0 LT LBSTNRLO 0 Anemia BLANE 2 Hemoglobin HGB HEMATOLOGY g/dL GE 8.0 LT 10.0 5 6 7 8 9 10 11 12 13 14 LBSTRESN Anemia BLANE 3 Hemoglobin HGB HEMATOLOGY g/dL LT 8.0 Machine Learning • May 2018 • Katja Glaß Page 16

  17. CTCAE Grading as Example Network Layout Sequential 20/2/4 Sequential 3/4 Machine Learning • May 2018 • Katja Glaß Page 17

  18. CTCAE Grading as Example Input Data Random Study Machine Learning • May 2018 • Katja Glaß Page 18

  19. CTCAE Grading as Example Implementing a Model with Keras (TensorFlow) Machine Learning • May 2018 • Katja Glaß Page 19

  20. CTCAE Grading as Example Results - Random generated Data Model Data Loop1 Loop2 Loop3 Range = 12 Accuracy Accuracy Accuracy Accuracy 20 / 2 Random 89.67% 93.33% 96.33% 92,28% Machine Learning • May 2018 • Katja Glaß Page 20

  21. CTCAE Grading as Example Results - Random generated Data Model Data Loop1 Loop2 Loop3 Range = 12 Accuracy Accuracy Accuracy Accuracy 20 / 2 Random 89.67% 93.33% 96.33% 92,28% 3 Random 88.18% 96.37% 98.63 98,13% generated Data Machine Learning • May 2018 • Katja Glaß Page 21

  22. CTCAE Grading as Example Results - Random generated Data Model Data Loop1 Loop2 Loop3 Range = 12 Accuracy Accuracy Accuracy Accuracy 20 / 2 Random 89.67% 93.33% 96.33% 92,28% 3 Random 88.18% 96.37% 98.63% 98,13% 3 Clinical 96.03% 98.91% 99.03% Machine Learning • May 2018 • Katja Glaß Page 22

  23. CTCAE Grading as Example Results - Random generated Data Model Data Loop1 Loop2 Loop3 Range = 12 Accuracy Accuracy Accuracy Accuracy 20 / 2 Random 89.67% 93.33% 96.33% 92,28% 3 Random 88.18% 96.37% 98.63% 98,13% 3 Clinical 68.75% 96.03% 98.91% 99.03% Machine Learning • May 2018 • Katja Glaß Page 23

  24. CTCAE Grading as Example Results - Random generated Data Model Data Loop1 Loop2 Loop3 Range = 12 Accuracy Accuracy Accuracy Accuracy 20 / 2 Random 89.67% 93.33% 96.33% 92,28% 3 Random 88.18% 96.37% 98.63% 98,13% 3 Clinical 68.75% 96.03% 98.91% 99.03% Machine Learning • May 2018 • Katja Glaß Page 24

  25. Use Cases Where can we apply Machine Learning in our area? Machine Learning • May 2018 • Katja Glaß Page 25

  26. Use Cases CSS Working Group „ Machine Learning“ Educate for Future! Find use cases Drug discovery Drug candidate selection Clinical system optimization Medical image recognition Medical diagnoses Optimum site selection / recruitment Data anomaly detection Personalized medicine Machine Learning • May 2018 • Katja Glaß Page 26

  27. Use Cases More Use Cases Data mapping Coding Virtual monitoring / studies (medical devices) RWE evaluations (tons of data) Chat bots for questions / tickets Document search Machine Learning • May 2018 • Katja Glaß Page 27

  28. Use Cases CTCAE Grading Apply ML on available formula for learning (1) Investigate depending parameters for doctor’s required grading (2) Check doctor’s grading (3) Machine Learning • May 2018 • Katja Glaß Page 28

  29. Use Cases CTCAE Grading Apply ML on available formula for learning (1) Investigate depending parameters for doctor’s required grading (2) Check doctor’s grading (3) Positive Negative Challenge doctor’s decision? Learning opportunity with hands-on experiences (1) Lower machine-power / Laptop sufficient (1) (no clould required) Enough data available Machine Learning • May 2018 • Katja Glaß Page 29

  30. Use Cases Optimum site selection / recruitment Build up site / recruitment data pool ML to learn quality / expected recruitment on parameters Machine Learning • May 2018 • Katja Glaß Page 30

  31. Use Cases Optimum site selection / recruitment Build up site / recruitment data pool ML to learn quality / expected recruitment on parameters Challenges Get information of possible parameters/features General (no. of staff, fluctuation rate, urban catchment, …) Study specific (TAS, experts, experiences, past recruitment- time rate, …) Subject specific (dropout rate, screening failure rate, … ) Evaluation size, Cloud need Likely need “machine learning” optimized machine Machine Learning • May 2018 • Katja Glaß Page 31

Recommend

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

497 views • 26 slides
Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

567 views • 17 slides
Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

881 views • 29 slides
Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

405 views • 26 slides
CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

1/22/19 CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine Learning? A Simple Task: Recognize Obama How do you program a computer to Recognize faces? Recommend movies? Decide which web

584 views • 5 slides
Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their performance We use machine learning in situations where it is very challenging (or impossible) to define the rules by hand: e.g. face detection

1.05k views • 28 slides
Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 12 Outline 1 Nearest Neighbor Prediction 2 Complexity Considerations 3 The Voronoi Diagram 4 Overfitting

571 views • 12 slides
1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

What is Learning? Herbert Simon: Learning is any process by which a system improves performance from CS 391L: Machine Learning experience. Introduction What is the task? Classification Problem solving / planning /

603 views • 6 slides
MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

JACOPO DI IORIO, MATTEO FONTANA, DANIELE OCCHIUTO, CLAUDIA VOLPETTI MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING STATISTICAL LEARNING Separate evolutions, but with shared methodologies MERGE

565 views • 55 slides
Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine Learning? What is Machine Learning? Examples of machine learning applications: Facial recognition software E-mail spam detectors Automated

302 views • 17 slides
Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning 11.1 Learning agents 11.2 Inductive learning 11.3 Deep learning 11.4 Statistical learning 11.5 Reinforcement learning 11.6 Transfer learning

1.7k views • 159 slides
Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides
Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine learning refers to any system where the performance of a machine in performing a task improves by gaining more experience in performing that task .

396 views • 27 slides
MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING 2012 MACHINE LEARNING MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How to separate the red class from the grey class? x 2 360 r x 1 Polar coordinates Data

1.04k views • 44 slides
BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

photo:@rewardyfahmi // Unsplash BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest Neighbor Classifier Aykut Erdem // Hacettepe University // Fall 2019 When Do We Use Machine Learning? ML is

1.33k views • 110 slides
Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

554 views • 27 slides
Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in Practise Probabilities Finite Resource Machine Learning @ Amazon Forecasting Machine Translation Visual Systems Conclusions

348 views • 34 slides
Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

CS6501: Deep Learning for Visual Recognition Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning? Supervised Learning: Classification with K-nearest neighbors Unsupervised Learning: Clustering with

1.36k views • 91 slides
Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton

Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton

Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton with Nitish Srivastava Kevin Swersky What is Machine Learning? It is very hard to write programs that solve problems like recognizing a

514 views • 48 slides
MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am

MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am

MACHINE LEARNING MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am and last until 12h30 2 MACHINE LEARNING Exam Format The exam lasts a total of 40 minutes: -Upon entering the room, you pick at

920 views • 57 slides
Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell

Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell provided a widely accepted definition: A computer program is said to learn from

595 views • 24 slides
Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

MACHINE LEARNING TOOLBOX Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret R package Automates supervised learning (a.k.a. predictive modeling ) Target variable Machine Learning Toolbox

634 views • 16 slides
Overview CS 446 What is machine learning? Machine learning : study of computational

Overview CS 446 What is machine learning? Machine learning : study of computational

Overview CS 446 What is machine learning? Machine learning : study of computational mechanisms that learn from data to make predictions and decisions. 1 / 21 Application 1: image classification Birdwatcher takes photos of birds,

1.08k views • 83 slides
Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

MACHINE LEARNING MACHINE LEARNING Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult Children Detecting facial attributes He & Zhang, Pattern Recognition, 2011 Sony (Make Believe) Training set

914 views • 80 slides

More recommend