deep learning demystified
play

DEEP LEARNING DEMYSTIFIED Will Ramey Director, Developer Programs - PowerPoint PPT Presentation

Apr 11, 2023 •282 likes •532 views

DEEP LEARNING DEMYSTIFIED Will Ramey Director, Developer Programs NVIDIA Corporation DEFINITIONS DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine Media & Entertainment Security & Defense Autonomous Machines

  1. DEEP LEARNING DEMYSTIFIED Will Ramey Director, Developer Programs NVIDIA Corporation

  2. DEFINITIONS

  3. DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine Media & Entertainment Security & Defense Autonomous Machines ➢ Image/Video classification ➢ Cancer cell detection ➢ Video captioning ➢ Face recognition ➢ Pedestrian detection ➢ Speech recognition ➢ Diabetic grading ➢ Content based search ➢ Video surveillance ➢ Lane tracking ➢ Natural language processing ➢ Drug discovery ➢ Real time translation ➢ Cyber security ➢ Recognize traffic signs

  4. DEEP LEARNING IS TRANSFORMING HPC 92% believe AI will impact their work 93% using deep learning seeing positive results insideHPC.com Survey Accelerating Drug Discovery “Seeing” Gravity In Real Time November 2016

  5. AI IS CRITICAL FOR INTERNET APPLICATIONS Users Expect Intelligence In Services

  7. A NEW COMPUTING MODEL Algorithms that Learn from Examples Traditional Approach ➢ Requires domain experts Expert Written ➢ Time consuming Computer ➢ Error prone Program ➢ Not scalable to new problems

  8. A NEW COMPUTING MODEL Algorithms that Learn from Examples Traditional Approach ➢ Requires domain experts Expert Written ➢ Time consuming Computer ➢ Error prone Program ➢ Not scalable to new problems Deep Learning Approach ✓ Learn from data ✓ Easily to extend ✓ Speedup with GPUs Deep Neural Network

  9. HOW IT WORKS

  10. HOW IT WORKS

  11. HOW IT WORKS

  12. HOW IT WORKS

  13. CHALLENGES Deep Learning Needs Why Data Scientists New computing model Latest Algorithms Rapidly evolving Fast Training Impossible -> Practical Deployment Platforms Must be available everywhere

  14. NVIDIA DEEP LEARNING INSTITUTE Hands-on Training for Data Scientists and Software Engineers Helping the world to solve challenging problems using AI and deep learning On-site workshops and online courses presented by certified instructors Covering complete workflows for proven application use cases Self-Driving Cars, Healthcare, Intelligent Video Analytics, IoT/Robotics, Finance and more www.nvidia.com/dli

  15. ADVANCE YOUR DEEP LEARNING TRAINING AT GTC Don’t miss the world’s most important event for GPU developers Silicon Valley, May 8-11 Israel, October 18 Washington DC, November 1-2 Beijing, September 26-27 Munich, October 10-11 Tokyo, December 12-13

  16. DEEP LEARNING SOFTWARE developer.nvidia.com/deep-learning

  17. END-TO-END PRODUCT FAMILY TRAINING INFERENCE FULLY INTERGRATED DL SUPERCOMPUTER DATA CENTER EMBEDDED AUTOMOTIVE DESKTOP DATA CENTER Tesla P100 Drive PX Jetson TX Tesla P4 Titan X Pascal Tesla P100 Tesla P100

  18. CHALLENGES Deep Learning Needs Why Data Scientists New computing model Latest Algorithms Rapidly evolving Fast Training Impossible -> Practical Deployment Platforms Must be available everywhere

  19. CHALLENGES Deep Learning Needs NVIDIA Delivers Deep Learning Needs Why Data Scientists Deep Learning Institute, GTC, DIGITS Data Scientists Demand far exceeds supply Latest Algorithms DL SDK, GPU-Accelerated Frameworks Latest Algorithms Rapidly evolving Fast Training DGX, P100, TITAN X Fast Training Impossible -> Practical Deployment Platforms TensorRT , P100, P4, Drive PX, Jetson Deployment Platform Must be available everywhere

  20. READY TO GET STARTED? Project Checklist 1. What problem are you solving, what are the DL tasks? 2. On what platform(s) will you train and deploy? 3. What data do you have/need, and how is it labeled? 4. Which deep learning framework & tools will you use?

  21. WHAT PROBLEM ARE SOLVING? Defining the AI/DL Tasks EXAMPLE QUESTION AI/DL TASK INPUTS OUTPUTS Is “it” present Detection Cancer Detection or not? What type of thing Tumor Classification Identification is “it”? Text Data Images To what extent Tumor Size/Shape Segmentation Analysis is “it” present? What is the likely Survivability Prediction Prediction outcome? Video Audio What will likely Therapy Recommendation Recommendation satisfy the objective?

  22. SELECTING A DEEP LEARNING FRAMEWORK Considerations 1. Type of problem 2. Training & deployment platforms 3. DNN models available, layer types supported 4. Latest algos & GPU acceleration: cuDNN, NCCL, etc. 5. Usage model/interfaces: GUI, command line, programming language, etc. 6. Easy to install and get started: containers, docs, code samples, tutorials, … 7. Enterprise integration, vendors, ecosystem

  23. START SIMPLE, LEARN FAST How One NVIDIAN Uses Deep Learning to Keep Cats from Pooping on His Lawn

  24. www.nvidia.com/dli

Recommend

Deep Learning (Partly) Need for Pooling Demystified Which Pooling . . . Pooling Four Values

Deep Learning (Partly) Need for Pooling Demystified Which Pooling . . . Pooling Four Values

Overview Traditional Neural . . . Why Go Beyond . . . Which Activation . . . Deep Learning (Partly) Need for Pooling Demystified Which Pooling . . . Pooling Four Values Sensitivity of Deep . . . Vladik Kreinovich How to Deal with . . .

390 views • 35 slides
Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Deep 3D Representation Learning for Visual Computing Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms Conclusion 2 Outline Overview of 3D deep learning Background 3D deep learning tasks 3D deep

1.66k views • 122 slides
ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY MEDIA & ENTERTAINMENT SECURITY & DEFENSE AUTONOMOUS MACHINES Image

308 views • 26 slides
Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice Scaling up DL 2 What is Deep Learning? 3 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY SECURITY & DEFENSE MEDIA &

1.45k views • 39 slides
Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning

Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning

Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning Methods) Peter Henderson Statistical Society of Canada Annual Meeting 2018 Contributors Riashat Islam Phil Bachman Doina Precup David Meger Joelle

850 views • 37 slides
Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI Mission Helping people solve challenging problems using AI and deep learning. Developers, data scientists and engineers Self-driving cars,

1.44k views • 72 slides
Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and Courville [chapt. 6,7,8]; AIMA [sect. 21.1-21.3]; Sutton and Barto, Reinforcement Learning: an

527 views • 35 slides
Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin

Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin

Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin Clark Deep Learning for NLP 5 years ago No Seq2Seq No Attention No large-scale QA/reading comprehension datasets No TensorFlow or

1.41k views • 92 slides
An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning Microsoft Research Asia (MSRA) Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. Deep Residual Learning for Image Recognition. arXiv

1.32k views • 54 slides
Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree

Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree

Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree Search, Nature 2016] CS 486/686 University of Waterloo Lecture 21: July 12, 2017 Outline AlphaGo Supervised Learning of Policy Networks

541 views • 15 slides
Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning with multi-layer (3~30) neural networks, on a huge training set. State-of-the-art on many AI tasks Computer Vision : Image Classification,

1.53k views • 23 slides
Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL

Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL

Tofu: Parallelizing Deep Learning Systems with Automatic Tiling Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL system is based on dataflow GPU#0 w1 w2 data g1 g2 Forward propagation

405 views • 38 slides
Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations deeplearning.cce2020@gmail.com Deep Networks Intuition Neural networks with multiple hidden layers - Deep networks [Hinton, 2006] Deep Networks Intuition

1.33k views • 28 slides
Deep Learning: State of the Art (2020) Deep Learning Lecture Series https://deeplearning.mit.edu

Deep Learning: State of the Art (2020) Deep Learning Lecture Series https://deeplearning.mit.edu

Deep Learning: State of the Art (2020) Deep Learning Lecture Series https://deeplearning.mit.edu 2020 For the full list of references visit: http://bit.ly/deeplearn-sota-2020 Outline Deep Learning Growth, Celebrations, and Limitations

1.1k views • 87 slides
12. Unsupervised Deep Learning CS 535 Deep Learning, Winter 2018 Fuxin Li With materials from

12. Unsupervised Deep Learning CS 535 Deep Learning, Winter 2018 Fuxin Li With materials from

12. Unsupervised Deep Learning CS 535 Deep Learning, Winter 2018 Fuxin Li With materials from Wanli Ouyang, Zsolt Kira, Lawrence Neal, Raymond Yeh, Junting Lou and Teck-Yian Lim Unsupervised Learning in General Unsupervised learning is

1.48k views • 115 slides
Regularization for Deep Learning Lecture slides for Chapter 7 of Deep Learning

Regularization for Deep Learning Lecture slides for Chapter 7 of Deep Learning

Regularization for Deep Learning Lecture slides for Chapter 7 of Deep Learning www.deeplearningbook.org Ian Goodfellow 2016-09-27 Definition Regularization is any modification we make to a learning algorithm that is intended to reduce

179 views • 13 slides
Introduction to Deep Learning Outline Deep Learning RNN CNN Attention

Introduction to Deep Learning Outline Deep Learning RNN CNN Attention

Introduction to Deep Learning Outline Deep Learning RNN CNN Attention Transformer Pytorch Introduction Basics Examples RNNs Some slides borrowed from Fei-Fei Li & Justin Johnson &

1.1k views • 55 slides
Deep learning for NLP: Introduction CS 6956: Deep Learning for NLP Words are a very fantastical

Deep learning for NLP: Introduction CS 6956: Deep Learning for NLP Words are a very fantastical

Deep learning for NLP: Introduction CS 6956: Deep Learning for NLP Words are a very fantastical banquet, just so many strange dishes And yet, we seem to do fine We can understand and generate language effortlessly. Almost 1 Wouldnt it be

1.62k views • 52 slides
Deep Reinforcement Learning and Complex Environments Raia Hadsell End-to-end Deep Learning

Deep Reinforcement Learning and Complex Environments Raia Hadsell End-to-end Deep Learning

Deep Reinforcement Learning and Complex Environments Raia Hadsell End-to-end Deep Learning for robots? slide from V. Vanhoucke End-to-end Deep Learning for robots? 2010 : Speech Recognition Audio Acoustic Model Phonetic Model

1.05k views • 65 slides
Bayesian Deep Learning Mohd Adnan Problems With Deep Learning What does a model not know?

Bayesian Deep Learning Mohd Adnan Problems With Deep Learning What does a model not know?

Bayesian Deep Learning Mohd Adnan Problems With Deep Learning What does a model not know? Uninterpretable black-boxes Easily fooled (AI safety) Lacks solid mathematical foundation Crucially relies on big dat Why

297 views • 15 slides
Deep Learning on Massively Parallel Processing Databases Frank McQuillan Feb 2019 2 A Brief

Deep Learning on Massively Parallel Processing Databases Frank McQuillan Feb 2019 2 A Brief

Deep Learning on Massively Parallel Processing Databases Frank McQuillan Feb 2019 2 A Brief Introduction to Deep Learning Artificial Intelligence Landscape Deep Learning 4 Example Deep Learning Algorithms Multilayer Recurrent

651 views • 44 slides
Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan Zelener Machine Learning Reading Group January 7 th 2016 The Graduate Center, CUNY Objectives Explain some of the trends of deep learning and

680 views • 44 slides
DSSTNE: Deep Learning At Scale For Large Sparse Datasets

DSSTNE: Deep Learning At Scale For Large Sparse Datasets

DSSTNE: Deep Learning At Scale For Large Sparse Datasets https://github.com/amznlabs/amazon-dsstne Scott Le Grand Senior Scientist Teza Technologies varelse2005@gmail.com Outline What's Deep Learning? Why GPUs? Deep Learning for

1.55k views • 76 slides
Deep Learning With Differential Privacy Presenter: Xiaojun Xu Deep Learning Framework

Deep Learning With Differential Privacy Presenter: Xiaojun Xu Deep Learning Framework

Deep Learning With Differential Privacy Presenter: Xiaojun Xu Deep Learning Framework Autonomous Driving Gaming Face Recognition Healthcare Deep Learning Framework Dataset Server Model Privacy Issues of Training Data Dataset Server

367 views • 33 slides

More recommend