full stack deep learning
play

Full Stack Deep Learning Lecture 1: Intro Pieter Abbeel, Sergey - PowerPoint PPT Presentation

Nov 09, 2023 •409 likes •747 views

Full Stack Deep Learning Lecture 1: Intro Pieter Abbeel, Sergey Karayev, Josh Tobin Organizer Intros Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 1 Guest Instructors Saturday Sunday Sunday

  1. Full Stack Deep Learning Lecture 1: Intro Pieter Abbeel, Sergey Karayev, Josh Tobin

  2. Organizer Intros Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 1

  3. Guest Instructors Saturday Sunday Sunday Saturday Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 2

  4. Thanks to our sponsors! Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 3

  5. Why deep learning? Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 4

  6. Why is AI hard to build? E.g. vision? “C “Coffe ffee Mug” Pi Pixel el Inten ensi sity Pi Pixel el inten ensi sity y is s a a ver very y po poor repr epresen esentat ation. [slide from Adam Coates] Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 5

  7. Object Detection in Computer Vision • State-of-the-art object detection until 2012: Support Hand-engineered “cat” Input Vector features (SIFT, “dog” Image Machine HOG, DAISY, …) “car” … (SVM) • Deep Supervised Learning (Krizhevsky, Sutskever, Hinton 2012; also LeCun, Bengio, Ng, Darrell, …): “cat” Input 8-layer neural network with 60 million “dog” Image parameters to learn “car” … • ~1.2 million training images from ImageNet [Deng, Dong, Socher, Li, Li, Fei-Fei, 2009] Pieter Abbeel -- Sergey Karayev -- Josh Tobin

  8. Neural Net Learning Image Recognition • Training / Learning: • Cars: labeled • Cats: data • Dogs: Machine Learning * Test Time: Label = Cat? Dog? Car? à à Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 7

  9. Many Layer Neural Network cat car dog nothing different weights à different computation Neural Net Training: Find the weights that minimize the difference between labels and activation. Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 8

  10. Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 9

  11. Performance graph credit Matt Zeiler, Clarifai Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 10

  12. Performance graph credit Matt Zeiler, Clarifai Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 11

  13. Performance graph credit Matt Zeiler, Clarifai Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 12

  14. MS COCO Image Captioning Challenge Karpathy & Fei-Fei, 2015; Donahue et al., 2015; Xu et al, 2015; many more Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 13

  15. Visual QA Challenge Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 14

  16. Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 15

  17. Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 16

  18. https://www.fda.gov/NewsEvents/Newsroom/PressAnnouncements/ucm604357.htm Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 17

  19. Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 18

  20. Speech Recognition graph credit Matt Zeiler, Clarifai Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 19

  21. Machine Translation Google Neural Machine Translation (in production) Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 20

  22. History (Olshausen, 1996) 2000s Sparse, Probabilistic, and Energy models (Hinton, Bengio, LeCun, Ng) Rosenblatt’s Perceptron based on history by K. Cho Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 21

  23. Why Now? • Data • Compute • Some new ideas Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 22

  24. [Source: domo.com] Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 23

  25. Compute [Source: OpenAI] Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 24

  26. Why this class? Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 25

  27. Why this class? Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 26

  28. Why this class? n Bring people together to talk about the challenges of working on ML projects n We want to help those who want to work in the field of deep learning get their dream job Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 27

  29. How we developed content n We talked to deep learning engineers and leaders at Airspace, Symbio, Determined.ai, W&B, Forethought.ai, DeepScale, Google, Ancestry, Lambda Labs, Bloomberg Beta, Rent the Runway, Magic Leap, Facebook, Tesla, Uber, OpenAI, and more. Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 28

  30. Schedule Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 29

  31. Logistics Make sure you’re in our Slack workspace (email team@fullstackdeeplearning.com if you’re not) Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 30

  32. Questions? Full Stack Deep Learning (March 2019) Pieter Abbeel, Sergey Karayev, Josh Tobin L1: Intro 31

Recommend

Full Stack Deep Learning Troubleshooting Deep Neural Networks Josh Tobin, Sergey Karayev, Pieter

Full Stack Deep Learning Troubleshooting Deep Neural Networks Josh Tobin, Sergey Karayev, Pieter

Full Stack Deep Learning Troubleshooting Deep Neural Networks Josh Tobin, Sergey Karayev, Pieter Abbeel Lifecycle of a ML project Cross-project Per-project infrastructure activities Planning & Team & hiring project setup Data

1.66k views • 142 slides
A. Job Title: Junior Full Stack Developer The Junior Full Stack Developer will be advised by the

A. Job Title: Junior Full Stack Developer The Junior Full Stack Developer will be advised by the

Job Description - Jr. Full Stack Developer 7/23/2020 A. Job Title: Junior Full Stack Developer The Junior Full Stack Developer will be advised by the Full Stack Developer - a professional who works on both client-side and server-side software

525 views • 4 slides
Evaluate Deep Q-Learning for Sequential Targeted Marketing with 10-fold Cross Validation

Evaluate Deep Q-Learning for Sequential Targeted Marketing with 10-fold Cross Validation

Agent Actions Evaluate Deep Q-Learning for Sequential Targeted Marketing with 10-fold Cross Validation Rewards Observations Jian Wu Full Stack Engineer Marketing Environment The idea of this talk was developed at Samsung SDSRA AI Lab

208 views • 19 slides
Deep Learning: State of the Art (2020) Deep Learning Lecture Series https://deeplearning.mit.edu

Deep Learning: State of the Art (2020) Deep Learning Lecture Series https://deeplearning.mit.edu

Deep Learning: State of the Art (2020) Deep Learning Lecture Series https://deeplearning.mit.edu 2020 For the full list of references visit: http://bit.ly/deeplearn-sota-2020 Outline Deep Learning Growth, Celebrations, and Limitations

1.1k views • 87 slides
TVM Deep Learning on Bare-Metal Devices Pratyush Patel No OS stack Extend TVM to support

TVM Deep Learning on Bare-Metal Devices Pratyush Patel No OS stack Extend TVM to support

TVM Deep Learning on Bare-Metal Devices Pratyush Patel No OS stack Extend TVM to support bare-metal devices Optimization High-Level Differentiable IR AutoTVM Tensor Expression IR LLVM, CUDA VTA AutoVTA Hardware FPGA ASIC Fleet

1.46k views • 18 slides
End to End Optimization Stack for Deep Learning Presenter: Tianqi Chen Paul G. Allen School of

End to End Optimization Stack for Deep Learning Presenter: Tianqi Chen Paul G. Allen School of

End to End Optimization Stack for Deep Learning Presenter: Tianqi Chen Paul G. Allen School of Computer Science & Engineering University of Washington Collaborators University of Washington AWS AI Team Ziheng Jiang Tianqi Chen Thierry

822 views • 46 slides
Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Deep 3D Representation Learning for Visual Computing Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms Conclusion 2 Outline Overview of 3D deep learning Background 3D deep learning tasks 3D deep

1.66k views • 122 slides
From Specification to Code put(x: G) -- add x to stack require -- precondition (and back

From Specification to Code put(x: G) -- add x to stack require -- precondition (and back

class STACK[G] -- A stack of Gs count: INTEGER empty: BOOLEAN -- true if empty full: BOOLEAN -- true if full From Specification to Code put(x: G) -- add x to stack require -- precondition (and back again) not full do

474 views • 23 slides
ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY MEDIA & ENTERTAINMENT SECURITY & DEFENSE AUTONOMOUS MACHINES Image

307 views • 26 slides
Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice Scaling up DL 2 What is Deep Learning? 3 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY SECURITY & DEFENSE MEDIA &

1.45k views • 39 slides
Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning

Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning

Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning Methods) Peter Henderson Statistical Society of Canada Annual Meeting 2018 Contributors Riashat Islam Phil Bachman Doina Precup David Meger Joelle

850 views • 37 slides
Stack: Resize scale by constant Original size c then increase by c when full Run time to push n

Stack: Resize scale by constant Original size c then increase by c when full Run time to push n

Stack: Resize scale by constant Original size c then increase by c when full Run time to push n items into an empty stack? Number of resizes: Cost of i th resize: Total resize cost: 1 Stack summary Linked list implementation: Array

412 views • 6 slides
Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI Mission Helping people solve challenging problems using AI and deep learning. Developers, data scientists and engineers Self-driving cars,

1.44k views • 72 slides
Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and Courville [chapt. 6,7,8]; AIMA [sect. 21.1-21.3]; Sutton and Barto, Reinforcement Learning: an

527 views • 35 slides
Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin

Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin

Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin Clark Deep Learning for NLP 5 years ago No Seq2Seq No Attention No large-scale QA/reading comprehension datasets No TensorFlow or

1.41k views • 92 slides
An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning Microsoft Research Asia (MSRA) Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. Deep Residual Learning for Image Recognition. arXiv

1.32k views • 54 slides
Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree

Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree

Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree Search, Nature 2016] CS 486/686 University of Waterloo Lecture 21: July 12, 2017 Outline AlphaGo Supervised Learning of Policy Networks

540 views • 15 slides
Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning with multi-layer (3~30) neural networks, on a huge training set. State-of-the-art on many AI tasks Computer Vision : Image Classification,

1.53k views • 23 slides
Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL

Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL

Tofu: Parallelizing Deep Learning Systems with Automatic Tiling Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL system is based on dataflow GPU#0 w1 w2 data g1 g2 Forward propagation

405 views • 38 slides
Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations deeplearning.cce2020@gmail.com Deep Networks Intuition Neural networks with multiple hidden layers - Deep networks [Hinton, 2006] Deep Networks Intuition

1.33k views • 28 slides
12. Unsupervised Deep Learning CS 535 Deep Learning, Winter 2018 Fuxin Li With materials from

12. Unsupervised Deep Learning CS 535 Deep Learning, Winter 2018 Fuxin Li With materials from

12. Unsupervised Deep Learning CS 535 Deep Learning, Winter 2018 Fuxin Li With materials from Wanli Ouyang, Zsolt Kira, Lawrence Neal, Raymond Yeh, Junting Lou and Teck-Yian Lim Unsupervised Learning in General Unsupervised learning is

1.48k views • 115 slides
Regularization for Deep Learning Lecture slides for Chapter 7 of Deep Learning

Regularization for Deep Learning Lecture slides for Chapter 7 of Deep Learning

Regularization for Deep Learning Lecture slides for Chapter 7 of Deep Learning www.deeplearningbook.org Ian Goodfellow 2016-09-27 Definition Regularization is any modification we make to a learning algorithm that is intended to reduce

179 views • 13 slides
Introduction to Deep Learning Outline Deep Learning RNN CNN Attention

Introduction to Deep Learning Outline Deep Learning RNN CNN Attention

Introduction to Deep Learning Outline Deep Learning RNN CNN Attention Transformer Pytorch Introduction Basics Examples RNNs Some slides borrowed from Fei-Fei Li & Justin Johnson &

1.1k views • 55 slides
Deep learning for NLP: Introduction CS 6956: Deep Learning for NLP Words are a very fantastical

Deep learning for NLP: Introduction CS 6956: Deep Learning for NLP Words are a very fantastical

Deep learning for NLP: Introduction CS 6956: Deep Learning for NLP Words are a very fantastical banquet, just so many strange dishes And yet, we seem to do fine We can understand and generate language effortlessly. Almost 1 Wouldnt it be

1.62k views • 52 slides

More recommend