Recent Trends in Computer Vision and Deep Learning Systems Yangqing - PowerPoint PPT Presentation

Jul 06, 2023 •24 likes •424 views

Recent Trends in Computer Vision and Deep Learning Systems Yangqing Jia Lead Researcher and Manager of AI Platform, Facebook Computer Vision AlexNet So it begins. VGGNet Punch it. GoogLeNet We must go deeper. ResNet And we took the word

Recent Trends in Computer Vision and Deep Learning Systems Yangqing Jia Lead Researcher and Manager of AI Platform, Facebook
Computer Vision
AlexNet So it begins.
VGGNet Punch it.
GoogLeNet We must go deeper.
ResNet And we took the word seriously
ResNet And we took the word seriously
ResNeXT We totally see it coming
Pushing the Performance 28.2 16.4 7.3 6.7 3.57 3.03 ScSVM AlexNet VGGNet GoogLeNet ResNet ResNeXT
Why is it challenging? Gradients, as one example exploding ideal vanishing 1 3 5 7 9 11 13 15 depth
Deep Learning Systems
"SAP" - Scalability
Scalability Run fast, run far “How do I train on   multiple GPUs and machines?” - Probably the most question we got from Ca ff e users
Scalability Run fast, run far 1.2 million = (# of images in ImageNet1K) (# of new images @FB every 5 mins in 2013) (# of AI jobs per month @FB)
Scalability Run fast, run far L1 L2 L3 L3b L2b L1b U3 U2 U1
Scalability Run fast, run far L1 L2 L3 L3b L2b L1b R3 R2 R1 U3 U2 U1
Scalability Run fast, run far L1 L2 L3 L3b L2b L1b R3 R2 R1 U3 U2 U1 L1 L2 L3 L3b L2b L1b R3 R2 R1 U3 U2 U1
Scalability Run fast, run far L1 L2 L3 L3b L2b L1b R3 U3 R2 U2 R1 U1 L1 L2 L3 L3b L2b L1b R3 U3 R2 U2 R1 U1
The Return of MPI "I'm your father", said Allreduce. Allreduce Tree based - O(MlogN) Ring based - O(M) etc.
And so we scale
"SAP" - Arithmetics
Quantized Computation Forget about float, the world is bigger 8 23 float 5 10 fp16 16 fixed16 8 fixed8
Why do we care? Battery life is life. 0.9 float add 4.0 float mul 0.4 fp16 add 1.0 fp16 mul 0.05 fixed16 add 0.2 fixed8 mul 0.03 fixed8 add
How does it perform? Source: Nvidia https://devblogs.nvidia.com/parallelforall/mixed-precision-programming-cuda-8/
Why does it matter for cars? 250 watts 10 watts 10 -> 20 TFlops 0.7 -> 1.5 TFlops
"SAP" - Portability
Portable System One software to rule them all, and... AI Math and Algorithms Deployment Platforms
Portable System Cloud, Mobile, IoT, Cars, Drones, Co ff ee makers auto predictor =   caffe2::Predictor(model_file) public class Predictor implements   Model Caffe2ModelInterface;
The Land of Deep Learning System Not as complex as a car, but still. Applications Caffe, Torch, TF, etc... DataBases Core Math Comms Low Level LevelDB   Eigen   NCCL   CUDA RocksDB   CuDNN MPI   OpenGL Compilers Hadoop NNPack   ZeroMQ   OpenCL Amazon S3 THNN   Redis   Vulkan   your old disk MKL ... ...
Thank you! Recent Trends in Computer Vision and Deep Learning Systems Yangqing Jia

Recommend

Recent Trends in 3D Computer Vision and Deep Learning Introductory meeting Winter Semester

Recent Trends in 3D Computer Vision and Deep Learning Introductory meeting Winter Semester 2019/20 PD Dr. Habil. Federico Tombari Fabian Manhardt, Johanna Wald Goals You are going to learn: about relevant recent trends in the field

532 views • 13 slides

Deep Learning in Computer Vision Caner Hazrba Deep Learning in Action 24. June 15

Deep Learning in Computer Vision Caner Hazrba Deep Learning in Action 24. June 15 Computer Vision Group 6 Postdocs, 16 PhD students Caner Hazrba | vision.in.tum.de Deep Learning in Computer Vision 2 Research in Computer Vision

960 views • 30 slides

Impact of Deep Learning Speech Recogni4on Computer Vision

Impact of Deep Learning Speech Recogni4on Computer Vision Recommender Systems Language Understanding Drug Discovery and Medical Image

526 views • 21 slides

APPLICATIONS OF DEEP LEARNING TO COMPUTER VISION AND COMPUTER GRAPHICS Mike Houston Practical DEEP

APPLICATIONS OF DEEP LEARNING TO COMPUTER VISION AND COMPUTER GRAPHICS Mike Houston Practical DEEP LEARNING Examples Image Classification, Object Detection, Localization, Speech Recognition, Speech Translation, Action Recognition, Scene

886 views • 40 slides

Learning Where to Look and Listen: Egocentric and 360 Computer Vision Kristen Grauman Facebook

Learning Where to Look and Listen: Egocentric and 360 Computer Vision Kristen Grauman Facebook AI Research University of Texas at Austin Visual recognition: significant recent progress Big labeled Deep learning datasets ImageNet top-5

1k views • 61 slides

FUNDAMENTALS OF DEEP LEARNING FOR COMPUTER VISION Twin Karmakharm DLI Certified Instructor

FUNDAMENTALS OF DEEP LEARNING FOR COMPUTER VISION Twin Karmakharm DLI Certified Instructor This event is organised and run by... What we do: Project work and consultancy Training Deep Learning, HPC, GPU Deep Learning

651 views • 32 slides

Delving Deep into Computer Vision Caner Hazirbas Machine Learning Meetup #1 Delving Deep into

Delving Deep into Computer Vision Caner Hazirbas Machine Learning Meetup #1 Delving Deep into Computer Vision FlowNet FuseNet PoseLSTM DDFF Caner Hazirbas | hazirbas@cs.tum.edu Delving Deep into Computer Vision 2 Delving Deep into

1.14k views • 45 slides

EE-559 Deep learning 7. Networks for computer vision Fran cois Fleuret

EE-559 Deep learning 7. Networks for computer vision Fran cois Fleuret https://fleuret.org/dlc/ [version of: June 8, 2018] COLE POLYTECHNIQUE FDRALE DE LAUSANNE Tasks and data-sets Fran cois Fleuret EE-559 Deep learning

1.93k views • 170 slides

Deep learning in computer vision and natural language processing Yifeng Tao School of Computer

Introduction to Machine Learning Deep learning in computer vision and natural language processing Yifeng Tao School of Computer Science Carnegie Mellon University Slides adapted from Matt Gormley, Russ Salakhutdinov Yifeng Tao Carnegie

415 views • 40 slides

Deep Learning in Computer Vision Yikang Li MMLab, The Chinese University of Hong Kong Sep 22nd,

Deep Learning in Computer Vision Yikang Li MMLab, The Chinese University of Hong Kong Sep 22nd, 2017 @Microsoft Research Asia, China Outline 1. Introduction 2. Roadmap of Deep Learning 3. DL in CV: Object detection 4. DL in CV: Image

630 views • 45 slides

Deep Learning for Computer Vision UCA Master 2 Data Science INRIA Sophia Antipolis STARS team

1 Deep Learning for Computer Vision UCA Master 2 Data Science INRIA Sophia Antipolis STARS team S3.2 : 10 December / 25 February STARS Inria Research Team Objective : designing vision systems for the recognition of human activities

1.12k views • 29 slides

Deep multi-task learning with evolving weights Machine learning - computer vision published in

Deep multi-task learning with evolving weights Machine learning - computer vision published in European Symposium on Artificial Neural Networks (ESANN 2016) Soufiane Belharbi Romain Hrault Clment Chatelain Sbastien Adam

631 views • 44 slides

Deep learning 8.1. Computer vision tasks Fran cois Fleuret https://fleuret.org/dlc/ Dec 20,

Deep learning 8.1. Computer vision tasks Fran cois Fleuret https://fleuret.org/dlc/ Dec 20, 2020 Computer vision tasks: classification, object detection, semantic or instance segmentation, Fran cois Fleuret Deep learning /

426 views • 20 slides

Related topics: Marc Van Droogenbroecks Computer Vision and Louis Wehenkel/Pierre

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning with multi-layer (3~30) neural networks, on a huge training set. State-of-the-art on many AI tasks Computer Vision : Image Classification,

1.53k views • 23 slides

The Impact of the Open Set Recognition Problem on Deep Learning Walter J. Scheirer Computer

The Impact of the Open Set Recognition Problem on Deep Learning Walter J. Scheirer Computer Vision Research Laboratory, De partment of Computer Science and Engineering Benchmarks in computer vision Assume we have examples from all classes:

572 views • 25 slides

Deep Convolutional Neural Network for Computer Vision Products LI XU, R&D Director

Deep Convolutional Neural Network for Computer Vision Products LI XU, R&D Director SenseTime Group Limited SenseTime Introduction SenseTime focuses on invention and development of computer vision and deep learning technologies. Our

1.03k views • 39 slides

Recognition and Classification of Radioactive Waste using Computer Vision-based Deep Learning

Transactions of the Korean Nuclear Society Virtual Spring Meeting July 9-10, 2020 Recognition and Classification of Radioactive Waste using Computer Vision-based Deep Learning Technology Sung-Chan Jang a , Dong-ju Lee a , Il-Sik Kang a ,

52 views • 3 slides

Computer Vision Neurobio 230 Bill Lotter Exciting time: Neuroscience computer vision

Computer Vision Neurobio 230 Bill Lotter Exciting time: Neuroscience computer vision -Traditionally: computer vision relied on hand crafted features -Today: Deep Learning -loosely based on how the brain does computations -most of

556 views • 21 slides

Deep Learning in the Connected Kitchen or Launching a Computer Vision program in a new

Deep Learning in the Connected Kitchen or Launching a Computer Vision program in a new vertical Hristo Bojinov, CTO Company Vision The Problem Food People disconnect Not-so-smart smart kitchen Food info not available, not

491 views • 28 slides

Learning for Computer Vision Ramprasaath Lecture Outline Computer Vision Before

A Shallow Introduction to Deep Learning for Computer Vision Ramprasaath Lecture Outline Computer Vision Before (Image/Alex)Net era (Summer 1956-2012) After (Image/Alex)Net era (2012 present) Neural Networks (Brief

1.2k views • 96 slides

DSC 102 Systems for Scalable Analytics Arun Kumar Topic 6: Deep Learning Systems 1 Outline

DSC 102 Systems for Scalable Analytics Arun Kumar Topic 6: Deep Learning Systems 1 Outline Rise of Deep Learning Methods Deep Learning Systems: Specification Deep Learning Systems: Execution Future of Deep Learning Systems

561 views • 25 slides

CSE 802 Spring 2017 Deep Learning Inci M. Baytas Michigan State University February 13-15,

CSE 802 Spring 2017 Deep Learning Inci M. Baytas Michigan State University February 13-15, 2017 1 Deep Learning in Computer Vision Large-scale Video Classification with Convolutional Neural Networks, CVPR 2014 2 Deep Learning in Computer

918 views • 32 slides

Computer Vision and Deep Learning Introduction to Data Science 2019 University of Helsinki Mats

Computer Vision and Deep Learning Introduction to Data Science 2019 University of Helsinki Mats Sj oberg mats.sjoberg@csc.fi CSC IT Center for Science September 23, 2019 Computer vision Giving computers the ability to understand

642 views • 45 slides