cs6501 deep learning for visual recognition
play

CS6501: Deep Learning for Visual Recognition Recurrent Neural - PowerPoint PPT Presentation

Feb 05, 2024 •565 likes •793 views

CS6501: Deep Learning for Visual Recognition Recurrent Neural Networks (RNNs) Todays Class Recurrent Neural Network Cell Recurrent Neural Networks (RNNs) Bi-Directional Recurrent Neural Networks (Bi-RNNs) Multiple-layer /

  1. CS6501: Deep Learning for Visual Recognition Recurrent Neural Networks (RNNs)

  2. Today’s Class • Recurrent Neural Network Cell • Recurrent Neural Networks (RNNs) • Bi-Directional Recurrent Neural Networks (Bi-RNNs) • Multiple-layer / Stacked / Deep Bi-Direction Recurrent Neural Networks • LSTMs and GRUs. • Applications in Vision: Caption Generation.

  3. ACM Turing Award 2019 Geoff Hinton Backpropagation Yann LeCun Yoshua Bengio CNNs GANs

  4. Recurrent Neural Network Cell ℎ & ℎ " #$$ ! "

  5. Recurrent Neural Network Cell ℎ " = tanh (. // ℎ & + . /1 ! " ) ℎ & ℎ " #$$ ! "

  6. Recurrent Neural Network Cell 3 " ℎ " ℎ & ℎ " #$$ ℎ " = tanh (. // ℎ & + . /1 ! " ) ! " 3 " = softmax (. /9 ℎ " )

  7. Recurrent Neural Network Cell ' " ℎ " ℎ & ℎ " #$$ ! "

  8. Recurrent Neural Network Cell e (0.7) - $ = [0.1, 0.05, 0.05, 0.1, 0.7] ℎ $ = [0.1 0.2 0 − 0.3 − 0.1 ] ℎ , = [0 0 0 0 0 0 0 ] ℎ $ = [0.1 0.2 0 − 0.3 − 0.1 ] !"" # $ = [0 0 1 0 0] a b c d e c

  9. Recurrent Neural Network Cell ' " ℎ " ℎ & ℎ " #$$ ! "

  10. Recurrent Neural Network Cell ℎ " ℎ & ℎ " #$$ ! "

  11. (Unrolled) Recurrent Neural Network a t <<space>> ) " ) ' ) ( ℎ " ℎ ' ℎ ( ℎ & ℎ " ℎ ' ℎ ( #$$ #$$ #$$ ! " ! ' ! ( c a t

  12. (Unrolled) Recurrent Neural Network cat likes eating ) " ) ' ) ( ℎ " ℎ ' ℎ ( ℎ & ℎ " ℎ ' ℎ ( #$$ #$$ #$$ ! " ! ' ! ( the cat likes

  13. (Unrolled) Recurrent Neural Network positive / negative sentiment rating ) ℎ ( ℎ & ℎ " ℎ ' ℎ ( #$$ #$$ #$$ ! " ! ' ! ( the cat likes

  14. Bidirectional Recurrent Neural Network comer gato quiere + " + ( + * ℎ " ℎ ( ℎ * ℎ ' ℎ " ℎ ( ℎ * #$%% B$%% #$%% ! " ! ( ! * wants the cat

  15. Stacked Recurrent Neural Network ) " ) ' ) ( ℎ " ℎ ' ℎ ( ℎ * ℎ " ℎ ' ℎ ( #$$ #$$ #$$ & " & ' & ( ℎ ℎ ℎ & " & * & ' & ( ℎ ℎ ℎ ℎ #$$ #$$ #$$ ! " ! ' ! ( c a t

  16. Stacked Bidirectional Recurrent Neural Network ) " ) ' ) ( ℎ " ℎ ' ℎ ( ℎ * ℎ " ℎ ' ℎ ( #$$ #$$ #$$ & " & ' & ( ℎ ℎ ℎ & " & * & ' & ( ℎ ℎ ℎ ℎ #$$ #$$ #$$ ! " ! ' ! ( c a t

  17. RNN in Pytorch

  18. LSTM Cell (Long Short-Term Memory) ℎ " ℎ ( #$%& ) ( ) " ! "

  19. LSTM in Pytorch

  20. GRU in Pytorch

  21. Questions? 21

Recommend

CS6501: Deep Learning for Visual Recognition Seq2Seq Model &amp; Text-to-Image Synthesis

CS6501: Deep Learning for Visual Recognition Seq2Seq Model &amp; Text-to-Image Synthesis

CS6501: Deep Learning for Visual Recognition Seq2Seq Model &amp; Text-to-Image Synthesis Presenter: Fuwen Tan Todays Class Mini-batch training of the RNN model Special End-of-Sequence token: &lt;end&gt; Padding

525 views • 40 slides
CS6501: Deep Learning for Visual Recognition Recognizing People in Images Todays Class

CS6501: Deep Learning for Visual Recognition Recognizing People in Images Todays Class

CS6501: Deep Learning for Visual Recognition Recognizing People in Images Todays Class Face Detection Face Matching - and any type of matching Pose estimation Face Detection Face Detection: Viola-Jones Face Detector circa 2001

850 views • 28 slides
CS6501: Deep Learning for Visual Recognition Recurrent Neural Networks (RNNs) Todays Class

CS6501: Deep Learning for Visual Recognition Recurrent Neural Networks (RNNs) Todays Class

CS6501: Deep Learning for Visual Recognition Recurrent Neural Networks (RNNs) Todays Class Recurrent Neural Network Cell Recurrent Neural Networks (RNNs) Bi-Directional Recurrent Neural Networks (Bi-RNNs) Multiple-layer /

583 views • 47 slides
CS6501: Deep Learning for Visual Recognition Object Detection: RCNN, Fast-RCNN, Faster-RCNN

CS6501: Deep Learning for Visual Recognition Object Detection: RCNN, Fast-RCNN, Faster-RCNN

CS6501: Deep Learning for Visual Recognition Object Detection: RCNN, Fast-RCNN, Faster-RCNN Todays Class Object Detection The RCNN Object Detector (2014) The Fast RCNN Object Detector (2015) The Faster RCNN Object Detector

747 views • 29 slides
Visual deep learning models, in particular for face recognition and models of invariant

Visual deep learning models, in particular for face recognition and models of invariant

Visual deep learning models, in particular for face recognition and models of invariant recognition in the ventral stream Center Name Presenter Name Towards a theory of the above tomaso poggio, CBMM, BCS, CSAIL, McGovern MIT Plan

1.14k views • 81 slides
Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

CS6501: Deep Learning for Visual Recognition Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning? Supervised Learning: Classification with K-nearest neighbors Unsupervised Learning: Clustering with

1.36k views • 91 slides
Deep learning for visual recognition Thurs April 27 Kristen Grauman UT Austin Last time

Deep learning for visual recognition Thurs April 27 Kristen Grauman UT Austin Last time

4/26/2017 Deep learning for visual recognition Thurs April 27 Kristen Grauman UT Austin Last time Support vector machines (wrap-up) Pyramid match kernels Evaluation Scoring an object detector Scoring a multi-class

377 views • 16 slides
Deep Convolutional Networks and their impact on solving large scale visual recognition problems

Deep Convolutional Networks and their impact on solving large scale visual recognition problems

IDA Machine Learning Seminars - Fall 2015 Deep Convolutional Networks and their impact on solving large scale visual recognition problems Hossien Azizpour, Computer Vision Group , KTH . Thanks to: J. Sullivan, A. S. Razavian, A. Maki and S.

1.13k views • 96 slides
Learning Deep Features for Scene Recognition using Places Database Bolei Zhou, Agata Lapedriza,

Learning Deep Features for Scene Recognition using Places Database Bolei Zhou, Agata Lapedriza,

Learning Deep Features for Scene Recognition using Places Database Bolei Zhou, Agata Lapedriza, Jianxiong Xiao, Antonio Torralba, Aude Oliva NIPS2014 Bora elikkale INTRODUCTION Human Visual Recognition Samples world several times / sec

697 views • 20 slides
Visual Learning with Unlabeled Video and Look-Around Policies Kristen Grauman Department of

Visual Learning with Unlabeled Video and Look-Around Policies Kristen Grauman Department of

Visual Learning with Unlabeled Video and Look-Around Policies Kristen Grauman Department of Computer Science University of Texas at Austin Visual recognition: significant recent progress Big labeled Deep learning datasets ImageNet top-5

804 views • 52 slides
Stochastic Gradient Descent (SGD) Todays Class Stochastic Gradient Descent (SGD) SGD Recap

Stochastic Gradient Descent (SGD) Todays Class Stochastic Gradient Descent (SGD) SGD Recap

CS6501: Deep Learning for Visual Recognition Stochastic Gradient Descent (SGD) Todays Class Stochastic Gradient Descent (SGD) SGD Recap Regression vs Classification Generalization / Overfitting / Underfitting Regularization

633 views • 30 slides
Object Recognition/Detection Radovan Fusek 2 nd International summer school on &quot;Deep Learning

Object Recognition/Detection Radovan Fusek 2 nd International summer school on &quot;Deep Learning

Object Recognition/Detection Radovan Fusek 2 nd International summer school on &quot;Deep Learning and Visual Data Analysis&quot; 2018 Our work presented here was partially supported by the EU H2020 686782 PACMAN project, (solved with

1.04k views • 81 slides
DeViSE: A Deep Visual-Semantic Embedding Model Presenters: Ji Gao, Fandi Lin Motivation Visual

DeViSE: A Deep Visual-Semantic Embedding Model Presenters: Ji Gao, Fandi Lin Motivation Visual

DeViSE: A Deep Visual-Semantic Embedding Model Presenters: Ji Gao, Fandi Lin Motivation Visual recognition systems experience problems with large amount of categories. Insufficient labeled training data Blurred distinction between

328 views • 16 slides
Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Deep 3D Representation Learning for Visual Computing Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms Conclusion 2 Outline Overview of 3D deep learning Background 3D deep learning tasks 3D deep

1.66k views • 122 slides
Learning about images from keyword-based Web search CS 395T: Visual Recognition and Search

Learning about images from keyword-based Web search CS 395T: Visual Recognition and Search

Learning about images from keyword-based Web search CS 395T: Visual Recognition and Search February 15, 2008 David Chen Problems with traditional training data for object recognition Time-consuming and difficult to construct Collect

530 views • 32 slides
Knowledge Transfer for Visual Recognition The University of Tokyo RIKEN AIP (Team leader of

Knowledge Transfer for Visual Recognition The University of Tokyo RIKEN AIP (Team leader of

IIT-H and RIKEN-AIP Joint Workshop on Machine Learning and Applications March 15, 2019 Knowledge Transfer for Visual Recognition The University of Tokyo RIKEN AIP (Team leader of Medical Machine Intelligence) Tatsuya Harada Deep Neural Networks

195 views • 15 slides
An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning Microsoft Research Asia (MSRA) Kaiming He, Xiangyu Zhang, Shaoqing Ren, &amp; Jian Sun. Deep Residual Learning for Image Recognition. arXiv

1.32k views • 54 slides
Deep Visual Learning on Hypersphere Weiyang Liu*, Zhen Liu* College of Computing Georgia

Deep Visual Learning on Hypersphere Weiyang Liu*, Zhen Liu* College of Computing Georgia

Deep Visual Learning on Hypersphere Weiyang Liu*, Zhen Liu* College of Computing Georgia Institute of Technology 1 Outline Why Learning on Hypersphere Loss Design - Large-Margin Learning on Hypersphere Convolution Operator - Deep

592 views • 47 slides
16-824:Visual Learning and Recognition Many slides from A. Farhadi, A. Efros Course Information

16-824:Visual Learning and Recognition Many slides from A. Farhadi, A. Efros Course Information

16-824:Visual Learning and Recognition Many slides from A. Farhadi, A. Efros Course Information Time: Monday, Wednesday 1:30-2:50 Location: NSH 1305 Office Hours: Email me for appointments Contact: abhinavg@cs ,

865 views • 74 slides
Image Processing Todays Class Image Representations: Matrices Image Representations: RGB,

Image Processing Todays Class Image Representations: Matrices Image Representations: RGB,

CS6501: Deep Learning for Visual Recognition Image Processing Todays Class Image Representations: Matrices Image Representations: RGB, HSV, etc Image Processing: Brightness Image Filtering: Mean Filter, Median Filter Image Filtering:

959 views • 77 slides
Learning from Fine-Grained and Long-Tailed Visual Data Yin Cui Google Research Dec 11 2019

Learning from Fine-Grained and Long-Tailed Visual Data Yin Cui Google Research Dec 11 2019

Learning from Fine-Grained and Long-Tailed Visual Data Yin Cui Google Research Dec 11 2019 Visual Recognition System Database Supervised Learning Convolutional Neural bird Network (CNN) Visual Recognition System Larger Database

532 views • 36 slides
APPLICATIONS OF DEEP LEARNING TO COMPUTER VISION AND COMPUTER GRAPHICS Mike Houston Practical DEEP

APPLICATIONS OF DEEP LEARNING TO COMPUTER VISION AND COMPUTER GRAPHICS Mike Houston Practical DEEP

APPLICATIONS OF DEEP LEARNING TO COMPUTER VISION AND COMPUTER GRAPHICS Mike Houston Practical DEEP LEARNING Examples Image Classification, Object Detection, Localization, Speech Recognition, Speech Translation, Action Recognition, Scene

886 views • 40 slides
Multimodal Learning for Image Captioning and Visual Question Answering Xiaodong He Deep Learning

Multimodal Learning for Image Captioning and Visual Question Answering Xiaodong He Deep Learning

Multimodal Learning for Image Captioning and Visual Question Answering Xiaodong He Deep Learning T echnology Center Microsoft Research UC Berkeley, April 7 th , 2016 Knowledge Freebase Text Vision Barack Obama is an American politician

882 views • 50 slides
Learning Semantic Visual Codebook for Action Recognition by Embedding into Concept Space Behrouz

Learning Semantic Visual Codebook for Action Recognition by Embedding into Concept Space Behrouz

Learning Semantic Visual Codebook for Action Recognition by Embedding into Concept Space Behrouz Saghafi Using Spatio-temporal Features Action recognition using silhouettes or optical flow encounters difficulties when dealing with non-uniform

556 views • 27 slides

More recommend