ammi introduction to deep learning 7 3 networks for
play

AMMI Introduction to Deep Learning 7.3. Networks for object - PowerPoint PPT Presentation

Jun 15, 2023 •164 likes •656 views

AMMI Introduction to Deep Learning 7.3. Networks for object detection Fran cois Fleuret https://fleuret.org/ammi-2018/ Wed Aug 29 16:58:03 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE The simplest strategy to move from image

  1. AMMI – Introduction to Deep Learning 7.3. Networks for object detection Fran¸ cois Fleuret https://fleuret.org/ammi-2018/ Wed Aug 29 16:58:03 CAT 2018 ÉCOLE POLYTECHNIQUE FÉDÉRALE DE LAUSANNE

  2. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  3. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  4. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  5. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  6. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  7. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. . . . Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  8. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  9. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  10. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  11. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  12. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  13. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  14. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  15. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. . . . Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  16. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  17. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  18. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  19. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  20. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Parsing at fixed scale Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  21. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Final list of detections Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  22. The simplest strategy to move from image classification to object detection is to classify local regions, at multiple scales and locations. Final list of detections This “sliding window” approach evaluates a classifier multiple times, and its computational cost increases with the prediction accuracy. Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 1 / 15

  23. This was mitigated in overfeat (Sermanet et al., 2013) by adding a regression part to predict the object’s bounding box. 1000d FC layers classication Max-pooling Conv layers Input image Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 2 / 15

  24. This was mitigated in overfeat (Sermanet et al., 2013) by adding a regression part to predict the object’s bounding box. 1000d 4d FC layers FC layers classication Localization Max-pooling Conv layers Input image Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 2 / 15

  25. In the single-object case, the convolutional layers are frozen, and the localization layers are trained with a 퓁 2 loss. Figure 7: Examples of bounding boxes produced by the regression network , before being com- bined into final predictions. The examples shown here are at a single scale. Predictions may be more optimal at other scales depending on the objects. Here, most of the bounding boxes which are initially organized as a grid, converge to a single location and scale. This indicates that the network is very confident in the location of the object, as opposed to being spread out randomly. The top left image shows that it can also correctly identify multiple location if several objects are present. The various aspect ratios of the predicted bounding boxes shows that the network is able to cope with various object poses. (Sermanet et al., 2013) Combining the multiple boxes is done with an ad hoc greedy algorithm. Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 3 / 15

  26. This architecture can be applied directly to detection by adding a class “Background” to the object classes. Negative samples are taken in each scene either at random or by selecting the ones with the worst miss-classification. Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 4 / 15

  27. This architecture can be applied directly to detection by adding a class “Background” to the object classes. Negative samples are taken in each scene either at random or by selecting the ones with the worst miss-classification. Surprisingly, using class-specific localization layers did not provide better results than having a single one shared across classes (Sermanet et al., 2013). Fran¸ cois Fleuret AMMI – Introduction to Deep Learning / 7.3. Networks for object detection 4 / 15

Recommend

AMMI Introduction to Deep Learning 4.1. DAG networks Fran cois Fleuret

AMMI Introduction to Deep Learning 4.1. DAG networks Fran cois Fleuret

AMMI Introduction to Deep Learning 4.1. DAG networks Fran cois Fleuret https://fleuret.org/ammi-2018/ Wed Aug 29 16:57:27 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Everything we have seen for an MLP w (1) b (1) w (2) b (2)

353 views • 33 slides
AMMI Introduction to Deep Learning 10.1. Generative Adversarial Networks Fran cois Fleuret

AMMI Introduction to Deep Learning 10.1. Generative Adversarial Networks Fran cois Fleuret

AMMI Introduction to Deep Learning 10.1. Generative Adversarial Networks Fran cois Fleuret https://fleuret.org/ammi-2018/ Thu Sep 6 16:09:56 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE A different approach to learn

666 views • 63 slides
AMMI Introduction to Deep Learning 6.5. Residual networks Fran cois Fleuret

AMMI Introduction to Deep Learning 6.5. Residual networks Fran cois Fleuret

AMMI Introduction to Deep Learning 6.5. Residual networks Fran cois Fleuret https://fleuret.org/ammi-2018/ Fri Nov 9 22:38:28 UTC 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Residual networks Fran cois Fleuret AMMI

732 views • 36 slides
AMMI Introduction to Deep Learning 6.6. Using GPUs Fran cois Fleuret

AMMI Introduction to Deep Learning 6.6. Using GPUs Fran cois Fleuret

AMMI Introduction to Deep Learning 6.6. Using GPUs Fran cois Fleuret https://fleuret.org/ammi-2018/ Fri Nov 9 22:38:37 UTC 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE The size of current state-of-the-art networks makes computation

946 views • 36 slides
AMMI Introduction to Deep Learning 7.2. Networks for image classification Fran cois

AMMI Introduction to Deep Learning 7.2. Networks for image classification Fran cois

AMMI Introduction to Deep Learning 7.2. Networks for image classification Fran cois Fleuret https://fleuret.org/ammi-2018/ Thu Sep 6 15:26:25 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Image classification, standard convnets

827 views • 71 slides
AMMI Introduction to Deep Learning 6.3. Dropout Fran cois Fleuret

AMMI Introduction to Deep Learning 6.3. Dropout Fran cois Fleuret

AMMI Introduction to Deep Learning 6.3. Dropout Fran cois Fleuret https://fleuret.org/ammi-2018/ Wed Aug 29 16:57:55 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE A first deep regularization technique is dropout (Srivastava

684 views • 29 slides
AMMI Introduction to Deep Learning 9.1. Transposed convolutions Fran cois Fleuret

AMMI Introduction to Deep Learning 9.1. Transposed convolutions Fran cois Fleuret

AMMI Introduction to Deep Learning 9.1. Transposed convolutions Fran cois Fleuret https://fleuret.org/ammi-2018/ Fri Nov 9 22:39:08 UTC 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Constructing deep generative architectures

849 views • 46 slides
AMMI Introduction to Deep Learning 11.2. LSTM and GRU Fran cois Fleuret

AMMI Introduction to Deep Learning 11.2. LSTM and GRU Fran cois Fleuret

AMMI Introduction to Deep Learning 11.2. LSTM and GRU Fran cois Fleuret https://fleuret.org/ammi-2018/ November 12, 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE The Long-Short Term Memory unit (LSTM) by Hochreiter and Schmidhuber

310 views • 30 slides
AMMI Introduction to Deep Learning 8.4. Optimizing inputs Fran cois Fleuret

AMMI Introduction to Deep Learning 8.4. Optimizing inputs Fran cois Fleuret

AMMI Introduction to Deep Learning 8.4. Optimizing inputs Fran cois Fleuret https://fleuret.org/ammi-2018/ Thu Sep 6 16:00:44 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Maximum response samples Fran cois Fleuret AMMI

686 views • 45 slides
AMMI Introduction to Deep Learning 6.4. Batch normalization Fran cois Fleuret

AMMI Introduction to Deep Learning 6.4. Batch normalization Fran cois Fleuret

AMMI Introduction to Deep Learning 6.4. Batch normalization Fran cois Fleuret https://fleuret.org/ammi-2018/ Sun Sep 30 10:42:14 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE We saw that maintaining proper statistics of the

565 views • 31 slides
AMMI Introduction to Deep Learning 10.4. Model persistence and checkpoints Fran cois

AMMI Introduction to Deep Learning 10.4. Model persistence and checkpoints Fran cois

AMMI Introduction to Deep Learning 10.4. Model persistence and checkpoints Fran cois Fleuret https://fleuret.org/ammi-2018/ Fri Nov 9 22:35:06 UTC 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Saving and loading models is key to use

335 views • 19 slides
AMMI Introduction to Deep Learning 5.3. PyTorch optimizers Fran cois Fleuret

AMMI Introduction to Deep Learning 5.3. PyTorch optimizers Fran cois Fleuret

AMMI Introduction to Deep Learning 5.3. PyTorch optimizers Fran cois Fleuret https://fleuret.org/ammi-2018/ Sat Nov 10 11:27:22 UTC 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE The PyTorch module torch.optim provides many

791 views • 14 slides
AMMI Introduction to Deep Learning 1.2. Current applications and success Fran cois Fleuret

AMMI Introduction to Deep Learning 1.2. Current applications and success Fran cois Fleuret

AMMI Introduction to Deep Learning 1.2. Current applications and success Fran cois Fleuret https://fleuret.org/ammi-2018/ Sat Oct 6 18:43:49 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Object detection and segmentation

482 views • 26 slides
AMMI Introduction to Deep Learning 1.3. What is really happening? Fran cois Fleuret

AMMI Introduction to Deep Learning 1.3. What is really happening? Fran cois Fleuret

AMMI Introduction to Deep Learning 1.3. What is really happening? Fran cois Fleuret https://fleuret.org/ammi-2018/ Wed Aug 29 16:56:56 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE (Zeiler and Fergus, 2014) Fran cois Fleuret

615 views • 16 slides
AMMI Introduction to Deep Learning 8.3. Visualizing the processing in the input Fran cois

AMMI Introduction to Deep Learning 8.3. Visualizing the processing in the input Fran cois

AMMI Introduction to Deep Learning 8.3. Visualizing the processing in the input Fran cois Fleuret https://fleuret.org/ammi-2018/ Thu Sep 6 15:58:38 CAT 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Occlusion sensitivity Fran

687 views • 46 slides
AMMI Introduction to Deep Learning 8.2. Looking at activations Fran cois Fleuret

AMMI Introduction to Deep Learning 8.2. Looking at activations Fran cois Fleuret

AMMI Introduction to Deep Learning 8.2. Looking at activations Fran cois Fleuret https://fleuret.org/ammi-2018/ Fri Nov 9 22:39:02 UTC 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Convnet internal layer activations Fran cois

748 views • 50 slides
AMMI Introduction to Deep Learning 11.3. Word embeddings and translation Fran cois Fleuret

AMMI Introduction to Deep Learning 11.3. Word embeddings and translation Fran cois Fleuret

AMMI Introduction to Deep Learning 11.3. Word embeddings and translation Fran cois Fleuret https://fleuret.org/ammi-2018/ November 2, 2018 COLE POLYTECHNIQUE FDRALE DE LAUSANNE Word embeddings and CBOW Fran cois Fleuret AMMI

1.04k views • 41 slides
Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations deeplearning.cce2020@gmail.com Deep Networks Intuition Neural networks with multiple hidden layers - Deep networks [Hinton, 2006] Deep Networks Intuition

1.33k views • 28 slides
Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan Zelener Machine Learning Reading Group January 7 th 2016 The Graduate Center, CUNY Objectives Explain some of the trends of deep learning and

680 views • 44 slides
Presentation about Deep Learning --- Zhongwu xie Contents 1.Brief introduction of Deep learning.

Presentation about Deep Learning --- Zhongwu xie Contents 1.Brief introduction of Deep learning.

Presentation about Deep Learning --- Zhongwu xie Contents 1.Brief introduction of Deep learning. 2.Brief introduction of Backpropagation. 3.Brief introduction of Convolutional Neural Networks. Deep learning I . Introduction to Deep Learning

609 views • 22 slides
Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and Courville [chapt. 6,7,8]; AIMA [sect. 21.1-21.3]; Sutton and Barto, Reinforcement Learning: an

527 views • 35 slides
Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for

Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for

Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for Deep Networks Perceptron Can only model linear functions Kernel Machines Non-linearity provided by kernels Need to design appropriate kernels

563 views • 43 slides
Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for

Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for

Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for Deep Networks Perceptron Can only model linear functions Kernel Machines Non-linearity provided by kernels Need to design appropriate kernels

1.45k views • 34 slides
Introduction to Artificial Intelligence Neural Networks - Deep Learning for NLP Janyl Jumadinova

Introduction to Artificial Intelligence Neural Networks - Deep Learning for NLP Janyl Jumadinova

Introduction to Artificial Intelligence Neural Networks - Deep Learning for NLP Janyl Jumadinova November 21, 2016 Neural Networks 2/20 Neural Networks 3/20 Neural Networks Neural computing requires a number of neurons , to be connected

813 views • 21 slides

More recommend