deep learning in image processing
play

Deep Learning in Image Processing Topics: Image Filtering 101 - PowerPoint PPT Presentation

Nov 22, 2022 •648 likes •1.46k views

Deep Learning in Image Processing Topics: Image Filtering 101 CNNs 101 Image Processing Pipelines Frank Dellaert CS 4476 Computer Vision Many slides from Stanfords CS231N by Fei-Fei Li, Justin Johnson, Serena Yeung, as well as

  1. Deep Learning in Image Processing Topics: – Image Filtering 101 – CNNs 101 – Image Processing Pipelines Frank Dellaert CS 4476 Computer Vision Many slides from Stanford’s CS231N by Fei-Fei Li, Justin Johnson, Serena Yeung, as well as some slides on filtering from Devi Parikh and Kristen Grauman, who may in turn have borrowed some from others

  4. Contrast • g(x) = a f(x), a=1.1

  5. Brightness • g(x) = f(x) + b, b=16

  7. Image filtering • Compute a function of the local neighborhood at each pixel in the image – Function specified by a “filter” or mask saying how to combine values from neighbors. • Uses of filtering: – Enhance an image (denoise, resize, etc) – Extract information (texture, edges, etc) – Detect patterns (template matching) 7 Slide credit: Kristen Grauman, Adapted from Derek Hoiem

  8. Image filtering • Compute a function of the local neighborhood at each pixel in the image – Function specified by a “filter” or mask saying how to combine values from neighbors. • Uses of filtering: – Enhance an image (denoise, resize, etc) – Extract information (texture, edges, etc) – Detect patterns (template matching) 8 Slide credit: Kristen Grauman, Adapted from Derek Hoiem

  9. Motivation: noise reduction • Even multiple images of the same static scene will not be identical. 9 Slide credit: Adapted from Kristen Grauman

  10. Common types of noise – Salt and pepper noise : random occurrences of black and white pixels – Impulse noise: random occurrences of white pixels – Gaussian noise : variations in intensity drawn from a Gaussian normal distribution 10 Slide credit: Steve Seitz

  11. Gaussian noise >> noise = randn(size(im)).*sigma; >> output = im + noise; Slide credit: Kristen Grauman What is impact of the sigma? 11 Figure from Martial Hebert

  12. Motivation: noise reduction • Even multiple images of the same static scene will not be identical. • How could we reduce the noise, i.e., give an estimate of the true intensities? • What if there’s only one image? 12 Slide credit: Kristen Grauman

  13. First attempt at a solution • Let’s replace each pixel with an average of all the values in its neighborhood • Assumptions: – Expect pixels to be like their neighbors – Expect noise processes to be independent from pixel to pixel 13 Slide credit: Kristen Grauman

  14. First attempt at a solution • Let’s replace each pixel with an average of all the values in its neighborhood • Moving average in 1D: 14 Slide credit: S. Marschner

  15. Weighted Moving Average • Can add weights to our moving average • Weights [1, 1, 1, 1, 1] / 5 15 Slide credit: S. Marschner

  16. Weighted Moving Average • Non-uniform weights [1, 4, 6, 4, 1] / 16 16 Slide credit: S. Marschner

  17. Image filtering • Image filtering: compute function of local neighborhood at each position • Really important! – Enhance images • Denoise, resize, increase contrast, etc. – Extract information from images • Texture, edges, distinctive points, etc. – Detect patterns • Template matching – Deep Convolutional Networks

  18. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 18 Slide credit: Steve Seitz

  19. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 19 Slide credit: Steve Seitz

  20. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 20 Slide credit: Steve Seitz

  21. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 21 Slide credit: Steve Seitz

  22. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 22 Slide credit: Steve Seitz

  23. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 20 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 23 Slide credit: Steve Seitz

  24. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 20 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 24 Slide credit: Steve Seitz

  25. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 20 30 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 25 Slide credit: Steve Seitz

  26. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 10 20 30 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 0 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 26 Slide credit: Steve Seitz

  27. Moving Average In 2D 0 0 0 0 0 0 0 0 0 0 0 10 20 30 30 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 0 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 27 Slide credit: Steve Seitz

Recommend

BBM413 Fundamentals of Image Processing Introduction to Deep Learning Erkut Erdem

BBM413 Fundamentals of Image Processing Introduction to Deep Learning Erkut Erdem

BBM413 Fundamentals of Image Processing Introduction to Deep Learning Erkut Erdem Hacettepe University Computer Vision Lab (HUCVL) What is deep learning? Y. LeCun, Y. Bengio, G. Hinton, "Deep Learning" , Nature,

1.12k views • 84 slides
Image Processing Todays Class Image Representations: Matrices Image Representations: RGB,

Image Processing Todays Class Image Representations: Matrices Image Representations: RGB,

CS6501: Deep Learning for Visual Recognition Image Processing Todays Class Image Representations: Matrices Image Representations: RGB, HSV, etc Image Processing: Brightness Image Filtering: Mean Filter, Median Filter Image Filtering:

959 views • 77 slides
Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI Mission Helping people solve challenging problems using AI and deep learning. Developers, data scientists and engineers Self-driving cars,

1.44k views • 72 slides
TOWARDS CREATING A KNOWLEDGE GAP FOR DEEP LEARNING BASED MEDICAL IMAGE ANALYSIS Dr. S.

TOWARDS CREATING A KNOWLEDGE GAP FOR DEEP LEARNING BASED MEDICAL IMAGE ANALYSIS Dr. S.

TOWARDS CREATING A KNOWLEDGE GAP FOR DEEP LEARNING BASED MEDICAL IMAGE ANALYSIS Dr. S. Kevin Zhou, Chinese Academy of Sciences Deep learning Input Algorithm: Output image variable Deep network X Y Y = f(X; W) Learning: arg min W S

685 views • 36 slides
A comparative study of deep learning based Dadashi-Tazehozi rd2669 methods for MRI image

A comparative study of deep learning based Dadashi-Tazehozi rd2669 methods for MRI image

A comparative study of deep learning based methods for MRI image processing Robert A comparative study of deep learning based Dadashi-Tazehozi rd2669 methods for MRI image processing Introduction Articles Motivation Medical Robert

624 views • 27 slides
Learning State of the Art 1 19.11.2019 What is Deep Learning? https://youtu.be/Kfe5hKNwrCU

Learning State of the Art 1 19.11.2019 What is Deep Learning? https://youtu.be/Kfe5hKNwrCU

Applications and Deep Learning State of the Art 1 19.11.2019 What is Deep Learning? https://youtu.be/Kfe5hKNwrCU Long pipeline of processing operations Designed by showing examples Example: TUT Age Estimation Image Recognition

556 views • 52 slides
Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin

Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin

Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin Clark Deep Learning for NLP 5 years ago No Seq2Seq No Attention No large-scale QA/reading comprehension datasets No TensorFlow or

1.41k views • 92 slides
Interpretable & Transparent Deep Learning Fraunhofer HHI, Machine Learning Group Wojciech

Interpretable & Transparent Deep Learning Fraunhofer HHI, Machine Learning Group Wojciech

Fraunhofer Image Processing Heinrich Hertz Institute Interpretable & Transparent Deep Learning Fraunhofer HHI, Machine Learning Group Wojciech Samek Northern Lights Deep Learning Workshop (NLDL19) Troms, Norway 8th January 2019

1.15k views • 51 slides
Deep Learning Europython 2016 - Bilbao G. French University of East Anglia Image montages from

Deep Learning Europython 2016 - Bilbao G. French University of East Anglia Image montages from

Deep Learning Europython 2016 - Bilbao G. French University of East Anglia Image montages from http://www.image-net.org Focus: Mainly image processing This talk is more about the principles and the maths than code Got to fit this into 1

2.37k views • 191 slides
Deep Learning on Massively Parallel Processing Databases Frank McQuillan Feb 2019 2 A Brief

Deep Learning on Massively Parallel Processing Databases Frank McQuillan Feb 2019 2 A Brief

Deep Learning on Massively Parallel Processing Databases Frank McQuillan Feb 2019 2 A Brief Introduction to Deep Learning Artificial Intelligence Landscape Deep Learning 4 Example Deep Learning Algorithms Multilayer Recurrent

651 views • 44 slides
Hybrid Deep Learning Topology for Image Classification Petru Radu petru.radu@ness.com 27 th

Hybrid Deep Learning Topology for Image Classification Petru Radu petru.radu@ness.com 27 th

15.07.2019 Hybrid Deep Learning Topology for Image Classification Petru Radu petru.radu@ness.com 27 th Summer School on Image Processing, Timisoara 2019 SSIP 2019 Introduction Classical Neural Networks employed in image classification have a

513 views • 33 slides
Towards Interpretable Deep Learning for Natural Language Processing Roy Schwartz University of

Towards Interpretable Deep Learning for Natural Language Processing Roy Schwartz University of

Towards Interpretable Deep Learning for Natural Language Processing Roy Schwartz University of Washington & Allen Institute for Artificial Intelligence December 2018 1 / 37 ( Deep-Learning -Based) AI Today 2 / 37 3 / 37 Deep Learning

1.63k views • 140 slides
Image Captioning Image Captioning Image Captioning A survey of recent deep-learning approaches

Image Captioning Image Captioning Image Captioning A survey of recent deep-learning approaches

Image Captioning Image Captioning Image Captioning A survey of recent deep-learning approaches Kiran Vodrahalli February 23, 2015 The task We want to automatically describe images with words Why? 1) It's cool 2) Useful for

934 views • 40 slides
CS 4803 / 7643: Deep Learning Topics: Image Classification Supervised Learning view

CS 4803 / 7643: Deep Learning Topics: Image Classification Supervised Learning view

CS 4803 / 7643: Deep Learning Topics: Image Classification Supervised Learning view K-NN Linear Classifier Zsolt Kira Georgia Tech Last Time High-level intro to what deep learning is Fast brief of logistics

1.24k views • 100 slides
ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY MEDIA & ENTERTAINMENT SECURITY & DEFENSE AUTONOMOUS MACHINES Image

307 views • 26 slides
BBM 413 Today Fundamentals of What is image processing? Image Processing What does it

BBM 413 Today Fundamentals of What is image processing? Image Processing What does it

BBM 413 Today Fundamentals of What is image processing? Image Processing What does it mean, to see? Vision as a computational problem Sample image processing problems Erkut Erdem Dept. of Computer Engineering Hacettepe

399 views • 13 slides
Deep Image-Text Embeddings Learning Deep Structure-Preserving Image-Text Embeddings (CVPR 2016)

Deep Image-Text Embeddings Learning Deep Structure-Preserving Image-Text Embeddings (CVPR 2016)

CS688 Paper Presentation 1 Deep Image-Text Embeddings Learning Deep Structure-Preserving Image-Text Embeddings (CVPR 2016) Woobin Im ( ) 2016-11-08 Sentence-to-image Retrieval Retrieval system Query text A cat next to a blue chair

594 views • 28 slides
Deep Learning for Natural Language Processing (in 2 hours) Eneko Agirre

Deep Learning for Natural Language Processing (in 2 hours) Eneko Agirre

Deep Learning for Natural Language Processing (in 2 hours) Eneko Agirre http://ixa2.si.ehu.eus/eneko IXA NLP group http://ixa.eus @eagirre Contents Introduction to Deep learning Deep Learning ~ Learning Representations Text as

1.58k views • 156 slides
E9 205 Machine Learning for Signal Processing 23-8-17 Outline Basics for Image Processing

E9 205 Machine Learning for Signal Processing 23-8-17 Outline Basics for Image Processing

E9 205 Machine Learning for Signal Processing 23-8-17 Outline Basics for Image Processing Filtering Smoothing Edge Detection Scale Invariant Feature Transform (SIFT) Reference: UCF, Computer Vision Course Link:

599 views • 42 slides
Introduction: What is Image Processing? CS 4640: Image Processing Basics January 10, 2012 What

Introduction: What is Image Processing? CS 4640: Image Processing Basics January 10, 2012 What

Introduction: What is Image Processing? CS 4640: Image Processing Basics January 10, 2012 What is Image Processing? Definition Image processing is the study of any algorithm that takes an image as input and returns an image as output.

530 views • 16 slides
An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning Microsoft Research Asia (MSRA) Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. Deep Residual Learning for Image Recognition. arXiv

1.32k views • 54 slides
Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning with multi-layer (3~30) neural networks, on a huge training set. State-of-the-art on many AI tasks Computer Vision : Image Classification,

1.53k views • 23 slides
PLT Project SIP(Simplified Image Processing) A Language for image processing Why SIP ??

PLT Project SIP(Simplified Image Processing) A Language for image processing Why SIP ??

PLT Project SIP(Simplified Image Processing) A Language for image processing Why SIP ?? Effectively an image processing language. Concept can be extended for videos Features included to make operations on images short and effective

733 views • 12 slides
Deep learning for natural language processing A short primer on deep learning Benoit Favre <

Deep learning for natural language processing A short primer on deep learning Benoit Favre <

Deep learning for natural language processing A short primer on deep learning Benoit Favre < benoit.favre@univ-mrs.fr > Aix-Marseille Universit, LIF/CNRS 20 Feb 2017 Benoit Favre (AMU) DL4NLP: deep learning 20 Feb 2017 1 / 25 Deep

530 views • 25 slides

More recommend