computational photography
play

Computational Photography Si Lu Spring 2018 - PowerPoint PPT Presentation

Dec 24, 2022 •406 likes •1.36k views

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 04/10/2018 Last Time o Digital Camera n History of Camera n Controlling Camera o Photography Concepts Today o Filters and its

  1. Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 04/10/2018

  2. Last Time o Digital Camera n History of Camera n Controlling Camera o Photography Concepts

  3. Today o Filters and its applications naïve denoising better denoising noisy image Gaussian blur edge-preserving filter Slide credit: Sylvain Paris and Frédo Durand

  4. The raster image (pixel matrix) Slide credit: D. Hoiem

  5. The raster image (pixel matrix) 0.92 0.93 0.94 0.97 0.62 0.37 0.85 0.97 0.93 0.92 0.99 0.95 0.89 0.82 0.89 0.56 0.31 0.75 0.92 0.81 0.95 0.91 0.89 0.72 0.51 0.55 0.51 0.42 0.57 0.41 0.49 0.91 0.92 0.96 0.95 0.88 0.94 0.56 0.46 0.91 0.87 0.90 0.97 0.95 0.71 0.81 0.81 0.87 0.57 0.37 0.80 0.88 0.89 0.79 0.85 0.49 0.62 0.60 0.58 0.50 0.60 0.58 0.50 0.61 0.45 0.33 0.86 0.84 0.74 0.58 0.51 0.39 0.73 0.92 0.91 0.49 0.74 0.96 0.67 0.54 0.85 0.48 0.37 0.88 0.90 0.94 0.82 0.93 0.69 0.49 0.56 0.66 0.43 0.42 0.77 0.73 0.71 0.90 0.99 0.79 0.73 0.90 0.67 0.33 0.61 0.69 0.79 0.73 0.93 0.97 0.91 0.94 0.89 0.49 0.41 0.78 0.78 0.77 0.89 0.99 0.93 Slide credit: D. Hoiem

  6. Perception of Intensity Slide credit: C. Dyer

  7. Perception of Intensity Slide credit: C. Dyer

  8. Color Image R G B Slide credit: D. Hoiem

  9. Image Filtering o Image filtering: compute function of local neighborhood at each pixel position o One type of “Local operator,” “Neighborhood operator,” “Window operator” o Useful for: Enhancing images n o Noise reduction, smooth, resize, increase contrast, etc. Extracting information from images n o Texture, edges, distinctive points, etc. n Detecting patterns o Template matching, e.g., eye template Source: D. Hoiem Slide credit: C. Dyer

  10. Blurring in the Real World Camera shake * = Source: Fergus, et al. “ Removing Camera Shake from a Single Photograph”, SIGGRAPH 2006 Bokeh : Blur in out-of-focus regions of image Slide credit: C. Dyer Source: http://lullaby.homepage.dk/diy-camera/bokeh.html

  11. Image Correlation Filtering o Select a filter g n g is called a filter , mask , kernel , or template o Center filter g at each pixel in image f o Multiply weights by corresponding pixels o Set resulting value in output image h o Linear filtering is sum of dot product at each pixel position o Filtering operation called cross-correlation , and denoted h = f  g Slide credit: C. Dyer

  12. Example: Box Filter   g [ , ] 1 1 1 1 1 1 1 1 1 Slide credit: David Lowe

  13. Image Filtering 1 1 1   g [ , ] 1 1 1 1 1 1 h [.,.] f [.,.] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 90 0 90 90 90 0 0 0 0 0 90 0 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 0 0 0 0 0 0 0 0 0 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0     h [ m , n ] g [ k , l ] f [ m k , n l ] k , l Credit: S. Seitz

  14. 1 1 1 Image Filtering   g [ , ] 1 1 1 1 1 1 h [.,.] f [.,.] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0     h [ m , n ] g [ k , l ] f [ m k , n l ] k , l Credit: S. Seitz

  15. 1 1 1 Image Filtering   g [ , ] 1 1 1 1 1 1 h [.,.] f [.,.] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 20 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0     h [ m , n ] g [ k , l ] f [ m k , n l ] k , l Credit: S. Seitz

  16. 1 1 1 Image Filtering   g [ , ] 1 1 1 1 1 1 h [.,.] f [.,.] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 20 30 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 0 0 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0     h [ m , n ] g [ k , l ] f [ m k , n l ] k , l Credit: S. Seitz

  17. 1 1 1 Image Filtering   g [ , ] 1 1 1 1 1 1 h [.,.] f [.,.] 0 0 0 0 0 0 0 0 0 0 0 10 20 30 30 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 0 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0     h [ m , n ] g [ k , l ] f [ m k , n l ] k , l Credit: S. Seitz

  18. 1 1 1 Image Filtering   g [ , ] 1 1 1 1 1 1 h [.,.] f [.,.] 0 0 0 0 0 0 0 0 0 0 0 10 20 30 30 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 0 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 ? 0 0 0 0 0 0 0 0 0 0 0 0 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0     h [ m , n ] g [ k , l ] f [ m k , n l ] k , l Credit: S. Seitz

  19. 1 1 1 Image Filtering   g [ , ] 1 1 1 1 1 1 h [.,.] f [.,.] 0 0 0 0 0 0 0 0 0 0 0 10 20 30 30 0 0 0 0 0 0 0 0 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 ? 0 0 0 90 0 90 90 90 0 0 0 0 0 90 90 90 90 90 0 0 50 0 0 0 0 0 0 0 0 0 0 0 0 90 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0     h [ m , n ] g [ k , l ] f [ m k , n l ] k , l Credit: S. Seitz

  20.   g [ , ] 1 1 1 Image Filtering 1 1 1 1 1 1 h [.,.] f [.,.] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 20 30 30 30 20 10 0 0 0 90 90 90 90 90 0 0 0 20 40 60 60 60 40 20 0 0 0 90 90 90 90 90 0 0 0 30 60 90 90 90 60 30 0 0 0 90 90 90 90 90 0 0 0 30 50 80 80 90 60 30 0 0 0 90 0 90 90 90 0 0 0 30 50 80 80 90 60 30 0 0 0 90 90 90 90 90 0 0 0 20 30 50 50 60 40 20 0 0 0 0 0 0 0 0 0 0 10 20 30 30 30 30 20 10 0 0 90 0 0 0 0 0 0 0 10 10 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0     h [ m , n ] g [ k , l ] f [ m k , n l ] k , l Credit: S. Seitz

  21. Box Filter What does it do? • Replaces each pixel with   g [ , ] an average of its neighborhood 1 1 1 • Achieves smoothing 1 1 1 effect (i.e., removes 1 1 1 sharp features) • Weaknesses: • Blocky results • Axis-aligned streaks Slide credit: David Lowe

  22. Smoothing with Box Filter Slide credit: C. Dyer

  23. Properties of Smoothing Filters o Smoothing n Values all positive n Sum to 1  constant regions same as input n Amount of smoothing proportional to mask size n Removes “high-frequency” components n “low-pass” filter Slide credit: C. Dyer

  24. Gaussian Filtering Weight contributions of neighboring pixels by nearness o 0.003 0.013 0.022 0.013 0.003 0.013 0.059 0.097 0.059 0.013 0.022 0.097 0.159 0.097 0.022 0.013 0.059 0.097 0.059 0.013 0.003 0.013 0.022 0.013 0.003 5 x 5,  = 1 o Constant factor at front makes volume sum to 1 o Convolve each row of image with 1D kernel to produce new image; then convolve each column of new image with same 1D kernel to yield output image Slide credit: Christopher Rasmussen

Recommend

Course Topic What is Computational Photography ? Study the basics of computation

Course Topic What is Computational Photography ? Study the basics of computation

Course Topic What is Computational Photography ? Study the basics of computation and its impact on the entire Computational Photography workflow of photography, from capturing, manipulating, and collaborating on, and CS

403 views • 5 slides
Einfhrung in Visual Computing U it 26 C Unit 26: Computational Photography t ti l Ph t h

Einfhrung in Visual Computing U it 26 C Unit 26: Computational Photography t ti l Ph t h

Einfhrung in Visual Computing U it 26 C Unit 26: Computational Photography t ti l Ph t h http:// www.caa.tuwien.ac.at/cvl/teaching/sommersemester/evc Content: Introduction to Computational Photography Introduction to Computational

989 views • 75 slides
Coded Computational Photography ! EE367/CS448I: Computational Imaging and Display !

Coded Computational Photography ! EE367/CS448I: Computational Imaging and Display !

Coded Computational Photography ! EE367/CS448I: Computational Imaging and Display ! stanford.edu/class/ee367 ! Lecture 9 ! Gordon Wetzstein ! Stanford University ! Coded Computational Photography - Overview ! [Cossairt et al., 2010] ! ! coded

1.26k views • 72 slides
Xun Cao ( ) School of Electronic Science & Engineering Nanjing University

Xun Cao ( ) School of Electronic Science & Engineering Nanjing University

High Resolution Spectral Video Capture & Computational Photography Xun Cao ( ) School of Electronic Science & Engineering Nanjing University caoxun@nju.edu.cn Dec 30th, 2015 Computational Photography Computational Photography

1.02k views • 65 slides
Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 04/05/2018 Last Time o Course overview n Admin. Info n Computational Photography 2 Today o Digital Camera n History of

889 views • 61 slides
From TensorFlow to Taichi : A GAN for Computational Photography and A Library for Computer Graphics

From TensorFlow to Taichi : A GAN for Computational Photography and A Library for Computer Graphics

From TensorFlow to Taichi : A GAN for Computational Photography and A Library for Computer Graphics Presented by Yuanming Hu , MIT CSAIL Part I Exposure: A White-Box Photo Post-Processing Framework ACM Transactions on Graphics, to be

940 views • 64 slides
RGB++ How "Side Information" Improves Computational Photography and Computer Vision

RGB++ How "Side Information" Improves Computational Photography and Computer Vision

RGB++ How "Side Information" Improves Computational Photography and Computer Vision (...or how to make better pictures) Sabine Ssstrunk Images and Visual Representation Group (IVRG) This%talk%is%about%linking%Informa3on%

1.63k views • 126 slides
On The Foundations of Computational Photography Yohann Tendero Joint work with: Jean-Michel

On The Foundations of Computational Photography Yohann Tendero Joint work with: Jean-Michel

On The Foundations of Computational Photography Yohann Tendero Joint work with: Jean-Michel Morel Bernard Roug e January, th Photographing moving scenes could only be done using short exposure times, until... Amit

730 views • 45 slides
Digital Photography II The Image Processing Pipeline EE367/CS448I: Computational Imaging and

Digital Photography II The Image Processing Pipeline EE367/CS448I: Computational Imaging and

Digital Photography II The Image Processing Pipeline EE367/CS448I: Computational Imaging and Display stanford.edu/class/ee367 Lecture 4 Gordon Wetzstein Stanford University Review Sensors are Buckets collect photons integrate

1.16k views • 70 slides
Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 04/17/2018 Last Time o Color o Color to Gray 2 Today o Projects o Notes on Presentation 3 Project o Option 1. Literature

313 views • 27 slides
Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 04/26/2018 Last Time o Panorama n Overview n Feature detection n Feature matching With slides by Prof. C. Dyer and K. Grauman

858 views • 67 slides
Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 04/24/2018 Last Time o Relighting n Tone Mapping n HDR 2 Today o Panorama n Overview n Feature detection n Feature matching

1.37k views • 71 slides
Image-based Lighting (Part 2) T2 Computational Photography Derek Hoiem, University of Illinois

Image-based Lighting (Part 2) T2 Computational Photography Derek Hoiem, University of Illinois

10/16/14 Image-based Lighting (Part 2) T2 Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros, Kevin Karsch Today Brief review of last class Show how to get an HDR image from several

1.16k views • 74 slides
Graph Cut Frdo Durand MIT - EECS Thursday, October 29, 2009 Last Tuesday: optimization

Graph Cut Frdo Durand MIT - EECS Thursday, October 29, 2009 Last Tuesday: optimization

6.815 Digital and Computational Photography 6.865 Advanced Computational Photography Graph Cut Frdo Durand MIT - EECS Thursday, October 29, 2009 Last Tuesday: optimization Relied on a smoothness term values are assumed to be smooth

868 views • 59 slides
Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 05/29/2018 Last Time o 3D Video Stabilization 2 Introduction of Neural Networks 3 Content Introduction

1.35k views • 86 slides
Macro Photography Macro Photography Photography of small items larger than life size. Typical

Macro Photography Macro Photography Photography of small items larger than life size. Typical

Macro Photography Macro Photography Photography of small items larger than life size. Typical subjects are still life, such as fruit, flowers, jewelry and small household objects. Macro photography often reveals details of the subject not

199 views • 4 slides
Macro Photography Macro Photography Photography of small items larger than life size. Typical

Macro Photography Macro Photography Photography of small items larger than life size. Typical

Macro Photography Macro Photography Photography of small items larger than life size. Typical subjects are still life, such as fruit, flowers, jewelry and small household objects. Macro photography often reveals details of the subject not

543 views • 19 slides
Image Composite Editor (ICE) Created by the Microsoft Research Computational Photography Group

Image Composite Editor (ICE) Created by the Microsoft Research Computational Photography Group

Image Composite Editor (ICE) Created by the Microsoft Research Computational Photography Group Image Composite Editor (ICE) Given a set of overlapping photographs of a scene shot from a single camera location, the app creates a

1.81k views • 32 slides
Computational High Dynamic Range Photography HDR Frank Dellaert School of Interactive

Computational High Dynamic Range Photography HDR Frank Dellaert School of Interactive

Computational High Dynamic Range Photography HDR Frank Dellaert School of Interactive Computing Georgia Institute of Technology Many Figures from Ron Brinkmanns Book Many figures from Debevecs paper Recovering High Dynamic Range

172 views • 5 slides
Computational Photography Photographie Algorithmique Frdo Durand MIT - EECS/CSAIL Willow /

Computational Photography Photographie Algorithmique Frdo Durand MIT - EECS/CSAIL Willow /

Computational Photography Photographie Algorithmique Frdo Durand MIT - EECS/CSAIL Willow / INRIA / ENS Thursday, October 8, 2009 Langue Frenglish... ...ou franglais? Thursday, October 8, 2009 Qui je suis / Who I am Eleve ENS

1.82k views • 145 slides
Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 04/12/2018 Last Time o Filters o De-noise 2 Today o Color o Color to Gray 3 Light and Color o The frequency, f , of light

789 views • 66 slides
Why Photography? Photography for My Soul // Feeling Alive with Camera in Hand! Why Creativity?

Why Photography? Photography for My Soul // Feeling Alive with Camera in Hand! Why Creativity?

Why Photography? Photography for My Soul // Feeling Alive with Camera in Hand! Why Creativity? Why Does Creativity Matter, esp. in COVID-19 times? How to Revitalize Your Love for Photography Visual Cross-Pollination (Study the Very Old

728 views • 43 slides
COMMUNICATIONS, EXPRESSIVE ARTS & PHOTOGRAPHY A. 4-H Photography Units II and III will be

COMMUNICATIONS, EXPRESSIVE ARTS & PHOTOGRAPHY A. 4-H Photography Units II and III will be

COMMUNICATIONS, EXPRESSIVE ARTS & PHOTOGRAPHY A. 4-H Photography Units II and III will be allowed to exhibit at the State Fair. B. 4- Hers are allowed to exhibit only one photography unit. C. 4-H members may enter up to two exhibits per

271 views • 6 slides
Bloom photography Photography tips What to photograph Editing and using images

Bloom photography Photography tips What to photograph Editing and using images

Bloom photography Photography tips What to photograph Editing and using images Photography tips Technical tips Set your camera to the highest quality setting Clean the lens with a soft lens cloth Make sure the

424 views • 16 slides

More recommend