a fast spatial patch blending algorithm for artefact
play

A Fast Spatial Patch Blending Algorithm for Artefact Reduction in - PowerPoint PPT Presentation

Sep 11, 2022 •121 likes •542 views

A Fast Spatial Patch Blending Algorithm for Artefact Reduction in Pattern-based Image Inpainting Maxime Daisy, David Tschumperl e, Olivier L ezoray GREYC - UMR 6072 CNRS, ENSICAEN, University of Caen Image team SIGGRAPH Asia 21

  1. A Fast Spatial Patch Blending Algorithm for Artefact Reduction in Pattern-based Image Inpainting Maxime Daisy, David Tschumperl´ e, Olivier L´ ezoray GREYC - UMR 6072 CNRS, ENSICAEN, University of Caen Image team SIGGRAPH Asia 21 November 2013

  2. Outlines 1 Inpainting : Context and State of the Art 2 Patch Blending for Inpainting 3 Results and Comparisons M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 2 / 41

  3. Outlines 1 Inpainting : Context and State of the Art 2 Patch Blending for Inpainting 3 Results and Comparisons M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 3 / 41

  4. Image Inpainting : Overview Original M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 4 / 41

  5. Image Inpainting : Overview Masked image M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 5 / 41

  6. Image Inpainting : Overview Inpainted image M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 6 / 41

  7. Image Inpainting : a little history • Masnou and Morel : Level lines based disocclusion, ICIP 1998 • Efros and Leung : Texture synthesis by non-parametric sampling, ICCV 1999 • Bertalm´ ıo et al. : Image Inpainting, SIGGRAPH 2000 • Criminisi et al. : Object Removal by Exemplar-based Inpainting, CVPR 2003 • Wexler et al. : Space-time video completion, CVPR 2004 • Sun et al. : Image Inpainting by Patch Propagation Using Patch Sparsity IEEE 2010 • Darabi et al. : Image Melding : Combining Inconsistent Images using Patch-based Synthesis, SIGGRAPH 2012 • . . . M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 7 / 41

  8. Criminisi et al. : overview M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 8 / 41

  9. Good texture reconstruction M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 9 / 41

  10. Good texture reconstruction M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 10 / 41

  11. Local geometry inconsistencies M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 11 / 41

  12. Since Criminisi et al. 2003 inpainting algorithm Content Aware Filling 2010 • Wexler et al. 2007 : Space-time completion of videos • Barnes et al. 2009 : PatchMatch ⇒ blurry textures Le Meur et al. 2011 • local geometry aware : structure tensors analysis • K-nearest neighbours averaging ⇒ blurry textures, geometry inconsitencies M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 12 / 41

  13. Since Criminisi et al. 2003 inpainting algorithm (a) Content-aware filling (b) Le Meur et al. 2011 M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 13 / 41

  14. The question How to keep both good textures and geometry consistency ? M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 14 / 41

  15. Outlines 1 Inpainting : Context and State of the Art 2 Patch Blending for Inpainting 3 Results and Comparisons M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 15 / 41

  16. Spatial patch blending - Extreme case Masked image. M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 16 / 41

  17. Spatial patch blending - Extreme case Inpainted image : Criminis et al. 2003. M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 17 / 41

  18. Spatial patch blending - Extreme case Diffusion PDE inpainting result. M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 18 / 41

  19. Spatial patch blending - Extreme case Content-aware filling algorithm. M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 19 / 41

  20. Spatial patch blending - Extreme case Effect of spatial patch blending. M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 20 / 41

  21. σ ( p ) : an adaptative blending amplitude (c) Break field R ( p ) (d) Blending amplitude field σ ( p ) M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 21 / 41

  22. Spatial Patch Blending : explanation M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 22 / 41

  23. Mathematical expression • Usage of reconstruction points and patch locations, saved during inpainting process w ( q , p ) ψ i q ( p − q ) ∑ ψ q ∈ Ψ p J i ( p ) = ε + ∑ w ( q , p ) ψ q ∈ Ψ p • Ψ p : set of patches used for the reconstruction around p q ( p − q ) : pixel value at (( N / 2 , N / 2 ) T +( p − q )) in ψ i • ψ i q • σ ( p ) : blending amplitude at p • w ( q , p ) gaussian weight of variance σ ( p ) 2 M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 23 / 41

  24. Fast algorithm - Blend scales M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 24 / 41

  25. Outlines 1 Inpainting : Context and State of the Art 2 Patch Blending for Inpainting 3 Results and Comparisons M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 25 / 41

  26. Time Comparison M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 26 / 41

  27. Result - Nature Original Image M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 27 / 41

  28. Result - Nature Content-aware Filling M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 28 / 41

  29. Result - Nature Criminisi + our spatial patch blending M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 29 / 41

  30. Result - Fake Owl Original Image M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 30 / 41

  31. Result - Fake Owl Criminisi et al. 2004 M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 31 / 41

  32. Result - Fake Owl Content-aware Filling M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 32 / 41

  33. Result - Fake Owl Criminisi + our spatial patch blending M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 33 / 41

  34. Result - Savanna Original Image M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 34 / 41

  35. Result - Savanna Criminisi et al. 2005 M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 35 / 41

  36. Result - Savanna Content-aware Filling M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 36 / 41

  37. Result - Savanna Criminisi + our spatial patch blending M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 37 / 41

  38. GIMP Software Integration : G’MIC plugin M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 38 / 41

  39. GIMP Software Integration : G’MIC plugin M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 39 / 41

  40. GIMP Software Integration : G’MIC plugin M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 40 / 41

  41. GIMP Software Integration : G’MIC plugin M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 41 / 41

  42. GIMP Software Integration : G’MIC plugin M. Daisy (GREYC) SIGGRAPH Asia 2013 21 November 2013 42 / 41

Recommend

http://www.writingwrocks.com/eportfolio/view/artefact.php?artefact=19132&view=4623

http://www.writingwrocks.com/eportfolio/view/artefact.php?artefact=19132&view=4623

http://www.writingwrocks.com/eportfolio/view/artefact.php?artefact=19132&view=4623 http://www.writingwrocks.com/eportfolio/view/artefact.php?artefact=16954&view=3069 What are the experiences of faculty who Gender Degree Years Division

911 views • 9 slides
Supplement 189: Parametric Blending Presentation State Storage 1 Overview Objective

Supplement 189: Parametric Blending Presentation State Storage 1 Overview Objective

Supplement 189: Parametric Blending Presentation State Storage 1 Overview Objective Input data Blending operation Example 2 Blending Presentation State introduction Objective Allowing to show spatial relationship of

477 views • 16 slides
Is This Algorithm Fast? Topic Number 8 op c u be 8 Problem: given a problem, how fast does

Is This Algorithm Fast? Topic Number 8 op c u be 8 Problem: given a problem, how fast does

Is This Algorithm Fast? Topic Number 8 op c u be 8 Problem: given a problem, how fast does this Algorithm Analysis code solve that problem? Could try to measure the time it takes, but " bit twiddling: 1. (pejorative) An exercise

396 views • 15 slides
Will My Patch Make It? And How Fast? Yujuan Jiang, Bram Adams (MCIS, Polytechnique Montral)

Will My Patch Make It? And How Fast? Yujuan Jiang, Bram Adams (MCIS, Polytechnique Montral)

Will My Patch Make It? And How Fast? Yujuan Jiang, Bram Adams (MCIS, Polytechnique Montral) Daniel M. German (University of Victoria ) 1 Monday, 3 June, 13 I do hold out hope that Google does come around and works to fix their codebase to

1.05k views • 57 slides
An Open Platform for Digitizing Real World through Sentient Artefact Model Fahim Kawsar Waseda

An Open Platform for Digitizing Real World through Sentient Artefact Model Fahim Kawsar Waseda

An Open Platform for Digitizing Real World through Sentient Artefact Model Fahim Kawsar Waseda University, Japan 1 Talk Outline Motivation Scenario Sentient Artefact Design Principle Sentient Artefact Development

323 views • 31 slides
Preparation for Blending Mr Don McWhirter MacWool Ltd Blending of Greasy Wool Extremely

Preparation for Blending Mr Don McWhirter MacWool Ltd Blending of Greasy Wool Extremely

Preparation for Blending Mr Don McWhirter MacWool Ltd Blending of Greasy Wool Extremely important in early stage processing Primary purpose is to produce an even and uniform top Pre-delivery/Preparation for Blending Purchase

1.28k views • 50 slides
Blending Blending Elements of two input spaces are projected into a third space, the

Blending Blending Elements of two input spaces are projected into a third space, the

Blending Blending Elements of two input spaces are projected into a third space, the blend, which contains elements of both, but is distinct from either one Non-linguistic blending Faces seen as combinations of parents

608 views • 24 slides
An Artefact Repository to Support Distributed Software Engineering October 29, 2004 1

An Artefact Repository to Support Distributed Software Engineering October 29, 2004 1

An Artefact Repository to Support Distributed Software Engineering October 29, 2004 1 Introduction The Open Source Component Artefact Repository (OSCAR) is an internet based system designed and built for use within the GENESIS process aware

688 views • 7 slides
Neural Networks applied to Blending Challenges Sowmya Kamath, Patricia Burchat Blending

Neural Networks applied to Blending Challenges Sowmya Kamath, Patricia Burchat Blending

Neural Networks applied to Blending Challenges Sowmya Kamath, Patricia Burchat Blending Workshop, 15th August, 2018 Blending & Neural Networks Object detection and instance segmentation is an active area of research in computer vision

528 views • 19 slides
Blending Blending Combining familiar spaces (domains of understanding, mental

Blending Blending Combining familiar spaces (domains of understanding, mental

Blending Blending Combining familiar spaces (domains of understanding, mental simulations, motor routines) to produce novel space with emergent structure General cognitive process Accidental or Creative Linguistic or

272 views • 24 slides
Hoare logic and Model checking If we can express the artefact as a temporal model too, and if the

Hoare logic and Model checking If we can express the artefact as a temporal model too, and if the

Hoare logic and Model checking If we can express the artefact as a temporal model too, and if the crucial aspects of the artefact. ...still, another crucial aspect of modelling is to not discard the M Abstraction of traffjc lights by some

538 views • 4 slides
Blending in LSST Data Products Jim Bosch, DM DRP Scientist / Princeton Blending Families Two

Blending in LSST Data Products Jim Bosch, DM DRP Scientist / Princeton Blending Families Two

Blending in LSST Data Products Jim Bosch, DM DRP Scientist / Princeton Blending Families Two Footprints: 2 above-threshold regions with peaks. 4 One isolated object ( 1 ). 3 One Parent ( 2 ): 5 blends measured with no deblending. Three

216 views • 20 slides
Modeling Algorithm for Test Cost Reduction of Analog/RF Circuits Hugo Gonalves 1,2 , Xin Li 1 ,

Modeling Algorithm for Test Cost Reduction of Analog/RF Circuits Hugo Gonalves 1,2 , Xin Li 1 ,

A Fast Wafer-Level Spatial Variation Modeling Algorithm for Test Cost Reduction of Analog/RF Circuits Hugo Gonalves 1,2 , Xin Li 1 , Miguel Correia 2 and Vitor Tavares 2 1 ECE Department, Carnegie Mellon University, USA 2 Faculdade de

480 views • 27 slides
Blending Wool for a uniform top which meets specification Martin Prins CSIRO FIBRE BLENDING

Blending Wool for a uniform top which meets specification Martin Prins CSIRO FIBRE BLENDING

FIBRE BLENDING Martin Prins Blending Wool for a uniform top which meets specification Martin Prins CSIRO FIBRE BLENDING Consists of selecting the right amounts of suitable wools to fulfil an order & then mixing them to give a uniform

726 views • 26 slides
A PROPORTIONATE AFFINE PROJECTION ALGORITHM USING FAST RECURSIVE FILTERING AND DICHOTOMOUS

A PROPORTIONATE AFFINE PROJECTION ALGORITHM USING FAST RECURSIVE FILTERING AND DICHOTOMOUS

A PROPORTIONATE AFFINE PROJECTION ALGORITHM USING FAST RECURSIVE FILTERING AND DICHOTOMOUS COORDINATE DESCENT ITERATIONS Felix Albu Valahia University of Targoviste Outline Motivation and objectives Development of the algorithm Simulation

668 views • 19 slides
An Analysis of Patch Plausibility and Correctness of

An Analysis of Patch Plausibility and Correctness of

An Analysis of Patch Plausibility and Correctness of Generate-And- Validate Patch Genera8on System Zichao Qi , Fan Long, Sara Achour, and Mar8n Rinard MIT

323 views • 29 slides
Some More Critical Section Solutions Dr. Liam OConnor University of Edinburgh LFCS (and UNSW)

Some More Critical Section Solutions Dr. Liam OConnor University of Edinburgh LFCS (and UNSW)

Petersons Algorithm Bakery Algorithm Fast Algorithm Szymanskis Algorithm Some More Critical Section Solutions Dr. Liam OConnor University of Edinburgh LFCS (and UNSW) Term 2 2020 1 Petersons Algorithm Bakery Algorithm Fast

435 views • 26 slides
SAH guided spatial split partitioning for fast BVH construction Per Ganestam and Michael Doggett

SAH guided spatial split partitioning for fast BVH construction Per Ganestam and Michael Doggett

SAH guided spatial split partitioning for fast BVH construction Per Ganestam and Michael Doggett Lund University Opportunistic triangle splitting for higher quality BVHs Bounding Volume Hierarchies (BVH) are a simple, compact 3D data

462 views • 30 slides
A Fast Algorithm for Permutation Pattern Matching Based on Alternating Runs Marie-Louise Bruner

A Fast Algorithm for Permutation Pattern Matching Based on Alternating Runs Marie-Louise Bruner

A Fast Algorithm for Permutation Pattern Matching Based on Alternating Runs Marie-Louise Bruner (Joint work with Martin Lackner) Vienna University of Technology June 13, 2012 Permutation Patterns, Glasgow Marie-Louise Bruner A Fast Algorithm

661 views • 37 slides
Chapter 8: Fast Convolution Keshab K. Parhi Chapter 8 Fast Convolution Introduction

Chapter 8: Fast Convolution Keshab K. Parhi Chapter 8 Fast Convolution Introduction

Chapter 8: Fast Convolution Keshab K. Parhi Chapter 8 Fast Convolution Introduction Cook-Toom Algorithm and Modified Cook-Toom Algorithm Winograd Algorithm and Modified Winograd Algorithm Iterated Convolution Cyclic

892 views • 50 slides
The FASK algorithm FASK (Fast Adjacency Skewness) appeals to Skewness. It runs the Fast

The FASK algorithm FASK (Fast Adjacency Skewness) appeals to Skewness. It runs the Fast

The FASK algorithm FASK (Fast Adjacency Skewness) appeals to Skewness. It runs the Fast Adjacency Search (FAS) to find edges that can be found from linearity. It uses a heuristic skewness rule to add additional edges to the graph.

487 views • 9 slides
FFTPL: An Analy,c Placement Algorithm Using Fast Fourier

FFTPL: An Analy,c Placement Algorithm Using Fast Fourier

FFTPL: An Analy,c Placement Algorithm Using Fast Fourier Transform for Density Equaliza,on Jingwei Lu 1 , Pengwen Chen 2 , Chin-Chih Chang 3 , Lu Sha 3 ,

760 views • 25 slides
Spatial Atomic Layer Deposition a novel very fast atmospheric pressure deposition technique

Spatial Atomic Layer Deposition a novel very fast atmospheric pressure deposition technique

Spatial Atomic Layer Deposition a novel very fast atmospheric pressure deposition technique bringing new possibilities for nano-scaled and nano- designed coatings for a range of large area glass and foil based applications Prof. Drs. Karel

733 views • 45 slides
Greenland ice sheet flow computations scaling-up to high spatial resolution and fast boundary

Greenland ice sheet flow computations scaling-up to high spatial resolution and fast boundary

Greenland ice sheet flow computations scaling-up to high spatial resolution and fast boundary processes Ed Bueler Dept. of Mathematics and Statistics Geophysical Institute University of Alaska, Fairbanks with help from Andy Aschwanden, ARSC,

373 views • 35 slides

More recommend