contour detection and hierarchical image segmentation
play

Contour Detection and Hierarchical Image Segmentation P. Arbelaez, - PowerPoint PPT Presentation

Jan 20, 2023 •314 likes •644 views

Contour Detection and Hierarchical Image Segmentation P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik. IEEE TPAMI 2011. Islam Beltagy Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx Outline

  1. Contour Detection and Hierarchical Image Segmentation P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik. IEEE TPAMI 2011. Islam Beltagy Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  2. Outline  Introduction  Contour Detection  Hierarchical Segmentation  Results and Evaluation  Discussion Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  3. Contours (Ground Truth BSDS500) Contour Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  4. Segmentation (Ground Truth-BSDS500) Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  5. Goal • Contour Detection • Segmentation from Contours Original Image Contour Segmentation Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  6. Outline  Introduction  Contour Detection  Hierarchical Segmentation  Results and Evaluation  Discussion Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  7. Contours Detection Contour = Pr(x, y, Ο ) Original Image Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  8. Contour Detection-Oriented gradient of histograms Circular disk around (x, y) with orientation θ • Histograms of Intensities in both halves • ฀Chi Square distance between the two histograms • Three scales of r and eight values for θ • Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  9. Contour Detection •Extract different channels • Brightness L, Color a, Color b • Components of CIE Lab colorspace • Texture Convolve Replace K-mean pixel with clustering cluster index http://www.cs.berkeley.edu/~malik/papers/LM-3dtexton.pdf Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  10. Contour Detection • Local Cues Combination Scale: 3 different values for the disc diameter α: learned from training data max Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  11. Contour Detection • Globalization Affinity Normalized Eigen Matrix Cuts Values Apply filters then sum Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  12. Outline  Introduction  Contour Detection  Hierarchical Segmentation  Results and Evaluation  Discussion Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  13. Uncertainty in Segmentation Hierarchical Segmentation Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  14. Hierarchical Segmentation  Oriented Watershed Transform  Ultrametric Contour Map Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  15. Oriented Watershed Transform •Watershed Transform http://cmm.ensmp.fr/~beucher/wtshed.html Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  16. Oriented Watershed Transform •Watershed Transform Artifacts Weight each arc Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  17. Oriented Watershed Transform WT OWT Weight arcs according to orientation Fitting lines Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  18. Hierarchical Segmentation • Ultrametric Contour Map - Iterative Merging Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  19. Brief Summary Original Image Oriented Gradient of histograms Contour Hierarchical Segmentation Oriented Watershed Transform Threshold Ultrametric Contour Map Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  20. Outline  Introduction  Contour Detection  Hierarchical Segmentation  Results and Evaluation  Discussion Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  21. Result (BSDS500 dataset) Left to Right: Image, gPb-owt-ucm, threshold = optimal dataset scale, threshold = optimal picture scale Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  22. Result • BSDS300 Dataset Evaluation of contour detector Evaluation of segmentation algorithms Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  23. Region benchmarks(2) Covering Rand Index Variation of Information -ODS: optimal dataset scale -OIS: optimal image scale Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  24. Outline  Introduction  Contour Detection  Hierarchical Segmentation  Results and Evaluation  Discussion Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  25. Discussion  What enforces closure in OWT-UCM for all possible thresholds? Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  26. Discussion  How to define ground truth ? Can we use Hierarchal segmentation ? Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  27. Discussion  OIS and the different possible segmentations below, what do they suggest ? Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  28. Interactive Segmentation 1 Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  29. Discussion  Contours vs Segments. Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  30. Reference • P. Arbelaez, M. Maire, C. Fowlkes and J. Malik. Contour Detection and Hierarchical Image Segmentation . IEEE TPAMI, Vol. 33, No. 5, pp. 898-916, May 2011 P. Arbelaez, M. Maire, C. Fowlkes and J. Malik. From Contours to • Regions: An Empirical Evaluation. In CVPR 2009. P. Arbelaez and L. Cohen. Constrained Image Segmentation from • Hierarchical Boundaries. In CVPR 2008. Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

  31. Thanks Original slides from: Hsin-Min Cheng http://archer.ee.nctu.edu.tw/powerpoint/GM_1024.pptx

Recommend

Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a label to every pixel in an image such that pixels with the same label share certain visual characteristics. Contours are the lines separating

676 views • 32 slides
Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Accel : A Corrective Fusion Network for Efficient Semantic Segmentation on Video Samvit Jain , Xin Wang , Joseph Gonzalez RISE Lab, UC Berkeley Semantic segmentation Image classification Object detection Semantic segmentation Evolution

857 views • 13 slides
Interactive image segmentation with integrated use of the markers and the hierarchical watershed

Interactive image segmentation with integrated use of the markers and the hierarchical watershed

Watershed transform Integrated approach SegmentIt Interactive image segmentation with integrated use of the markers and the hierarchical watershed approaches Bruno Klava and Nina Sumiko Tomita Hirata Institute of Mathematics and Statistics

863 views • 46 slides
Introduction to Object Detection & Image Segmentation Abel Brown (abelb@nvidia.com) November

Introduction to Object Detection & Image Segmentation Abel Brown (abelb@nvidia.com) November

Introduction to Object Detection & Image Segmentation Abel Brown (abelb@nvidia.com) November 2, 2017 Outline What is Object Detection and Segmentation? Examples Before Deep Learning Common Issues with Algorithms Quality Assessment and

512 views • 47 slides
Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a Segmentation is the process of partitioning an digital image correspond to the objects to be image into semantically interpretable

766 views • 24 slides
Seminar: Medical Image Processing A robust approach for automatic detection and segmentation of

Seminar: Medical Image Processing A robust approach for automatic detection and segmentation of

Introduction Morphology Linear filters Detection Evaluation Summary Seminar: Medical Image Processing A robust approach for automatic detection and segmentation of cracks in underground pipeline images Tim Niemueller < tim@niemueller.de

2.1k views • 165 slides
Learning-based Contour Detection & Contour-based Object Detection Iasonas Kokkinos Department

Learning-based Contour Detection & Contour-based Object Detection Iasonas Kokkinos Department

1 Learning-based Contour Detection &

766 views • 64 slides
JOINT DETECTION AND SEGMENTATION WITH DEEP HIERARCHICAL NETWORKS Zhao Chen Machine Learning

JOINT DETECTION AND SEGMENTATION WITH DEEP HIERARCHICAL NETWORKS Zhao Chen Machine Learning

JOINT DETECTION AND SEGMENTATION WITH DEEP HIERARCHICAL NETWORKS Zhao Chen Machine Learning Intern, NVIDIA ABOUT ME 5th year PhD student in physics @ S tanford by day, deep learning computer vision scientist by night. Intern with Deep

1.1k views • 53 slides
Edge Detection (points and lines too) Image analysis Image Analysis Derive

Edge Detection (points and lines too) Image analysis Image Analysis Derive

Edge Detection (points and lines too) Image analysis Image Analysis Derive features from an image segment an image into its constituent parts or objects how and why depends on application Segmentation Hard

243 views • 22 slides
A new metric for evaluating semantic segmentation: leveraging global and contour accuracy Eduardo

A new metric for evaluating semantic segmentation: leveraging global and contour accuracy Eduardo

Introduction Semantic segmentation Accuracy evaluation Conclusions A new metric for evaluating semantic segmentation: leveraging global and contour accuracy Eduardo Fernandez-Moral 1 , Renato Martins 1 , Denis Wolf 2 , and Patrick Rives 1 1

786 views • 40 slides
1 Method Outline Fragment Matching Fragment Extraction Individual Correspondence

1 Method Outline Fragment Matching Fragment Extraction Individual Correspondence

Overview (1) The major goal of image segmentation is to identify structures in the image that are likely to Class-Specific, Top-Down correspond to scene objects Classic image-based segmentation methods use Segmentation continuity of

523 views • 3 slides
18. Quadtrees Quadtrees, Collision Detection, Image Segmentation ... and as such it is not

18. Quadtrees Quadtrees, Collision Detection, Image Segmentation ... and as such it is not

Quadtree A quad tree is a tree of order 4. 18. Quadtrees Quadtrees, Collision Detection, Image Segmentation ... and as such it is not particularly interesting except when it is used for ... 523 524 Quadtree - Interpretation und Nutzen

68 views • 6 slides
Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set

Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set

Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set of regions Regions representing meaningful areas of the image, such as crops, urban areas, forests. Various applications in Computer

781 views • 61 slides
Image Segmentation Segmentation is the process of partitioning an image into regions

Image Segmentation Segmentation is the process of partitioning an image into regions

Image Segmentation Segmentation is the process of partitioning an image into regions region: group of connected pixels with similar properties properties properties: gray levels, colors, textures, motion characteristics (motion

546 views • 19 slides
Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur March 04 and 05, 2020

Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur March 04 and 05, 2020

Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur March 04 and 05, 2020 Detection RCNN Architectures YOLO Segmentation Agenda To get introduced to two important tasks of computer vision - detection and segmentation

1.41k views • 115 slides
Statistical image segmentation with Bayesian approach Tapio Helin Institute of Mathematics,

Statistical image segmentation with Bayesian approach Tapio Helin Institute of Mathematics,

Introduction Hierarchical stochastic model Conclusions Statistical image segmentation with Bayesian approach Tapio Helin Institute of Mathematics, Helsinki University of Technology Workshop on Inverse and Partial Information Problems:

650 views • 23 slides
Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University

Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University

Lecture 6: Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University Today What is image segmentation? A smrgsbord of methods for image segmentation: Thresholding Edge-based segmentation

830 views • 51 slides
Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation Hengshuang Zhao The Chinese University of Hong Kong May 29, 2019 Part I: I: Semantic Segmentation Semantic Segmentation background car person

510 views • 39 slides
Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Day 4 Lecture 2 Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image Segmentation: Datasets Pascal Visual Object Classes Microsoft COCO 20 Classes 80 Classes ~ 5.000 images ~ 300.000 images

995 views • 26 slides
Experiments from paper on Hierarchical Video Segmentation February 17, 2016 Original paper:

Experiments from paper on Hierarchical Video Segmentation February 17, 2016 Original paper:

Experiments from paper on Hierarchical Video Segmentation February 17, 2016 Original paper: Streaming Hierarchical Video Segmentation Chenliang Xu , Caiming Xiong and Jason J. Corso Further Experiments and Presentation: Kim Houck Using code

315 views • 15 slides
Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV Tools Layers Viewers Final Segmenting Original Scan Segmentation using Seg3D 2 3 Tools Menu Interactive tools for operating on volume

448 views • 10 slides
Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017

Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017

Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017 Image Segmentation Semantic Segmentation Instance Segmentation Scene Parsing Human Parsing Stuff Segmentation New Track in COCO 2017

1.04k views • 103 slides
19. Quadtrees Quadtrees, Collision Detection, Image Segmentation 514 Quadtree A quad tree is a

19. Quadtrees Quadtrees, Collision Detection, Image Segmentation 514 Quadtree A quad tree is a

19. Quadtrees Quadtrees, Collision Detection, Image Segmentation 514 Quadtree A quad tree is a tree of order 4. ... and as such it is not particularly interesting except when it is used for ... 515 Quadtree - Interpretation und Nutzen

560 views • 23 slides
CNN Applications in Computer Vision ELEG 5491 Tutorial Xihui Liu Table of Contents Image

CNN Applications in Computer Vision ELEG 5491 Tutorial Xihui Liu Table of Contents Image

CNN Applications in Computer Vision ELEG 5491 Tutorial Xihui Liu Table of Contents Image Representation & Pre-processing Object detection Semantic Segmentation Instance Segmentation 2 Image Representation Grayscale image

1.13k views • 39 slides

More recommend