interactive image segmentation with integrated use of the
play

Interactive image segmentation with integrated use of the markers - PowerPoint PPT Presentation

Oct 14, 2022 •391 likes •863 views

Watershed transform Integrated approach SegmentIt Interactive image segmentation with integrated use of the markers and the hierarchical watershed approaches Bruno Klava and Nina Sumiko Tomita Hirata Institute of Mathematics and Statistics

  1. Watershed transform Integrated approach SegmentIt Interactive image segmentation with integrated use of the markers and the hierarchical watershed approaches Bruno Klava and Nina Sumiko Tomita Hirata Institute of Mathematics and Statistics University of S˜ ao Paulo Brazil 06 February, 2009 This work is supported by CNPq, Brazil. Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  2. Watershed transform Integrated approach SegmentIt Outline Watershed transform 1 Classical watershed Watershed from markers Hierarchical watershed Integrated approach 2 Interactive segmentation From markers to the hierarchical watershed From hierarchical watershed to markers Integrated approach SegmentIt 3 Demonstration Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  3. Watershed transform Integrated approach SegmentIt Watershed transform [Beucher and Meyer, 1993] Classical watershed - Flooding simulation from the regional minima (Loading animation...) Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  4. Watershed transform Integrated approach SegmentIt Classical watershed Oversegmentation problem - Primitive catchment basins Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  5. Watershed transform Integrated approach SegmentIt Classical watershed Oversegmentation problem - Primitive catchment basins Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  6. Watershed transform Integrated approach SegmentIt Watershed from markers Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  7. Watershed transform Integrated approach SegmentIt Watershed from markers Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  8. Watershed transform Integrated approach SegmentIt Watershed from markers Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  9. Watershed transform Integrated approach SegmentIt Watershed from markers Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  10. Watershed transform Integrated approach SegmentIt Watershed from markers Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  11. Watershed transform Integrated approach SegmentIt Watershed on graphs WT can be formulated as a graph optimization problem: WS ( G I , M ) 19 22 27 60 98 98 98 93 G I = ( V , E , ω ) : a graph 100 124 169 169 166 19 19 22 76 19 22 100 124 169 169 169 166 representing the input image I 155 155 169 169 169 140 19 19 33 15 33 155 155 155 159 169 140 Granularities: 168 162 145 159 170 152 14 15 83 14 83 168 168 162 90 170 170 Pixel Adjacency Graph PAG I 139 168 162 170 152 19 19 72 90 Region Adjacency Graph 19 139 168 168 139 55 170 170 168 152 139 119 170 152 30 30 55 RAG I 30 152 168 168 85 119 170 170 152 168 170 170 152 30 32 85 55 ω : dissimilarity measure 32 152 156 156 46 170 170 170 140 140 152 159 170 170 120 between the vertices 61 61 140 152 159 159 61 167 167 167 140 140 137 159 102 102 167 167 120 M : the set of markers 129 137 157 157 102 164 164 164 129 139 147 179 169 169 164 164 133 139 147 179 179 169 169 163 157 129 139 104 179 169 169 163 157 133 33 104 168 168 158 158 115 115 Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  12. Watershed transform Integrated approach SegmentIt Watershed on graphs WT can be formulated as a graph optimization problem: WS ( G I , M ) G I = ( V , E , ω ) : a graph representing the input image I Granularities: Pixel Adjacency Graph PAG I Region Adjacency Graph RAG I ω : dissimilarity measure between the vertices M : the set of markers Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  13. Watershed transform Integrated approach SegmentIt Watershed on graphs P = WS ( G I , M ) is obtained by propagating the label of the markers for all the vertices of G I using minimum cost paths; WS ( G I , M ) can have multiple optimal solutions (minimum cost paths can be not unique), the obtained solution depends on the implementation details (queue policies, processing order of vertices, neighbors and markers, etc.) Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  14. Watershed transform Integrated approach SegmentIt Hierarchical watershed Tree of Critical Lakes (TCL) [Meyer, 1996] Hierarchy: nested set of partitions, where the finest partition is given by the classical watershed. I H E E F G D D C C A A A B C D E B B (a) Original image (b) Finest partition (c) MST of the (d) TCL RAG (simplified) Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  15. Watershed transform Integrated approach SegmentIt Hierarchical watershed Construction of the Tree of Critical Lakes (TCL) C A B A B C Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  16. Watershed transform Integrated approach SegmentIt Hierarchical watershed Construction of the Tree of Critical Lakes (TCL) D A D A B C Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  17. Watershed transform Integrated approach SegmentIt Hierarchical watershed Construction of the Tree of Critical Lakes (TCL) E E D A B C Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  18. Watershed transform Integrated approach SegmentIt Hierarchical watershed Limitation of partitions that can be found on the TCL C A E B D A B C Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  19. Watershed transform Integrated approach SegmentIt Hierarchical watershed Navigating through the partitions of the TCL [Zanoguera et al., 1999] E E G D D C C F F H I I I H H H F G F G F G A B C D E A B C D E A B C D E (a) Threshold (b) Split (c) Merge Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  20. Watershed transform Integrated approach SegmentIt Interactive segmentation Systems based on automatic segmentation are usually restricted to specific domains and for two classes of objects (foreground / background) Formal specification of the parameters of a segmentation algorithm can be very difficult; A post-processing of the partition (obtained through automatic techniques) may be necessary to achieve a satisfactory result; The concept of a good partition may depend on the purpose of its use and may be highly subjective. Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  21. Watershed transform Integrated approach SegmentIt Watershed from markers Strong points easy to segment a specific region works on both granularities (pixels and regions) easy to “force” inexistent borders Weak points a marker has to be drawn for each region of interest high interaction effort to design markers for complex regions Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  22. Watershed transform Integrated approach SegmentIt Hierarchical watershed Strong points easy to segment several objects according to their metrics works on the regions granularity (efficiency) Weak points works on the regions granularity (borders are always borders of the primitive catchment basins) the partitions are limited due to the structure of the TCL hard to segment a specific region Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  23. Watershed transform Integrated approach SegmentIt Proposal Integrate the watershed from markers and the hierarchical watershed in order to allow the full use of the strengths of both approaches. Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

  24. Watershed transform Integrated approach SegmentIt Problem From markers to the hierarchical watershed Given: Set of markers M Partition P = WS ( G I , M ) of the image I We want: Hierarchy of partitions of I which contains P From hierarchical watershed to markers Given: Partition P selected from a hierarchy of partitions of the image I We want: Set of markers M such that WS ( G I , M ) = P Bruno Klava and Nina Sumiko Tomita Hirata Interactive image segmentation with integrated use of the markers . . .

Recommend

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV Tools Layers Viewers Final Segmenting Original Scan Segmentation using Seg3D 2 3 Tools Menu Interactive tools for operating on volume

448 views • 10 slides
Towards Intelligent Interactive Segmentation of Medical Images Guotai Wang University of

Towards Intelligent Interactive Segmentation of Medical Images Guotai Wang University of

Towards Intelligent Interactive Segmentation of Medical Images Guotai Wang University of Electronic Science and Technology of China 2019-9-4 Content 1 Minimally interactive 2, Interactive segmentation 3, Image-specific fine-tuning

630 views • 37 slides
Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a Segmentation is the process of partitioning an digital image correspond to the objects to be image into semantically interpretable

766 views • 24 slides
Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation

Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation

2/9/2017 Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation Generate pixel level foreground masks for objects in a given image or video 2 1 2/9/2017 Why is Foreground Segmentation useful?

416 views • 25 slides
Integrating Color Image Segmentation and User Labeling for Efficient and Robust Graphics

Integrating Color Image Segmentation and User Labeling for Efficient and Robust Graphics

Integrating Color Image Segmentation and User Labeling for Efficient and Robust Graphics Recognition from Historical Maps Summary: the integration of a Color Image Segmentation (CIS) step with an interactive road-layer extraction process that

444 views • 6 slides
1 Method Outline Fragment Matching Fragment Extraction Individual Correspondence

1 Method Outline Fragment Matching Fragment Extraction Individual Correspondence

Overview (1) The major goal of image segmentation is to identify structures in the image that are likely to Class-Specific, Top-Down correspond to scene objects Classic image-based segmentation methods use Segmentation continuity of

523 views • 3 slides
Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set

Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set

Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set of regions Regions representing meaningful areas of the image, such as crops, urban areas, forests. Various applications in Computer

782 views • 61 slides
Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan

Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan

Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan University Fall 2018 1 Outline Segmentation Image segmentation Object selection with interactive segmentation Super-pixel methods

1.23k views • 87 slides
Image Segmentation Segmentation is the process of partitioning an image into regions

Image Segmentation Segmentation is the process of partitioning an image into regions

Image Segmentation Segmentation is the process of partitioning an image into regions region: group of connected pixels with similar properties properties properties: gray levels, colors, textures, motion characteristics (motion

546 views • 19 slides
Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University

Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University

Lecture 6: Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University Today What is image segmentation? A smrgsbord of methods for image segmentation: Thresholding Edge-based segmentation

830 views • 51 slides
Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation Hengshuang Zhao The Chinese University of Hong Kong May 29, 2019 Part I: I: Semantic Segmentation Semantic Segmentation background car person

510 views • 39 slides
Interactive FIJI/ImageJ2 Plugin for Biological Image Segmentation Case Study: Wound Healing

Interactive FIJI/ImageJ2 Plugin for Biological Image Segmentation Case Study: Wound Healing

Senior Project, Spring 2019 Interactive FIJI/ImageJ2 Plugin for Biological Image Segmentation Case Study: Wound Healing Analysis Nurzhan Sakenov, Bekzhan Kaspakov, Madiyar Katranov Adviser: Martin Lukac Wound Healing Analysis Cell migration

1.64k views • 11 slides
Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Day 4 Lecture 2 Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image Segmentation: Datasets Pascal Visual Object Classes Microsoft COCO 20 Classes 80 Classes ~ 5.000 images ~ 300.000 images

995 views • 26 slides
Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a label to every pixel in an image such that pixels with the same label share certain visual characteristics. Contours are the lines separating

676 views • 32 slides
Complex Network Construction for Interactive Image Segmentation using Particle Competition and

Complex Network Construction for Interactive Image Segmentation using Particle Competition and

Complex Network Construction for Interactive Image Segmentation using Particle Competition and Cooperation: A New Approach Jefferson A. R. Passerini and Fabricio Breve Fabricio Breve So Paulo State University (UNESP) fabricio.breve@unesp.br

486 views • 26 slides
Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Accel : A Corrective Fusion Network for Efficient Semantic Segmentation on Video Samvit Jain , Xin Wang , Joseph Gonzalez RISE Lab, UC Berkeley Semantic segmentation Image classification Object detection Semantic segmentation Evolution

857 views • 13 slides
Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017

Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017

Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017 Image Segmentation Semantic Segmentation Instance Segmentation Scene Parsing Human Parsing Stuff Segmentation New Track in COCO 2017

1.04k views • 103 slides
Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images

Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images

Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images Yuri Y. Boykov and Marie-Pierre Jolly 1 From [3] 2 Vision problems as image labeling depth (stereo) object index (segmention) original

562 views • 20 slides
YIN XU 1. Image Segmentaion & Retrieval What is image segmentation? Whats the

YIN XU 1. Image Segmentaion & Retrieval What is image segmentation? Whats the

CS688: Large-Scale Image & Video Retrieval (Spring 2020) YIN XU 1. Image Segmentaion & Retrieval What is image segmentation? Whats the relationship to image retrieval? 2. Current challenges & solutions: Challenges: Intra-class

239 views • 23 slides
Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline

Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline

Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline Overview Three Levels of Segmentation Basic Segmentation Semantic Segmentation (FCN, DeepLab) Instance Segmentation (Mask-RCNN)

449 views • 28 slides
Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati

Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/CS510/CS510_Computati onal_Photography.htm 05/10/2018 Last Time o Image segmentation n Normalized cut and segmentation 2 Today o Segmentation n Interactive image

581 views • 40 slides
FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION

FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION

FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION TO ROBOT VISION J. Chamorro-Martnez D. Snchez B. Prados-Surez Department of Computer Science and Artificial Intelligence. University of

164 views • 15 slides
VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a fundamental low level operation on Segmentation is a fundamental low-level operation on images. If an image is already partitioned into segments

639 views • 51 slides
Blobworld Image segmentation using EM and its application to image querying [Carson et. al. ]

Blobworld Image segmentation using EM and its application to image querying [Carson et. al. ]

Blobworld Image segmentation using EM and its application to image querying [Carson et. al. ] Presented by: Nikhil V. Shirahatti Introduction: Why do we need an image retrieval system? So does text retrieval method work for images?

988 views • 34 slides

More recommend