binary foreground map evaluation
play

Binary Foreground Map Evaluation Deng-Ping Fan Nankai University of - PowerPoint PPT Presentation

May 26, 2023 •343 likes •1.01k views

Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan Nankai University of Media Computing Lab IJCAI2018 Oral Presentation http://dpfan.net/e-measure Outline Overview of Binary Foreground Maps Previous Work

  1. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan Nankai University of Media Computing Lab IJCAI’2018 Oral Presentation http://dpfan.net/e-measure

  2. Outline  Overview of Binary Foreground Maps  Previous Work  Enhanced-alignment Measure  Experiments Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  3. Binary Foreground Map 0 (a) Image (b) Binary foreground map 1 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  4. Binary Foreground Map  The binary foreground map consists of values of either 0 or 1.  1 denotes foreground, 0 for background. 0 (a) Image (b) Binary foreground map 1 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  5. Application  Object Segmentation (a) Image (d) GT Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  6. Application  Object Segmentation (b) MDF (CVPR’15) (c) DISC (TNNLS’16) (a) Image (e) DCL (CVPR’16) (d) GT (f) Noise Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  7. Evaluation  Similarity evaluation is very important. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  8. Evaluation  Similarity evaluation is very important. VS VS Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  9. Outline  Overview of Binary Foreground Maps  Previous Work  Enhanced-alignment Measure  Experiments Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  10. Previous Work  Intersection-over-Union ( IoU ) Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  11. Previous Work  Intersection-over-Union ( IoU ) A Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  12. Previous Work  Intersection-over-Union ( IoU ) B Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  13. Previous Work  Intersection-over-Union ( IoU ) A B Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  14. Previous Work  Intersection-over-Union ( IoU ) 𝐽𝑝𝑉 = 𝐵 ∩ 𝐶 𝐵 ∪ 𝐶 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  15. Previous Work  Intersection-over-Union ( IoU ) A∩B 𝐽𝑝𝑉 = 𝐵 ∩ 𝐶 𝐵 ∪ 𝐶 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  16. Previous Work  Intersection-over-Union ( IoU ) A∩B 𝐽𝑝𝑉 = 𝐵 ∩ 𝐶 𝐵 ∪ 𝐶 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  17. Previous Work  Intersection-over-Union ( IoU ) A∩B 𝐽𝑝𝑉 = 𝐵 ∩ 𝐶 𝐵 ∪ 𝐶 A ∪ B Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  18. Previous Work  Contour Mapping ( CM ) [1] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  19. Previous Work  Contour Mapping ( CM ) [1] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  20. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  21. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework. 𝐺1 𝐽𝑝𝑉 = 2 − 𝐺1 [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  22. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework.  Visual Quality ( VQ ) [3] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  23. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework.  Visual Quality ( VQ ) [3] Considering psychological function based on the IoU. [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  24. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework.  Visual Quality ( VQ ) [3] Considering psychological function based on the IoU.  Structure measure ( S-measure ) [4] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  25. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework.  Visual Quality ( VQ ) [3] Considering psychological function based on the IoU.  Structure measure ( S-measure ) [4] Mainly focus on the non-binary maps evaluation. [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  26. Previous Work Table1. Current evaluation measure summary Measure Year Pros Cons IoU 190 easy to calculate losing image level statistics 1 CM [1] 2010 considering both region and noise sensitive contour assigning different weights error location sensitive, Fbw [2] 2014 for errors complicated VQ [3] 2015 weighting errors by subjective measure psychological function S-measure [4] 2017 considering structure focusing on non-binary map similarity properties [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  27. Problem (a) Image (b) GT (c) Foreground map (d) Noise Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

Recommend

Binary images Constrained image capture setting Two pixel values Foreground and

Binary images Constrained image capture setting Two pixel values Foreground and

Sudheendras office hours Mon, Wed 1-2 pm Lecture 3: Binary image analysis ENS 31NR Forsyth and Ponce book Thursday, Sept 6 Binary images Constrained image capture setting Two pixel values Foreground and background

518 views • 13 slides
Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation

Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation

2/9/2017 Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation Generate pixel level foreground masks for objects in a given image or video 2 1 2/9/2017 Why is Foreground Segmentation useful?

416 views • 25 slides
A Comparative Evaluation of Foreground/Background Sketch-based Mesh Segmentation Algorithms Min

A Comparative Evaluation of Foreground/Background Sketch-based Mesh Segmentation Algorithms Min

A Comparative Evaluation of Foreground/Background Sketch-based Mesh Segmentation Algorithms Min Meng Lubin Fan Ligang Liu Zhejiang University, China Mesh Segmentation Modeling Deformation Morphing Texture Mapping Shape Retrieval Shape

449 views • 41 slides
Software and Foreground Subtraction Dave McGinnis 4/26/2010 Foreground Subtraction - McGinnis

Software and Foreground Subtraction Dave McGinnis 4/26/2010 Foreground Subtraction - McGinnis

21cm Instrument Simulation Software and Foreground Subtraction Dave McGinnis 4/26/2010 Foreground Subtraction - McGinnis 1 SKY SIMULATION SOFTWARE 4/26/2010 Foreground Subtraction - McGinnis 2 Code Suite 20 Java classes organized into

727 views • 34 slides
Lecture 3: Binary image analysis Thursday, Sept 6 Sudheendras office hours Mon, Wed

Lecture 3: Binary image analysis Thursday, Sept 6 Sudheendras office hours Mon, Wed

Lecture 3: Binary image analysis Thursday, Sept 6 Sudheendras office hours Mon, Wed 1-2 pm ENS 31NR Forsyth and Ponce book Binary images Two pixel values Foreground and background Regions of interest

1.13k views • 78 slides
Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC Measures

Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC Measures

Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC Measures compstat-lmu.github.io/lecture_i2ml IMBALANCED BINARY LABELS Classify all as no disease (green) high accuracy. Accuracy Paradox c

451 views • 10 slides
Binary Numbers Binary numbers look like this Binary Numbers or Binary Code Binary numbers or

Binary Numbers Binary numbers look like this Binary Numbers or Binary Code Binary numbers or

Binary Numbers Binary numbers look like this Binary Numbers or Binary Code Binary numbers or binary code are used by computers and digital devices to talk to each other. It is used to give commands to the computer or a way to enter data

165 views • 12 slides
How to Make a Game Like Flappy Bird in Swift Step 3: Moving the Background Moving Foreground

How to Make a Game Like Flappy Bird in Swift Step 3: Moving the Background Moving Foreground

How to Make a Game Like Flappy Bird in Swift Step 3: Moving the Background Moving Foreground Moving Foreground Demo: Moving Foreground Challenge Time!

462 views • 6 slides
Foreground detection and tracking in 2D/3D Jos Luis Landabaso Montse Pards Outline 2D

Foreground detection and tracking in 2D/3D Jos Luis Landabaso Montse Pards Outline 2D

Foreground detection and tracking in 2D/3D Jos Luis Landabaso Montse Pards Outline 2D Foreground Detection 2D Object Tracking 3D Foreground Detection 3D Object Tracking 2D Entity Detection: Stauffer &Grimson We model

562 views • 29 slides
Morphological Operators CS/BIOEN 4640: Image Processing Basics February 23, 2012 Common

Morphological Operators CS/BIOEN 4640: Image Processing Basics February 23, 2012 Common

Morphological Operators CS/BIOEN 4640: Image Processing Basics February 23, 2012 Common Morphological Operations Shrinking the foreground (erosion) Expanding the foreground (dilation) Removing holes in the foreground

635 views • 30 slides
CSE 421 Project Selection / Reductions Shayan Oveis Gharan 1 Image Segmentation Foreground /

CSE 421 Project Selection / Reductions Shayan Oveis Gharan 1 Image Segmentation Foreground /

CSE 421 Project Selection / Reductions Shayan Oveis Gharan 1 Image Segmentation Foreground / background segmentation Label each pixel as foreground/background. V = set of pixels, E = pairs of neighboring pixels. # 0 is

604 views • 21 slides
Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC

Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC

Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC visualization compstat-lmu.github.io/lecture_i2ml LABELS: ROC SPACE Plot True Positive Rate and False Positive Rate: 1.00 True Class y C2 +

596 views • 17 slides
The Power of Binary 0, 1, 10, 11, 100, 101, 110, 111... What is Binary? a binary number

The Power of Binary 0, 1, 10, 11, 100, 101, 110, 111... What is Binary? a binary number

The Power of Binary 0, 1, 10, 11, 100, 101, 110, 111... What is Binary? a binary number is a number expressed in the binary numeral system, or base-2 numeral system, which represents numeric values using two different symbols: typically

485 views • 19 slides
Evaluation of Program Success for Programs with Multiple Trials in Binary Outcomes Meihua Wang,

Evaluation of Program Success for Programs with Multiple Trials in Binary Outcomes Meihua Wang,

Evaluation of Program Success for Programs with Multiple Trials in Binary Outcomes Meihua Wang, G. Frank Liu, Jerald Schindler Merck Research Laboratory 12/15/2015 Outline Background Methods -- Probability of success (POS) --

270 views • 24 slides
Detecting Foreground Huynh The Thien thienht@oslab.khu.ac.kr Dept. of Computer Science &

Detecting Foreground Huynh The Thien thienht@oslab.khu.ac.kr Dept. of Computer Science &

KYUNG HEE UNIVERSITY Department of Computer Science & Engineering PhD Thesis Dissertation Presentation PhD Thesis Dissertation Presentation Ubiquitous Computing Lab NIC: A Novel Background Estimation Algorithm For Detecting Foreground

831 views • 48 slides
Binary Search Tree intro BST with order properties After today, you should be able to

Binary Search Tree intro BST with order properties After today, you should be able to

Binary Search Tree intro BST with order properties After today, you should be able to implement deletion from a BST Partner Evaluation done? Q/A and Work time today, 2 nd hour Binary Trees that store elements in increasing order

91 views • 8 slides
LECTURE 2 Review 1 Binary Math and Assembly BINARY MATH In this section, we review Binary

LECTURE 2 Review 1 Binary Math and Assembly BINARY MATH In this section, we review Binary

LECTURE 2 Review 1 Binary Math and Assembly BINARY MATH In this section, we review Binary to decimal conversions and vice versa IEEE 754 Floating point representations Binary Arithmetic Decimal representation of binary numbers

1.66k views • 118 slides
Binary There are 10 types of people in the world those that understand binary and those

Binary There are 10 types of people in the world those that understand binary and those

Binary There are 10 types of people in the world those that understand binary and those that dont. What is binary? You and I write numbers like this: twelve is 12, sixty eight is 68, and one hundred is 100 Binary is a number

525 views • 26 slides
Synchrotron Radia iatio ion as s a Foreground to th the Glo lobal l Redshif ifted 21 21-cm

Synchrotron Radia iatio ion as s a Foreground to th the Glo lobal l Redshif ifted 21 21-cm

U. of Richmond July 21, 2017 Radio Synchrotron Background Conference Synchrotron Radia iatio ion as s a Foreground to th the Glo lobal l Redshif ifted 21 21-cm Measurement by EDGES Raul A. Monsalve University of Colorado Boulder -

556 views • 54 slides
Simple foreground cleaning algorithm for detecting primordial B-mode polarization of the CMB

Simple foreground cleaning algorithm for detecting primordial B-mode polarization of the CMB

Simple foreground cleaning algorithm for detecting primordial B-mode polarization of the CMB Eiichiro Komatsu (Max-Planck-Institut fr Astrophysik) Big3 Workshop, APC, Paris, September 20, 2013 This presentation is based on: Review part:

518 views • 39 slides
Statistical modelling of dust polarization as a CMB foreground Franois Boulanger Ecole

Statistical modelling of dust polarization as a CMB foreground Franois Boulanger Ecole

Statistical modelling of dust polarization as a CMB foreground Franois Boulanger Ecole Normale Suprieure Polarized Galactic and CMB skies Take home message The successes of ever more powerful experiments have transformed

489 views • 29 slides
A Quick Review Decimal to binary Binary to decimal Binary to hexadecimal

A Quick Review Decimal to binary Binary to decimal Binary to hexadecimal

A Quick Review Decimal to binary Binary to decimal Binary to hexadecimal Hexadecimal to binary Hexadecimal to Decimal Binary addition Binary subtraction Binary shift Decimal to Binary 146d = ????????b 146/2

91 views • 7 slides
Binary Numbers Calculate your age Binary & decimal differences In binary 1 represents

Binary Numbers Calculate your age Binary & decimal differences In binary 1 represents

Binary Numbers Calculate your age Binary & decimal differences In binary 1 represents on Fun Facts Why 10 digits? Because and the 0 represents off people typically have 10 fingers and 10 toes, making it easy for counting! 2

119 views • 10 slides
FastTrack: Foreground App-Aware I/O Management for Improving User Experience of Android

FastTrack: Foreground App-Aware I/O Management for Improving User Experience of Android

FastTrack: Foreground App-Aware I/O Management for Improving User Experience of Android Smartphones Jihong Kim Seoul National University NVRAMOS 2018 October 25, 2018 Mobile Storage Optimization Research Why does my aging smartphone get

732 views • 36 slides

More recommend