segmentation with a game
play

segmentation with a game Vincent Charvillat Amaia Salvador Aguilera - PowerPoint PPT Presentation

Jan 05, 2024 •201 likes •533 views

Crowdsourced object segmentation with a game Vincent Charvillat Amaia Salvador Aguilera Oge Marques Axel Carlier Xavier Gir i Nieto Outline Motivation Object Segmentation Experiments Results Conclusions Ongoing work

  1. Crowdsourced object segmentation with a game Vincent Charvillat Amaia Salvador Aguilera Oge Marques Axel Carlier Xavier Giró i Nieto

  2. Outline • Motivation • Object Segmentation • Experiments • Results • Conclusions • Ongoing work 2

  3. Motivation ? 3

  4. Motivation ? 4

  5. Semi-Supervised object segmentation Rough segmentation • B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman. Labelme: A database and web-based tool for image annotation. IJCV, 2008 5

  6. Semi-Supervised object segmentation • P. Arbelaez and L. Cohen. Constrained image segmentation from hierarchical boundaries. In CVPR'08, 2008. • 2) K. McGuinness and N. E. O'Connor. A comparative evaluation of interactive segmentation algorithms. 6

  7. Semi-Supervised object segmentation Boring task for users! 7

  8. 8

  9. Games with a purpose • J. Steggink and C. Snoek. Adding semantics to image-region annotations with the name-it- game. Multimedia Systems, 2011. • L. von Ahn, R. Liu, and M. Blum. Peekaboom: a game for locating objects in images. In CHI'06, 2006. 9

  10. Ask’nSeek A. Carlier, O. Marques, and V. Charvillat. Ask'nseek: A new game for object detection and labeling. In 10 ECCV'12 Workshops 2012.

  11. Motivation ? 11

  12. Outline • Motivation • Object Segmentation • Experiments • Results • Conclusions • Next steps 12

  13. Constrained parametric min-cuts for automatic object segmentation (CPMC) J. Carreira and C. Sminchisescu. Constrained parametric min-cuts for automatic object segmentation. In CVPR'10, 2010. 13

  14. Constrained parametric min-cuts for automatic object segmentation 14

  15. Motivation CPMC 15

  16. Outline • Motivation • Object Segmentation • Experiments • Results • Conclusions • Ongoing Work 16

  17. Experiments How many clicks do we need to achieve a certain quality in the segmentation? Test the algorithm for a large image dataset 17

  18. Pascal VOC2010 1928 images divided in: Train (964) Validation (964) 18

  19. Problem Simulator 19

  20. Simulator • The simulator generates points using the ground truth of the image. 20

  21. Simulator: Location of clicks S. Goferman, L. Zelnik-Manor, and A. Tal. Context-aware saliency detection. PAMI, 2012. 21

  22. Simulator: Foreground/Background ratio 22

  23. Outline • Motivation • Object Segmentation • Experiments • Results • Conclusions • Ongoing Work 23

  24. Jaccard index Measure of similarity between the segmentation result and the ground truth mask 24

  25. Results Using Pascal VOC2010 (Validation) 25

  26. Results Using Pascal VOC2010 (Validation) 26

  27. Outline • Motivation • Object Segmentation • Experiments • Results • Conclusions • Ongoing Work 27

  28. Conclusions • Realistic simulator to process large amounts of data. • Estimation of the expected AVERAGE Jaccard index by clicks. • Inter-class variance of results. 28

  29. Ongoing Work 29

  30. Ongoing Work • Image segmentation • CPMC candidates ● Label propagation through hierarchical partitions (eg. UCM, BPT…) ● Grabcut + Superpixels 30

  31. Ongoing Work • Data collection • Awarded with $250 in CrowdMM Competition (ACM MM Barcelona 2013). • Already more than 1500 games collected with 100 users More on that in our poster! 31

  32. Questions, suggestions… Thank you for your attention • Motivation • Object Segmentation • Experiments • Results • Conclusions • Ongoing Work 32

Recommend

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a fundamental low level operation on Segmentation is a fundamental low-level operation on images. If an image is already partitioned into segments

639 views • 51 slides
Segmentation Bottom-up Segmentation Semantic / instance segmentation Many Slides from L.

Segmentation Bottom-up Segmentation Semantic / instance segmentation Many Slides from L.

Segmentation Bottom-up Segmentation Semantic / instance segmentation Many Slides from L. Lazebnik. Outline Bottom-up segmentation Superpixel segmentation Semantic segmentation Metrics Architectures

1.28k views • 49 slides
Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Day 4 Lecture 2 Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image Segmentation: Datasets Pascal Visual Object Classes Microsoft COCO 20 Classes 80 Classes ~ 5.000 images ~ 300.000 images

995 views • 26 slides
Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation Hengshuang Zhao The Chinese University of Hong Kong May 29, 2019 Part I: I: Semantic Segmentation Semantic Segmentation background car person

510 views • 39 slides
e-Bug Junior Game Junior Game Game Style Game Process Demo Game Mechanics and

e-Bug Junior Game Junior Game Game Style Game Process Demo Game Mechanics and

e-Bug Junior Game Junior Game Game Style Game Process Demo Game Mechanics and Learning Outcomes Feedback to date and evaluation plans Game Style Game style encompasses two genres of game o Platform game fast action

575 views • 22 slides
e-Bug Senior Game Senior Game Game Style Game Process Demo Game Puzzles and

e-Bug Senior Game Senior Game Game Style Game Process Demo Game Puzzles and

e-Bug Senior Game Senior Game Game Style Game Process Demo Game Puzzles and Learning Outcomes Feedback to date and evaluation plans Game Style Game is a detective game where the player investigates microbial problems.

572 views • 19 slides
Semantic Segmentation / Instance Segmentation Based on Deep learning Yiding Liu 2018.12.08

Semantic Segmentation / Instance Segmentation Based on Deep learning Yiding Liu 2018.12.08

Semantic Segmentation / Instance Segmentation Based on Deep learning Yiding Liu 2018.12.08 Outline Overview of segmentation problem Semantic segmentation Instance Segmentation Our work Definition of segmentation problem Image

900 views • 54 slides
Segmentation using Segmentation using Bayesian Decision Theory Bayesian Decision Theory

Segmentation using Segmentation using Bayesian Decision Theory Bayesian Decision Theory

Segmentation Segmentation Segmentation using Segmentation using Bayesian Decision Theory Bayesian Decision Theory Segmentation of images is the separation of pixels into different categories depending upon their intensities and/or other

109 views • 8 slides
Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV Tools Layers Viewers Final Segmenting Original Scan Segmentation using Seg3D 2 3 Tools Menu Interactive tools for operating on volume

448 views • 10 slides
Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline

Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline

Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline Overview Three Levels of Segmentation Basic Segmentation Semantic Segmentation (FCN, DeepLab) Instance Segmentation (Mask-RCNN)

449 views • 28 slides
Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan

Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan

Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan University Fall 2018 1 Outline Segmentation Image segmentation Object selection with interactive segmentation Super-pixel methods

1.23k views • 87 slides
Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Accel : A Corrective Fusion Network for Efficient Semantic Segmentation on Video Samvit Jain , Xin Wang , Joseph Gonzalez RISE Lab, UC Berkeley Semantic segmentation Image classification Object detection Semantic segmentation Evolution

857 views • 13 slides
Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a Segmentation is the process of partitioning an digital image correspond to the objects to be image into semantically interpretable

766 views • 24 slides
Co-Segmentation of 3D Shapes via Subspace Clustering Ruizhen Hu Lubin Fan

Co-Segmentation of 3D Shapes via Subspace Clustering Ruizhen Hu Lubin Fan

Co-Segmentation of 3D Shapes via Subspace Clustering Ruizhen Hu Lubin Fan Ligang Liu Co-segmentation Input Hu et al. Co-Segmentation of 3D Shapes 2 Co-segmentation Output Hu et al. Co-Segmentation of 3D Shapes 3

1.26k views • 32 slides
Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017

Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017

Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017 Image Segmentation Semantic Segmentation Instance Segmentation Scene Parsing Human Parsing Stuff Segmentation New Track in COCO 2017

1.04k views • 103 slides
Learning a Segmentation as Classification Classification Model for Segmentation What is a Good

Learning a Segmentation as Classification Classification Model for Segmentation What is a Good

Learning a Segmentation as Classification Classification Model for Segmentation What is a Good Segmentation? Features for Classification Intra-region similarity Elements inside one region are similar: Similar brightness

576 views • 4 slides
1 What a Game is Not Outline A bunch of cool features What is a Game? Necessary, but

1 What a Game is Not Outline A bunch of cool features What is a Game? Necessary, but

Outline What is a Game? The Game Development Genres Process: Genres What is a Game? (1 of 4) What is a Game? (2 of 4) Movie? Movie? No interaction , outcome fixed Toy? Toy? Puzzle? No goal , but still fun!

512 views • 4 slides
Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation

Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation

2/9/2017 Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation Generate pixel level foreground masks for objects in a given image or video 2 1 2/9/2017 Why is Foreground Segmentation useful?

416 views • 25 slides
1 Method Outline Fragment Matching Fragment Extraction Individual Correspondence

1 Method Outline Fragment Matching Fragment Extraction Individual Correspondence

Overview (1) The major goal of image segmentation is to identify structures in the image that are likely to Class-Specific, Top-Down correspond to scene objects Classic image-based segmentation methods use Segmentation continuity of

523 views • 3 slides
Using BGP Flow-Spec for distributed micro-segmentation Davide Pucci / 12019364 Attilla de Groot /

Using BGP Flow-Spec for distributed micro-segmentation Davide Pucci / 12019364 Attilla de Groot /

Using BGP Flow-Spec for distributed micro-segmentation Davide Pucci / 12019364 Attilla de Groot / Cumulus Networks Data Center micro-segmentation Layer 2 segmentation Layer 3 segmentation VLANs to isolate multiple flows VRFs to separate

461 views • 16 slides
Rally-Owl Overview of Rally-Owl Game This game is based off of Rally-X The goal of the game is

Rally-Owl Overview of Rally-Owl Game This game is based off of Rally-X The goal of the game is

Rally-Owl Overview of Rally-Owl Game This game is based off of Rally-X The goal of the game is to collect all 10 flags before losing all your lives The game makes use of a horizontally and vertically scrolling map This game implements a

101 views • 8 slides
Segmentation of Objects in Images and Videos Alexandre X. Falc ao and Thiago V. Spina

Segmentation of Objects in Images and Videos Alexandre X. Falc ao and Thiago V. Spina

Introduction Region and Bounday-Based Segmentation using IFT A Comparison Between IFT and Min-Cut/Max-Flow Fuzzy Object Models and Video Segmentation Segmentation of Objects in Images and Videos Alexandre X. Falc ao and Thiago V. Spina

1.45k views • 124 slides
Game interoperability with functors functor AgsFun (structure Game : GAME) :> sig structure

Game interoperability with functors functor AgsFun (structure Game : GAME) :> sig structure

Game interoperability with functors functor AgsFun (structure Game : GAME) :> sig structure Game : GAME val bestmove : Game.config -> Game.Move.move option val forecast : Game.config -> Player.outcome end where type Game.Move.move =

247 views • 22 slides
Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a label to every pixel in an image such that pixels with the same label share certain visual characteristics. Contours are the lines separating

676 views • 32 slides

More recommend