Illumination-invariant Robust Multiview 3D Human Motion Capture - PowerPoint PPT Presentation

Mar 17, 2023 •239 likes •331 views

Illumination-invariant Robust Multiview 3D Human Motion Capture Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt MPI for Informatics, Intel VCI, Saarbruecken, Germany nroberti@mpi-inf.mpg.de Nadia Robertini Goal Input

Illumination-invariant Robust Multiview 3D Human Motion Capture Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt MPI for Informatics, Intel VCI, Saarbruecken, Germany nroberti@mpi-inf.mpg.de Nadia Robertini
Goal … Input Output http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Related Work ▪ Color-based: – Calibrated Light – Controlled Studio time ▪ Data-driven (e.g. CNN ) – More robust to illumination – Sparse information – Temporally unstable 2D Joints Detections http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Our Approach 2D Joints Detections time Pre-segmented Frames http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Our Approach: Material Segmentation Graph-cut Skin SkinSkin Output Pose Appearance Input Costs Costs http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Results: Illumination Robustness Global Soft Shadows Global Harsh Shadows http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Results: Initialization Robustness http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Comparisons Ours Data-driven Combined Color-based http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Thank you! Illumination-invariant Robust Multiview 3D Human Motion Capture (479, 13B) Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt Data Available! nroberti@mpi-inf.mpg.de http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini

Recommend

1 Algorithm for Identifying Loop Invariant Code Algorithm for Identifying Loop Invariant Code

Loop Invariant Code Motion Loop Invariant Code Motion Background: ud- and du-chains Last Time ud-Chains Control flow analysis A ud-chain connects a use of a variable to all defs of a variable that might reach it (a sparse representation

355 views • 6 slides

Loop-invariant code motion Example Two steps: analysis & transformation x := 3 Step 1: find

Loop-invariant code motion Example Two steps: analysis & transformation x := 3 Step 1: find invariant computations in loop y := 4 y := 5 invariant: computes same result each time evaluated z := x * y Step 2: move them outside loop

355 views • 4 slides

Motion Aftereffects Without Motion: Engaging the Human Motion Perception System With Still

Motion Aftereffects Without Motion: Engaging the Human Motion Perception System With Still Photographs Jonathan Winawer Stanford University None of these images contain motion Yet, some images have more motion than others 1 Were the two

579 views • 15 slides

Robust Face Recognition under Varying Illumination and Occlusion Considering Structured Sparsity

Robust Face Recognition under Varying Illumination and Occlusion Considering Structured Sparsity Xingjie Wei, Chang-Tsun Li and Yongjian Hu Department of Computer Science, University of Warwick x.wei@warwick.ac.uk http://warwick.ac.uk/xwei

1.08k views • 24 slides

Motion capture Captures the subtlety of human motion Keyframing difficult and not as

Motion capture Captures the subtlety of human motion Keyframing difficult and not as successful Cons: We can use only prerecorded material (with certain adaptations)-limiting Data valid only for same scale avatar-need for

772 views • 56 slides

Loop Invariant Code Motion Last Time Uses of SSA: reaching constants, dead-code elimination,

Loop Invariant Code Motion Last Time Uses of SSA: reaching constants, dead-code elimination, induction variable identification Today Finish up induction variable identification Loop invariant code motion Next Time Reuse

778 views • 10 slides

Define Illumination? Explain the laws of illumination? Illumination- The luminous flux falling per

Define Illumination? Explain the laws of illumination? Illumination- The luminous flux falling per unit area of a surface. Laws of Illumination: 1) Inverse square law- According to this law, the illumination of a surface is inversely

448 views • 32 slides

Structure from Motion Structure from Motion For now, static scene and moving camera

Structure from Motion Structure from Motion For now, static scene and moving camera Equivalently, rigidly moving scene and static camera Limiting case of stereo with many cameras Limiting case of multiview camera calibration with

839 views • 31 slides

Illumination with large data sets Updating the Lanscape of Human Engineering and Perceived

Real Time Global Illumination with large data sets Updating the Lanscape of Human Engineering and Perceived Quality Dennis Malone Human Engineering Nissan Technical Center - North America Opening Intro Nissan began a global initiative to

505 views • 22 slides

Motion and Human Motion and Human Actions Actions Ivan Laptev ivan.laptev@ens.fr Equipe projet

Object recognition and computer vision 2009/2010 Lecture 11 December 15 Lecture 11, December 15 Motion and Human Motion and Human Actions Actions Ivan Laptev ivan.laptev@ens.fr Equipe projet WILLOW ENS/INRIA/CNRS UMR 8548 Equipe-projet

536 views • 52 slides

Motion Capture Specialized Motion Capture N. Alberto Borghese Laboratory of Human Motion

Motion Capture Specialized Motion Capture N. Alberto Borghese Laboratory of Human Motion Analysis and Virtual Reality (MAVR) Department of Computer Science University of Milano Laboratory of Motion Analysis & Virtual Reality, MAVR

393 views • 25 slides

1 Scale invariant feature selection Affine transforms why? Harris-Laplace (HL) detector:

Why Local Features? Scale and Affine Invariant Interest Point Robust to noise, occlusion and clutter. Detectors Distinctive and repeatable. No explicit segmentation required represent Krystian Mikolajczyk and Cordelia Schm id

213 views • 6 slides

Human-Robot Interaction Elective in Artificial Intelligence Lecture 9 Motion control for HRI

Human-Robot Interaction Elective in Artificial Intelligence Lecture 9 Motion control for HRI Luca Iocchi DIAG, Sapienza University of Rome, Italy Outline Robot motion: main feature characterizing HRI from HCI Human-robot distance

437 views • 21 slides

Global illumination Anastasia Bolotnikova Global illumination a.k.a. GI a.k.a. indirect

Global illumination Anastasia Bolotnikova Global illumination a.k.a. GI a.k.a. indirect illumination What? - bunch of algorithms, a process of simulating indirect light Why? - add more realistic lighting to 3D scenes (direct+indirect) Some issues:

298 views • 19 slides

1 Reflection Equation Reflection Equation i i r r x x Sum over all light

Illumination Models Foundations of Computer Graphics So far considered mainly local illumination (Spring 2012) Light directly from light sources to surface CS 184, Lecture 22: Global Illumination Global Illumination: multiple bounces

232 views • 5 slides

Illumination Models Illumination Models So far considered mainly local illumination Computer

Illumination Models Illumination Models So far considered mainly local illumination Computer Graphics (Fall 2004) Computer Graphics (Fall 2004) Light directly from light sources to surface COMS 4160, Lecture 22: Global Illumination Global

379 views • 5 slides

Human Perception of Depth Lecture 5 Machine Depth Perception Multi-view / Stereo Motion

Human Perception of Depth Lecture 5 Machine Depth Perception Multi-view / Stereo Motion Humans? Stereo (binocular disparity) Motion (& motion perspective) What else? Occlusion Height in Visual Field Relative

118 views • 11 slides

Lightcuts: A Scalable Lightcuts: A Scalable Approach to Illumination Approach to Illumination

Lightcuts: A Scalable Lightcuts: A Scalable Approach to Illumination Approach to Illumination Bruce Walter, Sebastian Fernandez, Adam Arbree, Mike Donikian, Kavita Bala, Donald Greenberg Program of Computer Graphics, Cornell University

715 views • 70 slides

In theoretic Fgm ( X invariant k GW 1) us GW . = Ijf , M ) invariant refined ( M )

X.ge#ofQu4sche-s Virtual surfaced on . Introduction O . surface X Ici smooth CE Hak tf ( X ,Z ) , 2) projective e , . In theoretic Fgm ( X invariant k GW 1) us GW . = Ijf , M ) invariant refined ( M ) MTH ( v ) VW

537 views • 17 slides

Visual Motion Motion illusions Uses for motion cues Optic flow Motion blindness

Motion without movement illusion Visual Motion Motion illusions Uses for motion cues Optic flow Motion blindness Space-time receptive fields and the aperture problem and its solution Motion and cortical areas MT, MST

791 views • 10 slides

Motion Capture Sistemi a marker passivi N. Alberto Borghese Laboratory of Human Motion Analysis

Motion Capture Sistemi a marker passivi N. Alberto Borghese Laboratory of Human Motion Analysis and Virtual Reality (MAVR) Department of Computer Science University of Milano Laboratory of Motion Analysis & Virtual Reality, MAVR

708 views • 21 slides

Illumination and Reflectance Tues. Feb. 20, 2018 1 Illumination and Reflectance Shading

COMP 546 Lecture 12 Illumination and Reflectance Tues. Feb. 20, 2018 1 Illumination and Reflectance Shading Brightness versus Lightness Color constancy Shading on a sunny day L N(x) Lamberts (cosine)

769 views • 42 slides

Analysis of Multiview Legislative Networks with Structured Matrix Factorization: Does Twitter

Analysis of Multiview Legislative Networks with Structured Matrix Factorization: Does Twitter Influence Translate to the Real World? Shawn Mankad The University of Maryland Joint work with: George Michailidis 1 / 30 Motivation There is a

592 views • 30 slides

11.1 Global Illumination Hao Li http://cs420.hao-li.com 1 Global Illumination Lighting

Fall 2014 CSCI 420: Computer Graphics 11.1 Global Illumination Hao Li http://cs420.hao-li.com 1 Global Illumination Lighting based on the full scene Lighting based on physics (optics) Traditionally represented by two

590 views • 48 slides