real time performance based facial animation
play

Real-time Performance-Based Facial Animation Mark Pauly - PowerPoint PPT Presentation

Nov 26, 2022 •337 likes •542 views

Real-time Performance-Based Facial Animation Mark Pauly Eurographics 2012, Cagliari, Italy Introduction 2 Eurographics 2012, Cagliari, Italy Overview Facial Tracking using Blendshape Model rigid transformation + blendshape weights per

  1. Real-time Performance-Based Facial Animation Mark Pauly

  2. Eurographics 2012, Cagliari, Italy Introduction 2

  3. Eurographics 2012, Cagliari, Italy Overview Facial Tracking using Blendshape Model • rigid transformation + blendshape weights per frame Personalized Blendshape Model • static face capture • example based facial rigging Tracking • rigid & nonrigid registration • animation prior 3

  4. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy Animation Pipeline

  5. Eurographics 2012, Cagliari, Italy Facial Expression Model Static Face Capture [Weise et al, 2009] 5

  6. Eurographics 2012, Cagliari, Italy Facial Expression Model Face Fitting [Li et al, 2009] 6

  7. Eurographics 2012, Cagliari, Italy Facial Expression Model Texture Reconstruction Poisson Image Editing [Pérez et al, 2003] 7

  8. Eurographics 2012, Cagliari, Italy Facial Expression Model Example-based Facial Rigging generic template personalized expression model [Li et al, 2010] 8

  9. Eurographics 2012, Cagliari, Italy Rigid Tracking 9

  10. Eurographics 2012, Cagliari, Italy Non-rigid Tracking Estimate blendshape weights • similar to scans & color image • plausible animation MAP estimation • non-rigid registration based on geometry & texture • animation prior from existing animation sequences 10

  11. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy N-Dim Expression Space

  12. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy N-Dim Expression Space

  13. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy N-Dim Expression Space

  14. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy Animation Manifold

  15. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy Probabilistic Expression Prior

  16. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy Probabilistic Animation Prior

  17. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy Temporal Joint Probabilistic Distribution

  18. Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy MAP Estimation

  19. Eurographics 2012, Cagliari, Italy Demo www.faceshift.com

Recommend

Performance-Driven Facial Animation Performance-based Facial Animation Creating an animation

Performance-Driven Facial Animation Performance-based Facial Animation Creating an animation

Performance-Driven Facial Animation Performance-based Facial Animation Creating an animation of a realistic and expressive human face is one of greatest challenges in computer graphics. The human face is an extremely complex

492 views • 28 slides
Real-Time Performance of Linux Among others: A Measurement-Based Analysis of the Real-Time

Real-Time Performance of Linux Among others: A Measurement-Based Analysis of the Real-Time

CPSC-663: Real-Time Systems Linux, Preemption, and Real-Time Real-Time Performance of Linux Among others: A Measurement-Based Analysis of the Real-Time Performance of Linux (L. Abeni , A. Goel, C. Krasic, J. Snow, J. Walpole) [RTAS

472 views • 9 slides
Real-time Animation and Real-time Animation and Rendering of Ocean Whitecaps Rendering of Ocean

Real-time Animation and Real-time Animation and Rendering of Ocean Whitecaps Rendering of Ocean

Real-time Animation and Real-time Animation and Rendering of Ocean Whitecaps Rendering of Ocean Whitecaps Jonathan Dupuy, Eric Bruneton INRIA Grenoble Rhne-Alpes, Universit de Grenoble et CNRS, Laboratoire Jean Kuntzmann Universit de

558 views • 26 slides
Real-time 3D Eyelids Tracking From Semantic Edges Quan Wen, Feng Xu, Ming Lu, Jun-Hai Yong

Real-time 3D Eyelids Tracking From Semantic Edges Quan Wen, Feng Xu, Ming Lu, Jun-Hai Yong

Real-time 3D Eyelids Tracking From Semantic Edges Quan Wen, Feng Xu, Ming Lu, Jun-Hai Yong Tsinghua University Background Facial capture and animation is crucial in many applications Face capture in computer games Face animation in movies

944 views • 79 slides
Real-time Facial Animation Hao Li Mark Pauly ILM EPFL High-End 3D Scanning High-End 3D

Real-time Facial Animation Hao Li Mark Pauly ILM EPFL High-End 3D Scanning High-End 3D

Real-time Facial Animation Hao Li Mark Pauly ILM EPFL High-End 3D Scanning High-End 3D Scanning Low-Cost Passive Scanning (AGI soft) stereo pair Low-Cost Passive Scanning (AGI soft) stereo pair 3D scan Low-Cost Active Scanning +

1.67k views • 150 slides
Data-Driven Animation Full-body animation Skin deformation Facial animation Motion

Data-Driven Animation Full-body animation Skin deformation Facial animation Motion

Data-Driven Animation Full-body animation Skin deformation Facial animation Motion Representation A pose is represented by root translation, root orientation, and joint angles q = ( q 1 , , q n ) Motion consists of a

368 views • 24 slides
FMP Pitch Introduction The path I am keen to work with is an action animation and facial

FMP Pitch Introduction The path I am keen to work with is an action animation and facial

Joe Agilada M00486462 FMP Pitch Introduction The path I am keen to work with is an action animation and facial expression animation such as lip syncing. But for my fjnal major project I want to create a VR narrative animation where character

423 views • 13 slides
Facial Expressions & Rigging CSE169: Computer Animation Instructor: Steve Rotenberg UCSD,

Facial Expressions & Rigging CSE169: Computer Animation Instructor: Steve Rotenberg UCSD,

Facial Expressions & Rigging CSE169: Computer Animation Instructor: Steve Rotenberg UCSD, Spring 2016 Facial Muscles Universal Expression Groups Sadness Anger Happiness Fear Disgust Surprise FACS Facial Action

1.03k views • 59 slides
Facial Expressions & Rigging CSE169: Computer Animation Instructor: Steve Rotenberg UCSD,

Facial Expressions & Rigging CSE169: Computer Animation Instructor: Steve Rotenberg UCSD,

Facial Expressions & Rigging CSE169: Computer Animation Instructor: Steve Rotenberg UCSD, Winter 2020 Facial Muscles Universal Expression Groups Sadness Anger Happiness Fear Disgust Surprise FACS Facial

1.09k views • 51 slides
Chapter 8 - Animation Animation before the time of 3DCG Animation techniques

Chapter 8 - Animation Animation before the time of 3DCG Animation techniques

Chapter 8 - Animation Animation before the time of 3DCG Animation techniques keyframing bone animation & motion capture simulation Animation principles LMU Mnchen Medieninformatik Heinrich Hussmann

812 views • 47 slides
Overcoming the Top Four Challenges to Real-Time Performance in Large-Scale, Data-Centric

Overcoming the Top Four Challenges to Real-Time Performance in Large-Scale, Data-Centric

Overcoming the Top Four Challenges to Real-Time Performance in Large-Scale, Data-Centric Applications Tom Lubinski Founder and CEO SL Corporation 17 November 2011 Disclaimers I am not Mike Lee No Mariachi hat No Facial hair

599 views • 42 slides
Real Time Facial Expression Recognition using Eigen Faces - By Aadesh M Bagmar (U12 CO 092)

Real Time Facial Expression Recognition using Eigen Faces - By Aadesh M Bagmar (U12 CO 092)

Summer Intern Project on Real Time Facial Expression Recognition using Eigen Faces - By Aadesh M Bagmar (U12 CO 092) Project Guide: Dr. M.A.Zaveri Computer Engineering Department Brief The project aims at developing a robust system for real

206 views • 18 slides
WE MAKE DIGITAL HUMANS CONTENTS SCANNING 3D EXTRAS - FACIAL SCANNING - HAIR + CLOTH -

WE MAKE DIGITAL HUMANS CONTENTS SCANNING 3D EXTRAS - FACIAL SCANNING - HAIR + CLOTH -

WE MAKE DIGITAL HUMANS CONTENTS SCANNING 3D EXTRAS - FACIAL SCANNING - HAIR + CLOTH - BODY SCANNING - REAL-TIME INTEGRATION MODELLING/TEXTURING - LIGHTING + RENDERING - CAMERA ANIMATION - MODELLING - HEAD TRACKING -

728 views • 42 slides
animation 1 animation shape specification as a function of time 2 animation representation

animation 1 animation shape specification as a function of time 2 animation representation

animation 1 animation shape specification as a function of time 2 animation representation many ways to represent changes with time intent artistic motion physically-plausible motion efficiency typically not a major problem control most

756 views • 74 slides
Animation structure and content of the internal of changes over time? representation. Why?

Animation structure and content of the internal of changes over time? representation. Why?

Animation Animation: can it facilitate? Congruence Principle A useful graphic is congruent to the Does animation help the understanding Is animation useful? Animation structure and content of the internal of changes over time?

423 views • 4 slides
Realistic Modeling for Realistic Modeling for Facial Animation Facial Animation Yuencheng Lee,

Realistic Modeling for Realistic Modeling for Facial Animation Facial Animation Yuencheng Lee,

Realistic Modeling for Realistic Modeling for Facial Animation Facial Animation Yuencheng Lee, Lee, Demetri Demetri Yuencheng Terzopoulos, and Keith Waters. , and Keith Waters. Terzopoulos Overview Overview Desire Desire A

349 views • 13 slides
Network Layout Ma Maneesh Agrawala CS 448B: Visualization Fall 2020 1 Last Time: Animation 2

Network Layout Ma Maneesh Agrawala CS 448B: Visualization Fall 2020 1 Last Time: Animation 2

Network Layout Ma Maneesh Agrawala CS 448B: Visualization Fall 2020 1 Last Time: Animation 2 1 Implementing Animation 3 Animation Approaches Frame-based Animation Redraw scene at regular interval (e.g., 16ms) Developer defines the

837 views • 66 slides
Week 5 : b. Animation Anastasia.Bezerianos@lri.fr (part of this class is based on previous

Week 5 : b. Animation Anastasia.Bezerianos@lri.fr (part of this class is based on previous

Week 5 : b. Animation Anastasia.Bezerianos@lri.fr (part of this class is based on previous classes from J.Garcia) 1 ABezerianos - IntroProgIS - week5b-Animation - 6 October 2020 Animation Used to draw images/objects that vary over time

629 views • 16 slides
Annotated Facial Landmarks in the Wild A Large-scale, Real-world Database for Facial Landmark

Annotated Facial Landmarks in the Wild A Large-scale, Real-world Database for Facial Landmark

Institute for Computer Graphics and Vision, Graz University of Technology, Austria Annotated Facial Landmarks in the Wild A Large-scale, Real-world Database for Facial Landmark Localization Martin Kstinger, Paul Wohlhart, Peter M. Roth,

310 views • 14 slides
Final Demos on Thursday! 1. Robotic Arm Controller for Diagnostics 2. PiCar 3. Facial

Final Demos on Thursday! 1. Robotic Arm Controller for Diagnostics 2. PiCar 3. Facial

Final Demos on Thursday! 1. Robotic Arm Controller for Diagnostics 2. PiCar 3. Facial Recognition Based Attendance 4. Interactive Sign Language Training System 5. WashU Course Buddy IoT 6. Smart Soft Real-Time Security Camera 7.

932 views • 57 slides
Animation Presented by Sancho McCann Animation Is animation useful? Why?

Animation Presented by Sancho McCann Animation Is animation useful? Why?

Animation Presented by Sancho McCann Animation Is animation useful? Why? Principles of animation Principles applied Animation: can it facilitate? Does animation help the understanding of changes over time? A picture

4.12k views • 49 slides
Performance Estimation using Deep Learning Based Facial Expression Analysis Cho Woo Jo, Young Ho

Performance Estimation using Deep Learning Based Facial Expression Analysis Cho Woo Jo, Young Ho

Transactions of the Korean Nuclear Society Virtual Spring Meeting July 9-10, 2020 Performance Estimation using Deep Learning Based Facial Expression Analysis Cho Woo Jo, Young Ho Chae, and Poong Hyun Seong * Dept. Nuclear & Quantum Eng, Korea

161 views • 3 slides
GPU-Based Simulation of Spiking Neural Networks with Real-Time Performance & High Accuracy

GPU-Based Simulation of Spiking Neural Networks with Real-Time Performance & High Accuracy

GPU-Based Simulation of Spiking Neural Networks with Real-Time Performance & High Accuracy Dmitri Yudanov, Muhammad Shaaban, Roy Melton, Leon Reznik Department of Computer Engineering Rochester Institute of Technology United States WCCI

522 views • 26 slides
Based on: 1 Facial expression recognition based on Local Binary Patterns: A comprehensive study

Based on: 1 Facial expression recognition based on Local Binary Patterns: A comprehensive study

Based on: 1 Facial expression recognition based on Local Binary Patterns: A comprehensive study Caifeng Shan, Shaogang Gong, Peter W. McOwan Image and Vision Computing 27 (2009) 803816 Facial expression 2 Facial expression is one of

921 views • 42 slides

More recommend