towards an intuitive sign language animation authoring
play

Towards an Intuitive Sign Language Animation Authoring Environment - PowerPoint PPT Presentation

Jun 07, 2023 •472 likes •665 views

Towards an Intuitive Sign Language Animation Authoring Environment For the Deaf Alexis Heloir, Fabrizio Nunnari UVHC, LAMIH - Valenciennes, France DFKI-MMCI, SLSI group - Germany NLP: Parallel Corpora Aligned annotated videos Aligned Glosses

  1. Towards an Intuitive Sign Language Animation Authoring Environment For the Deaf Alexis Heloir, Fabrizio Nunnari UVHC, LAMIH - Valenciennes, France DFKI-MMCI, SLSI group - Germany

  2. NLP: Parallel Corpora Aligned annotated videos Aligned Glosses DictaSign Project (2009--2012) RWTH-Phoenix corpus (2010)

  3. NLP: Corpora Hand-crafting Motion capture CUNY SL Corpus (2012) ATLAS (2009-- 2011) SignCom System (2012)

  4. SL Corpora - Videos - Motion capture - Manual annotation - Hand-crafted animation

  5. Video + Easy to use and accessible + High fidelity - Low semantics

  6. Motion Capture + High fidelity + 3D plus numerical values - Still Low semantics - Cumbersome and expensive

  7. Hand-crafted animation + More intelligible animation + Theory independent motion abstraction - Expensive - Requires both expert interpreters and 3D animators

  8. Annotation + High semantic + Abstracted away - Requires expert annotators - Theory Dependent

  9. SL corpuses Abstraction Synthetic signs s n o i t (Sign Writing, HamNoSys) a t o n n A ??? Hand-crafted animation Motion Capture Videos Quantity of data

  10. SL corpuses Abstraction Synthetic signs s n o i t (Sign Writing, HamNoSys) a t o n n A Monitored handcrafted NEW! avatar animation Hand-crafted animation Motion Capture Videos Quantity of data

  11. Current SL production pipelines Mocap 3D operator operator Performance Sign animation mocap → Data Cleanup Capture Cleanup Hired Signary Performer / Interpreter Video hand-craft → Sign animation Capture 3D operator & Interpreter

  12. Production pipeline: to the user Mocap 3D operator operator Performance Sign animation mocap → Data Cleanup Capture Cleanup Signary Deaf user Video hand-craft → Sign animation Capture 3D operator & Interpreter

  13. Production pipeline: no complex 3D authoring Mocap 3D operator operator Performance Sign animation mocap → Data Cleanup Capture Cleanup Signary Deaf user hand-craft →

  14. Production pipeline: NUIs and no specialized operators Mocap 3D operator operator Performance Sign animation Data Cleanup Capture Cleanup Signary Deaf user NUI !!!

  15. Production pipeline: possibility to refine captured signs Performance Sign animation Data Cleanup Capture Cleanup Signary Deaf user

  16. New SL production pipelines Performance Data Cleanup Capture Signary Deaf user Manual Edit

  17. Production pipeline at work Video

  18. Future: Gathering users’ intention ● LIS relevant info ○ Contacts Manual Edit ○ Time alignments ○ Gesture amplification ○ ... Edit history Patterns extraction

Recommend

Sign Language Avatars Animation and Comprehensibility Michael Kipp* Alexis Heloir

Sign Language Avatars Animation and Comprehensibility Michael Kipp* Alexis Heloir

Sign Language Avatars Animation and Comprehensibility Michael Kipp* Alexis Heloir Quan Nguyen DFKI Embodied Agents Research Group Exzellenzcluster Multimodal Computing and Interaction Universitt des Saarlandes * University of

1.09k views • 32 slides
American Sign Language (ASL) Ms. Havens Class Sign Language Alphabet Numbers (0-10) Mother

American Sign Language (ASL) Ms. Havens Class Sign Language Alphabet Numbers (0-10) Mother

American Sign Language (ASL) Ms. Havens Class Sign Language Alphabet Numbers (0-10) Mother Father Sister Brother Day Sch chool ool Wo Word rds Learn Teacher Friend Quiet Monkey Animals Cat Duck Turkey Deer

481 views • 9 slides
ne o ed a language . c o m m n 2 FOR EXAMPLE: Sign symbols Imagine... You arrive at an

ne o ed a language . c o m m n 2 FOR EXAMPLE: Sign symbols Imagine... You arrive at an

A language is a standard form of communication . Humans speak many different languages . But, there are certain things we all need to understand and communicate . For t he se , we ne o ed a language . c o m m n 2 FOR EXAMPLE: Sign

958 views • 32 slides
Introduction to Computer Graphics Animation (1) May 23, 2019 Kenshi Takayama

Introduction to Computer Graphics Animation (1) May 23, 2019 Kenshi Takayama

Introduction to Computer Graphics Animation (1) May 23, 2019 Kenshi Takayama Skeleton-based animation Simple Intuitive Low comp. cost https://www.youtube.com/watch?v=DsoNab58QVA 2 Representing a pose using skeleton Tree

682 views • 40 slides
Introduction to Computer Graphics Animation (1) May 18, 2017 Kenshi Takayama

Introduction to Computer Graphics Animation (1) May 18, 2017 Kenshi Takayama

Introduction to Computer Graphics Animation (1) May 18, 2017 Kenshi Takayama Skeleton-based animation Simple Intuitive Low comp. cost https://www.youtube.com/watch?v=DsoNab58QVA 2 Representing a pose using skeleton Tree

895 views • 40 slides
A Lexical Comparison of Tajik Sign Language and Afghan Sign Language Justin Power The University

A Lexical Comparison of Tajik Sign Language and Afghan Sign Language Justin Power The University

A Lexical Comparison of Tajik Sign Language and Afghan Sign Language Justin Power The University of Texas at Austin First North American Conference in Iranian Linguistics 28 April 2017 Stony Brook University, New York, USA Introduction

497 views • 34 slides
Is there disruption in the sign language interpreting profession? Jemina Napier #WeAreLeverage

Is there disruption in the sign language interpreting profession? Jemina Napier #WeAreLeverage

Is there disruption in the sign language interpreting profession? Jemina Napier #WeAreLeverage Context Deaf sign language users 70 million deaf sign language users in the world (WFD) 138 sign languages listed on Ethnologue

237 views • 8 slides
Chapter 8 - Animation Animation before the time of 3DCG Animation techniques

Chapter 8 - Animation Animation before the time of 3DCG Animation techniques

Chapter 8 - Animation Animation before the time of 3DCG Animation techniques keyframing bone animation & motion capture simulation Animation principles LMU Mnchen Medieninformatik Heinrich Hussmann

812 views • 47 slides
Introduction to Computer Graphics Animation (1) July 2, 2020 Kenshi Takayama

Introduction to Computer Graphics Animation (1) July 2, 2020 Kenshi Takayama

Introduction to Computer Graphics Animation (1) July 2, 2020 Kenshi Takayama Skeleton-based animation Simple Intuitive Low comp. cost https://www.youtube.com/watch?v=DsoNab58QVA 2 Representing a pose using skeleton

536 views • 41 slides
Indian Sign Language Gesture Recognition Group 11 CS365 - Project Presentation Sanil

Indian Sign Language Gesture Recognition Group 11 CS365 - Project Presentation Sanil

Indian Sign Language Gesture Recognition Group 11 CS365 - Project Presentation Sanil Jain(12616) Kadi Vinay Sameer Raja(12332) Indian Sign Language History ISL uses both hands similar to British Sign Language and is similar to

479 views • 21 slides
Animation Presented by Sancho McCann Animation Is animation useful? Why?

Animation Presented by Sancho McCann Animation Is animation useful? Why?

Animation Presented by Sancho McCann Animation Is animation useful? Why? Principles of animation Principles applied Animation: can it facilitate? Does animation help the understanding of changes over time? A picture

4.12k views • 49 slides
Sign Language MT Sara Morrissey Overview Introduction Irish Sign Language Problems

Sign Language MT Sara Morrissey Overview Introduction Irish Sign Language Problems

Sign Language MT Sara Morrissey Overview Introduction Irish Sign Language Problems for SLMT SLMT Data MaTrEx for SLs Future work Introduction (1) Motivation Motivation SLs are poorly resourced and lack

308 views • 18 slides
1 Steps in Creating Animation Secondary Actions Sequences (1 of 3) Animation part that does

1 Steps in Creating Animation Secondary Actions Sequences (1 of 3) Animation part that does

Outline The Pipeline IMGD 1001: Concept Art 2D Art 2D Art (next) Animation Tiles Animation, Tiles 3D Art Modeling, Texturing, Lighting IMGD 1001 Animation Key Frames Animation produces the illusion of

80 views • 4 slides
Phrase Boundary Blinks in American Sign Language MON SKRATT HENRY MENTOR: DR. MARTHA TYRONE,

Phrase Boundary Blinks in American Sign Language MON SKRATT HENRY MENTOR: DR. MARTHA TYRONE,

Phrase Boundary Blinks in American Sign Language MON SKRATT HENRY MENTOR: DR. MARTHA TYRONE, LONG ISLAND UNIVERSITY- DOWNTOWN BROOKLYN & HASKINS LABORATORIES 1 Background American Sign Language (ASL) is a sign language used in the

218 views • 20 slides
Outline 1. Principles of Traditional Animation Applied to Computer Animation Animation

Outline 1. Principles of Traditional Animation Applied to Computer Animation Animation

Outline 1. Principles of Traditional Animation Applied to Computer Animation Animation (Lasseter, 1987) 2. Animation: Can it facilitate? (Tversky and Morrison, 2002) Presented By Timothy Chan 3. On Creating Animated Presentations (Zongker

541 views • 9 slides
Jianning Yue Wookyun Kho Young Jin Yoon AGL : Animation applet Generation Language Contents

Jianning Yue Wookyun Kho Young Jin Yoon AGL : Animation applet Generation Language Contents

Jianning Yue Wookyun Kho Young Jin Yoon AGL : Animation applet Generation Language Contents IPL? Advantages Syntax Development Examples Lessons Learned AGL : Animation applet Generation Language IPL? IPL is not

629 views • 26 slides
Animation Ats Kurvet What is animation? Where to use animation? How it works... Vision

Animation Ats Kurvet What is animation? Where to use animation? How it works... Vision

Animation Ats Kurvet What is animation? Where to use animation? How it works... Vision Animation ??? Profit! 12 principles of animation Disney's Twelve Basic Principles of Animation is a set of principles of animation

693 views • 35 slides
MIT Relational Database GraphiQL Expensive! Graph Intuitive Query Language for Relational

MIT Relational Database GraphiQL Expensive! Graph Intuitive Query Language for Relational

GraphiQL Graph Intuitive Query Language for Relational Databases at Talking on IEEE BigData 2014 Alekh Jindal collaborate Supervisors Amol Deshpande Sam Madden work sabbatical Mike Stonebraker work University work of Maryland

514 views • 40 slides
Animation Overview Overview Traditional Animation Traditional Animation Keyframe Animation

Animation Overview Overview Traditional Animation Traditional Animation Keyframe Animation

Animation Overview Overview Traditional Animation Traditional Animation Keyframe Animation Keyframe Animation Interpolating Rotation Interpolating Rotation 1999 Star Wars: Phantom Menace 2002 LOTR Two Towers 2001 Final Fantasy 1

513 views • 23 slides
Set 7: Events and Animation Animation and Events Animation attention, explanation

Set 7: Events and Animation Animation and Events Animation attention, explanation

IT452 Advanced Web and Internet Systems Set 7: Events and Animation Animation and Events Animation attention, explanation Capturing user events Education and games We will use jQuery to make coding easier 1 Preliminaries

451 views • 10 slides
Set 7: Events and Animation Animation and Events Animation attention, explanation

Set 7: Events and Animation Animation and Events Animation attention, explanation

IT452 Advanced Web and Internet Systems Set 7: Events and Animation Animation and Events Animation attention, explanation Capturing user events Example game: math functions swath of destruction Education and games We

458 views • 20 slides
Set 6: Events and Animation Animation and Events Animation attention, explanation

Set 6: Events and Animation Animation and Events Animation attention, explanation

IT452 Advanced Web and Internet Systems Fall 2009 Set 6: Events and Animation Animation and Events Animation attention, explanation Capturing user events Education and games We focus particularly on techniques with YUI 1

307 views • 8 slides
Court Sign Language Interpreting Standards Standards Introductions Introductions Emily Hill

Court Sign Language Interpreting Standards Standards Introductions Introductions Emily Hill

Court Sign Language Interpreting Standards Standards Introductions Introductions Emily Hill Sign Language Interpreter Emily Hill, Sign Language Interpreter Management (SLIM) Program Manager, Office of the Deaf and Hard of Hearing Office of

647 views • 35 slides
The Meaning of Pronouns: Insights from Sign Language Philippe Schlenker (Institut Jean-Nicod &

The Meaning of Pronouns: Insights from Sign Language Philippe Schlenker (Institut Jean-Nicod &

The Meaning of Pronouns: Insights from Sign Language Philippe Schlenker (Institut Jean-Nicod & NYU) The work on Weak Crossover is co-authored with Gaurav Mathur (Gallaudet University) Goals In two domains, sign language [here: ASL and

910 views • 72 slides

More recommend