Dance Movement Patterns Recognition (Part I) 1 Israel Sol Cerdn - PDF document

Dance Movement Patterns Recognition (Part I) 1� Israel Solà Cerdán EEMCS - HMI

Acknowledgments Acknowledgments • This project would not has been possible without the • This project would not has been possible without the collaboration of our project directors: collaboration of our project directors: – Anton Anton Nijholt Nijholt – – Dennis Dennis Reidsma Reidsma – – Jordi Carrabina Jordi Carrabina – • Thanks for the received aid of: • Thanks for the received aid of: – Herwin Herwin van van Welbergen Welbergen – – Ronald Ronald Poppe Poppe – • Thanks to our family, friends, girlfriends (MLG) and • Thanks to our family, friends, girlfriends (MLG) and partners. partners. EEMCS - HMI 2� / 40

Contents Contents • Introduction • Introduction – – Presentation Presentation – Goals – Goals – Organization of the Exposition – Organization of the Exposition • • The Virtual Dancer The Virtual Dancer • Parlevision • Parlevision • Work Environment • Work Environment – – Material Material – Setup – Setup • Previous Study • Previous Study – Interaction Dimensions – Interaction Dimensions – Interaction Tree – Interaction Tree – Interaction State Machine – Interaction State Machine – – Variables, Animations & Transitions Variables, Animations & Transitions – – Possible Improvements Possible Improvements • The Built System (CV) • The Built System (CV) – – New Added Features New Added Features – New Created Pipelines – New Created Pipelines – New Sent Variables – New Sent Variables EEMCS - HMI 3� / 40

Contents Contents • Introduction • Introduction – – Presentation Presentation – Goals – Goals – Organization of the Exposition – Organization of the Exposition • • The Virtual Dancer The Virtual Dancer • Parlevision • Parlevision • Work Environment • Work Environment – – Material Material – Setup – Setup • Previous Study • Previous Study – Interaction Dimensions – Interaction Dimensions – Interaction Tree – Interaction Tree – Interaction State Machine – Interaction State Machine – – Variables, Animations & Transitions Variables, Animations & Transitions – – Possible Improvements Possible Improvements • The Built System (CV) • The Built System (CV) – – New Added Features New Added Features – New Created Pipelines – New Created Pipelines – New Sent Variables – New Sent Variables EEMCS - HMI 4� / 40 / 39

Presentation Presentation • Joint project Joint project • • The Virtual Dancer The Virtual Dancer • • Obtaining a greater interaction Obtaining a greater interaction • • Recognizing dance movement patterns Recognizing dance movement patterns • EEMCS - HMI 5� / 40 / 39

Contents Contents • Introduction • Introduction – – Presentation Presentation – Goals – Goals – Organization of the Exposition – Organization of the Exposition • • The Virtual Dancer The Virtual Dancer • Parlevision • Parlevision • Work Environment • Work Environment – – Material Material – Setup – Setup • Previous Study • Previous Study – Interaction Dimensions – Interaction Dimensions – Interaction Tree – Interaction Tree – Interaction State Machine – Interaction State Machine – – Variables, Animations & Transitions Variables, Animations & Transitions – – Possible Improvements Possible Improvements • The Built System (CV) • The Built System (CV) – – New Added Features New Added Features – New Created Pipelines – New Created Pipelines – New Sent Variables – New Sent Variables EEMCS - HMI 6� / 40 / 39

Goals Goals 1. Starting up The Virtual Dancer application (computer vision part Starting up The Virtual Dancer application (computer vision part 1. and artificial intelligent part) and artificial intelligent part) 2. Analyzing the application and developing improvements 2. Analyzing the application and developing improvements strategies strategies 3. Recognition of simple dance movements Recognition of simple dance movements 3. 4. Recognition of dance movement patterns Recognition of dance movement patterns 4. 5. Automatic generation of dance movement search patterns Automatic generation of dance movement search patterns 5. 6. Finding patterns without a reference Finding patterns without a reference 6. EEMCS - HMI 7� / 40 / 39

Contents Contents • Introduction • Introduction – Presentation – Presentation – Goals – Goals – – Organization of the Exposition Organization of the Exposition • The Virtual Dancer • The Virtual Dancer • • Parlevision Parlevision • Work Environment • Work Environment – Material – Material – Setup – Setup • • Previous Study Previous Study – Interaction Dimensions – Interaction Dimensions – – Interaction Tree Interaction Tree – – Interaction State Machine Interaction State Machine – Variables, Animations & Transitions – Variables, Animations & Transitions – Possible Improvements – Possible Improvements • • The Built System (CV) The Built System (CV) – New Added Features – New Added Features – – New Created Pipelines New Created Pipelines – – New Sent Variables New Sent Variables EEMCS - HMI 8� / 40 / 39

Organization of the Exposition Organization of the Exposition • Virtual Dancer application • Virtual Dancer application • The computer vision system “ “ParleVision ParleVision” ” • The computer vision system • • The work The work environment with the environment with the setup application and the used material setup application and the used material • • The study carried out at the beginning of the project The study carried out at the beginning of the project • The implemented modifications in the computer vision system “ “ParleVision ParleVision” ” • The implemented modifications in the computer vision system • Dance Movement Patterns Recognition (Part II) • Dance Movement Patterns Recognition (Part II) – HMM – HMM – Recognizing Simple/Complex Movements – Recognizing Simple/Complex Movements – – Auto Generation of Complex Patterns Graphs Auto Generation of Complex Patterns Graphs – – Test Bench Test Bench – Conclusions – Conclusions EEMCS - HMI 9� / 40 / 39

Contents Contents • Introduction • Introduction – – Presentation Presentation – Goals – Goals – Organization of the Exposition – Organization of the Exposition • • The Virtual Dancer The Virtual Dancer • Parlevision • Parlevision • Work Environment • Work Environment – – Material Material – Setup – Setup • Previous Study • Previous Study – Interaction Dimensions – Interaction Dimensions – Interaction Tree – Interaction Tree – Interaction State Machine – Interaction State Machine – – Variables, Animations & Transitions Variables, Animations & Transitions – – Possible Improvements Possible Improvements • The Built System (CV) • The Built System (CV) – – New Added Features New Added Features – New Created Pipelines – New Created Pipelines – New Sent Variables – New Sent Variables EEMCS - HMI 10� / 40 / 39

/ 40 / 39 11� The Virtual Dancer The Virtual Dancer EEMCS - HMI

Contents Contents • Introduction • Introduction – – Presentation Presentation – Goals – Goals – Organization of the Exposition – Organization of the Exposition • • The Virtual Dancer The Virtual Dancer • Parlevision • Parlevision • Work Environment • Work Environment – – Material Material – Setup – Setup • Previous Study • Previous Study – Interaction Dimensions – Interaction Dimensions – Interaction Tree – Interaction Tree – Interaction State Machine – Interaction State Machine – – Variables, Animations & Transitions Variables, Animations & Transitions – – Possible Improvements Possible Improvements • The Built System (CV) • The Built System (CV) – – New Added Features New Added Features – New Created Pipelines – New Created Pipelines – New Sent Variables – New Sent Variables EEMCS - HMI 12� / 40 / 39

/ 40 / 39 13� Parlevision Parlevision EEMCS - HMI