tim
play

TIM Tangible Interaction Menu for AR Environments THE PROBLEM In - PowerPoint PPT Presentation

Jan 28, 2023 •619 likes •833 views

Sophie Erbsner and Julian Peter Augsburg University of Applied Sciences Interaction Engineering | WS 2017/18 TIM Tangible Interaction Menu for AR Environments THE PROBLEM In everyday life Covering display and objects with hands and fjngers

  1. Sophie Erbsner and Julian Peter Augsburg University of Applied Sciences Interaction Engineering | WS 2017/18 TIM Tangible Interaction Menu for AR Environments

  2. THE PROBLEM In everyday life Covering display and objects with hands and fjngers Fatigue due to touch gestures TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 2

  3. RELATED WORK “CAMERA-BASED INTERACTIONS FOR AUGMENTED REALITY” By: Tatu Harviainen, Otto Korkalo, Charles Woodward (VTT Technical Research Centre of Finland) Easy-to-use, marker-based tracking, Interacting with AR content by gesturing with camera on mobile device TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 3

  4. CORE IDEA AR connection to reality Augmented Reality as mix of reality and virtuality A tangible object (reality) manipulates AR content (virtuality) TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 4

  5. PAPER PROTOTYPE One tool for one hand Evolutionary process: From a cube to an octahedron Using the object in a single hand: Holding between thump + index fjnger, Rotating with another fjnger. TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 5

  6. THE INTERACTIONS Menu Items In total: 8 menu items for each side Implemented: 6 menu items Rotate Scale Move Colour • • • • TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 6

  7. THE INTERACTIONS Menu Items Colour • • • • Move Rotate Scale TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 7

  8. SHAPES AND GRAPHICS Design and functionality Creating functional trackers: From a simple icon to a marker with more trackable points TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 8

  9. TECHNICAL IMPLEMENTATION Coding Touch: LeanTouch, Vuforia Plugin for Unity 3D Rotate, pinch and drag gestures TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 9

  10. Live Demo First Prototype TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 10

  11. TECHNICAL IMPLEMENTATION Coding TIM: Unity und Vuforia Hold virtual buttons to start interaction TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 11

  12. Live Demo Second Prototype TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 12

  13. USER TEST Two scenarios User Test: Participants passed 8 functional tasks with different numbers of interaction Questionnaire: Which method is faster, more precise, easier to use and more enjoyable? TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 13

  14. USER TEST Comparison Speed in Sec. 0.4 MEAN SPEED related to NUMBER OF INTERACTIONS Problems with TIM: tracking markers 0 Rotate Move Scale Mean value (1. Bar) compared with fastest value (2. Bar) TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 14

  15. QUESTIONNAIRE Proof of concept Precision Speed Confjdence No Problems No fatigue 2 2 Scale: –2 | -1 | 0 | +1 | +2 1 1 From STRONGLY DISAGREE to STRONGLY AGREE 0 0 Touch -1 -1 Tangible Interaction Menu -2 -2 Precision Speed Confjdence No Problems No fatigue TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 15

  16. QUESTIONNAIRE Proof of concept Important questions for further research: Would people use it? 1.75 More fun with TIM than with Touch: 1.375 TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 16

  17. RECOGNITION Lessons learned People had fun with the TIM System, Field of Depth, instabil Vuforia AR Camera but the tests need a lot of time Virtual Buttons due to some technical diffjculties: Implementing menu items: More intuitive interaction for Rotate TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 17

  18. CONCLUSION Future work Improvings of TIM: Interacting as Proxy Using HoloLens TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 18

  19. CONCLUSION Further Usage Designing and planning landscapes (for cities) Interaction with more than 2 people Solution for Problem: Faster and easier than building miniatures TIM – Tangible Interaction Menu | Students: Sophie Erbsner, Julian Peter IMS | Interaction Engineering | WS 2017 / 18 | 19

  20. THANK YOU for your attention!

Recommend

More recommend