midilens
play

MidiLens An Augmented Reality Piano Learning System using HoloLens - PowerPoint PPT Presentation

Feb 14, 2023 •15 likes •175 views

MidiLens An Augmented Reality Piano Learning System using HoloLens Course: Interaction Engineering (WS_17/18) Ruben Schlagowski 954174 Course Instructor: Prof. Dr. Michael Kipp Martin Stadlmaier 954084 Submission: 02. February 2018 2

  1. MidiLens An Augmented Reality Piano Learning System using HoloLens Course: Interaction Engineering (WS_17/18) Ruben Schlagowski 954174 Course Instructor: Prof. Dr. Michael Kipp Martin Stadlmaier 954084 Submission: 02. February 2018

  2. 2

  3. [Motivation] ● Simplify musical training ● Make it more effective and fun ● Motivate more people to start playing music 3

  4. [Idea] Using Augmented Reality on a Head Mounted Display (HMD) for music learning on a Piano ! 4

  5. [Related Work] 5

  6. 6

  7. [Interaction Techniques] ● Song Selection: Mouse, Keyboard (PC) ● Musical Input: Classical Keyboard (Master-Keyboard) ● HMD Application Control: Speech, Gaze & Gesture (HoloLens) ● Visual Output: Augmented Reality on OST- Displays (HoloLens) ● Auditory Output: Speakers (PC) 7

  8. [Technical Realisation] (Unity/C#) (Windows Forms, C#) 8

  9. Learning Mode A Learning Mode B 9

  10. [User Tests] 10

  11. [Test Sequence] Song Playthroughs Song: 1 Song: 1 Introduction Mode: A Mode: B Song: 2 Song: 2 Interview Mode: A Mode: B 11

  12. [Results] A B Prefered Mode ? 55,6% Yes Potential for 44,4% excessive use? No 22,2% Maybe 33,3% 12

  13. [Live Demo] 13

  14. [Conclusion] ● Generally positive feedback (fun factor!) ● Prefered Learning Mode: A ● Positive effect on skill development questionable ● tracking precision must improve 14

  15. [Future Work] ● Gamification via Score and rising difficulty ● Improve Reliability with Midi over TCP/IP ● More user studies regarding timing/precision ● Add finger positioning 15

  16. Thanks for your attention! 16

Recommend

More recommend