Mobile Technologies context and task theory interaction techniques - PowerPoint PPT Presentation

Mobile Technologies context and task theory interaction techniques in/output technologies 1 LMU München — Medieninformatik — Julie Wagner, Andreas Butz — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Mobile Repetition context and task • Precision input techniques theory – Offset Cursor / Shift interaction – Tap Tap / MagStick techniques – back-of device small screens touch precision • Enlarge input vocabulary extend input – MicroRolls vocabulary – BezelSwipe menu techniques • Forgot last week (after XPaand): occlusion – Bend gestures multi-device in/output 2 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

PaperPhone: Bend Gestures in Mobile Devices with Flexible E-Paper Display Use device as watch … … detach, use as PDA Lahey, ¡Girouard, ¡Burleson, ¡Vertegaal. ¡PaperPhone: ¡Understanding ¡the ¡Use ¡of ¡Bend ¡Gestures ¡in ¡ Mobile ¡Devices ¡with ¡Flexible ¡Electronic ¡Paper ¡Display. ¡CHI ¡2011. 3 LMU München — Medieninformatik — Julie Wagner, Andreas Butz — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

PaperPhone: Bend Gestures in Mobile Devices with Flexible E-Paper Display Lahey, ¡Girouard, ¡Burleson, ¡Vertegaal. ¡PaperPhone: ¡Understanding ¡the ¡Use ¡of ¡Bend ¡Gestures ¡in ¡ Mobile ¡Devices ¡with ¡Flexible ¡Electronic ¡Paper ¡Display. ¡CHI ¡2011. 4 LMU München — Medieninformatik — Julie Wagner, Andreas Butz — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Mobile Extending Input Vocabulary context and task theory • ...by using the space around the body and the screen interaction techniques small screens – BodySpace – Virtual Shelf touch precision – Around-Body Interaction extend input vocabulary – SideSight – Air+Touch menu techniques occlusion multi-device in/output Literature: Cao, x. et al.: 5 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Mobile BodySpace context and task • uses inertial sensing and basic pattern theory recognition to allow gestural control interaction • control by placing the device at different techniques body parts small screens – magnetometer – accelerometer touch precision – gyroscope extend input vocabulary menu techniques occlusion multi-device � � � � � � � in/output Literature: Strachan, S. et al.: BodySpace: Inferring body pose for natural control of a music player , CHI’07 6 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide � �

Mobile Virtual Shelf context and task • access programmable shortcuts on mobile theory phone by pointing to a body-relative location around the body interaction techniques – especially interesting for visual impaired users small screens • shortcuts are arranged in an imaginary sphere. touch precision extend input vocabulary menu techniques occlusion multi-device in/output 7 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Mobile Around-body interaction context and task • phone’s 3D location tracking: front camera, theory accelerometer and inertia measurement units interaction techniques small screens touch precision extend input • three level of around body interaction: vocabulary – canvas: expand interaction area beyond the menu screen boundaries (e.g. place UI element in techniques space, which is larger than screen) – modal: switch between different applications or occlusion modes within a given application. multi-device – context: device’s spatial relationship to the user in/output Literature: Chen, x. et al.: Around-Body Interaction: Sensing & Interaction Techniques for proprioception-enhanced input with mobile devices, MobileHCI’14 8 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Side-of-Device Interaction: SideSight • Useful if device is placed on table • Distance sensors along device edges – Multipoint interactions • IR proximity sensors – Edge: 10x1 pixel “depth” image Left and right “depth” images Butler, Izadi, Hodges. SideSight: Multi-“touch” Interaction Around Small Devices. UIST’08. 9 LMU München — Medieninformatik — Julie Wagner, Andreas Butz — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Side-of-Device Interaction: SideSight Butler, Izadi, Hodges. SideSight: Multi-“touch” Interaction Around Small Devices. UIST’08. 10 LMU München — Medieninformatik — Julie Wagner, Andreas Butz — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Mobile Air + Touch context and task theory interaction techniques small screens touch precision extend input vocabulary menu techniques occlusion multi-device in/output Literature: Chen, x. et al.: Air+Touch: Interweaving Touch & In-Air Gestures, UIST’14 11 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Mobile Menu Techniques context and task theory • FastTap • BezelTap interaction techniques • Augmented Letters small screens • Two-handed Marking Menus touch precision extend input vocabulary menu techniques occlusion multi-device in/output Literature: Cao, x. et al.: 12 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

FastTap: Command selection on Mobile tablets context and task • rapid command execution theory technique interaction techniques • modal access to a grid of command buttons (quasimode) small screens • selection mechanism identical touch precision for novices and experts extend input • takes advantage of spatial vocabulary memory to teach command menu shortcuts. techniques occlusion multi-device in/output Literature: Gutwin, C. et al.: Faster Command Selection on Tablets with FastTap, CHI’14 13 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide

Mobile Bezel Tap context and task • usually: wake up tablet + unlock + navigate theory to command interaction • immediate interaction on handheld tablets techniques – bezel tap + screen contact 64 commands: 12 menus, 4 shortcuts small screens touch precision extend input vocabulary menu techniques occlusion multi-device in/output Literature: Serrano, M. Bezel-Tap Gestures: Quick Activation of Commands from Sleep Mode on Tablets, CHI’13 14 LMU München — Medieninformatik — Andreas Butz, Julie Wagner — � Mensch-Maschine-Interaktion II — WS2014/15 Slide