Renegade Computing Guiding and Enticing Users in an Off-the-Desktop - PowerPoint PPT Presentation

Renegade Computing Guiding and Enticing Users in an Off-the-Desktop World Edward Lank Cheriton School of Computer Science

Research Overview • Using computational intelligence to enhance interaction

Renegade Computing • 2007 Photo: Nintendo.com Nintendo DS

Renegade Computing Credit: http://grahamten.files.wordpress.com/2009/07/text.jpg

Renegade Computing • Pervasive and Ubiquitous computing domains multitaction.com

Outline • Pervasive Computing – Motion gestures • Ubiquitous Computing – Powerwall interaction • Waterloo – Co-op, research partnerships, open ip, and more

Motion Gestures • A gesture performed by physically translating or/and rotating the device.

Motion Gestures • Expands input space

Motion Gestures • Expands input space • Allows quick access to commands

Motion Gestures • Expands input space • Allows quick access to commands • Touchscreen not always available

Motion Gestures • Expands input space • Allows quick access to commands • Touchscreen not always available • … or usable http://www.flickr.com/photos/worldismyoyster/4068609454/

Designing Motion Gestures • Say you wanted to design a motion gesture to answer an incoming phone call. What motion gesture would you use?

Is there agreement? Flick Shake Circular Place phone to ear 16

Is there agreement? Act on a selection • Checkmark 17 Unique Gestures • Shake • Flick Did not have an agreement for • Rotate Screen – Act on selection – Switch to next application – Switch to previous application 20

Agreement?

Motion Gesture Taxonomy • Two classes of taxonomy dimensions – Gesture Mapping • Nature – physical mapping to objects • Context – requires a specific context • Temporal – occurs during or after a gesture is performed – Physical Characteristics • Kinematic Impulse - range of jerk • Dimension - number of axes involved in the movement • Complexity – simple or compound gesture 22

Gestures tend to be simple discrete gestures involving a single axis with low kinematic impulse 23

Consider Gestures tend to be simple discrete gestures involving a single axis with low kinematic impulse +

Motion Gestures vs Noise Sensor Input Space Person Person Flick Flick Right Left Running Running

Bi-Level Thresholding Observation: On false negative, user repeats gesture Safety Net • Observing two possible gestures = observing one highly probable gesture • One tightly thresholded initial model • One loosely thresholded double model

Bi-level Thresholding Recognition Fire Action Everyday Reset Motion Tight Threshold Tight or Loose Passive Threshold Loose State Threshold Primed Timeout Everyday State Motion

Evaluation • 2/3 of gestures recognized in the Bi-level case were detected by the double low model

Current Question How can we guide users, i.e. allow them to gradually improve, as we build interfaces that are increasingly clever?

Renegade Computing • Pervasive and Ubiquitous computing domains multitaction.com

Powerwall Research

Large Display Research telegraphjournal.com

Powerwall Research

In Progress Installation

Observational Studies

Laboratory Studies

Observations

Renegade Computing Credit: http://grahamten.files.wordpress.com/2009/07/text.jpg

A Few Words About Waterloo • Co-operative education • MITACS internships • Collaborative research programs – Networks of Centres of Excellence – Ontario Research Fund – Research Excellence – NSERC Collaborative Research and Development Grants

What about IP? • Policy 73: “UW’s intellectual property policy at its highest level of interpretation grants ownership of any intellectual property (IP) to the creators of the IP. UW embraces the philosophy that providing incentive through IP ownership is the best motivator to ensure that commercialization of research occurs for broad societal and economic benefit.”

Renegade Computing redmondpie wikipedia youtube

Renegade Computing: Guiding and Enticing Users in an Off-the-Desktop World Questions? Email: lank@uwaterloo.ca Ministry of Innovation