Situated Interaction (InSitu) � Head: Wendy Mackay � � 27-28 Nov. 2013 � Comité d'évaluation du LRI � 1 � �
InSitu Group members ! Permanent faculty ! ! Caroline Appert, CR1 CNRS ! Michel Beaudouin-Lafon, PRCE P-11 ! ! Anastasia Bezerianos, MC P-11 ! Olivier Chapuis, CR1 CNRS ! ! Cédric Fleury, MC P-11 ! Stéphane Huot, MC P-11 ! ! Wendy Mackay, DR1 INRIA ! Theophanis Tsandilas, CR1 INRIA ! Ph.D. students ! ! David Bonnet ! Jérémie Garcia ! ! Ghita Jalal ! Alexandre Kouyoumdjian ! ! Can Liu ! Justin Mathew ! ! Cyprien Pindat ! Daniel Strazzula !! ! Oleksandr Zinenko ! Post-docs ! ! Lora Oehlberg ! Halla Olafsdottir ! Engineers ! ! Gabriel Tezier ! Monireh Sanaei ! ! Jonathan Thorpe ! Amani Kooli ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 2 !
Computers are everywhere ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 3 !
Computer capacity is increasing… ! Capacity ! Computer ! Time ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 4 !
Computer capacity is increasing… ! but human cognitive and sensorimotor skills are not. ! Capacity ! Human ! Computer ! Time ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 5 !
Artificial Intelligence ! Creating Smart Computers 2001 A Space Odyssey 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 6 !
Human-Computer Interaction � Augmenting Human Capabilities Iron Man 27-28 Nov. 2013 � Comité d'évaluation du LRI � 7 �
Three interaction paradigms � Computer as tool � Human- � First person interfaces � Computer � Interaction � Empower users � � Computer as servant � Artificial � Second person Intelligence � interfaces � Delegate tasks � � Computer as medium � Social media � Multimedia � Third person interfaces � Communicate � � 27-28 Nov. 2013 � Comité d'évaluation du LRI � 8 �
Trade-off ! How can we keep simple things simple … ! but enable complex tasks? ! Power ! Simplicity ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 9 !
Research Challenge ! How can we move the curve? ! Power ! Simplicity ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 10 !
Scientific Themes & Objectives ! InSitu emphasizes situated interaction ! ! We develop theory, methods and technology that ! ! • generate new forms of interaction, ! ! • significantly empower users, and ! ! • inspire the next generation of interactive systems. ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 11 !
Positioning ! France ! ! Closest groups: Grenoble, Toulouse, Lille ! Europe ! ! UK Labs (Lancaster, RCA, Glasgow) ! ! Scandinavian labs (KTH, Aarhus) ! ! German labs (Aachen, Hasso Platner) ! North American Universities ! ! Stanford, MIT, Carnegie Mellon, ! ! U. Toronto, UCSD, Georgia Tech ! ! Corporate labs ! ! Microsoft (Redmond & Cambridge), Google ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 12 !
InSitu Research Themes ! Interaction and visualization paradigms ! ! Manage the trade-off between power and simplicity ! Mediated communication ! ! Establish peripheral and focused awareness at a distance ! Research methods ! ! Engage users throughout the design process ! Engineering of interactive systems ! ! Create tools and platforms for advancing the state of the art ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 13 !
HCI Research Process ! get an idea ! develop theory ! operationalize ! build system ! participatory design to ! Fitts’ law, human ! develop working ! avoid toy problems ! perception ! prototypes ! extract key features ! frame paper ! analyze results ! run experiment ! design experiment ! controlled lab studies, ! longitudinal field studies ! no standard benchmarks ! key insights to generalize ! quantitative and qualitative ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 14 !
Research Process ! new ! new ! Theory ! model ! model ! model ! new ! Real world ! observation ! evaluation ! evaluation ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 15 !
Research Process ! new ! new ! Theory ! model ! model ! model ! Artifact ! prototype ! prototype ! system ! new ! Real world ! observation ! evaluation ! evaluation ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 16 !
Research Contributions ! Fundamental research ! ! investigate details of human behavior ! Invention ! ! design & benchmark novel interaction techniques ! Real-world exploration ! ! participatory design with users in real-world settings ! Innovation ! ! transfer our technology ! ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 17 !
Interaction and visualization paradigms ! Interaction on the desktop: Manage the trade-off between power and simplicity ! DynaSpot ! JellyLens ! Octopocus ! Dwell-and-Spring ! Combine area and Adapt dynamically Learn complex Add undo to ! point cursor to to object’s shape for ! gestures with a direct manipulation, ! improve performance ! better focus+context ! dynamic guide ! e.g., drag ‘n drop ! ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 18 !
Example: JellyLenses ! Contribution: Invention ! Take advantage of an underlying representation ! to improve the trade-off between focus and context ! ! JellyLenses ! • adapt dynamically ! to the object’s shape ! • optimize placement of ! focus, context & transition ! regions ! • consistently outperform ! fisheye lenses ! ! ! ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 19 !
Interaction and visualization paradigms ! Interaction off the desktop Manage the trade-off between power and simplicity ! WILD pan & zoom ! BiPad ! Musink* ! EWE ! Augment paper Compare 12 wall-size Bimanual tablet Eyes-free entry of scores with user- interaction techniques interaction: taps, commands with defined annotations ! across 3 dimensions ! chords & gestures ! rhythmic input ! *Zoom on interactive paper ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 20 !
WILD Pan & Zoom ! Contribution: Invention ! Create and evaluate 12 multi-scale navigation techniques ! 3 Factors: uni/bimanual, guidance & movement type ! Identify individual and interaction effects ! Nancel, Wagner, Pietriga, Chapuis & Mackay (2011) CHI ’11 (Best Paper) ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 21 !
Mediated Communication ! Establish peripheral and focused awareness ! ! at a distance ! WeMe ! Pêle-Mêle ! Marker Clock ! CHI’13 Scheduler ! Multi-scale Ambient & Elderly peer-care Collaborative constraint mediated intentional via peripheral solving with crowd-sourced communication ! sharing ! awareness ! data, 1000+ events ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 22 !
Example: ICI-TV ! Contribution: Innovation ! Research from the EU InterLiving project on ! ! mediated communication led to the ICI-TV OMTE ! ! project with Presto, a CEA startup ! ! Praesto provides services ! to the elderly via a ! television set-top box ! Emphasizes ! bilateral communication ! to help the elderly ! age in place ! ! ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 23 ! !
Research Methods ! Engage users throughout the design process ! ! with participatory design ! Touchstone ! Inksplorer ! Generative Walks ! Prism ! Structured walk- Evaluate trade-offs Support transition 7-month field study ! throughs of socio- and run controlled ! between paper and of a hybrid paper- technical principles ! experiments ! electronic exploration ! electronic notebook ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 24 !
Example: Prism � Contribution: Real-world exploration � Participatory design with biologists (Institut Pasteur, INSERM, INRA) � Design of a hybrid interactive paper/electronic laboratory notebook � Field study with INRA biologists (7 months) � � � � � � Tabard, Mackay & Eastmond (2008) ACM CSCW'08 � 27-28 Nov. 2013 � Comité d'évaluation du LRI � 25 �
Engineering of Interactive Systems ! Create tools and platforms that support our research ! ! and advance the state of the art ! ! FlowStates ! JBricks ! Substance ! Toolkit that Platform for zooming Middleware for multi- combines data flows through massive datasets surface applications & state machines ! on a wall display ! with diverse input ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 26 !
FlowStates ! Contribution: Fundamental research ! ! Combine two computational models to increase power of expression ! ! ! Data Flow: ! ! ! ! State Machines: ! ! Low-level event streams ! ! Higher-level interactions ! ! !! ! ! ! Tracking ! ! Menu Appert, Huot, Dragicevic & Beaudouin-Lafon, IHM’09 (Best paper) ! 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 27 !
D em os Gimlense: a multi-view, detail-in-context visualization technique that lets users navigate complex 3D models by interactively drilling holes into their outer layers to reveal objects that are buried, possibly deep, into the scene. Gliimpse: a quick preview technique that smoothly transitions between document markup code (HTML, wiki markup or LATEX) and its visual rendering. It supports rapid overviews of code-to- document mappings, saving screen real-estate. WILD interactive visualization of CHI 2013 schedule: (500 presentations in 200 sessions, with 13 parallel tracks over four days). Abstracted into a simpler classification task for an experiment to compare desktop and wall-sized interaction. 27-28 Nov. 2013 ! Comité d'évaluation du LRI ! 28 !
Recommend
More recommend