Tangible User Interface Ludovic GARREAU, Nadine COUTURE LIPSI-ESTIA - PDF document

TUI ESKUA Design September, 8 th Monday 2003 : “Physical interaction – Workshop on Real World User Interfaces” Sample Context Mobile HCI Conference 2003 in Udine Study of Tangible User H uman C omputer Interface for handling I nteraction tridimensional objects 3D Handling Visualisati on Tangible User Interface Ludovic GARREAU, Nadine COUTURE LIPSI-ESTIA (biarritz), LaBRI (bordeaux) France Ludovic Garreau September , 8th 2003 2/24 TUI ESKUA Design TUI ESKUA Design Sample Sample Outline Outline 1. Presentation of TUI 1. Presentation of TUI 2. Description of ESKUA 2. Description of ESKUA 3. Specification and design 3. Specification and design 4. Example of theoretical ESKUA use 4. Example of theoretical ESKUA use Ludovic Garreau Ludovic Garreau September , 8th 2003 3/24 September , 8th 2003 4/24 TUI ESKUA Design TUI ESKUA Design Sample Sample Tangible User Interface (1/3) Tangible User Interface (2/3) Aim : provide control of digital information with real Aim : provide control of digital information with real objects objects Pioneers are Frazer 1983 and Aish 1979 • Aish R., "3D Input for CAAD Systems, Computer-Aided Design", 11 (2):66-70, Mar. 1979. exploit human sense of touch and MIT, tangible MediaLab kinesthesia • B. A. Ullmer :Models and Mechanisms for Tangible User Interfaces, University of Illinois, 1995 Give physical form to digital information Choice of Artifact Architectural Interpretation of 3D Models Link between action and result Anderson, D et AL. "Tangible Interactions and Graphical Interpretation: A New Approach to 3D Modeling", ACM SIGGRAPH , pps 393 -402, July 2000 Segal model . E. Sharlin et AL. 3D Computer interaction using physical objects: exploration of tangible user interfaces CADcast (MIT, 1999) .Leonardo Electronic Almanac, 9, 7 (2001). Ludovic Garreau Ludovic Garreau September , 8th 2003 5/24 September , 8th 2003 6/24

TUI ESKUA Design TUI ESKUA Design Sample Sample Tangible User Interface (3/3) Outline Aim : provide control of digital information with real objects 1. Presentation of TUI 2. Description of ESKUA 3. Specification and design 4. Example of theoretical ESKUA use ActiveCube Y. Kitamura and al : Real Time Interaction with ActiveCube, CHI 2001 Extended abstracts Ludovic Garreau Ludovic Garreau September , 8th 2003 7/24 September , 8th 2003 8/24 TUI ESKUA Design TUI ESKUA Design Sample Sample ESKUA Project TUI Real Virtual World World Pascal Guitton, Nadine Rouillon Couture , Jérémy Legardeur , Input device Graphical Software Ludovic Garreau User Interface Design and Create a Tangible User Interface to allow users to Capture handle and assemble system User Virtual Objects virtual objects with real objects. Ludovic Garreau Ludovic Garreau September , 8th 2003 9/24 September , 8th 2003 10/24 TUI ESKUA Design TUI ESKUA Design Sample Sample Artifact 1/2 Outline What is the good form of the artifact ? Handling, connexion artifact/model, assemblage 1. Presentation of TUI 2. Description of ESKUA 3. Specification and design 4. Example of theoretical ESKUA use mock Abstract ? -up form Ludovic Garreau Ludovic Garreau September , 8th 2003 11/24 September , 8th 2003 12/24

TUI ESKUA Design TUI ESKUA Design Sample Sample Artifact 2/2 Our Artifacts : “Interacteurs” Interacteur ˜ inter + to act on Good form for handling and Typology interacteur Fabrication process assemblage. Size Depth Cylinder Parallelepiped Name Name Small 14 mm C s , 1 P s , 1 1 Make plan with Catia (CAD (48mm) « Design for Assembly» (DFA) 28mm C s,2 P s,2 software) 42mm P s,3 56mm C s,4 P s,4 2 Machining with lathe J. Legardeur and L. Garreau and N. Couture. -Cylinder Des interacteurs pour l'assemblage mécanique en CAO. 98mm C s,7 P s,7 3rd International Conference : Integrated Design and Production, CPI'2003, Meknès, Medium 14 mm C m, 1 P m, 1 -Block Maroc, 2003. (70mm) 28mm C m, 2 P m, 2 3 Machining with drilling 56mm P m, 3 70mm C m, 4 P m, 4 machine 98mm C m, 7 P m, 7 Large 14 mm C l , 1 P l , 1 1 2 3 (98mm) 28mm C l , 2 P l , 2 56mm C l , 4 P l , 4 98mm C l , 7 P l , 7 Large Medium Small Ludovic Garreau Ludovic Garreau September , 8th 2003 13/24 September , 8th 2003 14/24 TUI ESKUA Design TUI ESKUA Design Link between real world and virtual Sample Sample Software Architecture one Interacteur Shape CRT screen with an CaptureDat Name ConvertDat 3D OpenGL display 3D representation a a representation List of Interacteurs CameraArg Colour Colour Position Orientation Model Based Orientation Collision Position System approach Detection Identifier Identifier Name Link (joint) Camera and a vision Name Assembly processor board List of pieces Orientation (MatroxOdyssey Xa) List of links Position Name (String) Type Model based System Operation History approach J-B de la Rivière and P. Guitton. Hand posture recognition in large display VR GUI environments. In gesture Workshop, April 2003. Ludovic Garreau Ludovic Garreau September , 8th 2003 15/24 September , 8th 2003 16/24 TUI ESKUA Design TUI ESKUA Design Sample Sample Platform : ESKUA Outline (under construction) start Camer a 1. Presentation of TUI Worktop Top View 2. Description of ESKUA 3. Specification and design 4. Example of theoretical ESKUA use List of interacteurs parts lis t vie Screen for w the user interface Ludovic Garreau Ludovic Garreau September , 8th 2003 17/24 September , 8th 2003 18/24

TUI ESKUA Design TUI ESKUA Design Sample Sample Platform : ESKUA Platform : ESKUA (under construction) (under construction) start Top View lis lis t t vie vie w w Ludovic Garreau Ludovic Garreau September , 8th 2003 19/24 September , 8th 2003 20/24 TUI ESKUA Design TUI ESKUA Design Sample Sample Platform : ESKUA Platform : ESKUA (under construction) (under construction) start start lis lis t t vie vie w w Ludovic Garreau Ludovic Garreau September , 8th 2003 21/24 September , 8th 2003 22/24 TUI ESKUA Design TUI ESKUA Design Sample Sample Platform : ESKUA Future Work (under construction) start Currently, we finish to design our interacteurand develop the software. Now we need to : - adapt the 3D detection capture (model J. Legardeur and L. Garreau and N. Couture. approach) Des interacteurs pour l'assemblage mécanique en CAO. 3rd International Conference : Integrated Design and Production, CPI'2003, Meknès, Maroc, 2003. lis t - make the worktop vie w Ludovic Garreau Ludovic Garreau September , 8th 2003 23/24 September , 8th 2003 24/24

Questions ? 90° 60° Ludovic Garreau Ludovic Garreau September , 8th 2003 September , 8th 2003 TUI ESKUA Design Sample Illustration Logiciel de CAO Sélection avec la souris de S1 Sélection avec la souris de S2 Sélection avec la souris de l'action « coplanaire » Sélection avec la souris de S3 Sélection avec la souris de S4 Sélection avec la souris de l'action « coplanaire » Sélection avec la souris de S5 Sélection avec la souris de S6 Sélection avec la souris de l'action «jointes » Ludovic Garreau September , 8th 2003 27/24