Outline Virtual Reality Collaboration in Virtual Reality Groupware - PDF document

05/12/2013 Outline • Virtual Reality • Collaboration in Virtual Reality Groupware and Collaborative Interaction • Awareness Collaborative Virtual Environments • Communication • Collaborative Interaction – Navigation – Co-manipulation M2R Interaction - Université Paris-Sud - Année 2013-2014 Cédric Fleury (cedric.fleury@lri.fr) Collaborative virtual environments - M2R Interaction - Cédric Fleury 2 Outline Virtual Reality • Virtual Reality • Virtual environment (VE) • Collaboration in Virtual Reality – 3D virtual world – Simulated by computers • Awareness • Communication • Interaction in real time • Collaborative Interaction – Trough various material devices – Navigation • Immersion – Co-manipulation – Multi-sensorial perception of the VE Collaborative virtual environments - M2R Interaction - Cédric Fleury 3 Collaborative virtual environments - M2R Interaction - Cédric Fleury 4 Virtual Reality Interaction • Action/perception loop • 3 kinds of interaction techniques [Hand, 1997] – Object manipulation (interaction) – Viewpoint manipulation (navigation) – Application Control [Bowman et al., 2004] Bowman D. A., Kruijff E., LaViola J. J. et Poupyrev I. (2004). 3D User Interfaces : Theory and Practice. Addison Wesley. Collaborative virtual environments - M2R Interaction - Cédric Fleury 5 Collaborative virtual environments - M2R Interaction - Cédric Fleury 6 1

05/12/2013 Navigation Navigation • Classical techniques • Move the viewpoint + Modify the scale [Hand, 1997] – Egocentric • Walking metaphor • Manipulate its own viewpoint • Flying metaphor or Manipulate the viewpoint of the others • Driving metaphor • Include path finding [Bowman et al., 2004] – Exocentric • Navidget [Hachet et al., 2008] • Grabbing the air [Mapes etMoshell, 1995] [Hachet et al., 2008] Collaborative virtual environments - M2R Interaction - Cédric Fleury 7 Collaborative virtual environments - M2R Interaction - Cédric Fleury 8 Navigation Navigation • Multi-scale techniques • Classical techniques : assisted navigation – Manuel scale modification – Select the destination • An additional DoF • Pointing • Head-butt Zoom [Mine et al., 1997] • World In Miniature (WIM) [Stoakley et al., 1995] – Automatic scale modification • List of defined path • Bounding Boxes [Kopper et al., 2006] – Move to destination • Scaled-world grab [Mine et al., 1997] [Stoakley et al., 1995] • Teleportation [Ruddle et al., 2000] • Interpolation [Mackinlay et al., 1990] • “Guided visit” metaphor [Elmqvist et al., 2007] Collaborative virtual environments - M2R Interaction - Cédric Fleury 9 Collaborative virtual environments - M2R Interaction - Cédric Fleury 10 Object Manipulation Object Manipulation • Virtual Hand [Jacoby et al., 1994] Video • Egocentric – Select and manipulate by touching vs Exocentric • “Go-Go” metaphor – Scaled-world grab [Poupyrev et al., 1996] – WIM – Extend the virtual hand – Move exponentially • 2 main tasks • 3D cursor [Zhai et al., 1994] – Selection – Manipulation Video – Position or speed control Collaborative virtual environments - M2R Interaction - Cédric Fleury 11 Collaborative virtual environments - M2R Interaction - Cédric Fleury 12 2

05/12/2013 Object Manipulation Object Manipulation • Selection/manipulation techniques not always • Virtual Ray [Mine, 1995] suitable for manipulation – Mimic a laser pointer – Ex: virtual ray for rotations • Image plan Interaction [Pierce et al., 1997] • Combining several interaction tools – Select by pointing with one part of the body – HOMER [Bowman et Hodges, 1997] • Move the manipulated object close to the user • Attached the interaction tools to the objects Collaborative virtual environments - M2R Interaction - Cédric Fleury 13 Collaborative virtual environments - M2R Interaction - Cédric Fleury 14 Application Control Applications of Virtual Reality • Control • Scientific data analysis – Application (exit, pause,…) • Industrial applications – Rendering parameters – Design, conception – Tools/actions selection – Fabrication process • Training, education • Techniques used • Phobia therapy, rehabilitation [CDS – Bowman – 2D menus et al., 1991] • Entertainments – 3D menus – Video games – Control on a [Coquillart – Virtual visits of museums et al., 1999] tablet/smartphone – Social communication (telepresence) [CHIMP – Mine et al., 1997] Collaborative virtual environments - M2R Interaction - Cédric Fleury 15 Collaborative virtual environments - M2R Interaction - Cédric Fleury 16 Outline Collaboration in Virtual Reality • Virtual Reality • Collaboration in Virtual Reality • Awareness • Communication • Collaborative Interaction • Several users work/play together in a VE – Navigation – Co-expertise of 3D data – Co-manipulation – Complex manipulation (real or virtual) – Training – Social presence (telepresence) Collaborative virtual environments - M2R Interaction - Cédric Fleury 17 Collaborative virtual environments - M2R Interaction - Cédric Fleury 18 3

05/12/2013 Co-located collaboration Remote Collaboration Distributed virtual environment Video Video Collaborative virtual environments - M2R Interaction - Cédric Fleury 19 Collaborative virtual environments - M2R Interaction - Cédric Fleury 20 Outline Awareness • Virtual Reality • Perception of the other users • Collaboration in Virtual Reality – Where are they? – What are they doing? • Awareness • What are they looking? • Communication • Are they looking at me? • Collaborative Interaction – What could they do ? – Navigation • Can they see me? – Co-manipulation • Could they see what I am showing to them? • Could they do what I am asking them to do? Collaborative virtual environments - M2R Interaction - Cédric Fleury 21 Collaborative virtual environments - M2R Interaction - Cédric Fleury 22 Awareness Visual Awareness • Avatar: representation of users in the VE • Improve the mutual understanding Simplified Realistic – Just next to me… But where are you? – Just in front of me … But where are you looking at? – Etc. • Multi-sensorial restitution [Second Life, 2005] [DIVE, 1991] – Visual awareness [Fleury et – Audio awareness al., 2008] [Fleury et al., 2012] – Haptic awareness [Beeler et [CALVIN, 1996] [Fleury et al., 2010] al., 2013] Collaborative virtual environments - M2R Interaction - Cédric Fleury 23 Collaborative virtual environments - M2R Interaction - Cédric Fleury 24 4

05/12/2013 Visual Awareness Visual Awareness • Animation of the avatars • Use of a WIM [CALVIN, 1996] Kinect Avatar Body tracking Mortal’s view Deity’s view Video Collaborative virtual environments - M2R Interaction - Cédric Fleury 25 Collaborative virtual environments - M2R Interaction - Cédric Fleury 26 Virtual Awareness Audio Awareness • Multi-scale collaborative virtual environment • Spatialized voice restitution • Remote users’ noises – Give a lot of information • Where they are • What they are doing – Add some sounds to describe the actions – Need to be spatialized sounds [Zhang et Furnas, 2002] Collaborative virtual environments - M2R Interaction - Cédric Fleury 27 Collaborative virtual environments - M2R Interaction - Cédric Fleury 28 Haptic Awareness Awareness Model • Force feedback of the others • Spatial Model of Interaction [Benford et al., 1994] – Direct – Compute which users can interact which others • Touch the others through – Medium haptic devices • A typical communication medium – Virtual handshake • Ex: audio, visual, haptic, etc. – affective haptic • Can be asymmetrical – Aura • Sub-space bounding the – Indirect presence in a particular medium • Manipulate an object together • Interaction is possible between • Feel the force apply by the other on the object two users with colliding Aura [Benford et al., 1994] Collaborative virtual environments - M2R Interaction - Cédric Fleury 29 Collaborative virtual environments - M2R Interaction - Cédric Fleury 30 5