DiVE Virtual Reality Lab Duke ITAC Meeting 2/22/2018 David J. Zielinski Dr. Regis Kopper Research and Development Assistant Research Professor of Engineer for the DiVE MEMS, and Computer Science Director of the DiVE 1
https://en.wikipedia.org/wiki/Hype_cycle History of VR Media Hype (1992,1999) Now? Oculus acquired by Facebook for $2B (2014) Trough of Disillusionment 2000s Ivan Sutherland 2 first HMD (1968)
Consumer VR Devices DiVE Lab Facilities Oculus CV-1 HTC VIVE Microsoft Hololens Zspace Duke immersive Virtual Environment Established 2005, Upgraded 2015 3
“A Visit to the DiVE” (Summer 2016) 4
VR Display Device Trade-offs? Consumer VR Devices (HTC Vive, Oculus) CAVE-type systems (Duke DiVE) Consumer Product See own body (presence, motor tasks) Translational (expand outside the lab) See others (collaboration) Affordable 5 Reduced sickness
A few recent DiVE projects 6
Virtual Archeology: Çatalhöyük Dig@IT: Virtual Reality in Archaeology Bass Connections. Oculus HMD. (2016) Emmanuel Nicola Prof. Regis Prof. Maurizio Shiferaw Lercari 7 Kopper DiVE version (2017) Forte
Art History: Santa Chiara VR David Zielinski Elisa Andrea Prof. Caroline Lucas Add in lost choir screen (Spring 2017) 8 Castagna Basso Bruzelius Giles
Blood Flow Through Arteries (Spring 2017) BME 307: Transport Phenomena in Biological Systems Prof. Amanda Randles 9
Molecules in the DiVE (Fall 2017) NEUROBIO 719: Concepts in Neuroscience I David Prof Jorg Grandl Zielinski 10
Interaction Technique: Specimen Box (2017) ● Hard to do tangible interfaces in world-fixed systems (visible to user). David Zielinski ● Clear acrylic box ● User can touch the box ● Can't reach contents ● User study showed ○ users faster ○ less rotations Derk Nankivil ○ less presence Inspiration: Published as: "Specimen box: A tangible interaction technique for world-fixed virtual reality displays". David J. Zielinski, Derek Nankivil, Regis Historical Kopper. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). “Specimen Jars” Regis Kopper Patented as: PCT/US2017/053803. Late 1700s. 11
Marksmanship in VR Now with EEG! (P3+P4 electrodes Time spent training shows changes in time show decrease over training) spent in ballistic vs refinement phases Rao, H.M., Khanna, R., Zielinski, D.J., Lu, Y., Clements, J.M., Potter, N.D.D., Sommer, M.A., Kopper, R. and Appelbaum, L.G., 2018. Sensorimotor learning during a marksmanship task in immersive virtual reality. Frontiers in Psychology , 9 , p.58. Clements, J. M., Kopper, R., Zielinski, D. J., Rao, H., Sommer, M. A., Kirsch, E., Mainsah, B. O., Collins, L. M., and Appelbaum, L. G. Neurophysiology of visual-motor learning during a simulated marksmanship task in immersive virtual reality. In Proceedings of the 25th IEEE Conference on Virtual Reality and 12 3D User Interfaces, March 18-22, 2018, Reutlingen, Germany.
A few recent HMD projects 13
Motion Sickness Reduction Via Rest Frames ● Motion Sickness is a side effect of VR ● Rest Frames are stable scene references, which may reduce symptoms User study found that rest frame helped reduce MS, and caused less sickness Z. Cao, J. Jerald, and R. Kopper. Visually-induced motion sickness reduction via static and dynamic rest frames. In Proceedings of the on follow-up experiences 2018 Conference on Virtual Reality and 3D User Interfaces, 2018. without rest frame 14 Zekun Cao Jason Jerald Regis Kopper
PanoVR: 360 Video. Multiple Users. Visualize View Frustums of Other Users Annotation Call to Attention Initially funded by DDI; won IgniteNC reverse pitch competition, allowing continued funding through 2018 Working on establishing 10G Link Regis Alex Mitchell Isaac Rayan from Duke to Sao Paulo: Streaming 15 Kopper Blumenstock Berger Andersen Tofique 360 video.
Eye Tracking + SQUAD Ray-casting. Common VR selection technique. Bad performance in cluttered/dense environment. Yunhan SQUAD. Sphere-casting refined by Wang QUAD menu selection technique (Regis Kopper et al. 2011). 2D Select from among 4 screen areas. Each refinement step has less objects in it. EyeSQUAD. Eye-controlled sphere-casting refined by QUAD-menu Prof. (EyeSQUAD) selection technique. Regis FOVE headset. Kopper
Augmented/Mixed Reality: EVD Placement Training Microsoft Hololens Patented as: PCT/US18/17381 Regis David Nandan Shervin Andrew Patrick 17 Rahimpour Lad Codd Kopper Zielinski Cutler
Classes ME 555.05: Virtual Reality Systems Research and Design (Spring 2017, Spring 2018) ISS 320S: Introduction to Programming and User Interface Design in Unity 3D ISS 320S Final Projects Fall 2016 ISS320 Final Project Fall 2017 18 https://youtu.be/S6MFgpLoT4Y https://youtu.be/IyXZ0jfFvE4
Discussion points Sickness is the biggest challenge for VR - Limits immersion time and enjoyment of experience - Potential software solutions? - Potential hardware solutions? Display trade-offs: HMDs vs. CAVEs (like the DiVE) - HMDs are getting widely adopted, but still issues remain: encumbrance, hygiene, embodiment, safety - CAVEs are expensive and not highly available, but there are advantages: multiple users, less sickness, embodiment What about accessibility? - VR is visually focused, are we leaving out the blind? - Requirement for physical interaction is an issue - Increase realism of other senses in VR (audio, haptics) - Work with experts to explore potential accommodations 19 - Determine legal rules and precedents, to reduce litigation potential
Thank you! Dr. Regis Kopper David J. Zielinski regis.kopper@duke.edu djzielin@duke.edu DiVE Open Houses http://people.duke.edu/~djzielin/ Thursday 5pm-6pm http://virtualreality.duke.edu/ 20
Recommend
More recommend
