S8215: Displaying and Interacting with Desktop Apps in VR GTC 2018 - PowerPoint PPT Presentation

S8215: Displaying and Interacting with Desktop Apps in VR GTC 2018 // Rouslan Dimitrov

Imagine YOUR OWN Holodeck User content from BIOHAZRED

Imagine YOUR OWN Holodeck VR Screens User content from BIOHAZRED

VR TOOLBOX the App Goal: bring existing desktop applications & content into VR 1 2 3 4 Desktop apps Customize your space Community integration Extras: with virtual screens & • Share props through Steam • YouTube 360 integration Capture apps’ render surface props Workshop • Watch streamed Twitch Forward input events • Share custom scenes with your broadcasts live • Built-in / online catalog / your Improve text readability friends or coworkers • Camera pass-through and own • C++ / JavaScript plugin support webcam support

SCREENS Screen Sources • Entire desktop • Individual apps • Video / image (poster) • Camera (webcam) • Built-in Browser Per Screen Properties • Size • Position • Orientation • Curvature • Alpha • Stereoscopy • + more… User content from Lipica

User content from BIOHAZRED

User content from TapCrush

INPUT Use everyday paradigms (in VR) Touchpad gestures • Click left / right – translate to left / right mouse clicks • Swipe left / right – go back / forward • Swipe up / down – scroll the page Laser pointer • In addition to mouse cursor • Mouse cursor: • Hovers above the screen • Significantly larger than on the desktop • Adaptive smoothing: • Users should not experience their shaky hands • Clicks should not push the pointer down • Clicks should not be interpreted as drags

INPUT Use everyday paradigms (in VR) Hand gestures • Grab by squeezing (the trigger) • Move objects by moving your hand • Extend your reach in VR by swiping while grabbing • Grip button applies hand transform to the grabbed object

VISUAL AIDS It’s easy to clutter your VR space, but VR Toolbox can help fix that! • Snap objects to vertical axis • Snap objects to other nearby objects • Auto-arrange screens • Link objects in a hierarchy Moving the desk also moves the screens and lamp on top • Render infinite bounding lines to align objects that are far apart, in addition to snapping them

Virtual Real World Connection Vive Tracker Integration • Track the chair / keyboard • Establish a linkage to any VR object Pass-through Camera (Beer Cam) • See your keyboard / hands / drink / cable around your feet • Activated when looking down • Activated when looking behind (who is knocking on the door)

Virtual Real World Connection Pass-through Camera (Beer Cam) • See your keyboard / hands / drink / cable around your feet • Activated when looking down • Activated when looking behind (who is knocking on the door) Vive Tracker Integration • Track the chair / keyboard • Establish a linkage to any VR object

RENDERING

RENDERING 1 2 3 Temporal Dithering Depth of Field Ambient Occlusion • World space technique • HMD resolution too low for reading • Decrease distraction while focusing small text on a window or examining a nearby • No noise object •“Smooth nearest” sampling mode • Fast (for 90 FPS, stereo) (in your hand) for text improves readability to • Very approximate, but nice hard counter head wobble • Makes VR more natural contacts • Image sharpening • Large eye aperture for far objects only • Turn off clear type

QUESTIONS? VR-Toolbox.com http://store.steampowered.com/app/488040