A Look Inside the USNs Mixed Reality Lab Dr. Josh Harguess GunnAR - PowerPoint PPT Presentation

A Look Inside the USN’s Mixed Reality Lab Dr. Josh Harguess GunnAR Technical Lead, BEMR Lab SPAWAR Systems Center, Pacific Phone: 619-553-0777 Email: joshua.harguess@navy.mil Distribution Statement A: Approved for public release; distribution is unlimited.

SSC Pacific Mission Conduct research, development, delivery and support of integrated C4ISR, cyber and space systems across all warfighting domains Distribution Statement A: Approved for public release; distribution is unlimited.

BEMR Lab Overview Source: SSC Pacific Play Video at: https://www.youtube.com/watch?v=IaDGF4qL2Rs 3 Distribution Statement A: Approved for public release; distribution is unlimited.

BEMR Lab Overview Play Video at: https://www.youtube.com/watch?v=IaDGF4qL2Rs Source: SSC Pacific 4 Distribution Statement A: Approved for public release; distribution is unlimited.

Some Current BEMR Lab Equipment VR & AR Goggles Hololens HTC Vive Samsung Gear VR ODG R-6, R-7 Source: ODG Oculus Rift CV-1, DK2 Source: Source: Hexo+ Samsung Source: Motion Capture Source: BEMR Wearality Systems Virtuix Omni Leap Motion Indotraq Haptic Feedback Systems By Maurizio Pesce - Delta Six - Haptic Rifle https://www.flickr.com/photos/pestoverde KOR-FX - Haptic Vest /17136184135, CC BY 2.0, Source: KOR-FX https://commons.wikimedia.org/w/index.p Source: hp?curid=39894065 Matterport Camera Systems Matterport IM360 360Heros By Menkes (Own work) [CC Microsoft Sweden [CC BY BY-SA 3.0 2.0 Software (https://creativecommons.org/l (http://creativecommons.or Unity icenses/by-sa/3.0/deed.en)], g/licenses/by/2.0)], via By Ats Kurvet - via Wikimedia Commons Unreal Wikimedia Commons Own work, CC BY- 3D Studio Max SA 4.0, https://commons.wi Kolor Autopano kimedia.org/w/inde x.php?curid=35919 Other Systems 898 Hexo+ drone zSpace 3D Monitor By SkywalkerPL (Own work) [Public domain], via Source: zSpace Wikimedia Commons 5 Source: Virtuix Source: BEMR Lab Distribution Statement A: Approved for public release; distribution is unlimited.

BEMR Lab Mission • Explore and leverage low cost commercial sector research directed at the computer gaming industry and cellular phone markets to demonstrate cutting edge battlespace visualization capabilities. • Provide Mixed Reality environment for warfighters, academia, industry and government researchers. Warfighter-to-Lab Sailors in BEMR Lab Admiral Richardson, CNO Recent interaction with sailors on NAS North Island SECDEF Ashton Carter Admiral Winter, CNR 6 Distribution Statement A: Approved for public release; distribution is unlimited. Source: SSC Pacific

Wh What a are W We W Wor orking On On? 7 Distribution Statement A: Approved for public release; distribution is unlimited.

Ship Installations/Planning AR / VR Displays SECNAV Innovation Award Winner 2016 Source: SSC Pacific Play Video at: https://www.youtube.com/watch?v=3aGTdTojKUM 8 Distribution Statement A: Approved for public release; distribution is unlimited.

Ship Installations/Planning AR / VR Displays Play Video at: https://www.youtube.com/watch?v=3aGTdTojKUM 9 Source: SSC Pacific Distribution Statement A: Approved for public release; distribution is unlimited.

Ship Installations/Planning IITSEC Paper IITSEC 2017 Paper “3D Scanning and Navy Ships: An Immediate and Outward Look at Utilization” 10 Distribution Statement A: Approved for public release; distribution is unlimited.

Ship Installations/Planning Multi-SID Comparisons Comparison between three different SID document pages. The brown boxes point out where unexpected conflict exists; the largest found was 18”. 11 Distribution Statement A: Approved for public release; distribution is unlimited.

Ship Installations/Planning 2D vs. 3D SID Comparisons 12 Distribution Statement A: Approved for public release; distribution is unlimited.

Ship Installations/Planning 2D vs. 3D SID Comparisons Junction box (blue); lack of info in 2D SID overlay; pin- point of upcoming installation issue (in red). 13 Distribution Statement A: Approved for public release; distribution is unlimited.

Ship Installations/Planning 3D As-Planned CAD vs. 3D Scan 3D CAD Catia derived model of a space on DDG-1000 overlaid with our group’s scan data. The gray CAD model shows distinct differences with the colorized 3D scan data. (Image courtesy of Beast Code) 14 Distribution Statement A: Approved for public release; distribution is unlimited.

Ship Installations/Planning Virtual Planning Environment Illustrates how a virtual environment can be interacted with through a variety of different hardware. 15 Distribution Statement A: Approved for public release; distribution is unlimited.

Gunnery System w/ AR: GunnAR AR Displays • GunnAR – Gunnery AR Source: DAQRI Source: BEMR Lab Source: Navy FIRE FREE TIGHT WARNING DESTRUCTIVE TRACK HOLD CEASE FIRE Source: SSC Pacific Source: DVIDS 16 Distribution Statement A: Approved for public release; distribution is unlimited.

Gunnery System w/ AR: GunnAR Live Fire Exercise aboard USS Bunker Hill GunnAR HUD Source: US Navy Play Video at: https://www.youtube.com/watch?v=tG9FPj1u2HQ&t=1s 17 Distribution Statement A: Approved for public release; distribution is unlimited.

Gunnery System w/ AR: GunnAR Live Fire Exercise aboard USS Bunker Hill 18 Source: US Navy/DAQRI Distribution Statement A: Approved for public release; distribution is unlimited.

Gunnery System w/ AR: GunnAR CITADEL PROTECT Waterside Security Demonstration 19 Source: US Navy/DAQRI Distribution Statement A: Approved for public release; distribution is unlimited.

Gunnery System w/ AR: GunnAR Prototype of GunnAR – VR System • GunnAR – We first prototyped the AR HUD in VR “Bend Original Artist’s Electrons Concept – Before You Gunner’s Aid Bend Steel” Synthetic Environment for Assessment (Virtual Reality) Source: SSC Pacific and DVIDS 20 Distribution Statement A: Approved for public release; distribution is unlimited.

GunnAR Cinematic Prototype 21 Distribution Statement A: Approved for public release; distribution is unlimited.

GunnAR Cinematic Prototype 22 Distribution Statement A: Approved for public release; distribution is unlimited.

23 Sources: SSC Pacific, USN Distribution Statement A: Approved for public release; distribution is unlimited.