HoloRange AR Sandtable Prototype Lessons Learned Formatted: English - PDF document

IT 2 EC 2020 1-6-19 DRAFT HoloRange AR Sandtable Prototype Lessons Learned Enhancing Training Through xR HoloRange AR Sandtable Prototype Lessons Learned Formatted: English (United States) Daniel J. Lacks, PhD 1 , Rodney Choi 2 1 Chief Scientist, Cole Engineering Services, Inc., Orlando, FlodidaFlorida, USA Formatted: English (United States) 2 Program Manager, Cole Engineering Services, Inc., Orlando, FlodidaFlorida, USA Formatted: English (United States) Abstract — The US Marine Corps is building a world class wargaming facility located at Headquarters, Quantico, Virginia. Commercial innovation is driving the vision to bring and build useful modern world-class technologies into the wargaming environment. Included is a desire to build an affordable Holodeck-like experience to immerse wargamers in high risk/high security environments to combine live and table-top wargaming with MR/AR/VR solutions. Cole Engineering Services, Inc. (CESI) prototyped building M&S and data visualization, collaboration, grease pen, and other features using Magic Leap One devices for this effort. This work shares CESI’s lessons learned from the industry perspective to explain what was accomplished, and lessons learned on how M&S industry partners can build AR wargaming solutions. New and creative possibilities unique to an AR solution show promise for creating a new type of Image Generator (IG) system, while variations to familiar challenges of terrain correlation and interoperability require more investigation. 1 Background features show potential for planning, execution, and analysis wargaming activities. While to focus of the The US Marine Corps is building a world class wargaming prototype effort was on wargaming use cases, we facility located aboard Marine Corps Base Quantico, anticipate the technology suits other use cases such as Virginia. Commercial innovation is driving the vision to training, planning, and mission rehearsal. bring and build useful modern world-class technologies into the wargaming environment. This innovation 2 Augmented Reality Research exploration and prototyping includes data analytics, artificial intelligence, collaboration, integration, In order to build a useable solution, it is important to employing standards, and eXtended Reality (XR) understand the technology and the value it provides. technologies such as Mixed Reality (MR), Augmented Reality (AR), and Virtual Reality (VR). The vision 2.1 Prior Research includes building an affordable Holodeck-like experience to immerse wargamers in high risk/high security One example of a similar former research conducted is for Formatted: Tab stops: 3.33 cm, Left environments to combine live and table-top wargaming the Augmented REality Sandtable (ARES) from the with XR solutions. (former) Human Research and Engineering Directorate Cole Engineering Services, Inc. (CESI) prototyped (now known as Combat Capabilities Development building Modeling and Simulation (M&S) and data Command Soldier Center), US Army Research Labs [1]. visualization, collaboration, grease pen, and other features The research focuses on creating a digital battlespace using the Unity game engine and Magic Leap One devices visualization at the point of need. The improvements for this effort called the HoloRange. The HoloRange claimed by the research include improved spatial prototype is a modern implementation of a digital sand awareness, situational awareness, distributed table – a digital twin of the battlefield. AR creates a 3D collaboration, 3D terrain and scenario authoring, and the map which may be superimposed anywhere in the real applicability of various US Army Warfighting Challenges world to include a tabletop, the floor, a wall, or at angles. (as of 2017). These improvements are further detailed to Users collaborate by sharing a common view of the explain important findings: map, icons, events, and other visual artifacts. Users also - Representation of 3D space is improved when may work offline in their own map local to their AR projected in 3D rather than on a 2D monitor. device, and then rejoin the collaborative game at any time. - Methods to depict a User-Defined Common Such a feature prevents crowding around the table and Operating Picture (UDOP [2]) are different in AR bending in awkward positions to see finer details. The compared to traditional means and need more grease pen feature allows users to draw or erase freehand investigation. drawings on invisible planes parallel to the user. The pen - Mobile AR devices bring digitized sandtables to the may be extended, retracted, or snapped to the map. The point of need from classroom to battlefield. data visualization feature included charts and graphs. - Data visualization needs require more research, but The digital nature of the AR solution allows users to the AR platform is unique and provides a mechanism explore the map and visualize simulations at a resolution that a traditional sandtable cannot. comfortable for their eyesight without knocking over pieces or messing up a physical sand table. These AR