VR-Based Toolsets for Instructors H.K. Yaqub 1 1 Unity3D Developer, - PDF document

VR-BASED TOOLSETS FOR INSTRUCTORS VR-Based Toolsets for Instructors H.K. Yaqub 1 1 Unity3D Developer, BMT, Bath, UK Abstract — This paper outlines the development of a suite of VR tools (ENGAGE Instructor Toolset) which allow instructors to monitor the activity of students in a virtual-training scenario. They also allow instructors to issue aid and introduce dynamic obstacles or changes in task. It makes use of consumer VR technologies and incorporates gaze- aided interaction as well as design principals found in games using an omniscient viewpoint. 1 Introduction 3 Toolset BMT’s ENGAGE platform is a flexible and high fidelity When considering how to approach this interaction training platform used to power virtual training challenge, one option to consider is for the moderator to applications. The features of the platform include curate and monitor the scenarios from a “God View” integration with LRS (Learning Record Store) perspective (omniscient or top-down third-person point of technologies, tools for developers and user to curate view). Examples of this interface can be found in real-time scenarios, instructor-to-student interaction (giving hints strategy games, simulation games (e.g. “The Sims”) and and directions) and analytics visualisation. While the core many roleplaying games. These genres of games require functionality of ENGAGE has been developed for a while, macro and micro management of a multitude of assets in we are continually seeking ways to improve the platform real-time. The application of this technique provides a and make it more accessible for customer use. This range of benefits including: includes a recent research project making it more effective for instructors to assess and communicate with students - Comprehensive Map Interaction - showing all the layers during live virtual training. This paper outlines the in a quick to access view. research and development contacted to date and the - Identifying Student Avatars - Identifying markers or proposed future development tasks to ensure effective symbols hovering above the players to identify them. instructor-student interaction. - Selecting and Directing - With the help of gaze tracking hardware for greater item precision. 2 Use Case - Curating Scenarios - Quick to adapt and create new scenarios for changing applications and requirements. - Activity and Progress Tracking - View allows for regular Consider a scenario of a training application on board a reporting to be presented alongside movement tracking. large ship similar to our previous work on the QEC aircraft carrier visualisation project. It is a PC-based application 4 VR vs PC which consists of an accurate model of the interior of the QEC aircraft carrier which allows users to familiarise The toolset was originally envisioned as a PC application themselves with layouts, routes, standard procedures and in the vein of similar applications mentioned previously. emergency procedures. It also offers the ability for an Literature also suggests that PC can be preferable as the instructor to curate training exercises by letting them set guide or moderator in asynchronous/asymmetric waypoints, objects of interest and emergency scenarios multiplayer tasks [1, 2] as PC interface offers high degree like power failures, flooding, causalities and fire. During a of control and familiarity. live scenario, the instructor is able to follow the student and manipulate the scenario by adding or removing tasks However, improvements in VR interaction design and on the fly. hardware allow COTS HMDs to be seriously considered as a preferable interface for instructors. Games such as These virtual tasks are designed for multiple simultaneous “Final Assault” [3] demonstrate methods exclusive to VR student (VR or non-VR) working together in the same which allow for naturistic interactions and management of virtual environment. They may all be collocated in the a large number of agents in war-gaming (real-time- same section and deck, or they could be in different parts strategy) scenario. Games such as “Star Trek Bridge of the ship. Though their instruction and progress are Crew” [4] demonstrate how a VR user using motion automated and tracked, it still requires real-time input from controllers can simulate fine-grain interactions. The a human moderator in a teaching and/or assessment “Spacetime” tool [5] demonstrates novel approaches to scenario. multiple VR user collaboration. It allows for users to