Beta Presentation Augmented Reality Mechanic Training The Capstone - PowerPoint PPT Presentation

Beta Presentation Augmented Reality Mechanic Training The Capstone Experience Team Union Pacific Justin Barber Jake Cousineau Colleen Little Nicholas MacDonald Luke Sperling Department of Computer Science and Engineering Michigan State University From Students… Fall 2018 …to Professionals

Project Overview • Two immersive training experiences for mechanics • Learn About Machinery (HoloLens + PC)  View labeled holograms of CAD models  Select parts to display information  Import CAD models through PC application • Build a Train (Android)  Guides user through assembling a 3D printed train  Uses object recognition to locate train cars The Capstone Experience Team Union Pacific Beta Presentation 2

System Architecture The Capstone Experience Team Union Pacific Beta Presentation 3

System Architecture The Capstone Experience Team Union Pacific Beta Presentation 4

Learn About Machinery: HoloLens Main Menu The Capstone Experience Team Union Pacific Beta Presentation 5

Learn About Machinery: Key Part Information The Capstone Experience Team Union Pacific Beta Presentation 6

Learn About Machinery: Model Manipulation The Capstone Experience Team Union Pacific Beta Presentation 7

Learn About Machinery Portal The Capstone Experience Team Union Pacific Beta Presentation 8

Build a Train: Instructions The Capstone Experience Team Union Pacific Beta Presentation 9

Build a Train: User Error The Capstone Experience Team Union Pacific Beta Presentation 10

Build a Train: Tutorial Complete The Capstone Experience Team Union Pacific Beta Presentation 11

What’s left to do? • More extensive error handling and optimization of Learn About Machinery networking code • Distinctive sound/vibration when errors detected in Build a Train • User interface cleanup • Final style guide pass on project code The Capstone Experience Team Union Pacific Beta Presentation 12

Questions? ? ? ? ? ? ? ? ? ? The Capstone Experience Team Union Pacific Beta Presentation 13