Remember last year ? Key takeaways from 2019 DSC speech : 1. Epic - PowerPoint PPT Presentation

DSC 2020 EUROPE VR Driving Simulation & Virtual Reality Conference & Exhibition Title Accelerate automotive simulation development Presenter Seb Loze | Simulation Industry Manager T : @SLFeeding #DSC2020 | sebastien.loze@epicgames.com DSC 2020 Europe VR Palais des Congrès - Antibes September 9, 2020

Remember last year ? Key takeaways from 2019 DSC speech : 1. Epic Games is strongly investing in some core non-game industries including Simulation 2. Unreal Engine is free (source code is available for free on GitHub as well) 3. Eager to aggregate insights coming from the simulation experts #UE4 | @UNREALENGINE

Remember yesterday ? If you missed James Butcher Unreal Engine tutorial : https://learn.unrealengine.com/ #UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa) Depending on their goals, priorities in the development process of driving simulators is focussing on 8 criterias impacting the way images are displayed (or not) : ● Image accuracy ● Photorealism Dynamics Engine Integration ● HIL Integration ● AI Integration ● ● Open Architecture ● Support of standards ● Pipeline Optimization “One thing that we're not necessarily doing is we're not doing a fancy 3D world like this because we are simulating perception.” - Uber, Matt Ranney “UE4 allowed us to achieve an impressive graphics quality, allowing top quality lighting effects, and rain/wet terrain simulation” - Kunos Assetto Corsa, Marco Massarutto #UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa) Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game (Attributed values are projections based on typical use cases observations) #UE4 | @UNREALENGINE

Unreal Engine | Driving Simulation use cases examples Inside a self-driving Uber Development of Pedestrian Artificial Intelligence Nvidia AI Can Render Complete Urban Microsoft Road-Runner photo-realistic simulation and Utilizing Unreal Engine 4 Environments in Unreal Engine 4 deep learning to train autonomous driving algorithms https://www.infoq.com/presentations/uber-self-driving-software/ https://www.ijrte.org/wp-content/uploads/papers/v8i1/A7288058119.pdf https://www.extremetech.com/extreme/281649-nvidia-ai-can-render- https://www.microsoft.com/en-us/garage/blog/2018/04/project-road- complete-urban-environments-in-unreal-engine-4 runner-train-autonomous-driving-algorithms-for-road-safety/ Reikko and Vertechs create Auto City OTSL strengthens 3D Real-Time Sensor Simulator Zoox merging Simulation & Reality GM’s Cruise is preparing for a self -driving Framework COSMOsim (R) Ecosystem future in the cloud https://www.vertechs.jp/autocity https://www.prnewswire.com/news-releases/otsl-strengthens-its-3d- https://zoox.com/journal/ https://venturebeat.com/2019/04/20/gms-cruise-is-preparing-for-a-self- real-time-sensor-simulator-framework-cosmosim-r-ecosystem-for- driving-future-in-the-cloud/ autonomous-driving-300883916.html #UE4 | @UNREALENGINE

Digital Marketing - 2020 - Examples https://www.youtube.com/watch?v=5Xqqe9WcZnk https://www.youtube.com/watch?v=FJsn2OGsLOc https://www.youtube.com/watch?v=CUH5hwkl7dI&t=10s https://www.youtube.com/watch?v=SyUQ2IImObA https://www.youtube.com/watch?v=feteiyjsHOQ https://www.youtube.com/watch?v=wv5UeSZST5w #UE4 | @UNREALENGINE

AV simulation and Engineering - 2020 - Examples https://www.unrealengine.com/en-US/spotlights/ike-develops-virtual- https://www.youtube.com/watch?v=ORpo_cpDH4s https://www.youtube.com/watch?v=skanz-dzaAg simulator-for-automated-trucks-with-unreal-engine https://www.unrealengine.com/en-US/spotlights/cm-labs-links-best-in- https://www.dspace.com/en/pub/home/news/sensor_realistic_simulation. class-real-time-toolsets-for-highest-fidelity-engineering-and-training- cfm#143_54589 https://carla.org/ simulation #UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa) Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game (Attributed values are projections based on typical use cases observations) #UE4 | @UNREALENGINE

#UE4 | @UNREALENGINE

#UE4 | @UNREALENGINE

What is so special about Driving Sim ? Challenges Solutions Content Creation Handling formats / GIS / Terrain Data / Stream the world Sensors ( handling / representation ) Non visible spectrum Identifying potential integrations Data accuracy Cloud vs local Deployment #UE4 | @UNREALENGINE

Content creation - the “classic” approach UE4 integrated Landscape - Create your own procedural geotypical environment Hand-crafted landscape, Terrain splines, Foliage tools, Marketplace assets ● ● Several training zones in same environment ● https://docs.unrealengine.com/en- US/Engine/OpenWorldTools/index.html ● https://docs.unrealengine.com/en-US/Engine/Landscape/index.html ● With terrain generation tools (World Machine, Instant Terra, World Creator, TerraForm) …) ● #UE4 | @UNREALENGINE

Content creation - The “GIS data integration” approach Adapting to traditional simulation content creation pipelines ESRI TrianGraphics VectorZero Presagis O2U CityEngine Trian3DBuilder RoadRunner LiDAR Point Cloud OpenStreetMap Presagis Terra Vista ( UE 4.24 free plugin) (free plugin) (UE4 output compiler WIP) #UE4 | @UNREALENGINE

Content creation - The “GIS data integration” approach Adapting to traditional simulation content creation pipelines ESRI TrianGraphics VectorZero Presagis O2U CityEngine Trian3DBuilder RoadRunner LiDAR Point Cloud OpenStreetMap Presagis Terra Vista ( UE 4.24 free plugin) (free plugin) (UE4 output compiler WIP) #UE4 | @UNREALENGINE

Content creation - The “Standard DB” approach ESRI ArcGIS Presagis CESIUM 3D Tiles CDB ORB Viewer Simblocks CDB RTP for UE #UE4 | @UNREALENGINE

#UE4 | @UNREALENGINE

Content creation - your “Homemade” solution < Insert here your challenges > Using Unreal Engine source code and open structure allows you to create your own importers and your optimization process from your source data #UE4 | @UNREALENGINE

Non visible spectrum #UE4 | @UNREALENGINE

Non visible spectrum LIDAR semantic #UE4 | @UNREALENGINE

Non visible spectrum < Insert here your challenges > We are using the sensors from our partners. We can help you to implement yours. Some implementations are being done internally by Epic Games. Your voices are important to help us to define what is our next step. #UE4 | @UNREALENGINE

Simulation data accuracy #UE4 | @UNREALENGINE

Deployment #UE4 | @UNREALENGINE

How to conclude ? Progress have been made. Challenges have been taken care of. Partners are being supported to provide new solutions to the community. We can do better. Let’s make sure we don’t wait until the next DSC to chat. Send us a line ---> Simulation@epicgames.com Seb Loze | Simulation Industry Manager T : @SLFeeding #DSC2020 | sebastien.loze@epicgames.com #UE4 | @UNREALENGINE