slam nvidia
play

SLAM@NVIDIA Kari Pulli| Senior Director of Research Overview - PowerPoint PPT Presentation

SLAM@NVIDIA Kari Pulli| Senior Director of Research Overview Keyframe-based SlAM 3D rendering for Augmented Reality Problems with traditional keyframe-based SLAM Solution: Deferred Triangulation SLAM KeyFrame-based SLAM 3D


  1. SLAM@NVIDIA Kari Pulli| Senior Director of Research

  2. Overview Keyframe-based SlAM � � 3D rendering for Augmented Reality � Problems with traditional keyframe-based SLAM � Solution: Deferred Triangulation SLAM

  3. KeyFrame-based SLAM 3D Mapping Stereo Rendering [Bundle Adjustment] 2D Tracking Initialization [Overlaying (AR)] [Optical Flow] 3D Tracking [Scene Reconstruction] [Triangulation] [Pose Estimation] Time  Tracking Optical flow 3D Tracking and pose estimation Stereo triangulation Incremental mapping and camera pose refinement Mapping Bundle Adjustment BA BA BA BA BA Adding Keyframes, data association, and recovery Rendering Rendering objects with the camera poses and geometry (map)

  4. Tracking example

  5. DTAM

  6. � We have done Kinectfusion-type of processing using SoftKinetic range scanners, the quality and framerate of the depth is better than on Tango

  7. How to deal with the rotation? ISMAR 2012 ISMAR 2013

  8. This is how 3DV 2014

  9. How to deal with the rotation? � Deferred triangulation 0.5x Speed for visualization Deferred 2D points Triangulated 3D points

  10. How to deal with the rotation? � Deferred triangulation � Jointly (2D/3D) constrain a pose 0.5x Speed for visualization Deferred 2D points Triangulated 3D points

  11. How to overcome the rotation? � Deferred triangulation � Jointly (2D/3D) constrain a pose � Region merging

  12. Pose estimation

  13. Epipolar segment

  14. Epipolar segment

  15. Pose estimation

  16. Bundle Adjustment

  17. Quantitative evaluation

  18. Summary Keyframe-based SLAM is efficient � � and can run in real time on mobile devices � But it has problems � A separate initialization phase is annoying � Breaking with pure rotations is a critical failure � Both can be addressed by � tracking first in 2D � deferring triangulation until there is enough baseline between the keyframes � Bonus: we plan to open source the implementation

Recommend


More recommend