DeepReal A Deep Learning Based 3D Advert Integration System Ivan - PowerPoint PPT Presentation

DeepReal A Deep Learning Based 3D Advert Integration System Ivan Bacher, Hossein Javidnia, Soumyabrata Dev, Rahul Agrahari, Murhaf Hossari, Matthew Nicholson, Clare Conran, Jian Tang, Peng Song, David Corrigan, Francois Pite The ADAPT Centre is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund.

www.adaptcentre.ie Current advertisement approaches create a disruptive user experience for online streaming platforms.

www.adaptcentre.ie We propose to solve this problem with a 3D Advertisement Creation System that enables users to seamlessly insert 3D objects into any user-generated video.

Overview of System - Core ML Operations www.adaptcentre.ie CNN based method for depth estimation CNN based system for occlusion handling CNN based system for background reconstruction GAN for accurately estimating alpha mattes

Overview of System - Process www.adaptcentre.ie

Overview of System - User interface www.adaptcentre.ie

Overview of System - Steps www.adaptcentre.ie

Inserting an object www.adaptcentre.ie

Occlusion Handling www.adaptcentre.ie

Camera Tracking www.adaptcentre.ie

Camera Tracking www.adaptcentre.ie Output examples

Video Export Examples www.adaptcentre.ie

Thank you The ADAPT Centre is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund.