Generative Adversarial Networks : When fake never looked so real Evan Ntavelis 1,2 Dr. Iason Kastanis 1 Philipp Schmid 1 {ens, iks, psd}@csem.ch 1. Robotics & Machine Learning CSEM SA 2. Computer Vision Lab ETH Zürich
CSEM at a glance – Close to industry Zürich Alpnach Muttenz M Z Neuchâtel Landquart N L A 2 83.0 450 175 64 Turnover Persons Industrial European (mio CHF) clients projects
Technologies in focus at CSEM 3
4 Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks Zhu et al. 2017
5 AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks} Xu et al 2018
6 A Style-Based Generator Architecture for Generative Adversarial Networks Karras et al. 2018
7 Semantic Image Synthesis with Spatially-Adaptive Normalization Park et al. 2019
8 Source: datagrid.co.jp 2019
9 Few-Shot Adversarial Learning of Realistic Neural Talking Head Models Zakharov et al. 2019
Generative Adversarial Nets • Introduced in 2014 by Ian Goodfellow 10 • Rapidly Adopted • Unprecedented Generational Quality
Generative Adversarial Nets • An adversarial game between two subnets: 11 • The Generator • The Discriminator
Deep Fakes • In the era of Fake News do highly realistic images harbor dangers to the society? 12
Defense Mechanisms 13
The important question… 14 How can we use GANs in the industry?
The Problem • Gathering data is tedious and costly • Good quality labels require even more effort 15
A Solution Using Adversarial Networks • Adversarial Domain Adaptation • Train on a simulated data and adapt for the use case • Data Augmentation 16 • Learn how to generate new samples to train with • Generate images with desired attributes Sources: CyCADA: Cycle-Consistent Adversarial Domain Adaptation Hoffman et al. 2017, GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification Frid-Adar et al, 2018
But… • GANs are not a panacea • Nascent technology • Difficult to train • Require abundance of data 17 • Clever schemes may reduce the effort • Yet, very promising results • Worth the effort!
That’s all folks! Are you interested in being part of a highly stimulating environment working on the latest Deep Learning Technologies? 18 We are hiring!
Recommend
More recommend