adversarial networks
play

Adversarial Networks : When fake never looked so real Evan Ntavelis - PowerPoint PPT Presentation

Generative Adversarial Networks : When fake never looked so real Evan Ntavelis 1,2 Dr. Iason Kastanis 1 Philipp Schmid 1 {ens, iks, psd}@csem.ch 1. Robotics & Machine Learning CSEM SA 2. Computer Vision Lab ETH Zrich CSEM at a glance


  1. Generative Adversarial Networks : When fake never looked so real Evan Ntavelis 1,2 Dr. Iason Kastanis 1 Philipp Schmid 1 {ens, iks, psd}@csem.ch 1. Robotics & Machine Learning CSEM SA 2. Computer Vision Lab ETH Zürich

  2. CSEM at a glance – Close to industry Zürich Alpnach Muttenz M Z Neuchâtel Landquart N L A 2 83.0 450 175 64 Turnover Persons Industrial European (mio CHF) clients projects

  3. Technologies in focus at CSEM 3

  4. 4 Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks Zhu et al. 2017

  5. 5 AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks} Xu et al 2018

  6. 6 A Style-Based Generator Architecture for Generative Adversarial Networks Karras et al. 2018

  7. 7 Semantic Image Synthesis with Spatially-Adaptive Normalization Park et al. 2019

  8. 8 Source: datagrid.co.jp 2019

  9. 9 Few-Shot Adversarial Learning of Realistic Neural Talking Head Models Zakharov et al. 2019

  10. Generative Adversarial Nets • Introduced in 2014 by Ian Goodfellow 10 • Rapidly Adopted • Unprecedented Generational Quality

  11. Generative Adversarial Nets • An adversarial game between two subnets: 11 • The Generator • The Discriminator

  12. Deep Fakes • In the era of Fake News do highly realistic images harbor dangers to the society? 12

  13. Defense Mechanisms 13

  14. The important question… 14 How can we use GANs in the industry?

  15. The Problem • Gathering data is tedious and costly • Good quality labels require even more effort 15

  16. A Solution Using Adversarial Networks • Adversarial Domain Adaptation • Train on a simulated data and adapt for the use case • Data Augmentation 16 • Learn how to generate new samples to train with • Generate images with desired attributes Sources: CyCADA: Cycle-Consistent Adversarial Domain Adaptation Hoffman et al. 2017, GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification Frid-Adar et al, 2018

  17. But… • GANs are not a panacea • Nascent technology • Difficult to train • Require abundance of data 17 • Clever schemes may reduce the effort • Yet, very promising results • Worth the effort!

  18. That’s all folks! Are you interested in being part of a highly stimulating environment working on the latest Deep Learning Technologies? 18 We are hiring!

Recommend


More recommend