based Deep Networks Hang Zhou 1 Dongdong Chen 2 Jing Liao 3 Kejiang - PowerPoint PPT Presentation

Sep 13, 2022 •413 likes •502 views

LG-GAN: Label Guided Adversarial Network for Flexible Targeted Attack of Point Cloud- based Deep Networks Hang Zhou 1 Dongdong Chen 2 Jing Liao 3 Kejiang Chen 1 Xiaoyi Dong 1 Kunlin Liu 1 Weiming Zhang 1 Gang Hua 4 Nenghai Yu 1 1 University of

LG-GAN: Label Guided Adversarial Network for Flexible Targeted Attack of Point Cloud- based Deep Networks Hang Zhou 1 Dongdong Chen 2 Jing Liao 3 Kejiang Chen 1 Xiaoyi Dong 1 Kunlin Liu 1 Weiming Zhang 1 Gang Hua 4 Nenghai Yu 1 1 University of Science and Technology of China 2 Microsoft Research 3 City University of Hong Kong 4 Wormpex AI Research
Problem Point shifting/adding/dropping Neural network Adversarial Threat! example attack house car
Motivation Related work Current attack methods: • Optimization-based: High attack success rate/ slow runtime / visible outliers • Gradient-based: Fast runtime/ low attack success rate Motivation Generation based adversarial examples will avoid creating optimization gradient original outliers and be fast in generation with high attack success based based point rates. adversarial adversarial cloud example example
Framework Reconstruction loss Point cloud encoder Decoder sampling feature learning aggregation interpolation FC 𝒬 conv conv conv N N/2 N × 3 N/4 N/8 ෠ 𝒬 … … … Label 𝑢 encoder Multi-level Feature Target padding N × 3 label integration Attacked Classification loss Prediction model Discriminator feature learning residual block real/fake? residual pooling graph conv conv conv Prediction Discriminative loss conv …
Objective loss functions Generator: ℒ 𝒣 = ℒ 𝑑𝑚𝑡 + 𝛽ℒ 𝑠𝑓𝑑 + 𝛾ℒ 𝑒𝑗𝑡 ℒ 𝑑𝑚𝑡 = − 𝑢 log ℋ ෠ 𝒬 + 1 − 𝑢 log ℋ 1 − ෠ 𝒬 ෠ where 𝒬 = 𝒣 𝜄 𝒬, 𝑢 ℒ 𝑠𝑓𝑑 is ℓ 2 distance 2 ℒ 𝑒𝑗𝑡 ෠ 1 − 𝐸 𝜄 ෠ 𝒬 = 𝒬 2 Discriminator: 𝒬 = 1 2 + 1 ℒ 𝐸 𝒬, ෠ 2 𝐸 𝜄 ෠ 2 𝒬 2 1 − 𝐸 𝜄 𝒬 2 2
Results clean plane C&W L2 attack C&W chamfer attack C&W hausdorff attack C&W cluster attack Single-layered LG-GAN C&W object attack IFGM attack (to toilet) LG attack (to sofa) LG-GAN attack (to lamp) attack (to vase)
Results Table: Attack success rate (%, second to fourth column), distance (fifth-sixth column) between original sample and adversarial sample (meter per object) and generating time (second per object) on attacking PointNet. “Target” stands for white-box attacks. The hyper-parameter setting of two gray-box attacks is: for the simple random sampling (SRS) defense model, percentage of random dropped points is 60% ∼ 90%; for DUP-Net defense model, k = 50 and α = 0.9 from [39]. The default LG-GAN (ours) consists of multi-layered label embedding, ℓ 2 loss and GAN loss.
Thank You

Recommend

Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Maulik Shah,

Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Maulik Shah, Yunjia Zhang 1. Introduction a. Explaining deep networks is hard! b. What makes a good interpretation? Class discriminative - localize the

452 views • 9 slides

Deep Neural Networks and Hidden Markov Models in i-vector-based Text-Dependent Speaker

Introduction HMM based method Deep Neural Networks (DNNs) Experiments and Results Conclusions Deep Neural Networks and Hidden Markov Models in i-vector-based Text-Dependent Speaker Verification Hossein Zeinali 1 , 2 , Luk s Burget 2 ,

301 views • 11 slides

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations deeplearning.cce2020@gmail.com Deep Networks Intuition Neural networks with multiple hidden layers - Deep networks [Hinton, 2006] Deep Networks Intuition

1.33k views • 28 slides

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan Zelener Machine Learning Reading Group January 7 th 2016 The Graduate Center, CUNY Objectives Explain some of the trends of deep learning and

680 views • 44 slides

Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for

Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for Deep Networks Perceptron Can only model linear functions Kernel Machines Non-linearity provided by kernels Need to design appropriate kernels

1.45k views • 34 slides

Deep Networks Andrea Passerini passerini@disi.unitn.it Machine Learning Deep Networks Need for

563 views • 43 slides

Deep Feedforward Networks Lecture slides for Chapter 6 of Deep Learning www.deeplearningbook.org

Deep Feedforward Networks Lecture slides for Chapter 6 of Deep Learning www.deeplearningbook.org Ian Goodfellow Last updated 2016-10-04 Roadmap Example: Learning XOR Gradient-Based Learning Hidden Units Architecture Design

483 views • 30 slides

Grad-CAM Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath

Grad-CAM Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, Dhruv Batra Presenter: Maulik Shah Scribe: Yunjia Zhang 1

4.4k views • 45 slides

Neural Networks and Computation Graphs CS 6956: Deep Learning for NLP Based on slides and

Neural Networks and Computation Graphs CS 6956: Deep Learning for NLP Based on slides and material from Geoffrey Hinton, Richard Socher, Yoav Goldberg, and others. The computation graph slides are based on a tutorial Practical Neural

1.5k views • 121 slides

E9 205 Machine Learning for Signal Processing Understanding Deep Networks 08-11-2019 Instructor

E9 205 Machine Learning for Signal Processing Understanding Deep Networks 08-11-2019 Instructor - Sriram Ganapathy (sriramg@iisc.ac.in.in) Understanding Deep Networks Understanding Deep Networks Understanding Deep Networks SVHN dataset

366 views • 23 slides

Deep networks CS 446 The ERM perspective These lectures will follow an ERM perspective on deep

Deep networks CS 446 The ERM perspective These lectures will follow an ERM perspective on deep networks: Pick a model/predictor class (network architecture). (We will spend most of our time on this!) Pick a loss/risk. (We will almost

608 views • 40 slides

Deep Feedforward Networks Thanks to Sargur Srihari, Alexander Ororbia, Christopher Olah Deep

Deep Feedforward Networks Thanks to Sargur Srihari, Alexander Ororbia, Christopher Olah Deep Learning Srihari Topics Overview 1. Example: Learning XOR 2. Gradient-Based Learning 3. Hidden Units 4. Architecture Design 5. Backpropagation and

2.17k views • 198 slides

Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and Courville [chapt. 6,7,8]; AIMA [sect. 21.1-21.3]; Sutton and Barto, Reinforcement Learning: an

527 views • 35 slides

Harmonic Analysis of Deep Convolutional Networks 1 Yuan YAO HKUST Based on Mallat and Bolcskei

Harmonic Analysis of Deep Convolutional Networks 1 Yuan YAO HKUST Based on Mallat and Bolcskei talks etc. Acknowledgement A following-up course at HKUST: https://deeplearning-math.github.io/ High Dimensional Natural Image Classification

749 views • 42 slides

Exploring Bit-Slice Sparsity in Deep Neural Networks for Efficient ReRAM-Based Deployment

Exploring Bit-Slice Sparsity in Deep Neural Networks for Efficient ReRAM-Based Deployment Jingyang Zhang 1 , Huanrui Yang 1 , Fan Chen 1 , Yitu Wang 2 , Hai Li 1 1 Duke University, 2 Fudan University EMC2 Workshop @ NeurIPS 2019 Motivation:

369 views • 6 slides

Architecture Perceptron Highway Networks Highway Networks Allows training very deep

Highway Networks for Visual Question Answering Aaditya Prakash PhD advisor: James Storer Brandeis University Architecture Perceptron Highway Networks Highway Networks Allows training very deep networks Srivastava et al trained

174 views • 16 slides

Deep Neural Networks based Text- Dependent Speaker Verification Gautam Bhattacharya, Jahangir

Odyssey Speaker & Language Recognition Workshop 2016 Deep Neural Networks based Text- Dependent Speaker Verification Gautam Bhattacharya, Jahangir Alam, Themos Stafylakis & Patrick Kenny Computer Research Institute of Montreal (CRIM) 1

519 views • 25 slides

Incremental and Approximate Inference for Faster Occlusion-based Deep CNN Explanations Supun

Incremental and Approximate Inference for Faster Occlusion-based Deep CNN Explanations Supun Nakandala , Arun Kumar, and Yannis Papakonstantinou University of California, San Diego Introduction Deep Convolutional Neural Networks (CNNs) are

456 views • 30 slides

Deep Learning: Training Juhan Nam Training Deep Neural Networks Forward (hidden unit

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Training Juhan Nam Training Deep Neural Networks Forward (hidden unit activation) Parametric Gradient-based Learning Backward Non-parametric (gradient

650 views • 21 slides

On the Expressive Power of Deep Neural Networks Maithra Raghu, Ben Poole, Jon Kleinberg, Surya

On the Expressive Power of Deep Neural Networks Maithra Raghu, Ben Poole, Jon Kleinberg, Surya Ganguli, Jascha Sohl Dickstein Tom Brady Deep Neural Networks Recent successes in using Deep neural networks for image classification,

1.32k views • 17 slides

Deep Neural Networks and Molecular Dynamics Roberto Car Princeton University MAX Conference

Deep Neural Networks and Molecular Dynamics Roberto Car Princeton University MAX Conference ICTP, Trieste, Jan 29-31 2018 Deep Neural Networks When properly trained, deep NN are capable of learning the complex functional dependence of

442 views • 17 slides

Visualizing and Interpreting Deep Neural Networks Bolei Zhou Department of Information

Visualizing and Interpreting Deep Neural Networks Bolei Zhou Department of Information Engineering The Chinese University of Hong Kong Deep Neural Networks are Everywhere Playing Go Making Medical Decision Understanding Scenes Deep Neural

1.1k views • 46 slides

CS7015 (Deep Learning) : Lecture 13 Visualizing Convolutional Neural Networks, Guided

CS7015 (Deep Learning) : Lecture 13 Visualizing Convolutional Neural Networks, Guided Backpropagation, Deep Dream, Deep Art, Fooling Convolutional Neural Networks Mitesh M. Khapra Department of Computer Science and Engineering Indian Institute

1.07k views • 72 slides

No Spurious Local Minima in Training Deep Quadratic Networks Abbas Kazemipour Conference on

No Spurious Local Minima in Training Deep Quadratic Networks Abbas Kazemipour Conference on Mathematical Theory of Deep Neural Networks October 31, 2019 New York City, NY Need for New Optimization Theory The mystery of deep neural networks

549 views • 17 slides