multi object representation learning with iterative
play

Multi-Object Representation Learning with Iterative Variational - PowerPoint PPT Presentation

Feb 20, 2024 •260 likes •356 views

Multi-Object Representation Learning with Iterative Variational Inference Klaus Greff, Raphal Lopez Kaufmann, Rishabh Kabra, Nick Watters, Chris Burgess, Daniel Zoran, Loic Matthey, Matthew Botvinick, Alexander Lerchner Multi-Object

  1. Multi-Object Representation Learning with Iterative Variational Inference Klaus Greff, Raphaël Lopez Kaufmann, Rishabh Kabra, Nick Watters, Chris Burgess, Daniel Zoran, Loic Matthey, Matthew Botvinick, Alexander Lerchner

  2. Multi-Object Representation Learning Object Representations Image Representation slots IODINE VAE (ours)

  3. Iterative Object Decomposition Inference NEtwork ● Built on the VAE framework Incorporates multi-object structure ● ● Iterative variational inference Decoder Structure Iterative Inference

  4. Iterative Object Decomposition Inference NEtwork ● Built on the VAE framework Incorporates multi-object structure ● ● Iterative variational inference Decoder Structure Iterative Inference

  5. Iterative Object Decomposition Inference NEtwork ● Built on the VAE framework Incorporates multi-object structure ● ● Iterative variational inference Decoder Structure Iterative Inference

  6. Object Decomposition by IODINE . s Slot Reconstructions (10) e n k g o s a c a m e M R I Inpainting of occluded parts

  7. Multi-Object Disentanglement VAE IODINE x y size color material

  8. Summary Poster #24 ● Multi-object representation learning Completely unsupervised ● Thank you for your Attention! ● Decomposes an image into individual objects Learns disentangled object representations ●

Recommend

GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with 2D-3D Multi-Feature Learning

GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with 2D-3D Multi-Feature Learning

GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with 2D-3D Multi-Feature Learning Xinshuo Weng, Yongxin Wang, Yunze Man, Kris Kitani Robotics Institute, Carnegie Mellon University 1 Motivation 3D multi-object tracking (MOT) is

317 views • 10 slides
Multi-View Representation Learning: Algorithms and Applications Changqing Zhang ( )

Multi-View Representation Learning: Algorithms and Applications Changqing Zhang ( )

Multi-View Representation Learning: Algorithms and Applications Changqing Zhang ( ) Tianjin University, China 2019-10-23 O u t l i n e 1. Background Multi-View Learning 2. Multi-View Subspace Representation 3. Multi-View

762 views • 36 slides
Multi-Object Tracking Challenge CV3DST Lecture Exercises Multi-Object Tracking Multi-Object

Multi-Object Tracking Challenge CV3DST Lecture Exercises Multi-Object Tracking Multi-Object

Multi-Object Tracking Challenge CV3DST Lecture Exercises Multi-Object Tracking Multi-Object Tracking Origins SONAR, RADAR Given a raw stream of sensory data: Localize objects Estimate object identities over time

340 views • 16 slides
Independent vs. Joint Estimation in Multi Agent Iterative Learning Control Angela Schoellig,

Independent vs. Joint Estimation in Multi Agent Iterative Learning Control Angela Schoellig,

Independent vs. Joint Estimation in Multi Agent Iterative Learning Control Angela Schoellig, Javier Alonso Mora and Raffaello DAndrea Institute for Dynamic Systems and Control ETH Zrich, Switzerland 1 Control and Decision Conference

416 views • 16 slides
Sensitivity of Joint Estimation in Multi Agent Iterative Learning Control Angela Schoellig and

Sensitivity of Joint Estimation in Multi Agent Iterative Learning Control Angela Schoellig and

Sensitivity of Joint Estimation in Multi Agent Iterative Learning Control Angela Schoellig and Raffaello DAndrea Institute for Dynamic Systems and Control ETH Zurich, Switzerland 1 IFAC World Congress 2011, Milano Aug 29, 2011 OUR FOCUS

865 views • 18 slides
Multi-Object Synchronization Chapter 6 OSPP Part I Multi-Object Programs What happens when

Multi-Object Synchronization Chapter 6 OSPP Part I Multi-Object Programs What happens when

Multi-Object Synchronization Chapter 6 OSPP Part I Multi-Object Programs What happens when we try to synchronize across multiple objects in a large program? Each object with its own lock, condition variables Performance: single

1.43k views • 28 slides
Invariant-equivariant representation learning for multi-class data Ilya Feige Faculty

Invariant-equivariant representation learning for multi-class data Ilya Feige Faculty

Invariant-equivariant representation learning for multi-class data Ilya Feige Faculty Invariant-equivariant representation learning High-level introduction 2 Separating content from style This work is about disentangling

533 views • 25 slides
Vision and Language Representation Learning Self Supervised Pretraining and Multi-Task Learning

Vision and Language Representation Learning Self Supervised Pretraining and Multi-Task Learning

Vision and Language Representation Learning Self Supervised Pretraining and Multi-Task Learning Jiasen Lu April 21, 2020 1 1 Vision and Language Visual Question Answering Image Captioning Visual Commonsense Reasoning Refer Expression 2

1.13k views • 53 slides
Joint Representation Learning for Multi-Modal Transportation Recommendation Hao Liu 1 , Ting Li 2 ,

Joint Representation Learning for Multi-Modal Transportation Recommendation Hao Liu 1 , Ting Li 2 ,

Joint Representation Learning for Multi-Modal Transportation Recommendation Hao Liu 1 , Ting Li 2 , Renjun Hu 3 , Yanjie Fu 4 , Jingjing Gu 5 , Hui Xiong 1 1 The Business Intelligence Lab, Baidu Research 2 National University of Defense

390 views • 17 slides
Multi-task Learning for Precise Object Search from Massive Images/Videos Fan Yang National

Multi-task Learning for Precise Object Search from Massive Images/Videos Fan Yang National

Multi-task Learning for Precise Object Search from Massive Images/Videos Fan Yang National Engineering Laboratory for Video Technology School of EE & CS, Peking University Outline Introduction Motivation Challenge Multi-task

852 views • 74 slides
Convolutional neural networks are good at representation learning Image Object Semantic

Convolutional neural networks are good at representation learning Image Object Semantic

Convolutional neural networks are good at representation learning Image Object Semantic Face Pose classification detection segmentation alignment estimation 2 deeper wider finer Deeper - more layers Wider - more

877 views • 70 slides
Adaptive Adversarial Multi-task Representation Learning Yuren Mao 1 Weiwei Liu 2 Xuemin Lin 1 1.

Adaptive Adversarial Multi-task Representation Learning Yuren Mao 1 Weiwei Liu 2 Xuemin Lin 1 1.

ICML 2020 WHU C H I N A Adaptive Adversarial Multi-task Representation Learning Yuren Mao 1 Weiwei Liu 2 Xuemin Lin 1 1. University of New South Wales, Australia. 2. Wuhan University, China. Overview: Adaptive AMTRL (Adversarial Multi-task

503 views • 12 slides
Learning an Alphabet of Shape and Appearance for Multi-Class Object Detection Andreas Opelt, Axel

Learning an Alphabet of Shape and Appearance for Multi-Class Object Detection Andreas Opelt, Axel

Learning an Alphabet of Shape and Appearance for Multi-Class Object Detection Andreas Opelt, Axel Pinz and Andrew Zisserman 09-June-2009 Irshad Ali (Department of CS, AIT) 09-June-2009 1 / 20 Object class recognition Object class recognition

386 views • 20 slides
www.mpc.berkeley.edu Borrelli (UC Berkeley) Iterative Learning MPC 2018 CDC Slide 1

www.mpc.berkeley.edu Borrelli (UC Berkeley) Iterative Learning MPC 2018 CDC Slide 1

Iterative Learning Model Predictive Control Francesco Borrelli Email: fborrelli@berkeley.edu University of California Berkeley, USA www.mpc.berkeley.edu Borrelli (UC Berkeley) Iterative Learning MPC 2018 CDC Slide 1 Acknowledgements

1.19k views • 104 slides
Iterative Learning of Feed Forward Corrections for High Performance Tracking Fabian L.

Iterative Learning of Feed Forward Corrections for High Performance Tracking Fabian L.

Iterative Learning of Feed Forward Corrections for High Performance Tracking Fabian L. Mueller, Angela P. Schoellig, Raffaello DAndrea Institute for Dynamic Systems and Control ETH Zrich, Switzerland 1 Iterative Learning of Feed

500 views • 15 slides
Human Kinematics Kinematic representation Iterative methods Optimization methods

Human Kinematics Kinematic representation Iterative methods Optimization methods

Human Kinematics Kinematic representation Iterative methods Optimization methods Motion representation Maximal coordinates Generalized coordinates x, y, z, 0 , 0 , 0 ( x 0 , R 0 ) 1 , 1 ( x 1 , R 1 ) 2 ( x 2 , R 2

405 views • 39 slides
Learning 3D object models from 2D images Cropped Input Image Predicted Mesh Generated Ground

Learning 3D object models from 2D images Cropped Input Image Predicted Mesh Generated Ground

Learning 3D object models from 2D images Cropped Input Image Predicted Mesh Generated Ground Truth Predicted Landmarks Mesh Loss Latent Spatial Mesh Convolutional ResNet-50 Vector Decoder Iterative Model Fitting Learning from Imperfect

964 views • 69 slides
Regularization for Multi-Output Learning Lorenzo Rosasco 9.520 L. Rosasco Regularization for

Regularization for Multi-Output Learning Lorenzo Rosasco 9.520 L. Rosasco Regularization for

Regularization for Multi-Output Learning Lorenzo Rosasco 9.520 L. Rosasco Regularization for Multi-Output Learning About this class Goal In many practical problems, it is convenient to model the object of interest as a function with multiple

507 views • 47 slides
Multi-task, Multi-lingual Learning Graham Neubig Site https://phontron.com/class/nn4nlp2018/

Multi-task, Multi-lingual Learning Graham Neubig Site https://phontron.com/class/nn4nlp2018/

CS11-747 Neural Networks for NLP Multi-task, Multi-lingual Learning Graham Neubig Site https://phontron.com/class/nn4nlp2018/ Remember, Neural Nets are Feature Extractors! Create a vector representation of sentences or words for use in

515 views • 32 slides
Efficient Grasping from RGBD Images: Learning Using a New Rectangle Representation Yun Jiang,

Efficient Grasping from RGBD Images: Learning Using a New Rectangle Representation Yun Jiang,

Efficient Grasping from RGBD Images: Learning Using a New Rectangle Representation Yun Jiang, Stephen Moseson, Ashutosh Saxena Cornell University Problem Goal: Figure out a way to pick up the object. Approach Grip Pick up

428 views • 29 slides
Deep Representation and Reinforcement Learning Soumalya Sarkar, PhD for Anomaly Detection and

Deep Representation and Reinforcement Learning Soumalya Sarkar, PhD for Anomaly Detection and

Deep Representation and Reinforcement Learning Soumalya Sarkar, PhD for Anomaly Detection and Control Senior Research scientist, UTRC in Multi-modal Aerospace Applications May 9 @ GTC 2017 This document contains no technical data subject to the

1.09k views • 43 slides
Decision Tree and Automata Learning Stefan Edelkamp 1 Overview - Decision tree representation

Decision Tree and Automata Learning Stefan Edelkamp 1 Overview - Decision tree representation

Decision Tree and Automata Learning Stefan Edelkamp 1 Overview - Decision tree representation - Top Down Induction, Attribute Selection - Entropy, Information gain - ID3 learning algorithm - Overfitting - Continous, multi-valued, costly and

718 views • 33 slides
Stable and Efficient Representation Learning with Nonnegativity Constraints Tsung-Han Lin and

Stable and Efficient Representation Learning with Nonnegativity Constraints Tsung-Han Lin and

Stable and Efficient Representation Learning with Nonnegativity Constraints Tsung-Han Lin and H.T. Kung Unsupervised Representation Learning Layer 3 Representation Layer 2 Representation Encoding Sparse encoder Layer 1 Representation

304 views • 18 slides
CosyPose: Consistent multi-view multi-object 6D pose estimation arXiv:2008.08465 Yann Labb 1,2

CosyPose: Consistent multi-view multi-object 6D pose estimation arXiv:2008.08465 Yann Labb 1,2

6th International Workshop on Recovering 6D Object Pose CosyPose: Consistent multi-view multi-object 6D pose estimation arXiv:2008.08465 Yann Labb 1,2 , Justin Carpentier 1,2 , Mathieu Aubry 4 , Josef Sivic 1,2,3 1 Inria 2 DI ENS, PSL 3 CIIRC,

1.08k views • 11 slides

More recommend