TRINITY OF AI Anima Anandkumar
AI is in the news every day But what is intelligence? 2
Which one is more intelligent? 3
4
5
What is intelligence? Ability to acquire and apply knowledge and skills. What is general intelligence? Human-level intelligence and cognitive reasoning. 6
TRINITY OF AI ALGORITHMS COMPUTE DATA 7
EXAMPLE AI TASK: IMAGE CLASSIFICATION Maple Tree Villa Backyard Plant Potted Plant Garden Swimming Pool Water 8
DATA: LABELED IMAGES FOR TRAINING AI Ø 14 million images and 1000 categories. Ø Images in Fish category. Ø Largest database of labeled images. Ø Captures variations of fish. Picture credits: Image-net.org, ZDnet.com 9
MODEL: CONVOLUTIONAL NEURAL NETWORK .02 p(cat) .85 p(dog) Deep learning: Many layers give large capacity for model to learn from data 10
COMPUTE INFRASTRUCTURE FOR AI: GPU Ø More than a billion operations per image. Ø NVIDIA GPUs enable parallel operations. Ø Enables Large-Scale AI. MOORE’S LAW: A SUPERCHARGED LAW 11
PROGRESS IN TRAINING IMAGENET Error in making 5 guesses about the image category 40 30 20 10 0 2010 2011 2012 2013 2014 Human 2015 Enabled by Trinity of AI : Data + Algorithms + Compute Statista: Statistics Portal 12
Where do we go next? 13
MULTI-DIMENSIONAL PROCESSING Image: 3 dimensions Video: 4 dimensions Width * Height * Channels Width * Height * Channels * Time 14
MULTI-DIMENSIONAL PROCESSING Ø Projection to lower dimensions can lose information. Ø How to capture all information in multidimensional data? 15
TENSORS: ENABLE MULTI-DIMENSIONAL PROCESSING 16
TENSORS: TOPIC DETECTION IN TEXT LIST OF TOPICS STOCK MARKET STORM WORLD SERIES WASHINGTON LIBRARY OF NEWS ARTICLES Amazon AUSTRALIA HEALTH Comprehend MACHINE CRISIS LEARNING 17
TENSORS: TOPIC DETECTION IN TEXT Co-occurrence Topic 2 Topic 1 of word triplets 18
Where do we go next? 19
“ Mens sana in corpore sano .” Juvenal in Satire X. 20
Center for Autonomous Systems and Technologies A New Vision for Autonomy
CAST @ CALTECH LEARNING TO LAND 22
CAST @ CALTECH DRONE TESTING LAB 23
MIND & BODY NEXT-GENERATION AI Deliberative: Instinctive: Making and adapting plans Fine-grained reactive Control Multi-Agent: Behavioral: Acting for the greater good Sense and react to human 24
Thank you 25
Recommend
More recommend