World's Fastest Machine Learning With GPUs - PowerPoint PPT Presentation

Aug 15, 2022 •228 likes •572 views

World's Fastest Machine Learning With GPUs http://github.com/h2oai/h2o4gpu Speaker: Jonathan C. McKinney Mateusz Erin Navdeep Rory Terry Karen Arno Jonathan S teve H2O4GPU TEAM Machine Learning Deep Learning c RIS

World's Fastest Machine Learning With GPUs http://github.com/h2oai/h2o4gpu Speaker: Jonathan C. McKinney
Mateusz Erin Navdeep Rory Terry Karen Arno Jonathan S teve H2O4GPU TEAM
Machine Learning Deep Learning c
RIS E OF GPU COMPUTING 1000X APPLICATIONS GPU-Computing perf 10 7 by 1.5X per year 2025 ALGORITHMS 10 6 1.1X per year 10 5 S YS TEMS 10 4 CUDA 10 3 1.5X per year 10 2 ARCHITECTURE S ingle-threaded perf 6
Exploratory ML/DL Scoring Analysis Algorithms Ingest/ Parse Feature Model Grid Search Engineering Export GPU Data Frame (GDF) github.com/ gpuopenanalytics 8
H2O4GPU / Open-Source: http://github.com/h2oai/h2o4gpu / Used within our own Driverless AI Product to boost performance 30X / Scikit-Learn Python API (and now R API) / All Scikit-Learn algorithms included / Important algorithms ported to GPU
Driverless AI https://www.youtube.com/watch?v=KkvWX3FD7yI 11
Driverless AI 12
Model Accuracy & Speed 13
Generalized Linear Model / Algorithm: ‒ A solver for convex optimization problems in graph form using Alternating Direction Method of Multipliers (ADMM) / Solvers: Lasso, Ridge Regression, Logistic Regression, and Elastic Net Regularization / Improvements to original POGS: ‒ Full alpha search ‒ Cross Validation ‒ Early Stopping + Warm Start ‒ Added Scikit-learn like API ‒ Supports multiple GPUs
https://www.youtube.com/watch?v=LrC3mBNG7WU https:/ / github.com/ h2oai/ h2o4gpu/ blob/ master/ exa mples/ py/ demos/ Multi-GPU-H2O-GLM-simple.ipynb 15
https://www.youtube.com/watch?v=4RKSXNfreLE 16
K-Means • Significantly faster than scikit-learn implementation (50x) • Significantly faster than other GPU implementations (5x-10x) • Supports kmeans++/kmeans|| initialization • Supports multiple GPUs • Supports batching data if exceeds GPU memory
K-Means https://github.com/h2oai/h2o4gpu/blob/master/examples/py/demos/H2O4GPU_KMeans_Images.ipynb
10 with latest solver 19
Principle Component Analysis (PCA)
Generate faces from PCA
Gradient Boosting Machines / Based upon XGBoost / Raw floating point data -> Binned into Quantiles / Quantiles are stored as compressed instead of floats / Compressed Quantiles are efficiently transferred to GPU / Sparsity is handled directly with highly GPU efficiency / Multi-GPU by sharding rows using NVIDIA NCCL AllReduce
Tree Growth Algorithms
171 with latest solver 87 51 https://www.youtube.com/watch?v=NkeSDrifJdg 29
Driverless AI on GPUs https://www.youtube.com/watch?v=KkvWX3FD7yI 31
32
Driverless AI — Competitive with Kagglers! Top 8 position in Kaggle with zero manual labor! (ranked above multiple Kaggle Grandmasters) https://www.kaggle.com/c/mercedes- benz-greener-manufacturing/leaderboard 33
H2O4GPU http://github.com/h2oai/h2o4gpu https://stackoverflow.com/questions/tagged/h2o4gpu https://gitter.im/h2oai/h2o4gpu Thank You! Questions?

Recommend

Driverless AI for GPUs Interpretability, Accuracy, Speed Sri Ambati, Arno Candel GTC 2017 Time

H2O.ai Driverless AI for GPUs Interpretability, Accuracy, Speed Sri Ambati, Arno Candel GTC 2017 Time is the Only Non-Renewable Resource World's Fastest GPU Then and Now Machine Learning in H2O Pit Stops, 1960 to 2013

186 views • 14 slides

Deep Machine Learning on GPUs Seminar talk | Daniel Schlegel | 28.01.2015 University of

Deep Machine Learning on GPUs Seminar talk | Daniel Schlegel | 28.01.2015 University of Heidelberg, Computer Engineering Group Supervisor: JProf. Dr. Holger Frning Outline 1. Introduction 4. DML on GPUs 1. What is Machine Learning 1.

1.04k views • 38 slides

XSP: Across-Stack Profiling and Analysis of Machine Learning Models on GPUs Cheng Li* 1 , Abdul

XSP: Across-Stack Profiling and Analysis of Machine Learning Models on GPUs Cheng Li* 1 , Abdul Dakkak* 1 , Jinjun Xiong 2 , Wei Wei 3 , Lingjie Xu 3 , Wen-mei Hwu 1 University of Illinois Urbana-Champaign 1 , IBM Research 2 , Alibaba Group 3

363 views • 23 slides

ZERO Digital Converting Machine Machine Overview The fastest Digital Converting Machine ZERO

ZERO Digital Converting Machine Machine Overview The fastest Digital Converting Machine ZERO RO A newly designed system based on over 20 years of experience and know-how in machine development. Most packaging and display products are

500 views • 13 slides

OPERATIONALIZING MACHINE LEARNING USING GPU 1 ACCELERATED, IN-DATABASE ANALYTICS Why GPUs?

OPERATIONALIZING MACHINE LEARNING USING GPU 1 ACCELERATED, IN-DATABASE ANALYTICS Why GPUs? Performance Increase A Tale of Numbers Infrastructure Cost Savings 100x 75% Performance Costs 100x gains over traditional 75% reduction in

329 views • 17 slides

Scott Le Grand Some Things Never Change (GPUs vs the World) How Best to Exploit GPUs

Scott Le Grand Some Things Never Change (GPUs vs the World) How Best to Exploit GPUs Molecular Dynamics or Matrix Factorization? Determinism and Numerical Stability Dynamic Range for both MD and NNs Latest AMBER PME Numbers

1.18k views • 90 slides

Extreme Machine Learning with GPUs John Canny Computer Science Division University of

Extreme Machine Learning with GPUs John Canny Computer Science Division University of California, Berkeley GTC, March, 2014 Big Data Event and text data: Microsoft Yahoo Ebay Quantcast MOOC logs Social Media Health Data

949 views • 42 slides

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice Scaling up DL 2 What is Deep Learning? 3 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY SECURITY & DEFENSE MEDIA &

1.45k views • 39 slides

ParSecureML: An Efficient Parallel Secure Machine Learning Framework on GPUs Zheng Chen , Feng

49th International Conference on Parallel Processing - ICPP ParSecureML: An Efficient Parallel Secure Machine Learning Framework on GPUs Zheng Chen , Feng Zhang , Amelie Chi Zhou , Jidong Zhai+, Chenyang Zhang , Xiaoyong Du Renmin

570 views • 34 slides

Practical Advice for Building Machine Learning Applications Machine Learning Based on lectures

Practical Advice for Building Machine Learning Applications Machine Learning Based on lectures and papers by Andrew Ng, Pedro Domingos, Tom Mitchell and others 1 ML and the world Making ML work in the world Mostly experiential advice Also

864 views • 69 slides

Clusters of GPUs Michael LeBeane mlebeane@utexas.edu Advisor : Lizy K. John Problem Statement

PhD Defense Optimizing Communication for Clusters of GPUs Michael LeBeane mlebeane@utexas.edu Advisor : Lizy K. John Problem Statement GPUs and Networks in the Wild GPUs are everywhere in HPC, Big Data, Machine Learning, and beyond

1.07k views • 61 slides

Poise : Balancing Thread-Level Parallelism and Memory System Performance in GPUs using Machine

Poise : Balancing Thread-Level Parallelism and Memory System Performance in GPUs using Machine Learning Saumay Dublish * Vijay Nagarajan Nigel Topham * * Synopsys Inc. The University of Edinburgh HPCA 2019 Washington D.C., USA

1.17k views • 46 slides

The Rise of AI and the World of Machine Learning Peter J Bentley What is AI? Robots? Magic

The Rise of AI and the World of Machine Learning Peter J Bentley What is AI? Robots? Magic software? Terrifying Super Intelligences? Machine Learning? 1951 This is a maze-solving machine that is capable of solving a maze by trial-and-error

529 views • 48 slides

NOW Handout Page 1 1 Vector Programming Model Scalar Registers Vector Registers r15 v15 #

Definition of a supercomputer: Fastest machine in world at given task A device to turn a compute-bound problem into an I/O bound problem Any machine costing $30M+ Any machine designed by Seymour Cray COSC 5351 Advanced Computer

510 views • 10 slides

Machine to Machine Communications As a Service Machine-to-Machine (M2M) refers to technologies

Machine to Machine Communications As a Service Machine-to-Machine (M2M) refers to technologies that allow both wireless and wired systems to communicate with other devices Its the fastest growing Telecom market today It uses the existing

412 views • 27 slides

GPU Accelerated Machine Learning for Bond Price Prediction Venkat Bala Rafael Nicolas Fermin

GPU Accelerated Machine Learning for Bond Price Prediction Venkat Bala Rafael Nicolas Fermin Cota Motivation Primary Goals Demonstrate potential benefjts of using GPUs over CPUs for machine learning Exploit inherent parallelism to

405 views • 24 slides

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides

Machine learning for lattice theories Real-world lattices 2 Machine learning for lattice

Machine learning for lattice theories 1 Michael S. Albergo, Gurtej Kanwar , Phiala E. Shanahan Center for Theoretical Physics, MIT Deep Learning and Physics 1 Albergo, GK, Shanahan [PRD 100 (2019) 034515] Kyoto, Japan (November 1, 2019) Machine

786 views • 52 slides

Machine learning applications in developing-world sustainability John Quinn AI-DEV Group School

Machine learning applications in developing-world sustainability John Quinn AI-DEV Group School of Computing and Informatics Technology Makerere University, Kampala, Uganda CompSust 2012 1 / 22 Overview Why machine learning in the

773 views • 22 slides

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

564 views • 17 slides

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

878 views • 29 slides

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

404 views • 26 slides

Introductory Applied Machine Learning The primary aim of the course is to provide the student with

Introductory Applied Machine Learning The primary aim of the course is to provide the student with a set of practical tools that can be applied to solve real-world problems in machine learning. Nigel Goddard School of Informatics Machine

716 views • 8 slides

10: Biological Applications for HMMs Machine Learning and Real-world Data Ann Copestake and

10: Biological Applications for HMMs Machine Learning and Real-world Data Ann Copestake and Simone Teufel Computer Laboratory University of Cambridge Lent 2017 Last session: dice world and HMM decoding You now have written a decoder, i.e., an

401 views • 14 slides