s91030 hybrid machine learning with the kubeflow
play

S91030 - Hybrid Machine Learning with the Kubeflow Pipelines and - PowerPoint PPT Presentation

Mar 12, 2023 •427 likes •782 views

S91030 - Hybrid Machine Learning with the Kubeflow Pipelines and RAPIDS Sina Chavoshi Cloud AI Strategy: The right approach for the right problem Building blocks Platform Solutions Cloud AI Strategy: The right approach for the right

  1. S91030 - Hybrid Machine Learning with the Kubeflow Pipelines and RAPIDS Sina Chavoshi

  2. Cloud AI Strategy: The right approach for the right problem Building blocks Platform Solutions

  3. Cloud AI Strategy: The right approach for the right problem Building blocks Platform Solutions

  4. Building Blocks Sight Language Conversation

  5. Cloud AI Strategy: The right approach for the right problem Building blocks Platform Solutions

  6. Solutions / Contact Center Google Cloud Contact Center AI Phone Backend Fulfillment Contact Center Contact Center Virtual Provider Interface Agent Customer Knowledge Base (PDF/HTML) Agent Chat Assist Agent Virtual Agent

  7. Cloud AI Strategy: The right approach for the right problem Building blocks Platform Solutions

  8. Cloud AI Platform Data pipeline Model development Cloud Cloud ML BigQuery Dataprep Engine Model deployment and management Cloud Cloud Dataflow Dataproc Cloud ML Cloud Kubeflow Engine Kubernetes Engine Services Tools Community Jupyter ASL Notebooks

  9. Building & deploying real-life ML applications is hard and costly because of lack of tooling that covers end-to-end ML development & deployment.

  10. In addition to the actual ML... ML Code

  11. You have to worry about so much more. Data Monitoring Verification Configuration Data Collection Analysis Tools ML Code Serving Process Management Machine Infrastructure Tools Resource Feature Extraction Management Source: Sculley et al.: Hidden Technical Debt in Machine Learning Systems

  12. AI problems today Problems Solutions Deployment Brittle, opinionated infrastructure that is hard to 01 productionize and breaks between cloud and on-prem Talent 02 02 Machine Learning expertise is scarce Reusable pipelines Collaboration 03 03 Difficult to find, leverage existing solutions

  13. 01: Kubeflow ML microservices Scalable ML services on Kubernetes Easy to get started • Out-of-box support for top frameworks Training Predict – pytorch, caffe, tf and xgboost • Kubernetes manages dependencies, resources Cloud Swappable & scalable • Library of ML services • GPU support • Massive scale Training Predict Meet customer where they are • GCP On-prem • On-prem with Cisco

  14. RAPIDS Product Overview

  15. THE BIG PROBLEM IN DATA SCIENCE Manage Data Training Evaluate Deploy Data Model All Structured ETL Visualization Scoring Preparation Training Data Data Store Slow Training Times for Data Scientists

  16. RAPIDS — OPEN GPU DATA SCIENCE Software Stack Python Data Preparation Model Training Graph Analytics cuDF cuML cuGRAPH PYTHON DEEP LEARNING FRAMEWORKS RAPIDS DASK/SPARK CUDF CUML CUGRAPH CUDNN CUDA APACHE ARROW on GPU Memory

  17. BENCHMARKS cuIO/cuDF — Load and Data Preparation cuML — XGBoost End-to-End Time in seconds — Shorter is better cuIO / cuDF (Load and Data Preparation) Data Conversion XGBoost Benchmark CPU Cluster Configuration DGX Cluster Configuration 200GB CSV dataset; Data preparation CPU nodes (61 GiB of memory, 8 vCPUs, 5x DGX-1 on InfiniBand network includes joins, variable 64-bit platform), Apache Spark transformations.

  18. AI Hub & Pipelines: Fast & simple adoption of AI The Flywheel of AI Adoption 1. Search & Discover 2. Deploy Find best-of-breed solutions on the AI Quick 1-click implementation of ML Hub which leverage Cloud AI solutions pipelines onto Google Cloud Platform . 5. Publish 3. Customize Network Upload & share pipelines running best Experiment and adjustment effect within your org or publicly. out-of-the-box pipelines to custom use cases. 4. Run in production Deploy customized pipelines in production.

  19. 02: Reusable Pipelines Enable developers to build custom ML applications by easily “stitching” and connecting various components. • Reuse instead of reimplement or reinvent • Discover, learn and replicate successful pipelines

  20. What constitutes a Kubeflow Pipeline ● Containerized implementations of ML Tasks ○ Containers provide portability, repeatability and encapsulation ○ A task can be single node or *distributed* ○ A containerized task can invoke other services ● Specification of the sequence of steps ○ Specified via Python SDK ● Input Parameters ○ A “Job” = Pipeline invoked w/ specific parameters

  21. 03: AI Hub at a glance All AI content in one place 1 Quick discovery of plug & play AI pipelines & other content built by teams across Google and by partners and customers. Fast & simple implementation of AI on GCP 2 One-click deployment of AI pipelines via Kubeflow on GCP as the go-to platform for AI + hybrid & on premise. Enterprise-grade internal & external sharing 3 Foster reuse by sharing deployable AI pipelines & other content privately within organizations & publicly.

  22. Mission The one place for everything AI, from experimentation to production.

  23. Public and private AI Hub + Private content Public content By Google By partners By customers Unique AI assets by Google Created, shared & monetized Content shared securely within and with other organizations by anyone AutoML, TPUs, Cloud AI Platform, etc.

  24. Kubeflow Pipelines enable Workflow Rapid reliable Share, re-use & orchestration experimentation compose

  25. Demo

  26. Visual depiction of pipeline topology

  27. View all current and historical runs, grouped as “Experiments”

  28. Rich visualizations of metrics

  29. Clone an existing pipeline

  30. Access to all config params, inputs and outputs for each run

  31. Update parameters and submit

  32. Easy comparison of Runs

  33. Easy comparison of Runs

  35. That’s a wrap.

Recommend

Kubeflow Anywhere Tim Van Steenburgh Engineering Manager, Canonical GTC 2019 - S9515 Zero to

Kubeflow Anywhere Tim Van Steenburgh Engineering Manager, Canonical GTC 2019 - S9515 Zero to

Up and Running with Kubeflow Anywhere Tim Van Steenburgh Engineering Manager, Canonical GTC 2019 - S9515 Zero to Kubeflow 01 Provision hardware. Physical or virtual. GPUs optional. 02 Deploy Kubernetes. Configure for GPUs. 03 Deploy

329 views • 22 slides
Delphi: a hybrid approach to forecasting a global marketplace Machine Learning is very good at

Delphi: a hybrid approach to forecasting a global marketplace Machine Learning is very good at

Kai Brusch / April 18th, 2019 / Data Council SF Delphi: a hybrid approach to forecasting a global marketplace Machine Learning is very good at interpolation Purely optimizing the error function with an arbitrary number degree of freedom will

450 views • 29 slides
An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides
Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

556 views • 17 slides
Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

872 views • 29 slides
Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides
CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

1/22/19 CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine Learning? A Simple Task: Recognize Obama How do you program a computer to Recognize faces? Recommend movies? Decide which web

581 views • 5 slides
Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their performance We use machine learning in situations where it is very challenging (or impossible) to define the rules by hand: e.g. face detection

1.04k views • 28 slides
Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 12 Outline 1 Nearest Neighbor Prediction 2 Complexity Considerations 3 The Voronoi Diagram 4 Overfitting

564 views • 12 slides
1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

What is Learning? Herbert Simon: Learning is any process by which a system improves performance from CS 391L: Machine Learning experience. Introduction What is the task? Classification Problem solving / planning /

603 views • 6 slides
MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

JACOPO DI IORIO, MATTEO FONTANA, DANIELE OCCHIUTO, CLAUDIA VOLPETTI MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING STATISTICAL LEARNING Separate evolutions, but with shared methodologies MERGE

565 views • 55 slides
Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine Learning? What is Machine Learning? Examples of machine learning applications: Facial recognition software E-mail spam detectors Automated

302 views • 17 slides
Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning 11.1 Learning agents 11.2 Inductive learning 11.3 Deep learning 11.4 Statistical learning 11.5 Reinforcement learning 11.6 Transfer learning

1.7k views • 159 slides
Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides
Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine learning refers to any system where the performance of a machine in performing a task improves by gaining more experience in performing that task .

394 views • 27 slides
MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING 2012 MACHINE LEARNING MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How to separate the red class from the grey class? x 2 360 r x 1 Polar coordinates Data

1.04k views • 44 slides
BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

photo:@rewardyfahmi // Unsplash BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest Neighbor Classifier Aykut Erdem // Hacettepe University // Fall 2019 When Do We Use Machine Learning? ML is

1.33k views • 110 slides
Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

553 views • 27 slides
Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in Practise Probabilities Finite Resource Machine Learning @ Amazon Forecasting Machine Translation Visual Systems Conclusions

348 views • 34 slides
Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

CS6501: Deep Learning for Visual Recognition Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning? Supervised Learning: Classification with K-nearest neighbors Unsupervised Learning: Clustering with

1.36k views • 91 slides
Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton

Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton

Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton with Nitish Srivastava Kevin Swersky What is Machine Learning? It is very hard to write programs that solve problems like recognizing a

514 views • 48 slides
Electric Machine Simulation T Electric Machine Simulation Technology chnology St Steve Har e

Electric Machine Simulation T Electric Machine Simulation Technology chnology St Steve Har e

Electric Machine Simulation T Electric Machine Simulation Technology chnology St Steve Har e Hartridge ridge Direct Director or, Electric & , Electric & Hybrid V Hybrid Vehicles hicles Agenda Ag Intro/Session description Intr

416 views • 30 slides
MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am

MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am

MACHINE LEARNING MACHINE LEARNING Overview 1 MACHINE LEARNING Oral Presentations of Projects Start at 9h15 am and last until 12h30 2 MACHINE LEARNING Exam Format The exam lasts a total of 40 minutes: -Upon entering the room, you pick at

919 views • 57 slides
Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell

Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Machine Learning for Music: Intro Juhan Nam Definition of Machine Learning Tom M. Mitchell provided a widely accepted definition: A computer program is said to learn from

595 views • 24 slides

More recommend