kubernetes for machine learning productivity over
play

Kubernetes for machine learning: productivity over primitives - PowerPoint PPT Presentation

Mar 22, 2023 •218 likes •1.24k views

Kubernetes for machine learning: productivity over primitives Sophie Watson @sophwats sophie@redhat.com William Benton @willb willb@redhat.com Kubernetes for machine learning: productivity over primitives Sophie

  1. Stateless microservices @sophwats @willb

  2. Stateless microservices @sophwats @willb

  3. Stateless microservices @sophwats @willb

  4. Stateless microservices @sophwats @willb

  5. Stateless microservices @sophwats @willb

  6. Stateless microservices @sophwats @willb

  7. Stateless microservices @sophwats @willb

  8. Declarative app configuration @sophwats @willb

  9. Integration and deployment OK! @sophwats @willb

  10. Integration and deployment application code OK! configuration and installation recipes base image @sophwats @willb

  11. Integration and deployment application code OK! configuration and installation recipes base image @sophwats @willb

  12. Integration and deployment application code configuration and installation recipes base image @sophwats @willb

  13. What containers offer for machine learning workflows @sophwats @willb

  14. FROM centos:centos7 RUN yum install -y \ python python-pip \ java java-devel git ENTRYPOINT /bin/bash @sophwats @willb

  15. FROM centos:centos7 RUN yum install -y \ python python-pip \ java java-devel git ENTRYPOINT /bin/bash @sophwats @willb

  16. @sophwats @willb

  17. @sophwats @willb

  18. 0.13 0.13 0 0 0 1 1 0 1 0 1 0 0 0 1 0 0 0 1 1 0 0 0.06 0.07 1 0 1 1 0 1 0 0 0 0 0.07 0.06 0 0 0 0 0 0 1 1 0 1 0.02 0.08 0 1 0 0 1 0 0 1 0 0 0.17 0.11 * 1 0 0 0 0 1 0 1 1 0 0.11 0.09 0 0 1 0 1 0 1 0 0 0 0.04 0.18 0 1 0 0 0 1 0 0 1 1 0.13 0.04 0 0 0 0 1 0 0 1 0 1 0.13 0.21 1 1 0 0 0 0 0 0 0 1 0.14 0.03 @sophwats @willb

  19. Self-service environments more CPUs better GPUs more storage sensitive data @sophwats @willb

  22. @sophwats @willb

  23. @sophwats @willb

  24. O K ! O K ! @sophwats @willb

  25. No friction: mybinder.org @sophwats @willb

  28. More flexible: source-to-image % @sophwats @willb

  29. More flexible: source-to-image % builder image application image https://github.com/openshift/source-to-image @sophwats @willb

  30. oc new-app getwarped/s2i-minimal-notebook:latest~\ https://github.com/willb/probabilistic-structures \ -e JUPYTER_NOTEBOOK_PASSWORD=developer @sophwats @willb

  31. oc new-app getwarped/s2i-minimal-notebook:latest~\ oc new-app getwarped/s2i-minimal-notebook:latest https://github.com/willb/probabilistic-structures \ -e JUPYTER_NOTEBOOK_PASSWORD=developer @sophwats @willb

  32. oc new-app getwarped/s2i-minimal-notebook:latest~\ oc new-app https://github.com/willb/probabilistic-structures \ https://github.com/willb/probabilistic-structures -e JUPYTER_NOTEBOOK_PASSWORD=developer @sophwats @willb

  33. oc new-app getwarped/s2i-minimal-notebook:latest~\ oc new-app https://github.com/willb/probabilistic-structures \ -e JUPYTER_NOTEBOOK_PASSWORD=developer -e JUPYTER_NOTEBOOK_PASSWORD=developer @sophwats @willb

  34. @sophwats @willb

  35. @sophwats @willb

  36. @sophwats @willb

  39. codifying data model model feature feature model model model monitoring, monitoring, problem 
 collection training training engineering engineering validation deployment deployment validation validation and metrics and cleaning and tuning and tuning @sophwats @willb

  40. codifying data model model feature feature model model model monitoring, monitoring, problem 
 collection training training engineering engineering validation deployment deployment validation validation and metrics and cleaning and tuning and tuning @sophwats @willb

  43. m A @sophwats @willb

  44. m A @sophwats @willb

  45. (joint) distribution of input data? distribution of predictions? m A distribution of number of multiplications while scoring? @sophwats @willb

  48. @sophwats @willb

  49. Where from here? @sophwats @willb

  50. transform developer UI web and mobile events transform federate databases archive file, object transform reporting storage train management models codifying data feature model model codifying model data model monitoring, feature model model monitoring, problem 
 collection engineerin training deploymen problem 
 collection training validation validation engineering validation deployment validation and metrics and cleaning and g and tuning t and metrics and tuning @sophwats @willb

  51. application developers data engineers web and transform developer UI events mobile transform federate databases archive file, object transform reporting storage train management models data scientists @sophwats @willb

  52. application developers data engineers web and transform developer UI events mobile transform federate databases archive file, object transform reporting storage train management models machine learning engineers data scientists @sophwats @willb

  53. opendatahub.io @sophwats @willb

  54. radanalytics.io @sophwats @willb

  55. Kubeflow @sophwats @willb

  56. What did we talk about today? @sophwats @willb

  57. @sophwats @willb

  58. @sophwats @willb

  59. @sophwats @willb

Recommend

Airflow on Kubernetes: Containerizing your Workflows By Michael Hewitt Agenda Kubernetes

Airflow on Kubernetes: Containerizing your Workflows By Michael Hewitt Agenda Kubernetes

Airflow on Kubernetes: Containerizing your Workflows By Michael Hewitt Agenda Kubernetes Overview 1 Airflows integration with Kubernetes 2 Deployment of Airflow on Kubernetes 3 Kubernetes Pod Operator and its benefits 4 DAG Development

2.79k views • 14 slides
Machine learning and discovery with Kubernetes William Benton @willb willb@redhat.com

Machine learning and discovery with Kubernetes William Benton @willb willb@redhat.com

Machine learning and discovery with Kubernetes William Benton @willb willb@redhat.com What do machine learning workflows look like? @willb #SEMLA19 @willb #SEMLA19 @willb #SEMLA19 @willb #SEMLA19 @willb #SEMLA19 @willb #SEMLA19

907 views • 76 slides
An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides
Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

556 views • 17 slides
Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

872 views • 29 slides
Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides
with Kubernetes and Tensorflow Daniel van der Ende & Tim van Cann o IT Consultancy o 40

with Kubernetes and Tensorflow Daniel van der Ende & Tim van Cann o IT Consultancy o 40

Data Council NYC 2019 Reducing Flight Delays with Kubernetes and Tensorflow Daniel van der Ende & Tim van Cann o IT Consultancy o 40 Data Scientists, Machine Learning Engineers, and Data Engineers o Based in Amsterdam o We help

885 views • 56 slides
CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

1/22/19 CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine Learning? A Simple Task: Recognize Obama How do you program a computer to Recognize faces? Recommend movies? Decide which web

581 views • 5 slides
Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their performance We use machine learning in situations where it is very challenging (or impossible) to define the rules by hand: e.g. face detection

1.04k views • 28 slides
TRAINING DEEP LEARNING MODELS AT SCALE USING KUBERNETES Mitul Tiwari and Deepak Bobbarjung

TRAINING DEEP LEARNING MODELS AT SCALE USING KUBERNETES Mitul Tiwari and Deepak Bobbarjung

TRAINING DEEP LEARNING MODELS AT SCALE USING KUBERNETES Mitul Tiwari and Deepak Bobbarjung Introductions Outline Conversational AI and Deep Learning Need for a Jobs framework on Kubernetes Our Jobs architecture Our Conversational AI Platform

595 views • 30 slides
Learning-by-doing, learning-by-exporting, and productivity: evidence from Colombia Ana M.

Learning-by-doing, learning-by-exporting, and productivity: evidence from Colombia Ana M.

Learning-by-doing, learning-by-exporting, and productivity: evidence from Colombia Ana M. Fernandes Alberto E. Isgut The World Bank Wesleyan University LACEA Conference Paris, October 27-29, 2005 Does participation in export markets

668 views • 37 slides
Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 12 Outline 1 Nearest Neighbor Prediction 2 Complexity Considerations 3 The Voronoi Diagram 4 Overfitting

564 views • 12 slides
1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

What is Learning? Herbert Simon: Learning is any process by which a system improves performance from CS 391L: Machine Learning experience. Introduction What is the task? Classification Problem solving / planning /

603 views • 6 slides
MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

JACOPO DI IORIO, MATTEO FONTANA, DANIELE OCCHIUTO, CLAUDIA VOLPETTI MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING STATISTICAL LEARNING Separate evolutions, but with shared methodologies MERGE

565 views • 55 slides
Continuous Kubernetes Security @sublimino and @controlplaneio Im: - Andy - Dev-like -

Continuous Kubernetes Security @sublimino and @controlplaneio Im: - Andy - Dev-like -

Continuous Kubernetes Security @sublimino and @controlplaneio Im: - Andy - Dev-like - Sec-ish - Ops-y Is this Kubernetes cluster secure? EPIC FAIL GIF How secure is Kubernetes? What this Kubernetes talk is about Common Pwns

1.18k views • 113 slides
Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine Learning? What is Machine Learning? Examples of machine learning applications: Facial recognition software E-mail spam detectors Automated

302 views • 17 slides
Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning 11.1 Learning agents 11.2 Inductive learning 11.3 Deep learning 11.4 Statistical learning 11.5 Reinforcement learning 11.6 Transfer learning

1.7k views • 159 slides
Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides
Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine learning refers to any system where the performance of a machine in performing a task improves by gaining more experience in performing that task .

394 views • 27 slides
MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING 2012 MACHINE LEARNING MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How to separate the red class from the grey class? x 2 360 r x 1 Polar coordinates Data

1.04k views • 44 slides
BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

photo:@rewardyfahmi // Unsplash BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest Neighbor Classifier Aykut Erdem // Hacettepe University // Fall 2019 When Do We Use Machine Learning? ML is

1.33k views • 110 slides
Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

553 views • 27 slides
Scaling model training From flexible training APIs to resource management with Kubernetes Kelley

Scaling model training From flexible training APIs to resource management with Kubernetes Kelley

Scaling model training From flexible training APIs to resource management with Kubernetes Kelley Rivoire, Stripe Real World Machine Learning (@ Stripe) Stripe provides a toolkit to start and run an internet business We need to make

713 views • 44 slides
Kubernetes Matthias Haeussler Mirna Alaisami Overview Overview Kubernetes is an open-source

Kubernetes Matthias Haeussler Mirna Alaisami Overview Overview Kubernetes is an open-source

Kubernetes Matthias Haeussler Mirna Alaisami Overview Overview Kubernetes is an open-source platform designed to automate deploying , scaling , and operating application containers . Kubernetes v1.0 was released in 2015. It utilizes

916 views • 52 slides

More recommend