1 Automating Machine Learning and Deep Learning Workflows 2 - PowerPoint PPT Presentation

Jan 07, 2023 •546 likes •794 views

1 Automating Machine Learning and Deep Learning Workflows 2 Information Name: Mourad Mourafiq Author of an open source platform: Polyaxon twitter: @mmourafiq GitHub: mouradmourafiq 3 What is Polyaxon Solves the

� 1
Automating Machine Learning and Deep Learning Workflows � 2
Information • Name: Mourad Mourafiq • Author of an open source platform: Polyaxon • twitter: @mmourafiq • GitHub: mouradmourafiq � 3
What is Polyaxon • Solves the machine learning life cycle • Can be deployed on premise or on any cloud platform • Is open source • Works with any library or framework • Can be used by single users or large organizations • Provides compliance, auditing, and security � 4
Why you need a tool to manage your ML operations? • Software development is mature • Why not use the same tools? • What is the difference between software development and ML development? • What is the difference between software deployment and ML deployment? � 5
Difference between software development and ML development • Development objectives • Vetting and quality assurance • Development stack � 6
Difference between software deployment and ML deployment • ML deployment needs a Feedback Loop • Iteration and refinement • People involved in the deployment cycle � 7
What should a ML platform answer • Should be flexible to support open source initiatives • Provides different deployment options • Ideally open source • Works with any library or framework • Scales with users • Provides compliance, auditing, and security � 8
ML development lifecycle • Data access • Data exploration and Feature engineering • Experimentation: iteration, packaging, reusability, reproducibility. • Scaling: Scheduling, orchestration and optimization • Tracking: code, data, params, artifacts, metrics • Insights, reporting, and knowledge distribution • Model management: packaging, deployment, and distribution • Compliance, auditing, and access management. • Automation, events, and workflows • User experience � 9
• Data access � 10
• Data exploration & Feature engineering � 11
• Experimentation • Different environments: local, remote, cluster • Portability and reusability • Reproducibility � 12
• Experimentation: Different environments � 13
• Experimentation: Packaging • polyaxon run -f polyxonfile.yaml • polyaxon run -f polyxonfile.yaml —local � 14
• Scheduling & Orchestration � 15
• Hyperparams tuning & distributed training � 16
• Experiments tracking � 17
• Experiments tracking � 18
• Insights, reporting, and knowledge distribution � 19
• Model Management � 20
• Compliance & Governance • Manage model development and deployment • Rigorous and auditable workflows � 21
• Automation & Events • Simple yet effective specification to create workflows and automation • Integration with other pipelining tools, e.g. airflow • Events and triggers based on data, code, metrics, … � 22
mourad@polyaxon.com twitter: @mmourafiq GitHub: mouradmourafiq https://polyaxon.com twitter: @polyaxonai GitHub: polyaxon � 23

Recommend

How Developers Iterate on Machine Learning Workflows -- A Survey of the Applied Machine Learning

How Developers Iterate on Machine Learning Workflows -- A Survey of the Applied Machine Learning Literature Doris Xin 1 , Litian Ma 1 , Shuchen Song 1 , Rong Ma 2 , Aditya Parameswaran 1 1 University of Illinois at Urbana-Champaign 2 Peking

337 views • 20 slides

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides

Basics of Machine Learning and Deep Learning (Part I) Machine Learning Tom Mitchell: An

CSci 8980 Basics of Machine Learning and Deep Learning (Part I) Machine Learning Tom Mitchell: An algorithm that is able to learn from data Learning? A computer program is said to learn from experience E with respects to some

416 views • 37 slides

Effectiveness of Deep Learning Vs. Machine Learning in a Health Care Use Case RxToDx A Data

Effectiveness of Deep Learning Vs. Machine Learning in a Health Care Use Case RxToDx A Data Science Machine Learning/Deep Learning Show Case Dima Rekesh/Julie Zhu/Ravi Rajagopalan Optum Technology November, 2017 Analytics Machine

483 views • 32 slides

Bringing the human back in the loop Joaquin Vanschoren, TU/e (new) data Meta-learning Automate

Bringing the human back in the loop Joaquin Vanschoren, TU/e (new) data Meta-learning Automate optimization data analysis improved initial workflows workflows Online collaboration Automating machine learning: a human-robot symbiosis

663 views • 19 slides

Deep Learning (CNNs) Deep Learning Readings: Matt Gormley Murphy 28 Bishop

10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University Deep Learning (CNNs) Deep Learning Readings: Matt Gormley Murphy 28 Bishop

985 views • 86 slides

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning 11.1 Learning agents 11.2 Inductive learning 11.3 Deep learning 11.4 Statistical learning 11.5 Reinforcement learning 11.6 Transfer learning

1.7k views • 159 slides

Deep Learning and Hardware: Matching the Demands from the Machine Learning Community Ekapol

Deep Learning and Hardware: Matching the Demands from the Machine Learning Community Ekapol Chuangsuwanich Department of Computer Engineering, Chulalongkorn University Deep learning Artificial Neural Networks rebranded Deeper models Bigger

808 views • 44 slides

Interpretable & Transparent Deep Learning Fraunhofer HHI, Machine Learning Group Wojciech

Fraunhofer Image Processing Heinrich Hertz Institute Interpretable & Transparent Deep Learning Fraunhofer HHI, Machine Learning Group Wojciech Samek Northern Lights Deep Learning Workshop (NLDL19) Troms, Norway 8th January 2019

1.15k views • 51 slides

Machine Learning Basics Prof. Kuan-Ting Lai 2020/4/4 Machine Learning Francois Chollet , Deep

Machine Learning Basics Prof. Kuan-Ting Lai 2020/4/4 Machine Learning Francois Chollet , Deep Learning with Python, Manning, 2017 Machine Learning Flow ( ) ( ) ( ) Data Evaluation Training

783 views • 62 slides

Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

CS6501: Deep Learning for Visual Recognition Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning? Supervised Learning: Classification with K-nearest neighbors Unsupervised Learning: Clustering with

1.36k views • 91 slides

Automating Cloud Deployment for Deep Learning Inference of Real-time Online Services Yang Li

Automating Cloud Deployment for Deep Learning Inference of Real-time Online Services Yang Li Zhenhua Han Quanlu Zhang Zhenhua Li Haisheng Tan DNN-driven Real-time Services Speech Recognition Image Classification Neural Machine Translation

500 views • 16 slides

Improving Reproducible Deep Learning Workflows with DeepDIVA M. Alberti 1 * , V. Pondenkandath 1*

Improving Reproducible Deep Learning Workflows with DeepDIVA M. Alberti 1 * , V. Pondenkandath 1* , L. Vgtlin 1 , M. Wrsch 12 , R. Ingold 1 , M. Liwicki 13 *Equal contribution 1 DIVA Group, University of Fribourg, Switzerland 2 IIT, FHNW

396 views • 20 slides

Distributed Deep Learning with Horovod Alex Sergeev, Machine Learning Platform, Uber Engineering

Distributed Deep Learning with Horovod Alex Sergeev, Machine Learning Platform, Uber Engineering @alsrgv Deep Learning Continues to improve accuracy long after older algorithms reach data saturation State of the art for vision,

866 views • 41 slides

Deep Learning Russ Salakhutdinov Associate Professor Machine Learning

Deep Learning Russ Salakhutdinov Associate Professor Machine Learning Department Carnegie Mellon University Canadian Institute of Advanced Research Mining for Structure Massive increase in

659 views • 49 slides

Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University

Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University March 31, 2011 Today: Readings: Learning representations III Deep Belief Networks ICA CCA Neuroscience example Latent

408 views • 11 slides

9.1 Overview 9 Deep Learning Alexander Smola Introduction to Machine Learning 10-701

9.1 Overview 9 Deep Learning Alexander Smola Introduction to Machine Learning 10-701 http://alex.smola.org/teaching/10-701-15 A brief history of computers 1970s 1980s 1990s 2000s 2010s Data 10 5 10 8 10 2 10 3 10 11 RAM ? 1MB 100MB

932 views • 57 slides

Automating variational inference for statistics and data mining Tom Minka Machine Learning and

Automating variational inference for statistics and data mining Tom Minka Machine Learning and Perception Group Microsoft Research Cambridge A common situation You have a dataset Some models in mind Want to fit many different

607 views • 31 slides

Introduction to Machine Learning Deep Learning Barnabs Pczos Credits Many of the pictures,

Introduction to Machine Learning Deep Learning Barnabs Pczos Credits Many of the pictures, results, and other materials are taken from: Ruslan Salakhutdinov Joshua Bengio Geoffrey Hinton Yann LeCun 2 Contents Definition

599 views • 44 slides

The bridge between deep learning and probabilistic machine learning Petru Rebeja 2020-07-15

The bridge between deep learning and probabilistic machine learning Petru Rebeja 2020-07-15 About me PhD student at Al. I. Cuza, Faculty of Computer Science Passionate about AI Iai AI member Technical Lead at Centric IT

670 views • 28 slides

The Unspoken Problems With Machine Learning in Security Noa Weiss Hi! AI & Machine Learning

The Unspoken Problems With Machine Learning in Security Noa Weiss Hi! AI & Machine Learning Consultant Playing with data for over a decade Risk and Security PayPal, Armis 2 Hi! Deep Voice foundation Leader of

554 views • 54 slides

STRUCTURE INTO MACHINE LEARNING TRINITY OF AI ALGORITHMS COMPUTE DATA 2 DEEP LEARNING IS

Anima Anandkumar BEYOND BLACK BOXES: INFUSING STRUCTURE INTO MACHINE LEARNING TRINITY OF AI ALGORITHMS COMPUTE DATA 2 DEEP LEARNING IS DATA-HUNGRY STRUCTURE-INFUSED LEARNING Learning Data Priors = + Learning Data Priors = + How

579 views • 44 slides

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan Zelener Machine Learning Reading Group January 7 th 2016 The Graduate Center, CUNY Objectives Explain some of the trends of deep learning and

680 views • 44 slides

Introduction to Machine Learning CMU-10701 Deep Learning Barnabs Pczos & Aarti Singh

Introduction to Machine Learning CMU-10701 Deep Learning Barnabs Pczos & Aarti Singh Credits Many of the pictures, results, and other materials are taken from: Ruslan Salakhutdinov Joshua Bengio Geoffrey Hinton Yann LeCun 2

1.22k views • 64 slides