Making AI forget you: Data deletion in machine learning T ONY G - PowerPoint PPT Presentation

Nov 18, 2022 •434 likes •561 views

Making AI forget you: Data deletion in machine learning T ONY G INART M ELODY G UAN , G REG V ALIANT , J AMES Z OU Advances in Neural Information Processing Systems December 12, 2019 AI systems today... Data Algorithm Model Users AI systems

Making AI forget you: Data deletion in machine learning T ONY G INART M ELODY G UAN , G REG V ALIANT , J AMES Z OU Advances in Neural Information Processing Systems December 12, 2019
AI systems today... Data Algorithm Model Users
AI systems today... Data Algorithm Model deletion Users
AI systems today... Updated Data Algorithm Model Model deletion Users Deletion Op
Deletion requests in the wild... EMAIL ---- UK BIOBANK ---- Subject: UK Biobank Application [REDACTED], Participant Withdrawal Notification [REDACTED] Dear Researcher, As you are aware, participants are free to withdraw form the UK Biobank at any time and request that their data no longer be used. Since our last review, some participants involved with Application [REDACTED] have requested that their data should longer be used.
Contributions 1) Define deletion in ML system and notion of efficient deletion 2) Propose general principles for co-design of ML algorithms and deletion operations 3) Introduce deletion efficient unsupervised learning
What is “data deletion” for an ML system? Informal definition: Deleting a data point from a trained ML model means updating the model as if this point had never existed.
What is “deletion efficiency” for an ML system? ▪ Setting: online deletion requests from users ▪ Figure-of-Merit: amortized computation X X X ...
Toolbox for deletion efficient ML ▪ Linearity : fast O(1) deletion with respect to n data points ▪ Laziness : E.g. nearest neighbors ▪ Modularity : Control dependency from data to parameters ▪ Quantization : Efficiently check if deletion matters
State of progress Supervised learning: ▪ Linear regressions/models ▪ Non-parameteric (k-NN) ▪ Incremental SVMs Unsupervised learning : ▪ 1) Quantized k-means ▪ 2) Divide-and-Conquer k-means
State of progress Supervised learning: ▪ Linear regressions/models ▪ Non-parameteric (k-NN) ▪ Incremental SVMs Unsupervised learning : ▪ 1) Quantized k-means ▪ 2) Divide-and-Conquer k-means 100X faster deletion without loss of clustering quality
Next steps in deletion efficient ML Models: Want to know more? ▪ Decision trees/forests ▪ Artificial neural networks Poster session @ 5pm #123, East Exhibition Hall B + C Settings: ▪ Approximate deletions Thank you! ▪ Adversarial requests Happy to chat more: Paradigms: tginart@stanford.edu ▪ Reinforcement learning ▪ Representation/embedding learning

Recommend

Better Machine Learning Through Data Sa Saleema ema Amershi shi Machine T eaching Group

Better Machine Learning Through Data Sa Saleema ema Amershi shi Machine T eaching Group Microsoft Research August 14, 2016 Making better sense of data. Better data makes better machine learning. Data + Algorithm = Model Data Algorithm

1.16k views • 81 slides

Making Programs Forget: Enforcing Lifetime for Sensitive Data Jayanthkumar Kannan (Google Inc),

Making Programs Forget: Enforcing Lifetime for Sensitive Data Jayanthkumar Kannan (Google Inc), Gautam Altekar (UC Berkeley), Petros Maniatis (Intel Labs), Byung-Gon Chun (Intel Labs) 1 The Problem: Lingering Data Sensitive Data How long is

437 views • 12 slides

Differential Privacy Machine Learning Li Xiong Big Data + Machine Learning + Machine

CS573 Data Privacy and Security Differential Privacy Machine Learning Li Xiong Big Data + Machine Learning + Machine Learning Under Adversarial Settings Data privacy/confidentiality attacks membership attacks, model inversion

3.44k views • 63 slides

Introduction to machine learning COMS 4721 Learning from data Machine learning : the study

Introduction to machine learning COMS 4721 Learning from data Machine learning : the study of computational mechanisms that learn from data in order to make predictions and decisions. Example 1: image classification A birdwatcher

932 views • 14 slides

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides

Machine Learning Track Data Analytics, Machine Learning and HPC in todays changing

Intel HPC Developer Convention Salt Lake City 2016 Machine Learning Track Data Analytics, Machine Learning and HPC in todays changing application environment Franz J. Kirly (practical) An overview of data analytics DATA Scientific

550 views • 27 slides

CS 403X Mobile and Ubiquitous Computing Lecture 15: Making Apps Intelligent/Machine Learning

CS 403X Mobile and Ubiquitous Computing Lecture 15: Making Apps Intelligent/Machine Learning Emmanuel Agu Making Apps Intelligent (Sensors Inference & Machine Learning) My Goals in this Section If you know machine learning Set off light

586 views • 33 slides

Making It Rain with Machine Learning James Kazmierczak and Neil Shah Mentors: Chae Clark and

Making It Rain with Machine Learning James Kazmierczak and Neil Shah Mentors: Chae Clark and David Darmon Motivation Financial Time Series Best Practices for Learning from Data Ensemble Methods Baseline Model

717 views • 16 slides

x ? Machine Learning 5/4/20 Tim Althoff, UW CS547: Machine Learning for Big Data,

? ? x ? Machine Learning 5/4/20 Tim Althoff, UW CS547: Machine Learning for Big Data, http://www.cs.washington.edu/cse547 2 ? ? ? ? Machine Learning ? Node classification 5/4/20 Tim Althoff, UW CS547: Machine Learning for Big Data,

755 views • 53 slides

? Option 1: Understand the problem, design a solution Option 2: Set it up as a machine learning

? Option 1: Understand the problem, design a solution Option 2: Set it up as a machine learning problem data supervised learning Deep Reinforcement Learning, Decision Making, and Control CS 285 Instructor: Sergey Levine UC Berkeley data

623 views • 50 slides

Machine learning for machine data David Andrzejewski - @davidandrzej

Machine learning for machine data David Andrzejewski - @davidandrzej Data Sciences, Sumo Logic Strata Conference Machine Data Track February 13, 2014 1

1.1k views • 72 slides

DOCKER AND PYTHON Making them play nicely and securely for Data Science and Machine Learning

DOCKER AND PYTHON Making them play nicely and securely for Data Science and Machine Learning TANIA ALLARD, PHD ixek | https:/ /bit.ly/europython-ml-docker Sr. Developer Advocate @Microsoft. @ixek @trallard trallard.dev THESE SLIDES

564 views • 41 slides

ONLINE MACHINE LEARNING AND DATA MINING EDO LIBERTY STANDARD MACHINE LEARNING SETTING =

ONLINE MACHINE LEARNING AND DATA MINING EDO LIBERTY STANDARD MACHINE LEARNING SETTING = call = ? = crawl Training Test Data Data Train call Apply Model Label 2 STANDARD MACHINE LEARNING SETTING Predicting the future

746 views • 51 slides

Machine Learning and Econometrics Hal Varian Jan 2014 Definitions Machine learning, data

Machine Learning and Econometrics Hal Varian Jan 2014 Definitions Machine learning, data mining, predictive analytics, etc. all use data to predict some variable as a function of other variables. May or may not care about insight,

609 views • 44 slides

MACHINE LEARNING Slide adapted from learning from data book and course, and Berkeley cs188 by Dan

MACHINE LEARNING Slide adapted from learning from data book and course, and Berkeley cs188 by Dan Klein, and Pieter Abbeel Machine Learning ?? Learning from data Tasks: Prediction Classification Recognition Focus on

691 views • 36 slides

Effectiveness of Deep Learning Vs. Machine Learning in a Health Care Use Case RxToDx A Data

Effectiveness of Deep Learning Vs. Machine Learning in a Health Care Use Case RxToDx A Data Science Machine Learning/Deep Learning Show Case Dima Rekesh/Julie Zhu/Ravi Rajagopalan Optum Technology November, 2017 Analytics Machine

483 views • 32 slides

Overview CS 446 What is machine learning? Machine learning : study of computational

Overview CS 446 What is machine learning? Machine learning : study of computational mechanisms that learn from data to make predictions and decisions. 1 / 21 Application 1: image classification Birdwatcher takes photos of birds,

1.08k views • 83 slides

Machine Learning: Der KDD-Prozess Knowledge Discovery in Databases Machine Learning Data-Mining

Machine Learning: Der KDD-Prozess Knowledge Discovery in Databases Machine Learning Data-Mining Aufgaben Aufgabe Von Daten zum Wissen Wissensextraktion durch We are drowing in automatisches Erkennen von information,

1.01k views • 47 slides

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

553 views • 27 slides

(Machine)Learning with limited labels Machine Learning for Big Data Eirini Ntoutsi (joint work

(Machine)Learning with limited labels Machine Learning for Big Data Eirini Ntoutsi (joint work with Vasileios Iosifidis) Leibniz University Hannover & L3S Research Center 4 th Alexandria workshop, 19-20.11.2017 A good conjuncture for ML/DM

558 views • 31 slides

MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING 2012 MACHINE LEARNING MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How to separate the red class from the grey class? x 2 360 r x 1 Polar coordinates Data

1.04k views • 44 slides

MLCC 2015 machine learning applications Francesca Odone ML applications Machine Learning

MLCC 2015 machine learning applications Francesca Odone ML applications Machine Learning systems are trained on examples rather than being programmed MLCC machine learning applications Data challenges big data - extract real knowledge from

451 views • 30 slides

Basics of Machine Learning and Deep Learning (Part I) Machine Learning Tom Mitchell: An

CSci 8980 Basics of Machine Learning and Deep Learning (Part I) Machine Learning Tom Mitchell: An algorithm that is able to learn from data Learning? A computer program is said to learn from experience E with respects to some

416 views • 37 slides

Good Machine Learning = Generalization Goal of machine learning: build models that generalize

Good Machine Learning = Generalization Goal of machine learning: build models that generalize well to predicting new data Overfitting: fitting the training data too well, so we lose generality of model o Example: linear regression vs.

120 views • 11 slides