Introduction to Data Stream Mining Albert Bifet March 2012 - PowerPoint PPT Presentation

Jul 03, 2023 •195 likes •390 views

Introduction to Data Stream Mining Albert Bifet March 2012 Motivation Source: IDCs Digital Universe Study (EMC), June 2011 Data is growing Motivation Memory unit Size Binary size 10 3 2 10 kilobyte (kB/KB) 10 6 2 20 megabyte (MB) 10 9

Introduction to Data Stream Mining Albert Bifet March 2012
Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing
Motivation Memory unit Size Binary size 10 3 2 10 kilobyte (kB/KB) 10 6 2 20 megabyte (MB) 10 9 2 30 gigabyte (GB) 10 12 2 40 terabyte (TB) 10 15 2 50 petabyte (PB) 10 18 2 60 exabyte (EB) 10 21 2 70 zettabyte (ZB) 10 24 2 80 yottabyte (YB) Data is growing
Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing
Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing
Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing
Streaming Data Big Data & Real Time
Big Data McKinsey Global Institute (MGI) Report on Big Data, 2011. Big data refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze.
Big Data McKinsey Global Institute (MGI) Report on Big Data, 2011. Big data refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze.
Methodology Sampling and distributed systems
Methodology Paolo Boldi Big Data does not need big machines, it needs big intelligence
Real time analytics We want to analyze what is happening now .
Real time analytics We want to analyze what is happening now .
Time and Memory Number 8 Wire Mentality Time and memory are the resource dimensions of the process.
Time and Memory Time and memory are the resource dimensions of the process.
Algorithms Classification, Regression, Clustering, Frequent Pattern Mining.
Applications ◮ sensor data: industry, cities ◮ telecomm data ◮ social networks: twitter, facebook, yahoo ◮ marketing: sales business Data may come from: humans, sensors, or machines.
Data Streams Big Data & Real Time

Recommend

Frequent Pattern Mining Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Frequent Pattern Mining Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9.

585 views • 44 slides

Clustering Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction

Clustering Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern

260 views • 22 slides

Regression Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction

Regression Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern

862 views • 16 slides

Introduction to data stream querying and mining Georges HEBRAIL Workshop Franco-Brasileiro sobre

Introduction to data stream querying and mining Georges HEBRAIL Workshop Franco-Brasileiro sobre Minerao de Dados Recife, May 5-7, 2009 Preliminaries Now at Google Page 2 G.HEBRAIL May 5th, 2009 Introduction to data stream querying

1.19k views • 86 slides

Distributed Streaming Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Distributed Streaming Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent

529 views • 13 slides

DATA MINING LECTURE 1 Introduction What is data mining? After years of data mining there is

DATA MINING LECTURE 1 Introduction What is data mining? After years of data mining there is still no unique answer to this question. A tentative definition: Data mining is the use of efficient techniques for the analysis of very large

1.28k views • 62 slides

Evaluation Albert Bifet April 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Evaluation Albert Bifet April 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern

394 views • 18 slides

Classification Albert Bifet April 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Classification Albert Bifet April 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent

1.12k views • 34 slides

Ensemble Methods Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Ensemble Methods Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent

696 views • 23 slides

Mining Data Streams (Part 2) Determine which elements of stream have keys in S Obvious

2/19/2010 Each element of data stream is a tuple Given a list of keys S Mining Data Streams (Part 2) Determine which elements of stream have keys in S Obvious solution: hash table But suppose we dont have enough memory to

284 views • 6 slides

Concept Drift Albert Bifet March 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Concept Drift Albert Bifet March 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent

633 views • 26 slides

Introduction What is data mining? to Data Mining: On what kind of data? Data Mining

Introduction Motivation: Why data mining? Introduction What is data mining? to Data Mining: On what kind of data? Data Mining Data mining functionalities Major issues in data mining 2 Motivation: Necessity is

438 views • 14 slides

LECTURE 1: INTRODUCTION TO DATA MINING Dr. Dhaval Patel CSE, IIT-Roorkee What is data mining?

LECTURE 1: INTRODUCTION TO DATA MINING Dr. Dhaval Patel CSE, IIT-Roorkee What is data mining? Data mining is also called knowledge discovery and data mining (KDD) Data mining is extraction of useful patterns from data sources , e.g.,

1.29k views • 50 slides

Data Mining and Exploration Data Mining and Exploration: Introduction Course Introduction Amos

Data Mining and Exploration Data Mining and Exploration: Introduction Course Introduction Amos Storkey, School of Informatics Welcome Administration January 10, 2006 Books (Hand Monilla and Smyth) Mini Project Paper

87 views • 5 slides

Introduction to Web Mining What is Web Mining? Discovering useful information from the

CS 345A Data Mining Lecture 1 Introduction to Web Mining What is Web Mining? Discovering useful information from the World-Wide Web and its usage patterns Web Mining v. Data Mining Structure (or lack of it) Textual information and

744 views • 31 slides

Introduction to Data Mining Methods and Tools by Michael Hahsler Agenda What is Data Mining?

Introduction to Data Mining Methods and Tools by Michael Hahsler Agenda What is Data Mining? Data Mining T asks Relationship to Statistics, Optimization, Machine Learning and AI T ools Data Legal, Privacy and Security

1.02k views • 69 slides

Data Mining: Concepts and Techniques Chap 8. Data Streams, Time Series Data, and Sequential

Data Mining: Concepts and Techniques Chap 8. Data Streams, Time Series Data, and Sequential Patterns Li Xiong Slides credits: Jiawei Han and Micheline Kamber and others 1 March 27, 2008 Data Mining: Concepts and Techniques Mining Stream,

1k views • 74 slides

DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data

DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data mining is the use of efficient techniques for the analysis of very large collections of data and the extraction of useful and possibly unexpected

2.4k views • 94 slides

Course Content Principles of Knowledge Introduction to Data Mining Discovery in Data

Course Content Principles of Knowledge Introduction to Data Mining Discovery in Data Data warehousing and OLAP Data cleaning Fall 2004 Data mining operations Chapter 9: Web Mining Data summarization

582 views • 30 slides

Web Mining Web Mining Web Mining Web Mining Web mining is the use of data mining techniques

What is Web Mining? Wh t i W b Mi i What is Web Mining? Wh t i W b Mi i ? ? Web Mining Web Mining Web Mining Web Mining Web mining is the use of data mining techniques to automat cally d scover and extract nformat on automatically

774 views • 20 slides

P ( X | Y ) P ( Y ) P ( Y | X ) P ( X ) Introduction to Data Mining, 2 nd

Data Mining Classification: Alternative Techniques Bayesian Classifiers Introduction to Data Mining, 2 nd Edition by Tan, Steinbach, Karpatne, Kumar 1 Bayes Classifier A probabilistic framework for solving classification

169 views • 13 slides

Data Stream Mining Albert Bifet @abifet Dagstuhl, 31 October 2017 Projects MOA (University

Data Stream Mining Albert Bifet @abifet Dagstuhl, 31 October 2017 Projects MOA (University of Waikato) (10.000 downloads/year, 50 contributors) Apache SAMOA (Yahoo Labs) 2 Data Set Classifier Algorithm builds Model Model Analytic

437 views • 14 slides

Web Mining Web Mining Web mining is the use of data mining techniques to automatically

What is Web Mining? What is Web Mining? Web Mining Web Mining Web mining is the use of data mining techniques to automatically discover and extract information from Web documents/services (Etzioni, 1996, CACM 39(11)) Web mining aims to

566 views • 22 slides

Web Mining Andreas Andersson Gustav Strmberg Sandra Stendahl Introduction Web mining o

2011-11-30 Web Mining Andreas Andersson Gustav Strmberg Sandra Stendahl Introduction Web mining o Structure mining o Content mining o Usage mining Web usage mining o Acquire the data o Preprocess the data o Detect patterns in the data o

84 views • 5 slides