big data and classification
play

Big Data and Classification Paul Balas Content Architect - PowerPoint PPT Presentation

Mar 15, 2024 •380 likes •601 views

Big Data and Classification Paul Balas Content Architect 303Computing A Dystopian Future George Orwell feared those who would deprive us of information. He feared the truth would be concealed from us. He never imagined Big Data A glut

  1. Big Data and Classification Paul Balas Content Architect 303Computing

  2. A Dystopian Future George Orwell feared those who would deprive us of information. He feared the truth would be concealed from us.

  3. He never imagined “Big Data” A glut of information that would conceal understanding

  4. In 9.5 minutes or less… Convince you that without classification BIG DATA FAILS

  6. Methods for Classification Data Mining Classification Taxonomies Machine-driven Human-driven

  7. Classification Helps! • Group information by common attributes • Easily compare similarities and differences

  8. People Classify Not Machines Not Algorithms All classification is done by humans at some point in the life of a datum

  9. Without Classification, finding information is like finding a needle in a haystack…

  10. Or, mistaking the haystack for a pile of needles

  11. With Big Data, the haystack is huge

  12. People don’t always agree Super Bowl XL Scott Steinmann

  13. A Quiz for you… On the next slide, I want you to tell me what these four types of data have in common Raise your hand when you get the answer… (don’t worry, I won’t call on anyone)

  14. “A computer would deserve to be called intelligent if it could deceive a human into believing that it was human.”

  15. Did you get it right? Alan Turing The more data types we have The harder the classification

  16. Classification Cracked The Enigma Code 158,962,555,217,826,360,000 possibilities Turing used Classification of the data to narrow the problem set 1 st A letter can never be itself 2 nd Known Phrases - The weather report

  17. Without Classification There is no Correlation Without Correlation We are all out of jobs!

  18. The ‘Classification Food Chain’ Classification shapes data Shaped data enables data quality Data Quality delivers confidence in results

  19. Bad Classification Has Bad Consequences Elections are won Shuttles explode Financial Markets Meltdown

  20. If you want to be confident in your Big Data results… Invest in your classifications as they are critical to your success!

  21. Thank You! Paul Balas 303computing@gmail.com

Recommend

Data Classification Data Classification While not (explicitly) on the CCNA Security (640-553

Data Classification Data Classification While not (explicitly) on the CCNA Security (640-553

Data Classification Data Classification While not (explicitly) on the CCNA Security (640-553 IINS) blueprint, all of the Cisco Press books for the CCNA Security exam that I reviewed included data classification (specifically US data

255 views • 9 slides
(a) Quantitative classification (b) Qualitative classification (c) Area classification (d) Simple

(a) Quantitative classification (b) Qualitative classification (c) Area classification (d) Simple

MCQS OF PRESENTATION OF DATA MCQ No 2.1: When data are classified according to a single characteristic, it is called: (a) Quantitative classification (b) Qualitative classification (c) Area classification (d) Simple classification MCQ No 2.2:

536 views • 9 slides
Automatic Classification of Automatic Classification of Audio Data Audio Data Carlos H. C.

Automatic Classification of Automatic Classification of Audio Data Audio Data Carlos H. C.

Automatic Classification of Automatic Classification of Audio Data Audio Data Carlos H. C. Lopes, Jaime D. Valle Jr. & Alessandro L. Koerich IEEE International Conference on Systems, Man and Cybernetics The Hague, The Netherlands October

1.17k views • 24 slides
CS145: INTRODUCTION TO DATA MINING 08: Classification Evaluation and Practical Issues

CS145: INTRODUCTION TO DATA MINING 08: Classification Evaluation and Practical Issues

CS145: INTRODUCTION TO DATA MINING 08: Classification Evaluation and Practical Issues Instructor: Yizhou Sun yzsun@cs.ucla.edu October 24, 2017 Learnt Prediction and Classification Methods Vector Data Set Data Sequence Data Text Data

635 views • 24 slides
CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 1 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 1 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 1 Instructor: Yizhou Sun yzsun@ccs.neu.edu September 14, 2014 Matrix Data: Classification: Part 1 Classification: Basic Concepts Decision Tree Induction Model

904 views • 44 slides
CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 1 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 1 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 1 Instructor: Yizhou Sun yzsun@ccs.neu.edu September 16, 2013 Matrix Data: Classification: Part 1 Classification: Basic Concepts Decision Tree Induction Model

779 views • 48 slides
CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 3 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 3 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 3 Instructor: Yizhou Sun yzsun@ccs.neu.edu September 28, 2014 Methods to Learn Matrix Data Set Data Sequence Time Series Graph & Data Network Classification Decision

858 views • 70 slides
DATA MINING LECTURE 10 Classification Nearest Neighbor Classification Support Vector Machines

DATA MINING LECTURE 10 Classification Nearest Neighbor Classification Support Vector Machines

DATA MINING LECTURE 10 Classification Nearest Neighbor Classification Support Vector Machines Logistic Regression Nave Bayes Classifier Supervised Learning Illustrating Classification Task Learning Tid Attrib1 Attrib2 Attrib3 Class

954 views • 79 slides
DATA MINING LECTURE 11 Classification Nearest Neighbor Classification Support Vector Machines

DATA MINING LECTURE 11 Classification Nearest Neighbor Classification Support Vector Machines

DATA MINING LECTURE 11 Classification Nearest Neighbor Classification Support Vector Machines Logistic Regression Nave Bayes Classifier Supervised Learning Illustrating Classification Task Learning Tid Attrib1 Attrib2 Attrib3 Class

1.03k views • 75 slides
Support Vector Machines for Classification of Flow Data Classification of Flow Data Funded by

Support Vector Machines for Classification of Flow Data Classification of Flow Data Funded by

Support Vector Machines for Classification of Flow Data Classification of Flow Data Funded by SBIR Grant # R43 RR024094-01A1 FlowCap 2010 p John Quinn Ph.D. Treestar john@treestar.com Our Objective Our Objective Demonstrate that

312 views • 18 slides
Classification Comparisons Math 3220 Data Mining Methods Angelo Parker Overview

Classification Comparisons Math 3220 Data Mining Methods Angelo Parker Overview

Classification Comparisons Math 3220 Data Mining Methods Angelo Parker Overview Classification C5.0 Rpart SVM The example datasets Classification comparisons Classification The method of taking data and breaking it

318 views • 18 slides
Classification and feat u re engineering MAC H IN E L E AR N IN G FOR TIME SE R IE S DATA IN

Classification and feat u re engineering MAC H IN E L E AR N IN G FOR TIME SE R IE S DATA IN

Classification and feat u re engineering MAC H IN E L E AR N IN G FOR TIME SE R IE S DATA IN P YTH ON Chris Holdgraf Fello w, Berkele y Instit u te for Data Science Al w a y s v is u ali z e ra w data before fitting models MACHINE LEARNING

579 views • 37 slides
Classification from Pairwise Similarity and Unlabeled Data Han Bao 1,2 , Gang Niu 2 , Masashi

Classification from Pairwise Similarity and Unlabeled Data Han Bao 1,2 , Gang Niu 2 , Masashi

Classification from Pairwise Similarity and Unlabeled Data Han Bao 1,2 , Gang Niu 2 , Masashi Sugiyama 2,1 1 The University of Tokyo, Japan / 2 RIKEN, Japan July 13 th , 2018 Gentle Start: Binary Classification 2 Boundary Training data

264 views • 13 slides
Learning From Data Lecture 8 Linear Classification and Regression Linear Classification Linear

Learning From Data Lecture 8 Linear Classification and Regression Linear Classification Linear

Learning From Data Lecture 8 Linear Classification and Regression Linear Classification Linear Regression M. Magdon-Ismail CSCI 4100/6100 recap: Approximation Versus Generalization VC Analysis Bias-Variance Analysis E out E in + ( d

390 views • 23 slides
P ( X | Y ) P ( Y ) P ( Y | X ) P ( X ) Introduction to Data Mining, 2 nd

P ( X | Y ) P ( Y ) P ( Y | X ) P ( X ) Introduction to Data Mining, 2 nd

Data Mining Classification: Alternative Techniques Bayesian Classifiers Introduction to Data Mining, 2 nd Edition by Tan, Steinbach, Karpatne, Kumar 1 Bayes Classifier A probabilistic framework for solving classification

169 views • 13 slides
CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 2 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 2 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 2 Instructor: Yizhou Sun yzsun@ccs.neu.edu September 27, 2015 Methods to Learn Matrix Data Text Set Data Sequence Time Series Graph & Images Data Data Network

551 views • 38 slides
CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 2 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 2 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Matrix Data: Classification: Part 2 Instructor: Yizhou Sun yzsun@ccs.neu.edu October 1, 2013 Matrix Data: Classification: Part 2 Bayesian Learning Nave Bayes Bayesian Belief Network Logistic

850 views • 37 slides
CS6220: DATA MINING TECHNIQUES Image Data: Classification via Neural Networks Instructor: Yizhou

CS6220: DATA MINING TECHNIQUES Image Data: Classification via Neural Networks Instructor: Yizhou

CS6220: DATA MINING TECHNIQUES Image Data: Classification via Neural Networks Instructor: Yizhou Sun yzsun@ccs.neu.edu November 19, 2015 Methods to Learn Matrix Data Text Set Data Sequence Time Series Graph & Images Data Data

310 views • 28 slides
15-388/688 - Practical Data Science: Linear classification J. Zico Kolter Carnegie Mellon

15-388/688 - Practical Data Science: Linear classification J. Zico Kolter Carnegie Mellon

15-388/688 - Practical Data Science: Linear classification J. Zico Kolter Carnegie Mellon University Fall 2019 1 Outline Example: classifying tumors Classification in machine learning Example classification algorithms Libraries for machine

629 views • 27 slides
Deconstructing Data Science David Bamman, UC Berkeley Info 290 Lecture 3: Classification

Deconstructing Data Science David Bamman, UC Berkeley Info 290 Lecture 3: Classification

Deconstructing Data Science David Bamman, UC Berkeley Info 290 Lecture 3: Classification overview Jan 27, 2016 Classification A mapping h from input data x (drawn from instance space ) to a label (or labels) y from some

680 views • 33 slides
1 Classification Recap We have already seen a popular way of making a classification decision

1 Classification Recap We have already seen a popular way of making a classification decision

CS109A/STAT121A/APCOMP209a: Introduction to Data Science Advanced Section 6: Topics in Supervised Classification Instructors: Pavlos Protopapas, Kevin Rader Nick Hoernle Section Times nhoernle@g.harvard.edu Wed 3-4pm & Wed 5:30-6:30 &

572 views • 7 slides
Machine Learning Classification over Encrypted Data Raphael Bost, Raluca Ada Popa, Stephen Tu,

Machine Learning Classification over Encrypted Data Raphael Bost, Raluca Ada Popa, Stephen Tu,

Machine Learning Classification over Encrypted Data Raphael Bost, Raluca Ada Popa, Stephen Tu, Shafi Goldwasser Classification (Machine Learning) Supervised learning (training) Classification data classification training model

1.29k views • 54 slides
Introduction to Big Data and Machine Learning Classification Dr. Mihail September 19, 2019 (Dr.

Introduction to Big Data and Machine Learning Classification Dr. Mihail September 19, 2019 (Dr.

Introduction to Big Data and Machine Learning Classification Dr. Mihail September 19, 2019 (Dr. Mihail) Intro Big Data September 19, 2019 1 / 3 Linear models for classification Goal Goal of classification: take an input vector x and assign

511 views • 17 slides
CS6220: DATA MINING TECHNIQUES Chapter 8&9: Classification: Part 4 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Chapter 8&9: Classification: Part 4 Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Chapter 8&9: Classification: Part 4 Instructor: Yizhou Sun yzsun@ccs.neu.edu March 18, 2013 Chapter 8&9. Classification: Part 4 Frequent Pattern-based Classification Ensemble Methods Other

593 views • 35 slides

More recommend