e x ploring n u merical data
play

E x ploring n u merical data E XP L OR ATOR Y DATA AN ALYSIS IN R - PowerPoint PPT Presentation

Sep 26, 2023 •115 likes •621 views

E x ploring n u merical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College Cars dataset str(cars) Classes tbl_df, tbl and 'data.frame': 428 obs. of 19 variables: $ name : chr

  1. E x ploring n u merical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College

  2. Cars dataset str(cars) Classes ‘tbl_df’, ‘tbl’ and 'data.frame': 428 obs. of 19 variables: $ name : chr "Chevrolet Aveo 4dr" "Chevrolet Aveo LS 4dr hatch" ... $ sports_car : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ suv : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ wagon : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ minivan : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ pickup : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ all_wheel : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ rear_wheel : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ msrp : int 11690 12585 14610 14810 16385 13670 15040 13270 ... $ dealer_cost: int 10965 11802 13697 13884 15357 12849 14086 12482 ... $ eng_size : num 1.6 1.6 2.2 2.2 2.2 2 2 2 2 2 ... $ ncyl : int 4 4 4 4 4 4 4 4 4 4 ... $ horsepwr : int 103 103 140 140 140 132 132 130 110 130 ... $ city_mpg : int 28 28 26 26 26 29 29 26 27 26 ... $ hwy_mpg : int 34 34 37 37 37 36 36 33 36 33 ... $ weight : int 2370 2348 2617 2676 2617 2581 2626 2612 2606 ... $ wheel_base : int 98 98 104 104 104 105 105 103 103 103 ... $ length : int 167 153 183 183 183 174 174 168 168 168 ... $ width : int 66 66 69 68 69 67 67 67 67 67 ... EXPLORATORY DATA ANALYSIS IN R

  3. Dotplot ggplot(data, aes(x = weight)) + geom_dotplot(dotsize = 0.4) EXPLORATORY DATA ANALYSIS IN R

  4. Histogram ggplot(data, aes(x = weight)) + geom_histogram() EXPLORATORY DATA ANALYSIS IN R

  5. Densit y plot ggplot(data, aes(x = weight)) + geom_density() EXPLORATORY DATA ANALYSIS IN R

  6. Densit y plot ggplot(data, aes(x = weight)) + geom_density() EXPLORATORY DATA ANALYSIS IN R

  7. Densit y plot ggplot(data, aes(x = weight)) + geom_density() EXPLORATORY DATA ANALYSIS IN R

  8. Bo x plot ggplot(data, aes(x = 1, y = weight)) + geom_boxplot() + coord_flip() EXPLORATORY DATA ANALYSIS IN R

  9. Bo x plot ggplot(data, aes(x = 1, y = weight)) + geom_boxplot() + coord_flip() EXPLORATORY DATA ANALYSIS IN R

  10. Bo x plot ggplot(data, aes(x = 1, y = weight)) + geom_boxplot() + coord_flip() EXPLORATORY DATA ANALYSIS IN R

  11. Bo x plot ggplot(data, aes(x = 1, y = weight)) + geom_boxplot() + coord_flip() EXPLORATORY DATA ANALYSIS IN R

  12. Faceted histogram ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() + facet_wrap(~pickup) `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  13. Faceted histogram ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() + facet_wrap(~pickup) `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  14. Faceted histogram ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() + facet_wrap(~pickup) `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  15. Let ' s practice ! E XP L OR ATOR Y DATA AN ALYSIS IN R

  16. Distrib u tion of one v ariable E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College

  17. Marginal v s . conditional ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  18. Marginal v s . conditional ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() + facet_wrap(~pickup) `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  19. B u ilding a data pipeline cars2 <- cars %>% filter(eng_size < 2.0) ggplot(cars2, aes(x = hwy_mpg)) + geom_histogram() EXPLORATORY DATA ANALYSIS IN R

  20. B u ilding a data pipeline cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_histogram() EXPLORATORY DATA ANALYSIS IN R

  21. Filtered and faceted histogram cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_histogram() `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. EXPLORATORY DATA ANALYSIS IN R

  22. Wide bin w idth cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_histogram(binwidth = 5) EXPLORATORY DATA ANALYSIS IN R

  23. Densit y plot cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_density() EXPLORATORY DATA ANALYSIS IN R

  24. Wide band w idth cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_density(bw = 5) EXPLORATORY DATA ANALYSIS IN R

  25. Let ' s practice ! E XP L OR ATOR Y DATA AN ALYSIS IN R

  26. Bo x plots E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College

  27. EXPLORATORY DATA ANALYSIS IN R

  28. EXPLORATORY DATA ANALYSIS IN R

  29. EXPLORATORY DATA ANALYSIS IN R

  30. EXPLORATORY DATA ANALYSIS IN R

  31. EXPLORATORY DATA ANALYSIS IN R

  32. EXPLORATORY DATA ANALYSIS IN R

  33. EXPLORATORY DATA ANALYSIS IN R

  34. EXPLORATORY DATA ANALYSIS IN R

  35. EXPLORATORY DATA ANALYSIS IN R

  36. EXPLORATORY DATA ANALYSIS IN R

  37. EXPLORATORY DATA ANALYSIS IN R

  38. EXPLORATORY DATA ANALYSIS IN R

  39. Side - b y- side bo x plots ggplot(common_cyl, aes(x = as.factor(ncyl), y = city_mpg)) + geom_boxplot() Warning message: Removed 11 rows containing non-finite values (stat_boxplot). EXPLORATORY DATA ANALYSIS IN R

  40. Side - b y- side bo x plots ggplot(common_cyl, aes(x = as.factor(ncyl), y = city_mpg)) + geom_boxplot() Warning message: Removed 11 rows containing non-finite values (stat_boxplot). EXPLORATORY DATA ANALYSIS IN R

  41. Side - b y- side bo x plots ggplot(common_cyl, aes(x = as.factor(ncyl), y = city_mpg)) + geom_boxplot() Warning message: Removed 11 rows containing non-finite values (stat_boxplot). EXPLORATORY DATA ANALYSIS IN R

  42. EXPLORATORY DATA ANALYSIS IN R

  43. EXPLORATORY DATA ANALYSIS IN R

  44. Let ' s practice ! E XP L OR ATOR Y DATA AN ALYSIS IN R

  45. Vis u ali z ation in higher dimensions E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College

  46. Plots for 3 v ariables ggplot(cars, aes(x = msrp)) + geom_density() + facet_grid(pickup ~ rear_wheel) EXPLORATORY DATA ANALYSIS IN R

  47. Plots for 3 v ariables ggplot(cars, aes(x = msrp)) + geom_density() + facet_grid(pickup ~ rear_wheel, labeller = label_both) EXPLORATORY DATA ANALYSIS IN R

  48. Plots for 3 v ariables ggplot(cars, aes(x = msrp)) + geom_density() + facet_grid(pickup ~ rear_wheel, labeller = label_both) table(cars$rear_wheel, cars$pickup) FALSE TRUE FALSE 306 12 TRUE 98 12 EXPLORATORY DATA ANALYSIS IN R

  49. Higher dimensional plots Shape Si z e Color Pa � ern Mo v ement x- coordinate y- coordinate EXPLORATORY DATA ANALYSIS IN R

  50. Let ' s practice ! E XP L OR ATOR Y DATA AN ALYSIS IN R

Recommend

Linking t w o charts IN TE R ME D IATE IN TE R AC TIVE DATA VISU AL IZATION W ITH P L OTLY IN

Linking t w o charts IN TE R ME D IATE IN TE R AC TIVE DATA VISU AL IZATION W ITH P L OTLY IN

Linking t w o charts IN TE R ME D IATE IN TE R AC TIVE DATA VISU AL IZATION W ITH P L OTLY IN R Adam Lo y Statistician , Carleton College E x ploring cl u sters INTERMEDIATE INTERACTIVE DATA VISUALIZATION WITH PLOTLY IN R E x ploring longit u

596 views • 43 slides
E x ploring relationships E XP L OR ATOR Y DATA AN ALYSIS IN P YTH ON Allen Do w ne y Professor

E x ploring relationships E XP L OR ATOR Y DATA AN ALYSIS IN P YTH ON Allen Do w ne y Professor

E x ploring relationships E XP L OR ATOR Y DATA AN ALYSIS IN P YTH ON Allen Do w ne y Professor , Olin College Height and w eight EXPLORATORY DATA ANALYSIS IN PYTHON Scatter plot brfss = pd.read_hdf('brfss.hdf5', 'brfss') height =

505 views • 38 slides
E x ploring categorical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant

E x ploring categorical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant

E x ploring categorical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College Comics dataset comics # A tibble: 23,272 x 11 name id align &lt;fctr&gt; &lt;fctr&gt; &lt;fctr&gt;

927 views • 33 slides
E x ploring the MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R Federico

E x ploring the MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R Federico

E x ploring the MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R Federico Castanedo Data Scientist at DataRobot Wh y do w e need dimensionalit y red u ction techniq u es ? t - Distrib u ted Stochastic Neighbor Embedding ( t

1.01k views • 28 slides
E x ploring fashion MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R

E x ploring fashion MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R

E x ploring fashion MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R Federico Castanedo Data Scientist at DataRobot What is Fashion MNIST ? 70.000 gra y scale images of 10 clothing categories 28x28 pi x els Identical format

586 views • 47 slides
Introd u ction to NLP feat u re engineering FE ATU R E E N G IN E E R IN G FOR N L P IN P YTH

Introd u ction to NLP feat u re engineering FE ATU R E E N G IN E E R IN G FOR N L P IN P YTH

Introd u ction to NLP feat u re engineering FE ATU R E E N G IN E E R IN G FOR N L P IN P YTH ON Ro u nak Banik Data Scientist N u merical data Iris dataset sepal length sepal w idth petal length petal w idth class 6.3 2.9 5.6 1.8 Iris

474 views • 35 slides
Welcome and Introd u ction SU P E R VISE D L E AR N IN G IN R : R E G R E SSION Nina Z u mel and

Welcome and Introd u ction SU P E R VISE D L E AR N IN G IN R : R E G R E SSION Nina Z u mel and

Welcome and Introd u ction SU P E R VISE D L E AR N IN G IN R : R E G R E SSION Nina Z u mel and John Mo u nt Data Scientists , Win Vector LLC What is Regression ? Regression : Predict a n u merical o u tcome (&quot; dependent v ariable &quot;)

588 views • 30 slides
Vis u ali z ing bi v ariate relationships C OR R E L ATION AN D R E G R E SSION IN R Ben Ba u

Vis u ali z ing bi v ariate relationships C OR R E L ATION AN D R E G R E SSION IN R Ben Ba u

Vis u ali z ing bi v ariate relationships C OR R E L ATION AN D R E G R E SSION IN R Ben Ba u mer Assistant Professor at Smith College Bi v ariate relationships Both v ariables are n u merical Response v ariable a . k . a . y, dependent E x

364 views • 25 slides
Creating transcription helper f u nctions SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON

Creating transcription helper f u nctions SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON

Creating transcription helper f u nctions SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON Daniel Bo u rke Machine Learning Engineer / Yo u T u be Creator E x ploring a u dio files # Import os module import os # Check the folder of

816 views • 46 slides
Inc Inclus lusiv ive e educ educatio tion, n, a mea eans ns of im impr proving ving

Inc Inclus lusiv ive e educ educatio tion, n, a mea eans ns of im impr proving ving

Inc Inclus lusiv ive e educ educatio tion, n, a mea eans ns of im impr proving ving educ educatio tional nal ac accoun untability ability: Explo ploring ing the the attitudes titudes of of Ghanaian teachers towards inclusive

382 views • 20 slides
Data Preparation Data cleaning Data integration and transformation (Data

Data Preparation Data cleaning Data integration and transformation (Data

Data Preprocessing Why preprocess the data? Data Preparation Data cleaning Data integration and transformation (Data preprocessing) Data reduction, Feature selection Discretization and concept hierarchy generation 2

891 views • 21 slides
DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data

DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data

DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data mining is the use of efficient techniques for the analysis of very large collections of data and the extraction of useful and possibly unexpected

2.4k views • 94 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 51 / 89 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4

344 views • 17 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 68 / 91 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4 2

729 views • 24 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 68 / 91 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4 2

579 views • 8 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 28 / 89 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4

455 views • 23 slides
Data Preparation Data cleaning Discretization (Data preprocessing) Data

Data Preparation Data cleaning Discretization (Data preprocessing) Data

Data Preprocessing Why preprocess the data? Data Preparation Data cleaning Discretization (Data preprocessing) Data integration and transformation Data reduction, Feature selection 2 Why Prepare Data? Why Prepare

462 views • 15 slides
DATA QUALITY AND DATA DATA QUALITY AND DATA PROGRAMMING PROGRAMMING &quot;Data cleaning and

DATA QUALITY AND DATA DATA QUALITY AND DATA PROGRAMMING PROGRAMMING &quot;Data cleaning and

DATA QUALITY AND DATA DATA QUALITY AND DATA PROGRAMMING PROGRAMMING &quot;Data cleaning and repairing account for about 60% of the work of data scientists.&quot; Christian Kaestner Required reading: Schelter, S., Lange, D., Schmidt, P.,

1.1k views • 86 slides
Data stories with The Pudding So what is data storytelling? Data academia &amp; data science

Data stories with The Pudding So what is data storytelling? Data academia &amp; data science

Data stories with The Pudding So what is data storytelling? Data academia &amp; data science dense complex static/non-interactive often not accompanied by an easy-to-follow narrative Data art beautiful abstract

647 views • 5 slides
Data Acquisition Chapter 2 Data Acquisition 1 st step: get data Usually data gathered by

Data Acquisition Chapter 2 Data Acquisition 1 st step: get data Usually data gathered by

Data Acquisition Chapter 2 Data Acquisition 1 st step: get data Usually data gathered by some geophysical device Most surveys are comprised of linear traverses or transects Typically constant data spacing Perpendicular to

432 views • 12 slides
Data Collection and Aggregation Data Collection and Aggregation 1 Challenges: data Challenges:

Data Collection and Aggregation Data Collection and Aggregation 1 Challenges: data Challenges:

Data Collection and Aggregation Data Collection and Aggregation 1 Challenges: data Challenges: data Data type: numerical sensor readings. Rich and massive data, spatially distributed and correlated. Data dynamics: data

713 views • 48 slides
Business Statistics CONTENTS The role of data The data matrix Data types Aspects of data

Business Statistics CONTENTS The role of data The data matrix Data types Aspects of data

DATA Business Statistics CONTENTS The role of data The data matrix Data types Aspects of data Obtaining data Further study THE ROLE OF DATA Data refers to observed facts there are 82 persons in this train the weight of

683 views • 22 slides
DataCamp Data Types for Data Science DataCamp Data Types for Data Science Data types Data type

DataCamp Data Types for Data Science DataCamp Data Types for Data Science Data types Data type

DataCamp Data Types for Data Science DataCamp Data Types for Data Science Data types Data type system sets the stage for the capabilities of the language Understanding data types empowers you as a data scientist DataCamp Data Types for Data

526 views • 23 slides
q.Datum Data Exchange The marketplace for big data Data is the new oil of the Internet and the

q.Datum Data Exchange The marketplace for big data Data is the new oil of the Internet and the

q.Datum Data Exchange The marketplace for big data Data is the new oil of the Internet and the new currency of the digital world . World Economic Forum 1 Problem: access to big data Data accessed &amp; analyzed Data in organizations

543 views • 30 slides

More recommend