comparing more than two observations
play

Comparing More than Two Observations Dmitriy Gorenshteyn Sr. Data - PowerPoint PPT Presentation

Nov 04, 2022 •155 likes •764 views

DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Comparing More than Two Observations Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center DataCamp Cluster Analysis in R The Closest Observation to a Pair Is 2

  1. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Comparing More than Two Observations Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  2. DataCamp Cluster Analysis in R The Closest Observation to a Pair Is 2 is closest to group 1,4? 1 2 3 2 11.7 Is 3 is closest to group 1,4? 3 16.8 18.0 4 10.0 20.6 15.8

  3. DataCamp Cluster Analysis in R Linkage Criteria: Complete Is 2 is closest to group 1,4? 1 2 3 2 11.7 max(D(2,1), D(2,4)) = 20.6 3 16.8 18.0 Is 3 is closest to group 1,4? 4 10.0 20.6 15.8 max(D(3,1), D(3,4)) = 16.8

  4. DataCamp Cluster Analysis in R Hierarchical Clustering Complete Linkage : maximum distance between two sets

  5. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  6. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  7. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  8. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  9. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  10. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  11. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  12. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  13. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  14. DataCamp Cluster Analysis in R Grouping With Linkage & Distance

  15. DataCamp Cluster Analysis in R Linkage Criteria Complete Linkage : maximum distance between two sets Single Linkage : minimum distance between two sets Average Linkage : average distance between two sets

  16. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  17. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Capturing K Clusters Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  18. DataCamp Cluster Analysis in R

  19. DataCamp Cluster Analysis in R

  20. DataCamp Cluster Analysis in R

  21. DataCamp Cluster Analysis in R

  22. DataCamp Cluster Analysis in R

  23. DataCamp Cluster Analysis in R

  24. DataCamp Cluster Analysis in R

  25. DataCamp Cluster Analysis in R

  26. DataCamp Cluster Analysis in R

  27. DataCamp Cluster Analysis in R

  28. DataCamp Cluster Analysis in R

  29. DataCamp Cluster Analysis in R Hierarchical Clustering in R print(players) x y <dbl> <dbl> 1 -1 1 2 -2 -3 3 8 6 4 7 -8 5 -12 8 6 -15 0 dist_players <- dist(players, method = 'euclidean') hc_players <- hclust(dist_players, method = 'complete')

  30. DataCamp Cluster Analysis in R Extracting K Clusters cluster_assignments <- cutree(hc_players, k = 2) print(cluster_assignments) [1] 1 1 1 1 2 2 library(dplyr) players_clustered <- mutate(players, cluster = cluster_assignments) print(players_clustered) x y cluster <dbl> <dbl> <int> 1 -1 1 1 2 -2 -3 1 3 8 6 1 4 7 -8 1 5 -12 8 2 6 -15 0 2

  31. DataCamp Cluster Analysis in R Visualizing K-Clusters library(ggplot2) ggplot(players_clustered, aes(x = x, y = y, color = factor(cluster))) + geom_point()

  32. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  33. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Visualizing the Dendrogram Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  34. DataCamp Cluster Analysis in R Building the Dendrogram

  35. DataCamp Cluster Analysis in R Building the Dendrogram

  36. DataCamp Cluster Analysis in R Building the Dendrogram

  37. DataCamp Cluster Analysis in R Building the Dendrogram

  38. DataCamp Cluster Analysis in R Building the Dendrogram

  39. DataCamp Cluster Analysis in R Building the Dendrogram

  40. DataCamp Cluster Analysis in R Building the Dendrogram

  41. DataCamp Cluster Analysis in R Building the Dendrogram

  42. DataCamp Cluster Analysis in R Building the Dendrogram

  43. DataCamp Cluster Analysis in R Plotting the Dendrogram plot(hc_players)

  44. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  45. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Cutting the Tree Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  46. DataCamp Cluster Analysis in R

  47. DataCamp Cluster Analysis in R

  48. DataCamp Cluster Analysis in R

  49. DataCamp Cluster Analysis in R Coloring the Dendrogram - Height library(dendextend) dend_players <- as.dendrogram(hc_players) dend_colored <- color_branches(dend_players, h = 15) plot(dend_colored)

  50. DataCamp Cluster Analysis in R Coloring the Dendrogram - Height library(dendextend) dend_players <- as.dendrogram(hc_players) dend_colored <- color_branches(dend_players, h = 15) plot(dend_colored)

  51. DataCamp Cluster Analysis in R Coloring the Dendrogram - Height library(dendextend) dend_players <- as.dendrogram(hc_players) dend_colored <- color_branches(dend_players, h = 10) plot(dend_colored)

  52. DataCamp Cluster Analysis in R Coloring the Dendrogram - K library(dendextend) dend_players <- as.dendrogram(hc_players) dend_colored <- color_branches(dend_players, k = 2) plot(dend_colored)

  53. DataCamp Cluster Analysis in R cutree() using height cluster_assignments <- cutree(hc_players, h = 15) print(cluster_assignments) [1] 1 1 1 1 2 2 library(dplyr) players_clustered <- mutate(players, cluster = cluster_assignments) print(players_clustered) x y cluster <dbl> <dbl> <int> 1 -1 1 1 2 -2 -3 1 3 8 6 1 4 7 -8 1 5 -12 8 2 6 -15 0 2

  54. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  55. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Making Sense of the Clusters Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  56. DataCamp Cluster Analysis in R Wholesale Dataset 45 observations 3 features: Milk Spending Grocery Spending Frozen Food Spending

  57. DataCamp Cluster Analysis in R Wholesale Dataset print(customers_spend) Milk Grocery Frozen 1 11103 12469 902 2 2013 6550 909 3 1897 5234 417 4 1304 3643 3045 5 3199 6986 1455 ... ... ... ...

  58. DataCamp Cluster Analysis in R Exploring More Than 2 Dimensions Plot 2 dimensions at a time Visualize using PCA Summary statistics by feature

  59. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Segment the Customers

Recommend

Comparing Several Samples We are often interested in comparing measurements made under more than

Comparing Several Samples We are often interested in comparing measurements made under more than

ST 380 Probability and Statistics for the Physical Sciences Comparing Several Samples We are often interested in comparing measurements made under more than two different sets of conditions. Examples Strengths of concrete beams manufactured

436 views • 15 slides
Comparing Two Samples We are often interested in comparing measurements made under two different

Comparing Two Samples We are often interested in comparing measurements made under two different

ST 380 Probability and Statistics for the Physical Sciences Comparing Two Samples We are often interested in comparing measurements made under two different sets of conditions. Examples Water quality measurements below an effluent outfall,

384 views • 22 slides
Business Statistics CONTENTS Comparing two samples Comparing two unrelated samples Comparing

Business Statistics CONTENTS Comparing two samples Comparing two unrelated samples Comparing

TWO S OR MEDIANS: COMPARISONS Business Statistics CONTENTS Comparing two samples Comparing two unrelated samples Comparing the means of two unrelated samples Comparing the medians of two unrelated samples Old exam question Further study

397 views • 38 slides
) n k = x b 1 k L r ( ) ( ) Assumption: vi vi with

) n k = x b 1 k L r ( ) ( ) Assumption: vi vi with

Model Equation Comparing Missing Values Handling Algorithms Observations: v = 1... n in the Context of the Rasch Model Items: i = 1... k Rainer W. Alexandrowicz ( ) ( ) x x ( ) e vi vi v i = = p x

92 views • 5 slides
Business Statistics CONTENTS Comparing two s Comparing more than two s Analysis of

Business Statistics CONTENTS Comparing two s Comparing more than two s Analysis of

SEVERAL S: COMPARISON Business Statistics CONTENTS Comparing two s Comparing more than two s Analysis of variance Testing significance of ANOVA Performing ANOVA The statistical model Equal variances Old exam question Further

532 views • 30 slides
Climate: What Is It Anyway Comparing Weather and Climate Climate Regions and Biomes Comparing

Climate: What Is It Anyway Comparing Weather and Climate Climate Regions and Biomes Comparing

Climate: What Is It Anyway Comparing Weather and Climate Climate Regions and Biomes Comparing Weather and Climate Directions 1. Watch the National Geographic Video Weather and Climate 2. In your lab book, construct a Venn Diagram comparing

50 views • 3 slides
Early CI and CO early results from Nanten2 towards Carina Photo: G. Wong Introduction

Early CI and CO early results from Nanten2 towards Carina Photo: G. Wong Introduction

Early CI and CO early results from Nanten2 towards Carina Photo: G. Wong Introduction Carina What is it? Why are we observing it? Observations done towards the region Comparing Spectra to previous observations The

286 views • 18 slides
Outline Comparing Infancy Narratives (Matthew &amp; Luke) Comparing the Structure of the

Outline Comparing Infancy Narratives (Matthew &amp; Luke) Comparing the Structure of the

11/13/17 Class 8a The Stories of Jesus in Luke Outline Comparing Infancy Narratives (Matthew &amp; Luke) Comparing the Structure of the Synoptics (Handout) Parables Introduction 3 parables in Luke 15 The Saint

501 views • 5 slides
Surface Observations We now look at some hourly surface observations to study the frontal

Surface Observations We now look at some hourly surface observations to study the frontal

Surface Observations We now look at some hourly surface observations to study the frontal passages which occurred in association with the November 10, 1998 storm. Time-traces of pressure, surface wind, temperature and dew- point, together with

412 views • 20 slides
1 Relational Operators Example Used to compare the values of two expressions If int

1 Relational Operators Example Used to compare the values of two expressions If int

Topics Forming Conditions if/else Statements Chapter 5 Comparing Floating-Point Numbers Comparing Objects The equals Method

217 views • 9 slides
Use of observations in data assimilation Grald Desroziers Mto-France, Toulouse, France

Use of observations in data assimilation Grald Desroziers Mto-France, Toulouse, France

Use of observations in data assimilation Grald Desroziers Mto-France, Toulouse, France Outline Introduction Optimizing observation error statistics Ensembles based on a perturbation of observations Impact of observations

318 views • 13 slides
OBSERVATIONS OF GRBs IN VERY HIGH ENERGY REGIME OBSERVATIONS OF GRBs IN VERY HIGH ENERGY REGIME

OBSERVATIONS OF GRBs IN VERY HIGH ENERGY REGIME OBSERVATIONS OF GRBs IN VERY HIGH ENERGY REGIME

OBSERVATIONS OF GRBs IN VERY HIGH ENERGY REGIME OBSERVATIONS OF GRBs IN VERY HIGH ENERGY REGIME Alessandro Carosi INAF/ASI Science Data Center &amp; University of Siena title FENOMENOLOGY OF GRB: Disovered in 1973 by Vela satellites: 12 GRB in

497 views • 33 slides
Roadmap for Section B A Brief History of Windows and Linux Comparing the Windows and Linux kernel

Roadmap for Section B A Brief History of Windows and Linux Comparing the Windows and Linux kernel

Unit OS B: Comparing the Linux and Windows Kernels Windows Operating System Internals - by David A. Solomon and Mark E. Russinovich with Andreas Polze Roadmap for Section B A Brief History of Windows and Linux Comparing the Windows and Linux

430 views • 25 slides
Recent Highlights from AGN Observations with Fermi-LAT Observations with Fermi-LAT

Recent Highlights from AGN Observations with Fermi-LAT Observations with Fermi-LAT

Sep.12, 2009 JSPS meeting @Konan Univ. JSPS meet ng @Konan Un v. Recent Highlights from AGN Observations with Fermi-LAT Observations with Fermi-LAT Jun KATAOKA (/) on

658 views • 24 slides
Comparing Problems Remember the concepts of Problem, Algorithm, and Program. Weve gotten

Comparing Problems Remember the concepts of Problem, Algorithm, and Program. Weve gotten

Comparing Problems Remember the concepts of Problem, Algorithm, and Program. Weve gotten pretty good at comparing algorithms. How do we compare problems? Sorted Array Search Sorting Integer Factorization Integer Multiplication Selection

449 views • 14 slides
Comparing the Effectiveness of Testing Techniques a paper by Elaine J. Weyuker presented by

Comparing the Effectiveness of Testing Techniques a paper by Elaine J. Weyuker presented by

Comparison relations Probabilistic measures Limitations Empirical comparison Conclusions Comparing the Effectiveness of Testing Techniques a paper by Elaine J. Weyuker presented by Matthias Kegele June 8, 2011 Comparing the Effectiveness

474 views • 25 slides
Lecture 5: ANOVA and Correlation Ani Manichaikul amanicha@jhsph.edu 23 April 2007 1 / 62

Lecture 5: ANOVA and Correlation Ani Manichaikul amanicha@jhsph.edu 23 April 2007 1 / 62

Lecture 5: ANOVA and Correlation Ani Manichaikul amanicha@jhsph.edu 23 April 2007 1 / 62 Comparing Multiple Groups Continous data: comparing means Analysis of variance Binary data: comparing proportions Pearsons Chi-square tests for r

920 views • 62 slides
Comparing Different Projection Operators in the Cylindrical Algebraic Decomposition for SMT

Comparing Different Projection Operators in the Cylindrical Algebraic Decomposition for SMT

Comparing Different Projection Operators in the CAD for SMT Solving Comparing Different Projection Operators in the Cylindrical Algebraic Decomposition for SMT Solving Tarik Viehmann, Gereon Kremer , Erika brahm SC 2 Workshop July 29th Tarik

848 views • 70 slides
Comparing TensorFlow 2.0 with PyTorch and PyTorch JIT Tim Lazarus 29 November, 2019 Comparing

Comparing TensorFlow 2.0 with PyTorch and PyTorch JIT Tim Lazarus 29 November, 2019 Comparing

Comparing TensorFlow 2.0 with PyTorch and PyTorch JIT Tim Lazarus 29 November, 2019 Comparing TensorFlow 2.0 with PyTorch and PyTorch JIT Tim Lazarus 29 November, 2019 Static Computation Graphs In a static execution model , we define the

2.1k views • 14 slides
Wrap-up Whats the output? What we heard Observations DNT and Policy

Wrap-up Whats the output? What we heard Observations DNT and Policy

Wrap-up Whats the output? What we heard Observations DNT and Policy and Beyond Observations EU cookie directive, legal aspects of behavioral targeting user studies: attitudes, usability, what do

297 views • 8 slides
CONSULTANT TEAM PRESENTATION ON PA SEPT 14 REVISED PLAN September 27, 2018 AGENDA

CONSULTANT TEAM PRESENTATION ON PA SEPT 14 REVISED PLAN September 27, 2018 AGENDA

CONSULTANT TEAM PRESENTATION ON PA SEPT 14 REVISED PLAN September 27, 2018 AGENDA Introduction High level Plan metrics Cross-Cutting Observations C&amp;I Observations Residential Observations Low Income Observations

909 views • 31 slides
SURFACE, CLIMATE AND UPPER-AIR OBSERVATIONS &amp; TRAINING OBSERVATIONS &amp; TRAINING SYSTEM

SURFACE, CLIMATE AND UPPER-AIR OBSERVATIONS &amp; TRAINING OBSERVATIONS &amp; TRAINING SYSTEM

SURFACE, CLIMATE AND UPPER-AIR OBSERVATIONS &amp; TRAINING OBSERVATIONS &amp; TRAINING SYSTEM IN PAKISTAN MUHAMMAD TOUSEEF ALAM Director Pakistan Meteorological Department http://www.pakmet.com.pk http://www.pakmet.com.pk E mail :

651 views • 41 slides
CSE 331 Comparing objects; Comparable , compareTo , and Comparator slides created by Marty Stepp

CSE 331 Comparing objects; Comparable , compareTo , and Comparator slides created by Marty Stepp

CSE 331 Comparing objects; Comparable , compareTo , and Comparator slides created by Marty Stepp based on materials by M. Ernst, S. Reges, D. Notkin, R. Mercer, 1 Comparing objects Operators like &lt; and &gt; do not work with objects in

434 views • 15 slides
http://cs224w.stanford.edu Observations Observations Models Models Algorithms Algorithms

http://cs224w.stanford.edu Observations Observations Models Models Algorithms Algorithms

CS224W: Social and Information Network Analysis Jure Leskovec, Stanford University http://cs224w.stanford.edu Observations Observations Models Models Algorithms Algorithms Small diameter, Small diameter, Erds Renyi model, Decentralized

735 views • 39 slides

More recommend