The Modern Analytical Landscape
2 Where We Are Today
3 Data ▸ Explosive growth ▹ Data ▹ 2014 – 566PB/day ▹ 2017 – est 1.5EB/day ▹ 2020 – est 2.5YB/day
4 Data Types ▸ Telemetry – IoT ▸ Formats ▹ JSON/BSON ▹ Audio/Video ▹ CDISC ▹ F004 ▹ ASDF ▹ DMS-MTX
5 Usage ▸ Analytics recognition Finally. ”I keep saying the sexy job in the next ten years will be statisticians.” Hal Varian – Google Chief Economist 2009
6
7
8 Used to be Easier ▸ Minimal Sources ▸ Minimal Data types ▸ Smallish Volume ▸ Couple of Analytic Packages
9
10
11 Used to be Harder ▸ Minimal Sources ▸ Minimal Data types ▸ Smallish Volume ▸ Couple of Analytic Packages ▸ Finding data ▸ Gathering data ▸ Limited data types ▸ Limited Analytic Techniques ▸ Limited Compute Power
12 Current “Trends” Disruptive Technologies
13 Hadoop ▸ “Released” in 2006 building on work done in 2003/4 ▸ Developed for page rank ▸ Distributed File Storage ▸ Map-Reduce on top ▸ Apache Hadoop 1.0 released in 2012
14 Hadoop ▸ Ideal for particular use cases ▸ Not always performant for Analytics
15 Data Science ▸ Gen 1 Data Scientist ▹ Programmer first ▸ Gen 2 Data Scientist ▹ Taught at University ▹ Has stats knowledge ▸ Gen 3 Data Scientist ▹ Workplace experience
16 Data Science ▸ Becoming the new “I.T department” style roadblock ▸ Rapidly becoming a 4 letter word
17 Machine Learning ▸ Trendy term ▸ Highly sought after skills
18 Congra gratul ulation ions y you c can now put ut m mach achin ine le learnin arning o on y n your ur resumes .
19 Deep Learning ▸ Simply a neural network with >1 hidden layer ▸ Frameworks ▹ Tensorflow ▹ Theano ▹ Keras ▹ Caffe ▹ DSSTNE t
20 Deep Learning ▸ May produce superior results ▸ Only way (currently) for some problems ▸ Programming skills ▸ Over complicating things ▸ Loss of explainabilty
21 In Database ▸ Move the work to the data ▸ Database to manipulate the data ▸ SAS and Teradata 10 year partnership ▸ Phenomenal reductions in processing
22 In Memory ▸ SAS leading the way ▸ Visual Analytics/Statistics ▸ HPA procs ▸ Teradata 750 appliance ▸ Viya
23 THANKS! Any questions? You can find me at @pwsegal-ca
Recommend
More recommend
