BigData R EBECCA P ARSONS M ARTIN F OWLER CTO http://martinfowler.com rparsons@thoughtworks.com http://thoughtworks.com http://thoughtworks.com @martinfowler Thursday, March 8, 2012
Big Data R EBECCA P ARSONS M ARTIN F OWLER CTO http://martinfowler.com rparsons@thoughtworks.com http://thoughtworks.com http://thoughtworks.com @martinfowler Thursday, March 8, 2012
The Evolving Panorama of Data R EBECCA P ARSONS M ARTIN F OWLER CTO http://martinfowler.com rparsons@thoughtworks.com http://thoughtworks.com http://thoughtworks.com @martinfowler Thursday, March 8, 2012
Changing Nature of Data Response How we use data now Thursday, March 8, 2012
Changing Nature of Data Response How we use data now Thursday, March 8, 2012
Data is: Thursday, March 8, 2012
Data is: Growing Thursday, March 8, 2012
Data is: Growing Thursday, March 8, 2012
Data is: Growing Walmart : 1 million transactions per hour Facebook : 40 billion photos The Economist: Feb 25th 2010 Thursday, March 8, 2012
640K ought to be enough for anybody Thursday, March 8, 2012
Lots of T raffic Thursday, March 8, 2012
Thursday, March 8, 2012
Thursday, March 8, 2012
Data is: Thursday, March 8, 2012
Data is: Distributed Thursday, March 8, 2012
1,482,824 Data is: Distributed 1,287,537 1,080,872 853,698 616,308 356,191 127,942 40,223 8,640 442 1,990 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 Monthly Contributors to Wikipedia souce: wikipedia Thursday, March 8, 2012
Data is: Distributed Thursday, March 8, 2012
Data is: Distributed ��� � � � Thursday, March 8, 2012
Data is: Distributed 98% of internet access points in Africa are mobile 30 million networked sensor nodes growing 30% per year McKinsey Global Institute: Big data: The next frontier for innovation, competition, and productivity Thursday, March 8, 2012
Data is: Thursday, March 8, 2012
Data is: Valuable Thursday, March 8, 2012
Data is: Valuable $300 billion / year for US health care 60% increase in retail margins McKinsey Global Institute: Big data: The next frontier for innovation, competition, and productivity Thursday, March 8, 2012
Data is: Thursday, March 8, 2012
Data is: Urgent Thursday, March 8, 2012
Data is: Thursday, March 8, 2012
Data is: Connected Thursday, March 8, 2012
Data Silos Thursday, March 8, 2012
App App Enterprise Data Model App App Thursday, March 8, 2012
App App Enterprise Data Model App App Thursday, March 8, 2012
Changing Nature of Data Response How we use data now Thursday, March 8, 2012
Changing Nature of Data Response How we use data now Thursday, March 8, 2012
Thursday, March 8, 2012
SQL SQL Thursday, March 8, 2012
Thursday, March 8, 2012
Bigtable Dynamo Thursday, March 8, 2012
Thursday, March 8, 2012
"NoSQL" Thursday, March 8, 2012
Definition of NoSQL Thursday, March 8, 2012
Characteristics of NoSQL Thursday, March 8, 2012
Characteristics of NoSQL non-relational open-source cluster-friendly 21st Century Web schema-less Thursday, March 8, 2012
Document Column- family Graph Key-value aph Thursday, March 8, 2012
Aggregate Thursday, March 8, 2012
Aggregate Eric Evans Thursday, March 8, 2012
orders ID: 1001 customer: Ann line items: customers 0321293533 2 $48 $96 0321601912 1 $39 $39 order lines 0131495054 1 $51 $51 payment details: Card: Amex CC Number: 12345 expiry: 04/2001 credit cards Thursday, March 8, 2012
ID: 1001 customer: Ann line items: 0321293533 2 $48 $96 Order 0321601912 1 $39 $39 1001 0131495054 1 $51 $51 aggregate payment details: Card: Amex CC Number: 12345 expiry: 04/2001 Thursday, March 8, 2012
ID: 1001 customer: Ann line items: 0321293533 2 $48 $96 Order 0321601912 1 $39 $39 1001 0131495054 1 $51 $51 aggregate payment details: Card: Amex CC Number: 12345 document expiry: 04/2001 key-value column family Thursday, March 8, 2012
Order 1001 Order 1004 Order 1026 Order 2843 Order 1001 Order 1004 Order 1001 Order 1004 Order 1026 Order 3754 Thursday, March 8, 2012
Document Column- family Graph Key-value aph Thursday, March 8, 2012
Document Column- family Graph Key-value aph Thursday, March 8, 2012
aph Thursday, March 8, 2012
aph Thursday, March 8, 2012
aph Thursday, March 8, 2012
P olyglot P ersistence aph Thursday, March 8, 2012
Billing Inventory Thursday, March 8, 2012
Billing Integration Database Inventory Thursday, March 8, 2012
Billing Billing Integration Database Inventory Inventory Thursday, March 8, 2012
Billing Billing Integration Database Application Database Inventory Inventory Thursday, March 8, 2012
Event Sourcing Thursday, March 8, 2012
John Smith : Person :Address city = Portland Thursday, March 8, 2012
John Smith : change my Person address :Address city = Portland Thursday, March 8, 2012
John Smith : change my Person address :Address city = Boston Thursday, March 8, 2012
John Smith : change my Person address :Address city = Portland Thursday, March 8, 2012
John Smith : change my Person address :Address city = Portland :Event change address Thursday, March 8, 2012
John Smith : change my Person address :Address city = Boston :Event change address Thursday, March 8, 2012
Application State Log Thursday, March 8, 2012
Application State Log Thursday, March 8, 2012
Application State Log Thursday, March 8, 2012
on-demand self-service rapid elasticity broad network access resource pooling measured service special publication 800-145 Thursday, March 8, 2012
Data Sources Thursday, March 8, 2012
Data Sources were Thursday, March 8, 2012
Data Sources were will be text image video connections Thursday, March 8, 2012
Analytics Thursday, March 8, 2012
Analytics were roll-ups trends variance Thursday, March 8, 2012
Analytics were will be pattern recognition roll-ups data mining trends chasing connections variance Thursday, March 8, 2012
Thursday, March 8, 2012
Thursday, March 8, 2012
Thursday, March 8, 2012
map map map map per order map map map map map map map map Thursday, March 8, 2012
map map map reduce map per order per month map map map reduce map map map map reduce map Thursday, March 8, 2012
map map map reduce map per order per month map map map reduce map reduce map map map reduce map Thursday, March 8, 2012
Thursday, March 8, 2012
10,000 ft view (literally) CodeCity by Richard Wettel http://www.inf.unisi.ch/phd/wettel/codecity.html Thursday, March 8, 2012
Thursday, March 8, 2012
Changing Nature of Data Response How we use data now Thursday, March 8, 2012
Changing Nature of Data Response How we use data now Thursday, March 8, 2012
Data Scientist Thursday, March 8, 2012
Data Thursday, March 8, 2012
Data Journalist Thursday, March 8, 2012
Thursday, March 8, 2012
Thursday, March 8, 2012
Thursday, March 8, 2012
Data Warehousing Thursday, March 8, 2012
Data Warehousing Thursday, March 8, 2012
Thursday, March 8, 2012
Thursday, March 8, 2012
http://ureport.ug/ Thursday, March 8, 2012
http://ushahidi.com/ Thursday, March 8, 2012
http://libyacrisismap.net/ Thursday, March 8, 2012
http://opendata.go.ke/ Thursday, March 8, 2012
http://datawithoutborders.cc/ Thursday, March 8, 2012
Recommend
More recommend