bigdata
play

BigData R EBECCA P ARSONS M ARTIN F OWLER CTO - PowerPoint PPT Presentation

BigData R EBECCA P ARSONS M ARTIN F OWLER CTO http://martinfowler.com rparsons@thoughtworks.com http://thoughtworks.com http://thoughtworks.com @martinfowler Thursday, March 8, 2012 Big Data R EBECCA P ARSONS M ARTIN F OWLER CTO


  1. BigData R EBECCA P ARSONS M ARTIN F OWLER CTO http://martinfowler.com rparsons@thoughtworks.com http://thoughtworks.com http://thoughtworks.com @martinfowler Thursday, March 8, 2012

  2. Big Data R EBECCA P ARSONS M ARTIN F OWLER CTO http://martinfowler.com rparsons@thoughtworks.com http://thoughtworks.com http://thoughtworks.com @martinfowler Thursday, March 8, 2012

  3. The Evolving Panorama of Data R EBECCA P ARSONS M ARTIN F OWLER CTO http://martinfowler.com rparsons@thoughtworks.com http://thoughtworks.com http://thoughtworks.com @martinfowler Thursday, March 8, 2012

  4. Changing Nature of Data Response How we use data now Thursday, March 8, 2012

  5. Changing Nature of Data Response How we use data now Thursday, March 8, 2012

  6. Data is: Thursday, March 8, 2012

  7. Data is: Growing Thursday, March 8, 2012

  8. Data is: Growing Thursday, March 8, 2012

  9. Data is: Growing Walmart : 1 million transactions per hour Facebook : 40 billion photos The Economist: Feb 25th 2010 Thursday, March 8, 2012

  10. 640K ought to be enough for anybody Thursday, March 8, 2012

  11. Lots of T raffic Thursday, March 8, 2012

  12. Thursday, March 8, 2012

  13. Thursday, March 8, 2012

  14. Data is: Thursday, March 8, 2012

  15. Data is: Distributed Thursday, March 8, 2012

  16. 1,482,824 Data is: Distributed 1,287,537 1,080,872 853,698 616,308 356,191 127,942 40,223 8,640 442 1,990 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 Monthly Contributors to Wikipedia souce: wikipedia Thursday, March 8, 2012

  17. Data is: Distributed Thursday, March 8, 2012

  18. Data is: Distributed ��� � � � Thursday, March 8, 2012

  19. Data is: Distributed 98% of internet access points in Africa are mobile 30 million networked sensor nodes growing 30% per year McKinsey Global Institute: Big data: The next frontier for innovation, competition, and productivity Thursday, March 8, 2012

  20. Data is: Thursday, March 8, 2012

  21. Data is: Valuable Thursday, March 8, 2012

  22. Data is: Valuable $300 billion / year for US health care 60% increase in retail margins McKinsey Global Institute: Big data: The next frontier for innovation, competition, and productivity Thursday, March 8, 2012

  23. Data is: Thursday, March 8, 2012

  24. Data is: Urgent Thursday, March 8, 2012

  25. Data is: Thursday, March 8, 2012

  26. Data is: Connected Thursday, March 8, 2012

  27. Data Silos Thursday, March 8, 2012

  28. App App Enterprise Data Model App App Thursday, March 8, 2012

  29. App App Enterprise Data Model App App Thursday, March 8, 2012

  30. Changing Nature of Data Response How we use data now Thursday, March 8, 2012

  31. Changing Nature of Data Response How we use data now Thursday, March 8, 2012

  32. Thursday, March 8, 2012

  33. SQL SQL Thursday, March 8, 2012

  34. Thursday, March 8, 2012

  35. Bigtable Dynamo Thursday, March 8, 2012

  36. Thursday, March 8, 2012

  37. "NoSQL" Thursday, March 8, 2012

  38. Definition of NoSQL Thursday, March 8, 2012

  39. Characteristics of NoSQL Thursday, March 8, 2012

  40. Characteristics of NoSQL non-relational open-source cluster-friendly 21st Century Web schema-less Thursday, March 8, 2012

  41. Document Column- family Graph Key-value aph Thursday, March 8, 2012

  42. Aggregate Thursday, March 8, 2012

  43. Aggregate Eric Evans Thursday, March 8, 2012

  44. orders ID: 1001 customer: Ann line items: customers 0321293533 2 $48 $96 0321601912 1 $39 $39 order lines 0131495054 1 $51 $51 payment details: Card: Amex CC Number: 12345 expiry: 04/2001 credit cards Thursday, March 8, 2012

  45. ID: 1001 customer: Ann line items: 0321293533 2 $48 $96 Order 0321601912 1 $39 $39 1001 0131495054 1 $51 $51 aggregate payment details: Card: Amex CC Number: 12345 expiry: 04/2001 Thursday, March 8, 2012

  46. ID: 1001 customer: Ann line items: 0321293533 2 $48 $96 Order 0321601912 1 $39 $39 1001 0131495054 1 $51 $51 aggregate payment details: Card: Amex CC Number: 12345 document expiry: 04/2001 key-value column family Thursday, March 8, 2012

  47. Order 1001 Order 1004 Order 1026 Order 2843 Order 1001 Order 1004 Order 1001 Order 1004 Order 1026 Order 3754 Thursday, March 8, 2012

  48. Document Column- family Graph Key-value aph Thursday, March 8, 2012

  49. Document Column- family Graph Key-value aph Thursday, March 8, 2012

  50. aph Thursday, March 8, 2012

  51. aph Thursday, March 8, 2012

  52. aph Thursday, March 8, 2012

  53. P olyglot P ersistence aph Thursday, March 8, 2012

  54. Billing Inventory Thursday, March 8, 2012

  55. Billing Integration Database Inventory Thursday, March 8, 2012

  56. Billing Billing Integration Database Inventory Inventory Thursday, March 8, 2012

  57. Billing Billing Integration Database Application Database Inventory Inventory Thursday, March 8, 2012

  58. Event Sourcing Thursday, March 8, 2012

  59. John Smith : Person :Address city = Portland Thursday, March 8, 2012

  60. John Smith : change my Person address :Address city = Portland Thursday, March 8, 2012

  61. John Smith : change my Person address :Address city = Boston Thursday, March 8, 2012

  62. John Smith : change my Person address :Address city = Portland Thursday, March 8, 2012

  63. John Smith : change my Person address :Address city = Portland :Event change address Thursday, March 8, 2012

  64. John Smith : change my Person address :Address city = Boston :Event change address Thursday, March 8, 2012

  65. Application State Log Thursday, March 8, 2012

  66. Application State Log Thursday, March 8, 2012

  67. Application State Log Thursday, March 8, 2012

  68. on-demand self-service rapid elasticity broad network access resource pooling measured service special publication 800-145 Thursday, March 8, 2012

  69. Data Sources Thursday, March 8, 2012

  70. Data Sources were Thursday, March 8, 2012

  71. Data Sources were will be text image video connections Thursday, March 8, 2012

  72. Analytics Thursday, March 8, 2012

  73. Analytics were roll-ups trends variance Thursday, March 8, 2012

  74. Analytics were will be pattern recognition roll-ups data mining trends chasing connections variance Thursday, March 8, 2012

  75. Thursday, March 8, 2012

  76. Thursday, March 8, 2012

  77. Thursday, March 8, 2012

  78. map map map map per order map map map map map map map map Thursday, March 8, 2012

  79. map map map reduce map per order per month map map map reduce map map map map reduce map Thursday, March 8, 2012

  80. map map map reduce map per order per month map map map reduce map reduce map map map reduce map Thursday, March 8, 2012

  81. Thursday, March 8, 2012

  82. 10,000 ft view (literally) CodeCity by Richard Wettel http://www.inf.unisi.ch/phd/wettel/codecity.html Thursday, March 8, 2012

  83. Thursday, March 8, 2012

  84. Changing Nature of Data Response How we use data now Thursday, March 8, 2012

  85. Changing Nature of Data Response How we use data now Thursday, March 8, 2012

  86. Data Scientist Thursday, March 8, 2012

  87. Data Thursday, March 8, 2012

  88. Data Journalist Thursday, March 8, 2012

  89. Thursday, March 8, 2012

  90. Thursday, March 8, 2012

  91. Thursday, March 8, 2012

  92. Data Warehousing Thursday, March 8, 2012

  93. Data Warehousing Thursday, March 8, 2012

  94. Thursday, March 8, 2012

  95. Thursday, March 8, 2012

  96. http://ureport.ug/ Thursday, March 8, 2012

  97. http://ushahidi.com/ Thursday, March 8, 2012

  98. http://libyacrisismap.net/ Thursday, March 8, 2012

  99. http://opendata.go.ke/ Thursday, March 8, 2012

  100. http://datawithoutborders.cc/ Thursday, March 8, 2012

Recommend


More recommend