"An Agile Throwdown: Munich Takes On the Columbus Agile - PDF document

! K3 K3 Keynote! 6/5/2014!8:45:00!AM ! ! ! ! "An Agile Throwdown: Munich Takes On the Columbus Agile Benchmark Study" ! ! ! Presented by: Michael Mah QSM Associates, Inc. ! ! ! ! Brought(to(you(by:( ! ! ! 340!Corporate!Way,!Suite!300,!Orange!Park,!FL!32073! 888E268E8770!F!904E278E0524!F!sqeinfo@sqe.com!F!www.sqe.com

! ! ! ! ! ! Michael Mah QSM Associates, Inc. ! ! With twenty-five years of industry experience Michael Mah teaches, writes, and consults for QSM Associates to tech companies on measuring and estimating software projects for offshore, waterfall, and agile. Michael and his QSM partners have researched thousands of projects worldwide. His work examines time-pressure dynamics of teams and their contribution to project success and failure. Michael’s clients include Boeing, Progressive, Verizon Wireless, Nationwide, JPMorgan Chase, and other Fortune 100 companies. He is the director of the Benchmarking Practice at the Cutter Consortium in the United States. A private pilot, Michael lives in the mountains of western Massachusetts. Reach Michael at qsma.com. ! !

3/17/14 An Agile Throwdown: Munich Germany Takes on the Columbus Agile Benchmark Study Michael Mah QSM Associates, Inc. June 1-6, 2014 Las Vegas, Nevada Caesars Palace � Without metrics, you � re just another person with a different opinion. � (#2) 1

3/17/14 (#3) The Columbus Agile Benchmark Study (Columbus vs the World) (#4) 2

3/17/14 Comparing Columbus AGILE projects vs. Industry Averages* -- 75% Fewer Defects, 30% Quicker Schedules -- *Industry Averages for Defects & Schedules come from the QSM, In database of several thousand Business type applications. AGILE 75% Fewer Defects Industry Average Defects* AGILE 30% Quicker Schedules Industry Average Schedules* 0 20 40 60 80 100 (#5) The QSM SLIM Database QSM maintains the world � s largest benchmarking database of 12,000+ completed software projects collected worldwide. We put industry productivity statistics on the desktop. The QSM SLIM database contains projects in all industries, waterfall, Agile, offshore/outsourced, in- house, new development, and maintenance. SLIM tools enable managers to measure and estimate Agile and/or waterfall projects. (#6) 3

3/17/14 The QSM SLIM Database British Telecom Fiserv Corp SAP IBM Global Microsoft Misys Healthcare Intel JPMorganChase AT&T/BellSouth Boeing Nationwide Bank of New York Mellon Motorola Lockheed Martin VerizonWireless Progressive Insurance Roche Diagnostics DirecTV (#7) How Might Agile Be Successful? � Agile projects can be considered more successful in the sense that they deliver more functionality with fewer defects. � - Kent Beck (xp creator) (#8) 4

3/17/14 (#9) (#10) 5

3/17/14 (#11) (#12) 6

3/17/14 (#13) (#14) 7

3/17/14 (#15) (#16) 8

3/17/14 T he SLIM-Suite The SLIM-Suite SLIM- MasterPlan: Incremental Development & Project SLIM-Control: Aggregation Variance Analysis & Adaptive SLIM- SLIM-Metrics: Forecasting Estimate: Industry Size, Schedule, Benchmarking & Process Cost & Quality Improvement Estimating SLIM-DataManager Software Project Metrics Repository (#17) footer (#18) 9

3/17/14 (#19) Project Sketch – Core Metrics (#20) 10

3/17/14 Input to SLIM Size Defects Time Effort (#21) Trendline Assessment – Build Phase Schedule Main Build Phase Duration vs Size 100 Faster Schedules Time (Months) 10 Rel 6.5 Rel 6.5 Rel 8.0 Rel 8.0 Rel 5.0 Rel 5.0 Rel 7.0 Rel 7.0 Rel 6.0 Rel 6.0 Rel 7.5 Rel 7.5 1 100 1,000 Effective SLOC (thousands) (#22) Business Systems Avionic Systems Command & Control Microcode Systems Process Control QSM 2005 Business Avg. Line Style 1 Sigma Line Style 11

3/17/14 Trendline Assessment – Defects/ Quality Defects During Test 10,000 Defects During Test 10,000 Fewer Defects Fewer Defects 1,000 1,000 Errors (SysInt-Del) Errors (SysInt-Del) Rel 8.0 Rel 8.0 Rel 8.0 Rel 8.0 Rel 6.0 Rel 6.0 Rel 6.0 Rel 6.0 Rel 6.5 Rel 6.5 Rel 6.5 Rel 6.5 Rel 7.0 Rel 7.0 Rel 7.0 Rel 7.0 Rel 7.5 Rel 7.5 Rel 7.5 Rel 7.5 Rel 5.0 Rel 5.0 Rel 5.0 Rel 5.0 100 100 10 100 1,000 10 Effective SLOC (thousands) 100 1,000 Effective SLOC (thousands) Business Sy stems Av ionic Sy stems Command & Control Microcode Sy stems Process Control QSM 2005 Business Av g. Line Sty le 1 Sigma Line Sty le (#23) Business Systems Avionic Systems Command & Control Microcode Systems Process Control QSM 2005 Business Avg. Line Style 1 Sigma Line Style Follett vs. Industry Average Industry Current Delta Average Performance Project Cost $3.5 Million $2.2 Million -$1.3M Schedule 12.6 months 7.8 months -4.8 mos QA Defects 242 121 -50% Staffing 35 35 n/a (#24) 12

3/17/14 (#25) (#26) 13

3/17/14 (#27) (#28) 14

3/17/14 (#29) Agile Captures the Right Metrics for SLIM Velocity/Burndown Headcount Stories and Point Sizing Bugs (#30) 15

3/17/14 The Columbus Agile Benchmark Study (Columbus vs the World) (#31) Comparing Columbus AGILE projects vs. Industry Averages* -- 75% Fewer Defects, 30% Quicker Schedules -- *Industry Averages for Defects & Schedules come from the QSM, In database of several thousand Business type applications. AGILE 75% Fewer Defects Industry Average Defects* AGILE 30% Quicker Schedules Industry Average Schedules* 0 20 40 60 80 100 (#32) 16

3/17/14 The Munich Agile Benchmark Study (Munich vs the World) (#33) (#34) 17

3/17/14 Munich vs. Columbus (#35) Sample Agile Release Summary July Release: · 4 months duration · 10 FTE staff · 139 Stories, 553 Story Points · Delivered by Adding/Creating (an additional) 26,579 New Code, plus 7,615 Changed Code = 34,194 New and Changed Code (Other code = same/unchanged or deleted) · 45 Defects during QA Testing (#36) 18

3/17/14 (#37) (#38) 19

3/17/14 Staffing - Columbus Average Staff 100 Larger Teams 10 FTE Headcount 1 0.1 1 10 100 1,000 New + Modified Size (thousands) (#39) United States QSM Business Avg. Line Style 1 Sigma Line Style Staffing - Columbus Average Staff 100 Larger Teams Larger Teams 10 FTE Headcount 1 0.1 1 10 100 1,000 New + Modified Size (thousands) (#40) United States QSM Business Avg. Line Style 1 Sigma Line Style 20

3/17/14 Staffing - Munich Average Staff 100 Smaller Teams Smaller Teams 10 FTE Headcount 1 0.1 1 10 100 1,000 New + Modified Size (thousands) (#41) Germany QSM Business Avg. Line Style 1 Sigma Line Style Staffing - Munich Average Staff 100 Smaller Teams Smaller Teams 10 FTE Headcount 1 0.1 1 10 100 1,000 New + Modified Size (thousands) (#42) Germany QSM Business Avg. Line Style 1 Sigma Line Style 21

3/17/14 Staffing – Columbus and Munich Average Staff 100 Larger Teams 10 FTE Headcount 1 Smaller Teams 0.1 1 10 100 1,000 New + Modified Size (thousands) (#43) United States Germany QSM Business Avg. Line Style 1 Sigma Line Style Staffing – Columbus and Munich Average Staff 100 Larger Teams 10 FTE Headcount 1 Smaller Teams 0.1 1 10 100 1,000 New + Modified Size (thousands) (#44) United States Germany QSM Business Avg. Line Style 1 Sigma Line Style 22

3/17/14 Effort – Columbus Effort 1,000 Higher Effort/Cost 100 Person-Months 10 Lower Effort/Cost 1 1 10 100 1,000 New + Modified Size (thousands) (#45) United States QSM Business Avg. Line Style 1 Sigma Line Style Effort – Columbus Effort 1,000 Higher Effort/Cost 100 Person-Months 10 Lower Effort/Cost 1 1 10 100 1,000 New + Modified Size (thousands) (#46) United States QSM Business Avg. Line Style 1 Sigma Line Style 23

3/17/14 Effort - Munich Effort 1,000 Higher Effort/Cost 100 Person-Months 10 Lower Effort/Cost 1 1 10 100 1,000 New + Modified Size (thousands) (#47) Germany QSM Business Avg. Line Style 1 Sigma Line Style Effort - Munich Effort 1,000 Higher Effort/Cost 100 Person-Months 10 Lower Effort/Cost 1 1 10 100 1,000 New + Modified Size (thousands) (#48) Germany QSM Business Avg. Line Style 1 Sigma Line Style 24

3/17/14 Effort – Columbus and Munich Effort 1,000 Higher Effort/Cost 100 Person-Months 10 Lower Effort/Cost 1 1 10 100 1,000 New + Modified Size (thousands) (#49) United States Germany QSM Business Avg. Line Style 1 Sigma Line Style (#50) 25

3/17/14 Speed - Columbus Time-to-Market 100 Faster Schedules Faster Schedules Months 10 1 1 10 100 1,000 New + Modified Size (thousands) (#51) United States QSM Business Avg. Line Style 1 Sigma Line Style Speed - Columbus Time-to-Market 100 Faster Schedules Months 10 1 1 10 100 1,000 New + Modified Size (thousands) (#52) United States QSM Business Avg. Line Style 1 Sigma Line Style 26

3/17/14 Speed - Munich Time-to-Market 100 Faster Schedules Months 10 1 1 10 100 1,000 New + Modified Size (thousands) (#53) Germany QSM Business Avg. Line Style 1 Sigma Line Style Speed - Munich Time-to-Market 100 Faster Schedules Months 10 1 1 10 100 1,000 New + Modified Size (thousands) (#54) Germany QSM Business Avg. Line Style 1 Sigma Line Style 27