metrics you should use but don t
play

Metrics You Should Use (but Dont) @catswetel at #YOW18 Metrics - PowerPoint PPT Presentation

Jun 30, 2023 •22 likes •642 views

Metrics You Should Use (but Dont) @catswetel at #YOW18 Metrics You Should Use (but Dont) @catswetel at #YOW18 If you dont know WHY you are measuring what you are measuring, just dont. Thank you for attending my TED talk. If you

  1. Metrics You Should Use (but Don’t) @catswetel at #YOW18

  2. Metrics You Should Use (but Don’t) @catswetel at #YOW18

  3. If you don’t know WHY you are measuring what you are measuring, just don’t.

  4. Thank you for attending my TED talk.

  5. If you don’t know WHY you are measuring what you are measuring, just don’t.

  6. Decisions Options Sensitivities @catswetel at #YOW18

  7. Balance is key.

  8. QUALITY RESPONSIVENESS PRODUCTIVITY PREDICTABILITY

  9. QUALITY RESPONSIVENESS Software Development Performance Index PRODUCTIVITY PREDICTABILITY

  10. QUALITY RESPONSIVENESS PRODUCTIVITY PREDICTABILITY

  11. QUALITY RESPONSIVENESS What’s missing? PRODUCTIVITY PREDICTABILITY

  12. “The RIGHTER we do the WRONG thing, the WRONGER we become.” -- Dr Russell Ackoff @catswetel at #YOW18

  13. QUALITY RESPONSIVENESS PRODUCTIVITY PREDICTABILITY

  14. Statistical Method from the Viewpoint of Quality Control Walter A Shewhart

  15. Quality is a characteristic of a relationship with a user @catswetel at #YOW18

  16. @catswetel at #YOW18

  17. Time in Process Units of time per unit of work @catswetel at #YOW18

  18. TIME IN PROCESS SCATTER PLOT TIME IN PROCESS DATE DELIVERED

  19. 90% TIME IN PROCESS 50% DATE DELIVERED

  20. TIME IN PROCESS SCATTER PLOT TIME IN PROCESS DATE DELIVERED

  21. FREQUENCY TIME IN PROCESS @catswetel at #YOW18

  22. FREQUENCY TIME IN PROCESS @catswetel at #YOW18

  23. @catswetel at #YOW18

  24. WEIBULL DISTRIBUTION @catswetel at #YOW18

  25. WEIBULL DISTRIBUTION ….maybe? Definitely not normal. @catswetel at #YOW18

  26. Stop trying to make everything normal (and overly complicated) @catswetel at #YOW18

  27. Tell me a story... TIME IN PROCESS DATE DELIVERED

  28. TIME IN PROCESS DATE DELIVERED

  29. When it comes to non-random… NELSON RULES! @catswetel at #YOW18

  30. MULTIMODAL FREQUENCY TIME IN PROCESS @catswetel at #YOW18

  31. TIME IN PROCESS DATE DELIVERED

  32. 90% TIME IN PROCESS AVERAGE DATE DELIVERED

  33. TIME IN PROCESS DATE DELIVERED

  34. FREQUENCY TIME IN PROCESS @catswetel at #YOW18

  35. QUALITY RESPONSIVENESS PRODUCTIVITY PREDICTABILITY

  36. 14 14 12 11 10 9 THROUGHPUT 7 5 TIME IN PROCESS 4 Units of work per unit of time DATE DELIVERED

  37. 14 14 11 9 7 5 TIME IN PROCESS 4 DATE DELIVERED

  38. 14 14 14 12 11 11 10 10 9 9 7 7 5 5 TIME IN PROCESS 4 4 DATE DELIVERED

  39. QUALITY RESPONSIVENESS PRODUCTIVITY PREDICTABILITY

  40. THROUGHPUT

  41. 50% 85%

  42. QUALITY RESPONSIVENESS PRODUCTIVITY PREDICTABILITY

  43. Leading versus lagging indicators @catswetel at #YOW18

  44. TO DO DOING REVIEW DONE @catswetel at #YOW18

  45. @catswetel at #YOW18

  46. CUMULATIVE FLOW DIAGRAM AVERAGE ARRIVAL RATE @catswetel at #YOW18

  47. CUMULATIVE FLOW DIAGRAM AVERAGE DEPARTURE RATE @catswetel at #YOW18

  48. Positive net flow Negative net flow @catswetel at #YOW18

  49. CUMULATIVE FLOW DIAGRAM AVERAGE WORK IN PROCESS @catswetel at #YOW18

  50. CUMULATIVE FLOW DIAGRAM AVERAGE TIME IN PROCESS @catswetel at #YOW18

  51. LITTLE’S LAW @catswetel at #YOW18

  52. #NOESTIMATES @catswetel at #YOW18

  53. ThInGs YoU mAy NoT hAvE NoTiCeD

  54. Unlabeled axes.

  55. NO red and green. @catswetel at #YOW18

  57. NO story points! No sizing whatsoever! @catswetel at #YOW18

  58. @catswetel at #YOW18

  59. It’s the system , stupid. @catswetel at #YOW18

  60. A cautionary tale… Trends over time. Bring a basket. Measures aligned with intent. Questions? Comments? @catswetel Come see me at the reception! #YOW18

  61. Questions/Comments? Come find me at the reception! Questions? Comments? @catswetel Come see me at the reception! #YOW18

Recommend

What we learned from Community Metrics Agenda Why are metrics used? How metrics are used

What we learned from Community Metrics Agenda Why are metrics used? How metrics are used

What we learned from Community Metrics Agenda Why are metrics used? How metrics are used in two Open Source communities Common pitfalls and ways to avoid them Why use Metrics? Transparency Who is contributing to the

166 views • 14 slides
AGENCY OPERATIONS METRICS The Metrics of Me The Metrics of Me x 159 13,006 5 days old books

AGENCY OPERATIONS METRICS The Metrics of Me The Metrics of Me x 159 13,006 5 days old books

Dont trust your gut AGENCY OPERATIONS METRICS The Metrics of Me The Metrics of Me x 159 13,006 5 days old books read so far in 2018 The Metrics of Me 6.3 4.5 4 0 hours of sleep hours in dance class hours cooking hours commuting

549 views • 20 slides
Proposal Metrics Dashboard What Gets Measured Gets Done Topics Why Keep Metrics? What

Proposal Metrics Dashboard What Gets Measured Gets Done Topics Why Keep Metrics? What

Proposal Metrics Dashboard What Gets Measured Gets Done Topics Why Keep Metrics? What Metrics Should We Keep? What is the Easiest Way to Collect Metrics? What is the Easiest Way to Report Metrics? Tips and Tricks to Building a

578 views • 16 slides
Software Metrics Chapter 4 1 SW Metrics SW process and product metrics are quantitative

Software Metrics Chapter 4 1 SW Metrics SW process and product metrics are quantitative

Click here to review OO Testing Strategies Software Metrics Chapter 4 1 SW Metrics SW process and product metrics are quantitative measures that enable SW people to gain insight into the efficacy of SW process and the projects that are

897 views • 44 slides
Lecture 2: Software Metrics Excursion: Scales Deadlines and Costs Some

Lecture 2: Software Metrics Excursion: Scales Deadlines and Costs Some

Topic Area Project Management: Content Content Software Metrics Survey : Expectations on the Course VL 2 Properties of Metrics Software Metrics Softwaretechnik / Software-Engineering Scales . . Motivation .

106 views • 9 slides
Software Metrics Alex Boughton Executive Summary What are software metrics? Why are

Software Metrics Alex Boughton Executive Summary What are software metrics? Why are

Software Metrics Alex Boughton Executive Summary What are software metrics? Why are software metrics used in industry, and how? Limitations on applying software metrics A framework to help refine and understand which

445 views • 33 slides
Performance Metrics for Graph Mining Tasks 1 Outline Introduction to Performance Metrics

Performance Metrics for Graph Mining Tasks 1 Outline Introduction to Performance Metrics

Performance Metrics for Graph Mining Tasks 1 Outline Introduction to Performance Metrics Supervised Learning Performance Metrics Unsupervised Learning Performance Metrics Optimizing Metrics Statistical Significance

1.19k views • 40 slides
Metrics and Estimation Rahul Premraj + Andreas Zeller 1 Metrics Quantitative measures that

Metrics and Estimation Rahul Premraj + Andreas Zeller 1 Metrics Quantitative measures that

These slides are based on Pressman, Chapter 15 Product Metrics, Chapter 22 Metrics for Process and Projects and Chapter 23 Estimation Metrics and Estimation Rahul Premraj + Andreas Zeller 1 Metrics Quantitative measures

624 views • 28 slides
Open Metrics Journal Metrics Perspective from an Open Access Publisher Martin Fenner Technical

Open Metrics Journal Metrics Perspective from an Open Access Publisher Martin Fenner Technical

Open Metrics Journal Metrics Perspective from an Open Access Publisher Martin Fenner Technical Lead Article-Level Metrics Public Library of Science http://pixabay.com/en/ruler-straight-edge-tool-geometry-145940/ Usage Stats Most immediate

683 views • 23 slides
NDCs and metrics Andrei Marcu , Director, ERCST 1 NDCs and metrics Main issues: - Which metrics

NDCs and metrics Andrei Marcu , Director, ERCST 1 NDCs and metrics Main issues: - Which metrics

ERCST August 26-27, 2019 | Santiago Chile NDCs and metrics Andrei Marcu , Director, ERCST 1 NDCs and metrics Main issues: - Which metrics are used in the NDCs? - Trends with respect to single/multiple metric NDCs - Are there trends in

617 views • 12 slides
Finding the Order in the CHAOS(S) of Metrics: Are We There Yet? And further questions :) Ildiko

Finding the Order in the CHAOS(S) of Metrics: Are We There Yet? And further questions :) Ildiko

Finding the Order in the CHAOS(S) of Metrics: Are We There Yet? And further questions :) Ildiko Vancsa - ildiko@openstack.org Metrics and I https://cdn-images-1.medium.com/max/1600/1*DyMkFmSYdgq-LPVK8j6Z5A.jpeg Metrics and I Good grades

357 views • 23 slides
Introduction Metrics and Review of Basic Statistics Metrics CS 239 Why are we talking

Introduction Metrics and Review of Basic Statistics Metrics CS 239 Why are we talking

Introduction Metrics and Review of Basic Statistics Metrics CS 239 Why are we talking about statistics? Experimental Methodologies for Important statistics concepts System Software Indices of central tendency Peter Reiher

548 views • 11 slides
MLXSW UPDATES August 2020 PLANNED FEATURES 2 DEVICE METRICS Netdev-centric metrics (rtnetlink

MLXSW UPDATES August 2020 PLANNED FEATURES 2 DEVICE METRICS Netdev-centric metrics (rtnetlink

MLXSW UPDATES August 2020 PLANNED FEATURES 2 DEVICE METRICS Netdev-centric metrics (rtnetlink / ethtool) Not configurable (e.g., enable / disable, histograms) Hardware-specific metrics, not mapped to software objects HW VTEP Algorithmic

598 views • 33 slides
Performance Metrics for Web Browsing draft fan ippm web metrics 00 Peng Fan

Performance Metrics for Web Browsing draft fan ippm web metrics 00 Peng Fan

Performance Metrics for Web Browsing draft fan ippm web metrics 00 Peng Fan Motivation Web browsing is a basic internet service, with a large population of users and proportion of traffic Understanding web browsing

578 views • 10 slides
Metrics are Pivotal A NATIONAL FARM TO INSTITUTION METRICS COLLABORATIVE WEBINAR Local

Metrics are Pivotal A NATIONAL FARM TO INSTITUTION METRICS COLLABORATIVE WEBINAR Local

Local Procurement: Metrics are Pivotal A NATIONAL FARM TO INSTITUTION METRICS COLLABORATIVE WEBINAR Local Procurement: Metrics are Pivotal NFtI Metrics Collaborative Webinar Dr. Lilian Brislen University of Kentucky The goals of this

442 views • 20 slides
CONTRACTS DIVISION METRICS: WHAT TOOLS ARE IN YOUR TOOLBOX? Presented by Heidi Timmerman &

CONTRACTS DIVISION METRICS: WHAT TOOLS ARE IN YOUR TOOLBOX? Presented by Heidi Timmerman &

CONTRACTS DIVISION METRICS: WHAT TOOLS ARE IN YOUR TOOLBOX? Presented by Heidi Timmerman & Landon Hill Modified from NCMA World Congress 2016 presentation 1 AGENDA Why use metrics How to develop metrics What to measure

692 views • 42 slides
A Map for Monitoring PostgreSQL #PgDaySF @LukasFittl @LukasFittl > 100 Metrics We Could

A Map for Monitoring PostgreSQL #PgDaySF @LukasFittl @LukasFittl > 100 Metrics We Could

A Map for Monitoring PostgreSQL #PgDaySF @LukasFittl @LukasFittl > 100 Metrics We Could Talk About > 100 Metrics We Could Talk About Historic Metrics Current Activity Logs Tuning Actions Query Workload

1.48k views • 100 slides
CSA Z260 Pipeline Safety Metrics CSA Z260 - Pipeline Safety Metrics Provide a suite of

CSA Z260 Pipeline Safety Metrics CSA Z260 - Pipeline Safety Metrics Provide a suite of

CSA Z260 Pipeline Safety Metrics CSA Z260 - Pipeline Safety Metrics Provide a suite of performance metrics to objectively and meaningfully convey pipeline operator performance Define a framework for creating meaningful leading

537 views • 10 slides
Week 2 Video 2 Diagnostic Metrics, Part 1 Different Methods, Different Measures Today well

Week 2 Video 2 Diagnostic Metrics, Part 1 Different Methods, Different Measures Today well

Week 2 Video 2 Diagnostic Metrics, Part 1 Different Methods, Different Measures Today well focus on metrics for classifiers Later this week well discuss metrics for regressors And metrics for other methods will be discussed later

761 views • 39 slides
RPC Metrics at Google JBD, Google (@rakyll) gRPC Metrics at Google JBD, Google (@rakyll)

RPC Metrics at Google JBD, Google (@rakyll) gRPC Metrics at Google JBD, Google (@rakyll)

RPC Metrics at Google JBD, Google (@rakyll) gRPC Metrics at Google JBD, Google (@rakyll) Request Metrics at Google JBD, Google (@rakyll) "100% is the wrong reliability target for basically everything." -- Benjamin Treynor

452 views • 20 slides
Monitoring Team Effectiveness: Measuring with Metrics, Not to Metrics Lynn Spragens, MBA

Monitoring Team Effectiveness: Measuring with Metrics, Not to Metrics Lynn Spragens, MBA

Monitoring Team Effectiveness: Measuring with Metrics, Not to Metrics Lynn Spragens, MBA President, Spragens & Associates, LLC Lynn@LSpragens.com Practical Tools for Making Change November 8 - 10 Orlando, FL Pre- Conference

579 views • 36 slides
A Tight Bound on Approximating Arbitrary Metrics by Tree Metrics Jittat Fakcheroenphol Satish

A Tight Bound on Approximating Arbitrary Metrics by Tree Metrics Jittat Fakcheroenphol Satish

A Tight Bound on Approximating Arbitrary Metrics by Tree Metrics Jittat Fakcheroenphol Satish Rao Kunal Talwar STOC 2003, JCSS 2004 Presented by Jian XIA for COMP670P: Topics in Theory: Metric Embeddings and Algorithms Spring 2007, HKUST

325 views • 14 slides
TXDOT TRAFFIC MANAGEMENT CENTER (TMC) PERFORMANCE METRICS Evolution by Performance Metrics

TXDOT TRAFFIC MANAGEMENT CENTER (TMC) PERFORMANCE METRICS Evolution by Performance Metrics

TXDOT TRAFFIC MANAGEMENT CENTER (TMC) PERFORMANCE METRICS Evolution by Performance Metrics Monday, June 18, 2018 Pe Performan ance B Based C Contrac actin ing Pe Peer E Exchan ange Agenda Projec ject O Overvie iew Projec

230 views • 10 slides
Hawkular Metrics Metric Storage & Alerting Stefan Negrea About Me Co-Creator of Hawkular

Hawkular Metrics Metric Storage & Alerting Stefan Negrea About Me Co-Creator of Hawkular

Hawkular Metrics Metric Storage & Alerting Stefan Negrea About Me Co-Creator of Hawkular Metrics 2 Hawkular Metrics Hawkular Demo & Alerting Introduction to Hawkular Metrics 3 Pre-History 2006 JBoss Operations Network 1.0

929 views • 30 slides

More recommend