Not Invented Here Syndrome and Dark Debt: The PagerDuty Story AISH - PowerPoint PPT Presentation

Apr 17, 2023 •231 likes •740 views

Not Invented Here Syndrome and Dark Debt: The PagerDuty Story AISH RAJ DAHAL Section I Why are we here ? Not Invented Here Syndrome the tendency towards reinventing the wheel based on the belief that in-house developments are

Not Invented Here Syndrome and Dark Debt: The PagerDuty Story AISH RAJ DAHAL  
Section I Why are we here ?
Not Invented Here Syndrome
“… the tendency towards reinventing the wheel based on the belief that in-house developments are inherently better suited, more secure, more controlled, quicker to develop, and incur lower overall cost than using existing implementations…” –The English Wikipedia (2018)
Dark Debt
“….Dark debt was named to draw a parallel with dark matter. Dark matter has detectable effects on the world but cannot be seen or detected directly….Dark debt is found in complex systems and the anomalies it generates are complex system failures….Dark debt is not recognizable at the time of creation. Its impact is not to foil development but to generate anomalies….” – Woods DD, STELLA: Report from the SNAFU catchers Workshop on Coping With Complexity. 2017
Comparison to technical debt
Build vs Buy: The age old question
Can building instead of buying lead to dark debt ?
Where does Not Invented Here syndrome come in the mix ?
Section II WorkQueue
October 24, 2011
WorkQueue
Background
High Availability
Durability
High Scalability
Decent Queryability
Flexible Schema
Backups
Synchronous Replication
What were the options then?
Kafka?
Other options were actually considered
Result: WorkQueue v1
But it did not stop there…
Host based partitioning
Fair partitioning
Time based row bucketing
…there were more services using WorkQueue
In the meanwhile…
Other distributed queues like Kafka gained popularity
PaaS based queues made their presence felt
Cassandra’s API changed*
Thrift RPC fell out of favor within the company
WorkQueue’s nature and widespread use was slowly turning into dark debt.
Section III Lessons learnt
Dark debt is a product of complexity
The development and use of in-house software for a task is not an indication dark debt
However, the proliferation of such special purpose software to other areas is often an indication of Not Invented Here syndrome
Not Invented Here syndrome is an indication of dark debt
Proactive evaluation of past custom solutions before proliferation could help alleviate some of the problems
Unless there is a really strong case for it, don’t go with build*
When in doubt chose simplicity over complexity
Epilogue The past, the present and the future
Official support for WorkQueue was ended in 2016
Cassandra based WorkQueue’s usage in PagerDuty has significantly reduced since 2017
“Simplicity is a great virtue but it requires hard work to achieve it and education to appreciate it. And to make matters worse: complexity sells better.” –Edsger W. Dijkstra
谢谢ありがとう مكل اركش Thank You Merci धन्रवाद Gracias Danke Asante @aishrajdahal

Recommend

PagerDuty Provider PagerDuty (https://www.pagerduty.com/) is an alarm aggregation and dispatching

PagerDuty Provider PagerDuty (https://www.pagerduty.com/) is an alarm aggregation and dispatching service for system administrators and support teams. It collects alerts from your monitoring tools, gives you an overall view of all of your

714 views • 35 slides

Arup Chakrabarti OPERATIONS ENGINEERING arup@pagerduty.com @arupchak PagerDuty Common Ops

Arup Chakrabarti OPERATIONS ENGINEERING arup@pagerduty.com @arupchak PagerDuty Common Ops Mistakes and How to Prevent Them PagerDuty Quick Bio Who the heck is this guy? Worked at Amazon as an Engineer/Manager Worked at Netflix as a

1.23k views • 24 slides

Actually Invented Here A plea for re-inventing the wheel Flip Sasser @flipsasser

Actually Invented Here A plea for re-inventing the wheel Flip Sasser @flipsasser https://github.com/flipsasser flip@inthebackforty.com https://github.com/BackForty/actually_invented_here Not Invented Here syndrome Digital nationalism

995 views • 75 slides

+ - + +/- + - - Syndrome Angelman + + - - - +/- + Syndrome Rett + + - - + +

Intellectual Language Visual- ADHD Anxiety Autistic Seizures Disability Disability Spatial Features Problems Williams + - + +/- + - - Syndrome Angelman + + - - - +/- + Syndrome Rett + + - - + + + Syndrome Down

768 views • 29 slides

syndrome M E D I C A L P O W E R P O I N T T E M P L A T E This is syndrome If you survive

syndrome M E D I C A L P O W E R P O I N T T E M P L A T E This is syndrome If you survive sudden cardiac arrest, your doctor will try to learn what caused it to help prevent future episodes. This procedure opens blocked coronary arteries,

745 views • 25 slides

Whats happening in the Research World of Down syndrome? Overview of research in Down Syndrome:

Whats happening in the Research World of Down syndrome? Overview of research in Down Syndrome: Guided by the NIH Down Syndrome Research Plan What is our common goal? Increase quality of life of those with Down syndrome Decrease

574 views • 45 slides

Equity & Debt Summary Intro Equity Debt: MM Debt: CM Intro Equity & Debt

Equity & Debt Summary Intro Equity Debt: MM Debt: CM Intro Equity & Debt Asset = E + L Debt Funding Investm CM MM Own Money Disc Int Disc Int Shares Retained earnings Script Dividends Risk of

442 views • 6 slides

Down Syndrome by Birth Order and Moms Age 3/20/2017 V0 2017-Down-Syndrome 1 2017-Down-Syndrome

Down Syndrome by Birth Order and Moms Age 3/20/2017 V0 2017-Down-Syndrome 1 2017-Down-Syndrome 2 V0A V0A Down Syndrome by Down Syndrome Birth Order & Moms Age Each person has 23 chromosome pairs. by Chromosomes are small

228 views • 21 slides

Designing for Down Syndrome IDIA 640 | Byron Buckley What is it? Down syndrome (DS) is a

Designing for Down Syndrome IDIA 640 | Byron Buckley What is it? Down syndrome (DS) is a disorder that manifests itself in disabilities that affect all three major types of capabilities: cognitive, motor, and perceptual Target

380 views • 23 slides

MATHEMATICAL THINKING A guest lecture by Mr. Chase Is mathematics invented or discovered?

MATHEMATICAL THINKING A guest lecture by Mr. Chase Is mathematics invented or discovered? Aristotle Plato Is mathematics invented or discovered? Options: Poll! 1. Invented 2. Discovered 3. Unresolvable 4. I dont know Newton and

341 views • 18 slides

an Age of Debt Guay Lim 20 July 2017 Page 1 Outline What Debt? Empirical facts: Debt,

MELBOURNE INSTITUTE Applied Economic & Social Research Fiscal Stimulus in an Age of Debt Guay Lim 20 July 2017 Page 1 Outline What Debt? Empirical facts: Debt, Deficits and Interest Payments Why should we care? High debt,

625 views • 20 slides

Alternatives to Dark Energy and Dark Matter and their implications Evidence for Dark Energy and

Alternatives to Dark Energy and Dark Matter and their implications Evidence for Dark Energy and Dark Matter Modified Gravity Models and their observational implications Orfeu Bertolami Instituto Superior Tcnico Departamento de Fsica

610 views • 46 slides

Country Context - Ghana Recent History of the Republic of Ghana 238,537 sq. Km; Accra Territory

Linkages between debt sustainability and debt management strategies. Fiscal and Debt Policies in Ghana Sovereign Debt Management Forum 2016 The World Bank 19 th -20 th October Samuel Danquah Arkhurst (Director Debt Mgt Division) Ministry of

874 views • 13 slides

AI IN DEBT OPTIMISATION Th The Debt t Challen llenge ge A growing issue that businesses must

AI IN DEBT OPTIMISATION Th The Debt t Challen llenge ge A growing issue that businesses must address to: Accurately predict what debt will or wont be resolved Effectively plan for debt to mitigate risk in times of uncertainty Identify

234 views • 7 slides

Multisystem Maladaptation Hypoxic Ischemic Syndrome Perinatal Asphyxia Hypoxic Ischemic

Neonatal Syndrome Multisystem Maladaptation Hypoxic Ischemic Syndrome Perinatal Asphyxia Hypoxic Ischemic Asphyxial Syndrome Neonatal Maladjustment Syndrome Dummy Foals Changes in Behavior Neonatal Intensive Care Hypoxic-Ischemic Syndrome

1.05k views • 90 slides

What is a syndrome? An epileptic disorder characterised by a cluster of signs and symptoms

What is a syndrome? An epileptic disorder characterised by a cluster of signs and symptoms customarily occurring together Boundaries? Which are Consistency? Disease? How many the limits of a syndrome? Haw many syndromes etiologies a syndrome

443 views • 15 slides

Aspergers Syndrome Aspergers Syndrome Disability Information Session October 23 2007

Aspergers Syndrome Aspergers Syndrome Disability Information Session October 23 2007 October 23, 2007 Jennifer Radt, UC Clermont Marcie Mendelsohn, CCHMC , What is Aspergers Syndrome? Individuals with AS can exhibit a

530 views • 18 slides

Eating to Make a Difference Why nutrition for Down Syndrome matters Matthew Rasberry, RD, CD,

Eating to Make a Difference Why nutrition for Down Syndrome matters Matthew Rasberry, RD, CD, CNSC Clinical Dietitian Down Syndrome Clinic Outline Down syndrome specific growth charts Calorie needs Feeding skills

542 views • 28 slides

th - The 67 th -Book Book- -Of Of- -The The- -Bible Bible The 67 Syndrome Syndrome An

th - The 67 th -Book Book- -Of Of- -The The- -Bible Bible The 67 Syndrome Syndrome An examination of a hermeneutical- exegetical plague that has become all too prevalent among New Testament Christians Definition Definition By the

1.15k views • 97 slides

Syndrome Decoding in the Non-Standard Cases Matthieu Finiasz Outline The Problem of Syndrome

Syndrome Decoding in the Non-Standard Cases Matthieu Finiasz Outline The Problem of Syndrome Decoding I The Cryptosystems of McEliece and Niederreiter II McEliece-Based Signatures III Provably Secure Syndrome-Based Hash Functions IV The

441 views • 32 slides

Acute coronary syndrome in a postpartum patient with Hellp Syndrome E G. Laws 1 , M. Mariani 1 ,

Acute coronary syndrome in a postpartum patient with Hellp Syndrome E G. Laws 1 , M. Mariani 1 , U. Paradossi 1 , R. Marrai 2, G. Casilla 2 , C. Angiolini 2, S. Baldassari 1 , S. Luciani 1 , J. Giannetti 1 , S. Baratta 1 (1) Gabriele Monasterio

431 views • 16 slides

Debt Consolidation Presenter: Esteban Arze Debt Consolidation Have you ever wondered if there

Debt Consolidation Presenter: Esteban Arze Debt Consolidation Have you ever wondered if there is a connection between health and wealth? Better decisions Clarity Less stress Less medical bills Debt Consolidation American household debt

629 views • 23 slides

Search for Dark Matter in the Lab. A personal bit of history OR from Dark MatterWhats

Search for Dark Matter in the Lab. A personal bit of history OR from Dark MatterWhats that?? to Dark MatterWhat is it?? Transition was not easy Until mid-80s particle physicists never heard of DMand couldnt care less

424 views • 18 slides

Improving Memory in Improving Memory in Children with Down syndrome Children with Down syndrome Dr

Improving Memory in Improving Memory in Children with Down syndrome Children with Down syndrome Dr Stephanie Bennett (University of Portsmouth) Dr Joni Holmes (MRC Cognition and Brain Sciences Unit) Georgia Eleftheriou (University of Surrey)

498 views • 26 slides