Testing Observability Amy Phillips Testing Observability | Amy - PowerPoint PPT Presentation

Testing Observability Amy Phillips

Testing Observability | Amy Phillips | @amyjph Amy Phillips ● Engineering Manager at Moo ● Previously manager and tester at Songkick, The Guardian, and Yahoo! ● Can be found @amyjph

Testing Observability | Amy Phillips | @amyjph The early days

Testing Observability | Amy Phillips | @amyjph Black box testing Test case Expected result Test result User saves a value of 4. System returns a value of 4 Pass Retrieve value. 4 4

Testing Observability | Amy Phillips | @amyjph White box testing Test case Expected result Test result User saves a value of 4. System returns a value of 4 Pass Retrieve value. if input == 4 return input 4 4 4 4 else break

Testing Observability | Amy Phillips | @amyjph Releases Build new Coding website Testing Bug fixing Retesting UAT Go Live! Bug fixing Retesting Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

Testing Observability | Amy Phillips | @amyjph Introducing agile Feature 1 Coding Testing Feature 2 Coding Testing Feature 3 Coding Testing Integration testing Go Live! Bug fixing Mon Tue Wed Thur Fri Mon Tue Wed Thur Fri Mon

Testing Observability | Amy Phillips | @amyjph Fluid testing Acceptance testing Error log reviews Manual Automated Ad Hoc tools Pairing Code reviews

Testing Observability | Amy Phillips | @amyjph Continuous delivery

Testing Observability | Amy Phillips | @amyjph Microservices and the impact on testing Push code The monolith Release

Testing Observability | Amy Phillips | @amyjph Microservices and the impact on testing Testing The monolith Testing

Testing Observability | Amy Phillips | @amyjph Microservices and the impact on testing Release Push code Service Release Push code Service Release Push code Service

Testing Observability | Amy Phillips | @amyjph Microservices and the impact on testing Push code Service End to End Release Push code Service Testing Push code Service

Testing Observability | Amy Phillips | @amyjph Consumer driven contract testing Release Service 1 Push code Test Test broker e.g. PACT Test Service 2 Release Push code

Testing Observability | Amy Phillips | @amyjph Self healing systems Master Node A Node B Service 1 Service 2 Service 3

Testing Observability | Amy Phillips | @amyjph A quick look at testing

Testing Observability | Amy Phillips | @amyjph The two sides to testing Have we built the thing right? Have we broken anything else?

Testing Observability | Amy Phillips | @amyjph Testing An investigation conducted to gather information on the quality of the system or product.

Testing Observability | Amy Phillips | @amyjph Quality A quality system meets the needs of the user.

Testing Observability | Amy Phillips | @amyjph Test pyramid UI Integration Unit

Testing Observability | Amy Phillips | @amyjph Testing dials Integration Contract Manual Unit testing testing testing testing

Testing Observability | Amy Phillips | @amyjph Testing that something works can be hard Push code Test Release Two problems: Process assumes a positive outcome = bug reports or rework ● Forced failure states can be unrealistic = limited value ●

Testing Observability | Amy Phillips | @amyjph Observability instead of testing?

Testing Observability | Amy Phillips | @amyjph Retrospectively adding logging Logging Service DB

Testing Observability | Amy Phillips | @amyjph How will we know when it isn’t working?

Testing Observability | Amy Phillips | @amyjph How would you test observability? Monitoring Alerting Tracing Log aggregation

Testing Observability | Amy Phillips | @amyjph Chaos monkey ● Weekly scheduled session ● Two “monkeys” ● One “victim”

Testing Observability | Amy Phillips | @amyjph Make it easy to observe failures Break something Improve Observability Fix it

Testing Observability | Amy Phillips | @amyjph Predictable chimp ● Cheeky ● Multi-talented ● Engaging ● Attention grabbing ● Playful http://interactivepuppy.com/spinmaster-zoomer -chimp-interactive-monkey-toy-review/

Testing Observability | Amy Phillips | @amyjph How to design test scenarios

Testing Observability | Amy Phillips | @amyjph Do you really need a tester?

Testing Observability | Amy Phillips | @amyjph Idea generation

Testing Observability | Amy Phillips | @amyjph Is it worth it? Test value = risk vs. effort

Testing Observability | Amy Phillips | @amyjph Make it better Break something Improve Observability Fix it

Testing Observability | Amy Phillips | @amyjph In summary ● Testing is changing as systems change ● Observability may take the place of many testing tasks ● But observability isn’t free ● We should be asking “How will be know when it isn’t working?”

Thanks Amy Phillips @amyjph