Using Monitoring and Metrics to learn in Development Patrick Debois Atlassian http://jedi.be/blog @patrickdebois Monday, May 21, 12
HOSTEDOPS https://my.atlassian.com/ondemand/ http://www.cutter.com http://itrevolution.com Vagrant & http://devopsdays.org Veewee Monday, May 21, 12
Your Code Monday, May 21, 12
Monday, May 21, 12
“Test Driven Development” - CI Coward Monday, May 21, 12
Testing in Controlled Environment Monday, May 21, 12
Your Code in Test Monday, May 21, 12
“Until code runs in production , your code is just inventory” - Agile Anonymous Monday, May 21, 12
Continuous Delivery DEV OPS CLASH Monday, May 21, 12
Monday, May 21, 12
Shit Happens in production Monday, May 21, 12
“You go to production with the code you have, not the code you wish you had” - Devops Rumsfeld Monday, May 21, 12
Dreamer Realist Critic DEV OPS Three Phases of Creativity (Disney) Monday, May 21, 12
Devops Areas Area 3: Embed Project knowledge into Operations Area 1: Extend delivery to production DEV OPS Area 2: Extend operations feedback to project Area 4: Embed Operations knowledge into Project http://jedi.be/blog/2012/05/12/codifying-devops-area-practices/ Monday, May 21, 12
C ulture A utomate DEV OPS M easure S hare http://www.opscode.com/blog/2010/07/16/what-devops-means-to-me/ Monday, May 21, 12
Smaller and more frequent changes DEV OPS Faster and better feedback Monday, May 21, 12
Area 1: Extend delivery to production “think Jez Humble” Area 1 DEV OPS Monday, May 21, 12
Continuous Integration Maturity Model http://www.slideshare.net/Urbancode/continuous-delivery-maturity-model Monday, May 21, 12
Infrastructure Code Repository DEV TEST PROD WEB WEB WEB APP APP APP DB DB DB Reuse “Infra code” across Environments Monday, May 21, 12
Reuse “workflow” across Environments VM UP PROVISION HALT VM Management DESTROY WEB Simple CLI APP Vagrantfile DB Puppet/Chef Config Basebox JEOS HOST http://vagrantup.com/ Monday, May 21, 12
Integrate with Continuous Integration DEV TEST PROD APP APP WEB DB APP WEB DB APP WEB DB INFRA APP WEB DB APP WEB DB APP WEB DB Infrastructure Application Code Repository Code Repository Monday, May 21, 12
Continuous Integration to Continuous Delivery Faster/Delivery DEV TEST PROD APP APP WEB DB APP WEB DB APP WEB DB INFRA APP WEB DB APP WEB DB APP WEB DB Faster/Feedback Infrastructure Application Code Repository Code Repository Monday, May 21, 12
Area 2: Extend operations feedback to project think “John Allspaw” DEV OPS Area2 Monday, May 21, 12
Monitoring Layers User/Business External Network/Security Services Service Clustered Services App App Middleware Middleware OS OS Hardware Hardware Network Storage Monday, May 21, 12
Monitoring Layers Behavioral (larger coverage) Diagnostics Monday, May 21, 12
“What part made it fail” ~unit test CPU Memory Network Monday, May 21, 12
“Is it working?” ~behavioral test Monday, May 21, 12
Monitoring Driven Development Create a monitor check before implementing a feature Monday, May 21, 12
Information Radiator Monday, May 21, 12
Monitoring Wonderland http://jedi.be/blog/2012/01/03/monitoring-wonderland-survey-introduction/ http://jedi.be/blog/2012/01/03/monitoring-wonderland-nagios-the-mighty-beast/ http://jedi.be/blog/2012/01/04/monitoring-wonderland-moving-up-the-stack-application-user-metrics/ http://jedi.be/blog/2012/01/03/monitoring-wonderland-metrics-api-gateways/ http://jedi.be/blog/2012/01/04/monitoring-wonderland-visualization/ Monday, May 21, 12
“traditional In house monitoring” Monday, May 21, 12
Monday, May 21, 12
“traditional In house metrics” http://munin-monitoring.org/ http://collectd.org/ Monday, May 21, 12
Ganglia http://ganglia.info/ Monday, May 21, 12
https://github.com/ monitoringsucks Monday, May 21, 12
“1980” style UI Monday, May 21, 12
No API Monday, May 21, 12
Hard to scale Monday, May 21, 12
Static configurations Monday, May 21, 12
Hard to expose “data” UI vs API Monday, May 21, 12
Not self-servicing Monday, May 21, 12
“Monitoring as a service” Monday, May 21, 12
Sonian Cloud Monitoring “Sensu” https://github.com/sensu/sensu Monday, May 21, 12
http://code.google.com/p/rocksteady/ Monday, May 21, 12
Reconnoiter's goal is to better the world of monitoring by marrying fault detection and trending together. Through ease of configuration and ongoing maintenance, Reconnoiter encourages monitoring important technical metrics along side critical business metrics to improve awareness and ultimately accountability. http://labs.omniti.com/labs/reconnoiter Monday, May 21, 12
Scalable writes http://opentsdb.net/ Monday, May 21, 12
Selfservicing Graphs http://graphite.wikidot.com/ Monday, May 21, 12
“App Metrics” Monday, May 21, 12
“End-User Metrics” Monday, May 21, 12
http://www.appdynamics.com/ Monday, May 21, 12
https://github.com/lookfirst/jmxtrans Monday, May 21, 12
GRAPHITE APP STATSD counting timing sampling https://github.com/etsy/statsd Monday, May 21, 12
Metrics Java Library http://metrics.codahale.com/ https://github.com/tritonrc/metricsd Monday, May 21, 12
Business Level Metrics Usage patterns - Google Analytics Monday, May 21, 12
A/B Testing in Prod Metrics / Information Monday, May 21, 12
Meta-Ops Metrics Know context Monday, May 21, 12
Logs as feedback http://logstash.net/ http://graylog2.org/ https://github.com/rashidkpc/Kibana Monday, May 21, 12
Unix Pipe Analogy Monday, May 21, 12
Integrate with Continuous Integration DEV TEST PROD APP APP WEB DB APP WEB DB APP WEB DB INFRA APP WEB DB APP WEB DB APP WEB DB Infrastructure Application Code Repository Code Repository Monday, May 21, 12
Reuse Tools across dev & ops DEV TEST PROD APP APP WEB DB APP WEB DB APP WEB DB INFRA APP WEB DB APP WEB DB APP WEB DB Monitoring/ Metrics Infrastructure Application Code Repository Code Repository Monday, May 21, 12
Integrate with Continuous Monitoring DEV TEST PROD APP APP WEB DB APP WEB DB APP WEB DB INFRA APP WEB DB APP WEB DB APP WEB DB Monitoring/ Monitoring/ Monitoring/ Metrics Metrics Metrics Infrastructure Application Code Repository Code Repository Monday, May 21, 12
Reuse Workflow Debugging Post-Mortem DEV TEST PROD APP APP WEB DB APP WEB DB APP WEB DB INFRA APP WEB DB APP WEB DB APP WEB DB Monitoring/ Monitoring/ Monitoring/ Metrics Metrics Metrics Monday, May 21, 12
Metrics Driven Engineering http://www.slideshare.net/mikebrittain/metricsdriven- engineering Monday, May 21, 12
Monday, May 21, 12
“The future is metrics are here they are just not evenly distributed yet” - Morpheus Monitoring Monday, May 21, 12
http://jedi.be/blog https://github.com/monitoringsucks Monday, May 21, 12
Recommend
More recommend
