Review and Update on Wilhelm Hasselbring 1 & Andr van Hoorn 2 1 - PowerPoint PPT Presentation

Review and Update on Wilhelm Hasselbring 1 & André van Hoorn 2 1 Kiel University (CAU) Software Engineering Group & 2 University of Stuttgart Reliable Software Systems Group SSP 2015 05. November 2015 @ Munich W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 1 / 26

Dynamic Analysis with Kieker [van Hoorn et al. 2012] Overview Monitoring Probe Software System with Monitoring Instrumentation W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 2 / 26

Dynamic Analysis with Kieker [van Hoorn et al. 2012] Overview Monitoring Records M e a s u r e m e n t Monitoring log/stream Monitoring Probe Software System with Monitoring Instrumentation W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 2 / 26

Dynamic Analysis with Kieker [van Hoorn et al. 2012] Overview Analysis Configuration (via API and WebGUI) Monitoring Records A n a l y s i s Pipes and Filters M e a s u r e m e n t Monitoring log/stream Monitoring Probe Software System with Monitoring Instrumentation W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 2 / 26

Dynamic Analysis with Kieker [van Hoorn et al. 2012] Overview Analysis Configuration (via API and WebGUI) Monitoring Records A n a l y s i s Pipes and Filters M e a s u r e m e n t Monitoring log/stream Workload Anomaly Detection Invocations/minute [x 1000] 2.0 1.5 SRV0:: 1.0 SRV0:: SRV0:: SRV1:: @3:..Bookstore @1:..Catalog @2:..CRM @1:..Catalog searchBook() 0.5 getBook(..) 0.0 getOffers() <<execution container>> SRV0 getBook(..) Calendar time (hh:mm) 543 <<deployment component>> Monitoring Probe <<deployment component>> <<deployment component>> @1:..Catalog @3:..Bookstore @2:..CRM 573 getBook(..) $ 1635 searchBook() 1635 getOffers() 1092 1062 <<execution container>> SRV1 <<deployment component>> @1:..Catalog getBook(..) Software System with Monitoring Instrumentation Online and Offline Visualization W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 2 / 26

Framework Features & Extension Points Essential Characteristics [Rohr et al. 2008, van Hoorn et al. 2009; 2012] Overview Manual AspectJ Servlet Spring Kieker.Monitoring tracing Control/flow VB6XDCOBOLXDNNN CXFbSOAP Monitoring Probes/Samplers <custom interception technology> Probe MonitoringT Servlet CPUDutilization monitoring Resource Sigar Time Source • Modular, flexible, and extensible architecture MemoryDusage Sampling Monitoring Adaptive Logging <custom technology> (Probes, records, readers, writers, filters etc.) <custom monitoring probe> SystemDtime Sources TimeT • Pipes-and-filters framework for analysis configuration <custom time source> MonitoringT JMX Controller FileDsystem DatabaseDMSQL( TCPbIP • Distributed tracing (logging, reconstruction, visualization) Interface MonitoringTT JavaDMessagingDServiceDMJMS( Writers JavaDManagementDExtNDMJMX( • Low overhead (designed for continuous operation) MonitoringT NamedDpipe OutputDstream Writer • Evaluated in lab and industrial case studies <custom monitoring writer> OperationDexecution Control/flowDevents MonitoringT Records CPUDutilization MemorybswapDusage Monitoring Record ResourceDutilization CurrentDtime Monitoring Log/Stream <custom monitoring record type> Kieker is open-source software (Apache License, V. 2.0) FileDsystem JavaDMessagingDServiceDMJMS( MonitoringTT ❤tt♣✿✴✴❦✐❡❦❡r✲♠♦♥✐t♦r✐♥❣✳♥❡t AnalysisTConfiguration Readers JavaDManagementDExtNDMJMX( Monitoring DatabaseDMSQL( TCPbIP Reader NamedDpipe Real/timeDreplayer Recommended Tool of the SPEC Research Group <custom monitoring reader> Kieker.Analysis PipesDandDfiltersDframework PerformanceDAnalysis Kieker is distributed as part of SPEC RG’s repository Analysis / DependencyDgraphs ArchitectureDreconstrN TraceDanalysis Visualization Analysis/VisualizationT Visualization Plugin SequenceDdiagrams of peer-reviewed tools for quantitative system Plug-Ins CallDgraphs evaluation and analysis, <custom visualization> Analysis <custom trace analysis> Controller ❤tt♣✿✴✴r❡s❡❛r❝❤✳s♣❡❝✳♦r❣✴♣r♦❥❡❝ts✴t♦♦❧s✳❤t♠❧ <custom reconstruction plug-in> <custom analysis plug-in/tool> W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 3 / 26

Agenda Review Overview 1 Review 2 Summary and Outlook 3 W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 4 / 26

Looking back . . . 2006–2009 Review 2006 2007 2008 2009 Trustworthy Software Systems Certification Correctness Availability Reliability Performance Security Privacy Safety Quality of Service Component Technology DEPARTMENT FÜR INFORMATIK SOFTWARE ENGINEERING Diplomarbeit Performance Monitoring von Middleware-basierten Applikationen 31. März 2006 Diplomand Thilo Focke Am Schloßgarten 4 26122 Oldenburg thilo.focke@informatik.uni-oldenburg.de Erstprüfer Prof. Dr. Wilhelm Hasselbring Zweitprüfer Prof. Dr. Ralf Reussner (Universität Karlsruhe) Betre uer MIT Matthias Rohr Dipl.-Math. Johannes-Gerhard Schute 2006 2007 2008 2009 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2006–2009 Review 2006 2007 2008 2009 Trustworthy Software Systems Certification Correctness Availability Reliability Performance Security Privacy Safety Quality of Service Component Technology DEPARTMENT FÜR INFORMATIK SOFTWARE ENGINEERING Diplomarbeit Performance Monitoring von Middleware-basierten Applikationen 31. März 2006 Diplomand Thilo Focke Am Schloßgarten 4 26122 Oldenburg thilo.focke@informatik.uni-oldenburg.de Erstprüfer Prof. Dr. Wilhelm Hasselbring Zweitprüfer Prof. Dr. Ralf Reussner (Universität Karlsruhe) Betre uer MIT Matthias Rohr Dipl.-Math. Johannes-Gerhard Schute 2006 2007 2008 2009 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2006–2009 Review 2006 2007 2008 2009 Trustworthy Software Systems Certification Correctness Availability Reliability Performance Security Privacy Safety Quality of Service Component Technology DEPARTMENT FÜR INFORMATIK SOFTWARE ENGINEERING Diplomarbeit Performance Monitoring von Middleware-basierten Applikationen 31. März 2006 Diplomand Thilo Focke Am Schloßgarten 4 26122 Oldenburg thilo.focke@informatik.uni-oldenburg.de Erstprüfer Prof. Dr. Wilhelm Hasselbring Zweitprüfer Prof. Dr. Ralf Reussner (Universität Karlsruhe) Betre uer MIT Matthias Rohr Dipl.-Math. Johannes-Gerhard Schute 0.5 0.6 2006 2007 2008 2009 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2010–2013 Review 2006 2007 2008 2009 Trustworthy Software Systems Certification Correctness Availability Reliability Performance Security Privacy Safety Quality of Service Component Technology DEPARTMENT FÜR INFORMATIK SOFTWARE ENGINEERING Diplomarbeit Performance Monitoring von Middleware-basierten Applikationen 31. März 2006 Diplomand Thilo Focke Am Schloßgarten 4 26122 Oldenburg thilo.focke@informatik.uni-oldenburg.de Erstprüfer Prof. Dr. Wilhelm Hasselbring Zweitprüfer Prof. Dr. Ralf Reussner (Universität Karlsruhe) Betre uer MIT Matthias Rohr Dipl.-Math. Johannes-Gerhard Schute 0.5 0.6 0.91 0.95a 1.0 2006 2007 2008 2009 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2010–2013 Review 2010 2011 2012 2013 JUnit 1.1 1.2 2010 2011 2012 2013 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2010–2013 Review 2010 2011 2012 2013 JUnit 1.1 1.2 1.3 1.4 2010 2011 2012 2013 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2010–2013 Review 2010 2011 2012 2013 JUnit 1.1 1.2 2010 2011 2012 2013 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2010–2013 Review 2010 2011 2012 2013 JUnit FindBugs regular meetings 1.1 1.2 1.3 1.4 2010 2011 2012 2013 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2010–2013 Review 2010 2011 2012 2013 iObserve ESN SL JUnit FindBugs Kieker Days '12 regular meetings 1.1 1.2 1.3 1.4 1.5 1.6 2010 2011 2012 2013 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26

Looking back . . . 2010–2013 Review 2010 2011 2012 2013 iObserve ESN SL JUnit FindBugs Kieker/ Kieker Palladio Days '12 Days '13 regular meetings 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 2010 2011 2012 2013 May Sept. May Sept. May Sept. May Sept. W. Hasselbring, A. van Hoorn Kieker 05. November 2015 @ Munich 5 / 26