DevOps: Are You Pushing Bugs to Your Clients Faster? Wayne Ariola - PowerPoint PPT Presentation

DevOps: Are You Pushing Bugs to Your Clients Faster? Wayne Ariola Chief Strategy Officer - Parasoft 2015-10-21 1 Parasoft Proprietary and Confidential

Re-Evaluate the Cost of Software Quality http://alm.parasoft.com/continuoustestingbook 2 2 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

2015 Non-Functional Requirements Survey OF 780 Respondents What best describes your role in your organization? Architect 15% Tester Business 26% Analyst/Product Owner 6% Senior Developer/Engin Management eer 17% IT Ops 32% 4% 3 3 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

2015 Non-Functional Requirements Survey Does your organization measure or monitor compliance to NON-functional requirements? No 56% Yes 44% 4 4 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

2015 Non-Functional Requirements Survey ‘Yes,’ My Organization Monitors Compliance to NON-Functional Requirements (NFRs) Agile-ish 34% 43% Agile Iterative 49% 53% Hybrid Waterfall 59% 0% 20% 40% 60% 80% 100% 5 5 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

From Automated to Continuous Testing 6 6 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Testing is a Bottleneck Organic Systems Software Quality Processes Business Views Fully Automated Provisioning Data Analytics Efficiency End-to-End Tasks Process Oriented Skilled Tasks Basic Tasks Automation is Incremental 7 7 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Impact of Test in the Evolving SDLC Test as a time-boxed event is the prevailing method Test Plan Develop Build Release Fixed Fixed “Are we done testing?” 8 8 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Impact of Test in the Evolving SDLC Plan Develop Release Build Build Build Build Build Build Build Build Build Build Build Test Test Test Test Test Test Test Test Test Test Test “Does the release candidate have an acceptable level of risk?” 9 9 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Software Drives Innovation Software has SDLC Speed will Switching costs The Cost of shifted from be the difference associated with Quality process enabler to between a first software are associated with software has mover and a dramatically lower business shifted differentiator follower dramatically 10 10 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Software Failures = Headlines Financial Airlines/Aero Government Media Internet/Tel Automotive Technology Retail 11 Parasoft Proprietary and Confidential

Software Failures = Headlines 2014 Software failures make headline news — eroding customer confidence, shareholder value and brand equity The day of the announcement companies lost an average -$2.3 Bn -3.75% of shareholder value 12 12 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Escalating Cost of Failure Impact on Market Capitalization 0.00% 2012 2013 2014 2015 (est.) -0.50% -1.00% -1.50% -2.00% -2.50% -3.00% -3.12% -3.50% -3.37% -3.75% -4.00% y = -0.0032x - 0.0278 -4.06% -4.50% 13 13 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Software Failures = Headlines Market does not forget — news about failure increase and average of 167% 6,000,000 5,500,000 5,000,000 4,000,000 3,490,000 3,000,000 2,240,000 2,000,000 1,550,000 1,400,000 1,080,000 896,000 821,000 1,000,000 650,000 451,000 0 Cloud Services Airline Bank Software Retail 1st Event 2nd Event 14 14 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Building a stronger American - Sometimes -5.70% -1.9B 15 15 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

United Airlines ‘Glitch’ "Airlines are flying computers," said industry analyst Henry Harteveldt. "Increased reliance on technology has enabled (airlines) to become a much more successful and efficient business, and that also creates an -3.61% -$750M exposure." 16 16 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Let’s Reverse the Game…Spot the Failure -7.4B -15% 17 17 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

The Cost of Software Failure - Sony Cumulative Loss = $18B -22% -19% -11% -33% -12% -30% Market Value Event 15 Days 30 Days http://www.reuters.com/article/2011/04/26/us-sony-stoldendata-idUSTRE73P6WB20110426 http://www.digitaltrends.com/gaming/sony-fined-almost-400000-for-2011-playstation-security-breach/ 18 18 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

We must Re-invent Test  The penalty for faulty software is increasing  Brand erosion  All industries at risk for total transformation  Technology is faster and more distributed  DevOps  Containers  Microservices 19 19 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Next Generation Testing 20 20 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Getting from “Automated” to “Continuous” There is a big leap moving from “Automated” to “Continuous”  Business expectations clearly defined  Business risks identified  Per application, team, release  Defects automatically prioritized versus business drivers  No defect left behind  Mitigate business risks  Testing in ‘complete’ test environments continuously  Leveraging simulation – Service Virtualization  Protecting the user experience “top - down”  Feedback loop for defect prevention  Pattern definition  Defect prevention practices enhanced 21 21 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Service Virtualization Service Virtualization delivers a simulated test environment to help development and testers with earlier, faster and more complete testing 22 22 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

So, What are you Virtualizing? AUT • HTTP 1.0 • • Mainframe Mobile Interfaces • HTTP 1.1 • • SOA / Web services AJAX • HTTPS • • Java JSP • JMS • • .NET languages JavaScript • IBM WebSphere MQ • • XML HTML • Sonic MQ • • WSDL CSS • RMI • • WADL WS-* • EJB • • UDDI Standards • SMTP • • WSIL MTOM(XOP) / MIME / DIME • Tibco Rendezvous • • SOAP OAuth • .NET WCF • • PoX (Plain XML) TCP/IP • ISO 8583 • • REST webMethods Broker • EDI • • JSON webMethods IS • SAP • • BPEL HL7 • custom • • Web Applications FTP 23 23 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Access to Dev / Test Systems Complex Mainframe External Database Configuration Cloud ERP App Message External Queue Application Web Server Internal ESB Database Internal Application 3 rd Party Service Internal Service Simple Difficult Test Access 24 24 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Service Virtualization & Dependencies  Access Complex  Dependent applications difficult  Scheduling conflicts  High access fees  Geo-political boundaries  3 rd party or partner applications Configuration Service Virtualization  Configuration  Complex to configure  No control  Limited variability Virtual Lab /  Consumes test time Server Virtualization Easy Simple Difficult Access 25 25 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

The Total Cost of System Access Service Virtualization dramatically reduces the cost of delivering a dev / test environment  Only manage the functionality Cost you need  Only manage data you need Staged Application Instance  Low- Risk “disposable instance” that can be accessed at anytime Hardware Savings  Dramatically reduce test Access Efficiency Staged w/ Virtual Test Lab environment setup and management Service Virtualization System Behavior 26 26 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

The Next Generation Software Quality ‘System’ Development Operations Release Candidate Development Test Integration Pre-Production Production (E1) (E2) (E3) (E4 – E n ) Continuous Assessment of Risk Continuous Verification of Requirements Environment Simulation (SV) Development Tests Auto Test Construction – Synthetic APM – Real Time Data Test Optimization Test Environment Management - Provisioning and Elastic Cloud Scale 27 27 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential

Transforming the Identification of Risk Business Objectives From To Causal Observations Probabilistic Defect Documentation Most Likely Causes Only Structured Data Structured and Unstructured Filters Business Policies Ad Hoc Automated Tool Dependent Tool Independent 28 28 Parasoft Proprietary and Confidential Parasoft Proprietary and Confidential