Quality Management Siegfried Zopf, Siemens PSE QM Program and - PowerPoint PPT Presentation

Quality Management Siegfried Zopf, Siemens PSE QM

Program and System Engineering PSE Quality Management � Quality assurance in projects � Quality assurance manager � Quality assurance plan � QA measures � Review � Concepts of quality management � Quality management in a software development organization � Quality models � ISO 9000, CMMI, EFQM Section 2: What is quality management 2

Program and System Engineering PSE Quality assurance in projects Overview Tasks of the QA manager Error prevention in general Validation and verification see stdSEM Kapitel 2: Was versteht man unter Qualitätsmanagement 3

Program and System Engineering PSE QA managers in the project (QAMs) Support project manager and/or project team in reaching the required/agreed quality (as “deputy” of project manager) Plan QA measures in the project (draw up QA plan) Check compliance with development method and other process instructions (together with project manager) Implement QA measures as specified in QA plan Coordinate reviews, moderate review meetings and keep minutes, where necessary Evaluate Q data: analyze systematic errors (occurring multiple times) Report in the case of Q problems Initiate and track corrective measures in the project Kapitel 2: Was versteht man unter Qualitätsmanagement 4

Reviews

Program and System Engineering PSE Costs of delayed detection of faults (B. Boehm, 1976) Relative costs for detecting and clearing a fault 1000 500 200 100 50 20 10 5 2 1 Requirements Design Code Development Acceptance Operation test test Phase in which a fault is detected Kapitel 2: Was versteht man unter Qualitätsmanagement 6

Program and Cost of delayed error detection System Engineering PSE Relative Kosten um einen Fehler zu finden 100 50 IBM-SDD 20 GTE 80 % 10 MEDIAN-TRW SURVEY und zu beheben 5 20 % 2 1 0,5 0,2 0,1 Anforderungen Entwurf Codierung Komponenten-Test Abnahme- Betrieb und Integration Test Phase in der ein Fehler entdeckt wird Kosten einer verzögerten Fehlerentdeckung nach/Boehm 76 / Kapitel 2: Was versteht man unter Qualitätsmanagement 7

Program and System Engineering PSE Early errors are detected late Requirements Design Coding Stand alone test Integration / System test Acceptance test Kapitel 2: Was versteht man unter Qualitätsmanagement 8

Program and System Engineering PSE Reviews Goal To detect errors in a subresult at an early stage , thus increasing productivity and product quality Approach A review is a formalized, critical check of work results by more than one reviewer Kapitel 2: Was versteht man unter Qualitätsmanagement 9

Program and System Engineering PSE Reviews • Reviews are mandatory (provided the respective documents are required for the project) for: Architectural design spec. User Requirements Spec. Detailed design spec. Tender Adaptations specification SW Requirements Spec. Test plan Feasibility study Product documentation Project plan QA plan • Reviews for the other documents and code are useful and therefore recommended • The review scope of a project is defined in the QA plan • All other documents need to be submitted at least to an informal type of check Kapitel 2: Was versteht man unter Qualitätsmanagement 10

Program and System Engineering PSE Review techniques Reviews in comment technique Reviews in session technique General reviews in session technique Intensive inspection Project-specific specification of methods in the QA plan Kapitel 2: Was versteht man unter Qualitätsmanagement 11

Intensive inspection Program and System Engineering Characteristics PSE Based on M. Fagan Roles - Facilitator - Author - Reader - Tester Special checklists Time required - Preparation: 100 LOC/h, document max. 10 pages/h - Inspection : 125 LOC/h, document max. 10 pages/h Errors - in the product - in the process (e.g. SEM) Kapitel 2: Was versteht man unter Qualitätsmanagement 12

Program and System Engineering PSE Intensive inspection How it works Planning Documents, participants, location, roles, date Overview Introductory information for the team (10 min.) Preparation Individual preparation for the role } Inspection Detecting errors (max. 2 hours) session Analysis For process and systematic errors Fault clearance Clear all faults Verification Have all faults been cleared? Kapitel 2: Was versteht man unter Qualitätsmanagement 13

Program and System Engineering PSE Not like this ! Kapitel 2: Was versteht man unter Qualitätsmanagement 14

Program and System Engineering Accumulated Errors (I) PSE without reviews Errors ENTWURF 100% DEFINIT. IMPLEMENT. TEST INSTALL. 50% Time Kapitel 2: Was versteht man unter Qualitätsmanagement 15

Program and System Engineering PSE Accumulated errors (II) with reviews Errors 100% DEFINIT. ENTWURF IMPLEMENT. TEST INSTALL. 50% Time Wirkung von Reviews Kapitel 2: Was versteht man unter Qualitätsmanagement 16

Program and System Engineering PSE Review Metriks Error detection rate [Errors / 100 pages] Intensity [ h / 100 pages] Efficiency [ h / errors ] Effectivity [errors detected / total errors] Kapitel 2: Was versteht man unter Qualitätsmanagement 17

Program and System Engineering PSE Error detection rate (Fehlerfindungsrate FFR) errors detected FFR= 100 Reviewed pages FFR = 17 ??? Kapitel 2: Was versteht man unter Qualitätsmanagement 18

Program and System Engineering FFR-Diagramm PSE Kapitel 2: Was versteht man unter Qualitätsmanagement 19

Program and System Engineering Early Findings PSE General observations Average FFR is independent from development platform and application domain FFR and intensity is high for small documents (<4 pages) Strong correlation between intensity and FFR Efficiency is about one hour per defect Variation is large Kapitel 2: Was versteht man unter Qualitätsmanagement 20

Program and Error detection rate System Engineering PSE Kapitel 2: Was versteht man unter Qualitätsmanagement 21

Program and System Engineering PSE Benefits of Reviews 1993/94 1994/95 Quality Goal FFR~20 FFR~40 + 50 % Many defects Guideline 3000 defects more found in test Training detected in reviews low intensity monthly observation 0,7 million Euro Fagan Inspections and saved yielded four times report as much defects Kapitel 2: Was versteht man unter Qualitätsmanagement 22

Program and System Engineering Error detection rate (Organization) PSE Kapitel 2: Was versteht man unter Qualitätsmanagement 23

Concepts of quality management

Program and System Engineering PSE What is quality management � QM is a management philosophy � It originated in Japan around 1950 Deming /Juran � Key ideas: - Market success based on customer satisfaction - Product improvement based on process improvement - Productivity gains based on error prevention - Continuous improvement process - Statistical methods Section 2: What is quality management 25

Program and System Engineering PSE R.Zultner Management philosophies Quality management Management by objectives Process orientation Results orientation Systematic approach Achievement of objectives Methods Coincidence, personality Correct root causes Correct errors Quality first Profit first Customer satisfaction Quality Customer satisfaction Market success Market success Profit Section 2: What is quality management 26

Program and System Engineering PSE R.Zultner Processes � Which level of quality will we achieve? � A process will deliver only what it is capable of delivering, not more and not less � We only know the capability (what can be achieved) of stable processes � Forecasts are possible only if the capability is known � Never set objectives without knowing the capability Section 2: What is quality management 27

Program and System Engineering PSE ISO 9000:2000 Definition of terms � Process A a set of interrelated or interacting activities which transforms inputs into outputs Section 2: What is quality management 28

Program and System Engineering PSE Statistical methods � Managing by figures � Measuring processing � Monitoring changes from a quantity angle � Distinguishing natural dispersion from special influences Statistical Process Control (SPC) is not common yet in the SW industry (control charts can be used for stable processes) Section 2: What is quality management 29

Program and System Engineering PSE Continuous improvement (Kaizen) Prerequisite: � Finding causes, and not scapegoats - To err is human (an error may occur once, but it's bad if it occurs a second time) Deming wheel Provide process description, Initiate improvement define improvement measure ACT PLAN CHECK DO Check result Do as defined Measure !!! in plan Section 2: What is quality management 30

Program and System Engineering PSE Continuous improvement: innovation Change Continuous improvement n o i t a v o n n I Established process t n e m e v o r p m i s u o u n i t n Time o C Section 2: What is quality management 31