model based mutation driven test case generation
play

MODEL-BASED, MUTATION-DRIVEN TEST CASE GENERATION VIA - PowerPoint PPT Presentation

Aug 26, 2022 •18 likes •358 views

MODEL-BASED, MUTATION-DRIVEN TEST CASE GENERATION VIA HEURISTIC-GUIDED BRANCHING SEARCH Andreas Fellner FMCAD Student Forum Wien, October 4th 2017 TEST CASE GENERATION WITH 1 Andreas Fellner TEST CASE GENERATION WITH Abstract Model UML /

  1. MODEL-BASED, MUTATION-DRIVEN TEST CASE GENERATION VIA HEURISTIC-GUIDED BRANCHING SEARCH Andreas Fellner FMCAD Student Forum Wien, October 4th 2017

  2. TEST CASE GENERATION WITH 1 Andreas Fellner

  3. TEST CASE GENERATION WITH Abstract Model UML / Event-B 1 Andreas Fellner

  4. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System 1 Andreas Fellner

  5. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation 1 Andreas Fellner

  6. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems 1 Andreas Fellner

  7. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems 1 Andreas Fellner

  8. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: 1 Andreas Fellner

  9. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  10. TEST CASE GENERATION WITH Abstract Model Test Cases Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  11. TEST CASE GENERATION WITH Input/Output Abstract Model Test Cases Executable Model Sequence UML / Event-B Action System Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  12. TEST CASE GENERATION WITH Input/Output Abstract Model Test Cases Executable Model Sequence UML / Event-B Action System Branching Search Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  13. TEST CASE GENERATION WITH Input/Output Abstract Model Test Cases Executable Model Sequence UML / Event-B Action System Branching Search Automatic Translation Mutated Action Systems Mutants killed / alive / equivalent? c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  14. TEST CASE GENERATION WITH Input/Output Abstract Model Test Cases Executable Model Sequence UML / Event-B Action System Branching Search Automatic Translation Mutated Action Systems Mutants killed / alive / equivalent? Mutant Killed: c := c + 1 Original: - Same Input c := c Mutation: - Different Output if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  15. BRANCHING SEARCH AND MUTATION KILLING 2 Andreas Fellner

  16. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches 2 Andreas Fellner

  17. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches ? ! ? ! ? ! 2 Andreas Fellner

  18. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches ? ? ? ? ! ! ? ! ? ! 2 Andreas Fellner

  19. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches ? ? ? ? ! ! ? ? ! ! ? ! 2 Andreas Fellner

  20. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches ? ? ? ? ! ? ! ? ? ! ! ? ? ! ! 2 Andreas Fellner

  21. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches • Each branch is explored in parallel ? ? ? ? ! ? ! ? ? ! ! ? ? ! ! 2 Andreas Fellner

  22. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches • Each branch is explored in parallel ? ? ? • Explore mutated models in parallel ? ! ? ! ? ? ! ! ? ? ! ! 2 Andreas Fellner

  23. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches • Each branch is explored in parallel ? ? ? • Explore mutated models in parallel ? ! ? ! ? ? ! ! ? ? ? ! ! ! 2 Andreas Fellner

  24. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! ? ! ? ? ! ! ? ? ? ! ! ! 2 Andreas Fellner

  25. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? ! ! ? ? ? ! ! ! 2 Andreas Fellner

  26. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? • Set of heuristics guiding branching search ! ! ? ? ? ! ! ! 2 Andreas Fellner

  27. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? • Set of heuristics guiding branching search ! • Where to start new branches • ! How to expand branches ? ? ? ! ! ! 2 Andreas Fellner

  28. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? • Set of heuristics guiding branching search ! • Where to start new branches • ! How to expand branches ? ? • ? Construct test cases from exploration graph ! ! ! 2 Andreas Fellner

  29. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? • Set of heuristics guiding branching search ! • Where to start new branches • ! How to expand branches ? ? • ? Construct test cases from exploration graph • Prune irrelevant exploration steps ! ! ! 2 Andreas Fellner

  30. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? • Set of heuristics guiding branching search • Where to start new branches • ! How to expand branches ? ? • ? Construct test cases from exploration graph • Prune irrelevant exploration steps ! ! ! 2 Andreas Fellner

  31. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ! ? • Set of heuristics guiding branching search • Where to start new branches • ! How to expand branches ? • ? Construct test cases from exploration graph • Prune irrelevant exploration steps ! ! 2 Andreas Fellner

  32. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ! ? • Set of heuristics guiding branching search • Where to start new branches • ! How to expand branches ? • ? Construct test cases from exploration graph • Prune irrelevant exploration steps ! • ! Map test cases to mutant kills 2 Andreas Fellner

  33. SUMMARY • Model based testing • Test high level behavior based on abstract description of the system • Mutation testing • Connect tests to faults • Prune irrelevant test steps • Demanding models from industrial context, thus emphasis on scalability • Branching Search • Fully leverage parallelism • Flexibility through set of heuristics • Shorter and more effective tests Andreas Fellner Andreas Fellner 3

  34. FUTURE WORK • Distance metric based on mutant constraints • Designated strong killing algorithm • Semi symbolic methods • Dynamic symbolic execution • Unfoldings, Partial Orders & Petri Nets • Static analysis • Better estimation of state space • Eliminate equivalent mutants Andreas Fellner Andreas Fellner 4

Recommend

Automating the Generation of Mutation-based Test Cases Mik ike e Pap apad adakis akis

Automating the Generation of Mutation-based Test Cases Mik ike e Pap apad adakis akis

Automating the Generation of Mutation-based Test Cases Mik ike e Pap apad adakis akis Department of Informatics Athens University of Economics and Business 1 Mutation Testing White-box, fault-based testing technique Considered as

540 views • 22 slides
GENERATION O OF MUTATION T TESTING T TOOLS WITH WODEL-TEST TEST P. Gmez-Abajo , E. Guerra,

GENERATION O OF MUTATION T TESTING T TOOLS WITH WODEL-TEST TEST P. Gmez-Abajo , E. Guerra,

GENERATION O OF MUTATION T TESTING T TOOLS WITH WODEL-TEST TEST P. Gmez-Abajo , E. Guerra, J. de Lara Modelling&Software Engineering Research Group http://miso.es Universidad Autnoma de Madrid (Spain) Mercedes G. Merayo Design

350 views • 13 slides
Model-Based Testing: Automated Generation of Test Cases, Test Data, and Test Procedures from

Model-Based Testing: Automated Generation of Test Cases, Test Data, and Test Procedures from

Model-Based Testing: Automated Generation of Test Cases, Test Data, and Test Procedures from SysML Models Jrg Brauer and Jan Peleska Verified Systems International GmbH support@verified.de Space Tech Expo Europe 2015-11-19 Motivation

499 views • 26 slides
Combining Model-Based and Risk-Based Testing for Effective Test Case Generation Duygu Metin

Combining Model-Based and Risk-Based Testing for Effective Test Case Generation Duygu Metin

Combining Model-Based and Risk-Based Testing for Effective Test Case Generation Duygu Metin Hasan Szer Ceren ahin Gebizli Vestel Electronics R&D zye in University Vestel Electronics R&D duygu.metin@vestel.com.tr

266 views • 3 slides
Mutation Testing of Memory- Related Operators Jay Nanavati, Fan Wu, Mark Harman, Yue Jia, Jens

Mutation Testing of Memory- Related Operators Jay Nanavati, Fan Wu, Mark Harman, Yue Jia, Jens

Mutation Testing of Memory- Related Operators Jay Nanavati, Fan Wu, Mark Harman, Yue Jia, Jens Krinke UCL, UK Mutation Testing Test case Test case Test case Test case Test case Test case Test case Jay Nanavati, Fan Wu, Mark

606 views • 28 slides
1 Mutation pressure Let = the mutation rate from A a Let = the mutation rate from a

1 Mutation pressure Let = the mutation rate from A a Let = the mutation rate from a

Population Genetics 5: Mutation pressure Mutation pressure Table 1 : Estimates of per generation mutation rates for a range of organisms Organism Per nucleotide rate Genomic rate RNA GENOMES 1.97 10 -5 Poliovirus 0.15 1.10 10 -4

350 views • 6 slides
1 Mutation pressure Let = the mutation rate from A a Let = the mutation rate from a

1 Mutation pressure Let = the mutation rate from A a Let = the mutation rate from a

Population Genetics 5: Mutation pressure Mutation pressure Table 1 : Estimates of per generation mutation rates for a range of organisms Organism Per nucleotide rate Genomic rate RNA GENOMES 1.97 10 -5 Poliovirus 0.15 1.10 10 -4

306 views • 7 slides
A UML-Based Testing Approach Using Sequence Diagrams, Statecharts, and OCL Constraints Dehla

A UML-Based Testing Approach Using Sequence Diagrams, Statecharts, and OCL Constraints Dehla

A UML-Based Testing Approach Using Sequence Diagrams, Statecharts, and OCL Constraints Dehla Sokenou TU Berlin Softwaretechnik Overview of the Test System test data test generation driver test case abstract test data generation test

444 views • 20 slides
RE-TARGETABLE GRAMMAR BASED TEST CASE GENERATION 2 TESTING PARSERS IS HARD 3 HOW WE GOT

RE-TARGETABLE GRAMMAR BASED TEST CASE GENERATION 2 TESTING PARSERS IS HARD 3 HOW WE GOT

JOE ROZNER / @JROZNER RE-TARGETABLE GRAMMAR BASED TEST CASE GENERATION 2 TESTING PARSERS IS HARD 3 HOW WE GOT HERE Mostly clean room (ish) implementation of complex languages (context-free- ish) ~35k lines of grammar in total

400 views • 19 slides
Automated Test Case Generation or: How to not write test cases Stefan Klikovits EN-ICE-SCD

Automated Test Case Generation or: How to not write test cases Stefan Klikovits EN-ICE-SCD

Automated Test Case Generation Stefan Klikovits Automated Test Case Generation or: How to not write test cases Stefan Klikovits EN-ICE-SCD Universit e de Gen` eve 28 th September, 2015 Automated Test Reminder: Testing is not easy Case

609 views • 33 slides
! ? b s i real-time testing s o p Attitude is changing: s t s n e d m o h e t

! ? b s i real-time testing s o p Attitude is changing: s t s n e d m o h e t

Contents introduction & background testing pre-orders Model-Based Testing input/output & quiescence ioco implementation relation Ed Brinksma test generation TorX test case study University of Twente Dept. of

451 views • 11 slides
Real-Time Modeling and Test Case Generation Konrad Krentz A Convincing Safety Case [1] 2 A

Real-Time Modeling and Test Case Generation Konrad Krentz A Convincing Safety Case [1] 2 A

Real-Time Modeling and Test Case Generation Konrad Krentz A Convincing Safety Case [1] 2 A Convincing Safety Case Fault Formal () Architecture Tree Testing Methods Analysis UPPAAL Agenda 3 Timed Timed UPPAAL Model- Overview

369 views • 36 slides
Mutation Score, Coverage, Model Inference: Quality Assessment for t -way Combinatorial Test-Suites

Mutation Score, Coverage, Model Inference: Quality Assessment for t -way Combinatorial Test-Suites

Mutation Score, Coverage, Model Inference: Quality Assessment for t -way Combinatorial Test-Suites Hermann Felbinger , Franz Wotawa, Mihai Nica Graz University of Technology Motivation Extend existing empirical evaluation results

477 views • 19 slides
UML-Based Statistical Test Case Generation Matthias Riebisch, Ilka Philippow, Marco Gtze

UML-Based Statistical Test Case Generation Matthias Riebisch, Ilka Philippow, Marco Gtze

UML-Based Statistical Test Case Generation Matthias Riebisch, Ilka Philippow, Marco Gtze Ilmenau Technical University; Germany http://www.theoinf.tu-ilmenau.de/~pld ALEXANDRIA NetObjectDays02, Erfurt, October 10, 2002 ALEXANDRIA Research

527 views • 13 slides
1 2 3 4 Most of the traditional approaches that drive test strategies are based on some

1 2 3 4 Most of the traditional approaches that drive test strategies are based on some

1 2 3 4 Most of the traditional approaches that drive test strategies are based on some attributes that is derived from other assessments such as requirements-driven, risk-driven or metrics-driven test strategies. The problem with these

526 views • 37 slides
Model-based Testing Model-based Testing Gordon Fraser Saarland University Gordon Fraser

Model-based Testing Model-based Testing Gordon Fraser Saarland University Gordon Fraser

Model-based Testing Model-based Testing Gordon Fraser Saarland University Gordon Fraser Saarland University Slides by Lars Frantzen Conformance Testing specifies Model System System conforms to Test Generation Test Execution Test

1.71k views • 143 slides
Software Engineering I cs361 Test Driven Development What is Test Driven Development (TDD)

Software Engineering I cs361 Test Driven Development What is Test Driven Development (TDD)

Software Engineering I cs361 Test Driven Development What is Test Driven Development (TDD) Test-driven development ( TDD ) is a software development process based on three simple rules TDD Rules (From Uncle Bob Martin) 1. You are not allowed

386 views • 19 slides
The Forecasting Waste Generation Model based on Linked Open Data and the DPSIR Framework. Case

The Forecasting Waste Generation Model based on Linked Open Data and the DPSIR Framework. Case

The Forecasting Waste Generation Model based on Linked Open Data and the DPSIR Framework. Case study concerning municipal waste in the Czech Republic. Ji H eb ek 1 , Ji Kalina 1 , Jana Soukopov 1 , Jan Prek 2 and Ji

242 views • 23 slides
6.869 Model-based Vision Topics: Advances in Computer Vision Hypothesize and test

6.869 Model-based Vision Topics: Advances in Computer Vision Hypothesize and test

6.869 Model-based Vision Topics: Advances in Computer Vision Hypothesize and test Interpretation Trees Prof. Bill Freeman Alignment Interpretation trees Model-based vision Hypothesis generation methods Hypothesize

358 views • 11 slides
Coverage-Driven Test Code Generation for Concurrent Classes Valerio Terragni Shing-Chi Cheung

Coverage-Driven Test Code Generation for Concurrent Classes Valerio Terragni Shing-Chi Cheung

Coverage-Driven Test Code Generation for Concurrent Classes Valerio Terragni Shing-Chi Cheung Department of Computer Science and Engineering The Hong Kong University of Science and Technology {vterragni, scc}@cse.ust.hk 20 May 2016 1

1.41k views • 111 slides
Using Non-Redundant Mutation Operators and Test Suite Prioritization to Achieve Efficient and

Using Non-Redundant Mutation Operators and Test Suite Prioritization to Achieve Efficient and

Using Non-Redundant Mutation Operators and Test Suite Prioritization to Achieve Efficient and Scalable Mutation Analysis Ren Just 1 , 2 & Gregory M. Kapfhammer 3 & Franz Schweiggert 2 1 University of Washington, USA 2 Ulm University,

1.18k views • 85 slides
Testing: Our Experiences Test Case Sof tware Testing Software to be tested Output When to

Testing: Our Experiences Test Case Sof tware Testing Software to be tested Output When to

Testing: Our Experiences Test Case Sof tware Testing Software to be tested Output When to Stop? A Real Testing Example Test Case Generation Test Cases Just a list. Test Case {1,3,2} SPECS: A sorted list. {1,2,3} Takes a list

316 views • 7 slides
Improving Test Case Generation for Web Applications Using Automated Interface Discovery William

Improving Test Case Generation for Web Applications Using Automated Interface Discovery William

Improving Test Case Generation for Web Applications Using Automated Interface Discovery William G.J. Halfond and Alessandro Orso Georgia Institute of Technology Web Application Overview Request Web http://host?login=alice&pin=1234

892 views • 40 slides
Model-Based Testing (ISTQB Chapter 4) Arie van Deursen 1 4.1 ISTQB Test Design Test Scripts

Model-Based Testing (ISTQB Chapter 4) Arie van Deursen 1 4.1 ISTQB Test Design Test Scripts

Model-Based Testing (ISTQB Chapter 4) Arie van Deursen 1 4.1 ISTQB Test Design Test Scripts Test Basis 4.1.2: Test Analysis 4.1.4: Test Implementation Test Selected Test Cases Test Conditions Conditions 4.1.3: Test Design 2 Test

1.18k views • 38 slides

More recommend