Using Squeeziness to test from Finite State Machines Manuel Nez - PowerPoint PPT Presentation

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing Using Squeeziness to test from Finite State Machines Manuel Núñez (joint work with Alfredo Ibias and Rob Hierons) Universidad Complutense de Madrid CREST Information Theory and Software Testing Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 1

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness? Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 2

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness? Honestly, until a couple of days ago, I had no clue! Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 2

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness? Honestly, until a couple of days ago, I had no clue! I did some research for this talk.... Squeeziness is According to Wiktionary: Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 2

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness? Honestly, until a couple of days ago, I had no clue! I did some research for this talk.... Squeeziness is According to Wiktionary:The quality of being squeezy.... Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 2

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness? Honestly, until a couple of days ago, I had no clue! I did some research for this talk.... Squeeziness is According to Wiktionary:The quality of being squeezy.... Squeezy is: flexible or causing compression . Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 2

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness? Honestly, until a couple of days ago, I had no clue! I did some research for this talk.... Squeeziness is According to Wiktionary:The quality of being squeezy.... Squeezy is: flexible or causing compression . Related to an expression? Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 2

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness? Honestly, until a couple of days ago, I had no clue! I did some research for this talk.... Squeeziness is According to Wiktionary:The quality of being squeezy.... Squeezy is: flexible or causing compression . Related to an expression? easy peasy lemon squeezy. Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 2

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness in Information Theory? D. Clark & R. Hierons. Squeeziness: An information theoretic measure for avoiding fault masking , IPL, 2012. It is a measure designed to quantify the likelihood of Failed Error Propagation. Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 3

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness in Information Theory? D. Clark & R. Hierons. Squeeziness: An information theoretic measure for avoiding fault masking , IPL, 2012. It is a measure designed to quantify the likelihood of Failed Error Propagation. FEP happens when a faulty statement is executed during testing, 1 Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 3

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness in Information Theory? D. Clark & R. Hierons. Squeeziness: An information theoretic measure for avoiding fault masking , IPL, 2012. It is a measure designed to quantify the likelihood of Failed Error Propagation. FEP happens when a faulty statement is executed during testing, 1 the fault corrupts the internal state of the SUT, 2 Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 3

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness in Information Theory? D. Clark & R. Hierons. Squeeziness: An information theoretic measure for avoiding fault masking , IPL, 2012. It is a measure designed to quantify the likelihood of Failed Error Propagation. FEP happens when a faulty statement is executed during testing, 1 the fault corrupts the internal state of the SUT, 2 but the expected output is observed. 3 Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 3

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s the meaning of Squeeziness in Information Theory? D. Clark & R. Hierons. Squeeziness: An information theoretic measure for avoiding fault masking , IPL, 2012. It is a measure designed to quantify the likelihood of Failed Error Propagation. FEP happens when a faulty statement is executed during testing, 1 the fault corrupts the internal state of the SUT, 2 but the expected output is observed. 3 How bad is FEP? FEP can reduce testing effectiveness: we might fail to find a fault despite executing the faulty statement. Empirical studies show that many systems suffer from FEP. Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 3

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing What’s this talk about? The adaption of Squeeziness to a black box scenario. Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 4

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing This talk in a nutshell Using Squeeziness to test from Finite State Machines Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 5

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing This talk in a nutshell Using Squeeziness to test from Finite State Machines Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 6

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing Finite State Machines Graphs with an initial state where transitions are labelled by a pair (input, output). Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 7

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing Finite State Machines Graphs with an initial state where transitions are labelled by a pair (input, output). i 1 / o 2 i 3 / o 2 i 2 / o 2 i 1 / o 2 q 8 q 7 q 0 q 3 q 4 i 2 / o 2 i 2 / o 2 i 3 / o 2 i 1 / o 1 i 1 / o 1 q 9 q 2 q 1 q 6 q 5 Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 7

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing FSMs: assumptions FSMs are deterministic. FSMs representing SUTs are input-enabled. Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 8

Squeeziness (round 1) Finite State Machines Squeeziness (round 2) Evaluating Squeeziness as a collision measure Application to testing FSMs as functions An FSM M can be seen as a function f M : dom M − → image M such that for all α ∈ dom M (sequence of inputs performed by M ) f M ( α ) = β (sequence of outputs observed after applying α ). i 1 / o 2 i 3 / o 2 i 2 / o 2 i 1 / o 2 q 8 q 7 q 0 q 3 q 4 i 2 / o 2 i 2 / o 2 i 1 / o 1 i 3 / o 2 f M ( i 1 ) = o 1 f M ( i 3 ) = o 2 i 1 / o 1 q 9 q 2 q 1 q 6 q 5 f M ( i 3 i 1 ) = o 2 o 2 f M ( i 2 i 3 ) = o 2 o 2 Using Squeeziness to test from Finite State Machines CREST Information Theory and Software Testing 9