Mutatjon-based Testjng of Rule-based Model Transformatjons Using - PowerPoint PPT Presentation

Mutatjon-based Testjng of Rule-based Model Transformatjons Using Higher-order Transformatjons Presented by: Ali Parsai Supervisor: Prof. Vangheluwe Model-driven Engineering 2013-2014

Sofuware Testjng Testing is required to assure quality Manual testing is not an option Automatic test-suites do the job 2

Test-suite quality Adequate coverage Ability to catch common bugs Quis custodiet ipsos custodes? Socrates 3

Mutatjon Testjng* Repeatable, scientific approach Simulates realistic situations* Quantifiable, tangible results * DeMillo et al. 1978 * Just et al. 2014 4

Mutatjon Testjng 5

Mutatjon Testjng of Model Transformatjons Requires complicated change Mutants compatible with meta-model Work on semantics* Output Input Meta- Meta- Model Model Model Transfor- mation Output Mutation Operator Model Input Model Faulty Mutant Output Model * Mottu et al. 2006 6

Higher-Order Transformatjons Mutation operator as a higher-order transformation 7

Experiment Tool: AToMPM* * Syriani et al. 2013 8

Experiment Meta-model: RPG Game 9

Mutatjon Operators 110 in total Using a double ramified version of RPG Game Using a ramified version of TransformationRule RSCC: Relation to Same Class Change ROCC: Relation to Other Class Change RSMD: Relation Sequence Modification with Deletion RSMA: Relation Sequence Modification with Addition CACD: Classes Association Creation Deletion CACA: Classes Association Creation Addition 10

Relatjon to Same Class Change 24 in total An association to an object is replaced by another association to the same object 11

Relatjon to Other Class Change 42 in total An association to an object is replaced by another association to another object 12

Relatjon Sequence Modifjcatjon with Deletjon 14 in total An association to an object is removed 13

Relatjon Sequence Modifjcatjon with Additjon 8 in total An association to an object is added 14

Classes Associatjon Creatjon Deletjon 14 in total An association between two objects is deleted 15

Classes Associatjon Creatjon Additjon 8 in total An association between two objects is added 16

Executjon Transformation Rule: HeroPicksGoal Mutation Operator Type: RSMA 17

Executjon Expected Result: 18

Conclusion Mutation testing can be adapted to model-driven context Mutation operators can be defined as higher-order transformations AToMPM can implement these operators 20

References DeMillo, R. A., Lipton, R. J., Sayward, F. G., Apr. 1978. Hints on test data selection: Help for the practicing programmer. Computer 11 (4), 34–41 21

References Just, R., Jalali, D., Inozemtseva, L., Ernst, M. D., Holmes, R., Fraser, G., 2014. Are mutants a valid substitute for real faults in software testing? Tech. Rep. UW- CSE-14-02-02, University of Washington 22

References Mottu, J.-M., Baudry, B., Le Traon, Y., 2006. Mutation analysis testing for model transformations. In: Rensink, A., Warmer, J. (Eds.), Model Driven Architecture Foundations and Applications. Vol. 4066 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, pp. 376–390 23

References Syriani, E., Vangheluwe, H., Mannadiar, R., Hansen, C., Van Mierlo, S., Ergin, H., 2013. Atompm: A web-based modeling environment. In: Demos/Posters/StudentResearch @ MoDELS. pp. 21–25 24

Questjons

Mutatjon-based Testjng of Rule-based Model Transformatjons Using - PowerPoint PPT Presentation

Mutatjon-based Testjng of Rule-based Model Transformatjons Using Higher-order Transformatjons Presented by: Ali Parsai Supervisor: Prof. Vangheluwe Model-driven Engineering 2013-2014 Sofuware Testjng Testing is required to assure quality

Rule-based Modeling William S. Hlavacek Theoretical Division Los Alamos National Laboratory

Comments on C. Walsh: The Challenges with Rule-Based Policy Implementation Jos e De Gregorio

CHR - a common platform for rule-based approaches Prof. Dr. Thom Fr uhwirth | June 2010 | Uni

Using Rule-Based Activity Using Rule-Based Activity Using Rule-Based Activity Using Rule-Based

Lecture 3: reflex-based, model-based, goal-based, utility-based, learning-based Systematic

1 Outline Problem Setting Instance-Based vs. Model-Based Model-Based Algorithms

Hybrid Example-Based Rule-Based MT: Feeding Apertium with Bilingual Chunks Felipe S

Hybrid Rule-Based Example-Based MT: Feeding Apertium with Sub-sentential Translation Units

Decision Rule-based Algorithm for Ordinal Classification based on Rank Loss Minimization

1 Model-Based Classification Model-Based Classification Model-based approach Build a

Robustness of model-based control Emo Todorov Roboti LLC University of Washington Model-based

Rule Based Systems and Networks for Knowledge Discovery in Big Data Alexander Gegov, David

Contjnuous Experimentatjon and A/B Testjng: A Mapping Study Rasmus Ros and Per Runeson A/B

Using unsupervised corpus-based methods to build rule-based machine translation systems Felipe

Dagstuhl-Seminar on Rule Markup Techniques 7th of February, 2002 XL: A rule-based query and

Integrating Workload Specification and Extraction for Model- Based and Measurement-Based

First Steps towards a Lingua Franca for Computing: Rule-based Approaches in CHR Thom Fr uhwirth

Lecture 4: Rule-based classification and regression Felix Held, Mathematical Sciences

Data Mining Classification: Alternative Techniques Lecture Notes for Chapter 4 Rule-Based

CLIPS (C Language Integrated Production System) Rule-based programming language Based on OPS-5

1 Miniature Mode Estimation Example ACS Subsystem GHe Pressure Transducer (S) Model

Automatic acquisition of Named Entities for Rule-Based Machine Translation Antonio Toral , Andy

Rule-Based Trust Assessment on the Semantic Web Ian Jacobi 1 , Lalana Kagal 1 , Ankesh Khandelwal

Collaborative Model-based Analysis for Uncertainty Reduction and Quality-based Refactoring Catia