Towards Model-Based Testing of Domain-Specific Modelling Languages - PowerPoint PPT Presentation

Towards Model-Based Testing of Domain-Specific Modelling Languages J. Merilinna, Olli-Pekka Puolitaival, J. Pärssinen

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Index • Testing Domain-Specific Modelling Languages (DSML) • Model-Based Testing (MBT) • Application Testing • Modelling Language Testing • Test Suite Generation in Practice • Case Lego • Future research 2

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Testing Domain-Specific Modelling Languages (DSML) • Currently: Manual testing during iterative and incremental DSML development • Problems: • Test applications in synch in metamodel? • Test coverage • How DSML testing can be systematized and automated ? 3

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Model-Based Testing (MBT) • MBT is a black box testing Implementing MBT technique • Phases: Requirements 1. Modelling 2. Test generation Modelling 3. Test execution Implementing • MBT is decreasing test suite maintenance efforts and Test case generation improves coverage. Test Execution Application 4

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Application Testing • Tests and the implementation are generated from the same model • Code generator and metamodel (from the utilized parts) are under testing • Comprehensive test suite is automatically generated and always in synch with implementation 5

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Modelling Language Testing • One application can be considered as one test case. Multiple test cases are required! • Metamodel describes rules of the language • We argue that applications can be generated from metamodel definitions 6

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Test Suite Generation in Practice • DSM tool requirements Metaedit+ Conformiq Qtronic L M Metamodel Q • Allows exporting the Met2QML metamodel and importing Metamodel the application models Application XML generator • MetaEdit+ fulfils the Application M L Q models requirements Code Application Mod2QML generator model • MBT tool requirements Test generator • Supports model importing Test suite and exporting the test Testing Test executor cases Application • Conformiq Qtronic fulfils the requirements 7

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Case Lego: Generating Application Application model Generated code Compiling Application Execution 8

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Application Model 9

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Generated Code 10

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Compiling 11

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Application Execution 12

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Case Lego: Generating Tests Application model Model into QML format Test cases Test generation 13

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Application Model 14

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Transform the Model into QML Format 15

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Test Generation 16

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Test Execution 17

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Case Lego: One Generated Test Case 1. 2. 3. 1. 2. 3. 18

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Future Research • More applications model tests • Metamodel testing and make a demo of that • Identifying the most potential domains, and possible restrictions. • Identifying effects in quality, processes… 19

VTT TECHNICAL RESEARCH CENTRE OF FINLAND Questions? 20