A Gamified Requirements Inspection Process for Goal Models Joo - PowerPoint PPT Presentation

[ACM SAC 2018 – RE Track] A Gamified Requirements Inspection Process for Goal Models João Pimentel Emanuel Santos Tarcisio Pereira that’s me Daniel Ferreira Jaelson Castro UFRPE 1

[agenda] 1) Context and Motivation 2) Proposal (gamified process) 3) Evaluation 2 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Inspection is an effective verification approach Bosu, A., Greiler, M., & Bird, C. (2015, May). Characteristics of useful code reviews: An empirical study at microsoft. In Mining Software Repositories (MSR), 2015 IEEE/ACM 12th Working Conference on (pp. 146-156). 3 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Bell, T. E., & Thayer, T. A. (1976, October). Software requirements: Are they really a problem?. In Proceedings of the 2nd international conference on Software engineering (pp. 61-68). IEEE Computer Society Press. 4 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

2015 Survey with 247 practitioners 55% of participants declared to perform some form of requirements review Kassab, M. (2015, August). The changing landscape of requirements engineering practices over the past decade. In Empirical Requirements Engineering (EmpiRE), 2015 IEEE Fifth International Workshop on. 5 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

i * Online Store Internet Orders Handled iStar Shopping Cart Add Item Security Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 6 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Is there an inspection process for i* goal models? 7

Is there a * NO inspection process for goal models? *to the best of our knowledge 8

Ring- i Requirements Inspection Gamified process for i * Models 9 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

10 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Online Store Internet Orders Handled Shopping Cart Add Item Security Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 11 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 12 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 13 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 14 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

2 GOAL ACTOR 3 FINISH 6 ty Decomposition TASK Means- SOFTGOAL link end link nd 15 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 16 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 17 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 18 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 19 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 20 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

1 Online 2 Store Internet Orders Handled Shopping 3 Cart FINISH 4 6 Add Item Security 5 Pay Decomposition Means- Softgoal Task Goal link Actor end link Legend 21 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

123 different cards Based on Literature Interviews Protocol analysis 22 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Some cards are not actual ‘inspection’ 23 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

24 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

[agenda] ● Incomplete coverage ● Not every element is inspected ● Not every inspection heuristic is applied ● Does it make sense to continue after a big change? 25 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Empirical Evaluation 26

18 students 5 groups i * Ring- i i * project training session Questionaire REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models 27

EASE OF USE USEFULNESS Able to execute the process without training Perceived as useful Perceived as easy to use Would recommend Perceived as fun Would use it again? FUN ACCEPTANCE 28 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

29 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Limitations of this evaluation ● Students as subjects ● Small sample size ● Lack of control group for comparison 30

Future work & conclusion 31

Future work ● Expand and update the inspection cards ● Test different game mechanics (e.g. RPG) ● Validate with industry and i* experts ● Create a non-gamified version 32

[context] RE goal models inspection Requirements inspection Ring- i [proposal] [evaluation] 33 Artefacts: www.cin.ufpe.br/~ler/istargame REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Thank you! 34

Analyze the Ring-i process; for the purpose of evaluation and improvement; with respect to its use by non-experts on i*; from the point of view of software engineers; in the context of students applying the process on their own projects. 35 REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Distribution of changes resulting from the Ring-i process 36

Questionnaire answers regarding error discovery 37

Questionnaire answers regarding improvements to the model 38

Questionnaire answers on whether respondents learned more about i* with the process 39

Questionnaire answers regarding usefulness, directly 40

Questionnaire answers regarding process enjoyment 41

Questionnaire answers regarding ease of use, directly 42

Questionnaire answers regarding ease of use, indirectly 43

Questionnaire answers regarding acceptance of the proposal 44