MAV-Vis: A Notation for Model Uncertainty M.Famelis, S.Santosa Introduction MAV-Vis: A Notation for Model Uncertainty Design Uncertainty MAV-Vis Michalis Famelis and Stephanie Santosa User Study Conclusion University of Toronto May 18th, 2013 Models in Software Engineering Workshop at ICSE 1 / 27
MAV-Vis: A Notation for Design Uncertainty Model Uncertainty M.Famelis, S.Santosa “The reality of today’s software systems requires us to consider Introduction uncertainty as a first-class concern in the design, implementation, Design and deployment of those systems.” [Garlan, 2010] Uncertainty MAV-Vis Our focus: User Study Uncertainty about design decisions – the contents of a model. Conclusion Our agenda: Enable MBSE with design uncertainty using Partial models . 2 / 27
MAV-Vis: A Notation for Design Uncertainty Model Uncertainty M.Famelis, S.Santosa “The reality of today’s software systems requires us to consider Introduction uncertainty as a first-class concern in the design, implementation, Design and deployment of those systems.” [Garlan, 2010] Uncertainty MAV-Vis Our focus: User Study Uncertainty about design decisions – the contents of a model. Conclusion Our agenda: Enable MBSE with design uncertainty using Partial models . 2 / 27
MAV-Vis: A Notation for Usable Notation for Uncertainty Model Uncertainty M.Famelis, Partial models: effective for automated reasoning. S.Santosa However: Introduction Existing notation (“MAV-Text”) developed ad-hoc. Design Uncertainty Is it effective for human communication? MAV-Vis User Study Need to maximize cognitive effectiveness . Conclusion “Physics of Notations” [Moody, 2009] Principles for designing graphical languages. What we did: • Developed a new notation: MAV-Vis • Evaluated our implementation with a user study: “Does MAV-Vis improve cognitive effectiveness?” Speed, ease, accuracy for reading and writing. 3 / 27
1 Introduction 2 Design Uncertainty 3 Designing MAV-Vis 4 User Study 5 Conclusion
MAV-Vis: A Notation for What is Design Uncertainty Model Uncertainty Example: a simple class diagram. M.Famelis, S.Santosa Introduction What does the modeler know ? Design Uncertainty MAV-Vis User Study Conclusion 5 / 27
MAV-Vis: A Notation for What is Design Uncertainty Model Uncertainty Example: a simple class diagram. M.Famelis, S.Santosa Introduction What does the modeler not know ? Design Uncertainty MAV-Vis User Study Conclusion 5 / 27
MAV-Vis: A Notation for What is Design Uncertainty Model Uncertainty Example: a simple class diagram. M.Famelis, S.Santosa Introduction What does the modeler not know ? Design Uncertainty MAV-Vis User Study Conclusion 5 / 27
MAV-Vis: A Notation for What is Design Uncertainty Model Uncertainty Example: a simple class diagram. M.Famelis, S.Santosa Introduction What does the modeler not know ? Design Uncertainty MAV-Vis User Study Conclusion 5 / 27
MAV-Vis: A Notation for What is Design Uncertainty Model Uncertainty Example: a simple class diagram. M.Famelis, S.Santosa Introduction What does the modeler not know ? Design Uncertainty MAV-Vis User Study Conclusion 5 / 27
MAV-Vis: A Notation for Uncertainty: a Set of Possible Model Uncertainty Refinements M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion If we remove all uncertainty, we have a concrete refinement . 6 / 27
MAV-Vis: A Notation for Modeling Uncertainty with Partial Model Uncertainty Models M.Famelis, S.Santosa Explicating uncertainty in a partial model. Introduction Design Uncertainty MAV-Vis User Study Conclusion 7 / 27
MAV-Vis: A Notation for Modeling Uncertainty with Partial Model Uncertainty Models M.Famelis, S.Santosa Explicating uncertainty in a partial model. Introduction Design Uncertainty MAV-Vis User Study Conclusion • M ay: Element is optional. 7 / 27
MAV-Vis: A Notation for Modeling Uncertainty with Partial Model Uncertainty Models M.Famelis, S.Santosa Explicating uncertainty in a partial model. Introduction Design Uncertainty MAV-Vis User Study Conclusion • M ay: Element is optional. • A bs: Element can be multiplied to many copies. 7 / 27
MAV-Vis: A Notation for Modeling Uncertainty with Partial Model Uncertainty Models M.Famelis, S.Santosa Explicating uncertainty in a partial model. Introduction Design Uncertainty MAV-Vis User Study Conclusion • M ay: Element is optional. • A bs: Element can be multiplied to many copies. • V ar: Element can be merged with others. 7 / 27
MAV-Vis: A Notation for Modeling Uncertainty with Partial Model Uncertainty Models M.Famelis, S.Santosa Explicating uncertainty in a partial model. Introduction Design Uncertainty MAV-Vis User Study Conclusion • M ay: Element is optional. • A bs: Element can be multiplied to many copies. • V ar: Element can be merged with others. • O W: Model is incomplete. 7 / 27
MAV-Vis: A Notation for Modeling Uncertainty with Partial Model Uncertainty Models M.Famelis, S.Santosa Explicating uncertainty in a partial model. Introduction Design Uncertainty MAV-Vis User Study Conclusion • M ay: Element is optional. • A bs: Element can be multiplied to many copies. • V ar: Element can be merged with others. • O W: Model is incomplete. 7 / 27
MAV-Vis: A Notation for “Extended” Partial Models Model Uncertainty M.Famelis, Expressing dependencies between points of uncertainty. S.Santosa e.g. May Model : variant presented in [ICSE’12] Introduction alternative refinements and relations between them. Design Uncertainty MAV-Vis User Study Conclusion 8 / 27
MAV-Vis: A Notation for Existing Notation: MAV-Text Model Uncertainty M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 9 / 27
MAV-Vis: A Notation for Assessing MAV-Text Model Uncertainty M.Famelis, MAV-Text: Textual annotations + Propositional formula S.Santosa Introduction Assessment (based on [Moody, 2009]): Design Pros: Uncertainty • Graphically economical MAV-Vis User Study • 1:1 symbol-concept correspondence Conclusion Cons: • Hard to visually distinguish symbols • Does not intuitively suggest meaning • Must annotate each element individually • Does not take advantage of graphics • Dependencies “hidden” in formula • Must know how to read propositional formulas 10 / 27
1 Introduction 2 Design Uncertainty 3 Designing MAV-Vis 4 User Study 5 Conclusion
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing Var M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing Abs M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing May: a color for each PoU M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing May: identify alternative M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing May: grouping elements in alternatives M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing May: the other alternative M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing May: numbers for different alternatives M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing May: alternative with many parts M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing May: a different PoU M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty Representing May: expressing PoU dependencies M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
MAV-Vis: A Notation for Introducing MAV-Vis Model Uncertainty M.Famelis, S.Santosa Introduction Design Uncertainty MAV-Vis User Study Conclusion 12 / 27
Recommend
More recommend
