design for testability
play

Design for Testability Maurcio F. Aniche M.F.Aniche@tudelft.nl - PowerPoint PPT Presentation

Nov 17, 2023 •107 likes •268 views

Design for Testability Maurcio F. Aniche M.F.Aniche@tudelft.nl Controllability and Observability Controllability determines the work it takes to set up and run test cases and the extent to which individual functions and features of the

  1. Design for Testability Maurício F. Aniche M.F.Aniche@tudelft.nl

  2. Controllability and Observability • Controllability determines the work it takes to set up and run test cases and the extent to which individual functions and features of the system under test (SUT) can be made to respond to test cases. • Observability determines the work it takes to set up and run test cases and the extent to which the response of the system under test (SUT) to test cases can be verified. • See Robert Binder’s post on Testability: https://robertvbinder.com/software-testability-part-2-controllability- and-observability/

  3. Hexagonal architecture (aka ports and adapters) Extracted from http://alistair.cockburn.us/Hexagonal+architecture

  4. Harder than it seems!

  5. Clear and well-defined interfaces Encapsulation plays a big role here!

  6. Dependency Inversion • Make dependencies injectable.

  7. Don’t Ask Tell!

  8. Encapsulation • Behavior should be in the right place. • Otherwise, test gets too complicated. • Indirect testing smell. • Law of Demeter • Avoid a.getB().getC().getD().doSomething(); • Much harder to arrange the test, i.e., you have to arrange states in A, B, C, and D.

  9. Should I test a private method? • Probably not. • You should test the class from its public interface. • If you want to test the private method in an isolated way, that’s the test telling you that your code is not cohesive.

  10. Static methods • Now that you know mock, what can we do with static methods? • Static methods can’t be mocked. • Therefore, AVOID THEM .

  11. Don’t be afraid of creating layers • How can I test date/time related things? • How can I test environment-dependent things? • Create a layer on top of APIs • These layers are easily mockable • The Restfulie.NET case: • https://github.com/mauricioaniche/restfulie.net/blob/master/Restful ie.Server/Marshalling/UrlGenerators/AspNetMvcUrlGenerator.cs

  12. Let’s code • The Clock abstraction example. • https://gist.github.com/mauricioaniche/312249471a71dddeeb74991 774529b7b

  13. Solution • We added a layer on top of Calendar. • Again, do not be afraid of adding layers to facilitate testability. • Solution: https://gist.github.com/mauricioaniche/2200d8c1dcab41e7c4dddcc46211f4c0

  14. http://misko.hevery.com/attachments/Guide- Writing%20Testable%20Code.pdf

  15. Some of the flaws listed in the Testability Guide, by Hevery • Flaw: Constructor does Real Work • Flaw: Digging into Collaborators • Flaw: Brittle Global State & Singletons • Flaw: Class Does Too Much • His tool, Testability Explorer (https://github.com/mhevery/testability- explorer) never became a hit. • I’m looking for BSc and MSc students who want to revive this idea!

  16. References • Compulsory: Fowler. M. Mocks aren’t Stubs. https://martinfowler.com/articles/mocksArentStubs.html • Freeman, S., & Pryce, N. (2009). Growing object-oriented software, guided by tests . Pearson Education. • Martin, R. C. (2002). Agile software development: principles, patterns, and practices . Prentice Hall. • Compulsory: Cockburn, A. Hexagonal architecture. http://alistair.cockburn.us/Hexagonal+architecture • Compulsory: Hevery, M. Guide: Writing testable code . http://misko.hevery.com/attachments/Guide- Writing%20Testable%20Code.pdf

Recommend

Design Principle 10: Design for Vragen Testability Testability Waarom is design

Design Principle 10: Design for Vragen Testability Testability Waarom is design

Design Principle 10: Design for Vragen Testability Testability Waarom is design noodzakelijk? Take steps to make testing easier g j g Design a program to automatically test the software Is design hetzelfde als programmeren?

327 views • 4 slides
Design for Testability 1 Basic Concept Design for testability (DFT) Design techniques

Design for Testability 1 Basic Concept Design for testability (DFT) Design techniques

9/19/2012 Design for Testability 1 Basic Concept Design for testability (DFT) Design techniques that make test generation and test application cost-effective. DFT methods for digital circuits: Ad-hoc methods Structured

760 views • 23 slides
Design for Testability Outline Ad Hoc Design for Testability Techniques Method of test

Design for Testability Outline Ad Hoc Design for Testability Techniques Method of test

Design for Testability Outline Ad Hoc Design for Testability Techniques Method of test points Multiplexing and demultiplexing of test points Time sharing of I/O for normal working and testing modes Partitioning of registers

1.13k views • 71 slides
Design for Testability 1 Basic Concept Design for testability (DFT) Design techniques

Design for Testability 1 Basic Concept Design for testability (DFT) Design techniques

Design for Testability 1 Basic Concept Design for testability (DFT) Design techniques that make test generation and test application cost-effective. DFT methods for digital circuits: Ad-hoc methods Ad-hoc methods

960 views • 46 slides
UMBC A B M A L T F O U M B C I M Y O R T 1 (Nov 20, 2001) I E S R C E O

UMBC A B M A L T F O U M B C I M Y O R T 1 (Nov 20, 2001) I E S R C E O

VLSI Design Verification and TestTestability Measures CMSC 691x Testability Measures An attempt to quantify testability by Goldstein 79 and Grason 79 resulted in two testability measures, controllability and observability . Controllability

438 views • 15 slides
Testability Reid Holmes Testability The degree to which a system or component facilitates the

Testability Reid Holmes Testability The degree to which a system or component facilitates the

http://robertvbinder.com/wp-content/uploads/rvb-pdf/talks/GTAC-2010-Binder-Testability.pdf https://www.youtube.com/watch?v=1keyEiJHqPw https://www.youtube.com/watch?v=XcT4yYu_TTs Testability Reid Holmes Testability The degree to which a system

407 views • 20 slides
EMT 368 Reliability and Testability in Integrated Circuit Design School of Microelectronic

EMT 368 Reliability and Testability in Integrated Circuit Design School of Microelectronic

EMT 368 Reliability and Testability in Integrated Circuit Design School of Microelectronic Engineering UniMAP A. Harun 1 Course content Reliability and availability concept Robust design principle Time and failure dependent

786 views • 32 slides
21. Design for Testability 40 J. A. Abraham 60 Department of Electrical and Computer

21. Design for Testability 40 J. A. Abraham 60 Department of Electrical and Computer

mm 40 60 80 100 120 21. Design for Testability 40 J. A. Abraham 60 Department of Electrical and Computer Engineering The University of Texas at Austin VLSI Design Fall 2015 80 November 11, 2015 ECE Department, University of Texas at

543 views • 50 slides
Design for Testability (DFT) Sh Sh Shaahin Hessabi Shaahin Hessabi hi hi H H bi bi

Design for Testability (DFT) Sh Sh Shaahin Hessabi Shaahin Hessabi hi hi H H bi bi

Testability: Lecture 23 Design for Testability (DFT) Sh Sh Shaahin Hessabi Shaahin Hessabi hi hi H H bi bi Department of Computer Engineering Department of Computer Engineering Sharif University of Technology Sharif University of

650 views • 43 slides
Canary Numbers: Design for Light-weight Online Testability of True Random Number Generators

Canary Numbers: Design for Light-weight Online Testability of True Random Number Generators

Canary Numbers: Design for Light-weight Online Testability of True Random Number Generators Vladimir Roi, Bohan Yang, Nele Mentens and Ingrid Verbauwhede Acknowledgment This work is supported in part by the European Commission through the

348 views • 19 slides
Report on Def Stan 00-42 Pt 4 Testability ake consultants Objective 1 Review 00-42 from

Report on Def Stan 00-42 Pt 4 Testability ake consultants Objective 1 Review 00-42 from

Report on Def Stan 00-42 Pt 4 Testability ake consultants Objective 1 Review 00-42 from perspective of an MOD IPT contracting for Testability. Generally inadequate Liaise with MOD R&M for input or requirements. Lead to

280 views • 10 slides
CIS 4930 Digital Circuit Testing Design For Testability Dr. Hao Zheng Comp Sci & Eng Univ

CIS 4930 Digital Circuit Testing Design For Testability Dr. Hao Zheng Comp Sci & Eng Univ

CIS 4930 Digital Circuit Testing Design For Testability Dr. Hao Zheng Comp Sci & Eng Univ of South Florida Introduction Testing cost Test gen., fault sim., test equipment, test process (fault detection and location), etc

572 views • 55 slides
Testability Analysis 1 Why Testability Analysis? Need approximate measure of: Difficulty

Testability Analysis 1 Why Testability Analysis? Need approximate measure of: Difficulty

8/22/2012 Testability Analysis 1 Why Testability Analysis? Need approximate measure of: Difficulty of setting internal circuit lines to 0 or 1 by setting primary input values. Difficulty of observing internal circuit lines by

322 views • 17 slides
A new approach for software testability Lydie du Bousquet Laboratoire dInformatique de

A new approach for software testability Lydie du Bousquet Laboratoire dInformatique de

A new approach for software testability Lydie du Bousquet Laboratoire dInformatique de Grenoble (LIG) Test and Testability Test is a validation method Widely used in Software companies BUT software testing is expensive Time

587 views • 10 slides
UMBC A B M A L T F O U M B C I M Y O R T 1 (12/4/06) I E S R C E O V U

UMBC A B M A L T F O U M B C I M Y O R T 1 (12/4/06) I E S R C E O V U

VLSI Design Verification and Test DFT & Scan I CMPE 646 Overview Design for testability (DFT) makes it possible to: Assure the detection of all faults in a circuit. Reduce the cost and time associated with test development.

326 views • 20 slides
Statistical Inference on Large Contingency Tables: Convergence, Testability, Stability Marianna

Statistical Inference on Large Contingency Tables: Convergence, Testability, Stability Marianna

Preliminaries Convergence of contingency tables Testability Homogeneous partitions, spectra Application References Statistical Inference on Large Contingency Tables: Convergence, Testability, Stability Marianna Bolla Institute of

839 views • 60 slides
Digital Testing Lecture 8: Testability Measures Instructor: Shaahin Hessabi Department of

Digital Testing Lecture 8: Testability Measures Instructor: Shaahin Hessabi Department of

Digital Testing Lecture 8: Testability Measures Instructor: Shaahin Hessabi Department of Computer Engineering Sharif University of Technology Adapted from lecture notes prepared by the book authors Sharif University of Technology Testability:

636 views • 36 slides
220 Maintainability: How easy is it to make changes and fix bugs? Testability: How easy is it to

220 Maintainability: How easy is it to make changes and fix bugs? Testability: How easy is it to

220 Maintainability: How easy is it to make changes and fix bugs? Testability: How easy is it to check for correctness and monitor and adapt the running system? Affordability: How much does it cost to develop and to run? Understandability: Can new

600 views • 47 slides
On the Complexity of k-Piecewise Testability and the Depth of Automata Tom Masopust and

On the Complexity of k-Piecewise Testability and the Depth of Automata Tom Masopust and

On the Complexity of k-Piecewise Testability and the Depth of Automata Tom Masopust and Michal Thomazo TU Dresden, Germany DLT 2015 1 / 24 Problems 2 / 24 Problems Problem (k-PiecewiseTestability) Input: an automaton (min. DFA or NFA)

898 views • 44 slides
A BIST Implementation Framework for Supporting Field Testability and Configurability in an

A BIST Implementation Framework for Supporting Field Testability and Configurability in an

DSN 2007 Workshop June 28, 2007 A BIST Implementation Framework for Supporting Field Testability and Configurability in an Automotive SOC Amit Dutta, Srinivasulu Alampally, Arun Kumar and Rubin Parekhji Texas Instruments, Bangalore

318 views • 20 slides
High Performance Graph Convolutional Networks with Applications in Testability Analysis Yuzhe Ma 1

High Performance Graph Convolutional Networks with Applications in Testability Analysis Yuzhe Ma 1

High Performance Graph Convolutional Networks with Applications in Testability Analysis Yuzhe Ma 1 , Haoxing Ren 2 , Brucek Khailany 2 , Harbinder Sikka 2 , Lijuan Luo 2 , Karthikeyan Natarajan 2 , Bei Yu 1 1 The Chinese University of Hong Kong 2

532 views • 18 slides
USING MACHINE LEARNING FOR VLSI TESTABILITY AND RELIABILITY Mark Ren, Miloni Mehta TAKE-HOME

USING MACHINE LEARNING FOR VLSI TESTABILITY AND RELIABILITY Mark Ren, Miloni Mehta TAKE-HOME

USING MACHINE LEARNING FOR VLSI TESTABILITY AND RELIABILITY Mark Ren, Miloni Mehta TAKE-HOME MESSAGES Machine learning can improve approximate solutions for hard problems. Machine learning can accurately predict and replace brute force

429 views • 40 slides
Sources of Randomness in Digital Devices and Their Testability Viktor F ISCHER Univ Lyon,

Sources of Randomness in Digital Devices and Their Testability Viktor F ISCHER Univ Lyon,

Sources Characterization Dedicated tests Conclusions Sources of Randomness in Digital Devices and Their Testability Viktor F ISCHER Univ Lyon, UJM-Saint-Etienne, CNRS Laboratoire Hubert Curien UMR 5516 F-42023, SAINT-ETIENNE, France

882 views • 30 slides
TDDE45 - Lecture 7: Testability Martin Sjlund Department of Computer and Information Science

TDDE45 - Lecture 7: Testability Martin Sjlund Department of Computer and Information Science

TDDE45 - Lecture 7: Testability Martin Sjlund Department of Computer and Information Science Linkping University 2020-10-06 Part I Testing What is testing? This course is not a course primarily in Software Testing (TDDD04 HT1).

310 views • 19 slides

More recommend