Test automation Building automatically repeatable test suites Test - PowerPoint PPT Presentation

Test automation Building automatically repeatable test suites

Test automation n Test automation is software that automates any aspect of testing TA–2

Test automation – 2 n Test automation is software that automates any aspect of testing n Generating test inputs and expected results TA–3

Test automation – 3 n Test automation is software that automates any aspect of testing n Generating test inputs and expected results n Running test suites without manual intervention TA–4

Test automation – 4 n Test automation is software that automates any aspect of testing n Generating test inputs and expected results n Running test suites without manual intervention n Evaluating pass/no pass TA–5

Test automation – 5 n Test automation is software that automates any aspect of testing n Generating test inputs and expected results n Running test suites without manual intervention n Evaluating pass/no pass n Testing must be automated to be effective and repeatable TA–6

Automated testing steps n Exercise the implementation with the automated test suite TA–7

Automated testing steps – 2 n Exercise the implementation with the automated test suite n Repair faults revealed by failures TA–8

Automated testing steps – 3 n Exercise the implementation with the automated test suite n Repair faults revealed by failures n Rerun the test suite on the revised implementation (includes test suite) TA–9

Automated testing steps – 4 n Exercise the implementation with the automated test suite n Repair faults revealed by failures n Rerun the test suite on the revised implementation (includes test suite) n Evaluate test suite coverage TA–10

Automated testing steps – 5 n Exercise the implementation with the automated test suite n Repair faults revealed by failures n Rerun the test suite on the revised implementation (includes test suite) n Evaluate test suite coverage n Enhance the test suite to achieve coverage goals TA–11

Automated testing steps – 6 n Exercise the implementation with the automated test suite n Repair faults revealed by failures n Rerun the test suite on the revised implementation (includes test suite) n Evaluate test suite coverage n Enhance the test suite to achieve coverage goals n Rerun the automated test suite to support regression testing TA–12

Automated testing advantages n Permits quick and efficient verification of bug fixes TA–13

Automated testing advantages – 2 n Permits quick and efficient verification of bug fixes n Speeds debugging and reduces “ bad fixes ” TA–14

Automated testing advantages – 3 n Permits quick and efficient verification of bug fixes n Speeds debugging and reduces “ bad fixes ” n Allows consistent capture and analysis of test results TA–15

Automated testing advantages – 4 n Permits quick and efficient verification of bug fixes n Speeds debugging and reduces “ bad fixes ” n Allows consistent capture and analysis of test results n Its cost is recovered through increased productivity and better system quality TA–16

Automated testing advantages – 5 n Permits quick and efficient verification of bug fixes n Speeds debugging and reduces “ bad fixes ” n Allows consistent capture and analysis of test results n Its cost is recovered through increased productivity and better system quality n More time to design better tests, rather than entering and reentering tests TA–17

Automated testing advantages – 6 n Unlike manual testing, it is not error-prone and tedious TA–18

Automated testing advantages – 7 n Unlike manual testing, it is not error-prone and tedious n Only feasible way to do regression testing TA–19

Automated testing advantages – 8 n Unlike manual testing, it is not error-prone and tedious n Only feasible way to do regression testing n Necessary to run long and complex tests TA–20

Automated testing advantages – 9 n Unlike manual testing, it is not error-prone and tedious n Only feasible way to do regression testing n Necessary to run long and complex tests n Easily evaluates large quantities of output TA–21

Limitations and caveats n A skilled tester can use his experience to react to manual testing results by improvising effective tests TA–22

Limitations and caveats – 2 n A skilled tester can use his experience to react to manual testing results by improvising effective tests n Automated tests are expensive to create and maintain TA–23

Limitations and caveats – 3 n A skilled tester can use his experience to react to manual testing results by improvising effective tests n Automated tests are expensive to create and maintain n If the implementation is changing frequently, maintaining the test suite might be difficult TA–24