6.2 Benefits and Risks of Test Automation

Question 1

What types of repetitive manual work can test automation save time on?

Answer 1

Executing regression tests, re-entering the same test data, comparing expected results vs actual results, and checking against coding standards.

Question 2

What are examples of how automation can reduce simple human errors through greater consistency and repeatability?

Answer 2

• tests are consistently derived from requirements
• test data is created in a systematic manner
• tests are executed by a tool in the same order with the same frequency

Question 3

How can automation support test management and test reporting?

Answer 3

Easier access to information about testing including statistics, graphs, and aggregated data about progress, defect rates, and execution duration. Can also provide more objective assessment and coverage and provide measures too complicated for humans to easily derive.

Question 4

What benefits does reduced test execution time provide?

Answer 4

Earlier defect detection, faster feedback, and faster time to market.

More time for testers to design new, deeper, and more effective tests.

Question 5

What are some risk factors to consider when choosing test tools?

Answer 5

• Choosing a tool that complies with regulatory requirement and safety standards.
• Choosing an automation tool that is compatible with your development platform.
• The dependability of the tool vendor; will they go out of business, retire the tool, sell the tool to a different vendor, or provide poor support?
• The reliability of open source software, which may be abandoned, or which may require more frequent updates as active development occurs.

Question 6

What are some risk factors to consider when using test tools?

Answer 6

• Unrealistic expectations about the benefits of a tool, including functionality and ease of use.
• Inaccurate estimates of time, costs, and effort required to introduce a tool, maintain test scripts, and change the existing manual test process.
• Using a test tool when manual testing is more appropriate.
• Relying on a tool too much, or ignoring the need for human critical thinking.