5.3. Test Monitoring, Test Control and Test Completion

Question 1

What is the purpose of test monitoring?

Answer 1

Gathering information about testing to assess progress and measure if test exit criteria are satisfied.

Question 2

How does test control use information from test monitoring?

Answer 2

It provides guidance and corrective actions to achieve effective and efficient testing.

Question 3

Give examples of control directives in test control.

Answer 3

Reprioritizing tests, re-evaluating test item criteria, adjusting the test schedule, and adding new resources.

Question 4

What activities are involved in test completion?

Answer 4

Collecting data from completed test activities to consolidate experience, testware, and relevant information.

Question 5

What types of metrics are gathered in testing?

Answer 5

Project progress metrics, test progress metrics, product quality metrics, defect metrics, risk metrics, coverage metrics, and cost metrics.

Question 6

What do project progress metrics include?

Answer 6

Task completion, resource usage, and test effort.

Question 7

What do test progress metrics track?

Answer 7

Test case implementation progress, test environment preparation, number of test cases run/not run, passed/failed, and test execution time

Question 8

What are some examples of product quality metrics?

Answer 8

Availability, response time, and mean time to failure

Question 9

What are common defect metrics?

Answer 9

Number and priorities of defects found/fixed, defect density, and defect detection percentage.

Question 10

What do risk metrics measure?

Answer 10

Residual risk level

Question 11

What do coverage metrics include?

Answer 11

Requirements coverage and code coverage.

Question 12

What do cost metrics track?

Answer 12

Cost of testing and organizational cost of quality.

Question 13

What is the purpose of test reporting?

Answer 13

To summarize and communicate test information during and after testing.

Question 14

What information is included in test progress reports?

Answer 14

Test period, test progress, impediments, test metrics, new/changed risks, and planned testing for the next period.

Question 15

What is typically included in a test completion report?

Answer 15

Test summary, evaluation of testing and product quality, deviations from the test plan, testing impediments, test metrics, unmitigated risks, and lessons learned.

Question 16

What are some methods for communicating test status?

Answer 16

Verbal communication, dashboards, electronic channels, online documentation, and formal test reports.

Question 17

How does the audience influence test reporting?

Answer 17

Reporting to team members is often frequent and informal, while reporting for a completed project is more formal and follows a set template.

Question 18

Why should communication be tailored to different stakeholders?

Answer 18

Different stakeholders are interested in different types of information, and communication should be adjusted accordingly.