1.4.3 TEST WORK PRODUCTS Flashcards
Test work products are created as part of
the test process.
Just as there is significant variation in the way that organizations implement the test process, there is also significant variation in the
the types of work products created during that process,
the ways those work products are organized and managed, and
the names used for those work products.
ISO standard (ISO/IEC/IEEE 29119-3) may also serve as a guideline for
test work products.
Many of the test work products described in this section can be captured and managed using
test management tools
defect management tools
Test planning work products typically include
one or more test plans.
The test plan includes information about
the test basis
exit criteria
exit criteria (or definition of done) which will be used during test
monitoring and control.
Test monitoring and control work products typically include various types of test reports, including
test progress reports (ongoing and/or a regular basis)
and
test summary reports (at milestones completion).
All test reports should provide
up-to-date and audience-relevant details about the test progress
a summary of the test execution results
Test monitoring and control work products should also address project management concerns, such as
task completion,
resource allocation and usage
effort.
Test analysis work products include defined and prioritized test conditions, each of which is ideally
bidirectionally traceable to the specific element(s) of the test basis it covers.
For exploratory testing, test analysis may involve the creation of
test charters.
Test analysis may also result in the discovery and reporting of defects in
the test basis.
Test design results in test cases and sets of test cases to exercise
the test conditions defined in test analysis.
It is often a good practice to design high-level test cases,
without concrete values for input data and expected results.
high-level test cases are reusable across
multiple test cycles with different concrete data,
Ideally, each test case is bidirectionally traceable to
the test condition(s) it covers.
Test design also results in:
the design and/or identification of the necessary test data
the design of the test environment
the identification of infrastructure and tools
the extent to which Test design results are documented
varies significantly.
Test implementation work products include:
Test procedures and the sequencing of those test procedures
Test suites
A test execution schedule
Ideally, once test implementation is complete, achievement of coverage criteria established in the test plan can be demonstrated via bi-directional traceability
between test procedures and specific elements of the test basis,
through the test cases
and test conditions.
In some cases, test implementation involves creating work products using or used by tools, such as
service virtualization
automated test scripts.
Test implementation also may result in the creation and verification of
test data and the test environment.
The completeness of the documentation of the data and/or environment verification results
may vary significantly.
The test data serve to assign concrete values to
the inputs of test cases.
expected results of test cases.
concrete values, together with explicit directions about the use of the concrete values, turn high-level test cases into
executable low-level test cases.
The same high-level test case may use different test data when
executed on different releases of the test object.
The concrete expected results which are associated with concrete test data are identified by
using a test oracle.
In exploratory testing, some test design and implementation work products may be
created during test execution,
the extent to which exploratory tests (and their traceability to specific elements of the test basis) are documented
may vary significantly.
Test conditions defined in test analysis may be
further refined in test implementation.
Test execution work products include:
Documentation of the status of individual test cases or test procedures
Defect reports
Documentation about which test item(s), test object(s), test tools, and testware were involved in
the testing
test item(s) involved in the testing
test object(s), test tools, and testware
some test cases or test procedures status
ready to run, pass, fail, blocked, deliberately skipped, etc.
Ideally, once test execution is complete, the status of each element of the test basis
can be determined and reported via bi-directional traceability with the associated the test procedure(s).
For example, once test execution is complete, we can say which requirements have
passed all planned tests,
failed tests and/or have defects associated with them
planned tests still waiting to be run.
determination and reporting the status of each element of the test basis, enables
verification that the coverage criteria have been met
the reporting of test results in terms that are understandable to stakeholders.
Test completion work products include
test summary reports,
action items for improvement of subsequent projects or iterations,
change requests or product backlog items
finalized testware