chapter 5 Managing the test activities Flashcards
The process of recognizing, recording, classifying, investigating, resolving and disposing of defects
Defect management
- Documentation of the occurrence, nature, and status of a defect. Synonyms: bug report
Defect report
The set of conditions for officially starting a defined task. Reference: Gilb and Graham See also: exit criteria
Entry criteria
The set of conditions for officially completing a defined task.
Synonyms?
Exit criteria
Synonyms: test completion criteria, completion criteria
- A risk impacting the quality of a product. See also: risk
Product risk
A risk that impacts project success. See also: risk
Project risk
A factor that could result in future negative consequences.
Risk
The overall process of risk identification and risk assessment
Risk analysis
The process to examine identified risks and determine the risk level
Risk assessment
The overall process of risk mitigation and risk monitoring
Risk control
- The process of finding, recognizing and describing risks.
Risk identification
- The measure of a risk defined by risk impact and risk likelihood.
Risk level
- The process for handling risks
Risk management
- The process through which decisions are reached and protective measures are implemented for reducing or maintaining risks to specified levels
Risk mitigation
- The activity that checks and reports the status of known risks to stakeholders
Risk monitoring
- Testing in which the management, selection, prioritization, and use of testing activities and resources are based on corresponding risk types and risk levels.
Risk-based testing
- The manner of implementing testing tasks
Test approach
- A type of test report produced at completion milestones that provides an evaluation of the corresponding test items against exit criteria.
Test completion report
The activity that develops and applies corrective actions to get a test project on track when it deviates from what was planned. See also: test management
Test control
The activity that checks the status of testing activities, identifies any variances from planned or expected, and reports status to stakeholders. See also: test management
Test monitoring
Documentation describing the test objectives to be achieved and the means and the schedule for achieving them, organized to coordinate testing activities. Reference: After ISO 29119-1 See also: master test plan, level test plan, test scope
Test plan
- The activity of establishing or updating a test plan.
Test planning
- A type of periodic test report that includes the progress of test activities against a baseline, risks, and alternatives requiring a decision. Synonyms: test status report
Test progress report
- A graphical model representing the relationship of the amount of testing per level, with more at the bottom than at the top
Test pyramid
A classification model of test types/test levels in four quadrants, relating them to two dimensions of test objectives: supporting the product team versus critiquing the product, and technology-facing versus business-facing
Testing quadrants
A test plan describes the objectives, resources and processes for a test project. A test plan:
Documents the means and schedule for achieving test objectives
Helps to ensure that the performed test activities will meet the established criteria
Serves as a means of communication with team members and other stakeholders
Demonstrates that testing will adhere to the existing test policy and test strategy (or explains why the testing will deviate from them)
the efforts needed to achieve the test project objectives.
Test Plan
In iterative SDLCs, typically two kinds of planning occur:
release planning and iteration planning
Test planning guides the testers’ thinking and forces the testers to confront the future challenges related to
risks, schedules, people, tools, costs, effort, etc.
The typical content of a test plan includes:
Context of testing (e.g., scope, test objectives, constraints, test basis)
Assumptions and constraints of the test project
Stakeholders (e.g., roles, responsibilities, relevance to testing, hiring and training needs)
Communication (e.g., forms and frequency of communication, documentation templates)
Risk register (e.g., product risks, project risks)
Test approach (e.g., test levels, test types, test techniques, test deliverables, entry criteria and exit criteria, independence of testing, metrics to be collected, test data requirements, test environment requirements, deviations from the organizational test policy and test strategy)
Budget and schedule
looks ahead to the release of a product, defines and re-defines the product backlog, and may involve refining larger user stories into a set of smaller user stories.
It also serves as the basis for the test approach and test plan across all iterations.
release planning
Testers involved in release planning participate in
writing testable user stories and acceptance criteria (see section 4.5),
participate in project and quality risk analyses (see section 5.2),
estimate test effort associated with user stories (see section 5.1.4),
determine the test approach,
and plan the testing for the release.
looks ahead to the end of a single iteration and is concerned with the iteration backlog.
iteration planning
Testers involved in iteration planning:
participate in the detailed risk analysis of user stories,
determine the testability of user stories,
break down user stories into tasks (particularly testing tasks),
estimate test effort for all testing tasks,
identify and refine functional and non-functional aspects of the test object.
define the preconditions for undertaking a given activity.
Entry criteria
If entry criteria are not met, it is likely that the activity will prove to be
more difficult, time-consuming, costly, and riskier.
define what must be achieved in order to declare an activity completed.
Exit criteria
Entry criteria and exit criteria should be
defined for each test level, and will differ based on the test objectives.
Typical entry criteria include:
availability of resources (e.g., people, tools, environments, test data, budget, time),
availability of testware (e.g., test basis, testable requirements, user stories, test cases),
and initial quality level of a test object (e.g., all smoke tests have passed).
Typical exit criteria include:
measures of thoroughness (e.g., achieved level of coverage, number of unresolved defects, defect density, number of failed test cases),
and completion criteria (e.g., planned tests have been executed, static testing has been performed, all defects found are reported, all regression tests are automated).
Running out of time or budget can also be viewed as valid
exit criteria
Even without other exit criteria being satisfied, it can be acceptable to end testing under such circumstances, if the stakeholders have reviewed and accepted the risk to go live without further testing.
In Agile software development, exit criteria are often called
Definition of Done
defining the team’s objective metrics for a releasable item
Definition of Done