Chapter 5 Flashcards
Why is it important to have a certain degree of independence in testing ?
A certain degree of independence makes the tester more effective at finding defects due to difference between the author’s and the tester’s cognitive biases.
What are the duties of a test manager/leader?
A test manager is involved in the planning, monitoring and control of testing activities and tasks. They devise test objectives, test policies, test strategies and test plans.
Which actors normally perform acceptance level testing?
BA’s, SME’s and users
What is a test plan?
A test plan is a document that outlines test activities for development and maintenance projects. It is a continuous activity performed throughout the product’s lifecycle.
What is test planning influenced by?
The test policy and test strategy.
Where may a test plan be documented?
In a master test plan document or in separate test plans for each test level.
What is a test strategy?
It is a generalized description of the test process.
What is a test approach?
A test approach is a tailored test strategy for a particular project. It is the starting point for selecting the test techniques, test level and test types and for defining entry and exit criteria.
Describe the analytical test strategy.
This strategy is based on an analysis of some factor.
eg. risk based testing
Describe the model based test strategy.
Tests are designed based on some model of a required aspect of the product.
eg. CTD and IGNITE
Describe the methodical test strategy.
Tests are designed based on some predefined set of tests or test conditions.
Describe the process compliant test strategy.
Tests are created based on external rules or standards.
Describe the directed test strategy.
Tests are created primarily by the advice of stakeholders, business domain experts or technology experts.
Describe the regression-averse test strategy.
This strategy is motivated by desire to avoid regression of existing capabilities. This strategy involves resuse of existing testware, extending automation of regression tests and standard test suites.
Describe the reactive test strategy.
Testing is reactive to the component or system being test and the events occur in test execution rather than be pre-planned.
Eg. exploratory testing
What are some factors affecting test effort?
Product characteristics
Development process characteristics
People characteristics
Test results
Without entry criteria being met, what can occur in a project?
Test activities may be more costly, risky, time-consuming or difficult.
Define entry criteria.
Define the preconditions for undertaking a given test activity.
Define exit criteria.
Define the conditions that must be achieved in order to declare a test level or a set of tests completed.
List and describe two test estimation techniques.
Metrics based: estimates the test effort based on metrics of similar projects or based on typical values.
Expert based: estimates the test effort based on the experience of the testers or experts.
What is test monitoring?
Test monitoring is to gather information and and provide feedback and visibility about test activities.
What is test control?
Test control describes any guiding or corrective actions taken as a result of information and metrics gathered and possibly reported.
eg. Reprioritizing tests when risks occur.
Describe a test progress report.
This is a test report prepared during a test activity.
Common details included:
Test object quality
Tests planned for the next reporting period
Factors impeding progress
The status of the test activities and progress against test plan
Describe a test summary report.
This is a test report prepared at the end of a test activity (test level)
Common details included:
Test summary report identifier Summary Variances Comprehensive assessment Summary of results Evaluation Summary of activities Approvals
What is the purpose of configuration management?
This is determining clearly what the items are that make up the software or system and that they are managed carefully throughout the entire project and product life cycle. It also involves the version control of systems as well as proper build processes.
Define product risk.
Product risk is the possibility that a system or software may fail to satisfy legitimate needs.
Define quality risk.
These are product risks that are associated with specific quality characteristics of a product.
Define project risk.
These are situations that may occur to have a negative effect on a project’s ability to achieve its objectives.
Describe the risk-based approach to testing.
Product risk analysis is done and the product risk information is used to guide test activities. Analyzing product risks early contributes to the success of a project.
In order to carry out product risk analysis, what is normally needed?
The knowledge and insight of the project stakeholders.
What is the difference between a test plan and a test design specification?
A test plan is the project plan for testing. A test design specification is a collection of test cases or a set of test procedures. Test plans are higher level than test design specification documents.
What is a test level?
This is a test execution period that occurs at different points in times and have different objectives.
What two factors determine risk?
Likelihood and impact.
What is the defect detection percentage.
The defect detection percentage (DDP) gives a measure of the testing effectiveness. It is calculated as a ratio of defects found found prior to release and after release by customers.
Defects found by testers / Defects found by testers + Defects found by end users
Describe an incident report.
This is a report that contains a description of the misbehaviour that was observed and classification of theat misbehavior.
Template: (Remember JIRA)
Test incident report identifier
Summary
Incident description (Steps, actual results, expected results
