Ch5 Flashcards
Benefits of Test Independence?
See other and different defects
Unbiased
Verify assumptions made during specification and implementation
Bring experience, skills and quality
Drawbacks of Test Independence?
Isolation from development team
May be seen as bottleneck or blamed for delays in release
May not be familiar with business, project or systems
Developers may lose a sense of responsibility for quality
Tasks of the Task Leader?
Write or review test policy and strategy.
Contribute to the testing perspective.
Plan tests (approach, estimates and resoruces.)
Assess testing objective and risks.
Schedule test activities and initate specification, preparation, implementation and execution of tests.
Monitor the test results and check exit criteria.
Adapt planning based on test results and progress, taking action necessary to compensate for problems.
Set up adequate configuration management of testware.
Introduce suitable metrics for measuring test progress and evaluating the quality of testing.
Consider automation and select tools to support testing.
Supervise the implementation of the test environment
Write test summary reports for stakeholders.
Tasks of the Tester?
Review and contribute to test plans
Review user requirements, specifications and models for testability
Create test specifications
Set up the test environment with appropriate technical support
Prepare and acquire test data
Execute and log tests
Evaluate results and record incidents
Use test tools as necessary and automate tests
Measure performance (if applicable)
Review tests developed by others
Are you a mad? Recite the IEEE Stand 829-1998.
Test plan identifier
- Test plan identifier
- Introduction
- Test items
- To be tested
- Not to be tested
- Approach
- P/F criteria
- Suspension and Resumption.
- Test deliverables.
- Testing tasks
- Enviormental needs
- Responsibilities
- Staffing and training needs.
- Schedule.
15 Risk and contingencies. - Approvals.
State the order in Levels of Planning!!
Test Policy –> Test Strategy –> Master Test Plan–Compent–>Integration–>System–>Acceptance
What is the definition of Entry Criteria?
Entry C is the condition by which we start testing, i.e when tests are ready for execution.
What are a few Entry Critera?
Test environment available and ready
Test tool configured in the test environment
Testable code available
Test data available, including configuration data, logins, etc.
Test summary report available from previous testing, including quality measures
Third-party software delivered and software licences bought
Other project dependencies in place
What is the Exit Criteria?
Exit Criteria is the used to define test end. Typically after testing has achieved a specific goal.
What are a few Exit Critera?
Measures of testing thoroughness, i.e. coverage measures
Estimates of defect density or reliability
Cost
Residual risks such as number of defects outstanding or requirements not tested
Schedules such as those based on time to market
What should you remember about Exit Criteria?
Exit Criteria varies with test level. The coverage of code for component testing.
Coverage of requirements or risk for system testing
Non-functional measures such as usability in acceptance testing
Define Test Approach.
The implementation of test stategy. Based on objective and risk.
What can the Test Approach be used for?
A starting point for test planning.
Selecting design techniques and test types.
Defining Entry/Exit Criteria
What are the types of Test Approach?
Analytical e.g. Risk-based Model-based e.g. Using statistics such as expected usage profiles Methodical e.g. Based on failures (error guessing), experience, checklist Process- or standard-compliant e.g. Industry standards or agile methods Dynamic/heuristic e.g. Reactive, exploratory testing Consultative Based on advice from experts in technology or business Regression-averse e.g. Reuse and automation
Test Estimation is?
A calculated approximation of the cost or effort required to complete a task.
What are the approaches for Test Estimation?
Two Approaches:
The Metrics-based approach based on
Metrics of former or similar projects, or typical values.
The Expert-based approach, based on assessments by the owner of the tasks, or domain experts.