Chapter 5 Test Management

Question 1

Configuration Management

Answer 1

A discipline applying technical and administrative direction and surveillance to identify and document the functional and physical characteristics of a configuration item, control changes to those characteristics, record and report change processing and implementation status, and verify compliance with specified requirements.

Question 2

Defect Managment

Answer 2

The process of recognizing and recording defects, classifying them, investigating them, taking action to resolve them, and disposing of them when resolved.

Question 3

Defect report

Answer 3

Documentation of the occurrence, nature, and status of a defect.

Question 4

Entry criteria

Answer 4

The set of conditions for officially starting a defined task.

Question 5

Exit criteria

Answer 5

The set of conditions for officially completing a defined task

Question 6

Product risk

Answer 6

A risk impacting the quality of a product

Question 7

Project risk

Answer 7

A risk that impacts project success

Question 8

Risk

Answer 8

A factor that could result in future negative consequences

Question 9

Risk level

Answer 9

The qualitative or quantitative measure of a risk defined by impact and likelihood

Question 10

Risk-based testing

Answer 10

Testing in which the management, selection, prioritization, and use of testing activities and resources are based in corresponding risk types and risk levels.

Question 11

Test approach

Answer 11

The implementation of the test strategy for a specific project.

Question 12

Test control

Answer 12

A test management task that deals with developing and applying a set of corrective actions to get a test project on track when monitoring shows a deviation from what was planned.

Question 13

Test estimation

Answer 13

The calculated approximation of a result related to various aspects of testing (e.g., effort spent, completion date, costs involved, number of test cases, etc) which is usable even if input data may be incomplete, uncertain, or noisy.

Question 14

Test manager

Answer 14

The person responsible for project management of testing activities and resources, and evaluation of a test object. The individual who directs, controls, administers, plans, and regulates the evaluation of a test object.

Question 15

Test monitoring

Answer 15

A test management activity that involves checking the status of testing activities, identifying any variances from the planned or expected status, and reporting status to stakeholders.

Question 16

Test plan

Answer 16

Documentation describing the test objectives to be achieved and the means and schedule for achieving them, organized to coordinate testing activities.

Outlines the development and maintenance of the test plan.

Question 17

Test planning

Answer 17

The activity of establishing or updating a test plan.

Influenced by 
Test policy and strategy
Development methodology
Scope of Testing / Development,  what to test
Objectives
Risks
Constraints
Criticality
Testability
Resources
Scheduling of Test Process Lifecyle (analysis, design, implementation ,execution, evaluation)
Select metrics
Budget
level of detail

Question 18

Test progress report

Answer 18

A test report produced at regular intervals about the progress of test activities against a baseline, risks, and alternatives requiring a decision.

Question 19

Test strategy

Answer 19

Documentation that expresses the generic requirements for testing one or more projects run within an organization, providing detail on how testing is to be performed, and is aligned with the test policy.

Question 20

Test summary report

Answer 20

A test report that provides an evaluation of the corresponding test items against exit criteria.

Question 21

Tester

Answer 21

A skilled professional who is involved in the testing of a component or system

Question 22

Independence

Answer 22

Tester Role vs Other Role (Business Customer, User, etc)
Different cognitive biase

Best to have multiple test levels with varying degrees of independence
on site / offsite /

Question 23

Test Manager Tasks

Answer 23

Coordinate, Share, Initiate, Prepare / Deliver Reports, Adapt

Coordinate between project managers, product owners and others
Share perspectives across project activities such as integration planning
Initiate the Test Process
Prepare and Deliver Test progress reports
Adapt the plan based on results
Perform Test Control
Set up defect management, configuration managment
Create metrics
Support selection and implementation of tools

Question 24

Tester Tasks

Answer 24

Review Test Plans
Analyze Test Basis
Identify Test Conditions
Trace Test Conditions to Basis
Design, Set Up Test Environment
Design, Implement Test Cases/Procedures
Prepare and acquire Test Data
Create Execution Schedule
Execute Tests, Evaluate Results, Document Defects
Automate
Evaluate non-functional aspects
Review others' tests

Question 25

Test Policy

Answer 25

A high level document describing the principles, approach, and major objectives of the organization regarding testing. 
Objectives
Test process
Organization
Training
Ethics
Standards
Value
Archiving
Process Improvement

Question 26

Test Strategy Examples

Answer 26

Analytical - some factor like risk
Model Based 
Methodical
Process or Standard Compliant
Directed or consultative
Regression averse
Reactive

Question 27

Analytical Test Strategy

Answer 27

Based on analysis of some factor, e.g. risk-based testing where testing is directed to areas of greatest risk

Question 28

Model Based Test Strategy

Answer 28

Based on some model of some required aspect of the product, such as a function, a business process, an internal structure, or a non-functional characteristic.

Question 29

Methodical Test Strategy

Answer 29

Systematic use of some predefined set of tests or test conditions, such as a taxonomy of common or likely types of failures.

Question 30

Process or Standards Compliant Test Strategy

Answer 30

Based on external rules and standards

Question 31

Directed or Consultative Test Strategy

Answer 31

Driven primarily by the advice, guidance, or instructions of stakeholders, business domains experts, or technology experts, who may be outside the test team or organization itself

Question 32

Regression Averse Test Strategy

Answer 32

Avoid regression of existing capabilities; reuse of existing testware, extensive automation of regression tests and standard test suites

Question 33

Reactive

Answer 33

Not preplanned, react to events during test execution

Question 34

Entry / Exit criteria

Answer 34

The set of conditions for officially starting / completing a defined task.
Definition of ready
Definition of done

Question 35

Factors that influence Testing Effort

Answer 35

Product Characteristics (size, complexity, quality)
Development Process (test approach, tools, maturity)
People (skills and experience, cohesion, leadership)
Results (defects found)

Question 36

Estimation Techniques

Answer 36

Metrics Based

Expert Based

Question 37

Test Metrics

Answer 37

% of planned worked done test cases
% of planned work done test environment setup
test cases run/not run, passed/failed
Defect rate, fix rate
Test coverage (requirements, code, stories, etc)
Costs

Question 38

Testing and Configuration Managment

Answer 38

All test items are identified, version controlled, tracke for changes
Testware is version controleled
Documents are referenced unambiguously.

Question 39

Product Risk Examples

Answer 39

Software defects
System Architecture not suitable
Response Times / Performance
User Experience
Quality Risks

Question 40

Project Risk Examples

Answer 40

Requirements
Environments
Lateness/Delays
Management
Communications
Process / Followthrough
Organizational (skills training)
Contractual / Supplier issues

Question 41

Product Risk Analysis

Answer 41

Likelihood vs Impact scores

Question 42

Defect Management Practices

Answer 42

Discovery and Classification
Correction
Acceptance or Deferral
Confirmation Testing