Chapter 1 Fundamentals of testing

Question 1

Activities designed to evaluate the quality of a component or system.

Answer 1

Quality control

Question 2

The degree to which a work product satisfies stated and implied needs of its stakeholders.

Answer 2

quality

Question 3

Activities focused on providing confidence that quality requirements will be fulfilled. Abbreviation: QA; see also: quality management

Answer 3

quality assurance

Question 4

The activity that derives and specifies test cases from test conditions

Answer 4

test design

Question 5

The activity that develops and applies corrective actions to get a test project on track when it deviates from what was planned. See also: test management

Answer 5

test control

Question 6

The activity that derives and specifies test cases from test conditions

Answer 6

test design

Question 7

The activity that runs a test on a component or system producing actual results.

Answer 7

test execution

Question 8

The activity that prepares the testware needed for test execution based on test analysis and design.

Answer 8

test implementation

Question 9

The activity that checks the status of testing activities, identifies any variances from planned or expected, and reports status to stakeholders. See also: test management

Answer 9

test monitoring

Question 10

The work product to be tested. See also: test item

Answer 10

test object

Question 11

The activity of establishing or updating a test plan

Answer 11

test planning

Question 12

A sequence of test cases in execution order, and any associated actions that may be required to set up the initial preconditions and any wrap up activities post execution.

Answer 12

test procedure

Question 13

The process within the software development lifecycle that evaluates the quality of a component or system and related work products. See also: quality control
-overall process that ensures software quality

Answer 13

testing

Question 14

Work products produced during the test process for use in planning, designing, executing, evaluating and reporting on testing.

-products or materials created to support and execute the testing process

Answer 14

testware

Question 15

Confirmation by examination that a work product matches a stakeholder’s needs

Question Addressed: “Are we building the right product?”

Answer 15

validation

Question 16

Confirmation by examination and through provision of objective evidence that specified requirements have been fulfilled

Question Addressed: “Are we building the product right?”

Answer 16

verification

Question 17

The body of knowledge used as the basis for test analysis and design.

-IT IS A DOCUMENTATION

Answer 17

test basis

Question 18

A testable aspect of a component or system identified as a basis for testing.

-If the test basis specifies "The system must authenticate users with a valid username and 			password," a test condition might be "Testing valid user login" or "Testing login with invalid credentials.”

Answer 18

test condition

Question 19

A set of preconditions, inputs, actions (where applicable), expected results and postconditions, developed based on test conditions.

Answer 19

test case

Question 20

The activity that identifies test conditions by analyzing the test basis

Answer 20

test analysis

Question 21

a human error which produces an incorrect result (MISTAKE)

Answer 21

Error

Question 22

An Imperfection or deficiency in a work product where it does not meet its requirements or specifications or impairs its intended use. (BUG, FAULT)

Answer 22

Defect

Question 23

an event in which a component or system does not perform a required function within specified limits

is an event! And code is executed!

can also be caused by environmental conditions, such as when radiation or electromagnetic field cause defects in firmware.

Answer 23

Failure

Question 24

A source of a defect such that if it is removed, the occurrence of the defect type is decreased or removed

-testers dont find root cause

Answer 24

Root Cause

Question 25

The process of evaluating a component or system without executing it, based on its form, structure, content, or documentation.

Answer 25

static analysis

Question 26

Testing that does not involve the execution of a test item.

Answer 26

static testing

-includes reviews and static analysis

-testing can directly find defects in the test object

-Static testing finds defects (bugs, faults) directly and immediately sees what might go wrong in the future

-When static testing identifies a defect, debugging is concerned with removing it (debugging only has the fixing the cause not the reporoduction or diagnosis)

Question 27

Testing that involves the execution of the test item

Answer 27

dynamic testing

-uses different types of test techniques and test approaches to derive test cases

-Testing can trigger failures that are caused by defects in the software

-Dynamic testing causes (triggers) failures

-The typical debugging process in this case involves:
Reproduction of a failure

Diagnosis (finding the root cause, analyzing the root cause)
Fixing the cause

Question 28

The typical test objectives are:

Answer 28

Evaluating work products such as requirements, user stories, designs, and code

Triggering failures and finding defects
Ensuring required coverage of a test object

Reducing the level of risk of inadequate software quality

Verifying whether specified requirements have been fulfilled

Verifying that a test object complies with contractual, legal, and regulatory requirements

Providing information to stakeholders to allow them to make informed decisions

Building confidence in the quality of the test object

Validating whether the test object is complete and works as expected by the stakeholders

Question 29

quality control

Answer 29

Activities designed to evaluate the quality of a component or system.

Testing is a form
of quality control (QC).

is a product-oriented

corrective approach that focuses on those activities supporting the achievement of appropriate levels of quality.

include formal methods (model checking and proof of correctness), simulation and prototyping.

test results are used to fix defects

Question 30

Who is preferably responsible for confirmation testing after debugging?

Answer 30

the same tester who identified the original defect

Question 31

quality assurance

Answer 31

Activities focused on providing confidence that quality requirements will be fulfilled.

is process-oriented

preventive approach that focuses on the implementation and improvement of processes.

applies to both the development and testing processes,

is the responsibility of everyone on a project.

test results provide feedback on how well the development and test processes are performing.

Question 32

Model Checking

Answer 32

Model checking is a formal verification technique used in software engineering and computer science to automatically verify if a system (often described as a mathematical model or state machine) satisfies certain specifications or properties. It checks whether the behavior of the system adheres to a given set of requirements, typically expressed in temporal logic (such as Linear Temporal Logic, LTL, or Computation Tree Logic, CTL).

Question 33

Testing Principles

Answer 33

1. Testing shows the presence, not the absence of defects.
2. Exhaustive testing is impossible.
   -Rather than attempting to test exhaustively, test techniques, test case prioritization, and risk-based testing, should be used to focus test efforts.

-Exhaustive testing is a test approach in which the test suite comprises all combinations of input values and preconditions.

3. Early testing saves time and money.
   To find defects early, both static testing and dynamic testing should be started as early as possible.
4. Defects cluster together.
   Pareto principle.
5. Tests wear out
   -in some cases, repeating the same tests can have a beneficial outcome, e.g., in automated regression testing
6. Testing is context dependent.
7. Absence-of-defects fallacy.
   -In addition to verification, validation should also be carried out

Question 34

The set of interrelated activities comprising of test planning, test monitoring and control, test analysis, test design, test implementation, test execution, and test completion.

-The test process can be tailored to a given situation based on various factors

Answer 34

test process

Question 35

Test Activities and Tasks of test process

Answer 35

—Test planning
-Estimating the test effort is part of test planning
workproduct:
test plan, test schedule, risk register, and entry and exit criteria (see section 5.1). Risk register is a list of risks together with risk likelihood, risk impact and information about risk mitigation (see section 5.2). Test schedule, risk register and entry and exit criteria are often a part of the test plan.

—-Test monitoring and control.
work product: test progress reports (see section 5.3.2), documentation of control directives (see section 5.3) and risk information (see section 5.2).

—Test analysis
-“what to test?”
work product:
(prioritized) test conditions (e.g., acceptance criteria, see section 4.5.2), and defect reports regarding defects in the test basis (if not fixed directly).

—Test design
-“how to test?”
defining the test data requirements,
designing the test environment
identifying any other required infrastructure and tools.
work product: test cases, test charters, coverage items, test data requirements and test environment requirements.

—Test implementation
work product:
test procedures, automated test scripts, test suites, test data, test execution schedule, and test environment elements. Examples of test environment elements include: stubs, drivers, simulators, and service virtualization.

—Test execution :
work product:
test logs, and defect reports (see section 5.5).

—Test completion
work product:
test completion report (see section 5.3.2), action items for improvement of subsequent projects or iterations, documented lessons learned, and change requests (e.g., as product backlog items).

Question 36

test plan

Answer 36

A test plan describes the objectives, resources and processes for a test project.

Documents the means and schedule for achieving test objectives

Helps to ensure that the performed test activities will meet the established criteria

Serves as a means of communication with team members and other stakeholders

Demonstrates that testing will adhere to the existing test policy and test strategy (or explains why the testing will deviate from them)

forces the testers to confront the future challenges related to risks, schedules, people, tools, costs, effort, etc.

Question 37

The typical content of a test plan includes:

Answer 37

Context of testing (e.g., scope, test objectives, constraints, test basis)

Assumptions and constraints of the test project

Stakeholders (e.g., roles, responsibilities, relevance to testing, hiring and training needs)

Communication (e.g., forms and frequency of communication, documentation templates)

Risk register (e.g., product risks, project risks)

Test approach (e.g., test levels, test types, test techniques, test deliverables, entry criteria and exit criteria, independence of testing, metrics to be collected, test data requirements, test environment requirements, deviations from the organizational test policy and test strategy)

Budget and schedule

Question 38

(test planning) In iterative SDLCs, typically two kinds of planning occur:

Answer 38

release planning and iteration planning

Question 39

Test monitoring

Answer 39

concerned with gathering information about testing.

This information is used to assess test progress and to measure whether the test exit criteria or the test tasks associated with the exit criteria are satisfied, such as meeting the targets for coverage of product risks, requirements, or acceptance criteria.

Test monitoring gathers a variety of metrics to support the test control and test completion.

Common test metrics include:

Project progress metrics (e.g., task completion, resource usage, test effort)

Test progress metrics (e.g., test case implementation progress, test environment preparation progress, number of test cases run/not run, passed/failed, test execution time)

Product quality metrics (e.g., availability, response time, mean time to failure)

Defect metrics (e.g., number and priorities of defects found/fixed, defect density, defect detection percentage)

Risk metrics (e.g., residual risk level)

Coverage metrics (e.g., requirements coverage, code coverage)

Cost metrics (e.g., cost of testing, organizational cost of quality)

Question 40

Test control

Answer 40

uses the information from test monitoring to provide, in a form of the control directives, guidance and the necessary corrective actions to achieve the most effective and efficient testing.

examples:
Reprioritizing tests when an identified risk becomes an issue

Re-evaluating whether a test item meets entry criteria or exit criteria due to rework

Adjusting the test schedule to address a delay in the delivery of the test environment

Adding new resources when and where needed

Question 41

test completion

Answer 41

Test completion collects data from completed test activities to consolidate experience, testware, and any other relevant information. Test completion activities occur at project milestones such as when a test level is completed, an agile iteration is finished, a test project is completed (or cancelled), a software system is released, or a maintenance release is completed.

Question 42

Essential Skills and Good Practices in Testing:

Generic Skills Required for Testing:

While being generic, the following skills are particularly relevant for testers:

Answer 42

Testing knowledge (to increase effectiveness of testing, e.g., by using test techniques)

Thoroughness, carefulness, curiosity, attention to details, being methodical (to identify defects, especially the ones that are difficult to find)

Good communication skills, active listening, being a team player (to interact effectively with all stakeholders, to convey information to others, to be understood, and to report and discuss defects)

Analytical thinking, critical thinking, creativity (to increase effectiveness of testing)

Technical knowledge (to increase efficiency of testing, e.g., by using appropriate test tools)

Domain knowledge (to be able to understand and to communicate with end users/business representatives)

Question 43

whole-team approach

Answer 43

any team member with the necessary knowledge and skills can perform any task, and everyone is responsible for quality.

The team members share the same workspace (physical or virtual), as co-location facilitates communication and interaction.

The whole team approach improves team dynamics, enhances communication and collaboration within the team, and creates synergy by allowing the various skill sets within the team to be leveraged for the benefit of the project.

Question 44

Independence of Testing

Answer 44

Work products can be tested by their author (no independence),

by the author’s peers from the same team (some independence),

by testers from outside the author’s team but within the organization (high independence),

by testers from outside the organization (very high independence). F

Question 45

Defects can be found in documentation, such as:

Answer 45

requirements specification or a test
script,

in source code,

in a supporting artifact such as a build file.

Question 46

—Test planning work product

Answer 46

work product:
test plan, test schedule, risk register, and entry and exit criteria (see section 5.1). Risk register is a list of risks together with risk likelihood, risk impact and information about risk mitigation (see section 5.2). Test schedule, risk register and entry and exit criteria are often a part of the test plan.

Question 47

—-Test monitoring and control
work product

Answer 47

work product: test progress reports (see section 5.3.2), documentation of control directives (see section 5.3) and risk information (see section 5.2).

Question 48

—Test analysis
-“what to test?”
work product:

Answer 48

work product:
(prioritized) test conditions (e.g., acceptance criteria, see section 4.5.2), and defect reports regarding defects in the test basis (if not fixed directly).

Question 49

—Test design work product:

Answer 49

work product: test cases, test charters, coverage items, test data requirements and test environment requirements.

Question 50

—Test implementation
work product:

Answer 50

work product:
test procedures, automated test scripts, test suites, test data, test execution schedule, and test environment elements. Examples of test environment elements include: stubs, drivers, simulators, and service virtualization.

Question 51

—Test execution :
work product:

Answer 51

work product:
test logs, and defect reports (see section 5.5).

Question 52

—Test completion
work product:

Answer 52

work product:
test completion report (see section 5.3.2), action items for improvement of subsequent projects or iterations, documented lessons learned, and change requests (e.g., as product backlog items).

Question 53

A component or tool that temporarily replaces another component and controls or calls a test item in isolation.


Answer 53

-driver:

Question 54

A type of test double providing predefined responses.

A skeletal or special-purpose implementation of a software component, used to develop or test a component that calls or is otherwise dependent on it. It replaces a called component

Answer 54

-stub:

Question 55

A component or system used during testing which behaves or operates like a given component or system

Answer 55

-simulator:

Question 56

A technique to enable virtual delivery of services which are deployed, accessed and managed remotely.

Answer 56

-service virtualization:

Question 57

In addition to evaluating coverage, good traceability makes it :

Answer 57

possible to determine the impact of changes

facilitates test audits

helps meet IT governance criteria.

Question 58

Traceability of test cases to requirements can verify that the

Answer 58

requirements are covered by test cases.


Question 59

Traceability of test results to risks can be used to evaluate the level of

Answer 59

residual risk in a test object.

Question 60

-Traceability provides information to assess

Answer 60

product quality

process capability

project progress against business goals.

Question 61

The test management role is mainly focused on the activities of :

Answer 61

test planning

test monitoring and control

test completion.

Question 62

The testing role is mainly focused on the activities of :

Answer 62

test analysis

test design

test implementation

test execution

Question 63

Contains hardware, instrumentation, simulators, software tools, and other support elements needed to conduct a test

Answer 63

Test Environment