Glossary Flashcards
defect, bug, fault
An imperfection or deficiency in a work product where it does not meet its requirements or specifications.
error, mistake
A human action that produces an incorrect result.
failure
An event in which a component or system does not perform a required function within specified limits.
quality
The degree to which a component, system or process meets specified requirements and/or user/customer needs and expectations.
risk
A factor that could result in future negative consequences.
debugging
The process of finding, analyzing and removing the causes of failures in software.
requirement
A provision that contains criteria to be fulfilled.
review
A type of static testing during which a work product or process is evaluated by one or more individuals to detect issues and to provide improvements.
test case
A set of preconditions, inputs, actions (where applicable), expected results and postconditions, developed based on test conditions.
testing
The process consisting of all lifecycle activities, both static and dynamic, concerned with planning, preparation and evaluation of software products and related work products to determine that they satisfy specified requirements, to demonstrate that they are fit for purpose and to detect defects.
test objective
A reason or purpose for designing and executing a test.
exhaustive testing, complete testing
A test approach in which the test suite comprises all combinations of input values and preconditions.
confirmation testing, re-testing
Dynamic testing conducted after fixing defects with the objective to confirm that failures caused by those defects do not occur anymore.
exit criteria, completion criteria, test completion criteria, definition of done
The set of conditions for officially completing a defined task.
incident, deviation, software test incident, test incident
An event occurring that requires investigation.
regression
A degradation in the quality of a component or system due to a change.
regression testing
Testing of a previously tested component or system following modification to ensure that defects have not been introduced or have been uncovered in unchanged areas of the software, as a result of the changes made.
test basis
The body of knowledge used as the basis for test analysis and design.
test condition, test requirement, test situation
An aspect of the test basis that is relevant in order to achieve specific test objectives.
coverage, test coverage
The degree to which specified coverage items have been determined or have been exercised by a test suite expressed as a percentage.
test data
Data created or selected to satisfy the execution preconditions and inputs to execute one or more test cases.
test execution
The process of running a test on the component or system under test, producing actual result(s).
test log, test record, test run log
A chronological record of relevant details about the execution of tests.
test plan
Documentation describing the test objectives to be achieved and the means and the schedule for achieving them, organized to coordinate testing activities.
test procedure
A sequence of test cases in execution order, and any associated actions that may be required to set up the initial preconditions and any wrap up activities post execution.
test policy, organizational test policy
A high-level document describing the principles, approach and major objectives of the organization regarding testing.
test suite, test case suite, test set
A set of test cases or test procedures to be executed in a specific test cycle.
test summary report, test report
A test report that provides an evaluation of the corresponding test items against exit criteria
testware
Work products produced during the test process for use in planning, designing, executing, evaluating and reporting on testing.
error guessing
A test technique in which tests are derived on the basis of the tester’s knowledge of past failures, or general knowledge of failure modes.
independence of testing
Separation of responsibilities, which encourages the accomplishment of objective testing
commercial off-the-shelf (COTS), off-the-shelf software
A software product that is developed for the general market, i.e. for a large number of customers, and that is delivered to many customers in identical format.
iterative development model
A development lifecycle where a project is broken into a usually large number of iterations. An iteration is a complete development loop resulting in a release (internal or external) of an executable product, a subset of the final product under development, which grows from iteration to iteration to become the final product.
incremental development model
A development lifecycle model in which the project scope is generally determined early in the project lifecycle, but time and cost estimates are routinely modified as the project team understanding of the product increases. The product is developed through a series of repeated cycles, each delivering an increment which successively adds to the functionality of the product.
validation
Confirmation by examination and through provision of objective evidence that the requirements for a specific intended use or application have been fulfilled.
verification
Confirmation by examination and through provision of objective evidence that specified requirements have been fulfilled.
V-model
A sequential development lifecycle model describing a one-for-one relationship between major phases of software development from business requirements specification to delivery, and corresponding test levels from acceptance testing to component testing.
alpha testing
Simulated or actual operational testing conducted in the developer’s test environment, by roles outside the development organization.
beta testing, field testing
Simulated or actual operational testing conducted at an external site, by roles outside the development organization.
component
A minimal part of a system that can be tested in isolation.
component testing, module testing, unit testing
The testing of individual hardware or software components.
driver, test driver
A software component or test tool that replaces a component that takes care of the control and/or the calling of a component or system.
functional requirement
A requirement that specifies a function that a component or system must be able to perform.
non-functional requirement
A requirement that describes how the component or system will do what it is intended to do.
robustness, error-tolerance, fault-tolerance
The degree to which a component or system can function correctly in the presence of invalid inputs or stressful environmental conditions.
robustness testing
Testing to determine the robustness of the software product.
stub
A skeletal or special-purpose implementation of a software component, used to develop or test a component that calls or is otherwise dependent on it. It replaces a called component.
system testing
Testing an integrated system to verify that it meets specified requirements.
test environment, test bed, test rig
An environment containing hardware, instrumentation, simulators, software tools, and other support elements needed to conduct a test.
test level, test stage
A specific instantiation of a test process.
test-driven development (TDD)
A way of developing software where the test cases are developed, and often automated, before the software is developed to run those test cases.
user acceptance testing, acceptance testing
Acceptance testing conducted in a real or simulated operational environment by intended users focusing their needs, requirements and business processes.
acceptance criteria
The criteria that a component or system must satisfy in order to be accepted by a user, customer, or other authorized entity.
acceptance testing
Formal testing with respect to user needs, requirements, and business processes conducted to determine whether or not a system satisfies the acceptance criteria and to enable the user, customers or other authorized entity to determine whether or not to accept the system.
black-box testing, specification-based testing
Testing, either functional or non-functional, without reference to the internal structure of the component or system.
black-box test technique, black-box technique, specification-based technique, specification-based test technique
A procedure to derive and/or select test cases based on an analysis of the specification, either functional or non-functional, of a component or system without reference to its internal structure.
code coverage
An analysis method that determines which parts of the software have been executed (covered) by the test suite and which parts have not been executed, e.g., statement coverage, decision coverage or condition coverage.
functional testing
Testing conducted to evaluate the compliance of a component or system with functional requirements.
non-functional testing
Testing conducted to evaluate the compliance of a component or system with non-functional requirements.
interoperability
The degree to which two or more components or systems can exchange information and use the information that has been exchanged.
interoperability testing, compatibility testing
Testing to determine the interoperability of a software product.
load testing
A type of performance testing conducted to evaluate the behavior of a component or system under varying loads, usually between anticipated conditions of low, typical, and peak usage.
maintainability
The degree to which a component or system can be modified by the intended maintainers.
maintainability testing
Testing to determine the maintainability of a software product.
performance efficiency, time behavior, performance
The degree to which a component or system uses time, resources and capacity when accomplishing its designated functions.
performance testing
Testing to determine the performance of a software product.