Test Generation Strategies Flashcards
What type of test generation needs requirements modeled using a formal notation?
Model-based test generation
Name some test generation strategies for requirements
- finite-state machines
- statecharts
- Petri nets
- timed I/O automata
- algebraic and logic specifications
- code + run-time data -> test selection
An informal process to review a work product
Walkthroughs
a formal review process with defined roles
Inspections
__% of software errors can be found by inspections
before the first test case is run
90
T/F Inspections are the least useful, least cost-effective form of error removal
F, most useful and most cost-effective
T/F At the inspection, specific metrics should be collected and tracked which will describe defects, defect removal efficiency, and efficiency of the inspection process
T
T/F The program needs to fund inspections and track rework savings
T
T/F Inspections are the most useful, most cost-effective form of error removal
T
T/F You should prioritize more complex modules for peer review
T
T/F cyclomatic complexity <10 good, >20 bad
T
Generation of tests from a formal model of program behavior
Model-based testing
List some sources of test generation
Black-box testing
White-box testing
Model-based or specification-based testing
Interface testing
List some test process models
Waterfall V-model Spiral Agile Test driven development (TDD)
T/F Testing is an economic activity
T
Measuring the goodness of a test set T, a collection of test inputs, based on one or more test adequacy criteria
Test assessment
Measuring test adequacy and improving a test set against a sequence of well defined, increasingly strong, coverage domains leads to improved reliability of the system under test
Coverage Principle
List some coverage domains
- requirements
- classes
- mutations
- exceptions
- data flows
List the hierarchy of coverage criteria from lowest to highest
- requirements
- function/method
- statement
- decision
- conditions
- modified paths
- data flow
- mutation
What is the saturation region?
A region where no new defects are found and fixed
Finding and fixing previously undiscovered defects leads to greater ____ in the program
Confidence
T/F Any method of constructing functional tests is inadequate in comparison to code-based coverage criteria
T
T/F In the software development life cycle testing activities should start as early as possible and should be focused on defined objectives
T
If the same kinds of tests are repeated again and again, eventually the same set of test cases will no longer be able to find any new bugs
Saturation Region
T/F Peer reviews are a form of static testing
T
What are the three best software engineering practices
Inspections, inspections, inspections
T/F All companies do plenty of inspections
F
At best, what is the practice for inspections?
Inspecting the key components
T/F All products that are placed under CM and are used as a basis for subsequent development need to be subjected to successful completion of a formal inspection prior to its release to CM
T
T/F The inspection needs to follow a rigorous process defined in the software development plan and should be based on agreed-to entry and exit criteria for that specific product
T
T/F All products to be placed under CM should be inspected as far from their production as possible
F, as close to their production as feasible
T/F Inspections should be conducted beginning with concept definition and ending with completion of the engineering process
T
T/F Simple errors lead to simple failures
F, can lead to large failures
Adequacy score or coverage, usually between _ and _
0 and 1
T/F Weaknesses depend on the criteria used for assessment
T
T/F In the saturation region, there are no more defects in the software
F, there may still be defects in the software that
our tests cannot find
T/F Test generation methods are practically limited
in what they can find
T
What is the most useful, most cost-effective form of error removal
Inspections
T/F Test generation methods are practically unlimited
in what they can find
F, limited
T/F You should prioritize less complex modules for peer review
F, more complex
T/F cyclomatic complexity <2 good, >5 bad
F, 10, 20
T/F Testing is not an economic activity
F, it is
What is the region where no new defects are found and fixed?
Saturation region
What is a form of static testing?
Peer reviews
