Scale and Combinatorial Testing Flashcards
What is testing scale? What is the general formula?
How does the number of tests grow as the number of inputs grow. k^n, for some k given n inputs
How do we cope with scale?
- Constraints can reduce the number of test combinations
- Not test as thoroughly (sampling) (if our project is low risk and test cost is limited)
- Plan which inputs interact with each other and test those only
What are some situations in which you should test all combinations?
Number if inputs is low
Software is high risk
What is “each choice” testing?
1 value for each partition is used in at least 1 test
Does “each choice” testing create better tests than all combinations testing?
No, as we are just testing a subset from all combinations testing
Most defects come from a small number of inputs ________
interacting
What is pairwise testing? How would you do this in practice?
1 value from each block is combined with 1 value from each other block.
Look at all combinations of the 2 largest domains, and then fill in remaining inputs
An extension of pairwise testing is ______ testing
T-wise
What is T-wise testing?
1 value from each block for each group of T characteristics
In T-wise testing, T is usually known as the _____ _______, as it determines the number of tests
test strength
What is base choice testing?
Select a base test and then generate tests by changing only 1 block and taking other values from the base
In base choice testing, why is it bad to choose a bad test?
We would be spending time testing derivatives of the bad test
What are some considerations when selecting the base test?
Feasible (must form a valid run)
Most likely?
Simplest?
Smallest?
What is multiple base choice?
Selecting 1 or more base characteristics then test as base choice
There is a _______ relationship between all combinations and each choice testing
subsumption