Scale and Combinatorial Testing Flashcards

1
Q

What is testing scale? What is the general formula?

A

How does the number of tests grow as the number of inputs grow. k^n, for some k given n inputs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

How do we cope with scale?

A
  • Constraints can reduce the number of test combinations
  • Not test as thoroughly (sampling) (if our project is low risk and test cost is limited)
  • Plan which inputs interact with each other and test those only
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are some situations in which you should test all combinations?

A

Number if inputs is low

Software is high risk

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is “each choice” testing?

A

1 value for each partition is used in at least 1 test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Does “each choice” testing create better tests than all combinations testing?

A

No, as we are just testing a subset from all combinations testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Most defects come from a small number of inputs ________

A

interacting

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is pairwise testing? How would you do this in practice?

A

1 value from each block is combined with 1 value from each other block.
Look at all combinations of the 2 largest domains, and then fill in remaining inputs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

An extension of pairwise testing is ______ testing

A

T-wise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is T-wise testing?

A

1 value from each block for each group of T characteristics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

In T-wise testing, T is usually known as the _____ _______, as it determines the number of tests

A

test strength

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is base choice testing?

A

Select a base test and then generate tests by changing only 1 block and taking other values from the base

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

In base choice testing, why is it bad to choose a bad test?

A

We would be spending time testing derivatives of the bad test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are some considerations when selecting the base test?

A

Feasible (must form a valid run)
Most likely?
Simplest?
Smallest?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is multiple base choice?

A

Selecting 1 or more base characteristics then test as base choice

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

There is a _______ relationship between all combinations and each choice testing

A

subsumption

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are some concerns with pairwise testing?

A

Pairwise interactions are tested when independent of others
Selected representative problem persists
Simple random testing seems to be as effective