Slides 16 - Combinatorial Testing

Question 1

Weak ECT Selection Criterion 
(ECT - Equivalence class testing)

Answer 1

A set of test cases 𝑆𝑆 ⊆ 𝑇𝑇 satisfies the weak ECT criterion if it contains every representative of all equivalence classes at least once

Test every equivalence class by one representative
● 4 test cases (weak ECT)
● 288 test Cases (strong ECT)

Question 2

Why Combinatorial Testing?

Answer 2

● Strong ECT & exhaustive testing are often infeasible

● Weak ECT & single fault assumption do not reveal interaction faults
for 𝑡𝑡 > 1

Question 3

Interaction Rule

Answer 3

Most failures are induced by single parameter faults or by interaction of two parameters, with progressively fewer failures induced by interactions between
three or more parameters

Question 4

Combinatorial Testing

Answer 4

A black-box test selection technique in which test cases are generated to execute specific combinations of valuesof several input parameters

Question 5

Testing strength t

Answer 5

A test suite 𝑆 satisfies the t-wise coverage criterion if every t-wise interaction is covered by at least one test case

Question 6

Conflict

Answer 6

A conflict is an irrelevant interaction of two or more parameter values

Question 7

Conflict handling strategies

Answer 7

Conflict handling strategies to exclude irrelevant interactions:
● Abstract Parameter
● Sub-Models
● Replacement
● Avoidance

Question 8

Robustness

Answer 8

Robustness describes the degree to which a system or

component can function correctly in the presence of external faults.

Question 9

Masking Effect

Answer 9

The input masking effect is an effect that prevents a test case from testing all combinations of input values, which the test input is normally expected to test

Question 10

Negative Test Case

Answer 10

Semantic information is required to distinguish valid and invalid value (combinations)
(Semantische Informationen werden benötigt, um gültige und ungültige Werte (Kombinationen) zu unterscheiden)