Testing Techniques

Question 1

Define testing techniques.

Answer 1

Procedures that are used to identify and select test conditions that can be targeted by tests.

Question 2

What is shift left testing? What is the noted benefit?

Answer 2

Testing that starts earlier in the development process; considered to make testing more efficient and effective.

Question 3

Describe how the best testing technique is selected.

Answer 3

There is no single perfect technique and it is important to understand the goals of testing to determine the appropriate technique.

Question 4

List six common testing techniques.

Answer 4

1. Equivalence partitioning
2. Boundary value analysis
3. Decision tables
4. Combinatorial
5. Exploratory testing
6. API testing

Question 5

Define what equivalence partitioning (EP) is used for and its focus.

Answer 5

Used to reduce the number of specific tests while still assuring broad coverage. Focused on determining a set of input values to use during testing.

Question 6

Describe the application of equivalence partitioning.

Answer 6

A set of possible values is divided into a partition, or equivalence classes, in which all values in the partition will be handled the same way by the software.

Question 7

Are partitions considered valid or invalid in equivalence partitioning?

Answer 7

Both.

Question 8

Describe how valid partition values should be handled.

Answer 8

All values in a valid partition should be accepted or processed by the software with no errors.

Question 9

What is a risk of equivalence partitioning?

Answer 9

When partitions are established with values that actually receive different processing.

Question 10

What types of defects are found in equivalence partitioning?

Answer 10

Usually functional and deals with incorrect handling of various sets of data.

Question 11

Describe how coverage is determined for equivalence partitioning.

Answer 11

Determined by dividing the number of partitions for which of value has been tested by the total number of partitions identified.

Question 12

Define boundary value analysis (BVA). (i.e., what does it concentrate on?)

Answer 12

An extension of equivalence partitioning, and concentrates on testing the values that fall on or near the boundaries of partitions.

Question 13

In boundary value analysis, what is required to test the boundaries of ranges?

Answer 13

Ordered partitions (i.e. range of numbers).

Question 14

What is the approach for boundary value analysis testing? Which approach is most common?

Answer 14

Testing uses a two-value or three-value approach. Two-value is more common.

Question 15

Describe two-value boundary value analysis.

Answer 15

Actual boundary value (valid partition) and value that falls immediately outside of the partition (invalid partition).

Question 16

Describe three-value boundary value analysis.

Answer 16

Value immediately before boundary (valid), value on the boundary (valid), value immediately outside of the boundary (invalid).

Question 17

Describe the application of boundary value analysis (i.e., what does it determine?)

Answer 17

Determines if values on and over the boundary are handled properly.

Question 18

Describe the types of defects found in boundary value analysis.

Answer 18

Detects defects due to incorrect usage of a relational operator (such as greater than, less than, or =).

Question 19

How is coverage determined for boundary value analysis?

Answer 19

Determined based on how many boundaries are tested divided by the number of boundaries there are.

Question 20

Describe where decision tables are used and what they help to define for an organization.

Answer 20

Used in requirements engineering and testing to help define how business rules should be handled.

Question 21

What do decision tables consist of?

Answer 21

Consists of two halves of a table; top half shows conditions to be tested (one condition per row), bottom half shows expected results from set of conditions (one results per row).

Question 22

Describe the application of decision tables (i.e., what are they often used as?). What can also be derived from them?

Answer 22

Often used as a shortcut to creating detailed test cases, serves as an organized checklist. Can also be used to derive additional results from the software.

Question 23

What type of defects are targeted in decision tables? What can it help identify?

Answer 23

Targets incorrect outcomes, and can help identify condition combinations that are not handled or where the expected outcome is unknown.

Question 24

How is coverage determined for decision tables?

Answer 24

Determined by the number of columns by at least one test divided by the possible combinations.

Question 25

Define combinatorial testing technique by explaining what it limits.

Answer 25

Used to limit the number of combinations of supposedly non-interacting (independent) parameters or conditions that need to be tested.

Question 26

How does combinatorial testing apply algorithms? What does it identify/not identify?

Answer 26

Applies algorithms built into tools that mathematically reduce the number of combinations to a manageable set. Only identifies efficient combinations of test conditions, not outcomes.

Question 27

What are the three most common tools and approaches in combinatorial testing? Describe each one.

Answer 27

1. Pairwise testing: all pairs of combinations are tested together, but not all possible combinations
2. Classification trees: allows users to create a diagram of a “tree” that shows variables to be tested and then applies an algorithm that will cover all singles, pairs, tupels, etc. of the combination of the variables
3. Orthogonal arrays: uses preset arrays of values to determine the combinations to be tested

Question 28

Describe the application of combinatorial testing. (i.e., types of variables)

Answer 28

Any testing with non-interacting conditions or variables (environment variables, internal variables).

Question 29

What types of defects are identified in combinatorial testing?

Answer 29

Identifies defects where a particular combination that should be handled is not or where there is an interaction between conditions.

Question 30

Describe how coverage is determined in combinatorial testing.

Answer 30

Determined by dividing the number of test combinations by the number of combinations generated by the specific tool or technique.

Question 31

Define exploratory testing.

Answer 31

Combination of learning how the software works (exploring) and testing that it works as expected.

Question 32

Exploratory testing is often ________-based.

Answer 32

Session

Question 33

How is exploratory testing documented?

Answer 33

Session sheets are filled out at the conclusion of testing to log unexpected occurrences for further investigation.

Question 34

What is timeboxing?

Answer 34

Used to set a time limit for a session.

Question 35

When is the exploratory testing technique most effective? (Referring to who is conducting it.)

Answer 35

Most effective when conducted by an experienced tester who is trained to detect issues that an untrained operator could easily miss.

Question 36

What is exploratory testing sometimes called?

Answer 36

Smoke testing or sanity testing.

Question 37

Describe the application of exploratory testing (i.e. what is it suited for?).

Answer 37

Suited to an environment where quick feedback is needed regarding overall quality of the software.

Question 38

What types of defects are found in exploratory testing?

Answer 38

Functional issues, but also non-functional issues in areas of usability and performance.

Question 39

How is coverage determined in exploratory testing? What can be equated?

Answer 39

Determining coverage is a drawback of this type of testing. It varies widely, possible to equate a test session to a test case.

Question 40

Define the focus of API testing and its categorization as a technique.

Answer 40

Focuses on interfaces between software components; more of an approach as opposed to a technique.

Question 41

What is the focus of API testing?

Answer 41

Focuses on information passed between the application and web service, error recovery, and data handling.

Question 42

Describe the application of API testing. What does it require the use of?

Answer 42

Used in cases where the UI is not yet available, or is unstable; requires the use of tools or programming to access the APIs (such as Postman or Swagger).

Question 43

What types of defects are found in API testing?

Answer 43

Variety of defects (functional, error handling, error recovery, performance, etc.)

Question 44

How is coverage determined in API testing? What should be checked?

Answer 44

Coverage is dependent on the capabilities of the API; all input and output parameters should be checked with variety of valid and invalid data.