All Flashcards

1
Q

(1) What are the two types of coverage in the white-box test technique and (2) how is coverage represented?

A

(1) Statement Coverage and Decision Coverage
(2) It is the “percentage” of coverage items determined or expressed in the test suite.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the responsibilities of the test manager?

A
  • Develop/review the test policy and test strategy
  • Write and update the test plan
  • Select test approaches
  • Estimate testing time, effort, and cost
  • Acquiring resources
  • Define test levels and cycles
  • Plan for defect management
  • Coordinate the test plan with others
  • Share testing perspectives with other project activities
  • Initiate the analysis, design, implementation, and execution of tests
  • Monitor test progress and results
  • Check status of exit criteria (definition of done)
  • Facilitate test completion activities
  • Prepare and deliver test progress reports and test summary reports
  • Adapt the plan based on results
  • Perform test control
  • Support setup of defect management system
  • Introduce suitable metrics
  • Support selection and implementation of tools
  • Promote and advocate testers, test team, and test profession
  • Develop skills and careers of testers (training plans, performance evaluations, coaching, etc.)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the responsibilities of the tester?

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the types of “defined behaviors” in the use case test technique?

A
  1. Basic (1 test case)
  2. Exceptional or Alternative (potentially multiple test cases)
  3. Error handling (potentially multiple test cases)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

(1) What are the three experience-based test techniques and (2) which are black-box vs. white box?

A

(1) Error Guessing, Exploratory, and Checklist-based
(2) They can all be used in black OR white-box testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the three triggers for maintenance testing?

A

Modification, migration, and retirement.

Note: the decision to maintain a system is not a trigger for maintenance testing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is another name for exploratory testing?

A

Session based testing

Note exploratory tests are “designed, executed, logged, and evaluated dynamically during execution.”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a test charter?

A

Documentation of test activities in session-based exploratory testing. Example: a general plan of approach for test cases not documented in advance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the types of reviewer roles?

A
  • Author
  • Management/Review Manager
  • Facilitator
  • Review Leader
  • Reviewer
  • Scribe/Recorder

Note: Roles can overlap. For example, the Facilitator might also be the Review Leader.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the review types (and sub-types)?

A

Formal:
Walkthrough (led by author)
Technical Review (technical reviewers)
Inspection (rules and checklists; most formal)
Informal (i.e. undocumented)

Note: A single work product might have more than one type of review performed on it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the key attribute of a formal review type?

A

Formal review will always have a scribe.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the main reason for performing a review?

A

To uncover defects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the review techniques?

A
  • Ad hoc (informal, free-for-all)
  • Checklist-based
  • Scenario-based
  • Perspective-based (e.g. stakeholder viewpoints)
  • Role-based (end user types and organization roles)

From section 3.2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the seven principles of testing?

A
  1. Testing shows the presence of defects, not their absence
  2. Exhaustive testing is a no no
  3. Early testing; Start with requirements
  4. Defects can cluster
  5. Pesticide Paradox
  6. Testing is context dependent
  7. Absence of errors is a fallacy
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is test analysis?

A

A step in the testing process wherein test conditions are identified in the test basis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is test control?

A

A step in the testing process that deals with creating and applying actions to get a test project back on track.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is test monitoring?

A

A step in the testing process that involves…
- Checking the status of testing activities
- Identifying any variances from the plan
- Reporting status to stakeholders

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the seven steps of the testing process?

A

Test Planning
Test Monitoring/Control
Test Analysis
Test Design
Test Implementation
Test Execution
Test Completion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

In which test levels can functional, non-functional, and white-box testing occur?

A

In any of them (CISA)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

In which test levels should functional testing occur?

A

In all of them (CISA)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

In which test levels should non-functional testing occur?

A

In all of them (CISA)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is another name for white-box testing?

A

Structural Testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What are the 2 types of change-related testing?

A

Confirmation Testing
Regression Testing

24
Q

In which test levels (CISA) should change-related testing be performed?

A

In all of them.

25
Q

What is the definition of a test type?

A

A group of test activities based on specific test objectives aimed at specific characteristics of a component or system.

The test types are: Functional, Non-Functional, White Box, and Changed Related.

26
Q

What are the 4 test types?

A

Functional
Non-Functional
White-Box
Change-Related

27
Q

True or False: Some test levels (CISA) will not have any functional, non-functional, or white-box testing performed in them.

A

False! All test levels might have some form of functional, non-functional, and white-box testing.

28
Q

True or False: 100 percent statement coverage guarantees 100 percent decision coverage.

A

False. 100% decision coverage guarantees 100% statement coverage, but not the other way around.

29
Q

What are the types of work products?

A

Testware:
- Test Plan
- Test Progress Report
- Test Summary Report
- Test Charter
- Test Procedures and Cases
- Test Suites
- Test Data
- Test Environment
- Test Execution Schedule
- Defect Reports
- Automated Test Scripts

30
Q

What is “the work product to be tested”?

A

It is the “test object” or “test item”.

31
Q

What is a test condition?

A

An aspect of the test basis that is relevant to the test objectives (i.e. that needs to be tested)

32
Q

Give examples of typical exit criteria.

A
  • Completed the planned test(s)
  • Defined level of coverage achieved
  • # unresolved defects is under agreed limit
  • # estimated remaining defects is sufficiently low
  • levels of quality (from evaluation of reliability, performance, efficiency, usability, security, etc.) are sufficient.
33
Q

Give examples of typical entry criteria.

A

Availability of…
- Requirements, user stories, and/or models
- Tests meeting exit criteria for prior test levels (CISA)
- Test environment
- Necessary test tools
- Test data

From pg. 357 in pdf

34
Q

What are the 7 types of test strategies?

A
  1. Analytical (“analysis”)
  2. Model-based (“model”)
  3. Methodical (“systematic”)
  4. Process or standard-compliant
  5. Directed or consultative (“experts”)
  6. Regression Averse
  7. Reactive (“exploratory”)

Note: You can use more that one strategy in a test approach.

35
Q

Unofficial:
What is the hierarchy of test documentation within an organization?

A
  • Test Policy (organization)
  • Test Strategy (organization -> multiple projects)
  • Test Approach (project)
  • Test Plan (features)
36
Q

What is a test technique?

A

A procedure used to derive/make/select test cases.

37
Q

What are all the test techniques and their categories?

A

Categories: Black Box, White Box, and Experience Based

Black Box:
- Equivalence Partitioning -> Boundary Value Analysis
- Decision Tables/Trees
- State Transition Diagrams/Tables
- Use Case

White Box:
- Statement Coverage
- Decision Coverage

Experience Based:
- Error Guessing
- Exploratory
- Checklist-based testing

38
Q

What is a test level?

A

An instance of a test process (i.e. the seven steps of the test process).
Each test level uses all of the steps in the testing process.

39
Q

What are the 4 test levels?

A
  • Component (unit)
  • Integration
  • System
  • Acceptance
40
Q

What is beta testing?

A

Operational acceptance testing (simulated or actual) conducted at an external site, by roles outside the development organization (e.g. actual customers).

Note: Alpha testing is the same, but performed inside the developer’s test environment.

41
Q

What is a test procedure?

A

A sequence of test cases in execution order, and any associated actions that may be required to set up the initial preconditions and any wrap up activities post execution.

The closest thing we have to this at TAB right now is the Xray Test Execution.

42
Q

What is a test oracle?

A

A source to determine expected results to compare with the actual result of the system under test.

In TAB’s case, the test oracle is accomplished by the expected vs. actual results functionality in Xray.

43
Q

What are the 5 steps in the general review process?

A
  1. Planning
  2. Initiate Review
  3. Individual Review
  4. Issue Communication & Analysis
  5. Fixing and Reporting
44
Q

What is static analysis?

A

Evaluation of a component/system, without executing it, based on its form, structure, content, or documentation.
It is performed by developers.

45
Q

What is Test Design?

A

One of the 7 steps in the testing process.

In this step, you…
- Design and prioritize test cases
- Identify test data
- Design the test environment.
- Set bi-directional traceability between test basis, conditions, and cases.

46
Q

What is Test Implementation?

A

One of the 7 steps in the testing process.

In this step, you…
- Implement and prioritize test cases
- Develop and prioritize test procedures
- Organize test procedures into test suites
- Organize test suites into an execution schedule
- Build and verify that the test environment has been set up correctly
- Update and verify bi-directional traceability

Note: there may be overlap between this step and the Test Design step.

47
Q

What is Test Execution?

A

One of the 7 steps in the testing process.

In this step, you…
- Record versions of items, objects, tools, and testware
- Execute manual and automated tests
- Compare actual and expected results
- Analyze causes of anomalies
- Log outcomes (pass, fail, blocked)
- Report defects for observed failures
- Re-execution of failed tests
- Verify/update bi-directional traceability between test basis, conditions, cases, procedures, and results.

48
Q

What is Test Completion?

A

One of the 7 steps in the testing process.

In this step, you…
- Analyze lessons learned
- Turn over planned deliverables
- Close defect reports
- Create test summary report
- Finalize/archive testware, environment, and infrastructure for later use
- Retrospect and improve test process maturity

49
Q

What is Impact Analysis?

A

The identification of all work products affected by a change, including an estimate of the resources needed to accomplish the change.

It can be done before a change is made, to help decide if the change should be made, or after/concurrent with the change to identify the test cases that need to be written/updated and run.

50
Q

[Reviews] What is the responsibility of the Author?

A
  • Create the work product under review
  • Fix defects in the work product under review
51
Q

[Reviews] What is the responsibility of the Review Manager?

A
  • Review planning
  • Decide on planning and execution of reviews
  • Assign budget, staff, and time
  • Monitor ongoing cost effectiveness
  • Execute control decisions
52
Q

[Reviews] What is the responsibility of the Facilitator/Moderator?

A
  • Leads the review
  • Ensure effective running of the review meetings.
  • Mediate between different viewpoints
53
Q

[Reviews] What is the responsibility of the Review Leader?

A
  • Takes overall responsibility for the review
  • Decides who will be involved, when and where
54
Q

[Reviews] What is the responsibility of the Reviewers?

A
  • Review the work product under review
  • Identify potential defects
  • Present different perspectives
55
Q

[Reviews] What is the responsibility of the Scribe/Recorder?

A
  • Collate potential defects found during the “individual review” step
  • Record new potential defects, open points, and decisions
56
Q

What are the contents of a defect report?

A
  • An identifier (e.g. jira key)
  • Title/Summary
  • Date
  • Author
  • Test Item/Object
  • Test Environment
  • SDLC phase the defect was observed in
  • Defect description
  • Steps to reproduce
  • Expected vs. actual results
  • Scope or degree of impact (severity) to the stakeholder
  • Urgency/priority to fix
  • Defect state
  • Conclusions, recommendations, and approvals
  • References, including the test case that revealed the problem