Chapter 4

Question 1

What are the main testing tasks?

Think back to CTFL

Answer 1

1. Planning
2. Analysis
3. Design
4. Implementation
5. Execution
6. Completion/Reporting

Question 2

Planning

Who is responsible for setting testing objectives?

Answer 2

Stakeholders

…though there should be a distinction between user-facing and technical objectives

Question 3

Planning

What are the 3 necessary questions to ask when gathering information for planning?

Answer 3

1. What transactions will be executed, and what is the expected response time?
2. What system metrics are to be captured, and what values are to be expected?
3. What performance improvements are expected from these tests compared to previous cycles?

Question 4

Planning

What kinds information should be included in a Performance Test Plan?

Answer 4

1. Objectives
2. Test Objectives
3. System Overview
4. Types of perf testing to be conducted
5. Acceptance Criteria
6. Test Data
7. System Configuration
8. Test Environment
9. Test Tools
10. Profiles (Operational and Load)
11. Relevant Metrics
12. Risks

Question 5

Planning

What is the PTP Objective?

PTP - Performance Test Plan

Answer 5

Describe goals, strategies, and methods for performance test

Question 6

Planning

What is contained in the Test Objectives section?

Answer 6

Test objectives for each type of stakeholder
* Business
* Tech

Example: X number of users can access site within 3 sec or less at peak load times

Question 7

Planning

What is contained in the System Overview?

Answer 7

This section provides context for the measurement of test parameters.

Includes a high-level description of the functionality being tested

Question 8

Planning

Define the Roles and Responsibilities section of the plan

Not on the syllabus, but mentioned in AT*SQA videos.

Answer 8

The roles and responsibilities of those involved with testing.

Example: Architects, BAs

Question 9

Planning

Define Operational Profile

Answer 9

A representation of a distinct set of tasks, possibly based on user behavior, when interacting with a component or system, with frequencies of occurence.

Question 10

Planning

Explain the Metrics section of the plan

Answer 10

Define metrics that will be most meaningful to stakeholders and ensure those metrics will be tracked.

Example: Averages are good as a general benchmark, but you can dive deeper in the trends to identify outliers, per situation. See the peaks and valleys within monitoring and logs.

Question 11

Planning

What 4 things should be considered for a Performance Test Approach?

Answer 11

How can we get the best representation of production system?
* Environments
* Protocols
* Profiles
* Test Data

From AT*SQA Learn

Question 12

Planning