Lecture 5

Question 1

Software testing is typically divided into what two types?

Answer 1

Functional and non-functional

Question 2

What are three examples of functional testing?

Answer 2

-Unit testing
-Integration testing
-End 2 end testing

Question 3

What are three examples of non-functional testing?

Answer 3

-Performance testing
-Security testing
-Usability testing

Question 4

Why do we do performance testing?

Answer 4

To ensure stability and reliability

Question 5

What do we hope to find during performance testing?

Answer 5

Bottlenecks

Question 6

What is the ultimate goal of doing performance tests to identify bottlenecks and improve performance?

Answer 6

To improve the user experience

Question 7

How can performance testing help with budgeting issues?

Answer 7

It can assess whether the IT infrastructure resources are over/underutilised, and if new changes are worth the time/money spent on them

Question 8

What are three types of performance test?

Answer 8

-Baseline test
-Load test
-Endurance test

Question 9

In the context of performance testing, what are transactions?

Answer 9

Logical groupings of requests

Question 10

In the context of performance testing, what is think time?

Answer 10

A way for the test to simulate the wait in between clicks for users

Question 11

What is response time?

Answer 11

Browser rendering time+network time+backend processing time

Question 12

What is throughput?

Answer 12

The number of operations the system can perform in a unit of time

Question 13

What is correlation?

Answer 13

The process of capturing parameters from server responses to use them in future requests, such as access IDs

Question 14

What is parametrisation?

Answer 14

The process of injecting parameters into requests to make them unique, for example orderIDs should be different each time to simulate real world usage

Question 15

What are metrics to consider when defining Acceptance Criteria goals?

Answer 15

-Response time
-Throughput
-Resource utilisation

Question 16

What is an example of a conceptual goal in performance testing, that might be used in a meeting with stakeholders?

Answer 16

The ‘user login’ function should be fast even under heavy usage

Question 17

What is an example of a quantitative goal that can actually be tested?

Answer 17

The ‘user login’ transaction is less than 4s with a 90% probability with up to 10k users in the system

Question 18

What is a common challenge in performance testing that arises from the need for the test environment to mirror the production environment?

Answer 18

Difficult to achieve early in the process (‘shift-left testing’), but doing it late might mean changes to infrastructure become more expensive

Question 19

What problems in performance testing are caused by the use of HTTP to communicate?

Answer 19

Most tools only work on the HTTP level, measuring from the backend, not including browser response time. Testing on the HTTP level requires deep knowledge of the application

Question 20

What are three popular load testing tools?

Answer 20

-JMeter (user friendly GUI)
-Loadrunner
-MS Visual Studio Load Tester for Web Applications

Question 21

What is an example of a programming framework?

Answer 21

Locust (python)