Deck #1 Flashcards

1
Q

What is a use case?

A

defines how the users interact with the system.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the goal of a use case?

A

defines how the users interact with the system.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is a test case?

A

set of conditions or variables under which a tester will determine whether a system undertestsatisfies requirements or works correctly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does a test case consist of?

A

”- Title

  • Description
  • Prerequisite
  • Steps
  • Expected Results”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is Equivalence Class testing?

A

reduce the number of test case inputs (and therefore test cases) where there are a large number of possible inputs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is an Equivalence Class?

A

a partition of input values

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are Boundary Values?

A

values which are at, just above, and just below the defined limits of an input domain

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Purpose of Boundary Value Testing

A

explicitly test inputs which are likely to generate an error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a Test Suite?

A

collection of test cases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are BVTs?

A

Build Verification Tests - suite of tests run just after a new build of the system has been created

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Purpose of BVT?

A

To verify that the critical functionalies of the system are working so that QA does not waste time installing and testing a broken system

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What do BVTs typically contain?

A

contain a set of functionality tests that are typically automated so that the BVT suite can be automated as part of the build process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What types of test cases are chosen during BVT?

A

cases that cover the most important functionalities of the system

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are DRTs?

A

Developer Regression Tests - suite of tests run against new code before the new code is checked into the source code control repository

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a full test pass suite

A

generally consists of every current test case

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

When are full test pass suites run?

A

before any milestone release and before final delivery

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is Code Coverage?

A

Metric used to measure test set thoroughness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is Mutation Testing?

A

Measures test set effectivness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is Pair-Wise testing?

A

technique used to reduce the number of test case inputs where there are too many inputs to deal with

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is a Test Plan?

A

“high-level details of test efforts including

  • What? In-scope, out of scope
  • Where? Environments and deployment strategy
  • When? Test schedule
  • Who? Test team”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What questions should be asked before logging a bug?

A

”- Is it consistently reporducible? Maybe just a caching issue

  • Where does it occur? Maybe deployment related
  • Easily reproducible?”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What should be included in a Bug Report?

A

”- Summary

  • Severity
  • Priority
  • Environment
  • Steps to Reproduce (Input data, screenshots, etc.)
  • Description (expected vs. actual)”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is black box testing?

A

testing that occurs when the tester does not have knowledge of the systems internal structure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Give an example of black box testing for a web application

A

from the webpage, verify you’re able to type in your credentials and view your files

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is white box testing?

A

internal structure is known

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Give an example of white box testing for a web application

A

calling an API to verify the correct response is given

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Benefits of automated testing

A

”- SAPES (Speed, Accuracy, Precision, Efficiency, Skill-building)

  • Speed - can be executed faster
  • Accuracy - not subject to human error
  • Precision - normally executed the same way each iteration
  • Efficiency - testing can be unattended
  • Creation of automated tests can increase the engineer’s skillset”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What is functional testing?

A

testing done to verify a systems compliance with specified requirements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What are some types of functional testing?

A

”- Unit testing

  • Smoke testing
  • Sanity testing
  • Integration Testing
  • Interface Testing
  • System Testing
  • Regression Testing
  • UAT Testing”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What is Unit Testing?

A

Testing of the individual components

31
Q

What is Smoke Testing?

A

another name for BVT

32
Q

What is Sanity Testing?

A

testing performed after a new build with minor changes is delivered

33
Q

Purposed of Sanity testing?

A

save time and costs involved if the test team begins rigorous testing on a broken system

34
Q

When to use Smoke vs. Sanity

A

”- Use smoke on initial buils when the system is relatively unstable
- Use santity on stable builds after multiple rounds of regression testing”

35
Q

What is Integration Testing?

A

Testing of integrate parts to expose defects in the interaction of integrated components

36
Q

What is System Testing?

A

Testing of the integrated system

37
Q

What is regression testing?

A

Done to verify that previously working features still funciton properly

38
Q

What is UAT?

A

User Acceptance Testing - testing done by “Real world” users to verify the system meets the requirements of the end user

39
Q

What is Configuration Testing?

A

testing a system on machine which have various combinations of hardware and software

40
Q

Issues with Configuration testing?

A

the number of possible configurations is too large, so it’s crucial that test planning identifies which platforms will be supported

41
Q

What to do when the number of configurations is large?

A

“Prioritize testing efforts based on factors like:

  • size of user base
  • risk associated with undiscovered bug in a particular configuration”
42
Q

How to test hardware configuration?

A

Set up a test lab consisting of a large number of machines with different types of hardware

43
Q

How to test software configuration

A

Set up mutliple VMs with different software configurations and run it on a single physical host machine

44
Q

Easy way to maintain software configuration test effort?

A

maintain a library of virtual machines in the form of .vhd files

45
Q

What is Data Set Testing?

A

“Testing the site with various types of data and partitions
• I.e. customer A data model is ok, customer B data model has invalid data causing issues

46
Q

What is non-functional testing?

A

testing done against non-functional requirements to check the readiness of the system

47
Q

List types of non-functional testing

A

”- Performance

  • Scalability
  • Security
  • Usability Testing”
48
Q

What is Performance Testing?

A

tests that check how the system behaves and performs to identify bottlenecks and bugs with the goal of establishing the benchmark behavior of the system

49
Q

Give an example of Performance testing

A

you can test the application network performance through ‘Connection Speed vs. Latency’ chart. Latency is the time difference between the data to reach from source to destination. A 70kb page would take not more than 15 seconds to load for the worst connection of 28.8kbps modem (latency=1000 milliseconds), while the page of the same size would appear within 5 seconds for the average connection of 256kbps DSL (latency=100 milliseconds). And, a 1.5mbps T1 connection (latency=50 milliseconds) would have the performance benchmark set as 1 second to achieve this target.

50
Q

Give another example of Performance Testing

A

Another example would be of Request-response model. We can set a benchmark that the time difference between the generation of request and acknowledgment of response should be in the range of x ms (milliseconds) and y ms, where x and y are standard digits.

51
Q

What are some KPIs to analyze during Performance Testing?

A

”- number of virtual users

  • hits per second
  • errors per second
  • response time”
52
Q

Types of testing encompassed in Performance Testing?

A

”- Load

  • Stress
  • Spike
  • Scalability
  • Volume
  • Endurance”
53
Q

Issues discovered during performance testing?

A

All performance bugs: runtime bloat, scope for optimization, issues related to speed, latency, throughput, etc.

54
Q

What is Salability Testing?

A

tests the ability of the system to continue functioning well when changes in size or volume

55
Q

What is Load testing?

A

testing the system through constantly and steadily increased loads until it reaches threshold

56
Q

Purpose of Load Testing?

A

used to determine if the system under test meets its functional requirments when operating with a large number of users

57
Q

What attributes are monitered during Load Testing

A

”- Peak Performance

  • Server Throughput
  • Response Time under various load levels
  • Adequacy of H/W environment
  • How many users the application can handle without effecting performance”
58
Q

Give an example of load testing a web application?

A

using a tool to simulate multiple users by sending HTTP requests to the web site hosting the application

59
Q

Give an example of load testing in Jmeter?

A

”- Test analyzes adding 100 users every 30 seconds until reaching 1,000 users.
- Each step takes 30 seconds to complete and JMeter waits 30 seconds before starting the next step. After reaching 1,000 threads all of them will continue running and hitting the server together for 5 minutes.

60
Q

What are some outcomes of load testing?

A

”- Exposing the defects in application related to buffer overflow, memory leaks and mismanagement of memory. The issues that would eventually come out as the result of load testing may include load balancing problems, bandwidth issues, the capacity of the existing system, etc.

  • To determines the upper limit of all the components of application like a database, hardware, network, etc. so that the application can manage the anticipated load in future.
  • To set the SLAs for the application.”
61
Q

Issues identified through load testing

A

Load balancing problems, bandwidth issues, system capacity issues, poor response time, throughput issues, etc.

62
Q

What is Stress Testing?

A

“examining how the system behaves under instense loads or reduced resources (low CPU availability, low RAM, limited hard drive space,etc.) and how it recovers when going back to normal usage

63
Q

Goal of Stress Testing?

A

analyze post-crash reports to define the behavior of application after failure. The biggest challenge is to ensure that the system does not compromise the security of sensitive data after the failure.

64
Q

What is a Spike Test?

A

Stress test that checks how the system behaves when there is a sudden ramp up in the number of users

65
Q

“Suppose a requirement states:

"”system must be able to respond to a Refresh request within 4000 milliseconds when the processor usage is operating at 95% or less””

How do you test?”

A

use a tool to simulate other programs running on a test host machine to throttle up CPU usage to the desired level and then perform a Refresh operation and measure the response time

66
Q

What are some issues that might result from stress testing?

A

Synchornization issues, memory leaks, race conditions, etc.

67
Q

Issues identified through stress testing

A

Security loopholes with overload, data corruption issues at overload situation, slowness, memory leaks, etc.

68
Q

What is the most fundamental type of testing for Web Applications?

A

HTTP Request-Response Testing

69
Q

What is HTTP Request-Response Testing?

A

Verifying that sending input requests produce the correct output response

70
Q

How would you perform HTTP Request-Response Testing?

A

“Manually: enter information in the web browser adddress bar and examine the results

Automatically: send a sequence of query string input requests to the Web server and then examine the HTML response”

71
Q

“Suppose we have a web application that accepts user input from an HTML form element and uses the GET method as such:

form>

What is a valid test case input when typed in the address bar of a web browser?”

A

“http://localhost/buildPage.asp?city=Bay+City&state=RI

Query strings consist of a URL followed by a “”?”” delimiting character and then a list of name-value pairs in the form of name=value, delimited by the & character”

72
Q

What is Latency?

A

Latency is the delay incurred in communicating a message (the time the message spends “on the wire”). T

73
Q

What is response time?

A

Response time is the total time it takes from when a user makes a request until they receive a response.

74
Q

What is process time

A

Processing time is the amount of time a system takes to process a given request, not including the time it takes the message to get from the user to the system or the time it takes to get from the system back to the user.