Lecture 4

Question 1

Test Automation (TA)

Answer 1

The use of special software to control the execution of tests and the comparison of actual outcomes with predicted outcomes.

Question 2

[TA] Advantages/Pros

Answer 2

• Saves time and $
• Increases accuracy
• Increases test coverage
• Helps devs find bugs faster

Question 3

[TA] What TO Automate

** Test cases that are: <4> **

Answer 3

Test cases that are:

• executed repeatedly
• tedious/difficult to perform
• time consuming
• high risk/business critical

Question 4

[TA] What to NOT Automate

** Test cases that are: <3> **

Answer 4

Test cases that are:

• new/never been manually executed yet
• frequently changing their requirements
• executed on an ad-hoc basis (for a particular purpose)

Question 5

[TA] Approaches <2>

Answer 5

• GUI Testing

- API Driven Testing

Question 6

[TA Approaches] GUI Testing

Answer 6

Generates GUI events (keystrokes, mouse clicks), and observes the changes that result in the GUI, to validate that the observed behavior of the program is correct.

Question 7

[TA Approaches] API Driven Testing

Answer 7

Uses a programming interface to the application to validate the behavior under test. Typically bypasses GUI altogether. Can also test public (usually) interfaces to classes, modules, or libraries.

Question 8

[TA] Agile

Answer 8

• Normal pyramid

- Emphasis from max to min (base to top): unit >= API >= GUI >= ~exploratory~

Question 9

[TA] Inverted Test Automation Pyramid

Answer 9

• Inverted pyramid

- Emphasis from min to max (tiny base to large top): Unit tests >= automated GUI >= manual tests

Question 10

[TA] Best Practices <4>

Answer 10

• Scope of Automation determined before project starts
• Selecting the right automation tool to fit automation requirements
• Scripting Standards followed while writing automation scripts
• Success of automation measured by percent of defects found, time required for automation testing for every release cycle, and productivity improvement

Question 11

[TA] Myths

Answer 11

• Automated software testing does NOT replace manual testing
• Not every tester can dual role manual and automation testing
• Automated testing is NOT a lot easier
• Testing jobs NOT in jeopardy due to automation

Question 12

Model Based Testing (MBT)

Answer 12

Testing technique, where run time behavior of software is checked against predictions made by a formal specification or model.
Describes how system behaves in response to an action (determined by a model).

Question 13

[MBT] Model

Answer 13

A description of a system’s behavior. Behavior is terms of input sequences, actions, conditions, output and flow of data from input to output.