Chapter 8: Testing & Evaluation

Question 1

What is Usability Testing?

Answer 1

Useful tool that can be implemented to improve functionality. A group of users are given access to the current version of the code and asked to perform certain tasks. The users then give feedback on how easy it was to perform those tasks, and other feedback on the user interface and other improvements.

Question 2

What is involved in testing a program using a testing table?

Answer 2

First selecting appropriate functions to check, then selecting a range of test
data that would check all boundaries of the solution and calculating expected results, then runing the test on the program to get actual results comparing those with the expected results.

Question 3

What is accessibility?

Answer 3

Allowing the solution to be used by a wide range of users

Question 4

What is bench marking?

Answer 4

Commonly performed in the analysis stage,
Benchmarking is documenting the capabilities of the software solution and comparing these with the design specificiations.

Question 5

What is involved in documentation testing and why is it important?

Answer 5

Creating a record of what has been carried out, how successful it was and what measures were taken to correct any errors that were found.

This information is useful for management in reporting and being accountable to clients.

Question 6

What is included in documenting test results

Answer 6

1) Tester’s name and department
2) Software package and version
3) Date and time tests were performed
4) Full description of results
5) Resolution of any problems

Question 7

In an evaluation strategy, what does the first row include

Answer 7

Time frame:
Prior to signing off on the finished solution

Description:
1) Acceptance or usability testing by the users

Efficiency measures:
- Is the software solution easy to use and understand
- Does the solution produce results in a timely manner?

Effectivenss measures:
- Does the solution produce accurate results

Question 8

In an evaluation strategy, what does the 2ND row include

Answer 8

Time Frame:
- IMMEDIATELY after the solution has been installed

Description:
- Network or technical staff ensure that the solution is operational and is ready to be used

Effectiveness measures:
- Is the software solution fully operational

Question 9

In an evaluation strategy, what does the 3RD row include

Answer 9

Time Frame:
3-6 Months after the introduction of the software

Description:
Feedback is gathered from the clients using the methods:
1) Surveys
2) Interviews with select staff/managers
3) System error logs
4) Feedback forms

Efficiency measures:
- Is the software as easy to use as it was initially?
- Does the solution continue to produce results in a timely manner (fast), now that more users are using the solution at the same time?

Effectiveness measures:
- Is the correct information being produced?

Question 10

What is quality assurance?

Answer 10

Process by which DEVELOPERS ensure a new software solution is operating correctly, and if it meets

Question 11

1. For this acceptance testing criteria, identify a technique to evaluate it:

Does the software solution perform the tasks set out in the SRS?

Answer 11

Identify the main tasks required of the software solution as identified in the SRS, placing them in a testing table, checking if the actual results can be compared/match the expected results

Question 12

2. For this acceptance testing criteria, identify a technique to evaluate it:

Is the software solution effective in producing the correct/expected results?

Answer 12

Compare information that is produced using the previous information system to that produced using the software solution.
OR, manually verify it.

Question 13

2. For this acceptance testing criteria, identify a technique to evaluate it:

Is the software solution effective in producing the correct/expected results?

Answer 13

Compare the time taken to perform tasks using the software solution to the previous system.

Question 14

4. For this acceptance testing criteria, identify a technique to evaluate it:

Is the software solutions user interface clear and intuitive?

Answer 14

Select a number of users to provide feedback on the functions and the easy of understanding and consistency of navigation in the solution.

Question 15

What are some factors that influence the effectiveness of project plans?

Answer 15

1) Clear scope
2) Specification creep
3) Changes in staff
4) Communication issues
5) Inadequate time for testing
6) Budget constraints
7) Tech changes

Question 16

Describe some factors influencing the effectiveness of the waterfall model

Answer 16

1) Clients may be unsure of their exact needs and the scope, which can impact the waterfall development

2) Clients may not be happy with the delivered product, and they may not see what will be delivered until it is finished

Question 17

If clients are unsure of their exact needs, what development model is the most suitable?

Answer 17

Agile, as it allows for adaptive design and clients can provide feedback during the design stages and are more involved

Question 18

If clients are 100% sure of what they would like to see in the solution, which development model is more suitable?

Answer 18

Waterfall model, as it will be a seamless transition from the stages, and the clients would be more satisfied

Question 19

Describe some factors influencing the effectiveness of the Agile model

Answer 19

1) The high client involvement may be an advantage, but clients may not have the time or interest for this large involvement, which will diminish the effectiveness

2) Due to its intensity with the sprints, team members need to be focused on their work, and if the completion of tasks drags on, the project timeline can be pushed, adding to the overall cost of the solution

Question 20

Describe some factors influencing the effectiveness of the Spiral model

Answer 20

1) The complexity places SIGNIFICANT pressure on the developor managing the projectu