5.1. Test Organization

Question 1

(K2) Explain the benefits of independent testing

Answer 1

• Independent testers are likely to recognize different kinds of failures compared to developers because of their different backgrounds, technical perspectives, and biases
• An independent tester can verify, challenge, or disprove assumptions made by stakeholders during specification and implementation of the system
• Independent testers of a vendor can report in an upright and objective manner about the system under test without (political) pressure of the company that hired them

Question 2

(K2) Explain the drawbacks of independent testing

Answer 2

• Isolation from the development team, may lead to a lack of collaboration, delays in providing feedback to the development team, or an adversarial relationship with the development team
• Developers may lose a sense of responsibility for quality
• Independent testers may be seen as a bottleneck
• Independent testers may lack some important information (e.g., about the test object)

Question 3

5.1.2. (K1) Identify the tasks of a test manager

Answer 3

• Develop or review a test policy and test strategy for the organization
• Plan the test activities by considering the context, and understanding the test objectives and risks. This may include selecting test approaches, estimating test time, effort and cost, acquiring resources, defining test levels and test cycles, and planning defect management
• Write and update the test plan(s)
• Coordinate the test plan(s) with project managers, product owners, and others
• Share testing perspectives with other project activities, such as integration planning
• Initiate the analysis, design, implementation, and execution of tests, monitor test progress and results, and check the status of exit criteria (or definition of done) and facilitate test completion activities
• Prepare and deliver test progress reports and test summary reports based on the information gathered
• Adapt planning based on test results and progress (sometimes documented in test progress reports, and/or in test summary reports for other testing already completed on the project) and take any actions necessary for test control
• Support setting up the defect management system and adequate configuration management of testware
• Introduce suitable metrics for measuring test progress and evaluating the quality of the testing and the product
• Support the selection and implementation of tools to support the test process, including recommending the budget for tool selection (and possibly purchase and/or support), allocating time and effort for pilot projects, and providing continuing support in the use of the tool(s)
• Decide about the implementation of test environment(s)
• Promote and advocate the testers, the test team, and the test profession within the organization
• Develop the skills and careers of testers (e.g., through training plans, performance evaluations, coaching, etc.)

Question 4

5.1.2. (K1) Identify the tasks of a tester

Answer 4

• Review and contribute to test plans
• Analyze, review, and assess requirements, user stories and acceptance criteria, specifications, and models for testability (i.e., the test basis)
• Identify and document test conditions, and capture traceability between test cases, test conditions, and the test basis
• Design, set up, and verify test environment(s), often coordinating with system administration and network management
• Design and implement test cases and test procedures
• Prepare and acquire test data
• Create the detailed test execution schedule
• Execute tests, evaluate the results, and document deviations from expected results
• Use appropriate tools to facilitate the test process
• Automate tests as needed (may be supported by a developer or a test automation expert)
• Evaluate non-functional characteristics such as performance efficiency, reliability, usability, security, compatibility, and portability
• Review tests developed by others