Chapter 1 Flashcards
For each test level, Test Planning starts when?
INITIATION of the test process and
Continues throughout the project until completion of CLOSURE ACTIVITIES
Test Planning identifies what?
- Activities and Resources
- Methods - Metrics
- gathering and tracking METRICS - Adherence to plan
- Assess achievement of the objectives
How to determine useful METRICS during test planning stages?
- TOOLS selected
- TRAINING scheduled
- DOCUMENTATION established
Test Strategies selected help to determine what?
TASKS that occur during the planning stages
RISK-BASED Test Strategy
RISK ANALYSIS
- to guide test planning process to MITIGATE the reduction of risks
- to help in contingency planning
RISK ANALYSIS
If a number of likely and serious potential defects related to security are identified, what shall be done?
Significant amount of effort should be spent developing and executing security tests.
If serious defects are usually found in the design specifications, what shall be done?
Test planning process could result in ADDITIONAL STATIC TESTING (Reviews) of design specifications.
Which is used to determine the priorities of various testing activities?
RISK INFORMATION
What should be conducted if system performance is at high risk?
Performance testing may be conducted as soon as integrated code is available
Planning for the creation of
- test charters and tools
- DYNAMIC TESTING TECHNIQUES
- EXPLORATORY TESTING
Reactive Strategy
Test Planning defines what?
Test Approach
Test Levels
Goals and Objectives per level
Test Techniques
Risk-based testing - AVIONICS
Risk-Assessment
- level of code coverage is required
- which testing techniques to use
External dependencies and SLAs
Resources from outside group Dependencies on other projects or working within a program Deployment team External vendors or Devt partners DB administrator
Efficient TEST CONTROL
Testing Schedule
Monitoring Framework
Test Framework includes these and to meet test objectives and test coverage
MEASURES and TARGETS
This is the ability to report on traceability status makes complex relationship between devt work work products, test basis, test work products more transparent and comprehensive
PROPER CONFIGURED TRACEABILITY
Stakeholder measures and tatgets
Coverage on operational business cycle
TEST CONTROL
- ongoing activity
- compares actual progress against the plan
- implements corrective actions
- guides testing to fulfill the mission, strategies, and objectives
- revisits test planning activities
It is the activity that defines “WHAT IS TO BE TESTED” in the form of test conditions
TEST ANALYSIS
Can be identified by analysis of the test basis, test objectives and product risks
TEST CONDITIONS
Test conditions are traceable back to?
- test basis and
- strategic objectives
- test objectives
- other project or stakeholder criteria for success
Test conditions are traceable forward to?
- test designs and
- other test work products
Can be used to identify test conditions
FORMAL TECHNIQUES
ANALYTICAL TECHNIQUES
- Risk-Based Strategies
- Requirement-Bars Strategies
Factors to consider on deciding the level of detail at which to specify test conditions
- Level of testing - High/Low
- Level of detail and quality of the test basis
- System software complexity
- Project and product risk
- Relationship between the test basis what is to be tested and how it is to be tested
- Software development lifecycle in use
- Test management tool being utilized example test director
- Level at which test design and other test word products are to be specified and documented
- Skills and knowledge of the test analyst
- Level of maturity of the test process and the organization itself (note that higher maturity may require a greater level of detail or allow a lesser level of detail)
- Availability of other project stakeholders for consultation
Advantages of Detailed Test Conditions
- Flexibility in relating other test work products example test cases to the test basis and test objectives thus, providing better and more detailed monitoring and control for a test manager
- Defect prevention
- Relates testing work products to stakeholders in terms that they can understand
- Influence and direct other development activities
- Enables test design, implementation and execution, together with the resulting word products to be optimized by more efficient coverage of detailed measures and target
- Basis for clearer horizontal traceability
Disadvantages of detailed test conditions
- Time consuming
- Maintainability ability can be difficult in a changing environment
- Level of formality needs to be defined and implemented across the team
Specification of detailed test conditions can be particularly effective in the following situation
- Light weight test design documentation methods such as checklists are being used due to accommodate the development lifecycle cost and time constraints or other factor
- Little or no formal requirements or other development work products are available as the test basis
- Project is large scale, complex or high risk and requires a level of monitoring and control that cannot be delivered by simply relating test cases to development work products
Test conditions may be specified as LESS DETAIL when the test bases can be related easily and directly to the test word products this is more likely to be the case for the following
- Component level testing
- Less complex projects where simple simple hierarchical relationships exist between what is to be tested and how it is to be tested
- Acceptance testing where use cases can be utilized to help define tests
What is the activity that defines how something is to be tested?
TEST DESIGN
TEST DESIGN
TEST CASES
Test data creation during Iterative Approach can be done in what test process?
Test Design
Activity during which tests are organized and prioritized by the test analysts
TEST IMPLEMENTATION
STANDARD define
- inputs and expected results in test case specs and
- test steps in test procedures specs
IEEE 829
Disadvantages of EARLY TEST IMPLEMENTATION
AGILE: Iterative
- code changes dramatically iteration to iteration results in significant changes
- code becomes obsolete
- scripted tests/auto script unreliable or high maintenance
SEQUENTIAL:
- requirements chg frequently
ADVANTAGES of EARLY IMPLEMENTATION
- Worked examples how sw shd behave
- Concrete tests written based on test basis are easier for business experts to find verification than abstract
- Identify weakness in sw specs
- Verified tests illuminate illustrations of required behavior for sw designers and developers
Test Manager’s Role (Test Execution)
- Monitor progress accdg to Test Plan
- Initiate, carry out CONTROL actions to guide testing towards successful conclusion:
MISSION
OBJECTIVE
STRATEGY
Checking against implicit and explicit entry criteria
Test Implementation
Test a implementation involves what?
- FINAL CHECKS - ready to test
- ensures delivery of
——test envt
——code
——test data
——/RUN ENVT AND ACCEPTANCE TESTS
- test cases are all
——written
—-/reviewed
——ready to run - Develop detail description of test envt and test data
Level of detail and associated complexity of work done during test implementation may be influenced by?
the detail of the test work products:
Test cases and test conditions
TEST EXECUTION starts when?
TEST OBJECT is delivered
ENTRY CRITERIA for test execution is satisfied
TOOL are in placed for what?
Test Management
Defect Tracking (Jira)
Test Execution Automation
Test Manager Role during Test Execution
MONITOR progress accdg to test plan
CONTROL to guide towards successful conclusion of: MISSION, OBJECTIVES, STRATEGY
Use TRACEABILITY from
- test results back to test conditions, test basis, objectives
- from objectives forward to test results
Definition of information requirements and methods for collection are part of?
TEST PLANNING, MONITORING AND CONTROL
WHEN should Test Manager should ensure team members responsible to provide information require in an
ACCURATE
TIMELY MANNER
to facilitate EFFECTIVE EVALUATION AND REPORTING?
During TEST ANALYSIS, DESIGN, IMPLEMENTATION EXECUTION
Activities when key outputs are captured and either passed to the relevant person or archived
TEST CLOSURE
4 MAIN GROUPS OF TEST CLOSURE
- TEST COMPLETION CHECK
- TEST ARTIFACTS HANDOVER
- LESSONS LEARNED
- ARCHIVING RESULTS
Test completion Check
All test work concluded
Defects fixed or deferred to future release or accepted as permanent restrictions
Test artifacts handover
user and support the use of the system
Test and environment- MAINTENANCE TESTING
REGRESSION TESTING - MAINTENANCE TEAM
LESSONS LEARNED
RETROSPECTIVE MEETINGS
Lessons Learned
User Representation
Estimates
Trends - CAUSE AND EFFECT ANALYSIS
Potential Process Improvement Opportunities
Variances
ARCHIVING RESULTS
Configuration Mgmt System
Task omission reasons
- Premature reassignment
- Dismissal of project team member
- Resource or schedule pressure
- Team member burnout