Acquisition Test 3 Flashcards

1
Q

Define procurement.

A

Purchase/Acquisition of required supplies & services.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the objectives of the procurement process?

A
  • Right quality
  • Right quantity
  • Right time
  • Right price
  • Right supplier
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the responsibilities of the Program Manager?

A

Responsible for meeting program objectives within cost, schedule, & performance.

PM Chain of Authority: PEO, CAE, DAE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the responsibilities of the Contracting Offier?

A

Provide procurement support to the PM & ensure contracts comply with statute.

  • Authority from Constitution and FAR.
  • Chain of Authority: Head of Contracting, Head of Agency, SECDEF, President
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is a contract and the basic elements?

A

A mutually binding legal relationship obligating the seller to furnish supplies or services & the buyer to pay.

Elements:

  • Offer
  • Acceptance
  • Consideration
  • Competency of parties
  • Legality of purpose
  • Certainty of terms
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the 6 phases of the procurement process?

A
  1. Procurement Planning
  2. Solicitation Planning
  3. Solicitation
  4. Source Selection
  5. Contract Admin
  6. Contract Close-Out
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Define Procurement Planning and list at least one activity.

A

Determine what to procure & when.

Identifying what needs are best met by procuring products or services outside the organization.

Activities:

  • Whether to procure (outsource)
  • How to procure
  • What to procure
  • How much to procure
  • When to procure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Define Solicitation Planning and list at least one activity.

A

Document requirements & identify potential sources.

  • State requirement in terms of Mission need & minimum Operational performance.
  • Use performance objectives rather than design requirements
  • ID min threshold & objectives & performance values
  • Develop eval factors that communicate program priorities in order of importance.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Define Solicitation and list at least one activity.

A

Invitation for offerors to submit a bid or proposal.

  • Post formal public advertisement
  • Obtain quotes, bids, offers, or proposals
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Define Source Selection and list at least one activity.

A

Evaluate proposals and select Best Value.

  • Maximize Competition
  • Minimize Complexity
  • Ensure Impartial Evaluation
  • Select proposal with highest degree of Realism
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Define Contract Admin and list at least one activity.

A

Manage relationship with the contractor.

Manage (activities):

  • Changes
  • Performance
  • Disputes
  • Termination
  • Close Out
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Define Contract Close-Out and list at least one activity.

A

Completion and settlement of the contract and resolution of any open items.

Activities:

  • ID & resolve any uncompleted obligations or pending liabilities on part of either party.
  • Document contract decisions & actions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How is the procurement process integrated with the acquisition framework?

A

The procurement process occurs at the beginning of each phase of the acquisition framework, which helps minimize Risk during progression through life cycle.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the 3 methods of procurement?

A

Competitive:

  1. Sealed Bidding: lowest-priced/tech acceptable (LP/TA). “Silent Bidding.” No communication or negotiations. Used with Well-Defined Requirements(i.e., blueprints/desing/drawings provide detailed specifications) and with Firm-Fixed Price Contracts.
  2. Competitive Negotiations: Best Value. Contract may be awarded to other than lowest bidder. **Quantity is important **(blueprint/design/drawings are not provided). Used with any auth contract type.

Noncompetitive:

  1. Sole-Source: only 1 contractor can provide service or product.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are 4 objectives in selecting contract type?

A
  1. Place as much cost responsibility on the contractor as reasonable.
  2. Allocate risk between buyer & contractor.
  3. Maximize contractor incentive.
  4. Minimize contract administration cost for both parties.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are 3 factors to consider in selecting contract type?

A
  1. Capability of seller’s accounting system
  2. Uncertainty in cost estimate
  3. Type & complexity of requirements
  4. Urgency of requirement
  5. Marketplace & competition
  6. Seller’s technical capability
  7. Admin costs
  8. Size & amount of the contract
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What’s the difference between Fixed Price & Cost Type contracts?

A

Fixed Price:

  • Contractor bears Risk
  • Risk of performance is **low **

-Contractor only receives agreed to amount & profit is dependent on costs incurred.

Cost Type:

-Gov’t bears Risk

  • Risk performance is high
  • Gov’t obligated to reimburse contractor for all allowable, reasonable, & allocable costs incurred.
  • Contractor provides “Best Effort”
  • Cost savings is returned to Gov’t
  • Cost overrun paid by Gov’t
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the 3 types of contract fee?

A
  1. Fixed Fee: Used with Cost type or Cost Plus Fixed Fee. Lowest risk to Contractor/Hightest risk to Gov’t. Paid regardless of Contractor’s performance.
  2. Award Fee: Award Fee pool (funding) available at contract initiation, Award Fee Plan states criteria for % of fee awarded, Award Fee Board meets at intervals to determine fee, may include fixed base fee. Subjective tip-like fee given for exceeding requirements. NOT Disputable.
  3. Incentive Fee: Used to incentivize cost, schedule, or performance, Fee determined by a calculation & is disputable, may specify minimum fee & always specifies max fee, Contractor must perform satisfactory on all contract elements to qualify.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What’s the relationship between requirement, buyer’s risk, seller’s risk, and contract type?

A

Cost Type Fixed Price

<————————————————>

**CPFF CPAF CPIF FPI FP/EPA FFP **

High <——–Buyer’s Risk——–> Low

**Low <——–Seller’s Risk——–>High **

**Less **Defined<—Requiremnet—> More Defined

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What’s the purpose of the SOW and its relationship to WBS?

A

The Statement of Work establishes and defines a standard for contractor performance. Such as:

  • What the Contractor must do
  • What goods or services are to be performed

**Each SOW Task corresponds to a WBS Element from the Systems Engineering Process. **

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is SOO and how is it different from SOW?

A

Statement of Objectives are high level objectives stated in broad terms of desired results, but not how to accomplish the results IOT garner max innovation.

SOO does NOT become part of the contract (like SOW)

Contractor proposes How and the SOO replaces the SOW in the RFP.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Differentiate between IFB and RFP.

A

Invitation for Bid:“Sealed Bidding” price based selection, discussions not allowed.

Request for Proposal:“Best Value” based selection. LPTA or other than LPTA, discussions are allowed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

List 3 source selection goals.

A
  1. Max Competition
  2. Minimize Complexity of Solicitation, Evaluation, & Selection decisions
  3. Ensure Impartial Evaluation
  4. Selet Proposal with highest degree of Realism
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Describe the “Best Value” continuum.

A

LP/TA Highest Tech

                                    Rated Offeror

<—————————————>

      Tradeoff Process
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Identify the 3 source selection organizations & the function of each.

A
  1. Source Selection Authority (SSA): Auth Individual Selects the most advantageous source.
  2. Source Selection Advisory Council (SSAC): Advises the SSA on comparative strengths & weaknesses of proposals based on SSEB findings
  3. Source Selection Evaluation Board: Performs comprehensive, independent evaluation of proposals against the Solicitation & Source Selection Plan (SSP).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Identify 3 characteristics of source selection factors (be able to ID which is NOT a factor).

A
  • Few in number
  • True discriminators with significant differences
  • Consistent with Source Selection Plan
  • Definable & measureable - Qualitative measures often used
  • Predictive of a successful procurement
  • Tailored to the Acquisition
  • Cost
  • Past Performance (required on $1M+ contracts)

Example with weighted importance:

Technical performance (25%), Past Performance (20%), Cost (20%), Supportability (15%), Producibility (15%), Management Approach (5%)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What are the 3 Contract Administration activities?

A
  1. Manage contract changes (supplemental Agreements, Constructive Changes)
  2. Monitor Contractor’s Performance (Quality assurance, Earned Value Management, Contractor Payments, Award Fee process)
  3. Disputes
  4. Contract Termination
  5. Contract Close Out
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Differentiate between Change Orders & Supplemental Agreements.

A
  1. Change Orders: written order signed by the Procurement Contracting Officer (PCO) directing the contractor to make a unilateral (w/o prior agreement) change.
    - Authorized by the contract “Changes Clause”
    - Contractor must contiue performance of the contract as changed by the PCO.
    - Creates “undefinitized” Gov’t liability & the contractor may be entitled to subsequent Equitable Adjustment.
  2. Supplemental Agreement: Contract modification based on a bilateral agreement to the change; Equitable Adjustment is part of the agreement.

-

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is a Constructive Change?

A
  • Contractor construes guidance or actions from a Gov’t Official as authorization for a change
  • Involves contractor effort that is not necessarily part of the contract.
  • Requires PCO ratification (retroactive change order)
  • Once ratified, may require Equitable Adjustment.

Ex: CO asks Contractor to install “leftover” carpet in his office, but wasn’t part of the original contract.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What is the role of the DCMA in the procurement process?

A
  • The Defense Contract Management Agency provides Contract Administration Services; PM representation, provides instruction/guidebook;
  • Involved in all phases of the contracting process: Pre-Award, Award & Performance, and Completion
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is the role of the DCAA in the procurement process?

A
  • The Defense Contract Audit Agency is the Principle Advisor to the Contracting Officer on financial matters.
  • Performs audits on the acceptability of the contractor’s incurred & estimated costs.
  • Reviews the financial & accounting aspects of the contractor’s cost control systems
  • Performs other analysis & reviews that require access to the contractor’s financial & accounting records supporting proposed & incurred costs.
  • Performs audits to confirm allowability of costs claimed on cost-reimbursement contracts.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What is the role of DFAS in the procurement process?

A

Defense Finance & Accounting Service:

  • Entitles & disburses payments on DoD contracts
  • Manages invoices & vouchers
  • Provides info concerning payment to vendors
  • Provides info on invoices submitted against contracts with the DoD & paid by DFAS.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What are 2 types of Contract Terminations?

A
  1. Termination for Convenience (T4C): Unilateral Gov’t Right, Notice of Termination must be in writing, No justification required, may be partial or complete, Contractor entitled to termination costs.
  2. Termination for Default (T4D): if Contractors fails to: Make Timely Delivery; Perform any Contract Provision; Make Satisfactory Progress thus Endangering Performance.
    - Gov’t pays contract price for completed items
    - Gov’t may obtain reprourement costs.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Discuss the cure notice, show cause letter, and termination notice.

A

A 3 step process under the Termination for Default (T4D)

Cure Notice: Issued by the Government when the contractor is failing to make progress on the contract. The contractor is given 10 days to cure (correct) the deficiency.

Show Cause: Issued by the Government when the contractor has failed to correct the deficiency (for example, deliver within the delivery due date), and is being considered for termination.

Termination Notice: Issued when the government takes action to terminate the contract.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What are 2 avenues available to contractors for appealing a CO’s final decision?

A
  1. Administrative Filed within 90 days forwarded to Armed Services Board of Contract Appeals, then US Court of Appleas for the Federal Circuit, and US Supreme Court
  2. Judicial Filded within 12 months forwarded to Court of Federal Claims, then US Court of Appeals for the Federal Circuit, and US Supreme Court
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What is the FYDP and what period does it cover?

A

The Future Years Defense Program.

  • “Full” FYDP is 10 years
  • “Basic” FYDP is 5 years (aka POM)

1 year: BY

4 years: Out Years

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What are the 3 basic dimensions of the FYDP structure?

A

Budget Year

Out Years (4 years)

Force Structure Only (3 years)

38
Q

Describe what the POM cycle looks like for the current year.

A

CY POM/PR Covering these yeas:

2006 POM-08 08 09 10 11 12 13

2007 PR-09 09 10 11 12 13

2008 POM-10 10 11 12 13 14 15

2009 PR-11 11 12 13 14 15

2010 POM-12 12 13 14 15 16

2011 POM-13 13 14 15 16 17

Biennial Budget Sumitted in POM

39
Q

What are the 4 phases of the resource allocation process?

A
  1. PPBE: Planning, Programming, Budgeting & Execution
  2. Enactment
  3. Apportionment
  4. Execution
40
Q

From a top-level after the PPBE process is complete, what process does the defense budget follow?

A

Enactment

41
Q

What 2 areas does the PPBE process link?

A

Budget execution & program performance.

42
Q

What is the PPBE process (include 4 characteristics)?

A

DoDs primary resource management system.

  • Articulates strategy
  • IDs size, structure & equipment
  • Sets programming priorities
  • Allocates resources
  • Evaluates actual output against planned performance & adjusts resources as appropriate.
43
Q

What is the DPPG & RMD and their purpose?

A

-Defense Planning & Programming Guidance: contains Guidance on the Development of the Force (GDF) and Joint Planning Guidance (JPG). A 5 year cycle of Budget Year plus 4 Outlay Years.

-Resource Management Decisions: issued by DEPSECDEF after POM and BES. Approves the Service POM/BES and affirms or changes dollar amounts or manpower allowances.

44
Q

What are the 4 phases of PPBE, key question being answered, and what is the purpose of each phase?

A
  1. Planning: “What capabilities are required?” Provide overall guidance for resource allocation.

2. Programming: “Which programs best meet the military strategy?” Allocate resources to support DPPG goals.

3. Budgeting: “Are the programs within fiscal policy?” To prepare a defensible budget.

4. Execution Review: “Are we executing efficiently?” Provide feedback.

45
Q

What is the POM and the BES and their purpose?

A

Program Objectives Memorandum (POM) - 4 years: Principal planning document addressing DoD requirements over the FYDP. A fiscally constrained memo from the Components to OSD that recommends a balanced allocation of resources, programs, & manpower.

Budget Estimate Submission (BES) - 1 year: DoD Component’s budget submissions to OSD showing budget requirements for inclusion in the DoD budget.

46
Q

Contrast the purpose of the PPBE process from an OSD vs PM perspective.

A

-OSD Perspective:

  • Balance requirements to available resources
  • Address Admin/DoD Priorities
  • Acquisition Initiatives
  • Assure Joint Programs are Consistent
  • Budget “Scrub” Issues

-PM Perspective:

  • Out Year Funding: know funding needs by year and Appropriation
  • POM Funding: Ensure POM build is accurate
  • Budget Execution: execute efficiently, watch obligation rates.
47
Q

List 4 primary reasons why programs may lose funding.

A
  1. Scarcity of resources
  2. Questionable need for program: lack detailed justification, duplication of efforts/capabilities, system retired
  3. Risk: new program, unstable/premature project, high tech risks.
  4. Funding/Execution Issues: slow obligations/expenditures, non-conformance w/ policies
  5. Politics
48
Q

The Congressional Budgeting process uses what 3 committees for both the House and Senate?

A

1. Budget Committee

2. Appropriation Committee

3. Authorization Committee

49
Q

What are 2 key functions of the Budget Committees? Does this result in a law?

A
  1. Draft Concurrent Budget Resolution
    - Spending Ceilings for each major Appropriation

Does NOT result in LAW

  1. Works with Congressional Budget Office
50
Q

What committee’s (both House & Senate) authorize National Defense? Give 3 examples of what they authorize?

A

House & Senate Armed Services Committees (HASC & SASC).

Authorizes:

  1. Program Initiation
  2. Procurement Quantities
  3. Personnel End Strength
  4. Program Funding Ceilings
    - Provides Authorization Policy
51
Q

What is provided for in the Appropriation Bill (What does it grant)? What 2 appropriations impact DoD?

A

Provides Budget Authority - Permission to Obligate Funds

Includes Defense & Military Contruction appropriations.

52
Q

What is apportionment?

A

Distribution of funds appropriated by Congress.

-Funds within DoD are allocated by USD Comptroller to Service counterparts and Defense Agencies

53
Q

What is the process of apportionment (from high to low)?

A

Congress

OMB

OSD Comptroller

Service Comptroller

MAJCOM/PEO Comptroller

PMO Program Management Office

54
Q

Define Commitment.

A

Administrative reservation of funds.

55
Q

Define Obligation.

A

A legal (contract) reservation of funds

56
Q

Define Expenditure.

A

Occurs when a government check is issued

57
Q

Define Outlay.

A

When cash leaves the US Treasury (DFAS processes payment)

58
Q

What 3 contrainsts impact the availability of funds for a particular obligation? Briefly describe each.

A

Purpose: for which appropriated (color of money)

Time: period during which authority exists to record a leagal liability against the appropriation.

Amount: funding available and not to exceed authorized amount.

59
Q

What violation may trigger the Misappropriation Act?

A

When funds are used for any purpose other than for which Congress appropriated them for.

60
Q

What are the durations of the following current appropriations?

O&M

RDT&E

Procurement

Construction

Shipbuilding

Military Personnel

A

O&M: 1 year (1+5 = 6)

MILPERS: 1 year (1+5 = 6)

RDT&E: 2 years (2+5 = 7)

Procurement: 3 years (3+5 = 8)

Construction (MILCON): 5 years (5+5 = 10)

Shipbuilding: 5 years (10)

61
Q

Explain the life of an appropriation.

A

-Current Period: Available for obligation based on type of appropriation

  • Expired: Available for adjustments, liquidations & changes for 5 FYs
  • Cancelled: No longer available for any purpose
62
Q

What is full funding? Explain an example of an exception.

A
  • Procurement & MILCON Appropriations
  • Funds are available at contract award to cover best total estimated cost to deliver the contract quanity of complete, militarily useable itmes.
  • Prohibitis piecemeal procurement
  • Helps stability (joint programs)

Exceptions:

  1. Advance Procurement for long lead-time items
    - To maintain production schedule
    - Lead-time of component greater than life of appropriation
    - Lead-time of component significantly longer than remainder of end item.
  2. Mult-Year:
    - When Gov’t contracts for the purchase of supplies or services that satisfy requirements for 1-5 yrs.
    - Contracted deliveries will exceed the 12 month funded delivery period
    - Economic Order Quantities
63
Q

What is incremental funding? When is it most commonly used?

A
  • Used with RDT&E Appropriations.
  • Allows flexibiltiy in an uncertain environment
  • Used when funding will cover only a portion of the obligations to be incurred in completing the program.
  • Phasing of total funding of programs over 2 or more FYs based upon levels & timing of obligatonal requirements for the funds.
64
Q

What violations may trigger the Anti-deficiency Act?

A
  • Obligations in excess of the amount appropriated or in excess of that permitted by agency regulations.
  • Obligation to pay money in advance of appropriation.
65
Q

What is T&E and its 3 components?

A

Test & Evaluation is a** process of conducting an assessment** or exercising a system or its components and analyzing the results/**information **in order to mitigate risk.

Generate, Gather, and Evaluate Data in support of the Decision Maker.

66
Q

What are 2 reasons for conducting T&E?

A
  1. Make the System Work
    - Support the Development Process
    - Manage Risk
  2. See if the System Works (OT&E)
    - Help Decision Makers
    - Combat Effectiveness Evaluation
67
Q

Differentiate between Test and Evaluation.

A
  1. Test: actual testing of hardware/software (models, prototypes, etc) to obtain, verify, or provide data to determine developmental objectives are being met.
  2. Evaluation: Review and Analyze qualitative or quantitative data from design review, hardware inspection, modeling, simulation & testing to aid decision making.
68
Q

List 2 principal types of T&E.

A
  1. Developmental (DT)
  2. Operational (OT)
69
Q

List 5 special types of T&E.

A
  1. Multi-service
  2. Joint
  3. Live Fire
  4. Nuclear, Chemical, Biological (NCB)
  5. Nuclear hardening/Survivability
70
Q

List 3 DOD agencies with primary responsibility for T&E process & which area of T&E each has responsibility for.

A

All 3 fall under the Sec of Defense

  1. Deputy Director for Test & Evaluation (underneath the Under SECDEF AT&L) is responsible for Developmental Test & Evaluation (DT&E)
  2. Director, Operational Test & Eval is responsible for Live Fire Test & Eval (LFT&E) and Operational Test & Eval (OT&E)
  3. Assistant SECDEF for Network & Integration (ASD NI)
71
Q

How is T&E integrated in the Systems Engineering Process?

A

T&E integrates with the Functional Verification phase of the Systems Engineering process.

-Verifies the functional architecture satisfies all validated requirements and traces physical/software elements to each requirement.

72
Q

What are the 5 steps of the DoD T&E process?

A
  1. ID critical issues & data requirements
  2. Pre-test analysis evaluation plan (expected outcomes)
  3. Test planning, run simulation, conduct test, gather data, analyze data, test report.
  4. Post-test synthesis, compare results/predictions, evaluation report.
  5. Balance T&E results with other program info
73
Q

What is the purpose of DT&E and give 2 examples?

A

Developmental Test & Evaluation (make it work) verifies design assumptions, finds failures, looks for problems with safety, integration, and IDs problem fixes.

Assist in Risk Management!

Answers: “Does it meet Contract & Performance Specifications?”

Examples: Software T&E, Contractor T&E, Production Qualification T&E (PQT), and Production Acceptance T&E (PAT)

74
Q

List 3 characteristics of DT&E.

A
  1. Controlled, experimentation environment
  2. Operated by test technicians
  3. Designed to obtain statistically significant data through repetition (rounds fired, miles drive, etc)
  4. Systems tested are engineering prototypes or models (not production items)
  5. Significant contractor involvement
75
Q

What is CaNDI and 2 issues as it relates to T&E?

A

Commercial and Non-Developmental Item

Testing requried for most CaNDI systems

  • Requires significant integration effort
  • Operational environment usually radically different than intended for commerical use.
  • Interoperability requirements
  • DoD supportability concept may not be compatible with the commercial item
76
Q

What are limitations of software testing?

A

Testing cannot produce quality software alone.

Software testing can only confirm the presence of defects - it can’t ascertain error free software.

77
Q

Give 3 examples of software testing activities.

A

Human Based Testing Activities:

  1. Desk Checking
  2. Code Walkthroughs
  3. Formal Inspections
  4. Joint Reviews

Other:

  1. Computer-Based Testing
78
Q

List 3 ways that you can tell when software is ready for testing.

A
  1. Software must be sufficiently mature
  2. Developer must certify software is ready for OT&E
  3. Exit criteria established that IDs impact of not meeting thresholds or other criteria
79
Q

What is the purpose of contractor testing? Give 2 broad examples.

A

To demonstrate the system or components are performing as planned at each step of Development.

  1. Qualification Acceptance Testing (QAT)
  2. Production Acceptance Testing (PAT)
80
Q

What are 3 purposes of OT&E?

A

Operational Test & Evaluation (See if it Works):

Answers, “Does it meet user Operational Effectiveness & Suitability Requirements?”

-Supports Evaluation Process

-Verify End Function has been achieved (whether minimum acceptable operational performance requiremetns have been satisfied).

-Supports the oversight process

  • Determines Operational Effectiveness & Suitability under realistic conditions (field testing).
  • IDs operational risks
  • Provides the PM info for critical decisions
  • Provides info on organization, personnel requirements, doctine & tactivs
  • Verifies operating instructions, software documentation, pubs & handbooks.
81
Q

List 2 types of OT&E.

A
  1. Early Operational Assessment (EOA): forecasts potential operational effectiveness & suitability
  2. Operational Assessment (OA): Determines ability to transition to IOT&E
  3. Initial Operational T&E or OPEVAL: on production-representative article
  4. Follow-On Operational T&E: fielded production systems to test modifications
82
Q

Differentitate between operational effectiveness & operational suitability.

A
  1. Operational Effectiveness: overall degree of mission accomplishment of a system when used by personnel in the planned environment. Does system perform as intended to accomplish mission?
  2. Operational Suitability: degree to which a system is suitible/satisfactory for field use (based on availability, compatibility, transportability, interoperability, reliability, wartime usage, maintainability, safety, manpower requirements, etc).
83
Q

What is the purpose of IOT&E?

A

To test production representative item by user (op) personnel in a realistic environment in support of Full Rate Production or Procurement Decision.

84
Q

List 3 characteristics of OT&E.

A
  • Realistic operation “combat” environment
  • Accomplished by operational & support personnel expected to use & maintain deployed system
  • Systems tested are “Production Representative”
  • Test design driven by operational doctrine
  • Managed by Operational Test Agency (OTA) - independent of Contractor & Developing Agency.
  • Must have sufficient numbers of systems to gain OT operational data
85
Q

What is the purpose of LFT&E?

A

Determines Lethality & Survivability in realistic combat conditions against actual threats.

86
Q

Contrast concurrent & combined testing.

A

-Concurrent Testing: when DT & OT take place at same time (parrallel, but separate activities).

-Combined Testing: a single test program conducted to support DT & OT objectives

87
Q

What 2 OT&E reports must be submitted to Congress prior to FRPDR?

A
  1. Beyond LRIP Report
    - DOT&E submitted to SECDEF & Congress
    - Confirms Op Effectiveness & Suitability
    - Required to being Full Rate Production
  2. Live Fire T&E Report
    - Confirms system Lethality & Survivability
    - Required to go beyond LRIP
88
Q

What is the purpose of the T&E Strategy?

A
  • Basis for the TEMP.
  • Balances Program Technical & Operational Risk with T&E cost & schedule
  • IDs verification method for system technical & operational performance.
89
Q

List 2 advantages & 2 disadvantages of Modeling & Simulation.

A

Advantages:

  • Reduces cost & duration of T&E programs
  • Iterative costs are extremely low, so excellent statistical confidence
  • Early influence of system design
  • See system impacts in large-scale operations

Disadvantages:

  • Initially expensive and time consuming
  • Must be validated & verified for data acceptance
  • Limited situational & technical variables
  • Decision maker skepticism
90
Q

Who is responsible for the preparation of the TEMP?

A

The Program Manager is responsible for the preparation of the Test & Evaluation Master Plan.

91
Q

What is the purpose of the TEMP?

A
  • Directed by DODI 5000.02
  • Mandated for ACAT I and DOT&E oversight programs
  • Documents overall structure & objectives of T&E program
  • Provides for the generation detailed T&E plans & documents associated schedule & resource implications.
  • IDs the necessary DT&E, OT&E, and LFT&E