UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR...

UNCLASSIFIEDUNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203

Developmental Test & Evaluation

Presented to ITEA SymposiumPresented to ITEA Symposium

Edward GreerEdward GreerDirector, Developmental Test & EvaluationDirector, Developmental Test & Evaluation

September 14, 2010September 14, 2010

www.acq.osd.mil/dte/www.acq.osd.mil/dte/

UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203

Minimizing Discovery in IOT&E

DDT&E supports:• Program Offices and DoD T&E community • Test planning and data analysis • Early discovery of deficiencies• Identification and sharing of best practices

Improve DT&E practice thru:• DT Policy & Oversight• Advancing DT&E Capability and Service Competencies

Mission of the Director, Developmental Test & Evaluation (DDT&E)

Improve acquisition outcomes by advancing “state of the practice”

DWSS

MRAP

2


DT&E Organization

DD, Land and Expeditionary Warfare

Steven Lopes

DD, Air Warfare

George Axiotis

DD, Naval Warfare

Patrick Clancy

DD, Net Centric & Space

Ray Shanahan

DD, Capability Development

Darlene Mosser-Kerner

• Policy / Guidance• Acquisition DT&E Workforce• DAU Content• TEMP DT&E Concept Briefs• Measures and Metrics• Joint T&E• Integrated T&E• DT&E in SEP• Annual Report

DirectorEdward Greer

Principal DeputyChris DiPetto

3

AppointeeSES

Legend:


Studies on T&E and Acquisition

4

“. . .beginning production before successfully demonstrating that the weapon system will work as intended increases the potential for discovering costly design changes…and usually requires substantial modification costs at a later time.” 2008 GAO Assessments of Selected Weapon Programs

“Approximately 50% of programs completing IOT&E since 2000 have been assessed as not operationally effective and/or suitable.” 2008 DSB Report on Developmental Test and Evaluation


DT&E Influences Acquisition

Pre-IOT&E:• AOTR showed high risk to IOT&E• Accurately predicted unfavorable results• Added time/expense to retest failures

LPD-17

5

P-8AMilestone C:• ITT engaged early and continuously• Risk of redesign carefully considered• Stable design and predictable performance • Low risk – Program entered LRIP on time

SDB II Milestone B:• Adequacy / affordability of the plan• Design of Experiments analysis• Risk at MS C (Knowledge points) drove agreement with PEO

Leve

l of

DT&

E E

ngag

emen

t C-5 RERP


DDT&E in DoD: What and When

Test Evaluation Strategy (TES)

Technology Development Strategy (TDS)

Identify emerging T&E capability requirements

Identify T&E resourcesDevelop T&E requirements in RFP

Support AoA technical analysis

Test and Evaluation Master Plan (TEMP)

Acquisition StrategySupport T&E Program Execution

Provide T&E results for OIPT/DAB Reviews

CDD requirements for testability and ability to evaluate

Support TRL EvaluationT&E requirements in RFP

Report of performance measures, metrics and evaluations

Update TEMPSupport T&E Program

ExecutionProvide T&E results for

OIPT/DAB ReviewsSupport PDR/CDR and

all technical reviews CPD requirements for

testability and ability to evaluate

Support TRL EvaluationT&E requirements in

RFPDiscovery and

deficienciesReport of performance

measures, metrics and evaluations

Update TEMPSupport T&E Program Execution

Characterize system capabilities and limitations

Provide T&E results for OIPT/DAB Reviews

AOTR / OTRRSupport training for IOT&E


Update TEMP for Follow-on DT&E and OT&E

Verification of corrections for deficiencies

Develop T&E programs to support upgrades, modifications, and increments

Support T&E Program Execution


TEMPTEMPTES TEMP

ICD CCD CPD

6

IOT&E

$1 invested here


DDT&E in DoD: What and When

TEMPTEMPTES TEMP

ICD CCD CPD

7

IOT&E

Saves $100 here $1 invested here

A few DDT&E observations:• Lack of DT&E expertise during program formulation• DT&E program planning and resourcing not adequate• System immaturity at MS C or at OTRR• Inadequate reliability growth programs


Training MRTFB Utilization by PMs

DAB

T&E Workforce

DAU T&E Curriculum

RTOsDDT&E

Environmental Scan

PlanningExecution

ResultsEnhance TEMPContent

T&E forTechnologiesEmerging

DT&E in Rapid Prototyping

DAES

DoE

AOTR

8


T&E Associations across the Enterprise

Warfighter

Test Infrastructure

Developmental Testing

Operational Testing

MaterielSolutionAnalysis

Production & Deployment

Operations & Support

Technology Development

Engineering and ManufacturingDevelopment

A B C

Need to Maximize Synergies Across Associations

9


DT&E Challenges/Initiatives

• Efficient, effective and fully Integrated T&E (CODB)• Reliability, Availability, and Maintainability• Information Assurance• Early and continuous engagement with PMs• Workforce skill mix• Increased use of M&S• Emerging technologies• Distributed testing

10

1943 SNJ-5 “Texan” Trainer


Back!

T&E Community Advocate!

DDT&E is . . . .

11

UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203 12

Questions?

The right information, to the right decision maker, at the right time, for better decisions

OFFICE OF THE SECRETARY OF DEFENSE

OFFICE OF THE UNDER SECRETARY OF DEFENSE FOR ACQUISITION,

TECHNOLOGY, AND LOGISTICS

DEVELOPMENTAL TEST & EVALUATION

3090 Defense PentagonRoom 3B941

Washington, DC 20301-3090

Email: [email protected]

www.acq.osd.mil/dte

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR...

Documents

Transcript of UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR...