The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

62
The Technical Risk Identification and Mitigation System (TRIMS) August 2008

Transcript of The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Page 1: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

The Technical Risk Identification

and Mitigation System

(TRIMS)

August 2008

Page 2: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Many programs failing or suffering cost/schedule overruns

Defense Science Board studies the problem; publishes findings in

DOD 4245.7-M (The “Willoughby Templates”)

Best Manufacturing Practices Program established to help the U.S. Defense

Industrial Base - BMP conducts first Survey (Texas Instruments)

BMP publishes NAVSO P-6071 (Best Practices Book)

BMP contracts with Bell Labs to write more detail on each Template

First version of PMWS is created

BMP Center of Excellence established in College Park, MD

BMP conducts 100th Survey (Northrop Grumman)

1960-1980

1983-1984

1985

1986

1987

1991

1993

2000

The Beginning of Process-Based Risk Management

Page 3: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Many programs failing or suffering cost/schedule overrunsMany programs failing or suffering cost/schedule overruns

Defense Science Board studies the problem; publishes findings in

DOD 4245.7-M (The “Willoughby Templates”)

Best Manufacturing Practices Program established to help the U.S. Defense

Industrial Base - BMP conducts first Survey (Texas Instruments)

BMP publishes NAVSO P-6071 (Best Practices Book)

BMP contracts with Bell Labs to write more detail on each Template

First version of PMWS is created

BMP Center of Excellence established in College Park, MD

BMP conducts 100th Survey (Northrop Grumman)

1960-19801960-1980

1983-1984

1985

1986

1987

1991

1993

2000

The Beginning of Process-Based Risk Management

Processed-based risk management came about as

a result of the acquisition problems that occurred

in the ’60s and ’70s.

Processed-based risk management came about as

a result of the acquisition problems that occurred

in the ’60s and ’70s.

Page 4: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Many programs failing or suffering cost/schedule overruns

Defense Science Board studies the problem; publishes findings in Defense Science Board studies the problem; publishes findings in

DOD 4245.7-M (The “Willoughby Templates”)DOD 4245.7-M (The “Willoughby Templates”)

Best Manufacturing Practices Program established to help the U.S. Defense

Industrial Base - BMP conducts first Survey (Texas Instruments)

BMP publishes NAVSO P-6071 (Best Practices Book)

BMP contracts with Bell Labs to write more detail on each Template

First version of PMWS is created

BMP Center of Excellence established in College Park, MD

BMP conducts 100th Survey (Northrop Grumman)

1960-1980

1983-19841983-1984

1985

1986

1987

1991

1993

2000

The Beginning of Process-Based Risk Management

In 1983, the Defense Science Board convened a group of

academics, government experts, and members of industry

to study the issue.

In 1983, the Defense Science Board convened a group of

academics, government experts, and members of industry

to study the issue.

Page 5: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Money Phasing

Design Reference Mission Profile

Design Requirements

Trade Studies

Design Policy

Design Process

Design Analysis

Parts & Material Selection

Software Design

Computer-Aided Design (CAD)

Design for Testing

Built-In Test (BIT)

Configuration Control

Design Reviews

Design Release

Integrated Test

Failure Reporting System

Uniform Test Report

Software Test

Design Limit

Life

Test, Analyze & Fix (TAAF)

Field Feedback

Manufacturing Plan

Qualify Manufacturing Process

Piece Part Control

Subcontractor Control

Defect Control

Tool Planning

Special Test Equipment (STE)

Computer-Aided Manufacturing (CAM)

Manufacturing Screening

Transition Plan

Modernization

Factory Improvements

Productivity Center

Logistics Support Analysis

Manpower & Personnel

Support & Test Equipment

Training Materials & Equipment

Spares

Technical Manuals

Manufacturing Strategy

Personnel Requirements

Data Requirements

Technical Risk Assessment

Production Breaks

Problem Areas Identified by DSB

They discovered that most programs failed because of basic engineering processprocess issues,

rather than high-technology issues.

They discovered that most programs failed because of basic engineering processprocess issues,

rather than high-technology issues.

Page 6: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Money Phasing

Design Reference Mission Profile

Design Requirements

Trade Studies

Design Policy

Design Process

Design Analysis

Parts & Material Selection

Software Design

Computer-Aided Design (CAD)

Design for Testing

Built-In Test (BIT)

Configuration Control

Design Reviews

Design Release

Integrated Test

Failure Reporting System

Uniform Test Report

Software Test

Design Limit

Life

Test, Analyze & Fix (TAAF)

Field Feedback

Manufacturing Plan

Qualify Manufacturing Process

Piece Part Control

Subcontractor Control

Defect Control

Tool Planning

Special Test Equipment (STE)

Computer-Aided Manufacturing (CAM)

Manufacturing Screening

Transition Plan

Modernization

Factory Improvements

Productivity Center

Logistics Support Analysis

Manpower & Personnel

Support & Test Equipment

Training Materials & Equipment

Spares

Technical Manuals

Manufacturing Strategy

Personnel Requirements

Data Requirements

Technical Risk Assessment

Production Breaks

Problem Areas Identified by DSB

They also established that most program failures were the result of one or more of the

47 issues shown here.

They also established that most program failures were the result of one or more of the

47 issues shown here.

Page 7: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

FUNDING:FUNDING:

Money Phasing

DESIGN:DESIGN:

Design Reference Mission Profile

Design Requirements

Trade Studies

Design Policy

Design Process

Design Analysis

Parts & Material Selection

Software Design

Computer-Aided Design (CAD)

Design for Testing

Built-In Test (BIT)

Configuration Control

Design Reviews

Design Release

TEST:TEST:

Integrated Test

Failure Reporting System

Uniform Test Report

Software Test

Design Limit

Life

Test, Analyze & Fix (TAAF)

Field Feedback

PRODUCTION:PRODUCTION:

Manufacturing Plan

Qualify Manufacturing Process

Piece Part Control

Subcontractor Control

Defect Control

Tool Planning

Special Test Equipment (STE)

Computer-Aided Manufacturing (CAM)

Manufacturing Screening

TRANSITION:TRANSITION:

Transition Plan

FACILITIES:FACILITIES:

Modernization

Factory Improvements

Productivity Center

LOGISTICS:LOGISTICS:

Logistics Support Analysis

Manpower & Personnel

Support & Test Equipment

Training Materials & Equipment

Spares

Technical Manuals

MANAGEMENT:MANAGEMENT:

Manufacturing Strategy

Personnel Requirements

Data Requirements

Technical Risk Assessment

Production Breaks

Problem Areas Identified by DSB

These 47 areas were then organized into 8 categories…

These 47 areas were then organized into 8 categories…

Page 8: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

DoD 4245.7-M…and the results were published

in DoD 4245.7-M, where they came to be known as

“The Willoughby Templates”.

…and the results were published in DoD 4245.7-M, where they

came to be known as “The Willoughby Templates”.

Page 9: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071

In 1986, the Best Manufacturing Practices (BMP) program published

NAVSO P-6071, also known as “The Best Practices Book”

In 1986, the Best Manufacturing Practices (BMP) program published

NAVSO P-6071, also known as “The Best Practices Book”

Page 10: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)

Page 11: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)

This book takes each of the 47 Template areas described in DoD 4245.7-M,

and identifies the 4 major traps that

programs are likely to encounter.

This book takes each of the 47 Template areas described in DoD 4245.7-M,

and identifies the 4 major traps that

programs are likely to encounter.

Page 12: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)

This book takes each of the 47 Template areas described in DoD 4245.7-M,

and identifies the 4 major traps that

programs are likely to encounter.

This book takes each of the 47 Template areas described in DoD 4245.7-M,

and identifies the 4 major traps that

programs are likely to encounter.

Page 13: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)

It identifies the consequences of falling

into each trap, and alarms that indicate that

this might be happening.

It identifies the consequences of falling

into each trap, and alarms that indicate that

this might be happening.

Page 14: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)It also identifies the best practices for

(and the benefits of) avoiding each trap.

It also identifies the best practices for

(and the benefits of) avoiding each trap.

Page 15: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)It also identifies the best practices for

(and the benefits of) avoiding each trap.

It also identifies the best practices for

(and the benefits of) avoiding each trap.

Page 16: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)It also identifies the best practices for

(and the benefits of) avoiding each trap.

It also identifies the best practices for

(and the benefits of) avoiding each trap.

Page 17: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)It also identifies the best practices for

(and the benefits of) avoiding each trap.

It also identifies the best practices for

(and the benefits of) avoiding each trap.

Page 18: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)It also identifies the best practices for

(and the benefits of) avoiding each trap.

It also identifies the best practices for

(and the benefits of) avoiding each trap.

Page 19: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

NAVSO P-6071 (Best Practices Book)

The book also includes checklist questions covering the best practices for each Template.

The book also includes checklist questions covering the best practices for each Template.

Page 20: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

• Defense Science Board Studies Determined that 80% of all Programs that Fail, Fail for Engineering not Technology Reasons

• Example: N43 Reports that Over 65% of all Fleet Reliability Problems are Due to Inadequate Design

• February 1998 GAO Report to the Subcommittee on Acquisition & Technology, Committee on Armed Services, U. S. Senate

• Since 1975 Schedule Overruns Average 24%• Weapon Systems Overruns Cost 20% - 40%

• March 2005 GAO Report:• Average Cost Increase Will be 28.5% in Only 4 Years• Reason: “Armed services order hardware with unproven technology,

with too little time allowed for perfecting that technology before contractors attempt to insert it into weapons systems...”

• With Acquisition Reform and Performance Specifications, We Must Monitor the Engineering Process to Understand Program Risks

Some Things To Consider

Do Do NotNot Get Technology Tunnel Vision Get Technology Tunnel Vision

Page 21: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

• Defense Science Board Studies Determined that 80% of all Programs that Fail, Fail for Engineering not Technology Reasons

• Example: N43 Reports that Over 65% of all Fleet Reliability Problems are Due to Inadequate Design

• February 1998 GAO Report to the Subcommittee on Acquisition & Technology, Committee on Armed Services, U. S. Senate

• Since 1975 Schedule Overruns Average 24%• Weapon Systems Overruns Cost 20% - 40%

• March 2005 GAO Report:• Average Cost Increase Will be 28.5% in Only 4 Years• Reason: “Armed services order hardware with unproven technology,

with too little time allowed for perfecting that technology before contractors attempt to insert it into weapons systems...”

• With Acquisition Reform and Performance Specifications, We Must Monitor the Engineering Process to Understand Program Risks

Some Things To Consider

Do Do NotNot Get Technology Tunnel Vision Get Technology Tunnel Vision

Unfortunately, too many programs are still having the

same problems today!

Unfortunately, too many programs are still having the

same problems today!

Page 22: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

So what is the answer?

Page 23: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMSTRIMSTechnical Risk IdentificationTechnical Risk Identification

& Mitigation System& Mitigation System

Page 24: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

• TRIMS (Technical Risk Identification & Mitigation System): A Methodology for Doing Knowledge-Based, Process-Oriented Risk Management

• Part of the Program Manager’s WorkStation (PMWS) Tool suite(Navy Owned, Fixed Revision Cycle)

• Outgrowth of DoD 4245.7-M and NAVSO P-6071 Templates

• Fully Compatible with BMPCOE Combined Government / Industry Systems Engineering Model

• Fully Supported: Training Classes, Computer-Based Training,On-line Help, 24-hour Help Desk

What Is TRIMS?

Process Based And Predictive Process Based And Predictive

Page 25: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

• TRIMS (Technical Risk Identification & Mitigation System): A Methodology for Doing Knowledge-Based, Process-Oriented Risk Management

• Part of the Program Manager’s WorkStation (PMWS) Tool Suite(Navy Owned, Fixed Revision Cycle)

• Outgrowth of DoD 4245.7-M and NAVSO P-6071 Templates

• Fully Compatible with BMPCOE Combined Government / Industry Systems Engineering Model

• Fully Supported: Training Classes, Computer-Based Training,On-line Help, 24-hour Help Desk

What Is TRIMS?

Process Based And Predictive Process Based And Predictive

TRIMS is a process-based risk management tool, that grew out of the checklist questions in NAVSO P-6071.

TRIMS is a process-based risk management tool, that grew out of the checklist questions in NAVSO P-6071.

Page 26: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS Proactive Methodology

TRIMS

Probability Effect

• Risk Management

• Snapshot Assessments

• Multiple Program Rollups

• Automatic Updates

Milestone Dates

PersonnelAssignments

QuestionWeighting

Due Dates

References

ComplianceStatus

Risks

Next Actions

Responsibilities

Action ItemTracking

Mission ProfileScheduleQualityCost

Guidance Documents

EngineeringProcess Model

Statistics

PastExperience

Planning &Tracking

SystemArchitecture

Risk Management

Understanding The Future Effects Of Today's DecisionsUnderstanding The Future Effects Of Today's Decisions

Risk Assessment

Page 27: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS Proactive Methodology

TRIMS

ProbabilityProbability EffectEffect

• Risk Management

• Snapshot Assessments

• Multiple Program Rollups

• Automatic Updates

Milestone Dates

PersonnelAssignments

QuestionWeighting

Due Dates

References

ComplianceStatus

Risks

Next Actions

Responsibilities

Action ItemTracking

Mission ProfileScheduleQualityCost

Guidance Documents

EngineeringProcess Model

Statistics

PastPastExperienceExperience

Planning &Tracking

SystemSystemArchitectureArchitecture

Risk Management

Understanding The Future Effects Of Today's DecisionsUnderstanding The Future Effects Of Today's Decisions

Risk AssessmentRisk Assessment“Risk” is a function of probability and effect. Determining these for

your program is “Risk AssessmentAssessment”.

“Risk” is a function of probability and effect. Determining these for

your program is “Risk AssessmentAssessment”.

Page 28: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS Proactive Methodology

TRIMS

Probability Effect

• Risk Management

• Snapshot Assessments

• Multiple Program Rollups

• Automatic Updates

Milestone Dates

PersonnelAssignments

QuestionWeighting

Due Dates

References

ComplianceStatus

Risks

Next Actions

Responsibilities

Action ItemTracking

Mission ProfileScheduleQualityCost

Guidance Documents

EngineeringProcess Model

Statistics

PastExperience

Planning &Planning &TrackingTracking

SystemArchitecture

Risk ManagementRisk Management

Understanding The Future Effects Of Today's DecisionsUnderstanding The Future Effects Of Today's Decisions

Risk Assessment

To do “Risk ManagementManagement” you also have to do planning and tracking: establish a plan to mitigate your risks, and then

track it to ensure that the plan is being followed, and that it is

having the desired effect!

To do “Risk ManagementManagement” you also have to do planning and tracking: establish a plan to mitigate your risks, and then

track it to ensure that the plan is being followed, and that it is

having the desired effect!

Page 29: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS Proactive Methodology

TRIMSTRIMS

Probability Effect

• Risk ManagementRisk Management

• Snapshot AssessmentsSnapshot Assessments

• Multiple Program RollupsMultiple Program Rollups

• Automatic UpdatesAutomatic Updates

Milestone Milestone DatesDates

PersonnelPersonnelAssignmentsAssignments

QuestionQuestionWeightingWeighting

Due DatesDue Dates

ReferencesReferences

ComplianceComplianceStatusStatus

RisksRisks

Next ActionsNext Actions

ResponsibilitiesResponsibilities

Action ItemAction ItemTrackingTracking

Mission ProfileScheduleQualityCost

Guidance Documents

EngineeringProcess Model

Statistics

PastExperience

Planning &Tracking

SystemArchitecture

Risk Management

Understanding The Future Effects Of Today's DecisionsUnderstanding The Future Effects Of Today's Decisions

Risk Assessment

TRIMS provides all of thesecapabilities, plusplus analysis, reporting, and

workload-reduction features!

TRIMS provides all of thesecapabilities, plusplus analysis, reporting, and

workload-reduction features!

Page 30: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS Identifies the TRIMS Identifies the RootRoot Causes of Cost & Schedule Problems Causes of Cost & Schedule Problems

Proactive vs. Reactive

Schedule Slippage

Cost Overruns

The TRIMS philosophy recognizes that beforebefore you

have schedule slippages and cost overruns, you have

technical issues.

The TRIMS philosophy recognizes that beforebefore you

have schedule slippages and cost overruns, you have

technical issues.

Page 31: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS Identifies the TRIMS Identifies the RootRoot Causes of Cost & Schedule Problems Causes of Cost & Schedule Problems

Proactive vs. Reactive

The TRIMS philosophy recognizes that beforebefore you

have schedule slippages and cost overruns, you have

technical issues.

The TRIMS philosophy recognizes that beforebefore you

have schedule slippages and cost overruns, you have

technical issues.Technical Issues

Schedule Slippage

Cost Overruns

Page 32: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS Identifies the TRIMS Identifies the RootRoot Causes of Cost & Schedule Problems Causes of Cost & Schedule Problems

Proactive vs. Reactive

And beforebefore you have technical issues, you have failures in

your engineering processes.

And beforebefore you have technical issues, you have failures in

your engineering processes.

Technical Issues

Schedule Slippage

Cost Overruns

Process Risks

Page 33: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Technical Issues

Reactive

Proactive

Schedule Slippage

Cost Overruns

TRIMS Identifies the TRIMS Identifies the RootRoot Causes of Cost & Schedule Problems Causes of Cost & Schedule Problems

Proactive vs. Reactive

Process RisksAnalyzing your processes Analyzing your processes

can provide early indication can provide early indication of potential problems.of potential problems.

Analyzing your processes Analyzing your processes can provide early indication can provide early indication

of potential problems.of potential problems.

Page 34: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Process Risks

T1 T2 T3 T4 T5 T6

““A ‘Problem’ Is A Risk Whose Time Has Come”A ‘Problem’ Is A Risk Whose Time Has Come”

Evolution of Risks

Another way to look at this...

Another way to look at this...

Page 35: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Process Risks

T1 T2 T3 T4 T5 T6

““A ‘Problem’ Is A Risk Whose Time Has Come”A ‘Problem’ Is A Risk Whose Time Has Come”

Evolution of Risks

A ProcessProcess issue that is left unchecked can lead to one or more

ProductProduct issues.

A ProcessProcess issue that is left unchecked can lead to one or more

ProductProduct issues.

Page 36: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Process Risks

T1 T2 T3 T4 T5 T6

““A ‘Problem’ Is A Risk Whose Time Has Come”A ‘Problem’ Is A Risk Whose Time Has Come”

Evolution of Risks

Product Risks

A ProcessProcess issue that is left unchecked can lead to one or more

ProductProduct issues.

A ProcessProcess issue that is left unchecked can lead to one or more

ProductProduct issues.

Page 37: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Process Risks

T1 T2 T3 T4 T5 T6

““A ‘Problem’ Is A Risk Whose Time Has Come”A ‘Problem’ Is A Risk Whose Time Has Come”

Evolution of Risks

Product Risks

And ProductProduct issues that are left unchecked

can lead to ProblemsProblems.

And ProductProduct issues that are left unchecked

can lead to ProblemsProblems.

Page 38: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Process Risks

Product Risks

T1 T2 T3 T4 T5 T6

““A ‘Problem’ Is A Risk Whose Time Has Come”A ‘Problem’ Is A Risk Whose Time Has Come”

Evolution of Risks

And ProductProduct issues that are left unchecked

can lead to ProblemsProblems.

And ProductProduct issues that are left unchecked

can lead to ProblemsProblems.

Problems

Page 39: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Process Risks Problems

Product Risks

T1 T2 T3 T4 T5 T6

““A ‘Problem’ Is A Risk Whose Time Has Come”A ‘Problem’ Is A Risk Whose Time Has Come”

Evolution of Risks

By focusing on good engineering processes, it

becomes possible to avoid many typical problems that

programs encounter.

By focusing on good engineering processes, it

becomes possible to avoid many typical problems that

programs encounter.

Page 40: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Process Risks Problems

Product Risks

T1 T2 T3 T4 T5 T6

““A ‘Problem’ Is A Risk Whose Time Has Come”A ‘Problem’ Is A Risk Whose Time Has Come”

Evolution of Risks

By focusing on good engineering processes, it

becomes possible to avoid many typical problems that

programs encounter.

By focusing on good engineering processes, it

becomes possible to avoid many typical problems that

programs encounter.

Page 41: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Time

Cos

t to

Miti

gate

Design Test Production

$1

$100

$10

Cost To Mitigate Increases Exponentially

We also know that the cost of resolving

issues tends to increase by [roughly] an order of magnitude

from one phase to the next.

We also know that the cost of resolving

issues tends to increase by [roughly] an order of magnitude

from one phase to the next.

Page 42: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Process Risks

Product Risks

Problems

Risk Management or Damage Control?Risk Management or Damage Control?

Cost To Mitigate Increases Exponentially

Time

Cos

t to

Miti

gate

Design Test Production

So, focusing on process risks just

makes good economic sense.

So, focusing on process risks just

makes good economic sense.

Page 43: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

PRODUCT TQM

FUNDING MoneyPhasing

DESIGN TEST PRODUCTION FACILITIES LOGISTICS MANAGEMENT

TRANSITION PLAN

• Design Refer. Mission Profile

• Design Requirements

• Trade Studies

• Design Policy

• Design Process

• Design Analysis

• Parts & Mater. Selection

• Software Design

• Computer-Aided Design (CAD)

• Design for Testing

• Built-In Test (BIT)

• Configuration Control

• Design Reviews

• Design Release

• Integrated Test

• Failure Reporting System

• Uniform Test Report

• Software Test

• Design Limit

• Life

• Test, Analyze & Fix (TAAF)

• Field Feedback

• Manufacturing Plan

• Qualify Manufacturing Process

• Piece Part Control

• Subcontractor Control

• Defect Control

• Tool Planning

• Special Test Equipment (STE)

• CAM

• Manufacturing Screening

• Modernization

• Factory Improvements

• Productivity Center

• Logistics Support Analysis

• Manpower & Personnel

• Support & Test Equipment

• Training Materials & Equipment

• Spares

• Technical Manuals

• Manufacturing Strategy

• Personnel Requirements

• Data Requirements

• Technical Risk Assessment

• Production Breaks

TRIMS Baseline Templates Shown here are the original “Willoughby Templates”,

from DoD 4245.7-M.

Shown here are the original “Willoughby Templates”,

from DoD 4245.7-M.

Page 44: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

PRODUCT TQM

FUNDING MoneyPhasing

DESIGN TEST PRODUCTION FACILITIES LOGISTICS MANAGEMENT

TRANSITION PLAN

• Design Refer. Mission Profile

• Design Requirements

• Trade Studies

• Design Policy

• Design Process

• Design Analysis

• Parts & Mater. Selection

• Software Design

• Computer-Aided Design (CAD)

• Design for Testing

• Built-In Test (BIT)

• Configuration Control

• Design Reviews

• Design Release

• Integrated Test

• Failure Reporting System

• Uniform Test Report

• Software Test

• Design Limit

• Life

• Test, Analyze & Fix (TAAF)

• Field Feedback

• Manufacturing Plan

• Qualify Manufacturing Process

• Piece Part Control

• Subcontractor Control

• Defect Control

• Tool Planning

• Special Test Equipment (STE)

• CAM

• Manufacturing Screening

• Modernization

• Factory Improvements

• Productivity Center

• Logistics Support Analysis

• Manpower & Personnel

• Support & Test Equipment

• Training Materials & Equipment

• Spares

• Technical Manuals

• Manufacturing Strategy

• Personnel Requirements

• Data Requirements

• Technical Risk Assessment

• Production Breaks

TRIMS Baseline Templates

CAM•Manufacturing Screening

Shown here are the original “Willoughby Templates”,

from DoD 4245.7-M.

Shown here are the original “Willoughby Templates”,

from DoD 4245.7-M.

Page 45: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

PRODUCT TQM

FUNDING MoneyPhasing

CostAssessment

DESIGN TEST PRODUCTION FACILITIES LOGISTICS MANAGEMENT

TRANSITION PLAN

New PMWSTemplatesNew PMWSTemplates

• Design Refer. Mission Profile

• Design Requirements

• Trade Studies

• Design Policy

• Design Process

• Design Analysis

• Parts & Mater. Selection

• Software Design

• Computer-Aided Design (CAD)

• Design for Testing

• Built-In Test (BIT)

• Configuration Control

• Design Reviews

• Design Release

• Concept Studies & Analysis

• Bread Board Development

• Brass Board Development

• Specification Dev/Allocation/ Validation

• Design for Assembly

• Prototype Development & Review

• Integrated Test

• Failure Reporting System

• Uniform Test Report

• Software Test

• Design Limit

• Life

• Test, Analyze & Fix (TAAF)

• Field Feedback

• TEMP Development/ Execution

• Software Simulator

• Manufacturing Plan

• Qualify Manufacturing Process

• Piece Part Control

• Subcontractor Control

• Defect Control

• Tool Planning

• Special Test Equipment (STE)

• CAM

• Manufacturing Screening

• Production Fabrication

• Environmental Issues

• Modernization

• Factory Improvements

• Productivity Center

• Field Visits/Site Surveys

• Logistics Support Analysis

• Manpower & Personnel

• Support & Test Equipment

• Training Materials & Equipment

• Spares

• Technical Manuals

• Logistics Analysis Documentation

• Manufacturing Strategy

• Personnel Requirements

• Data Requirements

• Technical Risk Assessment

• Production Breaks

• Determining Defining Need for System

• Prepare Requirement Documents

• Quality Assurance

• Design/Milestone Review Planning

• Make or Buy Decisions

• Technology Base Analysis

• Schedule & Planning

• Dim. Manuf. Sources & Mat. Shortage (DMSMS)

TRIMS Baseline Templates

CAM•Manufacturing Screening

•Production Fabrication•Environmental Issues

The TRIMS SE Model includes the original 47 Templates, plusplus another

21 templates that BMPCOE has added over the years – the

principles have been around for 20 years, but the model is up-to-date!

The TRIMS SE Model includes the original 47 Templates, plusplus another

21 templates that BMPCOE has added over the years – the

principles have been around for 20 years, but the model is up-to-date!

Page 46: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

3 Tiers: Category

Template

Knowledge

Base

Question

4.0 Design

4.6 Design Analysis

4.6.1 Do the contractor's corporate standards identify design analysis as an integral part of the design process?

TRIMS TailoringTRIMS Hierarchy

Design Test Production Facilities LogisticsManagementFunding TransitionPlan

The TRIMS approach to risk is based on “Process Templates”, that contain smart questions.

The TRIMS approach to risk is based on “Process Templates”, that contain smart questions.

Page 47: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

3 Tiers: Category

Template

Knowledge

Base

Question

4.0 Design

4.6 Design Analysis

TRIMS TailoringTRIMS Hierarchy

Design Test Production Facilities LogisticsManagementFunding TransitionPlan

These questions help determine your risk exposure in each

process-risk area.

These questions help determine your risk exposure in each

process-risk area.4.6.1 Do the contractor's corporate standards identify design analysis as an integral part of the design process?

Page 48: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

UserAdded

Questions

UserAdded

Questions

3 Tiers: Category

Template

Knowledge

Base

Question

4.0 Design

4.6 Design Analysis

TRIMS TailoringTRIMS Hierarchy

Design Test Production Facilities LogisticsManagementFunding TransitionPlan

TRIMS is flexible…

You can add your own Questions to any Template.

TRIMS is flexible…

You can add your own Questions to any Template.

4.6.1 Do the contractor's corporate standards identify design analysis as an integral part of the design process?

Page 49: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

UserAdded

Templates

UserAdded

TemplatesUser

AddedQuestions

UserAdded

Questions

3 Tiers: Category

Template

Knowledge

Base

Question

4.0 Design

4.6 Design Analysis

TRIMS TailoringTRIMS Hierarchy

Design Test Production Facilities LogisticsManagementFunding TransitionPlan

You can add your own Templates...

You can add your own Templates...

4.6.1 Do the contractor's corporate standards identify design analysis as an integral part of the design process?

Page 50: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

UserAdded

Templates

UserAdded

TemplatesUser

AddedQuestions

UserAdded

Questions

3 Tiers: Category

Template

Knowledge

Base

Question

4.0 Design

4.6 Design Analysis

TRIMS TailoringTRIMS Hierarchy

Design Test Production Facilities LogisticsManagementFunding TransitionPlan

User Added

Categories

User Added

Categories

…or even add entire Categories!

…or even add entire Categories!

4.6.1 Do the contractor's corporate standards identify design analysis as an integral part of the design process?

Page 51: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

3 Tiers: Category

Template

Knowledge

Base

Question

4.0 Design

4.6 Design Analysis

TRIMS Tailoring

You can even start with a blank sheet of paper,

and build an entire model from scratch!

You can even start with a blank sheet of paper,

and build an entire model from scratch!

4.6.1 Do the contractor's corporate standards identify design analysis as an integral part of the design process?

Page 52: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

Tailoring TRIMS To Your Needs

• Identify Risks Before they Become Problems

• Build YOUR Knowledge into TRIMS– Use the Systems Engineering Knowledge Base as a Starting Point for

A Good Engineering Process

• Create a Concrete, Repeatable Process for Evaluating & Comparing Programs & Contractors

• Ease the Learning Curve for New Employees

• Retain Knowledge of Lost Employees

• Share Knowledge

• To Maximize Benefits of Using TRIMS– Apply as Early as Possible in Program Life– Apply to All Subcontractors, Divisions & Vendors Involved– Use Tool Regularly to Prioritize Resources & Make Decisions

Some of the benefits of TRIMS’ flexibility.

Some of the benefits of TRIMS’ flexibility.

Page 53: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS Knowledge Models

TRIMS Has Many Applications TRIMS Has Many Applications

• Existing (Released) Models• Systems Engineering

• Software Risk Engineering (Carnegie Mellon)

• Circuit Card Testability

• Interoperability and Integration

• Existing (Beta) Models• Human Factors Engineering

• Development (Prototype) Models• Management

• Port Security/Force Protection

• SBIR ◄ ◄ ◄

TRIMS can be used to track any process-based

risk model… and it comes with a variety of

knowledge models.

TRIMS can be used to track any process-based

risk model… and it comes with a variety of

knowledge models.

Page 54: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

A Quick Look At TRIMS

A high level view givesan instant “snapshot”

of your program.

A high level view givesan instant “snapshot”

of your program.

Page 55: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

A Quick Look At TRIMS

Answering the “Smart Questions” helps determine risk levels;

“Next Actions” help mitigate process risks.

Answering the “Smart Questions” helps determine risk levels;

“Next Actions” help mitigate process risks.

Page 56: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

A Quick Look At TRIMS

A variety of filtering options make it easy

to review and analyze risk data.

A variety of filtering options make it easy

to review and analyze risk data.

Page 57: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

A Quick Look At TRIMS

APM Missile Body [Process Risks]

Likelihood of Occurrence

Impact (Cf) - Performance Impact/Risk Profile

5

4

3

2

1

1 2 3 4 5

Performance

2 A-1.1 Money Phasing1 A-1.2 Cost Assessment5 A-2.1 Design Reference Mission Profile4 A-2.2 Design Requirements3 A-2.3 Trade Studies4 A-2.4 Design Policy4 A-2.5 Design Process5 A-2.6 Design Analysis4 A-2.8 Software Design4 A-2.9 Computer-Aided Design (CAD)5 A-2.10 Design for Testing4 A-2.11 Built-In Test (BIT)4 A-2.12 Configuration Control4 A-2.13 Design Reviews3 A-2.15 Concept Studies and Analysis4 A-2.16 Bread Board Development4 A-3.1 Integrated Test4 A-3.7 Test, Analyze, And Fix (TAAF)4 A-3.9 TEMP Development/Execution4 A-4.3 Piece Part Control3 A-4.4 Subcontractor Control3 A-4.11 Environmental Issues1 A-6.4 Field Visits/Site Surveys4 A-7.1 Logistics Support Analysis4 A-7.2 Manpower and Personnel4 A-7.3 Support and Test Equipment4 A-7.7 Logistics Analysis/Documentation3 A-8.2 Personnel Requirements2 A-8.3 Data Requirements

A-1.2

A-6.4

A-8.3

A-1.1

A-4.11A-8.2

A-4.4A-2.3A-2.15

A-3.7A-2.8

A-7.3

A-4.3A-2.13

A-2.12A-2.11A-2.2A-2.5A-2.4A-7.1A-2.9A-3.1A-7.7A-3.9A-7.2A-2.16

A-2.6

A-2.10

A-2.1

Printed: 4 Apr 2005

You can print reports at both the summary level...

You can print reports at both the summary level...

Page 58: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

A Quick Look At TRIMSAPM Missile Body [Product Risks]

B-1.1.2 SRB Fuel

Milestone

Last Updated

Safety Risk

5

4

3

2

1

Likelihood of Occurrence

1 2 3 4 5Impact Factor (Cf)

03/31/2005

Impacts: -P |

5Sa|

4C |

3Sc

Performer

Derek Designer

Risk ID: B-1.1.2.1 Fuel Components Mixing Risk Rating: High

Description: Fuel components mixing in present fac ility may not be possible without safety upgrade.

Notes: Just testing...

Action Due Date Mitigation Actions

1 3 Apr 2005 Look up current safety regulations

1

2 14 Apr 2005 Identify necessary upgrades

2

3 23 Apr 2005 Conduct Safety T raining

3

4 4 Jun 2005 Install new equipment

4

Page: 1 Printed: 4 Apr 2005

…and in more detail!…and in more detail!

Page 59: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

TRIMS - Total Risk Management

PP33RMRM

Problem, Product & Problem, Product & ProcessProcess Risk Management, Risk Management,

in a Single Tool!in a Single Tool!

Page 60: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

How To Get Help Using TRIMS

• Use the Help menus

• Use the Computer-Based Training (CBT) Videos • Available on PMWS CD and on BMP’s Website• These are Animated & Narrated Tours Showing Each Step of

Using TRIMS

• Call our 24 Hour Helpdesk 301-405-9963

• E-Mail the BMP Center at [email protected]

• Arrange a Training Session

Help Is Available Help Is Available

Page 61: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.

3 Things To Remember…

• DoD 4245.7-M / NAVSO P-6071

• The Transition from Development to Production

• The Best Practices Book

• TRIMS

• Free Tool – Download from www.bmpcoe.org

• P3RM – Supports Problem, Product, and Process Risk Tracking!

• BMP Center of Excellence

• An Available Resource

• Call our 24 Hour Helpdesk 301-405-9963

Page 62: The Technical Risk Identification and Mitigation System (TRIMS) August 2008.