National Defense Industrial Association (NDIA) … 748 EVM System Acceptance...National Defense...

National Defense Industrial Association (NDIA) Program Management Systems Committee (PMSC)

ANSI/EIA 748 Earned Value Management System Acceptance Guide

Working Release For User Comment

January 23, 2006 DRAFT

NDIA PMSC

ANSI/EIA 748 EVM System Acceptance Guide

© 2004-2005 National Defense Industrial Association (NDIA) Program Management Systems Committee (PMSC).

NDIA PMSC ANSI/EIA 748 Earned Value Management System Acceptance Guide

January 16, 2006 DRAFT

Permission to copy and distribute this document is hereby granted provided that this notice is retained on all copies, that copies are not altered, and that the NDIA PMSC is credited when the material is used to form other copyrighted documents.

National Defense Industrial Association 2111 Wilson Blvd., Suite 400 Arlington, VA 22201 (703) 522-1820 Fax: (703) 522-1885 www.ndia.org

NDIA PMSC

ANSI/EIA EVM System Acceptance Guide

i January 23, 2007 DRAFT

CONTENTS 1 INTRODUCTION.........................................................................................................................................1

1.1 SYSTEM ACCEPTANCE OVERVIEW ..................................................................................1 1.2 BACKGROUND.................................................................................................................1 1.3 PURPOSE OF THE GUIDE. .................................................................................................1 1.4 DEFINITIONS ...................................................................................................................2

2 THE SYSTEM ACCEPTANCE PROCESS ...............................................................................................4 2.1 SYSTEM DESIGN AND IMPLEMENTATION.........................................................................5

2.1.1 Additional Documents ....................................................................................5 2.1.2 Compliance with ANSI Guidelines ................................................................6

2.2 COMPLIANCE EVALUATION REVIEW...............................................................................7 2.3 SYSTEM ACCEPTANCE ....................................................................................................8

3 SYSTEM DESIGN AND IMPLEMENTATION........................................................................................9 3.1 POLICY PREPARATION AND APPROVAL...........................................................................9 3.2 SYSTEM DOCUMENTATION AND PROCEDURES..............................................................10 3.3 IMPLEMENTATION AND REVIEW....................................................................................11 3.4 EVM AND SYSTEM TRAINING.......................................................................................12

4 EVM SYSTEM COMPLIANCE EVALUATION REVIEW ..................................................................13 4.1 EVM SYSTEM COMPLIANCE EVALUATION REVIEW SCHEDULE....................................14 4.2 EVM SYSTEM OWNER SELF-ASSESSMENT ...................................................................15 4.3 PROGRESS ASSESSMENT REVIEW..................................................................................15 4.4 COMPLIANCE EVALUATION TEAM MEMBERSHIP SELECTION AND TRAINING ...............16 4.5 EVM SYSTEM COMPLIANCE EVALUATION REVIEW (CER) ..........................................17 4.6 COMPLIANCE EVALUATION REVIEW REPORT ...............................................................19

5 SYSTEM COMPLIANCE ACCEPTANCE .............................................................................................20 5.1 INITIAL SYSTEM COMPLIANCE CERTIFICATION.............................................................20 5.2 EVM SYSTEM OWNER RESPONSIBILITIES.....................................................................21 5.3 EVM EXECUTIVE AGENT RESPONSIBILITIES ................................................................21

APPENDIX A CERTIFICATION TEAM QUALIFICATION GUIDELINES...................................................23 APPENDIX B EXAMPLE CER REPORT .............................................................................................................26 APPENDIX C PAR AND CER EXECUTION CONSIDERATIONS ..................................................................28

NDIA PMSC


LIST OF FIGURES Figure 2.1. The System Acceptance Process involves the System Owner, the Compliance

Evaluation Team, and Executive Agent.................................................................................. 4 Figure 2.2. An Example Guideline Matrix to Ensure all 32 Guidelines are addressed in the EVM

System..................................................................................................................................... 7 Figure 3.1. Documentation and Implementation Feedback Process............................................ 11 Figure 4.1. EVMS Compliance Framework ................................................................................ 13 Figure 4.2. Sample CER Schedule............................................................................................... 14 Figure 4.3. Review Cycles ........................................................................................................... 15 Figure 4.4. Overview of the CER Process ................................................................................... 17

NDIA PMSC


LIST OF ACRONYMS AA Advance Agreement ANSI American National Standards Institute CAR Corrective Action Request CER Compliance Evaluation Review EIA Electronics Industries Alliance EVMIG Earned Value Management Implementation Guide EVMS Earned Value Management System FAR Federal Acquisition Regulation GPRA Government Performance and Results Act NDIA National Defense Industrial Association OMB Office of Management and Budget PAR Progress Assessment Review PMSC Program Management Systems Committee WBS Work Breakdown Structure

NDIA PMSC


1 January 23, 2007 DRAFT

1 INTRODUCTION

1.1 System Acceptance Overview Systems Acceptance is a process that involves the reviewing, approving and certifying of the design and implementation of an Earned Value Management System (EVMS) that meets the requirements of the 32 EVMS Guidelines embodied in the American National Standards Institute/Electronic Industry Alliance’s (ANSI/EIA) EIA-748-A, Standard for Earned Value Management Systems.

1.2 Background The Government Performance and Results Act (GPRA) and the Office of Management and Budget (OMB) Circular A-11, have increased the requirement on government agencies to establish, maintain, and use a certified EVMS on major, capital asset acquisitions. This, in turn, has greatly expanded the number of suppliers who need to design, implement, and have approved EVM systems that provide timely performance information for both the supplier and the customer during these acquisitions. This need has challenged both the government and supplier communities to establish a framework where multiple government agencies can recognize a supplier’s certified EVMS without the need for unnecessary supplemental reviews or impediments to contract start-up. There is a pressing need for an approach that assures multiple government and commercial customers as well as the contractor community that they can have high confidence that a supplier’s EVMS meets the EIA 748-A, Industry Guidelines for Earned Value Management.

To address this issue, the National Defense Industrial Association (NDIA) Program Management Systems Committee (PMSC), with encouragement from OMB, has developed this standard EVM system acceptance process to provide a means of obtaining EVM system compliance recognition that is acceptable to all stakeholders, both government and commercial customers, and to the suppliers supporting them. The traditional supplier/customer relationship does not have to exist in order to initiate the system acceptance process established in this guide. For example, a government agency may use this process to assess the appropriate use of EVM at the program level within the agency.

1.3 Purpose of the Guide.

This guide is intended to define a process whereby an EVM System Owner (supplier) or government program with a first-time requirement to comply with the EVMS Guidelines can:

(a) Understand the needs for and effectively design an EVMS;

(b) Successfully implement the EVMS on the requiring acquisition;

(c) Conduct an evaluation of system compliance and its implementation;

(d) Prepare and provide substantiating documentation for evaluation and implementation;

NDIA PMSC



(e) Receive approval and documentation that will satisfy the current and future requirements for an approved EVMS.

In succeeding sections, appropriate guidance will be provided to assist both the EVM system owner and the customer in fulfilling this responsibility.

1.4 Definitions

ANSI/EIA 748 Accepted EVMS System

An EVM system that has been accepted by an organization, customer or third party representing the customer as compliant with the ANSI/EIA 748 Standard – EVMS, typically documented by an EVMS Advance Agreement (AA) or similar document. Acceptance may be found at a single geographic location or in multiple locations. Multiple accepted systems may also reside within a single geographic location.

ANSI/EIA 748 Compliant EVMS System

An EVM System that has been validated to be compliant with the intent of the ANSI/EIA 748 Standard – EVMS and consistent with the NDIA EVMS Intent Guide. Typically, ANSI/EIA 748 compliance is determined by an independent qualified review team.

Compliance Evaluation Review (CER)

The process to assess and determine EVM System Owner compliance with the ANSI/EIA 748 Standard – EVMS.

Compliance The characteristic of an EVMS that ensures the intent of the 32 EVMS Guidelines is embodied in the integrated processes and sub-processes of a contractor’s methods of operation that generates accurate and useful program performance data.

Customer The government or commercial organization or entity for which one or more programs are being executed.

EVM Executive Agent

An organization or party responsible to verify and accept an EVM System Owner compliance with ANSI/EIA 748 Standard – Earned Value Management Systems. Examples include a Government Agency EVM Focal Point (responsible to accept contractor and Government organization EVM Systems), and contractor (responsible to accept subcontractors’ EVM System.

Earned Value Management System (EVMS)

The integrated set of policies, processes, procedures, systems, and practices that meet the intent of the guidelines in American National Standard ANSI/EIA-748, Earned Value Management Systems.

NDIA PMSC



EVMS Guidelines The 32 EVMS guidelines contained in American National Standards Institute/Electronics Industries Alliance (ANSI/EIA) 748 - Current Version, Earned Value Management Systems.

EVM System Owner The organization or party responsible for the implementation and use of an Earned Value Management System compliant with the ANSI/EIA 748 – EVMS Guidelines. Examples of EVM System Owners include contractors, subcontractors, Government program offices, and Government functions.

Program or Project A planned effort to achieve an outcome, the progress toward which is discretely measurable.

Self-assessment The process of a contractor’s or government agency program’s internal review of the design and implementation of an EVMS with the intent to verify compliance with the 32 Guidelines.

Supplier/ Vendor A government or commercial organization or entity from which goods or services are required to complete a program or project.

The NDIA PMSC will review and assess the need for revisions to this guide every two years.

NDIA PMSC



2 THE SYSTEM ACCEPTANCE PROCESS The steps involved in the process of getting from system design to system acceptance are shown in Figure 2.1 and described in this chapter in general terms. Subsequent chapters describe each of these steps in sufficient detail to allow execution by the EVM system owner. It should also be noted that these steps may overlap to the extent that resources and capability exist within the EVM System Owner, the customer, or both. All steps except those in the Acceptance column are necessary for an EVM System Owner or government agency program to implement an EVMS that meets the intent of the guidelines. The decision to seek system acceptance is based on internal management desires, contractual requirements, or both.

Figure 2.1. The System Acceptance Process involves the System Owner, the Compliance Evaluation Team, and Executive Agent.

The amount of time to execute each step is a function of several factors:

• EVM System Owner resource availability and capability;

• Size of the acquisition driving the need for certification;

• Maturity level of the organization implementing EVM;

• Commitment of the organization and senior management;

• Availability of independent parties (customer, consultants, in-house, etc.).

NDIA PMSC



2.1 System Design and Implementation. Since ownership of the EVMS rests with the EVM System Owner (or a Government agency program when an EVM System Owner/customer relationship does not exist), the responsibility for completing this phase will also rest with the EVM System Owner. Normally, the customer or EVM Executive Agent requiring compliance does not participate in the implementation phase in order to provide independence during the Compliance Evaluation Review.

During this phase, the EVM System Owner must establish an EVM Policy that is endorsed and supported by management. This policy will describe in high level terms how EVM will be applied in the system owner organization. EVM policies usually include a reference to ANSI/EIA 748 compliance, the type of programs/projects required to use EVM, and the EVM Executive Agent responsible for EVM compliance and surveillance. Establishment of the EVM Policy is then followed by the development and implementation of an EVM System. This system is generally documented by a system description and procedures that translate the EVM Policy into specific organizational approaches of how the 32 guidelines in ANSI/EIA 748 will be executed. During this phase, the EVM System Owner will typically:

• Compare existing project management processes and procedures to the ANSI/EIA 748 Guidelines.

• Identify areas where modification of current procedures or creation of new ones is required. This is sometimes referred to as a “gap analysis.”

• Select candidate projects, programs, or contracts for initial implementation and demonstration of the EVMS via Compliance Evaluation Review (CER).

• Establish a plan and schedule with assigned resources to ensure proper and effective design, documentation, implementation, and maintenance.

• Train the program / project team on EVM and the organization EVM system description, procedures and systems.

The period of performance for these activities typically ranges from 6 to 18 months.

2.1.1 Additional Documents

In addition to the developing an EVM Policy and System Description and Procedures, two other documents are also developed that address post acceptance responsibilities: an EVMS Surveillance Plan and an EVM System Revision Procedure.

Since the EVM System Owner is responsible for the maintenance of the system, the Surveillance Plan is developed to describe how the organization will periodically monitor the compliance of its EVMS to ANSI/EIA-748 Standard. Guidance on developing and implementing the EVMS Surveillance Plan is provided in the NDIA Surveillance Guide.

Because modifications to the EVMS may be required from time to time, a System Revision Procedure is developed to document a formal approach to changing the EVMS. The DOD’s Earned Value Management Implementation Guide (EVMIG), while not

NDIA PMSC



directly applicable for many EVM System Owner organizations, does provide example guidance for such a document.

2.1.2 Compliance with ANSI Guidelines There are various approaches to documenting the processes involved in the structure of an EVMS. Many organizations choose to write a single document that describes how their program management processes and procedures meet the intent of the guidelines. Others choose to write a series of procedural documents that address specific elements of the guidelines; e.g. a work breakdown structure (WBS) procedure to cover the intent of the first Organization guideline or a procedure for establishing program or project schedules as covered by the first two Planning, Scheduling, and Budgeting guidelines. Another approach is to integrate EVMS processes and procedures into existing functional procedures, such as engineering, production, and program management. Whichever approach is chosen, it is vital that, when completed, the EVM System Owner assures itself that all 32 guidelines are addressed and that the aspects of the various processes are fully integrated in an approach to project management.

There are also two philosophies regarding how to describe compliance of the internal processes with the guidelines. The first involves taking each of the five sections of the guidelines (Organization; Planning, Scheduling and Budgeting; etc.) and discussing how the internal processes support the intent of each of the guidelines in that section. This means that for each guideline, the EVM System Owner must ensure that each of the internal processes that support or intersect with that guideline must be covered in the discussion. For example, the material control process and the subcontract management process cut across all five sections of the guidelines. As the guidelines in the Organization section are described in terms of internal processes, these areas must be covered as to how their unique aspects relate to the intent of the guideline under discussion.

The second approach orients the discussion around the multiple processes involved in project management and how each of these processes meets the intent of each guideline that is affected. For example, in describing how the management of material items, from identification of requirements to inclusion in the end-product, is conducted in a project management environment, the description of this process must address guidelines in all five sections. Other project management processes likewise intersect guidelines in all sections.

In either case, the EVM System Owner should make use of a matrix similar to Figure 2.2 to ensure that each of the 32 guidelines, their management intent, and related identifiable products are covered. This matrix becomes very useful during the self assessment and progress assessment reviews and subsequent documentation of the evaluation processes. It verifies to both internal management and external customers or reviewers that the EVM System Owner has done a comprehensive job of describing an EVMS that meets the intent of the guidelines.

The NDIA Earned Value Management Systems Intent Guide is an excellent document that will assist the EVM System Owner in ensuring a complete description of the EVMS is prepared.

NDIA PMSC



Figure 2.2. An Example Guideline Matrix to Ensure all 32 Guidelines are addressed in the EVM System.

2.2 Compliance Evaluation Review Once the processes and procedures have been created, modified, and published, the Compliance Evaluation Review (CER) is conducted to verify:

• The system, as described, meets the intent of the 32 Guidelines as described by the NDIA Earned Value Management Systems (EVMS) Intent Guide;

• The system, as described, is fully implemented on the selected programs;

• The implementation is successful and complies with the requirements of the system description/organization’s EVMS procedures and (if appropriate) program unique procedures;

• The system implemented provides timely, accurate, and auditable management information for both the organization’s project management and the customer.

The compliance review process and results are documented to allow those who did not participate in the review the ability to evaluate the propriety of the review and its results.

This independent review must be conducted by a person(s) or organization(s) that:

ORGANIZING

SCHEDULING

PLNG. & BUDGT.

ACCOUNTING

INDIRECT

MGR. ANALYSIS

CHANGE CONTROL

MATL PLNG & CNTRL.

OR

GA

NIZ

ATI

ON

PLN

G, S

CH

ED

;, &

BU

DG

T.

AC

CO

UN

TIN

G

AN

ALY

SIS

RE

VIS

ION

S

SUBCON .MGMT.

GUIDELINES

PRO

CES

SES

ORGANIZING

SCHEDULING

PLNG. & BUDGT.

ACCOUNTING

INDIRECT

MGR. ANALYSIS

CHANGE CONTROL

MATL PLNG & CNTRL.

OR

GA

NIZ

ATI

ON

PLN

G, S

CH

ED

;, &

BU

DG

T.

AC

CO

UN

TIN

G

AN

ALY

SIS

RE

VIS

ION

S

SUBCON .MGMT.

GUIDELINES

PRO

CES

SES

ORGANIZING

SCHEDULING

PLNG. & BUDGT.

ACCOUNTING

INDIRECT

MGR. ANALYSIS

CHANGE CONTROL

MATL PLNG & CNTRL.

OR

GA

NIZ

ATI

ON

PLN

G, S

CH

ED

;, &

BU

DG

T.

AC

CO

UN

TIN

G

AN

ALY

SIS

RE

VIS

ION

S

SUBCON .MGMT.

GUIDELINES

PRO

CES

SES

NDIA PMSC



• Has no vested interest in the EVM system owner; system; or program, project or contract being reviewed;

• Is recognized as being knowledgeable and competent in the area of EVM systems and implementation;

• Uses the NDIA EVMS Intent Guide for evaluating EVM systems for compliance.

A CER report will be prepared by the Compliance Evaluation Team. This report is an iterative document resulting from a process that allows the Compliance Evaluation Team to consider the EVM System Owner’s responses to any of the team’s findings prior to submitting the CER report to the EVM Executive Agent.

2.3 System Acceptance The final phase of the overall process is the acceptance of the EVM System Owner’s system by Government or commercial customers that may or may not have current or pending acquisitions with the EVM System Owner to whom the certification is to be issued. For Government customers, this acceptance, as defined by the OMB Federal Acquisition Regulation (FAR) clause, is effected by the contracting officer for the customer. For commercial customers, a designated representative will provide the appropriate acceptance document. If an AA is subsequently issued, it is normally signed by senior representatives of the EVM System Owner and the customer.

In the case where the customer is a Government agency, it is possible that the EVM System Owner will want the acceptance to also be acknowledged by other agencies. The responsibility for coordinating cross-agency acceptance of the system rests primarily with the agency issuing the initial acceptance. Cross-agency acceptance is best accomplished through the establishment of reciprocal agreements between agencies and organizations to mutually recognize EVM System Owner systems as ANSI EVM compliant. Each participant in the reciprocal agreement would specify the level of supporting documentation or additional reviews required from the certification process to meet their requirements for acceptance.

Commercial customers, at the request of the EVM System Owner, may provide documentation supporting the system acceptance to new customers of the EVM System Owner. For a new commercial customer, the EVM System Owner, upon receiving a new requirement for the implementation of an EVMS, may submit copies of the letter of acceptance, the compliance assessment results, and/or the report of the compliance acceptance for the new customer.

NDIA PMSC



3 SYSTEM DESIGN AND IMPLEMENTATION The primary purpose of Earned Value Management is to support program management with a system that provides a sound basis for program/project performance, problem identification, corrective actions, and management decisions. Thus, Earned Value Management isn’t simply a metric or a report. It is comprised of a number of management processes that form an integrated program/project management capability. EVM Systems must, first and foremost, meet an organization’s needs and good business practices to be effective. Therefore, the establishment of an EVMS requires a structured process.

There is no single correct process for establishing an EVMS, but it typically involves the following efforts:

• An organizational commitment to the use of EVM;

• An assessment of where changes/enhancements to processes to meet the EVMS Guidelines described by ANSI/EIA 748 are needed;

• Design of the EVMS processes;

• Documentation of the EVMS;

• Training;

• System evaluation.

This section addresses these topics.

3.1 Policy Preparation and Approval The EVM System belongs to and is governed by the EVMS owner corporation, company, Government Agency, or similar organization. Establishment of an EVM policy by senior management is not required, but is an invaluable first step. It will facilitate the commitment of resources necessary to design, implement, and maintain an EVMS with the requirements of ANSI/EIA-748 EVMS guidelines. At a minimum, the policy should include:

• A statement of commitment to the operation and maintenance of the EVMS;

• A reference to policies and standards, i.e., ANSI/EIA748 and OMB A-11;

• A definition of the type of programs and projects that will use EVM;

• Assignment of responsibility for the operation and maintenance of the EVMS;

• A definition of program management responsibilities for implementing and using EVM;

• Assignment of support organization responsibilities;

• Establishment of the requirement to conduct internal surveillance on the EVMS.

NDIA PMSC



3.2 System Documentation and Procedures The ANSI/EIA 748 EVMS guidelines are high level, goal oriented, and are intended to state the qualities and operational considerations of an integrated management system using earned value analysis methods without mandating detail system characteristics. They also are structured to enable implementation on large and small programs, projects, or contracts. EVMS owners have the flexibility to implement EVM in a manner that provides the effective and efficient performance management methods and techniques within the ANSI/EIA 748 Guidelines.

An EVM System Owner may choose to either:

a) Write a single document that describes how their program management processes and procedures meet the intent of the guidelines.

b) Write a series of procedural documents that address specific elements of the guidelines; e.g. a work breakdown structure (WBS) procedure to cover the intent of the first Organization guideline or a procedure for establishing program or project schedules as covered by the first two Planning, Scheduling and Budgeting guidelines.

c) Revise existing functional procedures to incorporate processes and procedures to meet the intent of the guidelines.

Whichever approach is chosen, it is vital that, when completed, the EVM system owner is assured that all 32 guidelines are addressed and that the EVMS system owner’s various processes are reflected in an integrated project management system.

Developing these documents will only take place after specific system design solutions have been identified to address any “gaps” that may exist between the EVMS owner’s current practices and the requirements of the EVMS Guidelines. One way that these gaps might be identified is by conducting an assessment of current processes and practices as related to each of the 32 EVMS Guidelines.

The NDIA Earned Value Management Systems Intent Guide may be used to assist the EVMS owner in ensuring an ANSI/EIA 748 conforming design of the EVMS is developed and documented. An organization that needs to satisfy a proposal requirement that its system meets this standard may prepare a compliance map documenting how its business processes conform to ANSI/EIA 748 EVMS guidelines using the NDIA Intent Guide Appendix A, Process Description Compliance Map Template.

Preparing an Intent Guide compliance map provides several benefits that keep the system design and implementation process moving forward. As described above, it can help in identifying any process or procedure gaps that will require closure to achieve conformance with the EVMS Guidelines. The aligning of EVM System Owner (company or Agency) processes and procedures with the applicable guideline may also identify duplicate documentation that, when removed, typically provides process streamlining. When the design and subsequent documentation efforts that result from actions taken based on the compliance mapping are completed, those involved with implementing and maintaining the EVMS typically have a better understanding because

NDIA PMSC



the EVMS reflects how the organization intends to do business. This, in turn, can reduce the training requirements.

3.3 Implementation and Review Early in the system design and documentation activity, senior management needs to select a program or project for the EVM System implementation. This program or project will be the vehicle used for the conduct of the Compliance Evaluation Review. Some considerations for selecting the program or project for EVM System implementation and review include:

• A program or project with a contractual or Government requirement to use an ANSI/EIA 748 compliance EVM System;

• The diversity of the business-base upon which EVM will be implemented:

- development, modernization, enhancement effort

- hardware production projects

- software design and delivery

- support and services

- multiple performing organizations (contractors, subcontractors, and Government organizations);

• The number of locations under which the EVMS will operate.

Implementation of the EVMS on the program/project or projects occurs after the system design and documentation discussed in paragraph 3.2 above has been completed. Additionally, as the processes are implemented, feedback on the effectiveness and accuracy of the system documentation and procedures is important to ensure that needed improvements are incorporated in a timely manner. Figure 3.2 graphically displays this process.

Figure 3.1. Documentation and Implementation Feedback Process

When the EVMS design is a product of using “as is” or modifying existing business processes and procedures, implementation can move forward efficiently because the

System Documentation

System Implementation

Feed

back

Feed

back

Feed

back



Feed

back

Feed

back

Feed

back



Feed

back

Feed

back

Feed

back

NDIA PMSC



processes are largely consistent with those already in use on programs or projects. Where the EVMS is the result of defining and documenting new processes and procedures, the implementation activity may require that more training be conducted. Implementation may also identify where modifications to the new processes and procedures may be required because issues weren’t recognized until the design concepts were actually implemented.

Once the implementation is completed, the system evaluation process begins. The EVMS system owner may elect to conduct or have conducted a simulation of the EVM System Evaluation Review to assure itself that the EVMS as implemented does conform with the EVMS Guidelines, allowing any shortfalls in the design and/or implementation to be addressed prior to the conduct of the actual Compliance Evaluation Review. Alternatively, they may move directly to the EVM System Evaluation Review as described in Section 4.0 of this document.

3.4 EVM and System Training In conjunction with the activities of design and implementation, training in both the concepts of earned value management and the system compliance with the ANSI/EIA 748 EVMS guidelines is critical to achieving system acceptance. EVM basic training focuses on the concepts of the EVMS as embodied by the 32 guidelines and the associated processes.

In addition to the EVM basic training, specific EVMS training must be structured around the process elements of the system designed and being implemented by the EVM System Owner. This would include unique project management aspects of the system, forms that have been or are being designed for implementation, and process-oriented interfaces with other internal systems that support project management.

Training should begin as early in the system implementation as possible. As system documentation is updated to reflect the feedback from implementation, the system training should also be modified to reflect the documentation updates.

NDIA PMSC



4 EVM SYSTEM COMPLIANCE EVALUATION REVIEW The purpose of the EVM System CER is to:

• Ensure senior management active participation and ownership of the earned value management process;

• Verify the EVM system (processes, procedures, systems, and practices) are compliant with the ANSI/EIA 748 standard;

• Demonstrate the use of the EVMS by the EVM System Owner’s project management workforce;

• Ensure the data and reports produced by the EVM system are reliable and capable of being used for planning, risk mitigation, and corrective actions, and for forecasting schedule and cost outcomes;

• Verify the EVM system produces performance data consistent with the program technical, schedule, and cost status.

The EVM System CER may occur prior to program approval or contract award or may occur after these events as depicted in Figure 4.1.

Acquisition Life

Cycle EVM Executive Agent /

Customer EVM Systems Owner /

Supplier Pre-Systems Acquisition Approval or Award

Recognize: - Application Guide - System

Acceptance Guide

Document and Assessment:

- Application Guide - Intent Guide

Systems Acquisition Approval or Award

Accept: - Intent Guide

IBR Review:

- IBR Guide Surveillance:

- Surveillance Guide

Implement: - Intent Guide

IBR Review: - IBR Guide

Execution and Surveillance:

- Surveillance Guide

Figure 4.1. EVMS Compliance Framework

There are various options for who conducts the EVM System CER, such as:

• The EVM Executive Agent;

• The customer;

NDIA PMSC



• The EVM System Owner using in-house resources;1

• The EVM System Owner using a combination of in-house, customer , EVM Executive Agent, and 3rd Party Certifier resources;

• An independent, non-advocate 3rd party.

The EVM System Owner may choose to conduct a Self-Assessment (SA) and Progress Assessment Reviews (PARs) to prepare for the EVM System Compliance Evaluation Review. These optional reviews (described below) provide an opportunity for the EVM System Owner to assess its readiness for the CER and to increase the probability of success.

4.1 EVM System Compliance Evaluation Review Schedule It is important to establish a schedule of activities required to get from system design to completion of the CER. The CER may be conducted serially, concurrently, or in combination with system design to reduce the cost of obtaining ANSI/EIA 748 acceptance. The review schedule for the CER needs to provide adequate time for an efficient review and assessment. While the CER review and assessment phases are not strictly defined, a notional high level process is illustrated in Figure 2.1, and is conducted by the Compliance Evaluation Team in accordance with that Figure.

While sufficient time to conduct each of the required activities should be included in the schedule, every effort should be made to complete the process quickly. When incorporating, as appropriate, the activities described in the schedule below, activities may be scheduled with some overlap depending on the maturity of the organization. Coordination of the schedule with all participants will assist in “buy-in” by the Compliance Evaluation Team, the EVM System Owner, and the EVM Executive Agent. Figure 4.2 is a nominal schedule for completing the CER. The overall timeline will change based on the EVM System Owner’s choices and situation.

Figure 4.2. Sample CER Schedule

1 For EVM System Owners who choose to conduct the EVM System Compliance Evaluation Review themselves or through a 3rd party, it may be appropriate to invite participation from the EVM Executive Agent or customer.

-

Nominal EVM System CER Schedule

Self-Assessment Review (SAR)

EVM System Compliance Evaluation Review (CER)

-

Nominal EVM System CER Schedule


EVM System Compliance Evaluation Review (CER)

NDIA PMSC



Some EVM System Owners may choose readiness reviews or assessments prior to scheduling the CER. Reviews such as an EVM Self-Assessment Review or an EVM Progress Assessment Review may be conducted at the request of the EVM System Owner or the EVM Executive Agent. These reviews normally are conducted after the EVM system has been implemented as depicted in Figure 4.3

Figure 4.3. Review Cycles

4.2 EVM System Owner Self-Assessment The purpose of the Self Assessment (SA) is to:

• Assess the compliance to the ANSI/EIA 748 Standard and identify areas of non-compliance and areas to improve, often referred to as a “Gap Analysis.” The SA may include Control Account Manager interviews (sometimes referred to as mock CAM interviews) to assess progress of the EVM system implementation.

• Develop a plan to prepare the program/contract team to conduct a CER.

• Develop a plan and schedule for future reviews, including proposed dates for the CER.

The SA is optional and the decision to conduct an SA is based on factors such as:

• Maturity of the EVMS processes;

• Project personnel’s understanding of EVM concepts;

• Status of EVM training for the project team;

• Size of the project (dollars, time, and/or complexity of scope).

After the EVMS Owner determines the program/project has implemented corrective actions to comply with the ANSI/EIA 748 Standard, the next step is to conduct a Progress Assessment Review (PAR) as described in the next section or proceed to coordinate with the CER Team Lead to schedule the CER.

4.3 Progress Assessment Review The PAR is optional and the need for a PAR may be determined by either the EVM System Owner or the EVM Executive Agent. The PAR is conducted by the Compliance Evaluation Team in preparation for the EVM System CER. The purpose of the PAR is to

Implement EVM

Program

Conduct CER

Review


ProgressAssessment Review (SAR)

And / OrImplement

EVM Program

Conduct CER

Review


ProgressAssessment Review (SAR)

And / Or

NDIA PMSC



review progress toward implementing the EVMS, to resolve misunderstandings, and to assess the project's readiness to demonstrate a fully-integrated, earned value management system. The PAR assists in preparing for the CER by familiarizing key team members with the fundamentals of the EVMS. Usually the PAR is conducted by a small team to provide the EVMS Owner with a readiness assessment. The PAR may include control Control Account Manager interviews (sometimes referred to as mock CAM interviews) to assess the EVMS implementation. The PAR team does not institute changes to the EVMS but provides sufficient information for the EVM System Owner to understand non-compliance issues and to implement corrective actions necessary to meet the intent of the ANSI/EIA 748 Standard. Although the PAR is optional, the PAR provides an additional opportunity for the EVM System Owner to correct potential non-compliance issues prior to conducting the CER.

4.4 Compliance Evaluation Team Membership Selection and Training Once the EVM System Owner decides which option to use for conducting the review and, therefore, how the team will be structured; one of the initial steps is selecting individuals to make up the CER team. The CER team qualifications should be consistent with those listed in Appendix A. The CER team selection documentation should include the checklist provided with the CER Team qualification guide (Statement of Qualifications for Review Lead of EVM Compliance Evaluation Reviews) with a copy of the team member resumes. The CER team lead assigns Compliance Evaluation Review responsibilities to the CER team members. Usually, CER team assignments are based on the five categories defined in the ANSI/EIA 748 Standard: Organizing, Planning, Accounting, Analysis & Reporting, and Change Management.

CER team members should be independent and non-advocates of the EVM System Owner and should not have participated in the design and implementation of the system. CER team members must certify their independence and non-advocacy as follows:

• Team members will certify that they have not participated in the EVMS design or implementation.

• Team members will certify that they will not enter into a business relationship with the company whose system is being evaluated that benefits the person or company that participated in the CER for 18 months except to conduct further attestation services, such as additional CERs, EVM surveillance, and general training.

• Team members will sign non-disclosure agreements to protect proprietary data provided to the review team during the CER.

• Where contractor CERs are conducted, team members will sign an agreement precluding teaming and providing EVM implementation consulting services to a company competitor on a competitive bid for 18 months or until such time as the contract is awarded, the company withdraws from competition, or the customer cancels the immediate project, whichever event comes later.

NDIA PMSC



Once the compliance evaluation team has been established, training is conducted. Since team members must meet stringent qualifications, their training requirements will vary depending on their experience with conducting CERs. A training program would include the process of evaluating EVMS compliance with the guidelines and the effectiveness of its implementation. This includes the approach to conducting the review (process or guideline oriented), the manager interview concept, documentation requirements, and the forms and formats to be used during the course of the review. The assessment formats provided in NDIA PMSC ANSI/EIA 748 Intent Guide, Appendix A, are required. At the conclusion of the team training, the team members should be able to:

• Verify that the system description words reflect the intent of the EVM Guidelines;

• Ensure that the system, as described, is implemented on the selected project(s);

• Prepare objective documentation of the results of the CER.

Team members should conduct CERs and PARs in a professional manner. Appendix C, PAR and CER Execution Considerations, is provided to encourage a well conducted review resulting in a final report that is acknowledged to be valid by all the participants in the review.

4.5 EVM System Compliance Evaluation Review (CER) The purpose of the EVMS CER is to determine if the implementation of a documented EVMS is compliant with the ANSI/EIA 748 Standard. An overview of the CER process is illustrated in Figure 4.4.

Figure 4.4. Overview of the CER Process

EVM System Owner

Review Team Documentation Review

Prepare CARs &

IOs

Notes:1. CARS (Corrective Action Request) document non-compliance findings 2. IOs (Improvement Opportunity) are EVMS recommendations made by the assessment team

EVM System Compliance Evaluation Review (CER)Process Overview

Request for EVM System Compliance Evaluation Review (CER)

Conduct CAM / PM / PO

Interviews

CAR Corrections

Verify CAR Corrections

Prepare CER

Report

Conduct In-briefings

Conduct Out-

Briefing

Data Gathering Findings CER ReportProcess Steps

EVM System Owner

Review Team Documentation Review

Prepare CARs &

IOs

Notes:1. CARS (Corrective Action Request) document non-compliance findings 2. IOs (Improvement Opportunity) are EVMS recommendations made by the assessment team

EVM System Compliance Evaluation Review (CER)Process Overview

Request for EVM System Compliance Evaluation Review (CER)

Conduct CAM / PM / PO

Interviews

CAR Corrections

Verify CAR Corrections

Prepare CER

Report

Conduct In-briefings

Conduct Out-

Briefing

Data Gathering Findings CER ReportProcess Steps

NDIA PMSC



The CER team will review the EVMS Owner's working papers and documents to ascertain compliance and document its findings. The EVMS Owner will make the documents used in the implementation of the EVMS available to the team. The NDIA PMSC ANSI/EIA 748 Intent Guide, Appendix A, provides examples of documentation that should be reviewed. The team should verify that the documentation is current and accurate. The EVM System Owner will demonstrate to the team how the EVMS is structured and used in actual operation.

The following are activities that will be performed to the extent necessary during the CER:

(1) An overview briefing by the EVMS Owner to familiarize the CER team with the proposed EVMS, identifying any changes that have occurred since the most recent PAR(s) that may have been conducted.

(2) A review, on a sample basis, of the documentation that establishes and records changes to the baseline plan for the contract. This will include work authorizations, schedules, budgets, resource plans, and change records (including management reserve and undistributed budget records). The purpose is to verify that the EVMS Owner has established and is maintaining a valid, comprehensive, integrated baseline plan for the contract.

(3) A review, on a sample basis, of the reported cost and schedule performance against the baseline plan, along with documented analyses of problems and a projection of future costs. Also, a trace of the summarization of cost/schedule performance data from the lowest level of formal reporting (normally the control account level) to the level designated for internal management and (if applicable) the external performance measurement reports. The purpose of this activity is to verify the adequacy of the control aspects of the systems and accuracy of the resulting management information.

(4) Interviews with a selected sample of members of the project organization, including control account managers, as well as functional representatives or other work teams, and project managers. The purpose of these interviews is to verify that the EVMS is fully implemented and is being used to manage the project. The sample data reviewed should be sufficient to verify implementation and compliance with the EVMS. While it may not be necessary to review 100% of all documentation and program personnel, too small a sample may not provide sufficient visibility into possible system problems. Samples should be selected to focus on the areas of greatest risk. If significant problems are found, the sample size, and, if necessary, the duration of the review, should be extended.

(5) Findings that require corrective action will be documented as Corrective Action Requests (CAR). Corrective actions required before ANSI/EIA 748 compliance acceptance can be issued should be identified. The CER review team may recommend optional process improvement opportunities.

(6) An exit briefing covering the team's findings. During this briefing, any open system discrepancies should be discussed along with the EVM System Owner’s

NDIA PMSC



corrective action plan which should establish responsibility and a timeframe for all required corrective actions.

4.6 Compliance Evaluation Review Report At the conclusion of the CER, the team prepares a report documenting the activities of the review, as well as the results. The content of the report will reflect, as completely as possible, how the team verified compliance with the guidelines and that the described system was properly and effectively implemented on the project or projects under review. Appendix B contains an example format for the CER report.

NDIA PMSC



5 SYSTEM COMPLIANCE ACCEPTANCE EVMS System Compliance acceptance represents the formal recognition by an EVM Executive Agent that an EVM System Owner’s EVMS is compliant with the ASI/EIA 748 Standard. It means that the EVM Executive Agent has reviewed the EVM system owner’s EVMS system CER report and determined that:

• The EVM system complies with the 32 guidelines of ANSI/EIA-748-A and the NDIA EVM Intent Guide;

• The EVM System Owner is using its EVMS;

• The customer’s review complied with the steps in this Systems Acceptance Guide.

The information provided in the CER Report, regardless of the report’s author, should be evaluated by the customer for completeness. The EVM system owner should provide documentation of the current status of corrective actions before a final decision is made concerning issuance of a system certification of acceptance

5.1 Initial System Compliance Certification EVMS ANSI/EIA 748 Compliance may be a partial acceptance. Examples include production certification and development certification. The EVMS System Compliance Certification should clearly indicate that all ANSI/EIA 748 Guidelines are included in the EVMS or clearly specify which Guidelines are not included in the Compliance.

The EVMS Compliance Certification document can take several forms. The style and content of the document is up to the EVM Executive Agent, but it should contain the following minimum information:

a) Title;

b) The EVM System Owner’s name and the location(s) for which the certification is applicable;

c) The title given to the EVMS by the EVM System Owner (PMCS, IMS, P23RD2005, etc.) and the date approved;

d) The title(s) of the project(s) or contract(s) on which the review was conducted;

e) The name and contact information for the person signing the document;

f) A statement of period for which the Compliance Certification will be effective;

g) Reference to the ANSI/EIA 748 Guidelines included in the Certification.

h) For those EVMS acceptances that have certified a portion of the ANSI/EIA 748 Guideline, it is recommended that “Partial EVMS Compliance Certification” be included.

The signed EVMS Compliance Certification document is then forwarded to the EVM System Owner and all other parties involved in the process.

NDIA PMSC



In cases where the certifying party is a government organization, the compliance acceptance for a contractor or Government organization is usually issued by an Agency EVM official, i.e., EVM Focal Point, EVM Executive Agent, or a contracting officer. If a Government Advance Agreement (normally executed between a government entity and the EVM system owner) is desired in addition to the EVMS System Certification, the Advance Agreement is signed by representatives of both the EVM system owner and the government agency. In cases where the certifying party is a contractor, compliance acceptance is usually issued by a contractor official, i.e., contracting officer or an EVM Focal Point.

5.2 EVM System Owner Responsibilities The issuance of the EVMS Compliance Certification to the EVM System Owner represents the completion of the EVM System Owner’s activities for the initial system acceptance process. The certification does not necessarily represent a contract certification and the EVM System Owner is required to maintain the system, implement EVM on additional programs or projects, and conduct EVM surveillance. If the EVM System Owner revises the EVM policy, process, procedures, or practices, the EVM Executive Agent issuing System Compliance Certification should approve the revisions.

EVM System Owners should maintain documentation of all reviews, acceptance notification, advance agreements, system description, and other EVMS products to ensure that they can adequately demonstrate compliance with the standard.

For additional contracts with EVM requirements, the EVM system owner will be tasked to furnish, generally with its proposal, the following documentation:

• EVMS System Compliance Certification and Advance Agreement, if any;

• Compliance Evaluation Report (CER);

• System description, policies, and procedures;

• Recent EVM Surveillance reports demonstrating the EVM system remains in compliance with the ANSI/EIA 748 Standard.

• EVMS surveillance conducted by the EVM System Owner and the EVM Executive Agent will be consistent with the NDIA EVMS Surveillance Guide.

5.3 EVM Executive Agent Responsibilities After acceptance and certification of an EVM System Owner compliance with ANSI/EIA 748, the EVM Executive Agent is responsible for conducting EVM surveillance to verify the EVM system is being maintained and used by the EVM System Owner. Revisions to ANSI/EIA 748 Compliant EVM System policies, processes, procedures, or practices must be approved by the EVM Executive Agent.

When an EVM System Owner with an ANSI/EIA 748 compliant EVMS receives future contracts with EVMS requirements, the customer should receive EVM documentation from the EVM System Owner (see section 5.2). The customer is not required to accept an EVMS Compliance Certification issued by another customer. However, the new customer should review the EVM System Compliance Certification, the CER EVMS

NDIA PMSC



Report, recent EVM surveillance reports, and other materials provided by the EVM system owner, assess them, and then determine whether the EVM System Owner has demonstrated, to the satisfaction of the customer, that its EVM system meets the ANSI/EIA-748-A Standard. The customer will then (a) request additional information and documentation, (b) issue an EVMS System Compliance Acceptance, or (c) conduct its own compliance review. In most cases, it will not be necessary to duplicate the CER review process in order to satisfy the contractual EVMS need.

NDIA PMSC



APPENDIX A CERTIFICATION TEAM QUALIFICATION GUIDELINES

NDIA PMSC



Dut

ies

and

Res

pons

ibili

ties

Rev

iew

Lea

dM

anda

tory

Des

ired

Opt

iona

l

Educ

atio

n/Tr

aini

ng

- Kno

wle

dge

and

unde

rsta

ndin

g of

the

appl

icab

le E

VM

S

tand

ard,

i.e.

, AN

SI/E

IA 7

48 S

tand

ard

- EV

MS

- A fo

rmal

cou

rse

of in

stru

ctio

n on

AN

SI/E

IA 7

48 S

tand

ard

Gui

delin

es- K

now

ledg

e of

ass

essm

ent t

echn

ique

s fo

r exa

min

ing,

qu

estio

ning

, eva

luat

ing,

and

repo

rting

- Und

ergr

adua

te d

egre

e or

min

imum

of t

en y

ears

of

earn

ed v

alue

man

agem

ent e

xper

ienc

e- F

orm

al c

ours

e of

inst

ruct

ion

(min

imum

of 4

- hou

rs) i

n th

e E

VM

sta

ndar

d be

ing

appl

ied

- PM

I Col

lege

of P

erfo

rman

ce M

anag

emen

t, P

rofe

ssio

nal

Edu

catio

nal P

rogr

am (e

ither

Cou

rse

Cer

tific

ate

or

Gra

duat

e C

ertif

icat

e)N

ot A

pplic

able

Expe

rienc

e-M

inim

um o

f ten

(10)

yea

rs o

f EV

M e

xper

ienc

e-M

inim

um o

f 5 y

ears

EV

M im

plem

enta

tion

expe

rienc

e-T

eam

mem

ber o

f thr

ee o

r mor

e E

VM

val

idat

ion

revi

ews

Not

App

licab

leN

ot A

pplic

able

Cer

tific

atio

nN

ot A

pplic

able

- Ear

ned

Val

ue P

rofe

ssio

nal c

ertif

icat

ion

(Ass

ocia

tion

for

Adv

ance

men

t of C

ost E

ngin

eerin

g)

Ethi

cal C

ondu

ctSTA

TEM

ENT

OF

QU

ALIF

ICAT

ION

S FO

R R

EVIE

W L

EAD

OF

EVM

CO

MPL

IAN

CE

EVA

LUAT

ION

REV

IEW

S

For o

ther

than

sel

f-eva

luat

ions

con

duct

ed w

ith in

-hou

se re

sour

ces:

- The

team

mem

ber s

hall

not b

e cu

rrent

ly e

mpl

oyed

or h

ave

been

em

ploy

ed b

y th

e co

mpa

ny o

r gov

ernm

ent a

genc

y un

derg

oing

EV

M v

alid

atio

n du

ring

any

porti

on o

f the

pr

eced

ing

18 m

onth

- The

team

mem

ber w

ill c

ertif

y to

pre

clud

e em

ploy

men

t or p

rovi

de s

ervi

ces

to th

e co

mpn

ay o

r gov

ernm

ent a

genc

y un

derg

oing

EV

M v

alid

atio

n of

r a p

erio

d of

18

mon

ths

- The

team

mem

ber w

ill c

ertif

y no

t to

parti

cipa

te w

ith (e

ngag

emen

t or e

mpl

oym

ent)

with

ano

ther

com

pany

com

petit

ive

activ

ity fo

r a p

erio

d of

18

mon

ths

- The

team

mem

ber w

ill c

ertif

y to

hav

e no

t pro

vide

d co

nsul

ting

or tr

aini

ng s

ervi

ces

for E

VM

impl

emen

tatio

n or

val

idat

ion

purp

oses

dur

int h

e pr

evio

us 2

4 m

onth

s- T

hem

team

mem

ber w

ill c

ertif

y to

hav

e no

sig

nific

ant f

inan

cial

inte

rest

in th

e co

mpa

ny u

nder

goin

g E

VM

val

idat

ion,

def

ined

as

owne

rshi

p of

sto

cks,

mem

bers

hip

on th

e bo

ard

of

dire

ctor

s, o

r em

ploy

men

t of a

n im

med

iate

fam

ily m

embe

r by

the

com

pany

.

This

sta

tem

ent o

f qua

lific

atio

ns w

as p

repa

red

by P

roje

ct M

anag

emen

t Ins

titut

e - C

olle

ge o

f Per

form

ance

Man

agem

ent,

and

is in

tend

ed to

ser

ve a

s a

guid

e on

ly.

This

st

atem

ent d

oes

not i

mpl

y en

dors

emen

t by

Proj

ect M

anag

emen

t Ins

titut

e or

any

of i

ts c

ompo

nent

s. T

his

is in

tend

ed to

ser

ve a

s a

stan

dard

for v

olun

tary

com

plia

nce

by

inde

pend

ent c

ertif

ying

com

pani

es o

r gov

ernm

ent a

genc

ies.

As

such

, Pro

ject

Man

agem

ent I

nstit

ute

and

its c

ompo

nent

s ar

e no

t lia

ble

for a

ny m

isap

plic

atio

n, m

isin

terp

reta

tion,

or

any

lega

l act

ion

resu

lting

from

the

appl

icat

ion

of th

is v

olun

tary

sta

ndar

d fro

m a

ny a

ffect

ed p

artie

s.

The

revi

ew le

ad is

resp

onsi

ble

for t

he o

vera

ll di

rect

ion

of th

e EV

M C

ompl

ianc

e Ev

alua

tion

Rev

iew

(CER

) effo

rt, e

nsur

ing

that

the

revi

ew is

in c

ompl

ianc

e w

ith

the

appl

icab

le E

VM s

tand

ard,

i.e.

, AN

SI/E

IA 7

48 S

tand

ard

- EVM

S.

The

revi

ew le

ad w

ill se

lect

revi

ew te

am m

embe

rs a

nd v

erify

com

plia

nce

with

the

Stat

emen

t of Q

ualif

icat

ions

for T

eam

Mem

bers

of E

VM C

ompl

ianc

e Ev

alua

tion

Rev

iew

s (C

ER).

The

Rev

iew

Lea

d is

resp

onsi

ble

to fo

rm a

team

that

has

a c

ross

sec

tion

of s

kills

and

kno

wle

dge

to a

ddre

ss th

e in

tent

of t

he E

VM S

tand

ard.

Ex

ampl

e Te

am M

embe

r ski

lls a

nd k

now

ledg

e re

quire

d to

con

duct

a c

ompr

ehen

sice

incl

ude:

- A

ccou

ntin

g

- Sch

edul

e M

anag

emen

t

- Cos

t est

imat

ing

and

budg

etin

g

- Pro

gram

man

agem

ent w

ith fa

milia

rity

with

the

type

of p

rogr

am b

eing

ass

esse

d an

d st

ruct

ure

of th

e W

BS u

sed

for s

imila

r pro

gram

sTh

e re

view

lead

pro

vide

s ov

eral

l rev

iew

dire

ctio

n an

d in

terp

reta

tion

of th

e EV

M s

tand

ard

to th

e re

view

team

. Th

e re

view

team

has

the

resp

onsi

bilit

y to

insu

re

that

all

revi

ew e

fforts

are

acc

ompl

ishe

d in

a p

rofe

ssio

nal m

anne

r by

the

entir

e te

am.

The

revi

ew le

ad s

houl

d ke

ep th

e re

ques

ting

auth

ority

info

rmed

of t

he

team

's p

rogr

ess.

NDIA PMSC



Dut

ies

and

Res

pons

ibili

ties

Not

e: t

eam

mem

bers

hip

will

be li

mite

d to

one

(1) o

n-th

e-jo

b tra

inee

s or

firs

t tim

e te

am m

embe

rs, i

n or

der t

o av

oid

dete

riora

tion

of th

e te

am's

effe

ctiv

enes

s.

Team

Mem

ber

Man

dato

ryD

esire

dO

ptio

nal

Educ

atio

n/Tr

aini

ng

- Kno

wle

dge

and

unde

rsta

ndin

g of

the

appl

icab

le E

VM S

tand

ard,

i.e

., A

NSI

/EIA

748

Sta

ndar

d - E

VM

S- A

form

al c

ours

e of

inst

ruct

ion

on A

NSI

/EIA

748

Sta

ndar

d

Gui

delin

es- K

now

ledg

e of

ass

essm

ent t

echn

ique

s fo

r exa

min

ing,

qu

estio

ning

, eva

luat

ing,

and

repo

rting

- Und

ergr

adua

te d

egre

e or

min

imum

of t

en y

ears

of e

arne

d va

lue

man

agem

ent e

xper

ienc

e- P

rior e

xper

ienc

e as

a v

alid

atio

n te

am m

embe

r, or

on-

the-

job

train

ing

is m

anda

tory

. O

n-th

e-jo

b tra

inee

s w

ill h

ave

an a

ssig

ned,

ex

perie

nced

men

tor w

ith a

n ev

alua

tion

of p

erfo

rman

ce- I

f app

oint

ed to

eva

luat

e th

e ac

coun

ting

porti

on o

f the

EV

M

syst

em, t

he m

embe

r sha

ll ha

ve a

Bac

helo

r's d

egre

e in

A

ccou

ntin

g or

a C

PA

.

- Kno

wle

dge

and

unde

rsta

ndin

g of

the

appl

icab

le E

VM

St

anda

rd, i

.e.,

AN

SI/E

IA 7

48 S

tand

ard

- EVM

S- A

form

al c

ours

e of

inst

ruct

ion

on A

NS

I/EIA

748

Sta

ndar

d

Gui

delin

es- K

now

ledg

e of

ass

essm

ent t

echn

ique

s fo

r exa

min

ing,

qu

estio

ning

, eva

luat

ing,

and

repo

rting

- Und

ergr

adua

te d

egre

e or

min

imum

of t

en y

ears

of e

arne

d va

lue

man

agem

ent e

xper

ienc

e- F

orm

al c

ours

e of

inst

ruct

ion

(min

imum

of 4

0 ho

urs)

in th

e EV

M s

tand

ard

bein

g ap

plie

d

- PM

I Col

lege

of P

erfo

rman

ce M

anag

emen

t, P

rofe

ssio

nal

Edu

catio

nal P

rogr

am (e

ither

Cou

rse

Cer

tific

ate

or G

radu

ate

Cer

tific

ate)

Expe

rienc

e- M

inim

um o

f fiv

e (5

) yea

rs o

f EVM

exp

erie

nce

- Min

imum

of 2

yea

rs E

VM

impl

emen

tatio

n ex

perie

nce

- Tea

m m

embe

r of p

rior E

VM

val

idat

ion

revi

ewN

ot A

pplic

able

Cer

tific

atio

n- M

inim

um o

f 2 y

ears

on

earn

ed v

alue

man

agem

ent

impl

emen

tatio

n ex

perie

nce

- PM

I Pro

ject

Man

agem

ent P

rofe

ssio

nal (

PM

P®) o

r- P

MI C

ertif

ied

Asso

ciat

e in

Pro

ject

Man

agem

ent (

CA

PM

®)

- Rec

ogni

zed

Prog

ram

Man

agem

ent c

ertif

icat

ion,

pro

fess

iona

l or

gani

zatio

n, o

r com

pany

- Ear

ned

Val

ue P

rofe

ssio

nal c

ertif

icat

ion

(Ass

ocia

tion

for

Adv

ance

men

t of C

ost E

ngin

eerin

g)

Ethi

cal C

ondu

ct

STAT

EMEN

T O

F Q

UAL

IFIC

ATIO

NS

FOR

TEA

M M

EMB

ER O

F EV

M C

OM

PLIA

NC

E EV

ALU

ATIO

N R

EVIE

WS

For o

ther

than

sel

f-eva

luat

ions

con

duct

ed w

ith in

-hou

se re

sour

ces:

- The

team

mem

ber s

hall

not b

e cu

rrent

ly e

mpl

oyed

or h

ave

been

em

ploy

ed b

y th

e co

mpa

ny o

r gov

ernm

ent a

genc

y un

derg

oing

EV

M v

alid

atio

n du

ring

any

porti

on o

f the

pre

cedi

ng 1

8 m

onth

s- T

he te

am m

embe

r will

cer

tify

to p

recl

ude

empl

oym

ent o

r pro

vide

ser

vice

s to

the

com

pany

or g

over

nmen

t age

ncy

unde

rgoi

ng E

VM

val

idat

ion

for a

per

iod

of 1

8 m

onth

s- T

he te

am m

embe

r will

cer

tify

not t

o pa

rtici

pate

with

(eng

agem

ent o

r em

ploy

men

t) w

ith a

noth

er c

ompa

ny c

ompe

titiv

e ac

tivity

for a

per

iod

of 1

8 m

onth

s- T

he te

am m

embe

r will

cer

tify

to h

ave

not p

rovi

ded

cons

ultin

g or

trai

ning

ser

vice

s fo

r EVM

impl

emen

tatio

n or

val

idat

ion

purp

oses

dur

ing

the

prev

ious

24

mon

ths

- The

team

mem

ber w

ill c

ertif

y to

hav

e no

sig

nific

ant f

inan

cial

inte

rest

in th

e co

mpa

ny u

nder

goin

g E

VM

val

idat

ion,

def

ined

as

owne

rshi

p of

sto

cks,

mem

bers

hip

on th

e bo

ard

of d

irect

ors,

or

empl

oym

ent o

f an

imm

edia

te fa

mily

mem

ber b

y th

e co

mpa

ny.

This

sta

tem

ent o

f qua

lific

atio

ns w

as p

repa

red

by P

roje

ct M

anag

emen

t Ins

titut

e - C

olle

ge o

f Per

form

ance

Man

agem

ent,

and

is in

tend

ed to

ser

ve a

s a

guid

e on

ly.

This

sta

tem

ent d

oes

not

impl

y en

dors

emen

t by

Proj

ect M

anag

emen

t Ins

titut

e or

any

of i

ts c

ompo

nent

s. T

his

is in

tend

ed to

ser

ve a

s a

stan

dard

for v

olun

tary

com

plia

nce

by in

depe

nden

t cer

tifyi

ng c

ompa

nies

or

gove

rnm

ent a

genc

ies.

As

such

, Pro

ject

Man

agem

ent I

nstit

ute

and

its c

ompo

nent

s ar

e no

t lia

ble

for a

ny m

isap

plic

atio

n, m

isin

terp

reta

tion,

or a

ny le

gal a

ctio

n re

sulti

ng fr

om th

e ap

plic

atio

n of

this

vol

unta

ry s

tand

ard

from

any

affe

cted

par

ties.

Each

team

mem

ber h

as th

e re

spon

sibi

lity

to p

erfo

rm d

etai

led

eval

uatio

ns w

ithin

thei

r ass

igne

d ar

eas,

and

are

und

er th

e m

anag

emen

t con

trol o

f the

team

chi

ef.

Thes

e du

ties

incl

ude

revi

ewin

g an

y E

VM s

yste

m d

escr

iptio

ns, c

ondu

ctin

g in

terv

iew

s, c

ompl

etin

g da

ta tr

aces

, and

com

pilin

g do

cum

enta

tion.

Eac

h te

am m

embe

r sho

uld

keep

the

team

chi

ef

info

rmed

of t

he s

tatu

s of

thei

r are

a, a

nd a

ssis

t with

doc

umen

tatio

n an

d pr

epar

atio

n of

the

final

repo

rt. T

eam

mem

bers

, bas

ed o

n th

eir e

xper

ienc

e, m

ay b

e as

ked

to s

erve

as

a gr

oup

lead

er, p

lann

ing

and

dire

ctin

g th

e ac

tiviti

es o

f the

ir gr

oup.

NDIA PMSC



APPENDIX B EXAMPLE CER REPORT

NDIA PMSC



Executive summary: A brief summary of the review results and an overview of the CER process.

Introduction: A brief summary of the EVM system owner implementation of EVM. Topics include the following:

• EVM policies

• Program(s) using EVM

• Customer EVM requirements

• CER methodology

• CER team.

Purpose: A description of the purpose of the review and the purpose of the report.

Team formulation: A summary of how the CER team was formed and why it is qualified to conduct the CER. Team resumes should be included in this section.

Findings: This includes the key CER team findings of compliance, strengths, and improvement opportunities. This section should address (a) how the system description satisfies the intent of the guidelines; (b) the implementation of the system on the project(s),and (c) how the team verified the accuracy of the implementation on the project(s). Findings include actions that are required prior to obtaining certification of ANSI/EIA 748 compliance. The CAR reports and disposition should be included in the CER report. The findings section should include a list of open CARs and improvement opportunities (IO).

Conclusions:

The CER team overall assessment and recommendation of ANSI/EIA 748 compliance. This section also includes open actions.

Exhibits and appendixes: Documentation and examples used in support of both the findings and the conclusions.

NDIA PMSC



APPENDIX C PAR AND CER EXECUTION CONSIDERATIONS

NDIA PMSC



OVERVIEW PAR and CER reviews are structured to facilitate the exchange of information about the EVM system ANSI/EIA 748 Standard compliance expectations and the EVM System Owner implementation. These reviews are structured to identify compliance or non-compliance with the ANSI/EIA 748 Standard guidelines. Open and honest communication is facilitated by:

• Code of conduct demonstrating respect for the EVM System Owner team

• Out briefing and discussion of potential findings before a report is generated.

CODE OF CONDUCT CONSIDERATIONS The following suggestions are provided to encourage the PAR/CER team to conduct a respectful review:

• The program in-briefing or orientation is used to introduce the team members and gain an understanding of review expectations, agenda, schedule, and process;

• The review team lead provides advanced notification of the review agenda and request for documentation;

• Documentation reviews are conducted prior to arriving at the EVM System Owner facility in an effort to minimize the amount of time spent at the facility;

• The PAR/CER process and expectations are described, and the EVM System Owner has an opportunity to comprehend and respond;

• The review is conducted in a professional manner in a spirit of constructive assessment and discovery;

• If there are proprietary data issues of limited disclosure, the team may request assistance of outside independent auditors to verify indirect, accounting, and material systems.

The EVM System Owner can contribute to a well conducted review. Suggestions for the EVM Systems Owner include:

• Coordinate with the PAR/CER review team leader to ensure that program personnel required for the review are available;

• Ensure documentation and policies are available to the review team sufficiently in advance of the review to allow for meaningful analysis;

• Respond to Corrective Action Requests as quickly as possible;

• Provide explanations and illustrations in the context of demonstrating compliance with the ANSI/EIA 748 Standard;

• Provide information that is used by the EVM System Owner in the normal course of business and avoid providing exhibits created solely for the purpose of the PAR/CER review.

NDIA PMSC



OUT BRIEFING AND DISCUSSION CONSIDERATIONS During the PAR/CER review, issues, concerns, and findings will be discovered by the review team. During the period of review and leading to the final report and out briefing, clear communications and avoidance of miscommunication can contribute to a well conducted review. Suggestions for maintaining good communications and a meaningful out-briefing include the following:

• EVM System Owner personnel should seek clarification to fully understand questions and data requests;

• In order to avoid to avoid conflicting assessments, the PAR/CER team leader is solely responsible for the final disposition of findings and concerns;

• PAR/CER team should discuss issues and concerns prior to documenting a finding.

National Defense Industrial Association (NDIA) … 748 EVM System Acceptance...National Defense...

Documents

Transcript of National Defense Industrial Association (NDIA) … 748 EVM System Acceptance...National Defense...