Day 2 Instructors

1 of 36

Systematic Planning for Environmental Decision-Making

DOE EM-5/NAMP Day 2 DQO Training

DOE RICHLAND Real Property Release Interest GroupHAMMER Training and Education Center,

Al Alm Building, Room A5 2890 Horn Rapids Road

Richland, WA 99352Date: Tuesday, March 19, 2002

2 of 36

Day 2 InstructorsSebastian TindallBechtel Hanford Inc.

3350 George Washington Way

Richland, WA 99352

(509) [email protected]

James R. Davidson, Jr.Davidson and Davidson, Inc.

(DDI)

8390 Gage Blvd., Suite 205

Kennewick, WA 99336

(509) 374-4498

[email protected]

Mitzi MillerEnvironmental Quality

Management, Inc. (EQM)

1777 Terminal DriveRichland, WA 99352

(509) 946-4985

[email protected]

Al RobinsonEnvironmental Quality

Management, Inc. (EQM)

1777 Terminal Dr.

Richland, WA 99352

(509) 946-4985

[email protected]

3 of 36

Introduction, Objectives, and Agenda

Presenter: Sebastian Tindall

Day 2 DQO Training CourseModule 1

8:00 AM - 8:15 AM (30 minutes)

4 of 36

Make defensible decisions by managing uncertainty via systematic planning

NAMP/EM-5 DQO Mission:

Introduction

Institutionalize the standardized Data Quality Objectives (DQO) Process (systematic planning) throughout the Department of Energy (DOE) complex

5 of 36

NAMP/EM-5 Courses To accomplish the mission, two courses have been

developed: Day 1- Managing Uncertainty for Environmental

Decision Making – Overview of Systematic Planning with implementation

approaches and tools– Audience - anyone

Day 2- Systematic Planning for Environmental Decision Making – ‘How to’ Implement the process

– Audience - those who perform the DQO Process

6 of 36

Day 2 Course Objectives Learn

– “How to” for each activity in each of the 7 steps of the DQO Process

– Basic statistical concepts using hands-on examples and computer simulations

– How to manage uncertainty in the sampling and analysis design process

– New Environmental Protection Agency (EPA) “TRIAD” approach for implementation of sampling

7 of 36

The TRIAD ApproachThe TRIAD Approach

Systematic Planning

Dynamic Work Plans

Real-Time Measurement Technologies

8 of 36

Important “How To” Concepts

Scoping is the most important activity Poor scoping promotes distrust between

regulators and facility managers Using an independent facilitator who has

technical knowledge promotes agreement between different opinions

Interviews with decision makers promote consensus and resolution of global issues

9 of 36

Global issues are those that do not require data to resolve but are crucial for success

Important “How To” Concepts (cont.)

Global issues are those that include interpretation of regulations

Resolution of global issues ensures technical staff resolve disagreements between decision makers prior to developing sampling designs

Good decisions require defensible sampling and analysis designs

10 of 36

Statistical Concepts

Generate frequency distributions Transform numerical to graphical

probability functions Generate histograms Evaluate error consequences versus target

error rates Evaluate error rates, number of samples,

versus cost of analysis

11 of 36

How Many Samples do I Need?

REMEMBER:

HETEROGENEITY

IS THE RULE!

12 of 36

Remember

Population is the TOTAL universe of objects within the decision unit

THUS

The only way to make decisions without errors is to take a CENSUS

Can’t sample or “measure” the ENTIRE site Population must therefore be sampled

representatively

13 of 36

Uncertainty is additive!Analytical

+ Sub-sampling

+Natural heterogeneity of the site

=Total Uncertainty

14 of 36

Errors

15 of 36

16 of 36

Sampling heterogeneity decreases as sampling density

increases.

REMEMBER:

How Many Samples do I Need?

17 of 36

To Control Sampling Error

Control sub-sampling methods and sample mixing methods

Take larger sample volumes Reduce particle size Specify methods that fit the sample size

and particle size Increase sample density by performing

more on-site, rapid analyses

18 of 36

Deficiencies and Inconsistencies in Environmental Decision Making

Exist because an integrated decision-making process is not being used to make environmental decisions

Result from the lack of systematic planning Result from failure to manage uncertainty Result from lack of standard documentation Result in decisions that are not scientifically,

technically, or legally defensible Result in vulnerability to third-party challenges

19 of 36

The EPA 7-Step DQO Process

Step 1 - State the Problem

Presenters:Mitzi Miller and Al Robinson

8:15 AM - 9:30 AM (75 minutes)


20 of 36


Step 2 - Identify the Decisions


9:30 AM - 9:45 AM (15 minutes)


21 of 36


Step 3 - Identify Inputs

10:00 AM - 10:45 AM (45 minutes)

Presenters:

Mitzi Miller and Al Robinson


22 of 36


Step 4 - Specify Boundaries

10:45 AM - 11:45 AM (60 minutes)

Presenters:

Sebastian Tindall and Al Robinson


23 of 36


Step 5 - Define Decision Rules

11:45 AM - 12:00 PM (15 minutes)



24 of 36


Statistical Concepts and Demonstrations

Presenter: Jim Davidson

1:00 PM – 2:45 PM (105 minutes)


25 of 36


Step 6 - Specify Error Tolerances

3:00 PM - 3:30 PM (30 minutes)



26 of 36


Step 7 - Optimize Sample Design

3:30 PM - 4:45 PM (75 minutes)

Presenters:

Mitzi Miller and Al Robinson


27 of 36

Closing Remarks


4:45 PM - 5:00 PM (15 minutes)


28 of 36

Appendix AEvolution of the DQO Concept

Objectives:– To illustrate how the DQO Process has matured over

time from a qualitative concept to practical implementation

– To reinforce DOE’s requirement for integrating the DQO Process into all environmental sampling activities

– To dispel the misconception that DQOs are the PARCC parameters

29 of 36

Appendix BU.S. EPA Inspector General Audit Reports Objectives:

– To highlight important findings from the EPA Inspector General Audit Reports

– To underscore the fact that EPA itself has not been implementing the DQO Process properly

– To present EPA’s new commitment to a systematic planning process for environmental decision-making

30 of 36

Appendix C: – Thomas Grumbly DOE DQO directive,

September 1994

Appendix D:

– Timothy Fields EPA OSWER directive,June 1999

Appendix E:

– Expedited Site Characterization Field Quality Assurance Meeting minutes,January 1994

31 of 36

Appendix F: Effective Data– Deana Crumbling, U.S. EPA-HQ

• ES&T: Managing Uncertainty…

• White Paper: Triad Approach…

• White Paper: Applying Effective Data...

• White Paper: Relationship: SW-846, PBMS... • White Paper: Clarifying DQO Terminology…

– Dr. Bart Simmons, CAL/EPA DTSC• Using Field Methods: Court decisions

– Dr. Al Robbat, Tufts University• Dynamic Work Plans & Field Analytics

– Sebastian Tindall, BHI

• ESC M-Cubed Approach

• Culture Change Flow Chart

32 of 36

Appendix G: – List of Acronyms and Symbols used in course

materials

Appendix H:

– U.S. EPA ORDER 5360.1 A2 CHG 2 May 5, 2000

33 of 36

We want to help you:

Do it!Do it!(Get the job done - right)

Prove it!Prove it!(Document what/why/how)

CertifiedCertified

34 of 36

Final Exam Preview

• Old answer - A painful elaboration of the obvious

• Hint: Answer has 3 items

What is the DQO Process in a Nutshell?

35 of 36

Evaluation Form

36 of 36

End of Module 1

Thank you

Day 2 Instructors

Documents

Transcript of Day 2 Instructors