Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for...
Transcript of Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for...
![Page 1: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/1.jpg)
Guidance for the Application of Quality Assurance and Quality
Control Principles to Ecological Restoration Project
Monitoring
Louis Blume1, Craig Palmer2, Lynn Walters2, Joan Cuddeback2,
Brick Fevold2, Molly Middlebrook Amos2,Timothy Lewis3, Martin Stapanian4
1US EPA, Great Lakes National Program Office, Chicago, IL,
2GDIT, Alexandria, VA3US Army Corps of Engineers, Vicksburg, MS
4US Geological Survey, Sandusky, OH
National Conference on Ecosystem Restoration 2018New Orleans, LAAugust 28, 2018
Disclaimer: The views expressed in this presentation are those ofthe author(s) and do not necessarily represent the views or policiesof the U.S. Environmental Protection Agency.
![Page 2: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/2.jpg)
2
• Initiated in 2010 • 16 federal agencies• $2.86 billion FY 2010-2018• Five focus areas
1. Toxic Substances and Areas of Concern
2. Invasive Species3. Nonpoint Source Pollution
Impacts on Nearshore Health4. Habitats and Species5. Foundations for Future
Restoration Actions
Great Lakes Restoration Initiative
![Page 3: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/3.jpg)
3
Quality Management Requirements
• National standards for environmental data collection require quality assurance planning and documentation (e.g., ANSI/ASQ E4-2014)
• EPA adopted these standards for projects with environmental data collection activities that they undertake or fund
![Page 4: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/4.jpg)
4
• Inherently difficult to control
• Minimal guidance exists
Quality of Ecological Data
Matt Cooper
![Page 5: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/5.jpg)
5
Interagency Ecological Restoration Quality Committee (IERQC)
• Initiated: June 2012• Purpose: Share quality concepts, practices, guidance,
methods, and tools to improve projects funded by the GLRI
USEPA
Con-tractor
Support
![Page 6: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/6.jpg)
6
Trainings
SER Partnership
MonthlyWebinars
JournalArticles
GuidanceDocument
Committee Accomplishments
![Page 7: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/7.jpg)
7
Committee Guidance Document
“Application of Quality Assurance and Quality Control Principles to Ecological Restoration Projects”
Overall GoalImprove data quality for
ecological data collection efforts, especially
observer-determined data
![Page 8: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/8.jpg)
8
Introduction
Fundamental Principles Concerning Quality Assurance/Quality Control
Planning for Data Collection
Preparing for Data Collection
1
2
3
4
Chapters
![Page 9: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/9.jpg)
9
Quality Control During Field Activities
Data Review
Data Assessment, Analysis and Reporting
The Relationship between Quality Management and Adaptive
Management Strategies
5
6
7
8
Chapters (cont’d)
![Page 10: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/10.jpg)
10
Plan
Prepare
CollectReview
Evaluate
• Project Goals & Objectives• Data Quality Indicators• Acceptance Criteria
• SOPs• Training & Certification
• Data Verification• Data Validation
• Data Assessment & Usability• Corrective Actions
• Quality Control Checks and Samples
PrepareChapter 4
CollectChapter 5
ReviewChapter 6
EvaluateChapter 7
PlanChapter 3
Project Lifecycle with Key QA Components
![Page 11: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/11.jpg)
11
Plan
Prepare
CollectReview
Evaluate
“We cannot overemphasize the importance of expressing each and every project goal with a succinct and carefully crafted statement.”
Guidelines for Developing and Managing Ecological Restoration Projects by the Society for Ecological Restoration
ProjectGoals
Project Objectives
Sampling Objectives
Data Quality Criteria
Planning for Data Collection
![Page 12: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/12.jpg)
12
• Recognize how data quality is evaluated– Data quality indicators– Acceptance criteria for precision, bias, and accuracy
• Error tolerance with expected frequency or rate of compliance
Plan
Prepare
CollectReview
Evaluate
Matt Cooper
Planning for Data Collection (con’t)
![Page 13: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/13.jpg)
13
• Standard operating procedures (SOPs)• Classroom and field training• Certification of crew members• Field permits and other logistics
Plan
Prepare
CollectReview
Evaluate
Jason Morrison
Preparing for Data Collection
![Page 14: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/14.jpg)
14
• Real-time assessments of:– Crew’s ability to perform procedures and effectiveness of procedures– Data quality
• Assessments through:– Checks of data before leaving the field– QC field checks: hot, cold, blind, precision, calibration– Routine plots or reference plots/points
Plan
Prepare
CollectReview
Evaluate
Emily Clegg TNC
Quality Control During Field Activities
![Page 15: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/15.jpg)
15
• Data verification• Data validation• Data certification
Plan
Prepare
CollectReview
Evaluate
USEPA
Matt Cooper
Julia Bohnen
Data Review
![Page 16: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/16.jpg)
16
• Assess impacts of data quality on use of the data• Analyze and interpret data• Take corrective action to support
• Continuous improvement• Decision making within an adaptive management
Plan
Prepare
CollectReview
Evaluate
www.npca.org
Data Assessment, Analysis and Reporting
NYSDEC
![Page 17: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/17.jpg)
17
Data ManagementBest Practices
Assessment of DataQuality Indicators
Quality Assurance Project Plan Template for Ecological Restoration
Projects
Quality Assurance Project Plan Review Checklist for Ecological
Restoration ProjectsD
C
B
A
Appendices
![Page 18: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/18.jpg)
18
• Review took place in Fall 2017 – 10 formal charge questions
– 19 reviewers from federal/state agencies, consultants, and universities (US and Canada)
– Over 300 comments provided
• Addressed comments in Winter 2018
Technical Review
![Page 19: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/19.jpg)
19
• Conduct final EPA review• Assign a document number• Publish and distribute to the restoration
community
Next Steps
![Page 20: Guidance for the Application of Louis Blume 1, Craig Palmer2 … · 2018. 9. 21. · Guidance for the Application of Quality Assurance and Quality Control Principles to Ecological](https://reader033.fdocuments.us/reader033/viewer/2022060915/60a8d715a570106e534bd26e/html5/thumbnails/20.jpg)
20
Please send all comments and questions to:
Louis Blume, US EPA GLNPO Quality Manager (312) 353-2317 | [email protected]
Thank You!