Advocating and AchievingRegional Monitoring Collaborations

Advocating and AchievingRegional Monitoring Collaborations

Robert Brown

Natasha Dickrell

Dr. David Karlen

Keith Kibbey

Robert Brown

Natasha Dickrell

Dr. David Karlen

Keith Kibbey

NWQMC Conference 2016Examples from the Success of the Southwest Florida

Regional Ambient Monitoring Program(SWF RAMP)

What’s a Regional Monitoring Program?What’s a Regional Monitoring Program?

Definition of“Together” versusThe 3 C’s

SWF Examples

SeagrassMonitoring

Bay BenthicMonitoring

Florida SeaGrant Initiatives

BathymetricLake Maps

Definition of“Together” versusThe 3 C’s

SWF Examples

SeagrassMonitoring

Bay BenthicMonitoring

Florida SeaGrant Initiatives

BathymetricLake Maps

To foster cooperativeparticipation of regional

monitoring program staffs toimprove comparability of

surface water samplecollection, in situ fieldmeasurements, and

laboratory methods used bysurface water quality

monitoring programs inSouthwest Florida marine and

freshwater systems.

To foster cooperativeparticipation of regional

monitoring program staffs toimprove comparability of

surface water samplecollection, in situ fieldmeasurements, and

laboratory methods used bysurface water quality

monitoring programs inSouthwest Florida marine and

freshwater systems.

SWF-RAMP Mission Introduction

Facilitate Communication &Information Sharing

Promote Partnerships

Focus on Data Comparability

Facilitate Communication &Information Sharing

Promote Partnerships

Focus on Data Comparability

Dedicated to Collaboration

Three Generations of RAMP LeadershipThree Generations of RAMP Leadership

“The beauty of collaborationbetween [mentor and neophyte]generations is that we combine

strength with wisdom—a surefireway to accomplish more ...”

― Brett Harris

Presented by:

Rob Brown

Manatee County

Presented by:

Rob Brown

Manatee County

SWF-RAMPHISTORY &

IMPACTin the

Southwest FloridaRegion

20+ Years of SWF-RAMP History20+ Years of SWF-RAMP History

Formation andGenesis

Early Goals &Objectives

RAMP Impact onthe Status ofTampa Bay

Tampa Bay in the1970s-Early 1980sTampa Bay in the1970s-Early 1980s

Poorly-treated Domestic PointSources, Untreated IndustrialPoint Sources & Stormwater,Rampant Dredge & Fill Activities

Phytoplankton and Periphytondominated basins

50% loss of seagrass coveragebetween 1950 and 1980

Newspapers declared TampaBay “dead”

Poorly-treated Domestic PointSources, Untreated IndustrialPoint Sources & Stormwater,Rampant Dredge & Fill Activities

Phytoplankton and Periphytondominated basins

50% loss of seagrass coveragebetween 1950 and 1980

Newspapers declared TampaBay “dead”

Introduction of theTampa Bay Estuary Program

Introduction of theTampa Bay Estuary Program

9

• 1980s-1990s regionalefforts provided minimalBay improvements

• 1990 - Tampa Baydeclared an “Estuary ofNational Significance” byCongress

• 1991 - Unique federal-local partnership begins

• Enhanced Bay recoveryefforts ensue

TBNEP Monitoring Assessment:Available Data Sources in 1990’s

TBNEP Monitoring Assessment:Available Data Sources in 1990’s

Regulatorycompliance data

Local programambient or sitespecific

Short-term specialstudies

Pre-developmentbaseline

Regulatorycompliance data

Local programambient or sitespecific

Short-term specialstudies

Pre-developmentbaseline

TBNEP Assessment:Regional Monitoring GoalsTBNEP Assessment:Regional Monitoring Goals

Early Goals and Objectives

Establish baseline conditions

Monitoring chemical andbiological parameters

Data to establish and verify models

Measure effectiveness ofmanagement actions

Estimate long-term trends

Early Goals and Objectives

Establish baseline conditions

Monitoring chemical andbiological parameters

Data to establish and verify models

Measure effectiveness ofmanagement actions

Estimate long-term trends

to Measure the Effectivenessof Management Actions andPrograms Implemented Underthe CCMP and

to Provide Information thatcan be used to Redirect andRefocus the ManagementPlan over time.

to Measure the Effectivenessof Management Actions andPrograms Implemented Underthe CCMP and

to Provide Information thatcan be used to Redirect andRefocus the ManagementPlan over time.

Long-term Benefits

Tampa Bay Regional Objectives:Nitrogen Management StrategyTampa Bay Regional Objectives:Nitrogen Management Strategy

ReduceNitrogen

Loads

ReduceChlorophyll

IncreaseSeagrass

Cover

IncreaseWaterClarity

TBNEP Monitoring Action:Genesis of RAMP

TBNEP Monitoring Action:Genesis of RAMP

1994 - First Southwest

Florida RAMP meeting

Discussion of state andlocal monitoringprograms

Who, what, when, why!

Initial RAMP intercalibration

core parameter

evaluate field/labmethods

1994 - First Southwest

Florida RAMP meeting

Discussion of state andlocal monitoringprograms

Who, what, when, why!

Initial RAMP intercalibration

core parameter

evaluate field/labmethods

Regional Collaboration:SWF -RAMP Objectives

Regional Collaboration:SWF -RAMP Objectives

1. Establish Core Parameters (Analytes)

2. Standardize Monitoring Activities

3. Evaluate/Standardize Methodologies

4. Minimize Duplication and Economize

1. Establish Core Parameters (Analytes)

2. Standardize Monitoring Activities

3. Evaluate/Standardize Methodologies

4. Minimize Duplication and Economize

Regional Collaboration:Adopted Water Quality TargetsRegional Collaboration:Adopted Water Quality Targets

TBEP Management TargetsEstablished ~2000

RegulatoryThreshold

Adopted 2002

Bay Segment Chl-aManagementTarget (ug/L)

Kd (m-1)Management

Target

Chl-aRegulatoryThreshold

(ug/L)

Old Tampa Bay 8.5 0.83 9.3

Hillsborough Bay 13.2 1.58 15.0

Middle Tampa Bay 7.4 0.83 8.5

Lower Tampa Bay 4.6 0.63 5.1

Annual WQ Report Card AssessAnnualTN Load

ReductionEffectiveness

Agreement to “Hold the Line” on TN Loads:Preclude 17 tons/yr to offset future growth

Improving Water Quality:Improving Water Quality:

StormwaterRegulations

Enacted

TBEP Partner &NMC ActionsImplemented

Citizen Actions

Power PlantUpgrades

Port FacilityUpgrades

AWT & ReuseStandards

Implemented

Ch

loro

ph

yll

–a

(ug

/L)

Seagrass Coverage:Now Exceeding GoalSeagrass Coverage:Now Exceeding Goal

IncreaseSeagrass

Cover

SustainingSuccess:AdaptivelyManaging TB

SustainingSuccess:AdaptivelyManaging TB

•Can recovery bemaintained w/increasingpopulation?

•Expected todouble by 2050

•New Actions /Offsets will callfor SWF-RAMP &RegionalCoordination

Year1940 1950 1960 1970 1980 1990 2000 2010

Po

pu

lati

on

(milli

on

s)

0.0

0.5

1.0

1.5

2.0

2.5

3.0

Ta

mp

aB

ay

An

nu

alA

vera

ge

Ch

loro

ph

yll-a

(ug

/L)

4

6

8

10

12

14

16

18

20

Hillsborough CountyPinellas CountyManatee CountyTampa Bay Chlorophyll-a

Split SamplingandData

Comparability

Split SamplingandData

Comparability

Presented by:

Dr. David Karlen

Environmental ProtectionCommission of Hillsborough County

Presented by:

Dr. David Karlen

Environmental ProtectionCommission of Hillsborough County

PurposePurpose

Check comparability oflab and field method andequipment results

Validation of the data toensure the science issound and data isdefensible

Discuss procedures ifresults are different

Provide feedback

Check comparability oflab and field method andequipment results

Validation of the data toensure the science issound and data isdefensible

Discuss procedures ifresults are different

Provide feedback

MethodMethod

Collect common source ofwater

40 gallon trash can w/circulation pump

Alternate marine andfreshwater sources

Individual labs fill samplebottles from homogenizedsource water

Collect common source ofwater

40 gallon trash can w/circulation pump

Alternate marine andfreshwater sources

Individual labs fill samplebottles from homogenizedsource water

Samples analyzed intriplicate for internalcomparison

Identify 2x SD as apotential outlier

Averages are used tocalculate regionaldeviation and mean forcomparison

Raw data submittedby labs

Field Equipment:Semi-AnnualComparison

Field Equipment:Semi-AnnualComparison

Comparison conductedsimultaneously using splitsample water.

Ability to compare brandsand models as desired.

Outlet for industryadvancements to bepresented and discussed.

Comparison conductedsimultaneously using splitsample water.

Ability to compare brandsand models as desired.

Outlet for industryadvancements to bepresented and discussed.

Quarterly Study:Averaged data

comparison

Quarterly Study:Averaged data

comparison

Ability to depictcomparability amongdifferent methods (e.g. bothturbidity methods result incomparable outcomes)

Ability to justify analysischoices – based onregulatory, legislative, orresource managementobligations (e.g. cost savingmethods, client requests,compliance measures)

Ability to depictcomparability amongdifferent methods (e.g. bothturbidity methods result incomparable outcomes)

Ability to justify analysischoices – based onregulatory, legislative, orresource managementobligations (e.g. cost savingmethods, client requests,compliance measures)

RAMP 67April 2013

Alafia River (Estuarine)

Lab Id

1701 201 901 702 1001 1301 1501 1504 2201 1901 2004 1201 101 1

Tu

rbid

ity(N

TU

)

0

2

4

6

8

SM 2130BEPA 180.1

Long-termData

Comparability:Chlorophyll

Long-termData

Comparability:Chlorophyll

Chlorophyll was the primaryanalyte to launch SWF-RAMP activities

Chlorophyll was the primaryanalyte to launch SWF-RAMP activities

SW Florida RAMPStudies 66 -77

RAMP Study

65 66 67 68 69 70 71 72 73 74 75 76 77 78

Ch

loro

phyl

la(c

orr

ect

ed

)S

tan

da

rdS

core

-3

-2

-1

0

1

2

3

DataComparability:

Standard Scores

DataComparability:

Standard Scores

Lab Mean − Overall Mean

Overall Standard Deviation

Z >1 or <-1 exceed ±1 SD

Z>2 or <-2 exceed ±2 SD

Lab Mean − Overall Mean

Overall Standard Deviation

Z >1 or <-1 exceed ±1 SD

Z>2 or <-2 exceed ±2 SD

SW Florida RAMPStudies 66 -77

Lab Id

B F G H I K P Q R W AA AC AD AE AF AG AH AI

Ch

loro

phyl

la(c

orr

ect

ed

)S

tan

da

rdS

core

-2

-1

0

1

2

Z=

BenefitsBenefits

Collaboration and “CrowdSourcing” improves theprocess for all

Option for proactive“audits” (either field or labamong participants)

SWF-RAMP provides adedicated monitoringaudience

Valuable feedbackprovided by a variety ofparticipants on technicaland regional monitoringoptions

Collaboration and “CrowdSourcing” improves theprocess for all

Option for proactive“audits” (either field or labamong participants)

SWF-RAMP provides adedicated monitoringaudience

Valuable feedbackprovided by a variety ofparticipants on technicaland regional monitoringoptions

LaboratoryBenefits

fromSWF-RAMP

Participation

LaboratoryBenefits

fromSWF-RAMP

Participation

Presented by:Keith KibbeyLee County

Benefits to RAMP ParticipationBenefits to RAMP Participation

Justify:

Regulatory Compliance

Quality System

Management Strategy

Justify:

Regulatory Compliance

Quality System

Management Strategy

Regulatory Justification TNIRegulatory Justification TNI

Review of Requests,Tenders and Contracts

Management Reviews

Quality Assurance forEnvironmental Testing

Review of Requests,Tenders and Contracts

Management Reviews

Quality Assurance forEnvironmental Testing

RegulatoryJustification:NELAC

RegulatoryJustification:NELAC

Laboratory uses data frommeetings to comply with NELACStandard 5.5.6.2.2 for chlorophyllanalysis.

Laboratory uses data frommeetings to comply with NELACStandard 5.5.6.2.2 for chlorophyllanalysis.

“Where traceability tonational standards ofmeasurement is notapplicable, thelaboratory shall providesatisfactory evidenceof correlation of results,for example byparticipation in asuitable program ofinter-laboratorycomparisons,proficiency testing, orindependent analysis.”

“Where traceability tonational standards ofmeasurement is notapplicable, thelaboratory shall providesatisfactory evidenceof correlation of results,for example byparticipation in asuitable program ofinter-laboratorycomparisons,proficiency testing, orindependent analysis.”

RegulatoryJustification:TNI

RegulatoryJustification:TNI

Review of Requests, Tenders and Contracts(ISO/IEC 17025:2005(E), Clause 4.4)

4.4.1 The laboratory shall establish and maintainprocedures for the review of requests, tendersand contracts. The policies and procedures forthese reviews leading to a contract for testingand/or calibration shall ensure that:

Review of Requests, Tenders and Contracts(ISO/IEC 17025:2005(E), Clause 4.4)

4.4.1 The laboratory shall establish and maintainprocedures for the review of requests, tendersand contracts. The policies and procedures forthese reviews leading to a contract for testingand/or calibration shall ensure that:

NOTE 2: The review of capabilityshould establish that thelaboratory possesses thenecessary physical, personneland information resources, andthat the laboratory's personnelhave the skills and expertisenecessary for the performance ofthe tests and/or calibrations inquestion.

The review may also encompassresults of earlier participation ininter-laboratory comparisons orproficiency testing and/or therunning of trial test or calibrationprogrammes using samples oritems of known value in order todetermine uncertainties ofmeasurement, limits of detection,confidence limits, etc.

NOTE 2: The review of capabilityshould establish that thelaboratory possesses thenecessary physical, personneland information resources, andthat the laboratory's personnelhave the skills and expertisenecessary for the performance ofthe tests and/or calibrations inquestion.

The review may also encompassresults of earlier participation ininter-laboratory comparisons orproficiency testing and/or therunning of trial test or calibrationprogrammes using samples oritems of known value in order todetermine uncertainties ofmeasurement, limits of detection,confidence limits, etc.

RegulatoryJustification:TNI

RegulatoryJustification:TNI

4.15 Management Reviews (ISO/IEC17025:2005(E), Clause 4.15)

4.15.1 In accordance with a predeterminedschedule and procedure, the laboratory's topmanagement shall periodically conduct areview of the laboratory's managementsystem and testing and/or calibrationactivities to ensure their continuing suitabilityand effectiveness, and to introducenecessary changes or improvements.

4.15 Management Reviews (ISO/IEC17025:2005(E), Clause 4.15)

4.15.1 In accordance with a predeterminedschedule and procedure, the laboratory's topmanagement shall periodically conduct areview of the laboratory's managementsystem and testing and/or calibrationactivities to ensure their continuing suitabilityand effectiveness, and to introducenecessary changes or improvements.

The review shall take accountof:

the suitability ofpolicies andprocedures;

reports frommanagerial andsupervisory personnel;

the outcome ofrecent internal audits;

corrective andpreventive actions;

assessments byexternal bodies;

the results ofinterlaboratorycomparisons orproficiency tests;

The review shall take accountof:

the suitability ofpolicies andprocedures;

reports frommanagerial andsupervisory personnel;

the outcome ofrecent internal audits;

corrective andpreventive actions;

assessments byexternal bodies;

the results ofinterlaboratorycomparisons orproficiency tests;

RegulatoryJustification:TNI

RegulatoryJustification:TNI

5.9 Quality Assurance for EnvironmentalTesting (ISO/IEC 17025:2005(E), Clause 5.9)

5.9.1 The laboratory shall have quality controlprocedures for monitoring the validity of testsand calibrations undertaken. The resultingdata shall be recorded in such a way thattrends are detectable and, wherepracticable, statistical techniques shall beapplied to the reviewing of the results.

5.9 Quality Assurance for EnvironmentalTesting (ISO/IEC 17025:2005(E), Clause 5.9)

5.9.1 The laboratory shall have quality controlprocedures for monitoring the validity of testsand calibrations undertaken. The resultingdata shall be recorded in such a way thattrends are detectable and, wherepracticable, statistical techniques shall beapplied to the reviewing of the results.

This monitoring shall be plannedand reviewed and may include,but not be limited to, thefollowing:

regular use of certifiedreference materials and/orinternal quality controlusing secondary referencematerials;

participation in inter-laboratory comparison orproficiency-testingprogrammes;

replicate tests orcalibrations using the sameor different methods;

retesting or recalibration ofretained items;

correlation of results fordifferent characteristics ofan item.

NOTE: The selected methodsshould be appropriate for thetype and volume of the workundertaken.

This monitoring shall be plannedand reviewed and may include,but not be limited to, thefollowing:

regular use of certifiedreference materials and/orinternal quality controlusing secondary referencematerials;

participation in inter-laboratory comparison orproficiency-testingprogrammes;

replicate tests orcalibrations using the sameor different methods;

retesting or recalibration ofretained items;

correlation of results fordifferent characteristics ofan item.

NOTE: The selected methodsshould be appropriate for thetype and volume of the workundertaken.

Quality System JustificationQuality System Justification

Audits are mostly a paperand procedural look at alaboratory, RAMP isoutcome based.

Makes data moredefensible.

Voice and clout when wespeak as a group.

Real sample matrix.

The TNI ISO 17025laboratory standard isbuilt upon a philosophy ofContinuous improvement.

Audits are mostly a paperand procedural look at alaboratory, RAMP isoutcome based.

Makes data moredefensible.

Voice and clout when wespeak as a group.

Real sample matrix.

The TNI ISO 17025laboratory standard isbuilt upon a philosophy ofContinuous improvement.

Quality SystemJustificationQuality SystemJustification

Florida EnvironmentalLaboratory Quality System(FELQS)

Florida EnvironmentalLaboratory Quality System(FELQS)

A network ofenvironmental testinglaboratories throughoutsouthern Florida.

Private labs, county &city labs, utilities labsand watermanagement districtlabs meet quarterly.

All, or most, areNELAC/TNI certified andtherefore sharecommon concerns withregard to meeting themandates of theNELAC/TNI Standard.

Several members participateon TNI Expert Committees

A network ofenvironmental testinglaboratories throughoutsouthern Florida.

Private labs, county &city labs, utilities labsand watermanagement districtlabs meet quarterly.

All, or most, areNELAC/TNI certified andtherefore sharecommon concerns withregard to meeting themandates of theNELAC/TNI Standard.

Several members participateon TNI Expert Committees

Management JustificationsManagement Justifications

Watersheds do not always follow geopolitical boundaries.

Funds saved by ideas from the group

Equipment selection

Process changes

Makes data more defensible.

Private labs joined due to contractual requirements, then learnedto use a as bragging rights and a sales tool.

Voice and clout when we speak as a group.

The more people or agencies using you data make it morevaluable. Valuable programs are less likely to be reduced oreliminated.

Provides a model for other collaborative efforts

Watersheds do not always follow geopolitical boundaries.

Funds saved by ideas from the group

Equipment selection

Process changes

Makes data more defensible.

Private labs joined due to contractual requirements, then learnedto use a as bragging rights and a sales tool.

Voice and clout when we speak as a group.

The more people or agencies using you data make it morevaluable. Valuable programs are less likely to be reduced oreliminated.

Provides a model for other collaborative efforts

Cost to LaboratoryCost to Laboratory

Staff time to attend

4 to 8 days/year

Lab time to processsamples

Return on investment

Credibility

Better Data

Collaborative groupfor other efforts

Priceless

Staff time to attend

4 to 8 days/year

Lab time to processsamples

Return on investment

Credibility

Better Data

Collaborative groupfor other efforts

Priceless

Advocating& Achievinga RegionalProgram

Advocating& Achievinga RegionalProgram

Presented by:

Natasha Dickrell

Pinellas County

Presented by:

Natasha Dickrell

Pinellas County

Why is voluntary collaborationfor monitoring so attractive?

Why is voluntary collaborationfor monitoring so attractive?

“If you don’t know whereyou’re going, you’llprobably end up

somewhere else and spenda lot of money getting

there.”

Why does SWF-RAMPwork?

KnowledgeFrameworkKnowledgeFramework

Saliency

Credibility

Legitimacy

Saliency

Credibility

Legitimacy

Enduring FrameworkEnduring Framework

SALIENCY: SWF-RAMP answers questions by proactively identifing regional data

comparability objectives and considering regional management impacts.

CREDIBILITY: SWF-RAMP succeeds through information sharing in a suggestive forum that

addresses issues and recommends solutions to build trust and promote partnerships.

LEGITIMACY: SWF-RAMP supports the efforts and quality of every program.

Investigating data comparability is highly recommended for monitoring programs which havelocal, State, or Federal management, assessment, and/or regulatory obligations.

SALIENCY: SWF-RAMP answers questions by proactively identifing regional data

comparability objectives and considering regional management impacts.

CREDIBILITY: SWF-RAMP succeeds through information sharing in a suggestive forum that

addresses issues and recommends solutions to build trust and promote partnerships.

LEGITIMACY: SWF-RAMP supports the efforts and quality of every program.

Investigating data comparability is highly recommended for monitoring programs which havelocal, State, or Federal management, assessment, and/or regulatory obligations.

SWF- RAMP relies on participation and achieves continued successbecause data acquired through monitoring supports the decision-

making framework for Federal, State, and local regions.

Saliency: Answering QuestionsSaliency: Answering Questions

1. Evolved from answeringquestions to askingquestions!

2. Expanded regionalinvolvement (upon request)to include freshwater andgroundwater systems.

3. Science, legislation,technology, and funding allchange and the programevolves based on thecurrent decision-making.

1. Evolved from answeringquestions to askingquestions!

2. Expanded regionalinvolvement (upon request)to include freshwater andgroundwater systems.

3. Science, legislation,technology, and funding allchange and the programevolves based on thecurrent decision-making.

Incomparable results mayprovide more questions thananswers…but

“…leads to the best science!”Judy Ott

Charlotte Harbor NEP

The program answers questionsthrough discussion and

assessment using split sampleresults to support credibility.

Saliency Challenges: Data ComparabilitySaliency Challenges: Data Comparability

1. Individual definition for what is good for business.

2. Work to overcome apprehension about puttingprocedures and process under scrutiny.

“Over time you see the needfor anonymity dissolvebecause the benefits ofimproved comparability arepowerful.”

-Matt JablonskiSWF-RAMP Co-chair (SWFWMD)

Credible Practice: Eliminating UncertaintyCredible Practice: Eliminating Uncertainty

SWF-RAMP maintains asuggestive environment.

Individual programs continueto determine their ownpractices based on currentstandards and guidelines.

Program is primarily a tool forinternal management purposes.

Credible Sources: Ensuring TrustCredible Sources: Ensuring Trust

“You’re not alone.”-Kerry Harkinson

Manatee CountyRepresentative

Supports the call forregional participationin State and Federal

decision-making.

“We can handle thisregionally.”

Contrary, if a regioncan’t coordinate avoluntary program

then mandates will beseen as the necessity!

“Street” Credibility: Building Trust“Street” Credibility: Building Trust

How does your organization,firm, or company’s vision align?

Legitimate Participants & EntitiesLegitimate Participants & Entities

Do your results comparein your region?

“…but we pass our audits!”

“We follow the method andSOPs and we are right!”

“If our data is a potentialoutlier how is that going to

look?”

Existing Legitimacy: ChallengesExisting Legitimacy: Challenges

Does your work benefityour monitoring region?

Overcoming Challenges

Determining Consensus

Implementing Solutions

Justifying Actions

Expanded LegitimacyExpanded Legitimacy

INSPIRE Activities(by overcoming challenges)

SUPPORT Initiatives(by determining consensus)

DEVELOP Solutions(through communicating concerns)

SHARE Success

(to justify actions)

Legitimate Activities

Regionally, we have benefited bymeeting increasing programrequirements with voluntary

collaboration and coordination!

Specific Examples Include:

Regulatory Compliance (NPDES)

Equipment & Method Selection

Academic Partnerships

Regionally, we have benefited bymeeting increasing programrequirements with voluntary

collaboration and coordination!

Specific Examples Include:

Regulatory Compliance (NPDES)

Equipment & Method Selection

Academic Partnerships

Legitimate Long-term Benefits

SWF-RAMP Proceedings and Consensus

http://www.tbeptech.org/

under Technical Committees thenSW FL Regional Ambient Monitoring

Program

“Legit” Activities