Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and...
Transcript of Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and...
![Page 1: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/1.jpg)
Water Board Open Data Initiative
Greg GearheartDeputy Director, Information Management and Analysis
March 18, 2016
![Page 2: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/2.jpg)
![Page 3: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/3.jpg)
#CAWaterDataDive Team Acknowledgement• Jarma Bennett - [email protected]
• David Altare - [email protected]
• Erick Burres - [email protected]
• Charlow Arzadon – [email protected]
GovOps! – Stuart Drown, Angie Quirarte, John Cornelison, Scott Gregory et al.
![Page 4: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/4.jpg)
SWAMP● Statewide
Monitoring● Regional Projects● Data Outreach
and Inreach
![Page 5: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/5.jpg)
Open Data Culture
![Page 6: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/6.jpg)
SWAMP Unit
Lori Webber (Sr ES)
Surface Water Ambient Monitoring Program -Overall Program Management and Support
SWAMP IQ Unit
Melissa Morris (Sr ES)
Quality Assurance and Quality Management Support for SWAMP and the CA Env Data Exchange Network (CEDEN)
Data Integration
Jarma Bennett (Sr Eng)
Data integration and analysis, CEDEN and CIWQS Project Management, “Open Data” Initiative
Office of Information Management and Analysis (OIMA)
![Page 7: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/7.jpg)
Additional OIMA Staff/Services/FunctionsSWAMP Senior Scientist - Dawit Tadesse, Staff Scientist
QA Officer - Renee Spears, Staff Scientist
Citizen Monitoring - Erick Burres, Staff Scientist
Water Quality Monitoring Council - Jon Marshack, Executive Director
![Page 8: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/8.jpg)
Open Data
“Open data is data that can be freely used, re-used and redistributed by anyone -subject only, at most, to the requirement to attribute and sharealike.”
Technically open: [data] available in a machine-readable standard format, which means it can be retrieved and meaningfully processed by a computer application.
Legally open: [data] explicitly licensed in a way that permits commercial and non-commercial use and re-use without restrictions.
http://www.govtech.com/data/Got-Data-Make-it-Open-Data-with-These-Tips.html
![Page 9: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/9.jpg)
Water Boards Open Data InitiativePhase 1
1. URL wrangling and the creation of an open data “corral” or single entry point for all Water Board data
2. Pilot use of open data platform with small set of datasets
Phase 2
URL wrangling and the creation of a the Open Data Corral
![Page 10: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/10.jpg)
“Water Data Integration” OpportunitiesOIMA Water Board Events
March 18 - Data Fair
April 2-22 - Data Innovation Challenge
June 29 - Water Quality Science Symposium
OIMA Brown Bag Series
Water Data Integration Topics in OIMA
Science Topics
Biointegrity
Pesticides/toxicity
Bioaccumulation
CECs
Climate
![Page 11: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/11.jpg)
Case Study Storm Water Program Resources “Performance Report” for FY2012/13
![Page 12: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/12.jpg)
$0.24
$1.03
$0.35
$1.91
$1.52
$0.26 $0.21
$1.30
$0.73
$0.39
$1.19
$0.48
$1.52
$1.09
$0.22 $0.10
$1.34
$1.11
$-
$0.50
$1.00
$1.50
$2.00
$2.50
RB1 RB2 RB3 RB4 RB5 RB6 RB7 RB8 RB9
50% Fees ($M)
Allocated ($M)
STORM WATER FEES COLLECTED and TOTAL $ ALLOCATED by RB FY2012/13
![Page 13: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/13.jpg)
Where does $100 in fees collected under SW go
$11
$40
$15
$35WDPF
Personnel
Operating andEquipmentIndirect
![Page 14: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/14.jpg)
1.3
6
3.5
6.95.3
0.5 0.2
5.4 6
1
3
0.75
5
3
0.3 0.4
4 3
1.5
3.1
0.75
5
3
1.80.5
43
0
2
4
6
8
10
12
14
16
18
20
RB1 RB2 RB3 RB4 RB5 RB6 RB7 RB8 RB9
CON IND
MUN
PYs by Sub Program
![Page 15: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/15.jpg)
Rollup of PYs by Sub Program
42.1
24.5
26.7
0 10 20 30 40 50
Municipal
Industrial
Construction
PYs
Municipal
Industrial
Construction
![Page 16: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/16.jpg)
Water Boards’ Performance Reporting System
Office of Research Planning and Performance
![Page 17: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/17.jpg)
![Page 18: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/18.jpg)
Toxicity and Pesticides
[What if we added biological and physical assessment data?]
![Page 19: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/19.jpg)
How toxic are California’s waters?• Surface water toxicity pervasive in California • 50% water and sediment samples statewide toxic
2001-2010• Most toxicity observed in urban areas
50%of sites sampled
for toxicity had
at least one
toxic sample
Source: SWAMP SPoT Program Third Report – Five-Year Trends 2008-2012 (2014)
Source: SWAMP
10-Year Toxicity
Report,
Anderson et al.
201171%
9%
14%6%
Ag
78%
19%
3%
Open 50%
27%
15%
8%
Urban
Toxicity Related to Land Use
Samples in Land Use (%)
![Page 20: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/20.jpg)
http://www.waterboards.ca.gov/water_issues/programs/swamp/bioassessment/csci_scores_map.shtml
California
Stream
Condition
Index
S
C
O
R
E
S
![Page 21: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/21.jpg)
Heat
Map
Storm
Water
Violations
SMARTS
&
Socrata
https://greengov.data.ca.gov
![Page 22: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/22.jpg)
Water Board Datasets on
greengov.data.ca.gov
System Dataset Data Status
CEDEN Toxicity Available April 1
CEDEN Chemistry Available April 1
CEDEN Tissue Available April 1
CEDEN Habitat Available April 1
CEDEN Benthic Available April 1
CIWQS Violations Available today
CIWQS Enforcement Actions Available today
CIWQS Violations Linked to Enforcement Actions Available today
CIWQS Self Reported Water Data Available today
CIWQS Regulatory Measures (permits, etc.) Available today
CIWQS Inspections Available today
SMARTS Violations Available today
SMARTS Enforcement Actions Available April 1
SMARTS Inspections Available April 1
SMARTS Enrollment Available April 1
![Page 23: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/23.jpg)
Web stuff:• www.waterboards.ca.gov/resources/data_databases/• www.waterboards.ca.gov/water_issues/programs/swamp/ • findanewway.ca.gov (#CAWaterDataDive)• www.ceden.org
![Page 24: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/24.jpg)
Why?
![Page 25: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/25.jpg)
![Page 26: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/26.jpg)
Marc Edwards, Ph.D.Charles P. Lunsford ProfessorVirginia Tech University
![Page 27: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/27.jpg)
![Page 28: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/28.jpg)
Who?
![Page 29: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/29.jpg)
Elden Vestal CA Fish and Game Biologist
![Page 30: Water Board Open Data Initiative · SWAMP IQ Unit Melissa Morris (Sr ES) Quality Assurance and Quality Management Support for SWAMP and ... Challenge June 29 - Water Quality Science](https://reader034.fdocuments.us/reader034/viewer/2022050121/5f515ccde5f918157102d8b1/html5/thumbnails/30.jpg)
https://public.tableau.com/views/DungenessCrabClosure/Dash1?:embed=y&:display_count=yes&:showTabs=y