WQX Web and FIFRA DataEPA Region 5

pre-SFIREG meeting WQX demonstration

Larry Theller, ABE, Purdue UniversityLeighanne Hahn, OISC

Conference CallApril 19, 2012 from 1:00 - 2:30 central time

(2:00 - 3:30 eastern time). The conference call number is 866-299-3188, conference code

7193131.

WQX and FIFRA Data

• What is WQX• How is it used• Original concept for data upload• Current “state of the art” data loader• Process flow• Data loader upgrades created for this project• Future Tool (2 year NEIEN project)

2OISC WQX

OISC WQX

WQX as Framework

• The Water Quality Exchange (WQX) is a framework that makes it easier for States, Tribes, and others to submit and share water quality monitoring data over the Internet.

• States, Tribes and other organizations can now submit data directly to the publicly-accessible STORET Data Warehouse using the WQX framework.

• WQX will eventually replace the distributed STORET, the STORET Data Entry Module, Reports Module, and STORET Import Module or SIM as the primary means of submitting water quality monitoring data to EPA.

3

OISC WQXhttp://www.epa.gov/storet/wqx/products/WQX_factsheet.pdf

CDX

STORET

NODEWEB

4

Win 2003

Server

2008 Purdue-OISC WQX NODE Design

Red Hat Entp

MySQL

ECN 8-Core Red Hat Server

Ubuntu

MySQL

MySQL

Oracle

Authenticated QUERY to CDX

Development (Test) computer

Main Development Server

Interim Production ServerRollover to:

Permanent Production Server

abeip867

abe2k3s2

Templeton.ecn

laptops

Data Loader Test Query Test

Backup of Prod. database

Proposed, Tested, but Not Implemented

5

Current WQX Web Design

Staging

CDX

Authenticated upload to staging database

Spreadsheet of results

Excel

QC done and

Reformat to XML

OISC

Authenticated XML upload to CDX

1

26

OISC WQXWQX_Web_User_Guide_v2.0.pdf 7

OISC WQX 8

OISC WQX

WQX_Web_User_Guide_v2.0.pdf

9

OISC WQXhttp://www.epa.gov/storet/wqx/products/WQX_factsheet.pdf

Project Name Monitoring Locations

2011 Activity - Results

2010Activity - Results

2009 Activity - Results

10

OISC WQX

Sample XML for monitoring location upload.

11

OISC WQX 12

In this typical spreadsheet layout, the measurements are in columns, and each set of samples from a location is a row.

12

OISC WQX

The columns need to pivot so each measurement becomes one row, and the data collection notes need to be replicated for each measurement.

13

OISC WQX 14

OISC WQX

The pink colored tab is used to export data for upload; The yellow tabs to set-up the input data;

The green tabs provide a linked reference for documented elements in WQX.

15

OISC WQX 16

OISC WQX 17

OISC WQX 18

OISC WQX 19

OISC WQX 20

OISC WQX

New Tool under development

• Load and Flow Duration Curve (LDC)– Upload of flow data from USGS– Upload of water quality data from USGS– Upload of water quality data from WQX

Current Grant: WQX data in Action21

OISC WQX 22

OISC WQX 23

OISC WQX

Load and Flow Duration Curves

24

OISC WQX

The End

25