DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of...
-
Upload
shana-butler -
Category
Documents
-
view
218 -
download
3
Transcript of DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of...
![Page 1: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/1.jpg)
DATA QUALITY CONTROL
Julie ThomasCoastal Data Information Program (CDIP)
Scripps Institution of Oceanography
CI Design Workshop17-19 October 2007
La Jolla, CA
![Page 2: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/2.jpg)
ACTQARTOD
REAL-TIME CASE STUDY
INTERNATIONAL EFFORTS
WMO, OceanSITES/Eurosites/IFREMER, JCOMM, ……..
![Page 3: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/3.jpg)
Directional Wave Observations1) The Basics
2) Remote Sensing v. In Situ : It’s all good.
3) Estimating directional wave properties.
4) Measurement accuracy and user needs.
5) A Recipe for instrument evaluation.
ALLIANCE FOR COASTAL TECHNOLOGIES
ACTWave Sensor Technologies
University of South Florida, March 7-9 2007By Bill O’Reilly
![Page 4: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/4.jpg)
z
xy
w
u
v
The Big 3
X, Y, Z
The Basics: Estimating the Motion of a Sea Surface Particle
Pressure SensorsAccelerometersTilt sensorsAngular Rate SensorsAcoustic SensorsRadarLidar
dz/dx,dz/dy
z
![Page 5: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/5.jpg)
In-Situ and Remotely Sensed Waves
MethodO(cm) X,Y,Z Accuracy
SpatialCoverage
Time Coverage
In situ
SAR,LIDAR
HF, X-Band Radar
In situ and remote sensing systems are complimentary, NOT redundant.
![Page 6: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/6.jpg)
XYZ TIME SERIES
![Page 7: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/7.jpg)
The Big 3: X, Y, Z Time Series Analysis The First 5: S(f),a1(f),b1(f),a2(f),b2(f) !!
S
![Page 8: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/8.jpg)
Theoretical maximum level of breaking wave in a fully developed sea
Each box represents the number of hourly observation – Datawell Buoy Mark II w/ hippy used as data source (standard).
![Page 9: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/9.jpg)
Comparison between a Datawell Buoy w/ hippy and a PROTOTYPE Datawell w/ GPS. Low numbers indicate good correlations. InstrumentsWere co-located.
GPS instrument dropped out during low Frequency – causing spikes in data
Instruments tend to disagree asthey are interpreting sea surface differently under breaking wave conditions.
![Page 10: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/10.jpg)
Datawell w/ hippy and Datawell w/ GPS tend to agree well with wave direction. Note how both instruments reach their noise floor during long period, low energy events.
![Page 11: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/11.jpg)
Directional spread is where many instruments fall apart! Good indication of the quality of the instrument – demonstrates their directional noise level!
GPS antenna on top of the buoy has a “natural” noise when it wobbles – a method has been devised to correct for this problem.
![Page 12: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/12.jpg)
QUALITY ASSURANCE OF REAL-TIME DATA
QARTODhttp://qartod.org
QARTOD is a continuing multi-agency effort to address the Quality Assurance and Quality Control issues of the Integrated Ocean Observing System (IOOS) and broader international community.
Quality Control standards have been submitted to DMAC for both waves and Currents. Ocean.US is now soliciting submissions from the Regional Associations for all standards including QA/QC. The QARTOD submissionsWill be posted soon on the Ocean.US website.
Parameters addressed through QARTOD: Waves, In-situ Currents, Remote Currents (HF RADAR), CTDs, Dissolved Oxygen.
Collaborated with DMAC Metadata team for a one day appended workshopDuring QARTOD IV, June 2006.
![Page 13: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/13.jpg)
http://qartod.orghttp://cdip.ucsd.edu/documents/index/product_docs/qc_summaries/waves/waves_table.php
Quality Assurance (QA) – Verify that instrumentation is calibrated and tested to assure collection of the highest qualitydata possible.
Quality Control (QC) – Analyze and verify the data streamto assure the highest quality datapossible.
![Page 14: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/14.jpg)
![Page 15: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/15.jpg)
![Page 16: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/16.jpg)
VALIDATION CASE STUDY - Real-time Buoy Data
Eel RiverCape Mendocino (094)
Humboldt Bay South Spit (128)
OREGON
CALIFORNIA
NDBC BUOY 46022, EEL RIVER, re-deployed this summer with 3DMG sensor. 46022 is 34 miles away from buoy 46213 (CDIP Datawell Buoy Station 094).
![Page 17: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/17.jpg)
Full spectra looks ok at first glance!
![Page 18: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/18.jpg)
Under predicts LONG PERIOD SWELL (12-33 sec)
Noisy directional spread
![Page 19: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/19.jpg)
Comparison of the Datawell /hippy and the NDBC 46022 (Eel River Buoy) w/ 3DMG sensor .
46022 under predicts low frequency waves.
Buoys are moored 34 miles apart. Part of this difference in the high frequency could be caused by local sea conditions.
![Page 20: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/20.jpg)
Why is directional spread important? Why do we need accurate wave measurements?
The models are only as good as their input source.
In Southern California, for instance, 5 degrees can makea big difference in how much energy reaches the beach.
![Page 21: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649f135503460f94c26ee2/html5/thumbnails/21.jpg)
Let’s come together as an IOOS community and further validate our wave instrumentation!