dQUOB: SQL queries over data streams
1
dQUOB: SQL queries over data streams Peachtree City, GA Streamed sweep data raw Level 2 data archive archive Archived sweep data discards Grier, SC Hytop, AL Transform, Filter, Aggregate repository event channe l provider consumer quoblet dQUOB notificat ion service Q M dispatcher Q N Query scripts Problem: asynchronous streams; stream S is slow and erratic join window: 10 sec. R: S: a g f e d c b 1 l k j i h 5 4 3 2 join window: count … … time S: 1 5 4 3 2 … R: a g f e d c b l k j i h … time Approach: express join window as interval of time Unoptimized version: Optimized version: Motivating Application: Linked Environments for Atmospheric Discovery (LEAD) NEXRAD Doppler radar data streamed and transformed, filtered, or aggregated for real-time use. dQUOB Queries execute continuously – upon arrival of every event. Queries implemented as DAG of operators (selects, projects, and joins) Beth Plale Indiana University
-
Upload
xantha-jefferson -
Category
Documents
-
view
16 -
download
2
description
Q M. Peachtree City, GA. Q N. Streamed sweep data. archive. dispatcher. archive. Query scripts. Grier, SC. Archived sweep data. repository. dQUOB notification service. Hytop, AL. Transform, Filter, Aggregate. time. R:. …. l. k. j. i. h. g. f. e. d. c. b. a. - PowerPoint PPT Presentation
Transcript of dQUOB: SQL queries over data streams
dQUOB:SQL queries over data streams
Peachtree City, GA
Streamed sweep data
raw Level 2 data archivearchiveArchived sweep data
discards
Grier, SC
Hytop, AL
Transform,Filter,Aggregate
repositoryrepository
event channel
providerprovider consumerconsumerquoblet
dQUOB notificationservice
QM
dispatcher
QN
Queryscripts
Problem: asynchronous streams; stream S is slow and erratic
join window: 10 sec.
R:S:
ag f e d c b
1
l k j i h
5 4 3 2
join window: count
……
time
S: 15 4 3 2…
R: ag f e d c bl k j i h…
timeApproach: express join window as interval of time
Unoptimizedversion:
Optimizedversion:
Motivating Application:Linked Environments forAtmospheric Discovery (LEAD)
NEXRAD Doppler radar data streamed and transformed, filtered, or aggregated for real-time use.
dQUOB Queries execute continuously – upon arrival of every event.Queries implemented as DAG of operators (selects, projects, and joins)
Beth PlaleIndiana University
