QARTOD – IOOS DMAC Relationship

QARTOD III November 2-4, 20QARTOD III November 2-4, 200505

QARTOD – IOOS DMAC QARTOD – IOOS DMAC RelationshipRelationship

Julie BoschJulie BoschNOAA Coastal Data Development NOAA Coastal Data Development

CenterCenter

QARTOD IIIQARTOD IIINovember 2–4, 2005November 2–4, 2005


OverviewOverview

• DMACDMAC– RepresentationRepresentation– Expert Teams and CaucusesExpert Teams and Caucuses

• DMAC current businessDMAC current business• Relationship to QARTOD Relationship to QARTOD

activitiesactivities– Demo Project lessons learnedDemo Project lessons learned– Standards processStandards process

• Parting ThoughtsParting Thoughts


IOOS Data Management and IOOS Data Management and Communications (DMAC)Communications (DMAC)

DMAC Steering TeamDMAC Steering Team– Chair: Lee Dantzler; Deputy Director for Chair: Lee Dantzler; Deputy Director for

Data Management and CommunicationsData Management and Communications– Approximately 20 - 25 team membersApproximately 20 - 25 team members– Expertise in various science disciplines, Expertise in various science disciplines,

data management activities and productsdata management activities and products– *At least 3 members noting expertise in *At least 3 members noting expertise in

real-time datareal-time data


IOOS Data Management and IOOS Data Management and Communications (DMAC)Communications (DMAC)

DMAC Expert Teams and Community DMAC Expert Teams and Community Engagement CaucusesEngagement Caucuses

• Metadata and Data Discovery Expert TeamMetadata and Data Discovery Expert Team

• Transport and Access Expert TeamTransport and Access Expert Team

• Archive Expert TeamArchive Expert Team

• Standards Process Expert TeamStandards Process Expert Team

• Private Sector CaucusPrivate Sector Caucus

• International CaucusInternational Caucus

• Modeling CaucusModeling Caucus

• System Engineering/Enterprise Architecture System Engineering/Enterprise Architecture Working GroupWorking Group


DMAC Current BusinessDMAC Current Business

DMAC Steering Team – Meeting Nov. 1-3, 2005DMAC Steering Team – Meeting Nov. 1-3, 2005• Participants include Steering Team, Expert Team and Participants include Steering Team, Expert Team and

Regional Association representativesRegional Association representatives

• Reviewing the proposed draft work plans and member Reviewing the proposed draft work plans and member nominations for expert teams and community nominations for expert teams and community engagement caucusesengagement caucuses

• Breakout sessions focused on developing project plans Breakout sessions focused on developing project plans emphasizing regional and strategic collaborations; emphasizing regional and strategic collaborations; including cross-connections among teams and caucusesincluding cross-connections among teams and caucuses

• Reviewing lessons learned and results from relevant Reviewing lessons learned and results from relevant IOOS community activitiesIOOS community activities

– MMI Workshop on Advancing Domain VocabulariesMMI Workshop on Advancing Domain Vocabularies– CSC Salinity WorkshopCSC Salinity Workshop– NOAA/Navy Sponsored Interoperability NOAA/Navy Sponsored Interoperability

DemonstrationDemonstration– Others as submittedOthers as submitted


Relevance to QARTODRelevance to QARTOD

NOAA/NAVY Interoperability NOAA/NAVY Interoperability DemonstrationsDemonstrations

• 2 projects2 projects– BoeingBoeing– Northrup-GrummanNorthrup-Grumman

• End-to-end demonstrationsEnd-to-end demonstrations– Real-time data discovery, access, Real-time data discovery, access,

transport and integrationtransport and integration• Decision support productsDecision support products

– NOAA - Marine Mammal Avoidance NOAA - Marine Mammal Avoidance – Navy - Sea BasingNavy - Sea Basing



NOAA/NAVY DemonstrationsNOAA/NAVY Demonstrations• DMAC-related interoperability issues DMAC-related interoperability issues

– Quality Control: the capability to achieve Quality Control: the capability to achieve common levels of quality control across the common levels of quality control across the heterogeneous sources of data that ensures a heterogeneous sources of data that ensures a maximum utilization of available data.maximum utilization of available data.

• Key findings and recommendations as Key findings and recommendations as they relate specifically to DMAC issuesthey relate specifically to DMAC issues– There is a general lack of community-endorsed There is a general lack of community-endorsed

Quality Assurance (QA) and Quality Control Quality Assurance (QA) and Quality Control processes. This requires users to perform their processes. This requires users to perform their own QA/QC, a time-consuming process.own QA/QC, a time-consuming process.



Standards Process Expert Team Draft SOWStandards Process Expert Team Draft SOW

““Defining data standards is a slow, consensus-building, and Defining data standards is a slow, consensus-building, and often expensive process. … Therefore, DMAC development often expensive process. … Therefore, DMAC development cannot be based upon a systematic redesign of marine data cannot be based upon a systematic redesign of marine data standards to achieve the required level of interoperability. standards to achieve the required level of interoperability. Rather, Rather, the focus of the DMAC Plan is on the use of the focus of the DMAC Plan is on the use of protocols and translators that can achieve an acceptable protocols and translators that can achieve an acceptable level of interoperability level of interoperability building upon standards that exist building upon standards that exist todaytoday.” .”

“… “… The level of interoperability that can be achieved The level of interoperability that can be achieved among differing standards is often limited by mismatches in among differing standards is often limited by mismatches in the information content of the standards, or differences in the information content of the standards, or differences in the semantic data models that underlie them. In the long the semantic data models that underlie them. In the long term, term, achieving the desired level of data interoperability achieving the desired level of data interoperability will require that the community develop and use fewer will require that the community develop and use fewer standardsstandards that are of greater breadth.” that are of greater breadth.”



Standards Process Expert Team Draft SOWStandards Process Expert Team Draft SOW

“… “… To be fully successful, To be fully successful, IOOS must IOOS must foster the adoption of community foster the adoption of community standards that encompass quality control,standards that encompass quality control, scientific analysis, data-set versioning, scientific analysis, data-set versioning, metadata, products and services, data metadata, products and services, data discovery, network data transport, file discovery, network data transport, file formats, and data archiving.”formats, and data archiving.”


Parting ThoughtsParting Thoughts

DMAC recognizes and supports the DMAC recognizes and supports the efforts of QARTODefforts of QARTOD

During QARTODDuring QARTOD– Consider the elements of the DMAC Consider the elements of the DMAC

PlanPlan• MetadataMetadata• Data DiscoveryData Discovery• TransportTransport• Online browse, visualizationOnline browse, visualization• ArchiveArchive


Parting ShotsParting Shots

Is your data archived?


Julie BoschJulie Bosch

NOAA Coastal Data Development NOAA Coastal Data Development CenterCenter

Stennis Space Center, MSStennis Space Center, MS

228-688-3841228-688-3841

[email protected]@noaa.gov

QARTOD – IOOS DMAC Relationship

Documents

Transcript of QARTOD – IOOS DMAC Relationship