METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

24
METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica

Transcript of METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Page 1: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

METADATA DRIVENSURVEY RESEARCH

Alerk Amin, CentERdata

Jeremy Iverson, Colectica

Page 2: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

What is Metadata?

Data (survey data) Metadata (data about data) Paradata (data about process)

Page 3: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Paradata

Empirical measurements about the process of creating survey data

Paradata is data

Page 4: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Metadata

DATA

Survey data

ParadataMetadata

Page 5: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Why is Metadata Important?

“Survey documentation and metadata are vital products of a survey and need careful consideration at the point of survey design so that the data will be useful.”

From Survey Methodology, by Robert M. Groves, Floyd J. Fowler, Mick P. Couper, James M. Lepkowski, Eleanor Singer

Page 6: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

AER Data Availability Policy

“It is the policy of the American Economic Review to publish papers only if the data used in the analysis are clearly and precisely documented and are readily available to any researcher for purposes of replication.”

Page 7: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

“Current” Situation

Page 8: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Questionnaire Development

Page 9: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

The Data Lifecycle

Documentation

Lost

Page 10: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

A Better Solution

Metadata-Driven Survey Research

Page 11: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Metadata Driven Survey Research

Metadata

Survey instruments

Paper questionnaires

Statistical source code

Paper documentation

Web documentation

Page 12: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Questionnaire Development

Better, faster, cheaper Eliminate cut-and-paste from Word/Excel Automate more of the process Metadata reuse saves even more time

and effort for longitudinal surveys

Page 13: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Survey Documentation

Integral part of process Easier to capture work done by all

people/agencies in data collection process

Page 14: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Metadata Repositories

Leverage metadata both inside & outside organization

Allows for Concept Banks Question Banks Variable Banks Classification Banks

Link to other repositories when reusing questions

Page 15: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Researcher Questions

What studies explore these concepts? What questionnaires use this question? What datasets have this variable?

Page 16: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Increased Understanding

Improved discoverability Improved comparability Researchers understand more of data

collection process

Page 17: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

How to do this?

It’s possible today

Page 18: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

DDI 3

Documents all stages of data lifecycle Defines elements and relationships Designed for reuse of elements Provides structured method of describing

additional data Geographic data Medical data Biomarker data

Page 19: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

DDI Workflow

Define the metadata and relationships

Automate everything else

Page 20: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

DDI 3 Tools

ColecticaQuestasy

DDA Metadata

EditorCanada

RDC Tools

STARDAT

Custom tools

Page 21: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Colectica

Page 22: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

Questasy

Page 23: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

DDA Metadata Editor

Page 24: METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.

THANK YOU

Alerk Amin

[email protected]

Jeremy Iverson

[email protected]