Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup...
-
Upload
conrad-bryan -
Category
Documents
-
view
217 -
download
1
Transcript of Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup...
![Page 1: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/1.jpg)
Research Program and Enterprise Architecture for
Adaptive Survey Design At Census
Peter Miller
Anup Mathur
Michael Thieme
May 23, 2014
![Page 2: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/2.jpg)
2
Adaptive Design Elements
• A tailored and dynamic approach to case management in data collection
• Uses auxiliary frame data, paradata and response data to guide contact approaches and resource allocation
• Employs a centralized system for controlling multiple data collection modes
![Page 3: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/3.jpg)
3
Data Resources for Adaptive Design
• Frame data: e.g. type of structure, block group demographic statistics, alternative modes, (previous response data)
• Paradata: contact history (effort and response propensity), interviewer observations, time and travel, progress, Web survey metrics
• Response data: Current estimates for key variables• Quality metrics -> sample balance, response rate,
stability/quality of estimates
![Page 4: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/4.jpg)
4
Tailored and Dynamic Case Management
• Prioritize cases (e.g. NSCG, 2013 Census Test)• Prioritize modes (e.g.NSCG)• Shift priorities with experience (e.g. NSCG,
2013 Census Test)• Subsample open cases (e.g. Econ Census)• Stop data collection (e.g. NHIS)• Faster provision of data (e.g. NSCG)
![Page 5: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/5.jpg)
5
What Does it Take to be Adaptive?
• An organizational mandate to “prove in” adaptive approaches to data collection
• An understanding of the elemental capabilities required
• An architectural approach
![Page 6: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/6.jpg)
6
Organizational MandateCensus Bureau Example1. Established a Center with the primary responsibility for
researching and implementing Adaptive Design for the enterprise
2. Staffed the new Center for Adaptive Design (CAD) with motivated representatives from each Directorate (Decennial, Demographic, Economic, Information Technology)
3. Inserted Adaptive Design goals in key strategic documents4. Insisted that the CAD be a combined effort of Statistical
Methodology and IT Enterprise Architecture5. Robert Groves and John Thompson
![Page 7: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/7.jpg)
7
Architectural Approach• Work with Standards (common
conceptual frameworks)
• Create a solution architecture
• Create a Program Roadmap
![Page 8: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/8.jpg)
8
Challenges• Accidental Architecture1
1 Source: Fostering Interoperability in Official Statistics: Common Statistical Production Architecture (UNECE, 2013)
![Page 9: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/9.jpg)
9
Challenges• This is what Accidental Architecture looks like at Census:
![Page 10: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/10.jpg)
10
User Interface
Policy Automation – Business Rules Layer
Integration & Access Services Layer
Maestro
XMLWorkload, Instrument forModes
StatusFrom Modes
Paper Mode Systems
Interview Operations Control
(CATI, CAPI, TQA, Listing)
Internet Mode System
ResponsesFrom Modes
XMLXML
Sample & Response Processing
Sample
XML
Response
Single Platform to Manage Multiple Data Collection Modes
Workflow Automation – BPM Layer
+
+
![Page 11: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/11.jpg)
11
User Interface
Policy Automation – Business Rules Layer
Workflow Automation – BPM Layer
+
+
Integration & Access Services Layer
Maestro
XML
Workload, Instrument Status
Paper Mode Systems
Interview Operations Control
(CATI, CAPI, TQA, Listing)
Internet Mode System
ResponseXMLXML
Sample & Response Processing
XML
Response
Administrative Records
Sample
Admin Records – Frame Augmentation
Augment Frame Data
![Page 12: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/12.jpg)
12
XMLXMLXML
Sample & Response Processing
XML
Administrative Records
Visualization, Modeling, Analysis, & Estimation
User Interface
Policy Automation – Business Rules Layer
Workflow Automation – BPM Layer
+
+
Integration & Access Services Layer
Maestro
Paper Mode Systems
Interview Operations Control
(CATI, CAPI, TQA, Listing)
Internet Mode System
Workload, Instrument Response Status
Paradata
Sample
Response
XML
XMLXML
Admin Records – Frame Augmentation
Admin Records
Paradata
Paradata
Estimates
Adaptive Orchestration of Data Collection
Response
![Page 13: Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649f425503460f94c626ab/html5/thumbnails/13.jpg)
13
Plan for Rolling Out Adaptive DesignCale 2012 2013 2014 2015 2016 2017 2018 2019
Baseline 1: Maestro Platform: Support ACS in 2016
Baseline 2: Maestro in place, add Paradata & Concurrent Analysis – Bring on Decennial and
some Demo surveys in 2017
Baseline 3: Bring on more Demo surveys, start bringing on Econ surveys and Econ
Census