Measured Progress ©2011

Guide to the Smarter Balanced IT ArchitectureConnecticut Assessment Forum

August 14, 2012

2012

• Smarter Balanced Update• IT Architecture Project Overview• Defining the Architecture – Period A• Governance and Implementation – Period B• Architecture Summary Report• Technical Standards for Interoperability• Q & A

Agenda

Measured Progress ©2011

Smarter Balanced Update

Measured Progress ©2011

IT Architecture Project Overview

2012

• The Approach: This is larger than any single company agenda; it requires an open and collaborative approach

• The Team: We have assembled a Collaborative with:o The thought leadership (industry, academia, industry

associations & individual contributors) to ensure the vision is grounded in assessment and education best practices

o The technical capability to deliver• The Process: Experienced and Agile; sustainability via a

community approach • The Goals: Open, Flexible, Standards Based, and

Componentized

Overview of Smarter Balanced Architecture Initiative

2012

Assessment Lifecycle

ContentDevelopment

Pre-TestAdministration

TestAdministration

Scoring

Reporting

Post-TestAdministration

• Content and data reviews• Test form construction• Field testing• Item banking & statistics• Content exchange /

interoperability

•Planning & blueprinting•Item types•Content development & universal design•Learning standard alignment

• Administration planning & scheduling

• Registration, assignment,• Form sampling• Online infrastructure

readiness assessment• Pre-session planning

(paper / online) & setup• Alternate form

assignment

• Test form delivery• Platform (paper, online,

mobile) presentation• Item content & tools• Adaptive testing• Response collection• Proctoring controls• Form content security• Desktop security• Accessibility• Testing anomalies

• Computer scoring• Professional scoring• Algorithmic (AI) scoring• Portfolio scoring• Sub test / strand scoring

• Attemptedness• Performance levels• Scaling / norming• Growth scores• Range finding

• Individual reporting• Diagnostic reporting• Informing & personalizing

instruction• Performance on

standards• Dashboard / summary

reporting• Aggregation / disaggregation• Exchanging results / data

• Psychometric analysis• Equating• Score tables - scaling, norming• Performance levels / cut

scores• Field test analysis• Aligning results with

curriculum / instruction• Program and teacher

effectiveness

2012

Project Approach

Goals and Capabilities

Drivers and Tradeoffs

Scenario Mapping

Detailed Architecture Reqs

Conceptual Models

Logical Models

Consolidate Library

Validate Architecture

Define Arch Review Process

Execute Architecture Governance Model

User Personas

Analysis Envisioning and Decomposition

Validation and Documentation

Governance and OSS Strategy

Execution

Scenarios

Define OSS Mgmt Process

0-3 Weeks 3-7 Weeks 7-10 Weeks 10-12 Weeks Jan 2012 -> Ongoing

Assist Vendor Selection and Oversight

Monitor OSS Development Activities

Coordinate QA Activities

Technology Models

2012

Team

Measured Progress ©2011

Defining the Architecture – Period A

2012

Process

• Workshops

• Showcases

• Reviews

• Final Deliverables

Measured Progress ©2011

Governance and Implementation– Period B

2012

Governance Structure

• Executive Committee

• Architecture Review Board

• Architecture Core Team

• Extended Architecture Team

2012

Governance Processes

Measured Progress ©2011

Architecture Summary Report

2012

Architecture Overview

Architecture Summary Report available at:http://www.smarterbalanced.org/smarter-balanced-assessments/technology/

Title: Assessment System Architecture and Technology Phase 1 Report

Measured Progress ©2011

Technical Standards for Interoperability

2012

Standards Groups

• CEDS

• IMS Global

• SIFA

• AIF

2012

Assessment Interoperability Framework

Measured Progress ©2011

Question and Answer