Goals for Webinar: Applications of SEC Alignment Analysis What is SEC alignment method How alignment...

Goals for Webinar:Applications of SEC Alignment Analysis

• What is SEC alignment method

• How alignment analyzed and reported --Stands/Assess: 30 states, NAEP, International; next: Common Core

• How states, districts, schools use results

Purposes: Alignment Analysis

• Policy question: Does Assessment match standards? Curriculum to standards, Standards to standards?

• Local question: Does instruction meet intended Curriculum or Goals?

• Question of How? What Measures?

Alignment= Core Idea in standards-based education reform (Porter, 2002)

Vertical and Horizontal Alignment

State-focused Models

• Webb: Assessment to standards– Content consistency, Depth of know, Balance– External teams, Statistics, Reports

• Achieve: Standards, Assess to Standards– Content centrality, Expected Perform, Challenge– Ext. teams, Stats, Qualitative, Reports

• SEC: Standards, Assessment, Instruction– Content matrix and language --multiple

comparisons/levels; Cross-state teams– Content consistency, Depth of know, Balance– Graphical online reporting (maps, tiles)

Surveys of Enacted Surveys of Enacted CurriculumCurriculum

A neutral content grid

with cognitive demand

The intended curriculum: State content standards—What students should learn

The enacted curriculum: What teachers teach

The learned curriculum: Student outcomes based on school learning

The assessed curriculum: State (and other) assessments—tested learning

Uses a multi-dimensional language fordescribing instructional content

SEC Instructional Content

Topics

byCognitive Demand

(Expectations for Student Learning)

www.SECsurvey.org

www.Seconline.org

http://www.secsurvey.org/

Categories of Cognitive Demand

Topics Algebra

Memorize Peform Procedures

Communicate Understanding

Sovle non-routine

problems

Conjecture/ Generalize/

Prove Multiple

Step Equations

Inequalities

Literal Equations

Lines / Slope and Intercept

Operations on

Polynomials

Quadratic Equations

Content Matrix--Math

Council of Chief State School Officers (CCSSO) www.seconline.org ©2007. All rights reserved.

Surveys of Enacted Curriculum

Surveys of Enacted Curriculum (SEC) are a research-based data tool that allows teachers, administrators and policy makers to examine the extent of alignment between the enacted curriculum (what teachers teach), the intended curriculum (what the standards require), and the assessed curriculum (what the state tests).


The SEC are…..

Surveys with teachers by K-12 subject: Math, Science, ELA, SST, and now ELD teachers, to collect and report consistent data on current instructional practices and content being taught in classrooms.

Content analysis of Stands., Assessments through SEC Collaborative –CCSSO and WCER


Background

State curriculum specialists, teachers, and researchers developed the SEC and reporting tools over the past decade.

The Surveys have been field tested in hundreds of schools and classrooms through collaboration with state education agencies.

The SEC are now being used in state and local projects across the U.S.

The data collection, analysis, and application services are available through CCSSO and several collaborating partner organizations.


Research Says….

• MSP-PD Study (Blank, Smithson, Porter, Garet, Birman, 2005)

Use of SEC data for program evaluation

SEC – ELL Consortium (2008-10) – Analyzing alignment of content AND language of academic content

• Reform-Up-Close (Porter, Kirst, Osthoff, Smithson, Schneider, 1993)

Validation of teacher self-report survey data.

• Upgrading Mathematics (Gamoran, Porter, Smithson, White, 1997)

Predictive validity of alignment index comparing instruction & assessments

• Data on Enacted Curriculum (Blank, Porter, Smithson, 2004)

Use of SEC data to facilitate school improvement efforts

Webb’s “Depth-of-Knowledge” Model for Alignment

Describe and analyze the rigor, or complexity, of content and expectations between standards/framework and assessments.

Level 1: Recall and Reproduction

Level 2: Skills and Concepts

Level 3: Strategic Thinking

Level 4: Extended Thinking

SEC Home Page


Topics List


SEC Math Expectations for Students

Important SEC facts

• Confidential• Teachers create unique usernames and

passwords when they register• The data reports out in groups of 3 or

more teachers• Completion of the survey is the

beginning of your SEC experience


Sophistication of knowledgeStudents use the same basic skills but in a more

sophisticated way.

Same rules, higher level game….

Instructional Practices

• Use of Homework

• Instructional Activities

• Small Group Work

• Educational Technology

• Teacher Opinions and Beliefs

• Professional Development

• Instructional Influences

• Instructional Readiness

Report Generator


Teachers complete the Survey questions through an online, web-based system.

Upon completion, the group data are reported in user friendly charts and graphs to facilitate analysis of the results.

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.


The SEC data Assist in

･ Aligning classroom instruction with state standards and assessments

･ Evaluating effects of initiatives, such as professional development, in changing instructional content and/or practice

･ Analyzing instructional practices and teacher preparation to develop a needs assessment in low performance areas

･ Measuring indicators of instruction and their relationship to student achievement

Enacted (3rd Grade Teacher Reports) Intended (3rd Grade Math Indicators)

Intended (3-4 Math Benchmarks) Assessed (3rd Grade Math Achievement Test)

Enacted (9th Grade Teacher Reports) Intended (9th Grade Indicators)

Reading First: 3rd Grade Teachers Random Sample: 3rd Grade Teachers

Tile Chart

SEC Project Planning Guide


Where are the resources to assist you?

www.seconline.org

www.secsurvey.org

http://www.seconline.org/

“Regardless of what a state policy requires or what a district curriculum spells out,” says Andrew C. Porter of Vanderbilt University, “the classroom teacher ultimately decides” what to teach.

Education Week, October 8, 2003

Source: Maine SEC project PPT, 2004

Goals for Webinar: Applications of SEC Alignment Analysis What is SEC alignment method How alignment...

Documents

Transcript of Goals for Webinar: Applications of SEC Alignment Analysis What is SEC alignment method How alignment...