Elliott Asp Special Assistant to the Commissioner Colorado Department of Education Assistant...
29
Elliott Asp Special Assistant to the Commissioner Colorado Department of Education Assistant Superintendent Cherry Creek Schools Reflections on “Student Outcomes Component” ACEE February 15, 2013
-
Upload
paul-tucker -
Category
Documents
-
view
218 -
download
0
Transcript of Elliott Asp Special Assistant to the Commissioner Colorado Department of Education Assistant...
Elliott AspSpecial Assistant to the Commissioner
Colorado Department of Educati onAssistant Superintendent
Cherry Creek Schools
Reflections on “Student Outcomes Component”
ACEE
February 15, 2013
2
Together We Can
VisionAll students in Colorado will become educated and
productive citizens capable of succeeding in a globally competitive workforce.
MissionThe mission of CDE is to shape, support, and safeguard a statewide education system that prepares all students
for success in a globally competitive world.
Successful studentsPrepare students to thrive in their education and in a globally competitive workforce. Ensure every student is on track to graduate postsecondary and workforce ready. Increase achievement for all students and close achievement gaps. Ensure students graduate ready for success in postsecondary education and the workforce. Increase national and international competitiveness for all students.
Great teachers and leadersEnsure effective educators for every student and effective leaders for every school and district. Increase and support the effectiveness of all educators. Optimize the preparation, retention, and effectiveness of new educators. Eliminate the educator equity gap.
Outstanding schools and districtsBuild the capacity of schools and districts to meet the needs of Colorado students and their families. Increase school and district performance. Turnaround the state’s lowest performing districts and schools. Foster innovation and expand access to a rich array of high quality school choices for students.
Best education system in the nationBuild the best education system in the nation. Lead the nation in policy, innovation, and positive outcomes for students. Operate with excellence, efficiency, and effectiveness to become the best SEA in the nation. Attract and retain outstanding talent to CDE.
Goals
Students
Educators
Schools/ Districts
State
3
Overview
Clarify “assessment vocabulary” Frame the process of specifying and measuring student
outcomes Share an example of how a district might approach the
“student outcomes component” for principals Reflect on the “Guidance” document and process Share ideas and processes for developing teacher and district
student outcomes ratings
Assessment Vocabulary: Place/source
Teacher developed Classroom School Common (across grade/dept., school, district) Vendor District State National
Assessment Vocabulary: Time/Sequence
Pre Post On-the-spot Frequent Daily Weekly Short cycle Interim End-of-Unit End-of-Course End-of-Year Mid-term Final
Assessment Vocabulary: Purpose“Assessment is as assessment does”
Diagnostic Formative Benchmark Anchor/calibration Predictive Summative Growth
Assessment Vocabulary: Formative
Inform instruction Provide meaningful feedback to students about progress
towards learning targets Non-evaluative Specific Actionable
Process vs instrument Methods
Questioning Feedback (self/peer/teacher)
Lots of strategies
9
Current system is not “highly effective” (not be “partially effective”)
Takes time to do this well, some folks don’t understand thisCaught between rock and a hard spotPolicy makers, the law, reform groups vs psychometric issues,
feasibility….. Process is complex, beyond the understanding of most
practitioners and policy measures Instructional value of assessments vs technical quality is a
long-standing issue Bringing teachers together to talk about “Student Learning
Outcomes” (or growth) and how to measure it is a useful thing
Issues
10
Will need to emphasize collective attributions vs individual to begin This is not without “political” consequences
Moving toward valid and reliable may need to start with logical process that is transparent
This process will be arbitrary, but should not be capricious
Issues
11
Student Learning Outcomes
Methods for
Measuring
High Technical Quality
Vague
Ideal
Col oradoGrowthModel
Precise
Low Technical Quality
Definition
·
·
·
12
Student Learning Outcomes
Dimensions of Gowth
Methods for
Measuring
High Technical Quality
Vague
Ideal
Col oradoGrowthModel
Precise
Low Technical Quality
Definition
·
·
·
·
13
Student Learning Outcomes
Methods for
Measuring
High Technical Quality
Vague
Ideal
Col oradoGrowthModel
Precise
Low Technical Quality
Definition
·
·
·
·
14
Student Learning Outcomes
Dimensions of Growth
Methods for
Measuring
High Technical Quality
Vague
Ideal
Col oradoGrowthModel
Precise
Low Technical Quality
Definition
·
·
·
·
DEPARTMENT OF EDUCATION
Colorado State Board of Education
RULES FOR ADMINISTRATION OF A STATEWIDE SYSTEM TO EVALUATE THE EFFECTIVENESS OF LICENSED PERSONNEL EMPLOYED BY SCHOOL DISTRICTS AND BOARDS OF COOPERATIVE SERVICES 1 CCR 301-87
Requirements for Principal “Growth Standard”
Data from the school performance frameworkAt least one other measure of student academic growthMeasure growth of students in all subjects and gradesAssure that assessments are valid and reliableInvolve principals in discussion of measures
First Steps: ProcessIncorporating Student Outcomes Data into Educator Eff ectiveness Ratings
Review the law, rules, and the assurances Review of literature and research (ongoing)Discussion with other metro area districts and professional educati onal measurement organizati ons (ongoing)Create guiding principles (ongoing)
First Steps: ProcessIncorporating Student Outcomes Data into Educator Eff ectiveness Ratings
Review of “Guidance Document”Create multi ple principal and teacher evaluati on frameworks for a School Student Outcomes IndexExamine results of multi ple models for principal evaluati onDiscussion of progress with Educati onal Operati onsIniti al discussion of progress with AdC0 – February
A CCSD System for Incorporating Student Outcomes into Principal Evaluation Will:
Refl ect district goals of excellence and equityEncourage professional collaborati on and mutual capacity building among ‐educatorsIncenti vize eff ecti ve educators to seek positi ons in lower performing schools
Guiding Principles for our Work
A CCSD System for Incorporating Student Outcomesinto Principal Evaluation Will:
Be clearly understandable, employing data readily available from existi ng reporti ng systemsCreate support for shared ownership of student progressComply with State rules and assurances to the best of our ability
Guiding Principles for our Work
Overall Principal Effectiveness Rating
ExcellenceEquityProfessional Prac-tice
Draft Framework for School Student Outcomes Index
Data Sources and Proportions of Contribution
EXCELLENCE EQUITY
Shared District Attribution
School School Demographics
Data Source:
District DPF rating SPF plan ratingKPI growth for students of color
Impact factor
Focus:How the State perceives the district, overall
How the State perceives the school, overall
Overall school growth goals for students of color
Factors outside the school that can impact student performance
Measure/ Metric:
State-assigned accreditation ranges
State-assigned school plan & % points earned
Overall growth TCAP ‐MGP (students of color only)
Current elementary “risk factor index”
Weights (=100%)
TBD TBD TBD TBD
Sample Student Outcomes Index: Categories
School student outcome categories will be derived from our district KPIs and SPFs from
the State.
Much less thanExpected
Less thanExpected
ExpectedMore thanExpected
Draft Decision Making Matrix
Professional Practices Rating
ExemplaryPartially Effective
EffectiveHighly
EffectiveHighly
Effective
AccomplishedPartially Effective
Effective Effective Effective
Proficient IneffectivePartially Effective
Effective Effective
Not Evident/Partially
ProficientIneffective Ineffective Ineffective
Partially Effective
StudentOutcomes
Index
MuchLess ThanExpected
Less ThanExpected
ExpectedAbove
Expected
Next StepsIncorporating Student Outcomes Data into Educator Eff ectiveness Ratings
Finalize principal evaluati on framework and weighti ngs for each data sourceFinalize Student Outcomes Index ranges for principal evaluati onCreate and verify fi nal principal evaluati on model with 2012 CCSD school data, level directors, and pilot principalsMake relevant research and literature available to allConti nue to study guidance documents from CDE
Next StepsIncorporating StudentOutcomes Data into Educator Eff ectiveness Ratings
Conti nue communicati on with EdOp and AdCoConti nue work on parallel model for teacher evaluati onShare progress with AdCo in AprilCreate and verify fi nal teacher evaluati on model with 2012 CCSD school data, level directors, and pilot principals
28
What questions/comments/feedback do you have in regard to the “Guidance” document and the process you experienced today?
How is your district thinking about/planning to and/or proceeding in defining the student outcomes component of the educator effectiveness ratings?
Small Group Discussion
Elliott AspSpecial Assistant to the Commissioner
Colorado Department of Educati on
Reflections on “Student Outcomes Component”
ACEE
February 15, 2013
