ASSESSMENT UPDATE

Rhonda Sims, Director Division of Support and ResearchOffice Of Assessment And Accountability

rhonda.sims@education.ky.gov502-564-4394

Kentucky Department of EducationSeptember 24, 2013

What We’ll be Covering

Timeline for 2013 Reporting What’s included in the School Report

Card (SRC)? Year 2 SRC Review Classifications and Labels

(Rewards/Assistance) Delivery Program Reviews

2

Timeline for 2013 Reporting

Wed.Sept. 25

9 a.m. ET -- Release of embargoed data to districts via the School Report Card 1 p.m. ET -- Release of embargoed data to media

Fri.Sept. 27

12:01 a.m. ET – Embargo liftedPublic release of School Report Card

August Schools received data Quality Review

Data Review for (10 days)ThroughOct. 7

3

School/District/State DataProfilesAssessment ResultsAccountability ClassificationsFederal Accountability/AMOLearning Environment –non-academic datamembershipper pupil spending student demographicsfree/reduced-mealschool safetyDelivery Targets

4

What’s Included in the School Report Card?

attendance rate retention rate dropout rate graduation rate

Assessment Data

K-PREP (Kentucky Performance Rating for Educational Progress) -- Grades 3-8

Scores and performance levels (NAPD)o Readingo Mathematicso Science EXPLORE, PLAN, ACT (Grades 8, 10, 11) Scores and benchmarks End-of-Courseo English II o Algebra II Writing (Grades 5, 6, 8, 10-11) Editing/mechanics (Grades 4, 6, 10 (Plan))

o Social Studieso Writing/mechanics

5

Accountability Data

Next-Generation Learners Achievement Gap Growth Accountability classifications Annual Measurable Objective (AMO) Participation Rate and Graduation Rate Rewards/Assistance

Graduation Rate College/career-readiness

6

Accountability: Year 2 SRC Review

7

Simulated data shown

8

Accountability: Year 2 SRC Review

Simulated data shown

KDE:OAA:rls: 9/11/2013

9

Accountability: Year 2 SRC Review

Simulated data shown

KDE:OAA:rls: 9/11/2013

10

Accountability: Year 2 SRC Review

Simulated data shown

KDE:OAA:rls: 9/11/2013

11

Accountability: Year 2 SRC Review

Simulated data shown

College/Career-Readiness Rate

12

College Ready:Must meet benchmarks on one of the following:

College Ready

ACT

COMPASS

KYOTE

Career Ready: Must meet benchmarks for one requirement in Career Academic area and must meet one requirement inCareer Technical area

Career Ready Academic

Career Ready Technical

Armed Services Vocational Aptitude

Battery (ASVAB)

ACT Work Keys (Applied Math,

Locating information, and Reading

for Information)

Kentucky Occupational

Skills Standards Assessment

(KOSSA)

Industry Certificates

Bonus: College AND Career Ready must meet at least one from each area

College Ready AcademicCareer Ready

Technical

ACT or COMPASS or KYOTE

KOSSA

Industry Certificates

NOTES: (1) By meeting the College Ready Academic definition, the student does not have to take the additional tests of ASVAB or Work Keys for the bonus area. (2) For accountability purposes, the bonus shall not allow the readiness percentageto exceed 100 percent.

KDE:OAA:rls: 9/11/2013

13

Accountability: Year 2 SRC Review

Simulated data shown

Graduation Rate Reminder

Cohort model graduation data is used in the 2012-13 calculation for the Graduation Rate component (20% of high school Next-Generation Learners).

Averaged Freshman Graduation Rate (AFGR) will be used one last time in 2012-13 for graduation rate goals.

Cohort will be used for graduation rate goals moving forward (i.e., 2013-14).

14

15

Accountability: Year 2 SRC Review

Simulated data shown

16

Accountability: Year 2 SRC Review

Simulated data shown

Accountability: Year 2 Classifications and Labels

Needs Improvement (Below 70th Percentile) Proficient (At or Above 70th Percentile) Distinguished (Above 90th Percentile)

Progressing NEW 2013oMeet Annual Measurable Objective (AMO)

goal (1.0 gain in Overall Score below Proficient or .5 gain Proficient and above);

oGraduation rate goal (AFGR); and o Participation rate (95%)

17

High Performing School Top 90% of schools and meets AMO,

graduation rate goal and participation rate goal School of Distinction

Top 95% of schools and meets AMO, graduation rate goal, participation rate goal and has graduation rate above 60% for 2 years

High-Progress NEW 2013Top 10% of improvement and Meet AMO, graduation rate goal (AFGR) and

participation rate (95%)Any other school label can also be labeled High-Progress

18

Accountability: Year 2Rewards Categories

Accountability: Year 2 Assistance Categories Priority (No new Priority Schools added in

2012-13)

Focus (No new Focus Schools added in 2012-13, but new Districts may be added)

oLowest 10% in Overall Gap Group or meets third standard deviation model for a single gap group

19

Accountability: Year 2Locked Proficient & Distinguished Percentiles

Percentiles for Elementary, Middle and High Overall Score were set and locked in 2011-12. The locked percentile serves as the overall score target for 2013 reporting.

70th 90th 95th Elementary Overall Score 62.5 69.8 72.5Middle Overall Score 58.7 64.9 68.2High Overall Score 58.0 64.4 67.7District Overall Score 58.4 63.3 65.2

20

School Report Card Year Two Format Changes Add Trend Data for Profiles Update Graduation Data to show both Cohort & AFGR Add Trend Data for NAPD Tables Add Non-Duplicated Gap Group to list of individual

group scores Add Total Students with Disability (regular and

alternate assessments) Add Level-Based (elementary, middle and high)

data for disaggregated pages Clarify language and footnotes

21

Delivery22

sets yearly targets based upon a 5-year goal to help schools/districts meet state achievement expectations

Simulated data shown

Program Review (PR) Data Release

Tentative Release of School and District Data Date: October 2013

Provided through Open House on KDE website Based on Program Review scores that schools

and districts entered into ASSIST Scores generated using the Program Review

scoring guides/rubrics For accountability, new set of combined goals

for 2014 Date: November 2013

23

Program Review (PR) Scoring Guide24

Program Review Calculations

Each of the 3 Program Review areas (Arts & Humanities, Writing, and Practical Living) is comprised of 4 standards (Curriculum/Instruction, Formative/Summative Assessment, Professional Development, and Administrative Support).Step 1: Average the characteristic scores for a score for each standard.

Scores range from 0-3 for each standard 0–No Implementation, 1–Needs Improvement, 2–Proficient, and

3–Distinguished

Step 2: Add the 4 standard scores to get a single number for each Program Review area.

Scores range 0-12 for each Program Review area The cut score 8 is Proficient and 10.8 is Distinguished

Step 3: Add the three Program Review area scores for a total Program Review score.

Scores range between 0-36

Step 4: Divide the total number by 24 (proficient (8) x 3 areas = 24).

This number yields the percent of the 23 points earned (number of points possible in Unbridled Learning accountability model for PR when Learners and PR are combined).

25

Program Review Data Release

26

CalculationExample

Program Review Data Release Combining Next-Generation Learners and Program Review

Accountability Formula for Combining Next Generation Learners and Program Reviews

Component OverallWeighted Percent

Weighted Score

Next Gen Learners Overall Score

57.9 X 77% = 44.6

Program Reviews 75.0 X 23% = 17.3

Combined Overall

Score* 61.9

27

*Combined Overall Score used to calculate new 70th and 90th percentile cut for summer 2014 targets

Important Resources

KDE website: www.education.ky.gov

28

Important Resources29

ASSESSMENT UPDATE

Rhonda Sims, Director Division of Support and ResearchOffice Of Assessment And Accountability

rhonda.sims@education.ky.gov502-564-4394

Kentucky Department of EducationSeptember 24, 2013