Addressing School Improvement through Data, III

98
1 Presented by Dr. Yuwadee Wongbundhit, Curriculum and Instruction June 5 - 14, 2012 Addressing School Improvement through Data, III

description

Addressing School Improvement through Data, III. Presented by Dr. Yuwadee Wongbundhit, Curriculum and Instruction June 5 - 14, 2012. Topics. Independent work: a draft copy of the complete School Improvement by June 22, 2012. Assumptions:. You. NORMS. Http://osi.dadeschools.net/actiondata . - PowerPoint PPT Presentation

Transcript of Addressing School Improvement through Data, III

Page 1: Addressing School Improvement through Data, III

1

Presented by Dr. Yuwadee Wongbundhit, Curriculum and InstructionJune 5 - 14, 2012

Addressing School Improvement through Data, III

Page 2: Addressing School Improvement through Data, III

Topics

Overview• 2012 School Grade Changes • Annual Measurable Objectives• 2012 FCAT 2.0/EOC Scores

2012-13 SIP Part II: Expected

Improvements

• Current and Expected Level of Performance

• Criteria for Expected Level of Performance

Independent work: a draft copy of the complete School Improvement by June 22, 2012

Page 3: Addressing School Improvement through Data, III

Assumptions:You...

are familiar with 2012-13 SIP

are familiar with the School Grade System and FCAT 2.0/EOC

have some experience in data analysis

love, love, love data!!!

3

Page 4: Addressing School Improvement through Data, III

NORMS

4

Norms

Listen to others

Engage with the ideas presented

Ask questions

Reflect on relevance to

you

Next, set your learning

into action

Page 5: Addressing School Improvement through Data, III

Http://osi.dadeschools.net/actiondata

Designed by Nelson Suarez

Page 6: Addressing School Improvement through Data, III

2012-13 SIP Part II:Expected Improvements

Page 7: Addressing School Improvement through Data, III

2012-13 SIP Goals

Student Performance

Reading

Math/ Algebra and Geometry EOC

ScienceBiology EOC

WritingU.S. History EOC

Civics EOC7

Page 8: Addressing School Improvement through Data, III

Florida School Accountability

School Grade

•Performance Status•Annual Learning Gains

AYP• Performance Status• Performance by

subgroups

Page 9: Addressing School Improvement through Data, III

Adequate Yearly Progress (AYP) Benchmark

Year%Proficiency Targets

Reading Math

2009-10 65 68

2009-10 72 74

2010-11 79 80

2011-12 86 86

2012-13 93 932013-14 100 100

9

Page 10: Addressing School Improvement through Data, III

AYP 39 Components Criteria (NA, No, Yes)

10

GroupParticipation Met

(Tested 95%) Proficiency Met

Reading Math Reading MathTOTAL 1 1 1 1WHITE 2 2 2 2BLACK 3 3 3 3HISP. 4 4 4 4ASIAN 5 5 5 5Am. Ind. 6 6 6 6ED 7 7 7 7ELL 8 8 8 8SWD 9 9 9 9

Page 11: Addressing School Improvement through Data, III

Annual Measurable Objectives

AYP is gone.AMO is here.Annual Measurable Objectives

ESEA Flexibility Waivershttp://www.fldoe.org/esea/

Ambitious & Achievable Goal11

Page 12: Addressing School Improvement through Data, III

Transition from AYP to AMO

AMO-1• School Performance

Grade Target

AMO-2 • Reading and Math Performance Targets

AMO-3• Target for Annual Learning of

Students in the Lowest-Performing 25% in Reading and Math

AMO-4

• Benchmark Florida’s Students Performance to the Highest-Performing States and nations. This is a statewide target.

Page 13: Addressing School Improvement through Data, III

AMO vs. Differentiated Accountability

Not Linked to DA

•The AMOs are not linked to Differentiated Accountability categories.

13

School Grade ESEA Category DA CategoryA Reward

Schools that increase their grade

Reward

BC Prevent PreventD Focus CorrectF Priority Intervene

Page 14: Addressing School Improvement through Data, III

Target Performance for AMO-2

14

Annual Measurable Objective 2

(AMO 2) sets targets for

each school and subgroup

to:

•Increase % of students scoring at Levels 3-5 and reduce % of students scoring at levels 1 and 2 by 50% over six years (using 2010-11 as the baseline year).

Page 15: Addressing School Improvement through Data, III

AMO Performance Targets: 2010-11 to 2016-172016-17

AMO Target

Proficient

30+35=65%

Non-proficient

70-35=35%

2010-11PerformanceBaseline Year

Proficient (%L3-5)

30%

Non-proficient(%L1-2)

50% of 70 = 35

70%

15

The goal of AMO-2 is to reduce the % of

non-proficient by 50% over six years

(2010-11 to 2016-17).

2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17Increase %pt. 5.8 11.7 17.5 23.3 29.2 35.0

30 36 42 48 53 59 65

35÷6 = 5.83

Page 16: Addressing School Improvement through Data, III

AMO Performance Targets: 2010-11 to 2016-172016-17

AMO Target

Proficient

60+20=80%

Non-proficient

40-20=20%

2010-11PerformanceBaseline Year

Proficient (%L3-5)

60%

Non-proficient(%L1-2)

50% of 40 = 20

40%

16

The goal of AMO-2 is to reduce the % of

non-proficient by 50% over six years

(2010-11 to 2016-17).

2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17Increase %pt. 3.3 6.7 10 13.3 16.6 20

60 63 67 70 73 77 80

20÷6 = 3.33

Page 17: Addressing School Improvement through Data, III

Worksheet 1: AMO-2 TargetSchool

Baseline Year

2010-11% L3-5

Baseline Year2010-11% L1-2

Baseline Year2010-11

50% of L1-2 Annual

Increment

% AMO-2 Target at

Year 62016-17

% AMO-2 Target for

Year 22012-13

1 70%2 40%3 58%4 45%5 38%6 73%7 50%8 63%9 35%

10 20%

Page 18: Addressing School Improvement through Data, III

Worksheet 1: AMO-2 TargetSchool

Baseline Year

2010-11% L3-5

Baseline Year2010-11% L1-2

Baseline Year2010-11

50% of L1-2 Annual

Increment

% AMO-2 Target at

Year 62016-17

% AMO-2 Target for

Year 22012-13

1 70% 30 15.0 2.5 85 752 40% 60 30.0 5.0 70 503 58% 42 21.0 3.5 79 654 45% 55 27.5 4.6 73 545 38% 62 31.0 5.2 69 486 73% 27 13.5 2.3 87 787 50% 50 25.0 4.2 75 588 63% 37 18.5 3.1 82 699 35% 65 32.5 5.4 68 46

10 20% 80 40.0 6.7 60 33

Page 19: Addressing School Improvement through Data, III

OSI Website -- Http://osi.dadeschools.net

19

Direction: Go tohttp://osi.dadeschools.net/actiondata

Click on “2012-2013 School Improvement Tools”

Locate “SIP Current and Expected Results”, click on

AMO-2 SIP Targets

Page 20: Addressing School Improvement through Data, III

Annual Measurable Objective (AMO)

20

Are there consequences for not making annual progress to wards an AMO-2 target?

Page 21: Addressing School Improvement through Data, III

AMO-2 Reports

Reading and mathematics

•AMO-2 performance targets will be established separately for each subgroup and all students in reading and mathematics.

Monitoring Progress

•AMO-2 targets will be used to determined whether the students are making progress in the current year to be on track to reduce the % of levels 1 and 2 by half by 2016-17.

Not making satisfactory

progress

• Any subgroup fail to meet AMO-2 target

21

Page 22: Addressing School Improvement through Data, III

Sample of AMO-2 ReportGroup 2010-11

% L 3-5BL

2011-12AMO-2Targets

2011-12Levels

3-5

Met Target

Improved Maintained or declined

All Students 30 36 37

Am. Indian NA NA NA

Asian NA NA NA

African Am. 33 39 33

Hispanic 35 40 37

White 40 45 39

SWD 28 34 34

ED 29 35 32

ELL 25 31 32 22

X

XX

XX

XX

Not Making Satisfactory

Progress

Page 23: Addressing School Improvement through Data, III

Safe Harbor Proficiency Target

23

Safe Harbor Proficiency

Target

•The percent of non-proficient students decreased by at least 10% from the preceding year in the subject being evaluated.

Page 24: Addressing School Improvement through Data, III

AMO-2 and Safe Harbor Proficiency Targets

24

AMO-2The percent of non-proficient students decreased by 50%

over six years (using 2010-11 baseline

year)

Safe HarborThe percent of non-proficient students

decreased by at least 10% from the

preceding year

Page 25: Addressing School Improvement through Data, III

Safe Harbor Provision

Group 2010-11% L 3-5

BL

2010-11 %

Levels 1-2

10% of L1-2 from 2010-

11

2011-12Safe Harbor

Targets

2011-12% L 3-5

School Results

All 30 70 7.0 30+7.0 37 37

B 33 67 6.7 33+6.7 40 33

H 35 65 6.5 35+6.5 42 37

W 40 60 6.0 40+6.0 46 39

SWD 28 72 7.2 28+7.2 35 34

ED 29 71 7.1 29+7.1 36 32

ELL 25 75 7.5 25+7.5 33 32

Page 26: Addressing School Improvement through Data, III

AMO-2 vs. Safe Harbor

26

2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17Increase % pt. 7.0 6.3 5.7 5.1 4.6 4.1

30 37 43 49 54 59 63

2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17Increase %pt. 5.8 11.7 17.5 23.3 29.2 35.0

30 36 42 48 53 59 65

AMO-2 Targets

Safe Harbor Targets

Page 27: Addressing School Improvement through Data, III

AMO-2 Targets vs. Safe Harbor Provision TargetsGroup 2010-11

% L 3-5BL

2011-12AMO-2Targets

2011-12 Safe

Harbor Targets

2011-12% L 3-5School Results

MetAMO-2Target

Met Safe

Harbor Target

All 30 36 37 37

B 33 39 40 33

H 35 40 42 37

W 40 45 46 39

SWD 28 34 35 34

ED 29 35 36 32

ELL 25 31 33 32

YNNN

NY

Y

YNNNNNN

Page 28: Addressing School Improvement through Data, III

SIP GOALS vs. SCHOOL GRADE

Performance

Reading (goals 1-2, 5)

Math (goals 1-2, 5)Alg. & Geo (goals 1-3)

Science (goals 1-2)Biology (goals 1-2)

Writing (goal 1)

Civics and US History (goals 1-2)

Page 29: Addressing School Improvement through Data, III

SIP-Level of Expected Improvements

Performance Goals (Reading, Math, Science & Social Science)

• FCAT/EOC: %L3

• FAA: %L4-6

• FCAT/EOC: %L4 &5

• FAA %L7-9

• No FAA goals for Civics/US History

Learning Gains Goals

(Reading and Math)

• Overall

• Lowest25%

• FCAT/EOC

• FAA

Sub-Groups Performance Goals -AMO2

Reading and Math

• FCAT/EOC: %L3-5

Page 30: Addressing School Improvement through Data, III

SIP Goals for AMO-2 Reading/Math

ELL

2012Current level of

performance

35%

2013Expected level of

performance

?

White

2012Current level of

performance

68%

2013Expected level of

performance

?

30

AMO-2 Performance Targets2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

ELL 30 36 42 48 53 59 65White 60 63 67 70 73 77 80

42 70

Page 31: Addressing School Improvement through Data, III

SIP Goals for Reading/Math/Science

FCAT Level 3

2012Current level of

performance

45%

2013Expected level of

performance

?

FCAT Levels 4 and 5

2012Current level of

performance

10%

2013Expected level of

performance

?

31

AMO-2 Performance Targets2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

60 63 67 70 73 77 80

Page 32: Addressing School Improvement through Data, III

2012-13 Expected Level of Performance

FCATLevel

2010-11 % Level

2011-12 % Level

Point Gain 2012-13Target

L 3 45 ?

L 4-5 10 ?

L 3-5 60

AMO-2 Performance Targets Achievement Levels 3-52010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

60 63 67 70 73 77 80

67-55=12

12*.7=8.4

12*.3=3.6

45+8.4=53

10+3.6=14

6755

Page 33: Addressing School Improvement through Data, III

SIP Goals for Reading/Math/Science

FCAT Level 3

2012Current level of

performance

45%

2013Expected level of

performance

?

FCAT Levels 4 and 5

2012Current level of

performance

10%

2013Expected level of

performance

?

33

AMO-2 Performance Targets2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

60 63 67 70 73 77 80

45+8.4=53 10+3.6=14

Page 34: Addressing School Improvement through Data, III

SIP Goals for Reading/Math/Science

Goal 1FCAT Level 3

2012Current level of

performance

37%

2013Expected level of

performance

?

Goal 2FCAT Levels 4 and 5

2012Current level of

performance

27%

2013Expected level of

performance

?

34

AMO-2 Performance Targets2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

60 63 67 70 73 77 80

Page 35: Addressing School Improvement through Data, III

2012-13 Expected Level of Performance

FCATLevel

2010-11 % Level

2011-12 % Level

Point Gain 2012-13Target

L 3 37 ?

L 4-5 27 ?

L 3-5 60

AMO-2 Performance Targets Achievement Levels 3-52010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

60 63 67 70 73 77 80

67-64=3

3*.7=2.1

3*.3=0.9

37+2.1=39

27+0.9=28

6764

Page 36: Addressing School Improvement through Data, III

SIP Goals for Reading/Math/Science

FCAT Level 3

2012Current level of

performance

37%

2013Expected level of

performance

?

FCAT Levels 4 and 5

2012Current level of

performance

27%

2013Expected level of

performance

?

36

AMO-2 Performance Targets2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

60 63 67 70 73 77 80

37+2.1=39 27+0.9=28

Page 37: Addressing School Improvement through Data, III

SIP Goals for Reading/Math/Science

Goal 1FCAT Level 3

2012Current level of

performance

27%

2013Expected level of

performance

?

Goal 2FCAT Levels 4 and 5

2012Current level of

performance

25%

2013Expected level of

performance

?

37

AMO-2 Performance Targets2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

35 40 46 51 57 62 68

Page 38: Addressing School Improvement through Data, III

Worksheet 2: SIP Goals 1 and 2

FCATLevel

2010-11 2011-12

Point Gain 2012-13Target

%L 3 27 ?

%L 4-5 25 ?

%L 3-5 35

AMO-2 Performance Targets Achievement Levels 3-52010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

35 40 46 51 57 62 68

Page 39: Addressing School Improvement through Data, III

Worksheet 2: SIP Goals 1 and 2

FCATLevel

2010-11 2011-12 Point Gain 2012-13Target

%L 3 27 ?

%L 4-5 25 ?

%L 3-5 35

AMO-2 Performance Targets Achievement Levels 3-52010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17

35 40 46 51 57 62 68

57-52=5

5*.7=3.5

5*.3=1.5

27+3.5=30.5

25+1.5=26.5

5752

Page 40: Addressing School Improvement through Data, III

OSI Website: Http://osi.dadeschools.net

40

Page 41: Addressing School Improvement through Data, III

Worksheet 3: SIP Goals 1 and 2No. 2011

L3-52012

L32012 L4-5

2012 L3-5

AMOTarget

Total PointGainsL3-5

Point Gains

L3 (70%)

Point Gains L4-5

(30%)

2013 L3

Target

2013L4-5

Target

1 35 27 10

2 46 35 17

3 59 35 27

4 67 40 30

5 85 70 21

6 73 45 20

7 73 55 26

8 51 41 26

9 39 25 26

10 37 25 20

11 40 23 25

Page 42: Addressing School Improvement through Data, III

Worksheet 3: SIP Goals 1 and 2No. 2011

L3-52012

L32012 L4-5

2012 L3-5

AMOTarget

Total PointGainsL3-5

Point Gains

L3 (70%)

Point Gains L4-5

(30%)

2013 Target

L3

2013 TargetL4-5

1 35 27 10 37 46 9 6.3 2.7 33 13

2 46 35 17 52 55 3 2.1 0.9 37 18

3 59 35 27 62 66 4 2.8 1.2 38 28

4 67 40 30 70 73 3 2.1 0.9 42 31

5 85 70 21 91 93 2 1.4 0.6 71 22

6 73 45 20 65 78 13 9.1 3.9 54 24

7 73 55 26 81 82 1 0.7 0.3 56 26

8 51 41 26 67 71 4 2.8 1.2 44 27

9 39 25 26 51 54 3 2.1 0.9 27 27

10 37 25 20 45 48 3 2.1 0.9 27 21

11 40 23 25 48 50 2 1.4 0.6 24 26

Page 43: Addressing School Improvement through Data, III

2012-13 SIP Goals 1 and 2: Reading, Math, Science, and Algebra Goals

Goal Data Source

CurrentPerformance 2012-13 Improvement Criteria

1.%L3

2012 FCAT

%L3-5 < 95

% of 2011-12 Level 3 plus 70% of the gap performance between the 2011-12 % L3-5 and the 2012-13 AMO-2 target. If the 2012-13 AMO-2 target is lower than that of 2011-12 % L3-5, then the next higher AMO-2 target will be used.

%L3-5 >= 95 Maintain % of Level 3

2.%

L4-5

2012 FCAT

%L3-5 < 95

% of 2011-12 Levels 4-5 plus 30% of the gap performance between the 2011-12 % L3-5 and the 2012-13 AMO-2 target. If the 2012-13 AMO-2 target is lower than that of 2011-12 % L3-5, then the next higher AMO-2 target will be used.

%L3-5 >= 95 Maintain % of Levels 4-5

Page 44: Addressing School Improvement through Data, III

2012-13 SIP Goal 5 %: Reading and Math by Subgroup

Goal Data Source

CurrentPerformance 2012-13 Improvement Criteria

Goal 5(Sub-group,%L3-5)

This goal

address AMO-2.

2012 FCAT

2.0

L3-5 < 95

2012-13 AMO-2 target.

If the 2012-13 AMO-2 target is lower than that of 2011-12 % L3-5, then the next higher AMO-2 target will be used.

L3-5 >= 95 Maintain % of Level 3

2012-13 SIP Goals for geometry and biology, the 2012-13 Baseline results will be used the set for

Expected level of performance.

Page 45: Addressing School Improvement through Data, III

If all data are available, the 2012-2013

Expected Improvement Chart with the

individual school data be populated, along

with the criteria to be used for determining

the 2013 expected improvement.

45

Page 46: Addressing School Improvement through Data, III

2012-2013 School Improvement Plan Current and Expected Level of Performance

Read

ing

Mat

h/EO

C

Science/Biology

Atten

danc

e

Susp

ensio

n

Dropou

t

Preve

ntion

46

Gradua

tion

U.S History/Civics

Writing

Page 47: Addressing School Improvement through Data, III

Take a 10 minutes break

Please be back on timeThank you!

Page 48: Addressing School Improvement through Data, III

Satisfactory Performance

• FCAT 2.0: Levels 3-5• FAA: Levels 4-9Reading• FCAT 2.0: Levels 3-5• FAA: Levels 4-9• Alg. EOC/Geo. EOC: Levels 3-5

Math• FCAT 2.0: Levels 3-5• FAA: Levels 4-9• Biology EOC: Levels 3-5

Science• FCAT Writing: score of 4-6• FAA: Levels 4-9Writing

Page 49: Addressing School Improvement through Data, III

FCAT 2.0/EOC Achievement Level Policy Definitions

5. Demonstrate mastery of the most challenging content of the

NGSSS.4. Demonstrate an above

satisfactory level of success with the challenging content of the

NGSSS.3. Demonstrate a satisfactory

level of success with the challenging content of the NGSSS.

2. Demonstrate a below satisfactory level of success with

the challenging content of the NGSSS.

1. Demonstrate an inadequate level of success with the

challenging content of the NGSSS.

Page 50: Addressing School Improvement through Data, III

FCAT 2.0/EOC Achievement Level Policy Definitions

Level 1

Student has little success with the challenging content of the SSS.

Level 2

Student has limited success with the challenging content of the SSS.

Level 3

Student has partial success with the challenging content of the SSS, but performance is inconsistent.

Level 4

Student has success with the challenging content of the SSS.

Level 5

Student has success with the most challenging content of the SSS. A student scoring in Level 5 answers most of the test questions correctly, including the most challenging questions.

Demonstrate an inadequate level of success with the challenging content of the NGSSS.

Demonstrate a below satisfactory level of success with the challenging content of the NGSSS.

Demonstrate a satisfactory level of success with the challenging content of the NGSSS.

Demonstrate an above satisfactory level of success with the challenging content of the NGSSS.Demonstrate mastery of the most challenging content of the NGSSS.

FCAT FCAT 2.0 and EOC

Page 51: Addressing School Improvement through Data, III

Understanding FCAT 2.0/EOC Reports?

Understanding FCAT 2.0 and EOC Reports, Spring 201251

Page 52: Addressing School Improvement through Data, III

FCAT 1999

FCAT 2001FCAT

2002FCAT 2010

Base scale of FCAT

1996 SSS

Base scale of FCAT 2.0

2007 NGSSS

2011FCAT 2.0

Equivalent Scores

FCAT 2.0 Scores Reading/Math

52

Page 53: Addressing School Improvement through Data, III

FCAT 2.0 2014

FCAT 2.0 2013

FCAT 2.0 2012

FCAT 2.0 2011

2010-11 Baseline Year

FCAT 2.0 Scores, Reading/math

53

Page 54: Addressing School Improvement through Data, III

RawScore

V

RALA

IR

Content Area Scores

FCAT 2.0 Reading-Math Scores Raw Score

Developmental Scale Score (DSS)(140 to 302 R: G3-10)

(140 to 298 M: G3-8)

Achievement Level

(1 to 5)

V: VocabularyRA: Reading ApplicationLA: Literary AnalysisIR: Informational

Text/Research Process

Page 55: Addressing School Improvement through Data, III

2012 Grade 9, FCAT 2.0 Reading

2012 Ach. Level

2012 Content Scores by Reporting Category

2011 Scores:Level,DSS,

DSS Change

2012 DSSStudent Name and FL ID

13302522211435232828

Raw Scores

Page 56: Addressing School Improvement through Data, III

Developmental Scale Score (Reading)

G6

G10

140 302Developmental Scale Scores

Min Max

G3

Raw Score

Grade 3 Grade 10

Grade Level 1 Level 2 Level 3 Level 4 Level 53 140-181 182-197 198-209 210-226 227-260

4 154-191 192-207 208-220 221-237 238-269

5 161-199 200-215 216-229 230-245 246-277

6 167-206 207-221 222-236 237-251 252-283

7 171-212 213-227 228-242 243-257 258-289

8 175-217 218-234 235-248 249-263 264-296

9 178-221 222-239 240-252 253-267 268-302

10 188-227 228-244 245-255 256-270 271-302

Page 57: Addressing School Improvement through Data, III

Developmental Scale Score (Math)

G6

G8

140 298Developmental Scale Scores

Min Max

G3

Raw Score

Grade 3 Grade 10

Grade Level 1 Level 2 Level 3 Level 4 Level 5

3 140-182 183-197 198-213 214-228 229-260

4 155-196 197-209 210-223 224-239 240-271

5 163-204 205-219 220-233 234-246 247-279

6 170-212 213-226 227-239 240-252 253-284

7 179-219 220-233 234-247 248-260 261-292

8 187-228 229-240 241-255 256-267 268-298

Page 58: Addressing School Improvement through Data, III

RawScore

C1

C2C3

C4

Content Scores

2012 FCAT 2.0 ScienceRaw Score

Equivalent Achievement

Level(1 to 5)

Equivalent Scale Score

(100 - 500)

58

Page 59: Addressing School Improvement through Data, III

Raw Score

T-Score Scale(20 to 80)

Statewide Comparison by

Thirds

RawScore C1

C2

C3

Content Scores

Geometry and Biology EOC Scores

Statewide by Thirds

T-Score Scale Range

1 20-452 46-543 55-80

Page 60: Addressing School Improvement through Data, III

60

Test

For

m

Scal

e Sc

ore Statewide

Comparison

Points Earned by Content

Area

1 2 3

Student Name and ID

Page 61: Addressing School Improvement through Data, III

2012 Geometry EOC Scale Distribution - Statewide

61

20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 800

1000

2000

3000

4000

5000

6000

7000

8000

9000

2012 Geometry EOC Distribution

EOC Scale Scores

Num

ber o

f Stu

dent

s 35% of Students at the bottom third (MDCPS: 44%)

34% of Students at the top third(MDCPS: 27%)

Statewide by Thirds T-Score Scale Range1 20-452 46-543 55-80

Page 62: Addressing School Improvement through Data, III

2012 Biology EOC Scale Distribution - Statewide

62

20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 800

1000

2000

3000

4000

5000

6000

7000

8000

9000

2012 Biology EOC Distribution

EOC Scale Scores

Num

ber o

f Stu

dent

s 34% of Students at the bottom third (MDCPS: 41%)

35% of Students at the top third(MDCPS: 29%)

Statewide by Thirds T-Score Scale Range1 20-452 46-543 55-80

Page 63: Addressing School Improvement through Data, III

RawScore C1

C2

C3

Algebra Content Scores

2012 Algebra 1 EOC ScoresRaw Score

EOC Scale Score(325 - 475)

Achievement Level(1 to 5)

Source: FL DOE/Office of Assessment

Level 1 Level 2 Level 3 Level 4 Level 5325-374

(49)375-398

(23)399-424

(25)425-436

(11)437-475

(38)

Page 64: Addressing School Improvement through Data, III

2012 Content Scores

64

Page 65: Addressing School Improvement through Data, III

2012 Grade 9, FCAT 2.0 Reading

2012 Ach. Level

2012 Content Scores by Reporting Category

2011 Scores:Level,DSS,

DSS Change

2012 DSSStudent Name and FL ID

13302522211435232828

Raw Scores

Page 66: Addressing School Improvement through Data, III

Worksheet 4: Calculate the % correct for each content area.

SchoolPoints Earned By Content Area % Correct By Content Area

Content 1 Content 2 Content 3 Content 4 Content 1 Content 2 Content 3 Content 4

Number of Points Possible 7 21 11 6  

1 6 17 8 52 5 17 9 53 4 12 7 34 4 13 6 35 5 17 9 56 6 18 9 57 4 13 7 38 4 14 7 49 4 13 7 4

10 5 14 7 411 4 12 7 412 3 10 5 213 4 13 7 314 4 13 7 415 4 11 6 316 4 14 7 417 4 12 7 318 3 11 6 319 4 12 6 320 4 13 6 321 5 13 7 322 5 13 7 423 6 17 9 524 4 12 7 325 5 13 7 3

66

Page 67: Addressing School Improvement through Data, III

Worksheet 4: Calculate the % correct for each content area.

StudentPoints Earned By Content Area % Correct By Content Area

Content 1 Content 2 Content 3 Content 4 Content 1 Content 2 Content 3 Content 4

Number of Points Possible 7 21 11 6  

1 6 17 8 5 86% 81% 73% 83%2 5 17 9 5 71% 81% 82% 83%3 4 12 7 3 57% 57% 64% 50%4 4 13 6 3 57% 62% 55% 50%5 5 17 9 5 71% 81% 82% 83%6 6 18 9 5 86% 86% 82% 83%7 4 13 7 3 57% 62% 64% 50%8 4 14 7 4 57% 67% 64% 67%9 4 13 7 4 57% 62% 64% 67%

10 5 14 7 4 71% 67% 64% 67%11 4 12 7 4 57% 57% 64% 67%12 3 10 5 2 43% 48% 45% 33%13 4 13 7 3 57% 62% 64% 50%14 4 13 7 4 57% 62% 64% 67%15 4 11 6 3 57% 52% 55% 50%16 4 14 7 4 57% 67% 64% 67%17 4 12 7 3 57% 57% 64% 50%18 3 11 6 3 43% 52% 55% 50%19 4 12 6 3 57% 57% 55% 50%20 4 13 6 3 57% 62% 55% 50%21 5 13 7 3 71% 62% 64% 50%22 5 13 7 4 71% 62% 64% 67%23 6 17 9 5 86% 81% 82% 83%24 4 12 7 3 57% 57% 64% 50%25 5 13 7 3 71% 62% 64% 50%

67

Page 68: Addressing School Improvement through Data, III

Annual Learning Gains

Page 69: Addressing School Improvement through Data, III

2012-13 SIP Reading/Math Goals 3-4Students Making Annual Learning Gains

Goals Data Source Current Performance Expected Improvement Criteria

Goal 3: Overall Learning Gains

Goal 4: Learning Gains for Lowest25 %

(This is AMO-3)

2012 School Grade

0-80% Increase by 10 percentage points

81-100% Maintain

Goals Description

Reading2012

Current Performance

2013 Expected Performance

3 Overall Learning Gains 80% (140)

90% (158)

4 Low25 % Learning Gains

74% (32)

84% (37)

Page 70: Addressing School Improvement through Data, III

2011FCAT

Annual Learning Gains

2012 CurrentFCAT

School Year

Fall Interim Assessment

Winter InterimAssessment

Baseline.

Annual Learning Gains

Performance

Performance

Page 71: Addressing School Improvement through Data, III

What’s New/Change on Learning Gains

All Schools• Students must be

full-year-enrolled.• Must have current

and prior-year test scores (FCAT 2.0, EOC Assessment scores, or Florida Alternate Assessment)

• FCAT 2.0• Reading, G3-10• Math, G3-8

• EOC: Alg. & Geo.• FAA

High School• The first EOC score earned during high school is used for performance and learning gains.

• 9th grade students’ Alg. scores will be compared with their prior-year FCAT 2.0 math scores

• Geo. EOC score will be compared with a prior-year Alg. EOC (2013-14)

Middle School• If a student has

both an FCAT 2.0 and EOC, the learning gains calculation will be applied using both scores.

• Student will be counted as making learning gains if the student makes gains in either calculation

Page 72: Addressing School Improvement through Data, III

72

Additional Points on Annual Learning Gains

Move up one or more level to level 4 will be counted at a weight of 1.1 in the numerator of the learning gain calculation

Move up one or more level to level 5 will be counted at a weight of 1.2 in the numerator of the learning gain calculation

Students who have prior-year FCAT 2.0 scores at levels 1 or 2, and SWDs who have prior-year FAA scores at level 1, 2, or 3 will be weighted 1.1 if they increase their score by at least 33% greater than the min. amount of increase that would be required on the FCAT 2.0 DSS or on the FAA scores to qualify for learning gains.

Page 73: Addressing School Improvement through Data, III

Min. Required DSS Gains for Prior-Year FCAT 2.0 Level 1 and 2 to Earn 1.1 Points

Prior -Year Grade to Current Grade

Point Earned

Reading DSS Gains Math DSS Gains

Level 1 Level 2 Level 1 Level 2

3 to 3, 3 to 44 to 4

1.0 12 11 16 151.1 16 15 22 20

4 to 55 to 5

1.0 10 9 10 91.1 14 12 14 12

5 to 66 to 6

1.0 9 8 10 91.1 12 11 14 12

6 to 77 to 7

1.0 8 7 9 81.1 11 10 12 11

7 to 88 to 8

1.0 7 6 11 101.1 10 8 15 14

8 to 99 to 9

1.0 6 51.1 8 7

9 to 1010 to 10

1.0 8 71.1 11 10

Page 74: Addressing School Improvement through Data, III

74

3-Ways to Make Annual Learning Gains

1. Improve achievement level

FCAT 2.0 Achievement Level

EOC Assessment Achievement Level

FAA Performance Level

Page 75: Addressing School Improvement through Data, III

Annual Learning Gains for FCAT 2.0

Page 76: Addressing School Improvement through Data, III

Additional Weight for DSS Gains

Example: A 4th grader scoring at level 1 in prior-year would need to increase score by at least 16 DSS points to qualify

for 1.1. (12+ 33% more than 12 = 16)

1.1 Points1.0 Points

Page 77: Addressing School Improvement through Data, III

Annual Learning Gains for EOC

Page 78: Addressing School Improvement through Data, III

Annual Learning Gains for FAA

Page 79: Addressing School Improvement through Data, III

Level 5

2011 FCAT 2.0 Level

2012 FCAT 2.0 Level

Level 4

Level 3

Level 5

Level 3

Level 3

Level 1

Level 2

Level 1

Level 2

-2

5

-8

11

5

DSS Change

2012 LG?

?

?

?

?

?

Y

N

Y

N

N

Reading Learning Gains

3

2011 FCAT Tested Grade

2012 FCAT Tested Grade

6

9

4

7

10

3

10

3

10

Page 80: Addressing School Improvement through Data, III

Student2011

Tested Grade

2012Tested Grade

2011 FCAT 2.0 DSS

2012 FCAT 2.0 DSS

2011 FCAT 2.0 Level

2012 FCAT 2.0 level DSS Change 2012 LG

Points2012 PF

Point

1 10 10 215 219 1 1 4 2 9 10 221 245 1 3 24 3 9 9 231 235 2 2 4 4 3 4 225 221 4 4 -4 5 7 8 230 NM 2 NA 6 9 10 250 256 3 4 6 7 3 4 185 210 2 3 25 8 6 7 238 240 4 3 2 9 4 5 230 247 4 5 17

10 10 10 240 244 2 2 4 11 5 6 210 217 2 2 7 12 4 5 221 227 4 3 6 13 8 9 241 224 3 2 -17 14 6 7 225 260 3 5 35 15 3 3 145 158 1 1 13 16 7 8 250 249 4 4 -1 17 10 10 225 228 1 2 3 18 5 6 205 237 2 4 32 19 7 8 175 181 1 1 6 20 8 9 245 242 3 3 -3 21 8 9 269 256 5 4 -13 22 5 6 162 170 1 1 8 23 4 4 179 190 1 1 11 24 6 7 200 215 1 2 15 25 8 9 296 277 5 5 -19

Worksheet 5: Learning Gains – FCAT 2.0 Reading

Page 81: Addressing School Improvement through Data, III

Student2011

Tested Grade

2012Tested Grade

2011 FCAT 2.0 DSS

2012 FCAT 2.0 DSS

2011 FCAT 2.0 Level

2012 FCAT 2.0 level DSS Change 2012 LG

Points2012 PF Points

1 10 10 215 219 1 1 4 0 02 9 10 221 245 1 3 24 1.1 13 9 9 231 235 2 2 4 0 04 3 4 225 221 4 4 -4 1 15 7 8 230 NM 2 NA NA 06 9 10 250 256 3 4 6 1.1 17 3 4 185 210 2 3 25 1.1 18 6 7 238 240 4 3 2 0 19 4 5 230 247 4 5 17 1.2 1

10 10 10 240 244 2 2 4 0 011 5 6 210 217 2 2 7 0 012 4 5 221 227 4 3 6 0 113 8 9 241 224 3 2 -17 0 014 6 7 225 260 3 5 35 1.2 115 3 3 145 158 1 1 13 1 016 7 8 250 249 4 4 -1 1 117 10 10 225 228 1 2 3 1 018 5 6 205 237 2 4 32 1.1 119 7 8 175 181 1 1 6 0 020 8 9 245 242 3 3 -3 1 121 8 9 269 256 5 4 -13 0 122 5 6 162 170 1 1 8 0 023 4 4 179 190 1 1 11 0 024 6 7 200 215 1 2 15 1.1 025 8 9 296 277 5 5 -19 1 1

Worksheet 5: Learning Gains – FCAT 2.0 Reading

Page 82: Addressing School Improvement through Data, III

Lowest 25% Learning Gains

Page 83: Addressing School Improvement through Data, III

What’s New/Change on Learning Gains Low 25%

FCAT 2.0 Level 3 students will be removed from the Low 25% group

Retained students at FCAT 2.0 Levels 1 and 2 will be added to the low 25% group.

Suspend the adequate progress requirements for reading and math in 2011-12 .

AMO-3 of ESEA Flexibility

Page 84: Addressing School Improvement through Data, III

Adequate Progress Criteria for the Low25%

Made Learning Gains

50% - 100%

Between40% to 49%

Below 40%

Made adequate progress

Higher than that of prior year by 1 percentage point

Made adequate progressAND

Higher than that of prior year by 5 percentage points

Made adequate progressAND

Page 85: Addressing School Improvement through Data, III

To avoid having the school grade reduced:

• Must show adequate progress of the low25% in both reading and math for the current year

School Grade

A

• Must show adequate progress of the low25% in both reading and math for either the current or previous year

School Grades B or C

2012R

2012M

2013R

2013M

School Grade A

No No Yes Yes

School Grades B or C

Yes No No Yes

No Yes Yes No

Yes Yes

Meet Adequate Progress Criteria for the Low25%?

Suspend the adequate progress requirements for reading and math in

2011-12

Page 86: Addressing School Improvement through Data, III

2012-13 SIP Writing Goal 1Goal Data

SourceCurrent

Performance 2013 Improvement Criteria

1 2012 FCAT

Writing

0-80% (Levels 3-6) Increase by 10 percentage points

81% - 89%(Levels 3-6) Increase by 1 percentage point

P90-100 (Levels 3-6) Maintain

Goal Description

Writing2012

CurrentPerformance

2013 Expected Performance

1 % FCAT WritingLevels 3.0 to 6.0

65% (30)

75% (49)

Page 87: Addressing School Improvement through Data, III

Updated on School Grade as of now

Page 88: Addressing School Improvement through Data, III

Elem. & Combination Schools up to grade 7School Grade of 800 Points

% of students performing at or above satisfactory level of

success

Reading – 100

Math – 100

Science – 100

Writing – 100

% of student making annual learning gains

Reading - 200• Overall - 100• Low 25% - 100

Math - 200• Overall - 100• Low 25% - 100

F: 0-394; D: 395-434; C: 435-494; B: 495-524, A: 525-800

Page 89: Addressing School Improvement through Data, III

2011-12 through 2013-14 School Grade:Middle School (900 Points)

% of students performing at or above satisfactory level of

success

Reading – 100

Math – 100

Science – 100

Writing – 100

% of student making annual learning gains

Reading - 200• Overall - 100• Low 25% - 100

Math - 200• Overall - 100• Low 25% - 100

F: 0-444; D: 445-489; C: 490-559; B: 560-589, A: 590-900

Algebra EOC – 100• Participation - 50• Performance - 50

Page 90: Addressing School Improvement through Data, III

2011-12 High School GradeFCAT Component (800 points)

• Reading (100 Points)• Math (100 Points)• Writing (100 Points)

Meeting High Standards

• Reading (200 Points)• Math (200 Points)

Making Learning Gains

• Reading• Math

FCAT Retake Bonus Point (10 Points)

Non-FCAT (800 points)

• Overall (200 points)• At Risk (100 points)

Graduation

• Participation (150 Points)• Performance (150 Points)

Acceleration Courses

• Reading (100 Points)• Math (100 Points)

Readiness (200 Points)

F: 0-789; D: 790-869; C: 870-989; B: 990-1049, A: 1050-1600

Page 91: Addressing School Improvement through Data, III

Data Analysis

Page 92: Addressing School Improvement through Data, III

Digging into Data

Vocabulary (45%)

LA.5.1.6.7(49%)

Base Words

Items: 2, 5, 655%, 20%,

45%

Root

Items: 4, 1070%, 40%

LA.A.5.1.6.3(48%)

LA.5.1.6.8(41%)

Antonyms

Items: 2, 7, 8, 11

Synonyms

Item 2415%

Reporting Category Analysis

Benchmark Analysis

Item Analysis

Identified Students

Content Focus

Page 93: Addressing School Improvement through Data, III

Disaggregated Data

Grade Level by Content Area

FCAT Level

Subgroup

Grade Level by Content Area

Teacher

Classroom,Period

Page 94: Addressing School Improvement through Data, III

Analyzing Student Progress

Baseline

Aug. 2011

Fall IA

Oct. 2011

Jan. 2012

2012FCAT2.0

EOC

Apr./May

2012

Winter IA

PG Q1 PG Q2All All

Page 95: Addressing School Improvement through Data, III

Data Analysis Scheme (G3-8)Grade 3/6

BL, FIA, WIA, FCAT2010-11Grade 4/7

BL, FIA, WIA, FCATGrade 5/8

BL, FIA, WIA, FCAT

Grade 3/6BL, FIA, WIA, FCAT2011-12

Grade 4/7BL, FIA, WIA, FCAT

Grade 5/8BL, FIA, WIA, FCAT

Grade 3/6BL, FIA, WIA, FCAT2012-13

Grade 4/7BL, FIA, WIA, FCAT

Grade 5/8BL, FIA, WIA, FCAT

Page 96: Addressing School Improvement through Data, III

2011-2012 Ideal Data File

98

2011-2012

Data File

2012 Demographics Information

2011 FCAT Scores

2012 Interim Assessments,

FAIR

2012 FCAT2.0 and EOC Scores

2012 Student Academic

2011 & 2012 Student

Accountability Information

Page 97: Addressing School Improvement through Data, III

Formulate key questions Obtain data to answer them Find the storyline to bring it all together Determine priority areas for action Share the data with the staff Seek technical assistance if needed Celebrate your achievement results! Use the data to communicate, inform, provoke,

and persuade ... and Improve Your System!

Tips for Analyzing Data

Page 98: Addressing School Improvement through Data, III

100