Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration &...

39
Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP

Transcript of Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration &...

Page 1: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007

MEAP Reporting

2007 OEAA Conference

Jim Griffiths – Manager, Assessment Administration & Reporting

Sue Peterman - Department Analyst, MEAP

Page 2: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 2

What is the MEAP?

• MEAP Fall Administration–Grades 3 – 9

• English Language Arts, Grades 3 – 8

• Mathematics, Grades 3 – 8

• Science, Grades 5 and 8

• Social Studies, Grades 6 and 9

Page 3: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 3

What is the MEAP?

• English Language Arts– GLCE coverage is limited by the fact that we

use intact, authentic texts

• Mathematics– Core GLCEs are covered by 3 items– Extended and Future Core GLCEs are covered

by one item each (spiraled across forms)– Future Core items are scored but do not count

toward student performance levels

Page 4: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 4

What is the MEAP?

• Science– Benchmarks are covered over a 3-year

period, to the extent possible

• Social Studies– Strands are covered in a fixed blueprint

each year– Benchmarks are covered over a 3-year

period, to the extent possible

Page 5: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 5

MEAP Performance Levels

• New Performance Level Descriptors for Fall 2007– Level 1: Advanced

– Level 2: Proficient

– Level 3: Partially Proficient

– Level 4: Not Proficient

Page 6: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 6

MEAP Performance Levels

• Level 1: Advanced–The student’s performance exceeds

grade level expectations and indicates substantial understanding and application of key concepts defined for Michigan students. The student needs support to continue to excel.

Page 7: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 7

MEAP Performance Levels

• Level 2: Proficient–The student’s performance indicates

understanding and application of key grade level expectations defined for Michigan students. The student needs continued support to maintain and increase proficiency.

Page 8: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 8

MEAP Performance Levels

• Level 3: Partially Proficient–The student needs assistance to

improve achievement. The student’s performance is not yet proficient, indicating a partial understanding and application of the grade level expectations defined for Michigan students.

Page 9: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 9

MEAP Performance Levels

• Level 4: Not Proficient– The student needs intensive intervention

and support to improve achievement. The student’s performance is not yet proficient and indicates minimal understanding and application of the grade level expectations defined for Michigan students.

Page 10: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 10

Progress Reporting

• Implementation of MEAP performance level changes– Fall 2006: Descriptive reports

– Fall 2007: Evaluative reports

Page 11: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 11

Progress Reporting

• Fall 2006: Descriptive reports–Student transitions from one

performance level to another from one grade to the next

–Individual and parent reports and school aggregate reports

Page 12: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 12

Progress Reporting

• Fall 2007: Evaluative reports– Fall 2006 information– Performance level change for

individual students: Significant Improvement (SI) Improvement (I) No Change (N) Decline (D) Significant Decline (SD)

Page 13: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 13

Progress Reporting

• Fall 2007: Evaluative reports–Add for schools: Year-to-Year

Transitions indicating percentages of students achieving each level of performance

Page 14: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 14

Types of Reports

• Individual Student Data– Parent Report

– Individual Student Report

– Student Labels

– Class Roster

– Student Data File

Page 15: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 15

Types of Reports

• Aggregate Data– Summary reports

School, District, State level

Feeder school reports

– Demographic reports School, District, State level

– Comprehensive report District, ISD level

Page 16: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 16

MEAP Parent Report

• Includes all MEAP subjects (reading, writing, total ELA, mathematics, science, social studies)

• Front cover– Scale scores– Current and previous year performance levels and performance

level change

# Science/social studies are not measured in every grade, so year-to-year progress cannot be reported.

**The writing assessment is not long enough to precisely categorize students’ year-to-year progress.

Page 17: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 17

MEAP Parent Report

• Inside– Explanations– Strand and/or domain information– Graphical representations– Student Performance Level Change (math, reading,

total ELA)

Page 18: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 18

MEAP Parent Report

• Expanded reports (Fall 2007)– Fall 2006 performance information plus…

– Performance Level Change• Significant Improvement (SI)

• Improvement (I)

• No Change (N)

• Decline (D)

• Significant Decline (SD)

Page 19: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 19

MEAP Reports

Low Mid High Low Mid High Low Mid High Low Mid HighLow N I I SI SI SI SI SI SI SI SI SIMid D N I I SI SI SI SI SI SI SI SIHigh D D N I I SI SI SI SI SI SI SILow SD D D N I I SI SI SI SI SI SIMid SD SD D D N I I SI SI SI SI SIHigh SD SD SD D D N I I SI SI SI SILow SD SD SD SD D D N I I SI SI SIMid SD SD SD SD SD D D N I I SI SIHigh SD SD SD SD SD SD D D N I I SILow SD SD SD SD SD SD SD D D N I IMid SD SD SD SD SD SD SD SD D D N IHigh SD SD SD SD SD SD SD SD SD D D N

Not Proficient

Partially Proficient

Advanced

Proficient

Proficient

Fall 2006 Achievement

Fall 2007 AchievementNot

ProficientPartially

Proficient Advanced

Page 20: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 20

MEAP Reports

• Report performance level change example:– Fall 2006 Performance: Mid Basic (level 3)

– Fall 2007 Performance: High Proficient (level 2)

– Performance level change: Significant Improvement (SI)

Page 21: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 21

MEAP Individual Student Report

– Includes all MEAP subjects– Student demographics– Includes overall and specific MEAP scores

• Scale scores• Performance levels – current and previous year• Performance Level Change• Sub-scores (e.g. domains, benchmarks)

– Includes constructed response data• Essay scores, condition/comment codes

Page 22: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 22

MEAP Individual Student Report

• Performance Levels–Current and previous year’s

performance levels

–Plus performance level change (SI, I, N, D, SD)

Page 23: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 23

MEAP Individual Student Report

Page 24: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 24

MEAP Student Label

Performance Level Change (Significant Improvement, Improvement, No Change, Decline, Significant Decline) may be included on labels beginning Fall 2007

Page 25: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 25

MEAP Class Roster

• Separate reports for each subject• One line for each student• Includes overall and specific MEAP scores

– Scale score– Performance levels – previous and current year– Sub-scores (e.g. benchmarks, domains, GLCEs)

• Progress reporting– Performance levels previous & current year– Fall 2007 progress information plus performance level

change (SI, I, N, D, SD)

Page 26: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 26

MEAP Class Roster

Page 27: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 27

MEAP Summary Report

• Includes all MEAP subjects aggregated to the school, district, and state levels

• Achievement summary (4 years of data)– Scale scores– Performance levels

• Performance level change– Summary– Year-to-Year Transitions

Page 28: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 28

MEAP Summary Report

• Summary reports also include one-year summary data on student progress– Student transitions (in performance levels) from one grade

to the next

– Fall 2006: Descriptive reports of transitions from one performance level to another in one grade to the next

– Fall 2007: Performance Level Change (percent attaining SI, I, N, D, SD)

• Feeder school reports are the same as summary reports without the progress information

Page 29: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 29

MEAP Summary Report

Page 30: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 30

MEAP Comprehensive Report

• Includes all MEAP subjects aggregated to the district and ISD levels– One year summaries of scale scores and performance

levels

• District summaries– One summary line for the entire district– A summary line for each school in the district

• ISD summaries– One summary line for the entire ISD– A summary line for each district in the ISD

Page 31: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 31

MEAP Comprehensive Report

Page 32: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 32

MEAP Demographic Report

• Includes all MEAP subjects aggregated to the school, district, and state levels

• One-year summaries of data on student performance– Scale scores– Performance levels

• Disaggregated by all NCLB reporting subgroups

Page 33: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 33

MEAP Demographic Report

Page 34: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 34

MEAP Demographic Report

Page 35: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 35

Student Data Files

• Where to find and download–OEAA Secure Site

• Student Test Scores

• Select Test Cycle–Report Type

–Grade

–ISD, District, School

Page 36: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 36

Student Data Files

• Where to find and download links for

–Guide to Reports

–Released Items

–Score Categories and Scale Score Ranges

–Student Data File Format

Page 37: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 37

Student Data Files

• Use file to create reports as desired• Comma delimited file (CSV) will open

directly into Excel – Student level data with

• Scale scores• Performance level• Raw score points • Subject area strand points

Page 38: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 38

Presenter contact information

Jim GriffithsManager, AssessmentAdministration & [email protected]

Sue PetermanDepartment Analyst, [email protected]

Page 39: Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.

Fall 2007 39

Program contact information

Office of Educational Assessmentand Accountability

(877) 560-8378

[email protected]