1

Directions I Give?Answers I Want?Time I Need?Analysis I Can Use?

How Can Data Help You Improve Instruction…Today?

Science and Engineering TeamJuly 10, 2009

2

Outcomes

Evaluate different sources of data that can be used guide instruction and to meet the needs of all students.

Review tools available to collect, organize, and analyze data on a daily, weekly, and by unit basis.

Discuss how to guide department level discussion on the value of using targeted assessment data to guide instruction.

3

As you view the data, ask…

Does this data tell me anything about instruction?

Does this data tell me anything about student thinking?

Does this data tell me anything about how to invest my time?

Does this data give me anything I can use?

4

What does this data tell us?

Who Has Attended School? Who Has Taken All HSA Tests?

5

What does this data tell us?

Who is Taking HSA Who is Passing HSA

Biology Test by 11th? Biology Test by 11th?

Did Not Take

Did Not Pass

Taken and Passed

6

What does this data tell us?

Who is Passing HSA Who is Passing HSA Biology Test in 10th? Biology Test by 11th?

Did Not Take

Did Not Pass

Taken and Passed

7

What does this data tell us?

Who in MCPS is Passing Who in Maryland is Passing HSA Biology Test by 11th? HSA Biology Test by 11th?

8

What does this data tell us?

Grade 5 MSA Science vs. Grade 8 MSA Science

9

How does MDK12.org data help us?

Should we be concerned with the student understanding of the content?

Should we be concerned with teacher clarity of instruction?

Should we be concerned with the phrasing of questions or test format?

Should we be concerned with the _______?

Where is the data we can use to help kids learn?

10

What does this data tell us?

Achievement Series Achievement Series

by Question by Indicator

11

How does Achievement Series data help me if…

I don’t teach high school biology? I don’t teach high school science? I only give a quiz? I want to plan for tomorrow?

Where is the data that helps me help kids learn NOW?

12

Grade 5 Summative AssessmentsA Case Study

Do the unit lessons provide students the content necessary for success on the summative assessment?

Do the assessment questions ask for the right information?

Do the assessment answers align to what the students are taught and required to know?

13

How can I EASILY collect data on my assessments?

1.Develop targeted SR assessment items linked to indicators.

2.Use Scantron bubble sheets to collect data.

3.Use Scantron “Detailed Test Analysis” sheets to disaggregate data.

4.Enter data into spreadsheet template.

5.Review, reflect, reteach.

Scantron Directions

Spreadsheet

14

What does this data tell me?

Detailed Test Analysis Using Scantron and Excel

15

Question 1: The data tells me…

Instruction needs to align to indicator language.

Top Distracters

16

Question 7 : The data tells me…

Instruction needs to review that weight is NOT a force. It is determined by force of gravitygravity.

Top Distracter

17

Question 17 : The data tells me…

Instruction needs to provide opportunities to challenge the misconception…Again.

Top Distracter

18

What does this IS6 data tell me?In groups, review the questions identified.

Detailed Test Analysis Using Scantron and Excel

Test Data on Selective Response Questions for IS 6 Butterfly Habitat

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%

50%

55%

60%

65%

70%

75%

80%

85%

90%

95%

100%

1 2 3 4 5 6 7 8 9

Question Number: Correct Answer in Solid Black

Perc

en

t C

ho

osin

g R

esp

on

se

Series1 Series2Series3 Series4

1 2 3 11 14 19 30 39 44

Assessment QuestionsClick for Link

19

How can I EASILY collect data on my daily instruction?

1. Develop targeted SR assessment items linked to indicators.

2. Present the questions to students before, during, and/or after instruction.

3. Use Promethean board and ACTIVote to collect data.

4. Review, reflect, reteach.

20

What does this data tell me?

PRETTY MUCH NOTHING.

21

This data connects:Question, Collection, Discussion…

IMMEDIATELY!

22

This data shows me:Everybody, Somebody, or Nobody…

NEEDS Reteaching.

Naming Eggs

Updating Naming Eggs

23

Reflection… Is data available? Is data useful? Is data available in a format that is useful? Is it possible for teachers to create and

manage their own data? Is it worth the time?

How can this be used back in your school?

24

.

Questions?