Classroom Assessment for

Student Learning

March 2009

Assessment Critiquing

Today’s outcomes

Review new ISS learning triangle

Review Key 3: Sound design: Stages of Assessment development

Understand bias, how bias looks in an assessment

Critique an assessment (CFA) for sound design

Pre-HYIS input re: graphic organizers

Keys to Quality Classroom Assessment

Clear PurposesWhy Assess?

What’s the purpose?Who will use results?

Clear TargetsAssess What?

What are the learning targets?Are they clear?Are they good?

Good DesignAssess How?

What method?Sampled how?

Avoid bias how?

Sound CommunicationCommunicate How?

How manage information?How report?

Accurate Assessment

Effectively Used

Student InvolvementStudents are users, too.

Students need to understand learning targets, too.Students can participate in the assessment process, too.

Students can track progress and communicate, too.

Overview of Stages in Assessment Development

All assessments, regardless of method selected, go through the same five stages of development:

1. Planning

2. Developing

3. Critiquing

4. Administering

5. Revising

Stage One - Planning

Assess WHY? Determine the intended use of an

assessment Identify the learning targets to be assessed Select the proper assessment method

Stage Two - Developing

Select or create test items or tasks Select or create scoring mechanisms (rubric,

scantron, etc.)

**we used the test planning document for this.

Stage Three - Critiquing

Evaluate to avoid bias or misrepresentation

Today’s focus!

Today’s focus: Critique A Working Definition

Going back over the assessment to see if you have completed or addressed all the necessary components of sound assessment design.

Looking for BiasWorking Definition of Bias

Anything in the assessment, or the conditions under which the assessment was given, including student barriers, that would lead to inaccurate measurements of student learning.

See handout

Critiquing activity

Get with your PLC members. **If you’re in a virtual PLC, find another VPLC

person to work with or sit in with a small PLC group.

Each PLC should use one check-off sheet to critique your CFA. (VPLC—use a sep. sheet)

Basic Components of Sound Assessment Design1. Are the student learning targets that are being measured by the

assessment stated? Clear?2. Is there a match between the stated learning targets and what is ON

the assessment?3. Does the method used match the target being assessed?4. Does the number of items for each target give you the information that

you need to determine student mastery of the target?5. Is the amount of instructional time spent on each target reflected in the

assessment?6. Is there anything in the assessment or conditions under which

administered that could lead to inaccurate estimates of student learning?

7. Will accommodations made for diverse student characteristics result in any distortions in the final judgment of student learning?

8. Are instructions present, clear, concise?

Question 1

Are the student learning targets measured by the assessment stated? Are they clear?

Look at samples provided. Now look at YOURS.

If the answer is yes, put a check in the box. If it’s no, then make notes as to how

you will make corrections.

Question 2

Is there a match between the stated learning targets and what is ON the assessment?

Look at samples provided. Now look at YOURS.

If the answer is yes, put a check in the box. If it’s no, then make notes as to

how you will make corrections.

Question 3

Does the method used match the target being assessed?

Look at the test planning document and your curriculum guide.

Now look at your CFA. If the answer is yes, put a check in the box. If it’s no, then make notes as to how you will make corrections.

Question 4

Does the number of items for each target give you the information that you need to determine student mastery of the target?

Look at samples provided. Now look at YOURS.

If the answer is yes, put a check in the box. If it’s no, then make notes as to how you will

make corrections.

Planning Backwards:Utilize Your “Planning To Assess” Document to ensure proper Sampling, representation and balance

Target Target Type (K, R, S, P)

Assessment Method (SR, PC,

EWR, PFA)

Percent of Importance In

The Overall Unit/Section

Number Of Assessment Questions Needed To

Measure This Target

1.

2.

3.

4.

5.

6.

You can also take a look at the key with the objectives connected to the answers or the test itself to see if there is a match.DASH reports also give you good information on this question as well!

XXXXXX Predictive Assessment Answer Key Ans Goal 1. B NC 1.01 2. D NC 1.01 3. C NC 1.01 4. B NC 1.01 5. D NC 1.02 6. C NC 1.02 7. A NC 1.02 8. B NC 1.02 9. C NC 1.02 10. C NC 1.02 11. B NC 1.02 12. A NC 1.03 13. B NC 1.03 14. A NC 1.03 15. D NC 1.03 16. B NC 2.01 17. A NC 2.01 18. C NC 2.01 19. D NC 2.01 20. D NC 2.02 21. C NC 2.02 22. C NC 2.02 23. C NC 2.02 24. D NC 2.02 25. B NC 2.02 Use this information to determine whether the balance and sampling of all objectives is accurate…..

Question 5

Is the amount of instructional time spent on each target reflected in the assessment?

Question 6

Is there anything in the assessment or conditions under which administered that could lead to inaccurate estimates of student learning?

Bias? (see handout)

Question 7

Will accommodations made for diverse student characteristics result in any distortions in the final judgment of student learning

Bias? (see handout)

Question 8

Are instructions present, clear, concise?

Stage Four - Administering

Simply administer the assessment to students

This will happen between this session and our April CASL training session scheduled for 4.28.09

Stage Five - Revising

Problems with questions Problems with tasks Problems with scoring

This will happen during our last CASL training session on April 28th.

CASL Content Connects to the Following NC Professional Teaching Standards:

Standard II bStandard III a, bStandard IV a, b, c, hStandard V a, b, c

Standard II b - Teachers strive to understand how a student’s culture and background may influence her school performance.

Knowing how to assess - Assessment should be sensitive to cultural bias/be careful of wording on assessment (possible example: writing prompt on American Patriotism - ESL students could not write to this prompt because they were not born in America and came when they were much older, so they could not write to the prompt because it would not be meaningful to them.) Assessment bias is the focus on our CASL session in March.

Standard III a –Teachers develop and apply strategies.

Assessment development is a strategy teachers use to help students understand performance on requirements and is a strategy used to inform instruction.

Standard III b – Teachers know there subject beyond what they are required to teach.

Teachers know their content when they are able to design an assessment that accurately measures student achievement levels on identified content, reviews previously learned content, and previews content not yet taught.

Standard IV a – Teachers keep abreast of evolving research about student learning. They adapt resources to address to address the strengths and weaknesses of their students.

CASL is a research based best practice on how to improve assessment development, analysis, and providing feedback. With CASL, we are learning how to identify strengths and weaknesses in our own assessments, adapting our own resources to better inform ourselves and our students regarding their academic achievement.

Standard IV b – Teachers use a variety of data sources short and long term based on NCSCOS. Teaches engage students in the learning process. Teachers understand that instructional plans must be consistently monitored and modified to enhance learning.

CASL helps teachers develop assessments that engage learners. If students are involved in the creation and development of assessments from the beginning, their performance on the assessment increases. CASL provides information on how monitoring timely and corrective feedback on assessment enhances student learning.

Standard IV c- Teachers choose the methods and techniques that are most effective in meaning as they strive to eliminate achievement gaps.

This refers to identifying and communicating clear learning targets, types of targets, and target/method match

Standard IV h – Teachers use a variety of methods to assess what each student has learned, 21st century knowledge, skills, performance, and dispositions and to use the assessment information to adjust their instructional practice.

This is the basis of all CASL content.

Standard V a -Teachers think systematically and critically about student learning in their classroom and school: why learning happens and what can be done to improve achievement.

CASL provides the research to support data analysis and classroom instructional practice at classroom and school level.

Standard V b Teachers participate continued, high quality professional development that reflects global view of educational practices ….that meets the needs of students and their own personal growth.

CASL helps to apply and implement knowledge gained from

professional development that impacts student learning.

Standard V c – Teachers adapt their practice based on research and data to best meet the needs of their students.

CASL equips teachers to use assessment results as information that drives instruction. Assessment results are the data that informs teaching and learning.

Pre-HYIS planning

Please put a dot on each consensogram to indicate your knowledge level of the specified thinking maps/graphic organizers.

Thank you!

Plus, delta, Rx

Please leave feedback as you depart. Have a wonderful day!