IPT SCORING TRAININGPAMS

Goals To review the IPT and rubric as exemplary

models of a performance task and rubric To identify the critical thinking skills

embedded in the performance task To become familiar with how to score

student work To calibrate, as a staff, our scoring of

student work using the rubric

About of the IPT

developed by Virginia Beach classroom teachers working collaboratively with the Departments of Curriculum & Instruction and Educational Leadership and Assessment

modeled after the College and Work Readiness Assessment (CWRA), a nationally-normed performance task that will be administered to VBCPS juniors in January 2013.

presents seventh-grade students will a real-life situation and related documents that they must analyze before writing responses to open-ended questions about the situation.

designed to measure the 21st century skills of critical thinking (CT), problem solving (PS), and written communication (WC) Source: Fall 2010 Integrated

Performance Task Guide for Teachers Grade 7

The Fall 2012 IPT…

is a low-stakes, diagnostic assessment to be used for formative purposes

was created to measure critical thinking, problem solving, and effective communication, three outcomes for student success specified by Compass to 2015

should be scored by teachers, preferably in teams, during the first semester (no later than January 25, 2013), according to the procedures and scoring rubricSource: Fall 2012 Integrated

Performance Task Guide for Teachers Grade 7

Results from the Fall 2012 IPT…

may NOT be used as a grade in any subject

should be used by teachers to evaluate their students’ skill levels in the areas of critical thinking (CT), problem solving (PS), and written communication (WC)

Source: Fall 2012 Integrated Performance Task Guide for Teachers Grade 7

Results from the Fall 2012 IPT, cont.

can assist teachers in planning instruction that involves CT, PS, WC, and the use of rubrics

are expected to indicate that most seventh graders will be at Levels 1 or 2 in CT and PS due to the limited implementation across the division of performance tasks and other activities that develop CT and PS skills.

There are no expectations at this time that skills levels in CT, PS, or WC should be at Levels 3 or 4. It will take time to move our students toward mastery. Source: Fall 2012 Integrated

Performance Task Guide for Teachers Grade 7

Things to remember while scoring

Always score according to the rubric Do not give a higher score just because it was the

best you’ve seen in a while Only scores are 1, 2, 3, 4—do not use decimals

or fractions or two scores for an element When in doubt, score down—”between-level”

students are at the lower level If unsure as to what to score, its okay to ask

someone else what they think A score of 0 is given when there is no response

at all, a single character is considered a response

Scoring IPT Responses

Familiarity with the IPT documents and rubric increases scoring efficiency and consistency.

It’s tedious at first but gets easier with experience.

Highlight, underline, circle, and/or write notes.

Silence is golden! Keep talk to a minimum.

IPT Scenario for Grade 7

CONFIDENTIAL

DO NOT

DISTRIBUTE

What does the rubric look like?

You have been provided the IPT Scoring Guide which includes: the prompts, a copy of the rubric and the documents which the students received as they took the test.

Each section of the rubric gives examples of what responses should contain in order to receive the level of proficiency

Critical Thinking (CT1) Prompt 1only

The first element of the rubric, CT1, decides if the information in the IPT booklet is correct and believable

Involves two facets: the quantity of distinct examples of information from

Document 4 (news story) that the student identifies as incorrect, misleading, or unbelievable

the quality of the explanations why each example may be incorrect, misleading, or unbelievable

A student’s response must satisfy both of the criteria to be assigned a specific level.

Be sure to look at the Incorrect, Misleading, and Unbelievable Information From Document 4 sheet

Skills Measured by the IPT

Prompt 1 – Critical Thinking 1

Scoring Critical Thinking 1

Sample A1 – Prompt 1 (CT1)

The first information I believe is false is that 25,000

dollars worth of items were stolen from a music store.

althogh a music store may contain this amount in items,

six teenagers could not carry this many items. If each

item is on average 25 dollars, then the teenagers would

have to carry 1,000 items. A peice of information I believe

is misleading is Abner Crutchfeild saying no teenagers are

hanging around the mall because of the chaperone policy.

this is not true because schoool starts and teenagers do

not go to the mall as much. Finally I believe he graph is

false. The graph does not contain a year or unit of time.

3

Sample B1 – Prompt 1 (CT1)

I think that the increase in property damage and theft were reasons for the new policy is false.

1

Sample C1 – Prompt 1 (CT1) One piece of information that I thought is false in the document is where it states,"The incident involved a group of six teenagers stealing more than $25,000 worth of items at Your Music Now." I beleive this is false because a CD costs about five dollars, so if they stole $25,000 worth of items, they must have stolen about every item in the store. Unless there was no security near the store, then that could not have happened. If they want to prevent crimes from happening then they should improve their security, not punish every teenager for it. I also do not beleive the part of document one where it states, "However, support for the protest has dropped off greatly." I do not beleive this because many teens in document 3 were very determined to get this protest to get called off by providing points like,"Excluding people from the the mall based on their age violates their civil rights--especially the equal protection clause of the 14th amendment."

3

Sample D1 – Prompt 1 (CT1)

I think the sales increace of certain stores is a little misleading because if they are preventing all of these teens from shopping at certain time frame, then how does their profit increase if the number of poeple is decresing. I also disbelvive that that 1400 signed a potition to boycott against the mall.

2

Critical Thinking (CT2) Prompt 2 only

The second element of the rubric, CT2, sees the need for important information not in the IPT booklet

It also involves four facets: Whether there is at least one relevant example of

information that was not in the booklet or not clearly explained

The quality of the description of the information Whether there is a reason for why the information is

needed for the student to make a recommendation concerning the chaperone policy

Whether there is an effect statement that describes how the information could affect the student’s final recommendation

A student’s response must satisfy all the criteria at a specific level.

Skills Measured by the IPT

Prompt 2 – Critical Thinking 2

Scoring Critical Thinking 2

Sample A2 – Prompt 2 (CT2)I think information that would be useful is more reactions from the teenager, people who own a store at the mall, and also the budget of the mall. If I could have more more reactions and quotes from teens and mall workers, then I could get a better understanding of their perspective and be able to come to fair agreement that might be based off of a vote or democracy for the customers of Beach Mall. If I had the mall budget, then I would know if they could afford to improve their security and offer more jobs for guards and policemen which would be what I write in a recommendation letter.

4

Sample B2 – Prompt 2 (CT2)

how many thngs did they steal and they should have cameras in the stores the teenagers go in.

1 or 2

Sample C2 – Prompt 2 (CT2)

In order to make a well justifyed dicition I would look at the sales numbers both before and after the policy went into affect. This information will help me make a informed dicition about the policy.

2

Sample D2 – Prompt 2 (CT2)In the documents, The explantion of people do not match the description of the policy. The policy states that children under the age of eighteen are allowed in the mall without a chaperone aas long as it is before 5:00. The commentator, Sk8rDude, states that, “There is no place to hang out with my buds except the vacant lot nner the dark alley." Althogh teens are not allowed without a gaurdian after 5:00, they can go to the mall after school since they have about two hours in high school. I need this informatio because if I am wrongly informed about the policy, my opinion would have incorrect facts on the situation. Finnaly, They do notclearly explain wether the policy is only at the Beach mall or every mall. Most of the Documents have the words "Beach Mall", Yet they do not state every mall. I would need this informaion because if it is for every mall, the policy is more acceptable, but if it is for one mall it is less broad.

1

Problem Solving (PS) Prompt 3 only

The third element of the rubric, PS, the student evaluates the information and uses it to support one of the choices.

PS is related to: The students recommendation of either continuing or

discontinuing the chaperone policy The quantity of reasons that support the

recommendation The quality of reasons that support the recommendation The source of the reasons that support the

recommendation Students responses must satisfy all of the criteria

at a specific level to be assigned to that level

Examples of Responses for PS

Problem Solving should not be confused with Written Communication (WC) If a response does not include an introductory

sentence or concluding statement, it is a WC issue—do not penalize the student in PS

Level 3 or 4 reasons must be explicitly relevant to the issue of whether

or not to continue or discontinue the policy “Distinct” reasons must be conceptually different

from the other reasons in the response that support either recommendation to continue or discontinue the policy

Cannot include any reasons that embellish or misrepresent information or facts

Skills Measured by the IPT

Prompt 3 – Problem Solving

Scoring Problem Solving

Sample A3 – Prompt 3 (PS) I am againtst keeping the policy because, first of all, of the fact that in document 1 it gives information about how youth crime is effected by violet tv shows and videogames but if the youth is nt at the mall then what will they be doing? I will tell you what they would be doing, they would be at home watching violent tv shows an playing violent vdeogames. Second,in document 3 it shws that five stores have list between 15%-35% of sales since the policy started and if the policy continues that could shut down some of the really good buisnesses in the mall. If you average together the top fie losses in percent of income then the mall has lost 24% of its income, and thats just the top five losses! That is almost 1/4 of the oncome that those 5 stores together normally make! Finally, in document 4 it say that that one theft was th only incedent like that, so all the y need is a couple of security cameras and the costomers are safe. All in all, it would be better for everyone if the mall just ended the policy.

3

Sample B3 – Prompt 3 (PS)

Yes keep the mall chaperone policy because the people under 21 should be wached. Because they could get hurt or kidnaped. Grown ups should watch kids younger then 21 becaus some kids still from stores and it happens alot.Thas why they should keep the policiy.

2

Sample C3 – Prompt 3 (PS)Well I think all malls in the Us should get security camras and post signs saying they have security camras around and the police is watching every move you make so when kids come to the mall they will see that the police is watching them and they will get scared they will get caught easly. So then they will stop shoplifting and Starting fights and doing Graffiti.But I think they should stop the Chaperone policy. Also i think every mall should have more police officers to watch the kids. Because when I go to the mall I see only 2 or 3. But the mall I go to is either a 2 story one or a 4 story mall. So if there is only 2 or 3 mall cops and there is only 6 kids shoplifting or fighting then half of those kids will get caught or run away and start another fight.

1

Sample D3 – Prompt 3 (PS)I think that the chaperone policy shouldnt be continued because the teenagers should be trusted and and ba able to buy there own cloths and if they do steal and you catch them you should make them work for it or call the cops on them. they should really let the policy up because the mall wont make as much money the would if they didnt have the policy plus the parents wont come because there kids wont come.the kids need to have their own privacy andshouldnt be crowded by their parents.

2

Sample E3 – Prompt 3 (PS)After considering the two main concerns for keeping the policy, I strongly recommend that the policy not stay. Businesses' profits have dropped now that teens aren'nt there anymore, especially ones that have teens as their main clientel. If businesses close down, then people lose their job and malls lose money from not having the shop there anymore. The safety and security of the mall's costumers are not compromised by teens being there. If it was, then this policy would ahve been installed a lot sooner. Profits for malls' stores are compromised by teens attending the mall because teens tend to shop at malls more than anywhere else. Teens have made malls hotspots for friends to hang out at and get a bite to eat. If the policy were to stay than teen wouldn't have anywhere to go to hang out with friends, and profits of the mall would go down. For these reasons, I believe that the chaperone policy should not stand.

3

Sample F3 – Prompt 3 (PS)

My reccomendation is that I'm splitting it 50/50.The reason being 50/50 is that I totally understand where the mall officials are coming from I understand.However I think that kids should have their freedoom and not be punished because of something possibly an adult could have did.You can assume anything but you just never know who did what and they are just assuming that kids/teenagers are commiting the crime.I understand how they are making profits better because before they were scared to come to the mall with the kids around not sure if they would get robbed or not.But I also understand that safety comes first and you should always be kept under your parents/guardians wing with supervision.So even though i agree with both sides i do very much disagree with the mall officials.

1

Written Communication (WC) Prompt 3 only

The Written Communication presents information and ideas that are clear, organized, detailed, and written for the intended audience

Scorers should look for: Clear/organized response Detail Transitions/sentences Voice and Tone/Vocabulary

Spelling, grammar, and keyboarding skills are not scored on the IPT unless they interfere with the clarity or organization of a response

Do not penalize students in their WC scores due to PS problems. Students who write excellent responses but lack PS abilities should receive a high WC and low PS

Skills Measured by the IPT

Prompt 3 – Written Communication