WRITING MULTIPLE CHOICE EXAM ITEMS DOUGLAS A. BERNSTEIN University of South Florida Southampton...
-
date post
20-Dec-2015 -
Category
Documents
-
view
215 -
download
0
Transcript of WRITING MULTIPLE CHOICE EXAM ITEMS DOUGLAS A. BERNSTEIN University of South Florida Southampton...
WRITING MULTIPLE WRITING MULTIPLE CHOICE EXAM CHOICE EXAM
ITEMSITEMS
DOUGLAS A. BERNSTEINDOUGLAS A. BERNSTEIN
University of South FloridaUniversity of South Florida
Southampton UniversitySouthampton University
www.douglasbernstein.comwww.douglasbernstein.comdouglas.bernstein@[email protected]
SOME MYTHS ABOUT MCQsSOME MYTHS ABOUT MCQs
USEFUL MAINLY FOR TESTING BASIC, USEFUL MAINLY FOR TESTING BASIC, FACTUAL INFORMATIONFACTUAL INFORMATION
NOT USEFUL FOR ASSESSING NOT USEFUL FOR ASSESSING LEARNING AT HIGHER COGNITIVE LEARNING AT HIGHER COGNITIVE LEVELSLEVELS
BLOOM’S TAXONOMY OF BLOOM’S TAXONOMY OF COGNITIVE SKILLSCOGNITIVE SKILLS
SOME MYTHS ABOUT MCQsSOME MYTHS ABOUT MCQs
USEFUL MAINLY FOR TESTING BASIC, USEFUL MAINLY FOR TESTING BASIC, FACTUAL INFORMATIONFACTUAL INFORMATION
NOT USEFUL FOR ASSESSING NOT USEFUL FOR ASSESSING LEARNING AT HIGHER COGNITIVE LEARNING AT HIGHER COGNITIVE LEVELSLEVELS
NOT AS GOOD OVERALL AS ESSAY NOT AS GOOD OVERALL AS ESSAY EXAMSEXAMS
EASY TO WRITEEASY TO WRITE
NO SPECIAL PRACTICE NEEDEDNO SPECIAL PRACTICE NEEDED
THE TRUTH ABOUT MCQsTHE TRUTH ABOUT MCQs
THEY CAN, INDEED, TEST MEMORY OF THEY CAN, INDEED, TEST MEMORY OF FACTUAL INFORMATIONFACTUAL INFORMATION
BLOOM’S LEVEL
DEFINITION SAMPLE
VERBS SAMPLE
QUESTIONS
Remembering
Recall or recognize information, ideas, and principles as presented.
List, label, name
What are the three main parts of _____?; What are the steps involved in____?
A “REMEMBERING” ITEMA “REMEMBERING” ITEM
Who wrote Who wrote War and PeaceWar and Peace??
a. Rachmoninova. Rachmoninov
b. Tolstoyb. Tolstoy
c. Dostoyevskyc. Dostoyevsky
d. Solzhenitsynd. Solzhenitsyn
THE TRUTH ABOUT MCQsTHE TRUTH ABOUT MCQs
THEY CAN, INDEED, TEST MEMORY OF THEY CAN, INDEED, TEST MEMORY OF FACTUAL INFORMATIONFACTUAL INFORMATION
THEY CAN ALSO TEST THE ABILITY TO THEY CAN ALSO TEST THE ABILITY TO UNDERSTAND, APPLY, ANALYZE, AND UNDERSTAND, APPLY, ANALYZE, AND EVALUATE INFORMATIONEVALUATE INFORMATION
LEVEL DEFINITION SAMPLE VERBSSAMPLE QUESTIONS
REMEMBERING
Recall or recognize information, ideas, and principles as presented.
List, label, name
What are the three main parts of _____; What are the steps involved in____?
UNDER-STANDING
Comprehend or interpret information
Explain, summarize describe, illustrate
How is __ related to __?; What themes do you see in __?
MCQs FOR ALL LEVELSMCQs FOR ALL LEVELS
AN “UNDERSTANDING” AN “UNDERSTANDING” ITEMITEM
During a sleep study, you notice that During a sleep study, you notice that your research participant’s EEG shows your research participant’s EEG shows brain activity known as spindles and K-brain activity known as spindles and K-complexes. The participant is probably in complexes. The participant is probably in stage ___ sleep.stage ___ sleep.
a. 1a. 1
b. 2b. 2
c. 3c. 3
d. 4d. 4
LEVEL DEFINITION SAMPLE VERBSSAMPLE QUESTIONS
REMEMBERING
Recall or recognize information, ideas, and principles as presented.
List, label, name
What are the three main parts of _____?; What are the steps involved in____?
UNDERSTANDING
Translate, comprehend, orinterpret information based on prior learning.
Explain, summarize,describe, illustrate
How is __ related to __?; What themes do you see in __?
APPLYING
Select, transfer, and use data and principles to complete a problem or task.
Use, compute, solve, demon-strate
How would you __ on the basis of __ theory?
MCQs FOR ALL LEVELSMCQs FOR ALL LEVELS
AN “APPLYING” ITEMAN “APPLYING” ITEM
Naomi asked seven randomly selected Naomi asked seven randomly selected people the following question, "On a scale people the following question, "On a scale from 0 (not at all) to 9 (definitely), how from 0 (not at all) to 9 (definitely), how strongly do you believe in ghosts?" Their strongly do you believe in ghosts?" Their responses were as follows: 0, 0, 1, 1, 9, 9, responses were as follows: 0, 0, 1, 1, 9, 9, 9. Which measure of central tendency 9. Which measure of central tendency should Naomi use if she wants to convince should Naomi use if she wants to convince her friends that most people strongly her friends that most people strongly believe in ghosts?believe in ghosts?
A. Mode C. MedianA. Mode C. Median B. Mean D. RangeB. Mean D. Range
LEVEL DEFINITION SAMPLE VERBSSAMPLE QUESTIONS
REMEMBERING
Recall or recognize information, ideas, and principles as presented.
List, label, name
What are the three main parts of _____; What are the steps involved in____?
UNDERSTANDING
Translate, comprehend, orinterpret information based on prior learning.
Explain, summarize,describe, illustrate
How is __ related to __?; What themes do you see in __?
APPLYING
Select, transfer, and use data and principles to complete a problem or task.
Use, compute, solve, demonstrate
How would you __ on the basis of __ theory?
ANALYZING
Distinguish, classify, and relate the assumptions,hypotheses, evidence, or structure of a statement or question.
Categorize comparecontrastseparate
How would you classify __?; What evidence
supports __?
AN “ANALYZING” ITEMAN “ANALYZING” ITEM
The difference between state and trait anxiety is The difference between state and trait anxiety is that that a. The former refers to general anxiety and the a. The former refers to general anxiety and the latter refers to situational anxiety.latter refers to situational anxiety.b. The former refers to situational anxiety and the b. The former refers to situational anxiety and the latter refers to general anxiety.latter refers to general anxiety.c. The former refers to physiological responses c. The former refers to physiological responses and the latter refers to questionnaire responses.and the latter refers to questionnaire responses.d. The former refers to questionnaire responses d. The former refers to questionnaire responses and the latter refers to physiological responses.and the latter refers to physiological responses.
LEVEL DEFINITION SAMPLE VERBS SAMPLE QUESTIONS
REMEMBERING
Recall or recognize information, ideas, and principles as presented.
List, label, name
What are the three main parts of _____; What are the steps involved in____?
UNDERSTANDING
Translate, comprehend, orinterpret information based on prior learning.
Explain, summarize,describe, illustrate
How is __ related to __?; What themes do you see in __?
APPLYING
Select, transfer, and use data and principles to complete a problem or task.
Use, compute, solve, demonstrate
How would you __ on the basis of __ theory?
ANALYZING
Distinguish, classify, and relate the assumptions,hypotheses, evidence, or structure of a statement or question.
Categorize,compare,contrast,separate
How would you classify __?; What evidence
supports __?
EVALUATING
Appraise, assess, based on standards and criteria.
Judge, recom-mend critique, justify
Which approach to __ would be most effective, and why?
AN “EVALUATING” ITEMAN “EVALUATING” ITEMInjuries to belted passengers increase Injuries to belted passengers increase
wherever seat belt laws are passed. Which wherever seat belt laws are passed. Which of the following serves as a logical of the following serves as a logical counterargument to repealing these laws?counterargument to repealing these laws?
a. Injuries will fall once people learn to wear a. Injuries will fall once people learn to wear belts correctly.belts correctly.
b. More people are wearing belts when b. More people are wearing belts when accidents occur.accidents occur.
c. Though injuries increase, fatalities c. Though injuries increase, fatalities decrease.decrease.
d. Both B and Cd. Both B and C
THE TRUTH ABOUT MCQsTHE TRUTH ABOUT MCQs
THEY CAN, INDEED, TEST MEMORY OF THEY CAN, INDEED, TEST MEMORY OF FACTUAL INFORMATIONFACTUAL INFORMATION
THEY CAN ALSO TEST THE ABILITY TO THEY CAN ALSO TEST THE ABILITY TO UNDERSTAND, APPLY, ANALYZE, AND UNDERSTAND, APPLY, ANALYZE, AND EVALUATE INFORMATIONEVALUATE INFORMATION
THEY CAN EVEN TEST CREATIVITYTHEY CAN EVEN TEST CREATIVITY
LEVEL DEFINITIONSAMPLE
VERBSSAMPLE QUESTIONS
REMEMBERING Recall or recognize
information, ideas, and principles as presented.
List, label, name
What are the three main parts of _____; What are the steps involved in____?
UNDERSTANDING Translate, comprehend, or
interpret information based on prior learning.
Explain, summarize,describe, illustrate
How is __ related to __?; What themes do you see in __?
APPLYING Select, transfer, and use data
and principles to complete a problem or task.
Use, compute, solve, demonstrate, apply
How would you __ on the basis of __ theory?
ANALYZING
Distinguish, classify, and relate the assumptions,hypotheses, evidence, or structure of a statement or question.
Categorize,compare,contrast,separate
How would you classify __?; What
evidence supports __?
EVALUATING Appraise, assess, based on
standards and criteria.
Judge, recommend, critique, justify
Which approach to __ would be most effective, and why?
CREATING
Originate, integrate, and combine ideas into a new product, plan or proposal.
Create, design, invent, develop
Write an MCQ item at the ___ level of Bloom’s taxonomy.
THE TRUTH ABOUT MCQsTHE TRUTH ABOUT MCQs
THEY CAN, INDEED, TEST MEMORY OF THEY CAN, INDEED, TEST MEMORY OF FACTUAL INFORMATIONFACTUAL INFORMATION
THEY CAN ALSO TEST THE ABILITY TO THEY CAN ALSO TEST THE ABILITY TO UNDERSTAND, APPLY, ANALYZE, AND UNDERSTAND, APPLY, ANALYZE, AND EVALUATE INFORMATIONEVALUATE INFORMATION
THEY CAN EVEN TEST CREATIVITYTHEY CAN EVEN TEST CREATIVITY
THEY CAN BE AS GOOD AS ESSAYSTHEY CAN BE AS GOOD AS ESSAYS
GOOD ONES ARE NOT EASY TO WRITEGOOD ONES ARE NOT EASY TO WRITE
Two researchers tested the hypothesis that college students’ grades and stress are related. One researcher operationally defined stress as the number of minutes spent arguing with others. The other researcher defined stress as the amount of tension at any point in time measured on a 10-point scale. Which of the following statements is accurate?
a. Because their hypotheses are identical, the two researchers should have similar results. b. The only valid definition is the number of minutes spent arguing with others because it is the only objective measure. c. The difference in operational definitions of
stress could lead to quite different results.
THE TRUTH ABOUT MCQsTHE TRUTH ABOUT MCQs
THEY CAN, INDEED, TEST MEMORY OF THEY CAN, INDEED, TEST MEMORY OF FACTUAL INFORMATIONFACTUAL INFORMATION
THEY CAN ALSO TEST THE ABILITY TO THEY CAN ALSO TEST THE ABILITY TO UNDERSTAND, APPLY, ANALYZE, AND UNDERSTAND, APPLY, ANALYZE, AND EVALUATE INFORMATIONEVALUATE INFORMATION
THEY CAN EVEN TEST CREATIVITYTHEY CAN EVEN TEST CREATIVITYTHEY CAN BE AS GOOD AS ESSAYSTHEY CAN BE AS GOOD AS ESSAYSGOOD ONES ARE NOT EASY TO WRITEGOOD ONES ARE NOT EASY TO WRITEUSEFUL GUIDELINES ARE AVAILABLEUSEFUL GUIDELINES ARE AVAILABLE
BASIC CHARACTERISTICS BASIC CHARACTERISTICS OF GOOD MCQ TESTSOF GOOD MCQ TESTS
CONTAIN AT LEAST 60 ITEMS (FOR CONTAIN AT LEAST 60 ITEMS (FOR MIDTERM AND FINAL EXAMS)MIDTERM AND FINAL EXAMS)
CAREFULLY PLANNEDCAREFULLY PLANNED
Fritz's computer screeches like a monkey every time he gets new e-mail. One day, Fritz is watching "Three Monkeys and a Banana" on HBO, but when a monkey screeches on the show, Fritz does not go to check his e-mail because he realizes the sound is coming from the TV set, not his computer. In other words, Fritz has made a A. hit. C. false alarm. B. miss. D. correct rejection.
A TABLE OF SPECIFICATION
COGNITIVE LEVEL
CONTENT REMEMBERING UNDERSTANDING APPLYING
Classical Conditioning 1 1 2
Shaping 1 1
Reinforcement 1 1
Observational Learning 1
Latent Learning 1 1
Cognitive Processes 1
in Learning
BASIC CHARACTERISTICS BASIC CHARACTERISTICS OF GOOD MCQ TESTSOF GOOD MCQ TESTS
CONTAIN AT LEAST 60 ITEMS (FOR CONTAIN AT LEAST 60 ITEMS (FOR MIDTERM AND FINAL EXAMS)MIDTERM AND FINAL EXAMS)
CAREFULLY PLANNEDCAREFULLY PLANNED
WRITTEN CAREFULLYWRITTEN CAREFULLY
CHARACTERISTICS OF CHARACTERISTICS OF GOOD MULTIPLE CHOICE GOOD MULTIPLE CHOICE
ITEMSITEMSSUBSTANTIAL, MEANINGFUL STEMSSUBSTANTIAL, MEANINGFUL STEMS
NOT SO GOODNOT SO GOOD
William JamesWilliam Jamesa. pioneered the functionalist school a. pioneered the functionalist school
in psychologyin psychologyb. developed introspection to measure b. developed introspection to measure
consciousness.consciousness.c. was concerned with perceptual c. was concerned with perceptual
principles.principles.d. was the founder of the behaviorist d. was the founder of the behaviorist
approach.approach.
BETTERBETTER
William James is best known for William James is best known for founding the _______ approach to founding the _______ approach to psychology.psychology.
a. functionalista. functionalist
b. structuralistb. structuralist
c. behavioristc. behaviorist
d. evolutionaryd. evolutionary
CHARACTERISTICS OF CHARACTERISTICS OF GOOD MULTIPLE CHOICE GOOD MULTIPLE CHOICE
ITEMSITEMSSUBSTANTIAL, MEANINGFUL STEMSSUBSTANTIAL, MEANINGFUL STEMS
RELEVANT INFORMATIONRELEVANT INFORMATION
NOT SO GOODNOT SO GOOD Shanelle and Audre were each graduating from high Shanelle and Audre were each graduating from high
school. During their commencement speeches, Shanelle school. During their commencement speeches, Shanelle spoke about how excited she was to be going to Harvard spoke about how excited she was to be going to Harvard because she had worked so hard to reach her goals and because she had worked so hard to reach her goals and was looking forward to moving far away to "spread her was looking forward to moving far away to "spread her wings." Audre said she could not have "made it" without wings." Audre said she could not have "made it" without her family's and friends' support and was delighted to be her family's and friends' support and was delighted to be able to attend a nearby university so she can stay close to able to attend a nearby university so she can stay close to home. According to your text, Shanelle is most likely home. According to your text, Shanelle is most likely _________ and Audre is most likely __________._________ and Audre is most likely __________.
A. from a collectivist culture; from an individualist cultureA. from a collectivist culture; from an individualist culture B. from an individualist culture; from a collectivist cultureB. from an individualist culture; from a collectivist culture C. resolving the identity crisis; resolving the intimacy C. resolving the identity crisis; resolving the intimacy
crisiscrisis D. resolving the intimacy crisis; resolving the identity D. resolving the intimacy crisis; resolving the identity
crisiscrisis
BETTERBETTER
Shanelle is excited to go to a faraway university so Shanelle is excited to go to a faraway university so that she can “spread her wings" and “be herself.” that she can “spread her wings" and “be herself.” Audre is happy to study at a local university where Audre is happy to study at a local university where she can be sure of having the support of her family she can be sure of having the support of her family and friends. According to your text, Shanelle is and friends. According to your text, Shanelle is most likely ___________ and Audre is most likely most likely ___________ and Audre is most likely _____________._____________.
A. from a collectivist culture; from an individualist A. from a collectivist culture; from an individualist cultureculture
B. from an individualist culture; from a collectivist B. from an individualist culture; from a collectivist cultureculture
C. resolving the identity crisis; resolving the C. resolving the identity crisis; resolving the intimacy crisisintimacy crisis
D. resolving the intimacy crisis; resolving the D. resolving the intimacy crisis; resolving the identity crisisidentity crisis
CHARACTERISTICS OF CHARACTERISTICS OF GOOD MULTIPLE CHOICE GOOD MULTIPLE CHOICE
ITEMSITEMSSUBSTANTIAL, MEANINGFUL STEMSSUBSTANTIAL, MEANINGFUL STEMS
RELEVANT INFORMATIONRELEVANT INFORMATION
MINIMAL USE OF NEGATIVESMINIMAL USE OF NEGATIVES
NOT SO GOODNOT SO GOOD
Tyler is two days old, healthy and wide Tyler is two days old, healthy and wide awake at the moment. Tyler is unlikely to awake at the moment. Tyler is unlikely to
A. be able to support his weight by A. be able to support his weight by hanging with his hands from your fingers.hanging with his hands from your fingers.
B. pay particular attention to moving B. pay particular attention to moving faces with high contrast.faces with high contrast.
C. hear the difference between musical C. hear the difference between musical notes on a scale.notes on a scale.
D. turn away and cry when spoken to D. turn away and cry when spoken to in an expressive manner.in an expressive manner.
BETTERBETTER
Tyler is two days old. He is likely to do all Tyler is two days old. He is likely to do all of the following EXCEPT of the following EXCEPT
A. be able to hang from your finger by A. be able to hang from your finger by one hand.one hand.
B. pay particular attention to human B. pay particular attention to human faces.faces.
C. hear the difference between musical C. hear the difference between musical notes on a scale.notes on a scale.
D. turn away and cry when spoken to D. turn away and cry when spoken to in an expressive manner.in an expressive manner.
CHARACTERISTICS OF CHARACTERISTICS OF GOOD MULTIPLE CHOICE GOOD MULTIPLE CHOICE
ITEMSITEMSSUBSTANTIAL, MEANINGFUL STEMSSUBSTANTIAL, MEANINGFUL STEMS
RELEVANT INFORMATIONRELEVANT INFORMATION
MINIMAL USE OF NEGATIVESMINIMAL USE OF NEGATIVES
GRAMMATICALLY CONSISTENTGRAMMATICALLY CONSISTENT
NOT SO GOODNOT SO GOOD
The neurotransmitters associated with The neurotransmitters associated with schizophrenia and depression areschizophrenia and depression are
A. GABAA. GABA
B. GlutamateB. Glutamate
C. Dopamine and serotoninC. Dopamine and serotonin
D. NorepinephrineD. Norepinephrine
BETTERBETTER
The neurotransmitters associated with The neurotransmitters associated with schizophrenia and depression areschizophrenia and depression are
A. GABA and glutamateA. GABA and glutamate
B. Dopamine and GABAB. Dopamine and GABA
C. Dopamine and serotoninC. Dopamine and serotonin
D. Serotonin and norepinephrineD. Serotonin and norepinephrine
CHARACTERISTICS OF CHARACTERISTICS OF GOOD MULTIPLE CHOICE GOOD MULTIPLE CHOICE
ITEMSITEMSSUBSTANTIAL, MEANINGFUL STEMSSUBSTANTIAL, MEANINGFUL STEMS
RELEVANT INFORMATIONRELEVANT INFORMATION
MINIMAL USE OF NEGATIVESMINIMAL USE OF NEGATIVES
GRAMMATICALLY CONSISTENTGRAMMATICALLY CONSISTENT
BALANCED CORRECT OPTIONS BALANCED CORRECT OPTIONS
ONLY ONE CORRECT OPTIONONLY ONE CORRECT OPTION
NOT SO GOODNOT SO GOOD
Azenett was interested in the relationship Azenett was interested in the relationship between temperature and domestic between temperature and domestic violence. She found a positive correlation violence. She found a positive correlation between daily high temperatures and between daily high temperatures and number of calls to a domestic violence number of calls to a domestic violence hotline over a one year period. Which of hotline over a one year period. Which of the following correlation coefficients best the following correlation coefficients best describes the relationship between describes the relationship between temperature and crisis line calls?temperature and crisis line calls?
A. -0.78 C. +0.83A. -0.78 C. +0.83 B. 0.00 D. +1.00B. 0.00 D. +1.00
BETTERBETTER
Azenett found a positive correlation Azenett found a positive correlation between daily high temperatures and between daily high temperatures and number of calls to a domestic number of calls to a domestic violence hotline over a one year violence hotline over a one year period. Which of the following period. Which of the following correlation coefficients best correlation coefficients best describes the relationship between describes the relationship between temperature and crisis line calls?temperature and crisis line calls?
A. -0.78 C. +0.83A. -0.78 C. +0.83 B. 0.00 D. -1.00B. 0.00 D. -1.00
CHARACTERISTICS OF CHARACTERISTICS OF GOOD MULTIPLE CHOICE GOOD MULTIPLE CHOICE
ITEMSITEMSSUBSTANTIAL, MEANINGFUL STEMSSUBSTANTIAL, MEANINGFUL STEMS
RELEVANT INFORMATIONRELEVANT INFORMATION
MINIMAL USE OF NEGATIVESMINIMAL USE OF NEGATIVES
GRAMMATICALLY CONSISTENTGRAMMATICALLY CONSISTENT
BALANCED CORRECT OPTIONS BALANCED CORRECT OPTIONS
ONLY ONE CORRECT OPTIONONLY ONE CORRECT OPTION
EQUALLY PLAUSIBLE OPTIONSEQUALLY PLAUSIBLE OPTIONS
NOT SO GOODNOT SO GOOD
The founder of Gestalt therapy wasThe founder of Gestalt therapy was
A. Karen HorneyA. Karen Horney
B. Fritz PerlsB. Fritz Perls
C. Osama Bin LadenC. Osama Bin Laden
D. George KellyD. George Kelly
BETTERBETTER
The founder of Gestalt therapy wasThe founder of Gestalt therapy was
A. Karen HorneyA. Karen Horney
B. Fritz PerlsB. Fritz Perls
C. Carl RogersC. Carl Rogers
D. George KellyD. George Kelly
NOT SO GOODNOT SO GOOD
Avoiding shock by pressing a button Avoiding shock by pressing a button when a warning tone sounds is an when a warning tone sounds is an example of example of
A. escape conditioningA. escape conditioning
B. avoidance conditioningB. avoidance conditioning
C. delayed conditioningC. delayed conditioning
D. backward conditioningD. backward conditioning
BETTERBETTER
In a laboratory experiment, Peter In a laboratory experiment, Peter learned that if he pushed a button at learned that if he pushed a button at the sound of a warning tone, he the sound of a warning tone, he would not be shocked. This learning would not be shocked. This learning is an example of _______ conditioning.is an example of _______ conditioning.A. escapeA. escapeB. delayedB. delayedC. backwardC. backwardD. avoidance D. avoidance
NOT SO GOODNOT SO GOOD
The phenomenon of looming occursThe phenomenon of looming occurs
A. when light is poorly focused.A. when light is poorly focused.
B. at the blind spot.B. at the blind spot.
C. when the visual image of an C. when the visual image of an approaching object expands about approaching object expands about equally in all directions on the retina equally in all directions on the retina until it fills the visual field.until it fills the visual field.
D. only at night.D. only at night.
BETTERBETTER
The phenomenon of looming occursThe phenomenon of looming occurs
A. when light is poorly focused on the retina, A. when light is poorly focused on the retina, preventing transmission of a clear image to the preventing transmission of a clear image to the brain.brain.
B. at the blind spot, where axons from ganglion B. at the blind spot, where axons from ganglion cells exit the eyeball and eventually reach the cells exit the eyeball and eventually reach the lateral geniculate nucleus in the thalamus.lateral geniculate nucleus in the thalamus.
C. when the visual image of an approaching C. when the visual image of an approaching object expands about equally in all directions on object expands about equally in all directions on the retina until it fills the visual field.the retina until it fills the visual field.
D. only at night, because looming depends on the D. only at night, because looming depends on the activity of photoreceptors called rods, which are activity of photoreceptors called rods, which are activated even in very low light conditions.activated even in very low light conditions.
CHARACTERISTICS OF CHARACTERISTICS OF GOOD MULTIPLE CHOICE GOOD MULTIPLE CHOICE
ITEMSITEMSSUBSTANTIAL, MEANINGFUL STEMSSUBSTANTIAL, MEANINGFUL STEMSRELEVANT INFORMATIONRELEVANT INFORMATIONMINIMAL USE OF NEGATIVESMINIMAL USE OF NEGATIVESGRAMMATICALLY CONSISTENTGRAMMATICALLY CONSISTENTBALANCED CORRECT OPTIONS BALANCED CORRECT OPTIONS ONLY ONE CORRECT OPTIONONLY ONE CORRECT OPTIONEQUALLY PLAUSIBLE OPTIONSEQUALLY PLAUSIBLE OPTIONSCLEARLY WORDEDCLEARLY WORDED
NOT SO GOODNOT SO GOOD
Susan is applying to graduate school Susan is applying to graduate school in psychology. She has always been in psychology. She has always been interested in the influences of interested in the influences of advertising on consumer behavior. advertising on consumer behavior. What department of psychology What department of psychology would be the best fit with Susan's would be the best fit with Susan's interests?interests?
A. Educational C. SocialA. Educational C. Social
B. Clinical D. IndustrialB. Clinical D. Industrial
BETTERBETTER
Susan is applying to graduate school in Susan is applying to graduate school in psychology. She has always been interested psychology. She has always been interested in the influences of advertising on consumer in the influences of advertising on consumer behavior. Which of the following psychology behavior. Which of the following psychology graduate programs would most likely graduate programs would most likely provide courses and research opportunities provide courses and research opportunities that best fit with Susan's interests?that best fit with Susan's interests?
A. Educational C. Social A. Educational C. Social
B. Clinical D. B. Clinical D. Developmental Developmental
LET’S WORK ON LET’S WORK ON SOME ITEMSSOME ITEMS
CAN YOU IMPROVE THIS ITEM?CAN YOU IMPROVE THIS ITEM?
Eukaria
BacteriaArchaea
Origin of life
a. Bacteria, Archaea, Eukaryab. Archaea, Bacteria, Eukarya*c. Eukarya, Archaea, Bacteriad. Eukarya, Bacteria, Archaeae. They are all the same age
Use the phylogenetic tree to order the domains from youngest to oldest.
Can You Improve This Can You Improve This Item?Item?
Noam Chomsky isNoam Chomsky is
*a. professor at Harvard *a. professor at Harvard UniversityUniversity
b. professor at WWUb. professor at WWU
c. an economics expertc. an economics expert
d. professor at MITd. professor at MIT
Can You Improve This Can You Improve This Item?Item?
According to the socioemotional theory of friendship According to the socioemotional theory of friendship change in later life,change in later life,
a. elderly people want larger and more diverse a. elderly people want larger and more diverse friendship networks but are unable to have them friendship networks but are unable to have them due to reduced mobility and inhibiting health due to reduced mobility and inhibiting health problemsproblems
b. elderly people experience important b. elderly people experience important developmental changes that reduce their developmental changes that reduce their motivation to have friendships and cause them to motivation to have friendships and cause them to withdraw into their own worldwithdraw into their own world
*c. *c. elderly people are more “present-oriented” rather elderly people are more “present-oriented” rather than “future-oriented” and as a result are less than “future-oriented” and as a result are less interested in large diverse networks of friendsinterested in large diverse networks of friends
d. none of the aboved. none of the above
Can You Improve This Can You Improve This Item?Item?
Which of the following is NOT true about how Which of the following is NOT true about how friendships change during midlife?friendships change during midlife?
a. As romantic relationships develop, individuals a. As romantic relationships develop, individuals tend to withdraw from their friendship networkstend to withdraw from their friendship networks
b. Women’s friendships are more significantly b. Women’s friendships are more significantly affected than are men’s friendships by the affected than are men’s friendships by the development of a romantic relationship.development of a romantic relationship.
*c. Friendship networks get broader (more friends) *c. Friendship networks get broader (more friends) and more intense (more intimacy) after marriageand more intense (more intimacy) after marriage
d. After children leave home, their parents’ d. After children leave home, their parents’ friendship networks tend to increase friendship networks tend to increase
It’s Time to Write It’s Time to Write Some Great Items!Some Great Items!
LEVEL DEFINITION SAMPLE VERBSSAMPLE QUESTIONS
REMEMBERING
Recall or recognize information, ideas, and principles as presented.
List, label, name
What are the three main parts of _____?; What are the steps involved in____?
UNDERSTANDING
Translate, comprehend, orinterpret information based on prior learning.
Explain, summarize,describe, illustrate
How is __ related to __?; What themes do you see in __?
APPLYING
Use data and principles to complete a problem or task.
Use, compute, solve, demon-strate
How would you __ on the basis of __ theory?
REMINDER ABOUT MCQ LEVELSREMINDER ABOUT MCQ LEVELS
SOME TIPS FOR REVIEWING SOME TIPS FOR REVIEWING MC EXAMSMC EXAMS
CREATE A LIST OF THE “TOP TEN” CREATE A LIST OF THE “TOP TEN” MISSED ITEMSMISSED ITEMS
REVIEW THOSE ITEMS FIRSTREVIEW THOSE ITEMS FIRST
DON’T ARGUE DON’T ARGUE
DISTRIBUTE ITEM-REVIEW FORMSDISTRIBUTE ITEM-REVIEW FORMS
REQUEST TO REVIEW REQUEST TO REVIEW GRADING OF AN EXAM ITEMGRADING OF AN EXAM ITEM
Name:__________________Student ID#:________Name:__________________Student ID#:________Test form (A or B): ______Item #:______ Test form (A or B): ______Item #:______
I believe that response alternative ___ should I believe that response alternative ___ should also be considered correct because:also be considered correct because:
________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
______________________________________________I found supporting evidence on page ____ in I found supporting evidence on page ____ in
the textbook.the textbook.
SOME TIPS FOR REVIEWING SOME TIPS FOR REVIEWING MC EXAMSMC EXAMS
CREATE A LIST OF THE “TOP TEN” CREATE A LIST OF THE “TOP TEN” MISSED ITEMSMISSED ITEMS
REVIEW THOSE ITEMS FIRSTREVIEW THOSE ITEMS FIRST
DON’T ARGUE DON’T ARGUE
DISTRIBUTE ITEM-REVIEW FORMSDISTRIBUTE ITEM-REVIEW FORMS
PROVIDE FEEDBACK AT NEXT CLASSPROVIDE FEEDBACK AT NEXT CLASS
WRITING MULTIPLE WRITING MULTIPLE CHOICE EXAM CHOICE EXAM
ITEMSITEMS
DOUGLAS A. BERNSTEINDOUGLAS A. BERNSTEIN
University of South FloridaUniversity of South Florida
Southampton UniversitySouthampton University
www.douglasbernstein.comwww.douglasbernstein.comdouglas.bernstein@[email protected]
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Jack Chang believes that his success in Jack Chang believes that his success in math is based upon hard work, but he math is based upon hard work, but he believes his difficulties in history are believes his difficulties in history are based upon an unfairbased upon an unfair
professor. Jack is likely from a(n) ______ professor. Jack is likely from a(n) ______ culture.culture.
A. collective C. A. collective C. competitivecompetitive
B. altruistic D. B. altruistic D. individualistindividualist
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
It is easier to notice the difference in It is easier to notice the difference in loudness between a two-piece and a loudness between a two-piece and a three-piece string ensemble than three-piece string ensemble than between a 110-piece and abetween a 110-piece and a
120-piece orchestra. This is predicted by120-piece orchestra. This is predicted by
A. the noise constant. A. the noise constant.
B. schema theory.B. schema theory.
C. perceptual constancy theory. C. perceptual constancy theory.
D. Fechner's law.D. Fechner's law.
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
The witness claimed the robber had a gun, although later examination of the surveillance video showed that this was not true. The witness’s perception of the event was likely influenced by
A. grouping principles. B. bottom-up processing. C. the simplicity principle. D. schemas.
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
The Theory of Planned Behavior proposes that intentions are a result of the following belief(s)
a. attitude and subjective normb. perceived behavioral controlc. a and bd. none of the above
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Factor analysisFactor analysisa. it is not designed to test a. it is not designed to test hypotheseshypothesesb. it is included in the SPSS packageb. it is included in the SPSS packagec. summarizes large sets of variables c. summarizes large sets of variables into smaller sets of into smaller sets of factorsfactorsd. all of the aboved. all of the above
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
In post traumatic stress disorder and according In post traumatic stress disorder and according to the DSM IV, trauma is defined as:to the DSM IV, trauma is defined as:
a. The level of damage to the individual after a. The level of damage to the individual after going through an intervention of any kind. going through an intervention of any kind.
b. An event or situation of overwhelming b. An event or situation of overwhelming emotional intensity where the person feels emotional intensity where the person feels or witnesses actual threat of death or or witnesses actual threat of death or serious injury.serious injury.
c. A natural catastrophe that does not affect c. A natural catastrophe that does not affect the great majority of people but only some the great majority of people but only some individuals to the extent of developing individuals to the extent of developing PTSD.PTSD.
d. None of the above.d. None of the above.
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Which of these is NOT a sign Which of these is NOT a sign of damage to descending of damage to descending motor pathways?motor pathways?
a. Increased muscle tonea. Increased muscle toneb. Loss of ability to perform b. Loss of ability to perform fine fine movementsmovementsc. Babinski reflexc. Babinski reflexd. None of the aboved. None of the above
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Which is a skin pigment:Which is a skin pigment:a. Melanina. Melanin
b. Caroteneb. Carotene
c. Haemoglobinc. Haemoglobin
d. All of the aboved. All of the above
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
In social sciences, who is In social sciences, who is NOTNOT a representative of the a representative of the constructivist movement: constructivist movement: a. Thomas Luckmana. Thomas Luckman
b. Abraham Maslowb. Abraham Maslow
c. Jean Piagetc. Jean Piagetd. Gregory Batesond. Gregory Bateson
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
On which part of a neuron can On which part of a neuron can the nodes of Ranvier be the nodes of Ranvier be found?found?
a. The dendritic spinesa. The dendritic spines
b. The somab. The soma
c. The axonc. The axon
d. The nucleusd. The nucleus
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
A researcher looking at an EEG of a A researcher looking at an EEG of a participant who participated in a study participant who participated in a study looking at brain activity during sleep looking at brain activity during sleep found that the prominent characteristics found that the prominent characteristics of the EEG were spindles and K-of the EEG were spindles and K-complexes. What stage of sleep is the complexes. What stage of sleep is the EEG representative of?EEG representative of?
a. Stage 1a. Stage 1
b. Stage 2b. Stage 2
c. Stage 3c. Stage 3
d. Stage 4d. Stage 4
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
The reticular formation has been The reticular formation has been found to play a part in arousal. found to play a part in arousal. Within what division of the brain Within what division of the brain can the reticular formation be can the reticular formation be found?found?
a. Mesencephalona. Mesencephalon
b. Metencephalonb. Metencephalon
c. Myelencephalonc. Myelencephalon
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
In an experiment, the In an experiment, the dependent variable is the dependent variable is the
a. causal variablea. causal variableb. affected variableb. affected variablec. experimental variablec. experimental variabled. first variable mentioned in d. first variable mentioned in the titlethe title
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
A test is reliable if it _____.A test is reliable if it _____.
a. provides accurate informationa. provides accurate informationb. provides adequate informationb. provides adequate informationc. produces similar scores on c. produces similar scores on retestsretestsd. measures what it was d. measures what it was designed to measuredesigned to measure
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Which of the following would a Which of the following would a person with prosopagnosia have person with prosopagnosia have difficulty with?difficulty with?
a. recognizing a person’s facea. recognizing a person’s faceb. recognizing a person's voiceb. recognizing a person's voicec. finding a location on a mapc. finding a location on a mapd. recognizing objects on the left-d. recognizing objects on the left-half of their visual fieldhalf of their visual field
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Who wrote the ‘cognitive-Who wrote the ‘cognitive-motivational analysis of motivational analysis of anxiety’?anxiety’?
a. Mogg & Bradleya. Mogg & Bradley
b. Ohman & Minekeb. Ohman & Mineke
c. Matthews & Macleodc. Matthews & Macleod
d. Fox & De Fockertd. Fox & De Fockert
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
What is the difference between state and trait What is the difference between state and trait anxiety? anxiety? a. The former refers to general anxiety and the a. The former refers to general anxiety and the latter refers to situational anxietylatter refers to situational anxietyb. The former refers to situational anxiety and b. The former refers to situational anxiety and the latter refers to general anxietythe latter refers to general anxietyc. The former refers to anxiety measured via c. The former refers to anxiety measured via physiological stress responses and the latter physiological stress responses and the latter refers to anxiety measured via a questionnaire.refers to anxiety measured via a questionnaire.d. The former refers to anxiety measured via a d. The former refers to anxiety measured via a questionnaire and the latter refers to anxiety questionnaire and the latter refers to anxiety measured via physiological stress responses.measured via physiological stress responses.
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
What are the three main components What are the three main components of attention as postulated by Posner of attention as postulated by Posner and Petersen?and Petersen?
a. Fixating, Tracking, & Scanninga. Fixating, Tracking, & Scanning
b. Orienting, Tracking, & Scanningb. Orienting, Tracking, & Scanning
c. Orienting, Shifting, & c. Orienting, Shifting, & DisengagingDisengaging
d. Tracking, Shifting, & Disengagingd. Tracking, Shifting, & Disengaging
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Which of the following statements regarding Which of the following statements regarding the theories of learning is truethe theories of learning is true
a. Pavlov is responsible for the theory of a. Pavlov is responsible for the theory of classical conditioningclassical conditioning
b. In classical conditioning, an b. In classical conditioning, an unconditioned stimulus is one that has not unconditioned stimulus is one that has not yet been paired with a responseyet been paired with a response
c. The amygdala is involved in learningc. The amygdala is involved in learning
d. The capacity of short term memory can d. The capacity of short term memory can be extended by chunkingbe extended by chunking
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Which of the following statements about Which of the following statements about attachment are trueattachment are truea. Bowlby is significant in the development of a. Bowlby is significant in the development of attachment theoryattachment theoryb. Rhesus monkeys given a choice between a b. Rhesus monkeys given a choice between a wire surrogate mother providing milk wire surrogate mother providing milk preferred her to a toweling covered mother preferred her to a toweling covered mother that did not provide milkthat did not provide milkc. According to Ainsworth there are 4 main c. According to Ainsworth there are 4 main types of attachmenttypes of attachmentd. The first reaction to separation from an d. The first reaction to separation from an attachment figure is despair.attachment figure is despair.
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Recent neuroimaging studies show Recent neuroimaging studies show that amygdala hyper-responsivity that amygdala hyper-responsivity and prefrontal hyporesponsivity and prefrontal hyporesponsivity could be characteristic of:could be characteristic of:a. Anxiety a. Anxiety
b. Depressionb. Depression
c. Schizophrenia c. Schizophrenia
d. Anorexia Nervosad. Anorexia Nervosa
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
According to Rothbart, Ellis & According to Rothbart, Ellis & Posner (2004), temperament can Posner (2004), temperament can be seen as part of the broader be seen as part of the broader domain of:domain of:a. Personality a. Personality
b. Aggression b. Aggression
c. Negative Affect c. Negative Affect
d. Characterd. Character
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Cognitive tasks examining Cognitive tasks examining executive control have been executive control have been shown to activate areas of the:shown to activate areas of the:a. Anterior Cingulate a. Anterior Cingulate
b. Broca's area b. Broca's area
c. Hippocampus c. Hippocampus
d. Occipital lobed. Occipital lobe
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
According to the HAPA, the According to the HAPA, the motivation stage is made up of the motivation stage is made up of the following component(s)following component(s)
a. self-efficacya. self-efficacyb. outcome expectanciesb. outcome expectanciesc. none of the abovec. none of the aboved. a and bd. a and b
CAN YOU IMPROVE THIS CAN YOU IMPROVE THIS ITEM?ITEM?
Which of these statements regarding Which of these statements regarding ADHD are trueADHD are true
a. ADHD as a disorder is more common a. ADHD as a disorder is more common in malesin males
b. ADHD is not hereditaryb. ADHD is not hereditary
c. According to the ICD10, Impulsivity is c. According to the ICD10, Impulsivity is not one of the cardinal features of ADHDnot one of the cardinal features of ADHD
d. According to the ICD10, there are d. According to the ICD10, there are three main types of ADHDthree main types of ADHD