Item Construction 1

Assoc. Prof. Dr. Othman Md. Johan 1

OBJECTIVE AND ESSAY ITEM CONSTRUCTION BASED ON BLOOM'S COGNITIVE TAXONOMY

ASSOC. PROF.DR. OTHMAN MD.JOHAN

FACULTY OF EDUCATIONUNIVERSITI TEKNOLOGI MALAYSIA

By

PSYCHOLOGICAL TESTING AND MEASUREMENTMPF 2103


OBJECTIVES OF THE TALK Participants should be able to:

State the definition of the various cognitive levels of Bloom’s Taxonomy, namely- Knowledge- Comprehension- Application- Analysis- Synthesis- Evaluation

2. State the keywords for each levels with relevant examples

3. Use the various cognitive levels in the construction of test questions


1. Cognitive Levels : Knowledge

Definition:

- Knowledge means the ability to recall or state information. Place in the Hierarchy of Cognitive Skills:

- This is the lowest level of the hierarchy. It is necessary to be able to recall information before it can be comprehended or used for higher level activities.


1. Cognitive Levels : Knowledge

Cognitive Level Key Words Examples

Knowledge:

o Recall of data defines, describes, identifies, knows, labels, lists, matches, names, outlines, recalls, recognizes, reproduces, selects, states.

Recite a policy. Quote prices from

memory to a customer.

Knows the safety rules.


Examples of knowledge questions

1 Which of the following are the raw materials for photosynthesis?

A Water, heat, sunlightB Water, carbon dioxide, sunlight * C Sunlight, oxygen, carbohydratesD Carbon dioxide, sunlight, oxygen

2 Which of the following is one of the major approaches to psychology?

A PsychiatryB StructuralismC Psychoanalysis *D New Age Movement


Examples of knowledge questions Language Arts:

- Recite a poem. - State the title of the play in which someone says, "To be or not to be…." - State the rule for using a semicolon in a sentence.- Spell "cat.“

Mathematics: - State the formula for the area of a circle.

- State the definition of an isosceles triangle. - Recite the multiplication tables up to 12 x 12.

Science: - Define sexual reproduction.- Describe sexual reproduction. - Draw a diagram that describes sexual reproduction.


Examples of knowledge questions Physical Education:

- State the correct distance of a marathon.- State the rule for balls and strikes in baseball. - Describe what is meant by a sprained ankle.

Computer Literacy: - Describe how to copy text from one program into another.- State the correct definition of a disk operating system. - Describe how to transfer files from a Macintosh system to a

Windows system that runs the same programs.


Examples of knowledge questions Educational Psychology:

- Give the definition of punishment.

{This would be a knowledge-level response if the learner answered by giving the example that the textbook or lecturer had given. If the learner had to make up his own example, this would be an example of application.}

- State the definition of application in Bloom's Taxonomy.

{This would be a knowledge-level response only if the difference is clearly stated in a textbook or lecture and all the learner has to do is remember that response. If the learner read the distinction in the book and had to paraphrase it in order to give the answer, this would be an example of comprehension. If the learner had to make up this distinction on his own, it might be an example of synthesis.}


2. Cognitive Levels : Comprehension

Definition:

- Comprehension means the ability to give meaning to information. Place in the Hierarchy of Cognitive Skills:

- Knowledge is a prerequisite for comprehension. Comprehension is a prerequisite for all higher-level activities.


2. Cognitive Levels : Comprehension


Comprehension:

o Understand the meaning, translation, interpolation, and interpretation of instructions and problems.

o State a problem in one's own words.

comprehends, converts, defends, distinguishes, estimates, explains, extends, generalizes, gives examples, infers, interprets, paraphrases, predicts, rewrites, summarizes, translates.

Rewrites the principles of test writing.

Explain in one’s own words the steps for performing a complex task.

Translates an equation into a computer spreadsheet.


Examples of comprehension questions1 If living cells similar to those found on earth were found on another planet where there

was no molecular oxygen, which cell part would most likely be absent?

A Nucleus B RibosomeC Mitochondria *D Cell membrane

3 Why did John B. Watson reject the structuralist study of mental events?

A He actually embraced both structuralism and functionalism B He believed that structuralism relied too heavily on scientific methodsC He rejected the concept that psychologists should study observable behaviourD He believed that scientists should focus on what is objectively observable *


Examples of comprehension questions Language :

- Explain what a poem (or a line in a poem) means.

- Describe in your own words when it is proper to use a semicolon in a sentence.

Mathematics:

- Given the mathematical formula for the area of a circle, paraphrase it using your own words.

- What is meant by the definition of an isosceles triangle.

Science:

- Answer questions about sexual reproduction that demonstrate an understanding of the component concepts.

- Explain in your own words what a recessive gene is.


Examples of comprehension questions Physical Education:

- State in your own words why a modern marathon is its current disatance.- State in your own words the rule for balls and strikes in baseball. - Describe in your own words what is meant by a sprained ankle. {A very large number of objectives in a physical education class would be psychomotor objectives, not cognitive outcomes.}

Computer Literacy:

- Describe in your own words how to copy text from one program into another.- Answer questions to clarify the correct definition of a disk operating system. - - Describe in your own words how to transfer files from a Macintosh system to a Windows system that runs the same programs.


Examples of comprehension questions

Educational Psychology:

- Paraphrase accurately the textbook definition of punishment.- Give in your own words the definition of application in Bloom's Taxonomy. - State the difference between the knowledge and comprehension

levels of Bloom's Taxonomy.

{This would be a knowledge-level response if the difference is clearly stated in a textbook or lecture and all the learner has to do is remember that response. If the learner read the distinction in the book and had to paraphrase it in order to give the answer, this would be an example of comprehension. If the learner had to make up this distinction on his own, it might be an example of synthesis.}


3. Cognitive Levels : Application

Definition:

- Application entails the ability to use knowledge or principles in new or real-life situations.

Clarification of terms in the definition:

- Application refers to rule using rather than problem solving, which means a higher level of thinking. Bloom's use of the term application differs from our normal conversational use of the term. When working at any of the four highest levels of the taxonomy, we "apply" what we have learned. At the application level, we "just apply." At the higher levels, we "apply and do something else." Perhaps it would be best to think of this level as simple application.



- Note that application and use are not synonymous. For example, a person who spells "cat" correctly is not applying the rule for spelling cat. This is

a simple knowledge task. However, a person who spelled "remedied" by "changing the y to i and adding ed" would be applying that rule. Place in the Hierarchy of Cognitive Skills: - Comprehension is a prerequisite for application. Application is a prerequisite for analysis, synthesis, and evaluation




Application:

o Use a concept in a new situation or unprompted use of an abstraction.

o Applies what was learned in the classroom into novel situations in the workplace.

applies, changes, computes, constructs, demonstrates, discovers, manipulates, modifies, operates, predicts, prepares, produces, relates, shows, solves, uses.

Use a manual to calculate an employee’s vacation time.

Apply laws of statistics to evaluate the reliability of a written test.


Examples of application questions

1 Which one of the following memory systems does a piano-tuner mainly use in his or her occupation?

A Echoic memory *B Short-term memory C Long-term memory D Mono-auditory memory

3 A researcher shows erotic films to one group of subjects and violent films to another group of subjects. The researcher then assesses the cooperativeness of each group of subjects. The independent variable in this study is

A the type of film seen *B the level of cooperativenessC the level of sexual arousal in subjectsD the level of aggressiveness in subjects


Examples of application questions Language :

- Write a part of a poem (perhaps by changing a metaphor or inserting a different word that rhymed). - Identify an example of a metaphor in a poem. - Use the rule for a semicolon in a sentence.

Mathematics: - Compute the area of actual circles.- Recognize an isosceles triangle. - Use the multiplication tables up to calculate that there are 144 people in a with 12 pews and 12 people in each pew.

Science: - Use principles about recessive genes to predict the results of matings one and two generations later.

- Given examples of several characteristics and the results of matings, designate which matings involved recessive genes.


Examples of application questions Foreign Languages:

- Look at the clock and express the time correctly in French.

Physical Education:

- Given the alignment and activities of football players during a play, state whether the defense was using a zone or man-to-man defense.

- State whether a pitch was a ball or strike in baseball.

- Correctly identify an example of a sprained ankle.

{A very large number of objectives in a physical education class would be psychomotor objectives, not cognitive outcomes.}

Computer Literacy:

- Correctly copy text from one program into another.

- Correctly transfer files from a Macintosh system to a Windows system that runs the same programs.


4. Cognitive Levels : Analysis

Definition: - Analysis entails the ability to break down complex information into simpler parts and to understand the relationships among the parts.

- In normal language, when we break down complex information into simpler parts, we call this analysis. - For example, the person who describes exactly what is happening (and why it is happening) during a football game is called a sports analyst. Place in the Hierarchy of Cognitive Skills:

- Application is a prerequisite for analysis. - Analysis was originally considered to be a prerequisite for synthesis; but there is not universal agreement on this issue. That is, some theorists believe that a person who is capable of application can go directly to synthesis (without first learning analysis) – at least in some areas. - Analysis or synthesis is a prerequisite for evaluation.


4. Cognitive Levels : Analysis


Analysis:

o Separates material or concepts into component parts so that its organizational structure may be understood.

o Distinguishes between facts and inferences.

analyzes, breaks down, compares, contrasts, diagrams, deconstructs, differentiates, discriminates, distinguishes, identifies, illustrates, infers, outlines, relates, selects, separates.

Troubleshoot a piece of equipment by using logical deduction.

Recognize logical fallacies in reasoning.

Gathers information from a department and selects the required tasks for training.


Examples of analysis questions

1 Mitochondria are called the powerhouses of the cell because they make energy available for cellular metabolism. Which of the following observations is most cogent in supporting this concept of mitochondrial function?

A ATP occurs in the mitochondria B Mitochondria have a double membrane C Mitochondria are found in almost all kinds of plant and animal cells D The enzymes of the Krebs cycle, and molecules required for terminal respiration, are found in mitochondria *

2 Determine one of the differences between a cube and a cuboid.

A A cube has all the plane surfaces equal in areaB The length of a cuboid is greater than that of a cubeC The height of a cube greater than that of a cuboid D The plane surface area of a cuboid is less than that of a cube


Examples of analysis questions Language :

- Given a poem, identify the specific poetic strategies employed in it.

Mathematics:

- Given a math word problem, determine the strategies that would be necessary to solve it.

Science:

- Given the results of a mating that involves several principles and concepts, explain the results of the mating in terms of these principles and concepts.


Examples of analysis questions Arts/Music:

- Analyze a painting in terms of how well it uses various artistic techniques to achieve its effect.

Physical Education:

- While watching a football game, explain a given play in terms of type of defense, type of offense, and the options exercised by both the defense and offense to make the play work.

Computer Literacy:

- Given the rough and final drafts of a 10-page document written on a word processor identify the techniques the author would have used to transform the first document into the second.


5. Cognitive Levels : Synthesis

Definition:

- Synthesis means the act of creating something that did not exist before by integrating information that had been learned at lower levels of the hierarchy.

- This is really a common-sense definition of the word. In normal language, when we put together a whole series of skills, we say we are synthesizing those skills.

Place in the Hierarchy of Cognitive Skills:

- Synthesis is a prerequisite for evaluation.


5. Cognitive Levels : Synthesis


Synthesis:

o Builds a structure or pattern from diverse elements.

o Put parts together to form a whole, with emphasis on creating a new meaning or structure.

categorizes, combines, compiles, composes, creates, devises, designs, explains, generates, modifies, organizes, plans, rearranges, reconstructs, relates, reorganizes, revises, rewrites, summarizes, tells, writes.

Write a company operations or process manual.

Design a machine to perform a specific task.

Integrates training from several sources to solve a problem.

Revises and process to improve the outcome.


Examples of synthesis questions 1 If Homer wrote The Iliad today, Stanley Fish and Harold Bloom would argue,

respectively, whether the work should be classified as

A modern vs. romantic B existential vs. romantic C postcolonial vs. modernD post-modern vs. classical E preliterate vs. post-literate

2 What would happen if the terminals of an ordinary household light bulb were connected to the terminals of an automobile storage battery?

A The bulb would explode B The bulb would light to its brillianceC The battery would go dead in a few minutesD The bulb would not glow, though some current would flow through it


Examples of synthesis questions Mathematics:

- Apply and integrate several different strategies to solve a mathematical problem.

Arts/Music:

- Draw a painting that uses various principles of perspective to achieve its effect.

Physical Education:

- While playing quarterback on offense in a football game, respond to a particular defense by selecting the proper options, based on principles that the coach has taught you.

Computer Literacy:

- Use a word processor to generate a 10-page document that meets designated standards.


- Apply the strategies learned in educational psychology in an organized manner to solve an educational problem.


6. Cognitive Levels : Evaluation

Definition:

- Evaluation means the ability to make judgments based on previous levels of learning to compare a product of some kind against a designated standard.

- To meet Bloom's definition, there has to be a comparison to a cognitive standard of some kind. For example, if a course evaluation asked you to analyze what a teacher did and to state how well he did each of these things compared to some standard of performance, this would fit Bloom's definition of evaluation.

Place in the Hierarchy of Cognitive Skills:

- Evaluation is the highest level of cognitive activity in any area


6. Cognitive Levels : Evaluation


Evaluation:

o Make judgments about the value of ideas or materials.

appraises, compares, concludes, contrasts, criticizes, critiques, defends, describes, discriminates, evaluates, explains, interprets, justifies, relates, summarizes, supports.

Select the most effective solution.

Hire the most qualified candidate.

Explain and justify a new budget.


Examples of evaluation questions 1 Disregarding the relative feasibility of the following procedures, which of these lines of

research is likely to provide us with the most valid and direct evidence as to evolutionary relations among different species?

A Analysis of the form of the Krebs cycleB Determination of the total protein in the cellC Comparison of details of the molecular structure of DNA *D Analysis of the chemistry of stored food in female gametes

2 Which of the following would be most appropriately assessed by an essay item?

A Stating a major formula in chemistryB Interpreting the results of an experiment *C Recall the Newtonian laws of thermodynamics D Locating a given element in the periodical table


Examples of evaluation questions Language :

- Critique your peer’s speech, based on the criteria we have studied this semester.

Mathematics:

- When your peer have finished solving a problem, determine the degree to which that problem was solved as efficiently as possible.

Science:

- After designing an experiment, examining the results, and drawing conclusions, determine in what ways the experiment could be conducted more effectively in order to draw more productive conclusions in the future.

Social Studies:

- Examine the stated positions of both major political candidates with regard to a particular issue and state good reasons (based on principles discussed in class) for why one candidates position is more likely to be effective than the other's.


Examples of evaluation questions Computer Literacy:

- After using a word processor to generate a 10-page document, determine the degree to which it meets designated standards and suggest strategies for meeting those standards more effectively.

Counseling:

- Given a videotape of a situation in which the client encountered a person who made her anxious, the client will use the principles discussed with the counselor to determine the degree to which she handled the situation effectively and will suggest specific strategies for handling the situation more effectively in the future.


- Observe another teacher (or yourself) and determine the quality of the teaching performance in terms of the teacher's appropriate application of principles of educational psychology.


A Teacher Takes A HandOpens A MindTouches A HeartShapes The Future.

Item Construction 1

Documents

Transcript of Item Construction 1