TitleSubtitle

QTI 2.1 and the Common Cartridge

Niall S F Barrn.barr@admin.gla.ac.uk

Background: The Common Cartridge

Simple profile of IMS Content Packaging Contains:

A single organization HTML web pages Forum placeholders Quizzes Itembanks LTI links (coming in version 1.1)

Background: CC 1.0 QTI

A profile of QTI 1.2.1 One enhancement – regular expressions Six (really 3) item types:

Multiple choice True/False Multiple Response Short text Essay Expression match

Can be imported into legacy assessment systems

A QTI 1.2.1 CC Item<item ident="QUE_104045" title="Question 01"><!-- start multiplechoice --><itemmetadata><qtimetadata><qtimetadatafield><fieldlabel>cc_profile</fieldlabel><fieldentry>cc.multiple_choice.v0p1</fieldentry></qtimetadatafield><qtimetadatafield><fieldlabel>cc_question_category</fieldlabel><fieldentry>Chapter 01</fieldentry></qtimetadatafield><qtimetadatafield><fieldlabel>cc_weighting</fieldlabel><fieldentry>2</fieldentry></qtimetadatafield></qtimetadata></itemmetadata><presentation><material><mattext texttype="text/html">Which of the following best defines psychology?</mattext></material><response_lid ident="QUE_104045_RL" rcardinality="Single"><render_choice><response_label ident="QUE_104045_A1"><material><mattext texttype="text/html">the scientific study of behavior and mental processes</mattext></material></response_label><response_label ident="QUE_104045_A2"><material><mattext texttype="text/html">the science of mental and emotional disorder</mattext></material></response_label><response_label ident="QUE_104045_A3"><material><mattext texttype="text/html">the science of human and animal behavior</mattext></material></response_label><response_label ident="QUE_104045_A4"><material><mattext texttype="text/html">the study of actions and reactions</mattext></material></response_label></render_choice></response_lid></presentation>

<resprocessing><outcomes><decvar defaultval="0" maxvalue="100" varname="SCORE" vartype="Integer"/></outcomes><respcondition><conditionvar><varequal respident="QUE_104045_RL">QUE_104045_A1</varequal></conditionvar><setvar action="Set" varname="SCORE">100</setvar><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_1_IC"/><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_ALL"/></respcondition><respcondition><conditionvar><varequal respident="QUE_104045_RL">QUE_104045_A2</varequal></conditionvar><setvar action="Set" varname="SCORE">0</setvar><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_2_IC"/><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_ALL"/></respcondition><respcondition><conditionvar><varequal respident="QUE_104045_RL">QUE_104045_A3</varequal></conditionvar><setvar action="Set" varname="SCORE">0</setvar><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_3_IC"/><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_ALL"/></respcondition><respcondition><conditionvar><varequal respident="QUE_104045_RL">QUE_104045_A4</varequal></conditionvar><setvar action="Set" varname="SCORE">0</setvar><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_4_IC"/><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_ALL"/></respcondition><respcondition><conditionvar><other/></conditionvar><displayfeedback feedbacktype="Response" linkrefid="QUE_104045_ALL"/></respcondition></resprocessing><itemfeedback ident="QUE_104045_1_IC"><material><mattext texttype="text/html"/></material></itemfeedback><itemfeedback ident="QUE_104045_2_IC"><material><mattext texttype="text/html"/></material></itemfeedback><itemfeedback ident="QUE_104045_3_IC"><material><mattext texttype="text/html"/></material></itemfeedback><itemfeedback ident="QUE_104045_4_IC"><material><mattext texttype="text/html"/></material></itemfeedback><itemfeedback ident="QUE_104045_ALL"><material><mattext texttype="text/html">Incorrect</mattext></material></itemfeedback></item>

Issues with QTI 1.2.1 CC

Lots of redundant XML that is identical in each item

Meta-data is needed to control presentation A 'correct' QTI 1.2.1 player will display

feedback incorrectly It is QTI 1.2.1 – wasn't QTI 2.0 created

because of issues with QTI 1.2.1?

Issues with QTI 1.2.1 CC

Lots of redundant XML that is identical in each item

Meta-data is needed to control presentation A 'correct' QTI 1.2.1 player will display

feedback incorrectly It is QTI 1.2.1 – wasn't QTI 2.0 created

because of issues with QTI 1.2.1? However, commercial software publishers

supported QTI 1.2.1 (sort of...)

QTI 2.1

In many ways similar to QTI 1.2.1 Presentation section with text and interactions Response processing describes a marking

system An in many ways different

Variables declared at the start Presentation uses XHTML (and MathML) Interactions clearly defined 'Correct' value can be declared at the top.

Several implementations with high degree of interoperability

Issues for the Common Cartridge

Common Cartridge has to be reasonably easy to implement – Importing items, not interpreting or compiling

them. Response processing has to stick to very

simple rules. Feedback has to accommodate different styles

(option specific or just correct/incorrect)

QTI 2.1 actually can do this!

Response processing templates specifically designed to address the issue of simple systems

'Correct' values (mappings) are closer to simple formats

Just a few extra rules needed Only use 'template' response processing One interaction only Non- adaptive Fixed names for feedback variables Simplest possible assessments and itembanks

QTI 2.1 actually can do this!

<?xml version="1.0" encoding="utf-8"?><assessmentItem xmlns="http://www.imsglobal.org/xsd/imsqti_v2p1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.imsglobal.org/xsd/imsqti_v2p1 imsqti_v2p1.xsd" identifier="Choice_example_01"

title="Choice 1" adaptive="false" timeDependent="false"><responseDeclaration identifier="RESPONSE" cardinality="single" baseType="identifier"><correctResponse><value>QUE_104045_A1</value></correctResponse></responseDeclaration><outcomeDeclaration identifier="SCORE" cardinality="single" baseType="integer"><defaultValue><value>0</value></defaultValue></outcomeDeclaration><outcomeDeclaration identifier="FEEDBACK" cardinality="single" baseType="identifier"/><outcomeDeclaration identifier="FEEDBACKBASIC" cardinality="single" baseType="identifier"/><outcomeDeclaration identifier="MAXSCORE" cardinality="single" baseType="integer"><defaultValue><value>100</value></defaultValue></outcomeDeclaration><itemBody><choiceInteraction responseIdentifier="RESPONSE" shuffle="false" maxChoices="1"><prompt>Which of the following best defines psycology?</prompt><simpleChoice identifier="QUE_104045_A1">the scientific study of behaviour and mental processes <feedbackInline outcomeIdentifier="FEEDBACK" showHide="show" identifier="QUE_104045_A1">Yes, that is correct, well Done</feedbackInline></simpleChoice><simpleChoice identifier="QUE_104045_A2">the science of mental and emotional disorder <feedbackInline outcomeIdentifier="FEEDBACK" showHide="show" identifier="QUE_104045_A2">No psycology is not only about disorder, the correct answer is "the scientific study of behaviour and mental processes</feedbackInline></simpleChoice><simpleChoice identifier="QUE_104045_A3">the science of human and animal behaviour <feedbackInline outcomeIdentifier="FEEDBACK" showHide="show" identifier="QUE_104045_A3">No psycology also covers the processes underlying behaviour, the correct answer is "the scientific study of behaviour and mental processes</feedbackInline></simpleChoice><simpleChoice identifier="QUE_104045_A4">the study of actions and reactions <feedbackInline outcomeIdentifier="FEEDBACK" showHide="show" identifier="QUE_104045_A4">No that answer is too vague, the correct answer is "the scientific study of behaviour and mental processes</feedbackInline></simpleChoice></choiceInteraction><div id="hintcontainer"><a href='#' OnClick="javascript:document.getElementById('hint').style.visibility = 'visible';">Hint: </a><div id="hint" style="visibility:hidden;">This is the hint.</div></div></itemBody><responseProcessing template="CC2_match"/><modalFeedback outcomeIdentifier="FEEDBACKBASIC" showHide="show" identifier="correct">Well done!</modalFeedback><modalFeedback outcomeIdentifier="FEEDBACKBASIC" showHide="show" identifier="incorrect">No, the correct answer is "the scientific study of behaviour and mental processes".</modalFeedback></assessmentItem>

A few minor changes

Case insensitive mapping and mapping to regular expressions<mapEntry mapKey="^hierarchy\s*need$" mappedValue="50" caseSensitive="false" mapIsRegex="true"/>

New response processing templates Standard (preferred) feedback and simple

feedback variations A no-penalty feedback system (that doesn't

require an adaptive item)

A few minor changes

Case insensitive mapping and mapping to regular expressions<mapEntry mapKey="^hierarchy\s*need$" mappedValue="50" caseSensitive="false" mapIsRegex="true"/>

New response processing templates Standard (preferred) feedback and simple

feedback variations A no-penalty feedback system (that doesn't

require an adaptive item) Will be adopted by Common Cartridge 1.2

The future

QTI 2.1 is in a very strong position It needs (one or two) profiles It needs more examples Maybe it needs better documentation...