QTIDI

Online

Demo WebinarDemo Webinar

Sue Milne, University of Glasgow & ELandWeb Ltd

Niall Barr, University of Glasgow

Project Aims

� The project will provide a documented and packaged version of

standards-compliant assessment delivery tools

� Learning Tools Interoperability (LTI) connection between popular

VLEs and delivery software

� QTIWorks rendering and responding engine � QTIWorks rendering and responding engine

� The tools will be distributed to the project’s client partners

� Kingston University,

� Harper Adams University College

� University of Strathclyde.

QTI – what’s that?� Question and Test Interoperability specification

� Version 2.1 is now final

� Standard for representing questions and tests

� Many implementations worldwide:

� UK, France, Netherlands, Germany, Spain� UK, France, Netherlands, Germany, Spain

� USA, Mexico

� Korea

� Used by

� Educational institutions for internal assessments

� Examination authorities (Scotland, Netherlands, Germany, Korea)

� Publishers for online content associated with textbooks

Why use QTI?� Interoperability:

� Share assessment resources with colleagues in same or other institutions

� Efficiency, less reinvention of wheels

� Economical – costly to produce good resources, so share and repurpose

� Preserve materials to prevent loss when changing systems� Preserve materials to prevent loss when changing systems

� Ensure content separate from software

� All these contribute to SUSTAINABILITY

� Flexibility:

� 20 or so input types – and extendable, e.g. Maths

� Several inputs in one question – engaging resources

� Targeted, individualised feedback, related directly to input

Tools

LTI Connector – connect VLE with delivery software

Delivery software:

LTIQuizzes – deliver basic question types

QTIWorks – all-singing, all-dancing delivery –includes facilities for Maths

LTI Connector for VLEs

Learning System

Our simple QTI 2.1

Assessment Tool - LTIQuizzes

Connecty

thing Learning System thing

(LTI)

Our fancy QTI 2.1

Assessment Tool – QTI Works

LTIQuizzes - basic delivery software

� Connects to VLE through LTI Connector

� Basic interactions: multiple-choice, drop-down,

short text, numerical input… (several in one short text, numerical input… (several in one

question if required)

� Numerical randomisation

� Feedback targeted on expected inputs

� Supports (most of) Uniqurate’s questions

QTIWorks – QTIv2.1 delivery software

� Validates questions and tests – reports problems

� Supports all QTIv2.1 UK HE profile

� Supports input and manipulation of Maths expressions� Supports input and manipulation of Maths expressions

� Full randomisation, including Maths expressions

� Feedback may be targeted on analysis of input

� Connects to VLE through LTI Connector

� … available late summer 2012

Installation?

� LTI – Moodle 2, newer versions of Blackboard and Sakai VLEs

are already LTI-enabled.

� LTIQuizzes – a single .war file needs to be copied to a Tomcat

server, then an XML configuration file is edited to add the LTI server, then an XML configuration file is edited to add the LTI

details (server names and shared secrets).

� QTIWorks – online demo at

https://www2.ph.ed.ac.uk/qtiworks/ , .war file expected

soon for institutional installation on Tomcat server

Links...� QTIWorks – online demo at

https://www2.ph.ed.ac.uk/qtiworks/

� QTI Support Site (examples, tools, resources...) http://qti-

support.gla.ac.uk

Contacts...Contacts...� Niall Barr (Project Leader) niall.barr@glasgow.ac.uk

� Sue Milne (Project Manager) sue.milne@e-learning-

services.org.uk

� David McKain (QTIWorks Developer) david.mckain@ed.ac.uk

Hands-on Time

Please type any questions or comments in the chat box...

Just in Case...

The following slides are provided in case the live demo

is not available...

They are quite mathematical in flavour, but resources

from other disciplines work just the same!

QTI WorksQTI Works https://www2.ph.ed.ac.uk/qtiworks/

Use the Demo section to try out questions and tests

Log in to set up LTI delivery data

QTI Works – Demos

Upload questions

or tests to check

operation

Validate questions

and tests

Try out and

download example

questions and tests

from collections

QTI Works – VLE Setup

Upload questions

or tests to use in

VLEs

Generate LTI data

for setting up

questions and tests

in VLEs

Uploading an Assessment� Content of uploaded assessments –question or test – can

be changed (e.g. fix a bug)

� Date of last change is displayed

Setting Up Assessment Launch Data� Saving a delivery with LTI enabled creates launch data

� Data is pasted into Moodle 2 External Tool dialog or

equivalent in other VLEs

QTI in Moodle 2 – Question

QTI in Moodle 2 – Question with Solution

QTI in Moodle 2 – Maths Input

Test: Algebra 1

This test is the one used in the Maths T1 topic Algebra 1. It is also

in the demo course.

Question in a Test

The indicator at top right shows the question status. No feedback is

visible during the test – students have been using these randomised

questions in formative mode for several weeks. Candidates return to

the list of questions to select another question.

Test feedback & review

These are the two parts of the feedback and review page; the scores

for the questions are displayed and the candidate may return to see

the questions and their input.