Learning Object Virtualization Allowing for Learning Object

Assessments and Suggestions for Use

Olivier CATTEAU, Philippe VIDAL, Julien BROISIN

Institut de Recherche en Informatique de Toulouse

Outline

Learning Object Assessments and Suggestions for Use

Research Issues Proposed Approach Implementation Conclusion and perspectives

Annotations

LOM Annotation Category « enable educators to share their

assessments of learning objects, suggestions for use, etc. »

IEEE-LTSC, 1484.12.1-2002, IEEE Standard for Learning Object Metadata

Production

Diffusion

Use

Re-Authoring

Termination

[ICALT’06] Why assesments?

LO & Metadata Lifecycle

Production

AuthoringTools

Ready-to-useLearning Object Metadata

Author

+ Annotations

LOR

Are annotations objective?

Production Diffusion

Use

Re-Authoring

Termination

Diffusion

LOR

LearningManagement

System

Editing teacher

Learning Object Assessments Help teachers to

build a curriculum

Production Diffusion

Use

Re-Authoring

Termination

Diffusion & Use

LOR

LearningManagement

System

Learning Object Assessments Help teachers to

build a curriculum

Suggestions for Use Avoid

pedagogical mistakes

Help building a learning design

Teacher

Production Diffusion

Use

Re-Authoring

Termination

Re-authoring(Feedback step)

Teacher

Student

LOR

LearningManagement

System

Usercomments

Subject Matter Expert

Peer reviewing

Suggestionsfor Use

Improve Learning Objectcontent, form or description

Production Diffusion

Use

Re-Authoring

Termination

What’s in the reality?

Existing Reviewing SystemsMemoNote

LORAzouaou & Desmoulins, A Flexible and ExtensibleArchitecture for Context-Aware Annotation in E-Learning,ICALT’06

ExistingReviewing Systems

ExistingReviewing Systems

ExistingReviewing Systems

ExistingReviewing Systems

ExistingReviewing Systems

ExistingReviewing Systems

ExistingReviewing Systems

ExistingReviewing Systems

LearningManagement

System

Qualitative &/or quantitativepeer review with criteria

by a domain expert

User comments &/orquantitative evaluation

Suggestionsfor use

Evaluation Criteria according to LO types

LOR

Existing Reviewing SystemsSynthesis

LOR Quantitative Review

Qualitative Review

Evalutech NO Peer review by domain expert

Harvey Project NO Peer review + Classroom testing

LORI Peer review

MERLOT Peer review (2 domain experts)Member comments

Wisconsin Online Public comments

Issues Need for sharing and reusing peer reviews,

comments and suggestions for useInformation stored in metadata

The LOM Annotation Category has to be improved

8. Annotation

8.3 Description

8.2 Date

8.1 Entity

Teacher ?Student ?Subject Matter Expert?

Global ?Criterion?Suggestion for Use?

Quantitative evaluation?

Issues

Systems elaborated to manage assessments differ from the system used to learn and teach

Proposed approach

Collection of annotations through a LMS

Storage of annotations within metadata and LOR

LearningManagement

System

LOR

Modified Annotation Category

8. Annotation

8.3 Description

8.2 Date

8.1 Entity

8. Annotation 8.3 Description8.2 Date

8.1’ Contribute 8.1’.1 Entity

8.4 Annotation Type8.5 Quality Level

8.1’.2 Role

Closer to the end userThe LOV Design

LMS 1 LMS 2

Search Importation Indexation Generation

Specific API 1

Federation Layer

Integration LayerVirtualization Layer

Specific API 2

LOR 1 LOR 2

LOR WEB SERVICES

PHP

SOAP/HTTP

Storage of Learning Objects& Metadata

PHP

LOM++

Annotation

● Peer review● Comments

● Comments● Suggestion for use

Subject Matter Expert

● Import

● Import

Teacher● LO selection

Student● Use● Use

LOM++

Benefits Annotations:

are added when they become relevant can be shared from several LMS can be stored on multiple LOR

Criteria can be customized depending on the user role

LO selection can be improved (quality-based sorting) to build a courseware

Teachers avoid pedagogical mistakes

Implementation

Search Importation Indexation Generation

Specific API

Federation Layer

Integration LayerVirtualization Layer

KPS

ARIADNE WEB SERVICES

PHP

SOAP/HTTP

Storage of Learning Objects& Metadata

LOM

Annotation

Moodle Roles:● administrator● course creator● editing teacher● teacher● student● guest+ subject matter expert

LO evaluations within the LMS

Fast global evaluation

Detailed evaluation

Annotation Types:● global● suggestion for use● content quality● effectiveness● ease to use

Annotation submission sequence

: USER LMS AMS AWS KPS

1. Fill annotationform 2. Deliver annotation

3. Generate vCard,role,LOR location,LO id

4. Send annotationinformation

5. Update LO metadata

Conclusion Share and reuse of annotations

An open architecture that facilitates LO assessments & suggestions for use

Annotations are submitted and retrieved when and where they become relevant

June, 26th 2008 19798 materials 2599 peer reviews 5736 comments 1218 assignments

Perspectives Modifications applied to the Annotation

category should be adopted by consensus

Annotation types adapted to the user role

Criteria customized according to the LO type

In situ annotations Personal Annotations

Thanks for your attention