1. Quality standards and user-based mechanisms for Open Educational Resources - convergence or contradiction?Experiences from the OpenScienceResources project
OnlineEduca Berlin, December 2010
Prof. Dr. Jan M. Pawlowski
Kati I. Clements

2. Licensing: Creative Commons
You are free:
to Share to copy, distribute and transmit the work
to Remix to adapt the work
Under the following conditions:
Attribution. You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work).
Noncommercial. You may not use this work for commercial purposes.
Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.
http://creativecommons.org/licenses/by-nc-sa/3.0/
http://www.slideshare.net/jan.pawlowski
3. JYU: Global Information Systems
Projects
OpenScout: OER for Management
NORDLET: Nordic Baltic Network for Learning, Education and Training
COSMOS, Open Science Resources: Exchange of Scientific Content
ASPECT: Open Content and standards for schools
iCOPER: New standards for educational technologies
LaProf: Language learning in ICT and agriculture
Focus areas
Global Information Systems
Supporting globally distributed workgroups
Open Educational Resources
Reference Modeling
E-Learning
Supporting international education settings
Cultural adaptation
Standardization & Quality Management
Mobile & Ambient Learning
Innovative tools and solutions
4. Contents
Barriers of OER use
Quality
Trust
Case Study Results:
What does quality mean for users?
Mixed approach of quality standards and user-based quality mechanisms
The users view
5. Open Educational Resources
6. Challenges in quality assurance
Huge amount of available contents
No wisdom of the crowd effect
Potential problems in OER repositories
Scientifically incorrect content
Broken links
IPR violations
Inadequate recommendations: Context content preferences
Voluntary / non-profit contributors
How to assure the quality in OER repositories in a sustainable solution which can still support itself after projects end?
7. Instruments to assure quality
Quality standards which are agreed on by a formal standardization body such as ISO or CEN
ISO 9000, EFQM, or ISO/IEC19796-2 for organizations
Quality marks for resources
Certifications qualifications for individuals
User oriented mechanisms
Meeting users quality needs
Recommendation mechanisms
Rankings
Peer-reviewing
What do the users consider useful?
8. Twosurveys on teachers
Second survey (n=66): Teachers from Lithuania, Portugal, Finland, Belgium, Romania Austria, Sweden, Greece, United Kingdom, Bulgaria, Turkey and one teacher from Ethiopia.
All teachers were from the domains of IT, Maths and Science
First survey (n=80): Teachers from Lithuania, Portugal, Finland, Belgium and Romania
9. European teachers find resources
10. Barriers of re-use
11. Preliminary findings
Users do not trust materials (in contrast to wikipedia)
Users are willing to share and re-use
Users base their decisions on trust
Formal standards can create trust in organizations,
User based mechanisms can create trust in resources.
How do users perceive and trust different mechanisms?
12. 13. Quality of resources means to the users
Good use of multimedia (animations, simulations): 83%
Scientifically correct: 80%
Fit their lessons or curriculum: 79%
Technical interoperability: 68%
Created in an organization with a good reputation(e.g., CERN, Harvard, NASA):55%
Own quality strategy: 17%
14. Which resources do you trust?
I trust organizations with good reputation(85%)
Quality for me means that the resources come from an organization with good reputation (55%)
15. Users willingness to contributetowardsquality of resources
16. OSR Approach
Utilize existing certificates, standards, qualifications to minimize operational efforts
Trust as the key concept
Integrate different levels
Organizations
Resources
Individuals
Engage users in quality assurance
Create a sustainable model
17. OSR Approach
18. An example: COSMOS Portal
19. First degree trusted network
Topic / ContextA
Topic / ContextB
Second degree trusted network
Collaboration network construction
Efficient network organization is the key to success
Tools are needed to facilitate the process
Open Issues:

Factors?

20. Organization? 21. The right network?