Designing Online Information systems for portfolio based assessment-Design criteria and heuristics

8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics

1/25

Designing Online Information systems for

portfolio based assessment-Design criteria and

heuristics

Submitted by:

Sushant Srivastava (09609182)

Priyanka Bahal (09609084)Poornima Balani (09609181)

Saima Ahmed (06503869)

17-08-2010 1

designing online information system for

portfolio based assessment-design criteria

and heuristics


2/25

Objectives

The aim of the paper is to provide information about theonline portfolio information systems.

It highlights how online systems have led to the maximizationof shareholder value.

The paper explores issues related to information storage,automation of functions, security and fraud.

It provides an understanding of the importance and benefitsof online systems as compared to conventional systems.

17-08-2010 2



and heuristics


3/25

Introduction

There has been a significant increase in the use of online

systems in secondary, tertiary and primary education system

over the last few years.

The paper talks about research undertaken by Love and

Cooper which highlights the benefit of such systems over

traditional ones.

The primary themes evaluated were integrity of course

design and benefits for all stakeholders.

17-08-2010 3



and heuristics


4/25

What is a portfolio?

Portfolios are complex educational tools that require full

integration into carefully crafted course designs.

Portfolio assessment consists of a number of interlinkedprocess and the specific processes depend directly or aremodified according to the course design.

Online portfolio assessment requires a carefulintegration/amalgam of different processes.

There are different process issues for different stakeholdersand they are quite different in type and magnitude fromoffline assessment processes.

17-08-2010 4



and heuristics


5/25

Online portfolios are increasing in universities because:

1. The obvious advantage of online portfolios overtraditional modes of assessment.

2. Recent changes in the educational environment of

institutions that favor the use of portfolios in assessment

of stakeholder groups.

17-08-2010 5



and heuristics


6/25

Benefits of Portfolio for assessment and learning

Portfolios can contain many different types of evidence and

from different sources.

Portfolios provide an opportunity for students to manage

their own professional development.

They resolve may assessment problems, especially in equity

and moderation.

Portfolios provide a richer picture of students, their learning

and their competencies.

Portfolios are well suited to authentic learning environments.17-08-2010 6



and heuristics


7/25

Stakeholder groups

Designing online education courses requires carefulconsideration of stakeholders and relative value distribution

of different stakeholder groups.

The value of online portfolio assessment is interpreted only interms of that particular group.

The broadest approach of evaluation can be in terms of

number of students attending the course, teaching staff,academic line managers, learning support technologists and

university upper level managers and administrators.

17-08-2010 7



and heuristics


8/25

Trends Shaping University

Education Successfully designing and evaluating online portfolio

assessment systems to distribute value and benefit to

stakeholders requires morethan identifying the stakeholder

In educational contexts, customer are poorly suited todescribing the institutionalised power and service relations.

It is necessary to look to the institutional structures and

mores that govern what is valued in different educational

sectors and situations.

The design of future courses in universities is influenced by

a variety of factors .

17-08-2010 8



and heuristics


9/25

FACTORS

Evidence-based assessment

Employability

Quality assurance

Equity

Addressing plagiarism

Increasing commercialisation, modularisationand globalisation

17-08-2010 9



and heuristics


10/25

Evidence-based assessment is increasingly found in

university systems in Australia and the US.

Evidence-based assessment requires demonstration of

application of a body of knowledge rather than knowing

about a body of knowledge.

In fast changing Designing Online Information Systems for

Portfolio-Based Assessment 1452

disciplines, it is unsatisfactory to assess knowledge of content

likely to be obsolete soon.

17-08-2010 10



and heuristics


11/25

Employability

Students completing a course expect to be employable as aresult ,and this results tension in course designs between:

The development of skills and attitudes that

facilitate life- long learning.

Academic development.

Continued professional development.

Learning skills of immediate use in employment.

17-08-2010 11



and heuristics


12/25

Quality assurance

Quality assurance : is becoming increasingly critical to all

stakeholders in Australia.

Key quality issues include transparency and high levels of

integrity and coherency between institutional educationalaims and objectives, assessment practices, and effective

moderation processes between and across units, courses,

programs and institutions.

17-08-2010 12



and heuristics


13/25

Equity And Plagiarism

Equity problems in assessment become increasinglyimportant as student populations become culturally,

educationally, and socially more diverse.

Plagiarism is increasingly problematic , especially wherestudents have high levels of Internet and electronic filemanipulation skills.

Portfolios can assist in identifying plagiarism because their

nature as a container of students work facilitatestriangulation of assessment and offers examiners a readymeans to correlate standards across an individual studentsmultiple assessment items.

17-08-2010 13



and heuristics


14/25

Commercialisation modularisation and

globalisation.

A common response is for courses and units to

be provided by partner institutions,via flexibledelivery, and, occasionally with marking

processes outsourced.

17-08-2010 14



and heuristics


15/25

Discipline Related Factors and

TechnologyChoice

Make sure that the technology implementation alignswith the skills typical of users of the online portfolioassessment system.

Information Storage

Quality Assurance

EquityIssues

Plagiarism

17-08-2010 15



and heuristics


16/25

Security, Fraud and Tampering with

Records

Implement conventional security systems to

enable tamperproof recording, information

storage and data access processes.

Online security technologies:(gone mature)

online banking

Share trading

retail trading

17-08-2010 16



and heuristics


17/25

Graduate attributes:

Online portfolios can offer an effective means

for demonstrating graduate attributes.

Implement cross module portfolio assessmentsystem using performance indicators for

generic attributes. Train students in skill

recognition and in uses of documents as

evidence of generic skills.

17-08-2010 17



and heuristics


18/25

Interface issues:

interface requirement:

Software development environment

Modification of online portfolio assessmentsystem software.

Course designer and lecturer(s) to input

advisory or educational material. Course administrator(s) for gathering

information from the system, cleaning files.

17-08-2010 18



and heuristics


19/25

APPROACH

online access to a complete suite of software

for a student to complete all aspects of their

portfolio and not allow the use of any other

software .

online access to the means to build a coherent

portfolio out of individual elements created

elsewhere

17-08-2010 19



and heuristics


20/25

Cognitive andInformation Artifacts

The computerised and internetworkedprocesses that facilitate online portfolioassessment informatic processes require

appropriate choices of cognitive artifacts. Choice and definition of cognitive and

informatic artefacts to be as a result of clearunderstanding of how value creation anddistribution is undertaken in the onlineportfolio assessment system

17-08-2010 20



and heuristics


21/25

Conclusion:

The design brief omits most of the key

educational and administrative issues, and,

instead, focuses only on identifying technical

means

The online portfolio consists only of a single

essay, project report or term paper presented

as a web-based electronic facsimile of aconventional document.

17-08-2010 21


portfolio based assessment-design criteriaand heuristics


22/25

designs for online portfolio assessment

systems are based on an over-narrow view of

value distribution that does not take allstakeholders into account.

The designing of online portfolio assessment

systems is not well integrated with overallcourse design processes.

17-08-2010 22




23/25

Recommendations:

The identification of the nature and

characteristics of the educational and

institutional contexts for which the online

portfolio assessment systems is designed.

The identification of potential benefits and

increase in value for all stakeholders.

The development of heuristics for prioritising

value distributions.

17-08-2010 23




24/25

The development of an online system through:

The use of best practices in course design,

The fulfilment of the requirements of the

course criteria,

The integration of the designing of the online

portfolio system with the broader course

design processes, and

17-08-2010 24




25/25

THANK YOU

17-08-2010 25



Designing Online Information systems for portfolio based assessment-Design criteria and heuristics

Documents

Transcript of Designing Online Information systems for portfolio based assessment-Design criteria and heuristics