Post on 10-Apr-2018
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
1/25
Designing Online Information systems for
portfolio based assessment-Design criteria and
heuristics
Submitted by:
Sushant Srivastava (09609182)
Priyanka Bahal (09609084)Poornima Balani (09609181)
Saima Ahmed (06503869)
17-08-2010 1
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
2/25
Objectives
The aim of the paper is to provide information about theonline portfolio information systems.
It highlights how online systems have led to the maximizationof shareholder value.
The paper explores issues related to information storage,automation of functions, security and fraud.
It provides an understanding of the importance and benefitsof online systems as compared to conventional systems.
17-08-2010 2
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
3/25
Introduction
There has been a significant increase in the use of online
systems in secondary, tertiary and primary education system
over the last few years.
The paper talks about research undertaken by Love and
Cooper which highlights the benefit of such systems over
traditional ones.
The primary themes evaluated were integrity of course
design and benefits for all stakeholders.
17-08-2010 3
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
4/25
What is a portfolio?
Portfolios are complex educational tools that require full
integration into carefully crafted course designs.
Portfolio assessment consists of a number of interlinkedprocess and the specific processes depend directly or aremodified according to the course design.
Online portfolio assessment requires a carefulintegration/amalgam of different processes.
There are different process issues for different stakeholdersand they are quite different in type and magnitude fromoffline assessment processes.
17-08-2010 4
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
5/25
Online portfolios are increasing in universities because:
1. The obvious advantage of online portfolios overtraditional modes of assessment.
2. Recent changes in the educational environment of
institutions that favor the use of portfolios in assessment
of stakeholder groups.
17-08-2010 5
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
6/25
Benefits of Portfolio for assessment and learning
Portfolios can contain many different types of evidence and
from different sources.
Portfolios provide an opportunity for students to manage
their own professional development.
They resolve may assessment problems, especially in equity
and moderation.
Portfolios provide a richer picture of students, their learning
and their competencies.
Portfolios are well suited to authentic learning environments.17-08-2010 6
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
7/25
Stakeholder groups
Designing online education courses requires carefulconsideration of stakeholders and relative value distribution
of different stakeholder groups.
The value of online portfolio assessment is interpreted only interms of that particular group.
The broadest approach of evaluation can be in terms of
number of students attending the course, teaching staff,academic line managers, learning support technologists and
university upper level managers and administrators.
17-08-2010 7
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
8/25
Trends Shaping University
Education Successfully designing and evaluating online portfolio
assessment systems to distribute value and benefit to
stakeholders requires morethan identifying the stakeholder
In educational contexts, customer are poorly suited todescribing the institutionalised power and service relations.
It is necessary to look to the institutional structures and
mores that govern what is valued in different educational
sectors and situations.
The design of future courses in universities is influenced by
a variety of factors .
17-08-2010 8
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
9/25
FACTORS
Evidence-based assessment
Employability
Quality assurance
Equity
Addressing plagiarism
Increasing commercialisation, modularisationand globalisation
17-08-2010 9
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
10/25
Evidence-based assessment is increasingly found in
university systems in Australia and the US.
Evidence-based assessment requires demonstration of
application of a body of knowledge rather than knowing
about a body of knowledge.
In fast changing Designing Online Information Systems for
Portfolio-Based Assessment 1452
disciplines, it is unsatisfactory to assess knowledge of content
likely to be obsolete soon.
17-08-2010 10
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
11/25
Employability
Students completing a course expect to be employable as aresult ,and this results tension in course designs between:
The development of skills and attitudes that
facilitate life- long learning.
Academic development.
Continued professional development.
Learning skills of immediate use in employment.
17-08-2010 11
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
12/25
Quality assurance
Quality assurance : is becoming increasingly critical to all
stakeholders in Australia.
Key quality issues include transparency and high levels of
integrity and coherency between institutional educationalaims and objectives, assessment practices, and effective
moderation processes between and across units, courses,
programs and institutions.
17-08-2010 12
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
13/25
Equity And Plagiarism
Equity problems in assessment become increasinglyimportant as student populations become culturally,
educationally, and socially more diverse.
Plagiarism is increasingly problematic , especially wherestudents have high levels of Internet and electronic filemanipulation skills.
Portfolios can assist in identifying plagiarism because their
nature as a container of students work facilitatestriangulation of assessment and offers examiners a readymeans to correlate standards across an individual studentsmultiple assessment items.
17-08-2010 13
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
14/25
Commercialisation modularisation and
globalisation.
A common response is for courses and units to
be provided by partner institutions,via flexibledelivery, and, occasionally with marking
processes outsourced.
17-08-2010 14
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
15/25
Discipline Related Factors and
TechnologyChoice
Make sure that the technology implementation alignswith the skills typical of users of the online portfolioassessment system.
Information Storage
Quality Assurance
EquityIssues
Plagiarism
17-08-2010 15
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
16/25
Security, Fraud and Tampering with
Records
Implement conventional security systems to
enable tamperproof recording, information
storage and data access processes.
Online security technologies:(gone mature)
online banking
Share trading
retail trading
17-08-2010 16
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
17/25
Graduate attributes:
Online portfolios can offer an effective means
for demonstrating graduate attributes.
Implement cross module portfolio assessmentsystem using performance indicators for
generic attributes. Train students in skill
recognition and in uses of documents as
evidence of generic skills.
17-08-2010 17
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
18/25
Interface issues:
interface requirement:
Software development environment
Modification of online portfolio assessmentsystem software.
Course designer and lecturer(s) to input
advisory or educational material. Course administrator(s) for gathering
information from the system, cleaning files.
17-08-2010 18
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
19/25
APPROACH
online access to a complete suite of software
for a student to complete all aspects of their
portfolio and not allow the use of any other
software .
online access to the means to build a coherent
portfolio out of individual elements created
elsewhere
17-08-2010 19
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
20/25
Cognitive andInformation Artifacts
The computerised and internetworkedprocesses that facilitate online portfolioassessment informatic processes require
appropriate choices of cognitive artifacts. Choice and definition of cognitive and
informatic artefacts to be as a result of clearunderstanding of how value creation anddistribution is undertaken in the onlineportfolio assessment system
17-08-2010 20
designing online information system for
portfolio based assessment-design criteria
and heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
21/25
Conclusion:
The design brief omits most of the key
educational and administrative issues, and,
instead, focuses only on identifying technical
means
The online portfolio consists only of a single
essay, project report or term paper presented
as a web-based electronic facsimile of aconventional document.
17-08-2010 21
designing online information system for
portfolio based assessment-design criteriaand heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
22/25
designs for online portfolio assessment
systems are based on an over-narrow view of
value distribution that does not take allstakeholders into account.
The designing of online portfolio assessment
systems is not well integrated with overallcourse design processes.
17-08-2010 22
designing online information system for
portfolio based assessment-design criteriaand heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
23/25
Recommendations:
The identification of the nature and
characteristics of the educational and
institutional contexts for which the online
portfolio assessment systems is designed.
The identification of potential benefits and
increase in value for all stakeholders.
The development of heuristics for prioritising
value distributions.
17-08-2010 23
designing online information system for
portfolio based assessment-design criteriaand heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
24/25
The development of an online system through:
The use of best practices in course design,
The fulfilment of the requirements of the
course criteria,
The integration of the designing of the online
portfolio system with the broader course
design processes, and
17-08-2010 24
designing online information system for
portfolio based assessment-design criteriaand heuristics
8/8/2019 Designing Online Information systems for portfolio based assessment-Design criteria and heuristics
25/25
THANK YOU
17-08-2010 25
designing online information system for
portfolio based assessment-design criteriaand heuristics