AYS1

t M Pý'

Faculty of Cognitive Sciences and Human Development

THE DEVELOPMENT AND EVALUATION OF ONLINE COURSE REGISTRATION MODULE SYSTEM (OCREMS) IN

UNIMAS

Ahmad Zuhairy Bin Hashim

TK 5105.888 W43 A286 2009

Bachelor of Science (Honours) Cognitive Sciences

2009

Pusat Khidmat Maklumat Akademik UNIVERSITt MALAYSIA SARAWAIG

THE DEVELOPMENT AND EVALUATION OF ONLINE COURSE REGISTRATION MODULE SYSTEM (OCREMS) IN UNIMAS

AHMAD ZUHAIRY BIN HASHIM

This project is submitted in partial fulfillment of the requirements for a Bachelor of Science with Honours

Cognitive Science

Faculty of Cognitive Sciences and Human Development UNIVERSITI MALAYSIA SARAWAK

2009

The project entitled `The Development and Evaluation of Online Course Registration Module System (OCREMS) in UNIMAS' was prepared by Ahmad Zuhairy B. Hashim and submitted to the Faculty of Cognitive Science and Human Development in partial fulfillment of the requirements for Bachelor of Science with Honours (Cognitive Science).

Received for examination by:

XMM. " dmm4#6" w.. Iran

FakuNi sails tft& Daa Feeiaatuiaa btaawis

MALAYSIA siwºwA[ .....a-ý.... ------ = ------------------------------ (En. Mohamad Hardyman Barawi)

Date:

1 1 /s / a-ooý --------------------------------------------

Statement of Originality

The work described in this Final Year Project, entitled "The Development and Evaluation of

Online Course Registration Module System (OCREMS) in UNIMAS" is to the best of the author's knowledge that of the author except

where due reference is made.

a lasj 0 9(Date submitted) (Stint's signature)

AHMAD ZUHAIRY B. HASHIM 13671

BORANG PENGESAHAN STATUS TESIS Gred:JUDUL: Ttie b%vQtoprnmj and &-afv(ºfion op On. fýne

Co&c, -te ýe9 ý6fra fioý. Ihodufe dºýyrtaný CoCaf&, t') ýý uNlýKAJ`.

SESI PENGAJIAN : zooB 1cca I

Saya AHiul. Qb . e uFf, 4 1 Ay Q- 1440+iM(HURUF BESAR)

mengaku membenarkan tesis * ini disimpan di Pusat Khidmat Maklumat Akademik, Universiti Malaysia Sarawak dengan syarat-syarat kegunaan seperti berikut:

1. Tesis adalah hakmilik Universiti Malaysia Sarawak. 2. Pusat Khidmat Maklumat Akademik, Universiti Malaysia Sarawak dibenarkan

membuat salinan untuk tujuan pengajian sahaja. 3. Pusat Khidmat Maklumat Akademik, Universiti Malaysia Sarawak dibenarkan

membuat pendigitan untuk membangunkan Pangkalan Data Kandungan Tempatan. 4. Pusat Khidmat Maklumat Akademik, Universiti Malaysia Sarawak dibenarkan

membuat salinan tesis ini sebagai bahan pertukaran antara institusi pengajian tinggi.

** sila tandakan ( 4 )

SULIT

0

TERHAD

TIDAK TERHAD

(Mengandungi maklumat yang berdarjah keselamatan atau kepentingan seperti termaktub di dalam AKTA RAHSIA RASMI 1972)

(Mengandungi maklumat Terhad yang telah ditentukan oleh organisasi/badan di mana penyelidikan dijalankan)

(TANDA`PANGAN PENULIS) (TANDATANGAN PENYELIA)

Alamat Tetap: ýcof /19 9- A9 kofg folca P, --iu Gcna lSI oo, kcfg VAo, u .

kclolfon.

Tarikh : /l l o s% o 9 Tarikh: _

I Iý Sý ;? -DogCatatan: * Tesis dimaksudkan sebagai tesis bagi Ijazah Doktor Falsafah, Sarjana dan Saijana Muda *Jika tesis ini SULIT atau TERHAD, sila lampirkan surat daripada pihak berkuasa/organisasi berkenaan dengan menyatakan sekali sebab dan tempoh tesis ini perlu dikelaskan sebagai TERHAD.

ACKNOWLEDGEMENT

Alhamdulillah. I thank the Almighty that I am able to finish this Final Year Project perfectly and most importantly is finishing it on time. I would also like to thank my supervisor, Mr. Mohd Hardyman b. Barawi for his advice and patient with me during these exhausting months.

My thanks and gratitude also go to my family and close friends who has given me the strength and inspire me with their support throughout the difficult times in finishing the project. I would also like to express my thanks to the lecturers and staffs of Faculty of Cognitive Sciences and Human Development for their encouragement and the participating respondents for their cooperation.

Last but not least, I would like to thank all that have helped me through ups and downs. This project could never be carried out without the help of those many people directly or indirectly.

Thank you.

V

Pusat Khidmat Maklumat Akademik UMVERSITI MALAYSIA SARAWAK.

TABLE OF CONTENTS

Acknowledgement List of Contents List of Tables List of Figures List of Abbreviations List of Appendix Abstrak Abstract

1. CHAPTER 1 INTRODUCTION

Page

v vi ix

x xii xiii xiv xv

1.0 Introduction I 1.1 Background of the study 2

1.1.1 Usability 2 1.2 Design Process 4

1.2.1 User Centered Design 5 1.2.2 Rapid Application Development (RAD) 5

1.3 Problem Statement 5 1.3.1 Accessibility 5 1.3.2 User Interface 6

1.4 Objective of Study 7 1.4.1 General Objective 7 1.4.2 Specific Objective 7

1.5 Significant of Study 7 1.6 Scope of the Project 8 1.7 Definition of term 9

1.7.1 User Interface 9 1.7.2 Usability 10 1.7.3 Evaluation 10 1.7.4 Heuristic Evaluation 11 1.7.5 System 11

1.8 Assumption 12 1.9 Limitation of Study 12 1.10 Conclusion 13

2 CHAPTER 2 LITERATURE REVIEW

2.0 Introduction 14 2.1 Usability 14 2.2 Accessibility 16 2.3 Importance of online payment 19 2.4 Usability of Navigation Controller 20

2.4.1 Usability of Text link to other page 20 2.4.2 Usability of Button 21

2.5 Organization of Information and Interface 23 2.6 User Centered Design 23

V1

2.7 Principle of Web Usability 25 2.8 Summary 29

3 CHAPTER 3 METHODOLOGY

3.0 Introduction 30 3.1 Research Design 30

3.1.1 Unit of Analysis 31 3.1.2 Sampling Strategy 31

3.1.2.1 Simple Random Sampling Technique 31 3.1.3 Analysis framework 31

3.1.3.1 Usability Testing & Interview 31 3.2 Rapid Application Development (RAD) 31

3.2.1 What is RAD ? 31 3.3 User Centered Design (Interview) 32 3.4 Research Location 34 3.5 Development Requirement 34 3.6 Hardware Requirement 34 3.7 Summary 35

4 CHAPTER 4 IMPLEMENTATION OF THE SYSTEM AND INTERFACE DESIGN

4.0 Introduction 36 4.1 The Development of the Design 37 4.2 Softwares and Tools 37

4.2.1 Computer Software 38 4.2.2 WAMP5 39 4.2.3 Adobe Dreamweaver CS3 40

4.3 Development of Interface Design 41 4.4 The Testing of the Design 41

6 CHAPTER 5 FINDINGS AND DISCUSSIONS

5.0 Introduction 45 5.1 Respondent Demographic 45

5.1.1 Gender 45 5.1.2 Age 46 5.1.3 Faculty 46 5.1.4 Experience Using the Computer 47 5.1.5 Experience Using the Online Database System 48

5.2 The Frequency Score for the Criteria of the Heuristics System Usability 49 5.2.1 The Frequency Score for Visibility of System Status 49 5.2.2 The Frequency Score for Match between System

and the Real World 51 5.2.3 The Frequency Score for User Control and Freedom 54 5.2.4 The Frequency Score for Error Prevention 56 5.2.5 The Frequency Score for Help and Documentation 57

5.3 Reliability Statistics (Cronbach's Alpha) 60

vii

5.4 Comparison between SMP and OCREMS in term of usability of the interface design 60

6 CHAPTER 6 CONCLUSION

6.0 Introduction 63 6.1 Limitation of the Study 63 6.2 Recommendation 64 6.3 Conclusion 64

References 65 Appendix 68

viii

LIST OF TABLES

Table 1 Modules of course registration module system 9

Table 2 The frequency of the respondent according to gender 46

Table 3 The frequency of the respondents according to age 46

Table 4 The frequency of the respondents according to faculty 47

Table 5 The frequency of the respondents' experience in using computers 48

Table 6 The frequency of the respondents according to experience in using online database system 49

Table 7 The frequency of the score for the visibility of system status 50

Table 8 The Frequency Score for the Match Between System and the Real World 52

Table 9 The Frequency Score for the User Control and Freedom 54

Table 10 The Frequency Score for Error Prevention 56

Table 11 The Frequency Score for Help and Documentation 58

Table 12 Reliability Statistics based on Cronbach's Alpha

Table 13 The comparison between SMP and OCREMS in term of usability of the interface design

60

60

ix

LIST OF FIGURES

Figure 1 The main user interface of the online registration system in Ball State University 16

Figure 2 The interface of Courseware Computer Science system 19

Figure 3 Perspective of User Centered Technologies Research Institute in Human Computer Interaction 25

Figure 4 The checklist to measure the usability index in the certain websites 28

Figure 5 The User Centered Design process above shows the flow of the level in the development of the system which involves the student as the user 33

Figure 6 The example of the course registration module system using the Adobe Dreamweaver CS3

Figure 7 The comparison of deactivated Apache service (left) and activated Apache service (right)

Figure 8 The example of the programming language and design for the OCREMS system

Figure 9 The design that focus on the users which is applicable in the testing stage of the design

Figure 10 First drawing

Figure 11 Second drawing

Figure 12 Third drawing

Figure 13 The instruction and the error box are at the same place can clearly be seen on every page of the display screen

38

39

40

42

42

43

44

51

X

Figure 14 Information display is clearly understood 53

Figure 15 Display of the page that shows each page has its linkage button 55

Figure 16 The information displayed is able to help users from making any mistakes 57

Figure 17 It shows that help button in every single page 59

Figure 18 It shows that help and documentation in other window browser 59

X1

LIST OF ABBREVIATIONS

BSU Ball State University

CICTS Centre for Information & Communication Technology Services

CSCW Courseware Computer Sciences System

EFT Electronic Fund Transfer

HCI Human-Computer Interaction

IBM International Business Machines

IC Identification Certificate

LMS Learning Management System

OCREMS Online Course Registration Module

PHP Hypertext Preprocessor

RAD Rapid Application Prototype

SMP Sistem Maklumat Pelajar

UCD User Centered Design

UNIMAS Universiti Malaysia Sarawak

X11

LIST OF APPENDIX

Appendix 1.0 Ujian Kebolehgunaan 68

Appendix 2.0 Cadangan dan Pendapat 72

X111

ABSTRAK

PEMBANGUNAN DAN PENILAL4N SISTEMMODUL PENDAFTARAN KURSUS (OCREMS) SECARA DALAM TALIAN DI UNIMAS

Ahmad Zuhairy B. Hashim

Kajian ini bertujuan untuk membangun dan menilai tahap kebolehgunaan antaramuka sistem modul pendaftaran kursus secara dalam talian. Ciri-ciri kebolehgunaan yang diuji adalah kejelasan status sistem, kesesuaian sistem diantara keadaan sebenar, kawalan dan kebebasan pengguna, pencegah kesalahan dan pertolongan dan dokumentasi. Seramai 35 orang pelajar di UNIMAS terlibat sebagai responden untuk menguji sistem ini. 5 orang dari setiap fakulti dipilih secara rawak kecuali fakulti dari perubatan tidak terlibat dalam pengujian ini. Instrumen yang digunakan di dalam kajian ialah komputer peribadi, soalan kaji-selidik dan sistem OCR EMS. Kaedah penilaian Heuristik telah digunakan dalam mendapatkan data. Hasil kajian menunjukkan sistem OCREMS memenuhi kelima-lima ciri kebolehgunaan yang diuji. Kesimpulan daripada kajian ini, SMP tidak mempunyai tahap kebolehgunaan yang optimum.

xiv

ABSTRACT

THE DEVELOPMENT AND EVALUATION OF ONLINE COURSE REGISTRATION MODULE SYSTEM (OCREMS) IN UNIMAS

Ahmad Zuhairy B. Hashim

The propose of this research is to develop and to test the online course registration module system in term of interface design usability. The usability criteria tested in this research includes the visibility of system status, the match between system and real world, the user control and freedom, the error prevention and the help and documentation criteria. There were 35 students in UNIMAS involved as the respondents to test the system. 5 students were randomly selected as respondents in each faculty except Faculty of Medical. This research uses instruments such as personal computer, questionnaire and OCREMS system. Heuristic evaluation method is used in order to collect the data. The finding of this research shows that the OCREMS have fulfilled all the five usability criteria compared to SMP that only two out of five usability criteria. From the research, it can be concluded that SMP did not have optimum usability level.

xv

CHAPTER 1

INTRODUCTION

1.0 Introduction

Advanced systems and high technologies are rapidly developed for the

past 50 years. This can be seen through various uses of system interfaces, web

pages software systems that enable user to solve complicated problems easily. However, most of the systems developed are not up to the level of human

comfort. Good systems are systems that are able to interact with the user and offer

solutions to problems. But, better systems are system that is developed based on

the way human want it to be seen and behave. Thus, it means that the system is

usable and visible to the user view.

One of the main factors that contribute to the usability of the system is the

design of the user's interface. Bad design of the system can lead to frustration and

stress for the users. Therefore, each system should have good quality of interface

design in the system.

According to Preece, Rodger & Sharp (2002), generally, usability is used

to ensure that certain products are interactive, easy to learn and efficient. Sistem

Maklumat Pelajar (SMP) has quite a weak interface that need to be improved.

1

Universiti Malaysia Sarawak (UNIMAS) is one of the local universities in

Malaysia that used this application for the students course registration.

Sistem Maklumat Pelajar (SMP) involves two sets of users. One is the

student and the others is the staff from registration department. The main purpose

of the system is to enable students to register and drop the courses easily without

the use of filling various forms. Students can easily re-check the courses that they have registered in the click of a finger and prevent them from registering courses

exceeding the total credit hour limit. The staff is also able to check the students

and courses information efficiently and systematically.

The Online Course Registration Module System (OCREMS) involves two

sets of users which is similar to SMP. The users are the student and the

registration department staff. The proposed system is more usable in term of

accessibility. It provides online registration module and suggest online payment

prototype for the module. The students can easily make payment through this

system without physically going to the particular place.

Nevertheless, the development of Sistem Maklumat Pelajar (SMP) is still

weak in terms of the design of the user interface and its accessibility. This simple

problem might weaken the flow of the system and lead to reduce operation

performance.

1.1 Background of the study

1.1.1 Usability

Usability can be considered as the bench mark for the users when they are

using that certain products, be it a system or a website. Usability hold quite a

number of meanings and this depends on the particular person to how he is going

to interpret the meaning. According to Nielson (1994), usability is a very

2

important component in the system although there are other elements which

contribute to the system in achieving its goal.

There are five chareteristics in usability which are leamability, users'

understanding, memorability, minimal errors and users' satisfaction. Usability is

also used as the key concept for human-computer interaction design. For example,

user-centered design is used as a process to develop a user-friendly system (Preece et. al., 1994).

The particular statement is supported by Nielson (2000) and Powell (2002)

whereby the quality of a system is measured based on the usability elements used. The applied method is able to help in the development of a system easily.

The examples of the five characteristics are as the following:

i. Learnability

Is it easy for the first time user to use the system?

ii. Users' understanding Is the user able to use the system easily again say that they have

used the system before.

iii. Memorability

Is user able to use the system easily say that they didn't use the

system for quite a long time?

iv. Minimal errors How many errors are done and how the users prevent themselves from doing so?

v. Satisfaction Is the user satisfied when they are using the system?

3

All five characteristics mentioned above is applied in developing the new

system. According to Frokjaer, Hertzum & Hornbaek (2000), effectiveness served

as to achieve the goal of the system. The goal of the system is achieved if the

course registering system is provided and the users are able to register their

subjects. Users' understanding helps in the operation of the system and ensure the

system to run smoothly. Satisfaction enable the users to use the system easily.

According to Plaisant & Shneiderman (2004), ISO 9241 focused on the

three main objectives of usability which are effectiveness, users' understanding

and achievement. However, the objectives are more focused on the practical

evaluation. The particular practical evaluation is the amount of time for users in

learning on how to use the system or how long the users try to solve certain

problems.

As a conclusion, usability is a very important element in developing a

website because it enables users to use the system easily. Usability is about developing a good website whereby it focus on the user cognitive abilities which

enables designers to develop a better version of website based on the user itself.

1.2 Design Process

Design process is a stage-by-stage process in designing a certain product. The steps involve are knowing what to do, knowing what is desired by the user

and put in a unique touch of style on the website (Nicole & Abascal, 2001).

The designing process is very essential in developing OCREMS as it

ensures the specific design required by the students which are the main user of the

system.

4

1.2.1 User-Centered Design (UCD)

The user-centered design is used in every stage of developing the website (Darlington, 2005). It is served to achieve the needs and limitation of the user

which is the students who are the main user of the website. The user-centered design is divided into four stages. The first stage is the user's request in a

particular website. It is very essential to understand the user's requests which are the student since they are the main user of the system. Normally, web designers

will have trouble in designing a certain website when they are not focusing on the

user. This is because users will take a longer time to use the system as it is

designed only based on the designer's perspective.

1.2.2 Rapid Application Development (RAD)

Based on Martin (2000), Rapid Application Development (RAD) is a development lifecycle considered to give much quicker development and high

quality results than those achieved with the conventional lifecycle.

It is designed to take the minimum advantage of powerful development

software that has evolved recently.

1.3 Problem Statement

1.3.1 Accessibility

Nowadays, popular and well-established online web based application

systems have higher demand especially among the university students. Student is

anxious to access and join online web based systems due to the current situation

where the Internet is so popular among students. Sistem Maklumat Pelajar (SMP)

lack this particular quality. The system is indeed using online system, but the function stops there.

5

We have found out that students have problems when they are sitting for

the final examination. Examination slip is issued to students before they are going

for the examination. However, students who have not made their fee payment are banned from getting the slips. How can the students check on the payment debt

easily without going all the way to the Financial Department? This is the question

that the study would be able to solve for us.

Some students have problems to register the minor course because the

system did not showed the scheduled time about the course. This can makes time

scheduling clashed with other courses.

1.3.2 User Interface

Based on the user interface of the current system, there are few minor

weakness which is found. The weaknesses are as the following:

i. The button of "Simpan/Keluar" is confusing as it has two different

functions for the button.

ii. Information access cost makes the display of the system a bit

crowded and troublesome for the user. This is so because both of the matrix number and IC number that need to be filled before

registration are unique. The use of one primary key is enough for

one system.

iii. The buttons for "Pendaftaran kursus" and "Cetakan laser" are too

close to each other in the main page. Users are most likely to press

on the wrong button most of the time.

iv. New users do not know how to get to the option of courses as there is no label that displays the function of "F9".

6

Pusat Khidmat Maklwnat Akademik

UNtVERSITI MALAYSIA SARAWAiC-

These weaknesses may seem to be a normal and minor problem of the user interface. However, these weaknesses could develop into negative emotion when

user is using the system. User is a human being that is mostly controlled by their

emotion and desire to use products efficiently and systematically.

1.4 Objective of Study

Objectives of this research can be divided into two objectives which are

general objective that focus on the general objective and the specific objective. The general objective refers to the overall goal of the study. The specific objective defines the research specific motive.

1.4.1 General Objective

The purpose of the study is to develop a web based application for course

registration module and online fee payment prototype.

1.4.2 Specific Objective

i. To develop a new system which focus on the design of graphical

userinterface based on Human-Computer Interaction (HCI).

ii. To test the system in term of usability in Usability Testing.

iii. To develop an online fee payment prototype which linked to the Online Course Registration web base.

1.5 Significant of Study

Online Course Registration Module System (OCREMS) will give benefit

for both students and the staff from the registration department. It allows easy and faster data access with the systematic organization. Through this system,

7

responsible staffs would be able to access the database and update the inventory

. via the Internet. It also reduce data redundancy and the risk of human error. Thus,

manipulation of data can be done at maximum speed.

The development of the new system will improve the graphical interface

where the needs of the user is set to achieve the maximum and optimum

understanding. The usability testing that will be carried out help in ensuring the

system to operate smoothly in order to fulfill the user needs.

The design and the development of the Online Course Registration

Module System(OCREMS) will provide acts of referrence in the future for the

Centre for Information & Communication Technology Services (CICTS) and UNIMAS.

1.6 Scope of the Project

The scope of Online Course Registration Module System (OCREMS) will be an incorporated user-profile processing system that features the registration and

allow authorized access. It contains information about the student's profile, course

registration module and fee payment all in one web. The module details involved

in Online Course Registration Module System (OCREMS) are listed in Table 1:

8