Exam Absence Survey:Preliminary Analysis & Findings

Presented at the Extended Management Committee

2 February 2010Professor George Subotzky

Executive Director: Information & Strategic Analysis

Acknowledgements

The following staff members of DISA were involved in design, administration & analysis of this survey:– Hanlie Liebenberg: design– Yuraisha Chetty: design & oversight– Lerato Tladi: design, implementation, data

analysis & preparation of presentation– George Subotzky: design, interpretation &

presentation– Pam Pistorius: admin support

Introduction & Background• Efforts to improve Unisa’s course success rates

are thwarted not only by failure, but also attrition prior to writing

• Analyses have shown that up to 10% of students are admitted to exams, but for a variety of reasons do not write

• At the final signoff meeting for the exam results of the 2009 Oct/Nov sitting, it was decided to investigate the reasons for this

• Accordingly, DISA was requested to design and conduct a survey to do this and to report by the end of January

Conceptual Framework & Method• At the heart of the Success & Retention model

lies the assumption that non-academic factors impact as much, if not more than academic ones one student success

• Accordingly, the survey was designed to investigate all probable reasons for exam absence – both academic & non-academic

• 13 questions & 158 items• Relevant students were identified

– Problem of not being able to distinguish absentees from results outstanding, practical & PG students)

• Survey notification sent by e-mail & SMS with link to access electronic survey

Focus

• Preliminary analysis – focusing on main findings

• Subsequent analysis – focusing on relationship between variables and background demographics

Response Rate

• Survey population (13 Jan): 27 299• Response rate (25 Jan): 2 359 (8,7%) (full)• Response rate (2 Feb):

– Total responses: 5 105 (19,0%)– Full responses: 3 747 (13,7%)

• This represents a remarkably high response rate

• Frantic responses from many students – part of the findings

Full-Time (Study only) Part-Time (Work and Study)

0%

20%

40%

60%

80%

100%

5.7%

94.3%

Mode of Study

Academ

ic Fact

ors

Non-ac

adem

ic fact

ors

Factor

s with

in yo

ur con

trol

Factor

s bey

ond y

our c

ontro

l0%

20%

40%

60%

11.2% 16.0% 15.9%

56.9%Reasons for Exam Absence

Very well prepared

Somewhat prepared

A little prepared

Not at all prepared

0%

10%

20%

30%

40%

25.3%

37.4%

17.7% 19.7%

Exam Preparedness

Inadequate feedback on assignments

Did not understand the study material

Did not know what to expect in the examination

Wasn't motivated to write

Lacked confidence to write

Insufficient study time

0% 5% 10% 15% 20% 25% 30% 35% 40% 45%

5.0%

9.8%

10.4%

11.3%

24.9%

38.5%

Reasons for Exam Unpreparedness

Participated in on-line study/discussion groups

Participated in face-to-face study/discussion groups

Used additional material/sources beyond the prescribed study material

Memorized the study material

Drew up a study timetable

Worked through previous examination papers

Summarized the study material

Used the prescribed textbook (where applicable)

Read the study material

0% 5% 10% 15% 20% 25%

1.2%

1.2%

7.5%

8.1%

9.3%

10.9%

16.3%

22.3%

23.2%

Exam Study Methods

Yes No

-20%

0%

20%

40%

60%

41.3%

58.7%Needed More Academic Support

Yes No0%

20%

40%

60%

80%

29.2%

70.8%

Tried to Contact Lecturer

Lecturer previously uninterested or unwilling to help

Did not know the lecturer

Lecturer previously unavailable

Did not think that it would be useful

Did not have the time to contact the lecturer

0% 10% 20% 30% 40%

6.8%

9.1%

17.6%

30.7%

35.8%

Why Lecturer was not Contacted

Contacted the lecturer after hours

Contacted the lecturer in person (face-to-face)

Contacted the lecturer by letter

Received satisfactory support

Contacted the lecturer via myUnisa

Contacted the lecturer during the afternoon

Contacted the lecturer during the morning

Received unsatisfactory support

Contacted the lecturer via e-mail

Contacted the lecturer by telephone

The lecturer was not available

0% 5% 10% 15% 20% 25% 30%1.0%

1.0%

1.1%

4.9%

5.4%

6.2%

9.1%

10.2%

17.7%

18.2%

25.3%

Experience with Contacting Lecturer

Yes No Don't know0%

10%

20%

30%

40%

50%

40.4%

21.4%

38.2%

Tutorial Classes Offered

Yes No0%

20%

40%

60%

80%

100%

17.0%

83.0%

Attended Tutorial Classes

Helpful Not Helpful0%

20%

40%

60%

80%70%

30%

Tutorial Class Ratings

No information about the times/venues

Did not think that attending classes would be helpful

No transport money

Far or inaccessible location of the venue

Tutorial class times were not convenient

No time to attend tutorial classes

0% 5% 10% 15% 20% 25% 30% 35% 40% 45%

1.8%

2.7%

7.8%

23.0%

25.7%

38.9%

Reasons for not Attending Tutorials

Yes No0%

20%

40%

60%

80%

26.8%

73.2%

Needed Counselling Support

Yes No0%

20%

40%

60%

80%

100%

19.4%

80.6%

Contacted Unisa's Counselling Services

Didn't have the time Didn't think it would be useful

0%

20%

40%

60%

80%

45.9%54.1%

Why Counselling Services not Contacted

Received satisfactory support

Contacted Unisa by telephone

Contacted Unisa during the afternoon

Contacted Unisa during the morning

Contacted Unisa after hours

Contacted Unisa via e-mail

Received unsatisfactory report

Tried to contact but didn't succeed

0% 5% 10% 15% 20% 25% 30%1.7%

4.2%

8.9%

9.3%

13.5%

16.0%

19.0%

27.4%

Experience with Counselling Services

Yes No0%

20%

40%

60%

80%

28.2%

71.8%

Consulted Anyone Regarding Exam Decision

Yes No0%

20%

40%

60%

80%

39.5%

60.5%

Received Advice Influenced Exam Decision

Religious leaderUnisa tutor

Unisa CounsellorPrivate psychologist/psychiatrist

Unisa LecturerOther students

Colleagues at workEmployer

Medical doctorFriendsFamily

0% 5% 10%15%20%25%30%35%1.1%1.5%2.1%2.8%

4.9%7.3%

9.6%10.9%

13.3%15.0%

31.6%

Person Consulted for Exam Advice

Yes No0%

20%

40%

60%

49.8% 50.2%

Had Enough Study Time

Yes No0%

10%

20%

30%

40%

50%

60%

70% 64.7%

35.3%

Spent Sufficient Time Studying

Did not receive the study materials at all

Social life interfered with my studies

Did not receive the study materials in time

Did not have enough study leave

Domestic responsibilities interfered with my studies

Work responsibilities interfered with my studies

0% 5% 10%15%20%25%30%35%40%45%50%

.8%

3.9%

8.1%

17.5%

24.1%

45.5%

Reasons for Insufficient Study Time

Course did not cover the topics I thought it would cover

Course was not relevant to my future work/career

Not interested in the study material

Social life distracted me

Did not feel motivated to study

0% 10% 20% 30% 40% 50% 60%

4.6%

8.0%

11.0%

24.8%

51.5%

Reasons for not Studying Enough

Wrong info about venueNo transport money

Was late (my own fault)Wrong exam timeWrong exam date

Was late (unreliable transport)

Was late(other reasons) My social life

IllnessDomestic responsibilities

Work responsibilities

0% 10% 20% 30% 40% 50%.8%

1.1%

1.4%

1.6%

2.0%

2.4%

2.5%

4.3%

18.6%

21.2%

44.1%Other Factors: Exam Absence

Yes No0%

20%

40%

60%

80%

100%82.4%

17.6%

Strong Consequences for Exam Absence

Family would withdraw financial and other support

Lecturer would be disappointed

Employer would not provide another opportunity to write

Employer would withdraw financial and other support

Other financial support would be lost

Employer would be disappointed

Family would be disappointed

I would be disappointed in myself

The completion of my studies would be postponed

0% 10% 20% 30% 40%

2.3%

2.9%

3.0%

5.3%

5.7%

7.4%

11.7%

28.3%

33.4%

Perceived Consequences of Exam Absence

Employer would continue to support me financially and otherwise

Employer would provide another oportunity for me to write

Family would continue to support me financially and otherwise

Employer would understand

Family would understand

Was not concerned as I could simply write again at the next Unisa examination

0% 10% 20% 30% 40% 50%

5.2%

6.1%

7.6%

10.3%

24.2%

46.6%

Why There Would Be No Strong Consequences

Better counselling support

Better access to counselling support

Better lecturer support

Better access to lecturer support

Better tutorial support

Better access to tutorial support

More general encouragement and support

Earlier distribution of study material

Better study material

Clearer information on exam requirements

Clearer information on exam times and venues

0% 5% 10% 15% 20%4.8%

6.7%

8.0%

8.7%

10.5%

8.8%

9.9%

14.5%

9.3%

15.5%

3.4%Unisa Exam Support