Are practical laboratory skills among first year science undergraduates related to academic achievement or qualification choice?

Results of a pilot study at Newcastle College

Dr Sarah McLuskyFormerly Newcastle College

Currently Royal Society of Chemistry

Practical laboratory

workSCIENCE Theoretical

knowledge

BTEC National/Extended

Diploma Applied Science

A-level Science (Biology, Chemistry,

Physics)

A-level Applied Science

Access to HE (Science)

Similar academic achievementExtremely variable practical skills

FdSc Analytical ChemistryFdSc Biotechnology

Core Lab

SkillsWorking

safelyAccuracy and Skill

Making up a

solution

Weighing out solids

Diluting a solution

Following instructions

Using a pipette

Formative assessment for all new L4 FdSc students in 2012 and 2013

Students opt in or out of research study

Opt in questionnaire on L2 and L3 qualifications

Useable results obtained from 25 students

Weigh out 1.5g

copper (II) sulphate Place the

powder in a beaker and dissolve in a little water

Put the solution in the

volumetric flask and make up to

the markGet assessor to check

level

Prepare 5ml of a 1 in 5

dilution of the copper

sulphate solution

Fill a cuvette with a

sample of your original

solution… and another with your

diluted solution.

Measure the

absorbance

Test Scoring (out of 35)Type Category Mark out of 5 based on

Quantitative scores Time taken Class mean

Weight Class mean

Stock absorbance Assessor mean

Dilution absorbance Assessor mean

Qualitative scores Volumetric accuracy Assessor judgement

Use of PPE Assessor judgement

Good Laboratory Practice Assessor judgement

One mark was subtracted each time they asked for help

Scores ranged from 15 to 31 (out of 35)

Most confident (highest scores)

• Use of PPE• Weighing out

Least confident (lowest scores)

• Preparing a dilution• Using a pipette• Making up solutions

0 20 40 60 80 100 120 140 160 180 20010

15

20

25

30

35

There is no general correlation between practical test scores and academic achievement at L2 (GCSE Science)

GCSE Science Score

Prac

tical

Tes

t Sco

re

100 120 140 160 180 200 220 240 260 280 30010

15

20

25

30

35

There is no general correlation between practical test scores and academic achievement a L3 (UCAS points)

UCAS Points

Prac

tical

Tes

t Sco

re

100 120 140 160 180 200 220 240 260 280 30010

15

20

25

30

35

There is some correlation between practical test scores and academic achievement within qualification groups

BTEC Applied ScienceA-level ScienceLinear (A-level Science)A-level Applied ScienceAccessLinear (Access)

UCAS Points

Prac

tical

Tes

t Sco

re

Access A-level Applied Science A-level Science BTEC Applied Science0

5

10

15

20

25

30

Mean test scores by L3 qualification Pr

actic

al T

est S

core

Do these results indicate a wider

trend?

Do more practical students self-

select?

BTEC grades are not always true

indicators of academic ability

Some A-level and Access students

claim they did no practical at all

BTEC requires students to carry

out tasks and demonstrate skills

Is it the curriculum?

Possible significance

Employers/ recruitment

decisions

Advice and Guidance

University admissions

Qualification status and

equivalence

Curriculum design

Informed decision making

Value of ‘wet’ practicals

With thanks to

Julie Hizzett (co-assessor)Newcastle College colleaguesCameron (star of the photos)

Are practical laboratory skills among first year science undergraduates related to academic achievement or qualification choice?

Results of a pilot study at Newcastle College

Dr Sarah McLuskyFormerly Newcastle College

Currently Royal Society of Chemistry