WSOA

Quality Reports GMC Trainee Survey 2013 & EPEFs

D Maloney

GMC Trainee report

• http://www.gmc-uk.org/education/national_summary_reports.asp

• Outlier reports

Vs• Indicator reports

Vs

• ARCP/ RITA outcome

Doctors in training overall satisfaction in different post specialty – Wales

Number 2013

Average 2013

Number2012

Average 2012

GP 198 90.1 190 88.9

Pathology 19 89.3 21 89.3

Radiology 51 87.4 58 84.3

Public Health 5 86.4 8 81.5

Paeds & CH 215 84.8 212 83.2

Anaesthetics 245 84.6 249 85.4

Surgery 403 78.7 441 76.5

WSOA Satisfaction - 2012

WSOA Satisfaction – Since 2007

Outlier reports i.e. RAG

Cumulative RAG      Indicators

Trust / Board Site

Den

om

inato

r

Overall S

atisfaction

Clin

ical Su

pervisio

n

Han

do

ver

Ind

uctio

n

Ad

equ

ate Exp

erience

Wo

rk Lo

ad

Ed

ucatio

nal S

up

ervision

Access to

Ed

ucatio

nal R

esou

rces

Feed

back

Lo

cal Teach

ing

Reg

ion

al Teach

ing

Stu

dy L

eave

Abertawe Bro Morgannwg University

Lhb

Morriston Hospital 33                        

Princess of Wales Hospital 12                        

Aneurin Bevan LhbNevill Hall Hospital 14                        

Royal Gwent Hospital 29                        

Betsi Cadwaladr University Lhb

Wrexham Maelor Hospital 12                        

Ysbyty Glan Clwyd 10                        

Ysbyty Gwynedd 10                        

Cardiff & Vale University Lhb

University Hospital of Wales 65                        

Cwm Taf LhbPrince Charles Hospital Site 6                        

The Royal Glamorgan Hospital 12                        

Hywel Dda Lhb West Wales General Hospital 8                        

Programme Group

Trust / Board

Site

Den

om

inato

r

Overall S

atisfaction

Clin

ical Su

pervisio

n

Han

do

ver

Ind

uctio

n

Ad

equ

ate Exp

erience

Wo

rk Lo

ad

Ed

ucatio

nal S

up

ervision

Access to

Ed

ucatio

nal R

esou

rces

Feed

back

Lo

cal Teach

ing

Reg

ion

al Teach

ing

Stu

dy L

eave

Specialty A

naesthetics

Abertawe Bro Morgannwg University Lhb

Morriston Hospital 18                        

Princess of Wales Hospital 4                        

Aneurin Bevan Lhb Royal Gwent Hospital 13                        

Betsi Cadwaladr University Lhb

Wrexham Maelor Hospital 5                        

Ysbyty Glan Clwyd 4                        

Ysbyty Gwynedd 5                        

Cardiff & Vale University Lhb

University Hospital of Wales 55                       

Cwm Taf Lhb The Royal Glamorgan Hospital 5                        

Hywel Dda Lhb West Wales General Hospital 3                        

Core A

naesthetics

Abertawe Bro Morgannwg University Lhb

Morriston Hospital 11                        

Princess of Wales Hospital 8                        

Aneurin Bevan LhbNevill Hall Hospital 10                        

Royal Gwent Hospital 13                        

Betsi Cadwaladr University Lhb

Wrexham Maelor Hospital 5                        

Ysbyty Glan Clwyd 5                        

Ysbyty Gwynedd 3                        

Cardiff & Vale University Lhb

University Hospital of Wales 6                       

Cwm Taf LhbPrince Charles Hospital Site 3                        

The Royal Glamorgan Hospital 9                        

Hywel Dda Lhb West Wales General Hospital 3                        

Abertawe Bro Morg

Aneurin Bevan

Betsi

Cardiff & Vale

Cwm Taf

Hwyel Dda

'Induction' indicator

• Did you get all the information you needed about your workplace when you started working in this post?

• Did someone explain your role and responsibilities in your unit or department at the start of this process?

• How would you rate the quality of induction in this post? (This refers to your induction to the organisation in which you worked.)

• Did you sit down with your educational supervisor and discuss your educational objectives for this post?

Welsh School 2012 -13

N.B. WSoA only has induction days for CT1& ST3

‘Educational Supervision’ indicator

• Did you have a designated educational supervisor (the person responsible for your appraisal) in this post?

• In this post did you have a training/learning agreement with your educational supervisor, setting out your respective responsibilities?

• In this post did you use a learning portfolio? • In this post were you told who to talk to in

confidence if you had concerns, personal or educational?

Educational Supervision

Educational Supervision

'Feedback' indicator

• How often did you have informal feedback from a senior clinician on how you were doing in this post?

• Did you have a formal meeting with your educational supervisor to talk about your progress in this post?

• Did you have a formal assessment of your performance in the workplace in this post?

Feedback

'Clinical supervision' indicator

• How would you rate the quality of clinical supervision in this post?

• In this post did you always know who was providing your clinical supervision when you were working?

• In this post how often, if ever, were you clinically supervised by someone who you felt wasn’t competent to do so?

• In this post how often did you feel forced to cope with clinical problems beyond your competence or experience?

• In this post how often have you been expected to obtain consent for procedures where you feel you do not understand the proposed interventions and its risks?

Welsh School – Clinical Supervision

Welsh School – Clinical Supervision

Adequate experience

• How would you rate the practical experience you were receiving in this post?

• How confident are you that this post will help you acquire the competencies you needed at that particular stage of your training?

Adequate Experience

'Local teaching' indicator

• How would you rate the quality of this local/departmental teaching for this post?

• For how many hours per week was the local/departmental basis specialty-specific teaching provided in this post?

• When attending these local/departmental sessions, in this post, how often did you have to leave a teaching session to answer a clinical call?

• In this post who provided the local/departmental teaching?

Welsh School – Local Teaching

‘Workload’ Indicator

• •How would you rate the intensity of your work, by day in this post?

• •How would you rate the intensity of your work, by night in this post?

• •In this post, how often have you worked beyond your rostered hours?

• •In this post, how often did your working pattern leave you feeling short of sleep when at work?

'Regional teaching' indicator

• In this post, was specialty-specific teaching provided on a deanery/regional/school wide basis?

• In this post how frequently was this deanery/regional/school specialty-specific teaching provided?

• Were you able to attend these whilst in this post?

• How would you rate the quality of this deanery/regional/school specialty-specific teaching for this post

'Study leave' indicator

• In this post how would you rate the encouragement you had to take study leave?

• In this post were you able to access funds to cover the cost of all courses that were recommended for you to complete?

• Were any days subtracted from your study leave allowance for compulsory training in this post (in or out of hospital)?

• In this post did you have difficulty obtaining study leave for any of the following reasons?

Access to educational resources indicator

• Overall, how would you rate the educational resources available to you in this post?

• How good or poor was access to each of the following in your post? – Library – Online journals

• How good or poor was access to each of the following in your post? – E-learning resources – Inernet access – Space for private study

• How good or poor was access to the following in your post? – Equipped rooms for group teaching – Simulation facilities

ARCP unsatisfactory OutcomesProvider Mean Lower_CI Upper_CI

NHS Education for Scotland (West Region) 11.79 9.54 14.49

Wessex Deanery 11.17 8.4 14.71

Wales Deanery 10.36 7.86 13.54

East Midlands Healthcare Workforce Deanery 9.34 7.05 12.26

North Western Deanery 8.47 6.59 10.82

London Deanery 8.03 7.1 9.07

NHS West Midlands Workforce Deanery 7.67 5.83 10.02

Yorkshire and the Humber Postgrad Deanery 7.65 6.08 9.58

NHS Education for Scotland (North Region) 7.38 4.17 12.74

South West Peninsula Deanery 7.05 4.45 11.01

Severn Deanery 6.37 4.16 9.63

Kent, Surrey and Sussex Deanery 5.76 2.94 10.95

NHS Education for Scotland (SE Region) 5.31 2.99 9.26

Northern Deanery 5.06 3.45 7.36

NHS Education for Scotland (East Region) 4.9 2.11 10.97

East of England Multi-Professional Deanery 4.84 2.95 7.83

Oxford Deanery 4.72 2.93 7.53

Mersey Deanery 3.41 1.91 5.99

Northern Ireland Medical Dental Training Agency 1.25 0.49 3.16

ARCP unsatisfactory outcomes (Exam Failure excluded)

Provider Mean Lower_CI Upper_CI

NHS Education for Scotland (West Region) 7.69 5.85 10.05

Wessex Deanery 7.59 5.3 10.75

NHS Education for Scotland (North Region) 4.26 1.96 8.97

Severn Deanery 4.23 2.49 7.11

East Midlands Healthcare Workforce Deanery 3.96 2.52 6.17

North Western Deanery 3.75 2.53 5.52

Wales Deanery 3.4 2.03 5.62

Yorkshire and the Humber Postgraduate Deanery 2.96 2.01 4.34

Northern Deanery 2.7 1.58 4.56

East of England Multi-Professional Deanery 2.64 1.34 5.12

NHS West Midlands Workforce Deanery 2.37 1.42 3.94

Oxford Deanery 1.82 0.84 3.92

NHS Education for Scotland (South-East Region) 1.51 0.51 4.34

Kent, Surrey and Sussex Deanery 1.5 0.41 5.32

Northern Ireland Medical Dental Training Agency 1.25 0.49 3.16

NHS Education for Scotland (East Region) 1.02 0.18 5.56

London Deanery 0.88 0.59 1.31

Handover

• In this post, which of the following best describes handover arrangements BEFORE night duty?

• In this post, which of the following best describes handover arrangements AFTER night duty?

Welsh EPEF indicators

Summary

• Good with an overall improvement

• Still some pockets to improve

• Induction should be possible in particular to improve

• Educational Supervisors role crucial

• Don’t forget to give more informal feedback