2-Kirkpatrick-Evaluation-Model-PPT.ppt

8/9/2019 2-Kirkpatrick-Evaluation-Model-PPT.ppt

http://slidepdf.com/reader/full/2-kirkpatrick-evaluation-model-pptppt 1/13

Principles of E ectivePrinciples of E ective

EvaluationEvaluationProf Keithia WilsonProf Keithia Wilson

Academic Leader StudentAcademic Leader StudentSuccess & RetentionSuccess & Retention



Kir patric !"##$%Kir patric !"##$%

odel of Evaluation -odel of Evaluation -'vervie('vervie($ levels of outcome evaluation %$ levels of outcome evaluation %

'' Level % ReactionLevel % Reaction'' Level % Learnin)Level % Learnin)

*'*' Level * % +ehaviourLevel * % +ehaviour$'$' Level $ % ResultsLevel $ % Results



)evel " - *eaction)evel " - *eaction

,easures participant-s reactions to the trainin) pro)ram.,easures participant-s reactions to the trainin) pro)ram.includin)/includin)/reactions to the overall pro)ram (outcomes e')'.reactions to the overall pro)ram (outcomes e')'.

0 12o 3hat e4tent did you 5nd the 6rientation pro)ram0 12o 3hat e4tent did you 5nd the 6rientation pro)ramuseful78useful78reactions to speci5c components of the pro)ramreactions to speci5c components of the pro)ram(processes e')'.(processes e')'.

0 What aspects of 6rientation did you ,6S20 What aspects of 6rientation did you ,6S2APPR9":A29 and found ;S9<;L7APPR9":A29 and found ;S9<;L7

0 What aspects of 6rientation did you L9AS20 What aspects of 6rientation did you L9AS2APPR9":A29 and feel is ,6S2 := =99> 6<APPR9":A29 and feel is ,6S2 := =99> 6<:,PR6?9,9=27:,PR6?9,9=27




:mportant to include:mportant to include closed-ended itemsclosed-ended items includin)includin) rating scales e+g+,rating scales e+g+,

o( e ective (as the 'rientation program overall in helpingo( e ective (as the 'rientation program overall in helpingyou to ma e a transition to university.you to ma e a transition to university.

not at all e ective very e ectivenot at all e ective very e ective " / 0 $ 1 2 3" / 0 $ 1 2 3 o( useful (as the initial information session on theo( useful (as the initial information session on the

predictors of success in 4rst year.predictors of success in 4rst year. not at all useful very usefulnot at all useful very useful " / 0 $ 1 2 3" / 0 $ 1 2 3

As 3ell asAs 3ell as open-ended itemsopen-ended items What else 3ould you have liked included in theWhat else 3ould you have liked included in the

6rientation pro)ram today76rientation pro)ram today7




5ome FYE e6amples5ome FYE e6amples %%Startin)@!ri th Survey Buestions onStartin)@!ri th Survey Buestions on

6rientation (retrospective student6rientation (retrospective studentsurveysurveySchool speci5c 6rientation Pro)ramSchool speci5c 6rientation Pro)ramevaluation at the end of 6C>ay & theevaluation at the end of 6C>ay & the"ommon 2ime (on)oin) 6rientation"ommon 2ime (on)oin) 6rientationPro)ram % student surveys. focus )roupsPro)ram % student surveys. focus )roupsPeer ,entorin) Pro)ram 5nal evaluationPeer ,entorin) Pro)ram 5nal evaluation#y mentors & mentees#y mentors & mentees



)evel / - )earning)evel / - )earning

,easures 3hat participants,easures 3hat participants have learnedhave learned fromfrominvolvement in the pro)raminvolvement in the pro)ramWhat is measured needs to relate to 3hatWhat is measured needs to relate to 3hat3as covered in the pro)ram viD'3as covered in the pro)ram viD' learninglearningobjectivesobjectives

2ypically covers 2ypically covers no(ledge, s ills, orno(ledge, s ills, orattitudesattitudes

=eeds to include #oth ratin) scales & openC=eeds to include #oth ratin) scales & openCended Buestionsended Buestions"an include selfCreport & tests of actual"an include selfCreport & tests of actualkno3led)ekno3led)e



)evel / - )earning)evel / - )earning5ome e6amples5ome e6amples %%"+"+ 5tudent self-report5tudent self-report

77 : feel con5dent that : kno3 3hat to do to #e successful: feel con5dent that : kno3 3hat to do to #e successfulacademicallyacademically

this semesterthis semester not at all con5dent very con5dentnot at all con5dent very con5dent

* $ E F G * $ E F G

0 What have you learned a#out the transitions you 3ill need to0 What have you learned a#out the transitions you 3ill need tomake asmake as

a commencin) student in order to #e successful7a commencin) student in order to #e successful7

'' 5tudent no(ledge5tudent no(ledge 0 : kno3 the name of my <irst ear Advisor yes no (circle one0 : kno3 the name of my <irst ear Advisor yes no (circle one

0 : kno3 the di erence #et3een a lecture and a tutorial (circle one0 : kno3 the di erence #et3een a lecture and a tutorial (circle one Stron)ly >isa)ree I >isa)ree I =eutral I A)ree I Stron)ly A)reeStron)ly >isa)ree I >isa)ree I =eutral I A)ree I Stron)ly A)ree



)evel / - )earning)evel / - )earning

5ome FYE e6amples5ome FYE e6amples %%Startin)@!ri th Survey data evaluatesStartin)@!ri th Survey data evaluateslearnin) outcomes in terms of kno3led)e &learnin) outcomes in terms of kno3led)e &attitudes (e')'. kno3in) 3here to )o to )etattitudes (e')'. kno3in) 3here to )o to )ethelpJ perceptions of )ood teachin)helpJ perceptions of )ood teachin)6utcome evaluation for Peer ,entees (What6utcome evaluation for Peer ,entees (Whatare your * most important learnin)s from yourare your * most important learnin)s from yourparticipation in the Peer ,entorin) Pro)ram7participation in the Peer ,entorin) Pro)ram7<irstCAssessmentC<irstC<eed#ack am#er alert<irstCAssessmentC<irstC<eed#ack am#er alertintervention (What have you learned as aintervention (What have you learned as aresult of your participation7result of your participation7



)evel 0 - 8ehaviour)evel 0 - 8ehaviour

,easures the transfer of kno3led)e. skills &,easures the transfer of kno3led)e. skills &attitudes from the trainin) conte4t to in vivoattitudes from the trainin) conte4t to in vivoor realClife conte4ts (the classroom & study 'or realClife conte4ts (the classroom & study '9valuate #oth #efore & after the pro)ram if9valuate #oth #efore & after the pro)ram ifpracticalpractical;se survey. focus )roups. intervie3s 3ith;se survey. focus )roups. intervie3s 3ithstudents. mentors. sta (convenors.students. mentors. sta (convenors.

sessionalssessionalsStartin)@!ri th Survey (>id you attendStartin)@!ri th Survey (>id you attend6rientation7 Ho3 much time are you6rientation7 Ho3 much time are youspendin) on study7spendin) on study7



)evel 0 - 8ehaviour)evel 0 - 8ehaviour

5ome FYE e6amples5ome FYE e6amples %%Startin)@!ri th survey dataStartin)@!ri th survey data9ttendance9ttendance at 9C>ay. 6C>ay &at 9C>ay. 6C>ay &"ommon 2ime ASP Pro)ram"ommon 2ime ASP Pro)ram9ttendance9ttendance at lectures & tutesat lectures & tutes9ssessment submission9ssessment submission ratesratesin coursesin courses



)evel $ - *esults)evel $ - *esults

,easures,easures :return-on-investment:return-on-investment 8. or the8. or thee4tent to 3hich the pro)ram has producede4tent to 3hich the pro)ram has producedresults'results'

Some < 9 e4amples include %Some < 9 e4amples include %ard student outcomesard student outcomes such as Csuch as C

0 pass rates in courses for assessment items0 pass rates in courses for assessment items 0 !PA in semester . & < overall0 !PA in semester . & < overall 0 student retention into year 0 student retention into year

5oft student outcomes5oft student outcomes such as %such as %0 student satisfaction0 student satisfaction



EvaluationEvaluation

Key ;uestionKey ;uestion % What di erence do our < 6&9% What di erence do our < 6&9interventions (e')'. 6rientation. Peerinterventions (e')'. 6rientation. Peer,entorin). Attendance. <irst Assessment,entorin). Attendance. <irst Assessment:ntervention etc' make overall7:ntervention etc' make overall7

Pro)ram :nterventionPro)ram :ntervention Reactions ReactionsLearnin)Learnin) * +ehaviour* +ehaviour $ 6verall$ 6verall

Productivity ResultProductivity Result

Pro)ram :nterventionPro)ram :ntervention <eel<eel Kno3Kno3 >o>o 3hat3hatis the result or di erence overall7is the result or di erence overall7

2-Kirkpatrick-Evaluation-Model-PPT.ppt

Documents

Transcript of 2-Kirkpatrick-Evaluation-Model-PPT.ppt