Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care...

38
Outcome Assessment Plan: Cardiovascular Technology College: Piedmont College dedicates itself to the transformative power of education through reciprocal learning, the development of compassionate leaders, and the stewardship of our local and global communities. School of Nursing and Health Sciences: The R.H. Daniel School of Nursing and Health Sciences at Piedmont College shall be recognized as an exemplary professional academic program. The arts & sciences are the foundation upon which the students’ intellectual endeavors are built, contributing to the provision of holistic care to clients that includes physical, psychosocial, spiritual, and environmental care. The School of Nursing and Health Sciences is dedicated to respect for diversity and to community outreach. Program Mission: The cardiovascular technology program seeks to prepare undergraduate students for careers in cardiovascular diagnostics by providing exemplary classroom and clinical education to develop their cognitive, psychomotor, and affective learning abilities relevant to non-invasive adult echocardiography. Furthermore, the program is dedicated to respecting individual diversity and engaging the community by exposing students to a variety of healthcare settings, practitioners, and patient populations. Program Goals: 1. The Program is committed to recruiting eight quality students into each cohort and graduating them one year after program admission. a) Piedmont Goal Reference: GOAL 8. Piedmont College will provide students the resources to achieve their academic goals in a timely fashion and meet learning outcomes expected in their degree programs. b) Outcome (non-student learning): The number of students who matriculate into each cohort and persist. c) Measures: 1) Number of students admitted (8) 2) Retention rate by cohort (100%) 3) Graduation rate by cohort (100%) 2. The Program seeks to have an 100% passing rate on the Certification Examination. a) Piedmont Goal Reference: GOAL 4. Piedmont College will offer traditional and innovative academic programs that are rigorous in content and flexible in real-world application. b) SLO 1: Students will integrate knowledge, skills, and values from the arts and sciences to engage in critical and creative dialogue through discovery, analysis, and communication. 1.1 Adapt evidence-based practice concepts when making business, organizational, and healthcare decisions and critically examining cardiovascular technology practice. 1.2 Demonstrate oral, written, and visual communication strategies that are organized, coherent, accurate, and professionally prepared and delivered. 1.3 Critically evaluate research findings to develop holistic, patient-centered cardiovascular care plans. 1.4 Demonstrate knowledge of healthcare policy, law, finance, and regulatory environments, including local, national, and global trends and adapt

Transcript of Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care...

Page 1: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Outcome Assessment Plan: Cardiovascular Technology

College: Piedmont College dedicates itself to the transformative power of education through reciprocal learning, the development of compassionate leaders, and the stewardship of our local and global communities. School of Nursing and Health Sciences: The R.H. Daniel School of Nursing and Health Sciences at Piedmont College shall be recognized as an exemplary professional academic program. The arts & sciences are the foundation upon which the students’ intellectual endeavors are built, contributing to the provision of holistic care to clients that includes physical, psychosocial, spiritual, and environmental care. The School of Nursing and Health Sciences is dedicated to respect for diversity and to community outreach.

Program Mission: The cardiovascular technology program seeks to prepare undergraduate students for careers in cardiovascular diagnostics by providing exemplary classroom and clinical education to develop their cognitive, psychomotor, and affective learning abilities relevant to non-invasive adult echocardiography. Furthermore, the program is dedicated to respecting individual diversity and engaging the community by exposing students to a variety of healthcare settings, practitioners, and patient populations.

Program Goals: 1. The Program is committed to recruiting eight quality students into each cohort and graduating them one year after program admission.

a) Piedmont Goal Reference: GOAL 8. Piedmont College will provide students the resources to achieve their academic goals in a timely fashion and meet learning outcomes expected in their degree programs.

b) Outcome (non-student learning): The number of students who matriculate into each cohort and persist. c) Measures:

1) Number of students admitted (8) 2) Retention rate by cohort (100%) 3) Graduation rate by cohort (100%)

2. The Program seeks to have an 100% passing rate on the Certification Examination.

a) Piedmont Goal Reference: GOAL 4. Piedmont College will offer traditional and innovative academic programs that are rigorous in content and flexible in real-world application.

b) SLO 1: Students will integrate knowledge, skills, and values from the arts and sciences to engage in critical and creative dialogue through discovery, analysis, and communication.

1.1 Adapt evidence-based practice concepts when making business, organizational, and healthcare decisions and critically examining cardiovascular technology practice.

1.2 Demonstrate oral, written, and visual communication strategies that are organized, coherent, accurate, and professionally prepared and delivered.

1.3 Critically evaluate research findings to develop holistic, patient-centered cardiovascular care plans. 1.4 Demonstrate knowledge of healthcare policy, law, finance, and regulatory environments, including local, national, and global trends and adapt

Page 2: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

this information to best serve the client’s needs. c) Measures:

1) Pathology and Pharmacology Multimedia Project (80% of students will score 3.75 on the rubric)-QEP3 2) Research Methods Project (80% of students will score 3.75 on the rubric)-QEP1 3) Healthcare Finance Project (80% will score 4.0 on the rubric) 4) Capstone Project (80% will score 4.0 on the rubric)-QEP5 5) Capstone Reflection Paper (80% at 3 on the rubric)-QEP2

3. The Program seeks to provide high quality instruction that integrates cognitive and psychomotor skills into active problem solving abilities that will culminate

in 90% of students with post-graduate placements (employment or graduate school) within three months of graduation. a) Piedmont Goal Reference: GOAL 1. Piedmont College will attract and retain students, faculty, and staff, and engage alumni and friends, by providing b) SLO 2: Students will work collaboratively through interprofessional teams to provide or accommodate quality care to clients across the lifespan in a

variety of settings, while respecting the diversity of individuals, groups, and communities. 2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the appropriate use of technology to provide holistic, patient-centered care. 2.3 Implement, evaluate, and modify cardiovascular care decisions for both healthy and at-risk individuals through collaboration with allied

healthcare providers. 2.4 Demonstrate cultural competence in the care of clients from diverse backgrounds.

c) Measures: 1) Pharmacology Project (80% will score 4.25 on the rubric) 2) Preceptor Evaluations of Students (100% will score 3.5 on the rubric) 3) Faculty Evaluations (100% will score 3.5 on the rubric) 4) Employer Survey (respondents will score 80% of program and employee attributes at 4.0 on the rubric) 5) Exit Survey (80% of program attributes will be scored at 4.0 and 90% of students will be placed within 90 days) 6) Alumni Survey (respondents will score 80% of program attributes at 4.0 and 100% will have passed the certification exam)

4. The Program is committed to providing quality clinical sites and preceptors for experiential learning. a) Piedmont Goal Reference: GOAL 6. Piedmont College will educate the whole student through co-curricular programs, extra-curricular activities, and

experiential learning endeavors. b) SLO 3: Through civic engagement, personal growth, and ethical reasoning, students will demonstrate responsible, global citizenship by upholding

high professional standards. 3.1 Demonstrate professional moral, legal, and ethical judgment when delivering patient-centered decisions. 3.2 Maintain oversight and accountability for patient care through the application of management and leadership strategies in the context of a

healthcare system (i.e. risk management, healthcare delivery mechanisms, documentation, client privacy, and financial analysis). 3.3 Use appropriate professional guidelines to develop, implement, evaluate, and modify client care strategies in the changing healthcare

environment. 3.4 Demonstrate a commitment to professional growth and development.

Page 3: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

c) Measures: 1) Health Policy and Law Project (80% will score 4.0 on the rubric)-QEP5 2) Student Evaluations of Preceptors (100% will score 3.0 on the rubric) 3) Student Evaluations of Sites (100% will score 3.0 on the rubric) 4) Skill Sheets (100% will score 4.0 on the rubric) 5) Piedmont 1101 Reflection Paper (80% at 2 on the rubric)-QEP4, QEP6

Page 4: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG2;SLO1;M1 Evaluating Oral and Written Communication Skills, Use of Literature, and Research Methods through Formal Projects and Exercises

Description Pathology & Pharmacology Multimedia Project

Objectives Measured PG2, SLO1, QEP3

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥3.75 on the rubric and section scores will average ≥3.75 overall

Sample Size and Source Students enrolled in HSCS3302

Results

2016 2017 2018

All 88 88 97 APHS 100 100

ATRG 100 100 83 CVTE 100 100 100 EXSS 100 100 100

HCAD-Ath 83 67 100 HCAD-Dem 50 0 100

OTHER

100

Page 5: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative This goal was met, as 97% of all students and 100% of CVTE students met the target. This is a 10 percentage point group improvement from last year, and third consecutive year of 100% on target for CVTE majors. The overall poster quality was very good; this could perhaps be related to their prior experience completing a similarly formatted project as freshmen.

Plan • Continue the project as designed and using the same rubric.

Timeline for Improvement • This same assignment will be given in Spring 2019. (E. McKinney)

Page 6: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG2;SLO1;M4 Evaluating Oral and Written Communication Skills, Use of Literature, and Research Methods through Formal Projects and Exercises

Description Capstone Paper

Objectives Measured PG2, SLO1, QEP5

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥4.0 on the rubric and section scores will average ≥4.0 overall

Sample Size and Source Students enrolled in HSCS4450

Results

2015 2016 2017 2018 All 62 80 96 88 APHS 100 100 100 ATRG 100 100 CVTE 100 63 EXSS 100 100 100 HCAD-Ath 83 80 75 100 HCAD-Dem 43 50 100 100 SFAD 100

Page 7: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative

This goal was partially met, as 88% of all students, but only 63% of CVTE students met the target on the rubric (37 point reduction). This does represent a small decline from last year due to a few low-performing students in this program. Individual section scores showed weaknesses in “evidence”, “discussion”, and the statistical analysis, with many students failing to connect their findings to previous research. The general grammar and paper mechanics were slightly improved from last year.

Plan • Reiterate the paper outline in both this course and HSCS4410 so students are more clear for “what goes where” • Use the OWL at Purdue as a resource.

Timeline for Improvement • The general paper outline will be given more weight and peer-review time in HSCS4410 in the Fall 2018. (A. Dondanville)

Page 8: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG3;SLO2;M1 Evaluating Oral and Written Communication Skills, Use of Literature, and Research Methods through Formal Projects and Exercises

Description Pharmacology paper

Objectives Measured PG3, SLO2

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥4.25 on the rubric and section scores will average ≥4.25 overall

Sample Size and Source Students enrolled in CVTE4020

Results

2015 2016 2017 2018 All 100 100 100 100 Paper 100 100 100 100 Presentation 100 100 100 100

Narrative This goal was met, as 100% of students earned 5.0 on the rubric. Since this was the fourth year this project was completed and data collected, we are pleased with the outcome, but are unsure if the high scores reflect true student ability or a flaw in the assignment or assessment tool (halo central tendency error).

Plan • This assignment will be given again in the same format and assessed using the same rubric next year to give a more clear picture of the data meaning.

Timeline for Improvement • This assignment will be given in Spring 2019. (P. Braum)

0

1

2

3

4

5

% M

eetin

g Ta

rget

Pharmacology Paper Section Scores

2015

2016

2017

2018

Target

Page 9: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG2;SLO1;M3 Evaluating Oral and Written Communication Skills, Use of Literature, and Research Methods through Formal Projects and Exercises

Description Healthcare Finance Project

Objectives Measured PG2, SLO1

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥4.0 on the rubric and section scores will average ≥4.0 overall

Sample Size and Source Students enrolled in HSCS3330

Results

2016 2017 2018 All 100 90 82 CVTE 100 100 90 HCAD-Ath 100 100 60 HCAD-Dem 100 50 100

Page 10: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative This goal was met, as 82% of all students and 90% of CVTE students met the target. This represents an 8 point decline for the group and 10 point reduction for the major cohort. The majority of low scores were from not submitting the assignment sections.

Plan • Consider paring down the material to allow for more in-class engagement activities.

Timeline for Improvement • The project will be modified in Spring 2018. (M.McKinney)

Page 11: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG4;SLO3;M1 Evaluating Oral and Written Communication Skills, Use of Literature, and Research Methods through Formal Projects and Exercises

Description Health Policy and Law Project

Objectives Measured PG4, SLO3

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥4.0 on the rubric and section scores will average ≥4.0 overall

Sample Size and Source Students enrolled in HSCS4411

Results

2015 2016 2017 All 100 79 50 APHS 100 100 100 CVTE 100 75 50 HCAD-Ath 100 50 100 HCAD-Dem 100 100 30 Other 100 SFAD 0

Page 12: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

2015 2016 2017 All 100 92 100 APHS 100 100 100 CVTE 100 100 100 HCAD-Ath 100 100 100 HCAD-Dem 100 75 100 Other

100

SFAD

100

Page 13: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative

This target was partially met, as 100% of CVTE students met the target on the presentation, but only 50% did so on the paper. This ~25 point reduction from last year on the paper could be due to this group of CVTE students being less academically inclined as previous cohorts (several have previously failed out of other academic programs and this major is their ‘fall back’ plan). However, when looking at the individual scores, only a small number of students did poorly, which compromised the overall class performance. The students also relied heavily on their own opinions and did not support their conclusions with evidence.

Plan • Add a few case reviews due at the midpoint as a checkpoint to ensure they will have evidence at the end. • Clarify that opinion is not evidence

Timeline for Improvement • Implement summer 2018. (J.Koshuta)

Page 14: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG2;SLO1;M4 Evaluating Oral and Written Communication Skills, Use of Literature, and Research Methods through Formal Projects and Exercises

Description Capstone Presentation

Objectives Measured PG2, SLO1

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥4.0 on the rubric and section scores will average ≥4.0 overall

Sample Size and Source Students enrolled in HSCS4450

Results

2015 2016 2017 2018 All 100 95 89 88 APHS 100 100 100 ATRG 100 100 CVTE 67 75 EXSS 100 90 100 HCAD-A 100 80 75 100 HCAD-D 100 100 100 100 SFAD 100

Page 15: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative This goal was partially met, as 88% of all students, but only 75% of CVTE students met the target on the rubric. This represents no change for the group as a whole and an 8 point improvement for CVTE majors. With the exception of ‘organization and visual aids’ which improved significantly (4.4 to 5.0) from last year, all other measures were virtually unchanged.

Plan • Reiterate the paper outline in both this course and HSCS4410 so students are more clear for “what goes where” • Use the OWL at Purdue as a resource.

Timeline for Improvement • The general paper outline will be given more weight and peer-review time in HSCS4410 in the Fall 2018. (A. Dondanville)

Page 16: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG3;SLO2;M1 Evaluating Oral and Written Communication Skills, Use of Literature, and Research Methods through Formal Projects and Exercises

Description Pharmacology Presentation

Objectives Measured PG3, SLO2

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥4.25 on the rubric and section scores will average ≥4.25 overall

Sample Size and Source Students enrolled in CVTE4020

Results

2015 2016 2017 2018 All 100 100 100 100 Paper 100 100 100 100 Presentation 100 100 100 100

Narrative This goal was met, as 100% of students earned 5.0 on the rubric. Since this was the fourth year this project was completed and data collected, we are pleased with the outcome, but are unsure if the high scores reflect true student ability or a flaw in the assignment or assessment tool (halo central tendency error).

Plan • This assignment will be given again in the same format and assessed using the same rubric next year to give a more clear picture of the data meaning.

Timeline for Improvement • This assignment will be given in Spring 2019. (P. Braum)

0

1

2

3

4

5

% M

eetin

g Ta

rget

Pharmacology Presentation Section Scores

2015

2016

2017

2018

Target

Page 17: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG3;SLO2;M2 Evaluating Clinical Progress and Competence and the Ability to Integrate Didactic Concepts in the Clinical Setting

Description Preceptor Evaluation of Student

Objectives Measured PG3, SLO2

Assessment Result Rubric Score

Benchmark (Criteria for Success) 80% of students will score ≥3.5 on the rubric

Sample Size and Source All students completing clinical experiences

Results

Student Average Brown, Evette 3.48 Brown, Scott 4.27 Edoimioya, Shawn 4.30 Fleming, Kenzie 4.39 Manotas, Rachel 4.30 Thomas, Blake 4.35 Warren, Emilie 4.24 Warren, Kassie 4.42

Group Average 4.23

2015-2016 2016-2017 2017-2018 All 100 98 93 Certificate 100 100 90 Bachelor's

97 97

0

1

2

3

4

5

Aver

age

Scor

e

Student Evaluation Subscale Scores

2015-2016

2016-2017

2017-2018

Target

020406080

100

All Certificate Bachelor's

% o

n Ta

rget

Student Evaluation Targets

2015-2016

2016-2017

2017-2018

Target

Page 18: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative

Given the large number of high scores and very low original target (60%), the target score was raised to be 80% at 3.5 on the rubric. This new target was met, as 93% of all students exceeded a score of 3.5 on the rubric. However, when disaggregating the data by program status (certificate or bachelor’s degree), one student has had several evaluations at or lower than the target. This student underwent remediation, and was subsequently removed from the program when unable to meet minimal clinical standards.

Plan • This assessment will be given again in the same format next year with additional student to give a more clear picture of the data meaning.

Timeline for Improvement • Reassessment will take place in April 2019 (A.Dondanville)

1.001.502.002.503.003.504.004.505.00

Aver

age

Scor

e

Student Evaluation Score

Brown, Evette

Brown, Scott

Edoimioya, Shawn

Fleming, Kenzie

Manotas, Rachel

Thomas, Blake

Warren, Emilie

Warren, Kassie

Average

Page 19: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG4;SLO3;M2 Evaluating Clinical Progress and Competence and the Ability to Integrate Didactic Concepts in the Clinical Setting

Description Student Evaluation of Preceptor

Objectives Measured PG4, SLO3

Assessment Result Rubric Score

Benchmark (Criteria for Success) 100% of preceptors will score ≥3.5

Sample Size and Source All Preceptors currently assigned students

Results

2016-2017 2017-2018 2018-2019 All 99 99 Heartcenter 100 98 Hospital/Other 96 100

Narrative Given the large number of high scores and very low original target (60%), the target score was raised to be 100% at 3.5 on the rubric. This new goal was nearly met, as 99% of all preceptors met the target. When disaggregating by location (Heartcenter or Other), one preceptor at one site received a few evaluations lower than the threshold.

020406080

100

% M

eetin

g Ta

rget

Preceptor Evaluation Targets

All

Gainesville

Other

Target

00.5

11.5

22.5

33.5

44.5

5

Aver

age

Scor

e

Preceptor Evaluation Targets

Target

2016-2017

2017-2018

2018-2019

Page 20: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Plan • This assessment will be given again in the same format next year with additional student to give a more clear picture of the data meaning.

Timeline for Improvement • Reassessment will take place in April 2019 (A.Dondanville)

Page 21: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG4;SLO3;M3 Evaluating Clinical Progress and Competence and the Ability to Integrate Didactic Concepts in the Clinical Setting

Description Student Evaluation of Site

Objectives Measured PG4, SLO3

Assessment Result Rubric Score

Benchmark (Criteria for Success) 100% of sites will score ≥3.5

Sample Size and Source All sites with assigned students

Results

2016-2017 2017-2018 2018-2019 All 100 97

Hospital/Other 100 95 Heartcenter 100 98

0

20

40

60

80

100

% M

eetin

g Ta

rget

Site Evaluations by Student Targets

2016-2017

2017-2018

Target

2018-2019

Page 22: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

2016-2017

2017-2018

2018-2019

Practice Opportunities 4.53 4.43 Resources 4.76 4.79 Relevant Experience 4.74 4.82

Narrative Given the large number of high scores and very low original target (60%), the target score was raised to be 100% at 3.5 on the rubric. This new goal was nearly met as 97% of sites scored >3.5 on the rubric. While this is a slight decrease from last year (-3 pionts), the disaggregated data reveal only 3 scores below the target. The individual content scores all improved slightly, but not significantly.

Plan • This assessment will be given again in the same format next year with additional student to give a more clear picture of the data meaning.

Timeline for Improvement • Reassessment will take place in April 2019 (A.Dondanville)

00.5

11.5

22.5

33.5

44.5

5

Aver

age

Scor

e

Site Evaluations by Students

2016-2017

2017-2018

2018-2019

Target

Page 23: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG4;SLO3;M4 Evaluating Skill Competence and Mastery

Description Skill Sheets

Objectives Measured PG4, SLO3

Assessment Result Rubric Score and Overall Score

Benchmark (Criteria for Success)

100% of students will score 4 or higher on rubric and 80% Overall

Sample Size and Source All Students

Results

2016-2017 2017-2018 2018-2019 All 88 96

0

20

40

60

80

100

% M

eetin

g Ta

rget

Site Evaluations by Student Targets

2016-2017

2017-2018

Target

2018-2019

Page 24: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Brown, Evette 2.891 Echocardiography Evaluation 2.474 Patient Care Evaluation 3.308

Brown, Scott 4.780571429 Carotid Evaluation 4.706 Echocardiography Evaluation 4.526 Patient Care Evaluation 5 Renal Evaluation 5

Edoimioya, Shawn 4.823571429 Carotid Evaluation 4.8825 Echocardiography Evaluation 4.5 Patient Care Evaluation 5 Renal Evaluation 5

Fleming, Kenzie 4.60075 Carotid Evaluation 4.735 Echocardiography Evaluation 4.5525 Patient Care Evaluation 4.6155 Renal Evaluation 4.5

Manotas, Rachel 4.754333333 Carotid Evaluation 5 Echocardiography Evaluation 4.763 Patient Care Evaluation 5 Renal Evaluation 4

Thomas, Blake 4.5789 Carotid Evaluation 4.666666667 Echocardiography Evaluation 4.596333333 LE Venous Evaluation 4 Patient Care Evaluation 5 Renal Evaluation 4.5

Warren, Emilie 4.641285714 Carotid Evaluation 4.3235 Echocardiography Evaluation 4.921 Patient Care Evaluation 5 Renal Evaluation 4.5

Warren, Kassie 4.475 Carotid Evaluation 4.294 Echocardiography Evaluation 4.8685 Patient Care Evaluation 5 Renal Evaluation 4

Narrative This target was not quite met, as only 96% of students met the threshold score on the rubric. This does represent an 8 point improvement. One student had two low evaluations which brought the group total/average down.

Plan • The low-scoring student is receiving remediation; all assessments will be continued as given.

Timeline for Improvement • Reassessment will take place in April 2019 (A.Dondanville)

Page 25: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG3;SLO2;M4 Evaluating Skill Competence and Mastery

Description Employer Survey

Objectives Measured PG3, SLO2

Assessment Result Rubric Score and Overall Score

Benchmark (Criteria for Success) respondents will score 80% of program and employee skill attributes at 4 on the rubric

Sample Size and Source Employers of Alumni

Results n/a

Narrative The first student will graduate in July 2017.

Plan • An employer survey will be sent to all students’ supervisors following passing of a board exam.

Timeline for Improvement • Surveys will be sent approximately 1 year after graduation (P. Braum)

Page 26: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG4;SLO3;M5 Through civic engagement, personal growth, and ethical reasoning, students will demonstrate responsible, global citizenship by upholding high professional standards.

Description Piedmont 1101 Community Service Reflection Paper

Objectives Measured PG4, SLO3, QEP4, QEP6

Assessment Result Rubric Score

Benchmark (Criteria for Success) 80% of students will score ≥2.0 on the rubric

Sample Size and Source Students enrolled in PDMT1101

Results

Narrative This assessment measure will be implemented in 2018-2019.

Plan •

Timeline for Improvement •

Page 27: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG2;SLO1;M5 Through civic engagement, personal growth, and ethical reasoning, students will demonstrate responsible, global citizenship by upholding high professional standards.

Description Capstone Reflection Paper

Objectives Measured PG2, SLO1, QEP2

Assessment Result Rubric Score

Benchmark (Criteria for Success) 80% of students will score ≥3.0 on the rubric

Sample Size and Source Students enrolled in HSCS4450 and ATRG4420

Results

2018 All 87 APHS 100 ATRG 67 CVTE 88 EXSS HCAD-Ath HCAD-Dem 100 SFAD

0102030405060708090

100

% M

eetin

g Ta

rget

Capstone Reflection Targets

2018

2019

2020

2021

Target

Page 28: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative This assessment measure was implemented for the first time in 2017-2018. It is important to note that this measure is on a 4-point scale, while all others are on a 5-point scale. This goal was met for CVTE students (88% on target).

Plan • Continue data collection in Spring 2019 (A. Dondanville, J. Koshuta)

Timeline for Improvement • Continue data collection in Spring 2019 (A. Dondanville, J. Koshuta)

00.5

11.5

22.5

33.5

4

% M

eetin

g Ta

rget

Capstone Reflection Section Scores

2018

2019

2020

2021

Target

Page 29: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG1;Non-SLO;M2,3 Overall Program Effectiveness Description Retention/Graduation Rates Objectives Measured PG1 Assessment Result Number of students persisting in the program and graduating each year. Benchmark (Criteria for Success) 100% of students will persist each semester and graduate 1 year after admission Sample Size and Source All Students in the Clinical Year and those in the pre-professional phase of the program

Results

Program Fall 2016 S to F Spring 2017 F to S Fall 2017 S to F Spring 2018 F to S

Applied Health Science 9 1.1 6 0.67 3 0.5 3 1 Athletic Training (all) 33 1.6 29 0.88 29 1 30 1.03 Cardiovascular Tech (Clinical) 5 5 5 1 9 2 9 0.9 Exercise & Sport Science 42 1.6 37 0.88 34 0.92 34 1 Health Care Admin 26 1.5 20 0.77 13 0.65 13 1 Pre-Cardiovascular Tech 11 1.1 13 1.18 14 1.08 14 1 Sport &Fitness Admin 1 4 4 6 1.5 6 1

Narrative

This goal was partially met, as 80% of PCVT students retained from fall to spring, but only 89% from the first to third semesters of the professional phase of the program (student withdrew for financial reasons). All 5 students enrolled in the professional cohort last summer also graduated on target (100%). While we are not yet at our goal of 15 pre-professional students, the numbers have grown from 4 to 14 over the last three years.

Plan • Continue tracking enrollment and retention each term. Timeline for Improvement • Reassess in Spring 2019. (A.Dondanville)

Page 30: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG1;Non-SLO;M1 Overall Program Effectiveness Description Acceptance/Admission Rates Objectives Measured PG1 Assessment Result Number of students applying and being admitted to the program each year. Benchmark (Criteria for Success) The program will accept 8 students per year Sample Size and Source All Students applying for the Clinical Year

Results

CVTE

Semester in the Program

Cohort Entrance Semester Interview Accept FA SP SU GR Retent.

% Avg.

Enroll. Target Enroll.

Fall 2015 1 1 1 1 1 1 1 1.00 8.00 Fall 2016 6 5 5 5 5 5 1 5.00 8.00 Fall 2017 9 9 9 9 8 0.889 8.00 8.00 Fall 2018 10 10 8.00

Narrative This goal was met, as 9 students were admitted to the clinical phase; this is an increase of (5 to 9). The program is now accredited, and has accepted all applicants thus far. We anticipate having 10 students in the 2018 cohort, but are unsure if the low admission standards (2.5GPA) is giving us the strongest cohort (i.e. should all be accepted or should the program requirements be strengthened?).

Plan • Continue administering the program as it was this year and monitor application and admission rates prior to the start of the clinical

year. • Institute clinical skill “check points” in the fall and spring terms to determine the need for remediation.

Timeline for Improvement • Review application and admission data in June 2019. (A.Dondanville) • Clinical skill checkpoint development June 2018 (P. Braum)

Page 31: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG3;SLO2;M5 Overall Program Effectiveness Description Senior Exit Survey/Placement Objectives Measured PG3, SLO2 Assessment Result Rubric Score Benchmark (Criteria for Success) Students will score 80% of program attributes at 4 on the rubric and 90% will have post-graduation placements secured within 3mo of graduating

Sample Size and Source Graduating Seniors (July)

Results

2015 2016 2017 All 100 100

Certificate 100 100 Bachelor's

2015 2016 2017 All 4.375 4.79

Certificate 4.375 4.79 Bachelor's

020406080

100

All Certificate Bachelor's

% M

eetin

g Ta

rget

Exit Survey on Target

2015

2016

2017

Target

020406080

100

All Certificate Bachelor's

% M

eetin

g Ta

rget

Exit Survey on Target

2015

2016

2017

Target

Page 32: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative Since these data are collected after annual reports are due, this metric will always be from the previous year. Of the 5 graduating students in 2017 (July), only 2 completed the survey. They scored program attributes at 4.79, meeting the target. This represents no change from last year. Additionally, 4 of 5 students were employed immediately after graduation (the other chose to not seek employment to begin a family).

Plan • The graduating student will be asked to complete the survey prior to graduation. Timeline for Improvement • The survey will be administered in July 2018. (A. Dondanville)

00.5

11.5

22.5

33.5

44.5

5

Aver

age

Scor

e

Exit Survey Program Attributes

2015

2016

2017

Target

Page 33: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG3;SLO2;M6 Overall Program Effectiveness Description Alumni Survey Objectives Measured PG3, SLO2 Assessment Result Rubric Score Benchmark (Criteria for Success) Respondents will score 80% of program attributes at 4 on the rubric and 100% will have taken and passed the certification exam. Sample Size and Source All Alumni every 3 years Results n/a Narrative This program has no alumni meeting the criteria yet. Plan • Alumni surveys will be sent to all program graduates every three years. Timeline for Improvement • The first survey will be sent in July 2019. (A. Dondanville)

Page 34: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG3;SLO2;M3 Overall Program Effectiveness Description Faculty Evaluations Objectives Measured PG3, SLO2 Assessment Result Rubric Score Benchmark (Criteria for Success) 100% of faculty will score 3.75 or higher on the rubric Sample Size and Source All Course Faculty currently assigned students

Results The one faculty member scored 5 on all but three faculty evaluations (average of 4.92). This was a slight change from last year having only 1 evaluation with a score of less than 5.

Narrative

This goal was met; this was a slight change (+2) from last year having only 1 evaluation with a score of less than 5. however, since there is only one faculty member in the program, it is unclear if the instructor is truly outstanding or if the students’ lack of comparators contributed the homogeneity (halo central tendency error). Unfortunately, since this faculty person is also the program director, the evaluations are never truly anonymous, which could also contribute to the scores.

Plan • This assessment will be given again in the same format next year with additional student to give a more clear picture of the data meaning.

Timeline for Improvement • Reassessment will take place in April 2019 (A.Dondanville)

Page 35: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG2;SLO1;M2 Through civic engagement, personal growth, and ethical reasoning, students will demonstrate responsible, global citizenship by upholding high professional standards.

Description Research Methods Paper

Objectives Measured PG2, SLO1, QEP1

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥3.75 on the rubric

Sample Size and Source Students enrolled in HSCS4410

Results

2015 2016 2017 All 90 63 63 APHS 100 33 50 ATRG 83 67 CVTE 100 67 25 EXSS 100 56 100 HCAD-Ath 75 67 100 HCAD-Dem 100 67 25 SFAD 100

0

20

40

60

80

100

% M

eetin

g Ta

rget

Research Methods Paper Rubric Targets

2015

2016

2017

Target

Page 36: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative

This goal was not met, as only 63% of all students and 25% of CVTE students reached the target. Only 25% of CVTE students reached the goal a 42 point reduction. Many students continue having difficulty determining a research direction and envisioning the fundamental supporting information. We believe that part of this may be due to only one third of these students having completed scaffolding papers in previous classes (CVTE and HCAD do not have previous experience with this type of assignment). Additionally, this group of PCVT students has lower than average GPAs and are completing the major as a “fall back” option after not being selected into the NURS program.

Plan • This assignment will be given again in the same format and assessed using the same rubric next year to give a more clear picture of the data meaning. • Additional opportunities for students to work on their writing and citation skills will be given in this class next year. • More emphasis will be placed on developing the outline next year.

Timeline for Improvement

• This assignment will be given in Fall 2018. (A. Dondanville) • Additional in class group assignments for students to work on sentence construction and citation use will be implemented next year (A. Dondanville)

00.5

11.5

22.5

33.5

44.5

5

Aver

age

Scor

e

Research Methods Paper Rubric Scores

2015

2016

2017

Target

Page 37: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

PG2;SLO1;M2 Through civic engagement, personal growth, and ethical reasoning, students will demonstrate responsible, global citizenship by upholding high professional standards.

Description Research Methods Presentation

Objectives Measured PG2, SLO1, QEP1

Assessment Result Rubric Score

Benchmark (Criteria for Success)

80% of students will score ≥3.75 on the rubric

Sample Size and Source Students enrolled in HSCS4410

Results

2015 2016 2017 All 83 64 73 APHS 100 67 100 ATRG 50 67 CVTE 50 100 63 EXSS 100 67 100 HCA-Ath 75 67 80 HCA-Dem 100 50 50 SFAD 100

0

20

40

60

80

100

% M

eetin

g Ta

rget

Research Methods Presentation Rubric Targets

2015

2016

2017

Target

Page 38: Outcome Assessment Plan: Cardiovascular Technology...2.1 Provide safe, competent cardiovascular care in a variety of settings for patients across the life span. 2.2 Demonstrate the

Narrative This target was not met, as only 73% of students overall met the target and 63% of PCVT students scored at least 3.75 on the rubric. This is a 37-point reduction for this major (and 9 point improvement for the group as a whole). Similar to the related paper, students scored lowest on ‘discussion and recommendations’; again, this likely relates to their difficulty connecting concepts into large frameworks.

Plan • This assignment will be given again in the same format and assessed using the same rubric next year to give a more clear picture of the data meaning. • Additional opportunities for students to work on their writing and citation skills will be given in this class next year. • More emphasis will be placed on developing the outline next year.

0

1

2

3

4

5

Aver

age

Scor

e

Research Methods Presentation Section Scores

2015

2016

2017

Target