Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

19
Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology [email protected]

description

Merging Service-Learning and Institutional Databases: Does Service-Learning Contribute to Student Engagement , Success and Learning?. Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology [email protected]. Defining SL “completion”. - PowerPoint PPT Presentation

Transcript of Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Page 1: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Robert Franco, Ph.D.Director, Office for Institutional Effectiveness

Professor of [email protected]

Page 2: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology
Page 3: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Defining SL “completion”finished 20+ service-learning hours

(supervised and evaluated course-embedded) wrote required semester capstone essay to

be rubric assessed in relation to new College General Education student learning outcomes

submitted all signed forms

Page 4: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

UH as Multi-Campus SystemDistribution by home institution for fall 2009

and spring 2010 Service Learning completers

Institution Number of students

Percentage

Kapiolani CC 500 83.47%

Honolulu CC 36 6.01%

UH Manoa 26 4.34%

Leeward CC 17 2.84%

UH Maui College

7 1.17%

Windward CC 7 1.17%

Hawaii CC 5 0.83%

Kauai CC 1 0.17%

Page 5: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Distribution by GenderService-Learning students by gender, fall

2009 and spring 2010

Page 6: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Distribution by Citizenship

Page 7: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Distribution by EthnicityEthnicity Fall 2009 Spring 2010

SL N = 345 College N = 9102

SL N = 293 College N = 8656

Japanese 28.12 17.02 29.01 16.25

Chinese 19.42 8.82 13.31 8.86

Mixed 14.78 18.96 9.56 18.72

Caucasian 7.83 13.54 11.26 14.56

Native Hawaiian

8.99 13.70 8.87 13.55

Other 5.51 7.76 9.56 7.79

Filipino 6.96 12.60 7.17 12.62

Korean 5.51 4.74 8.53 4.57

Pacific Islander

2.90 2.96 2.73 3.08

Page 8: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Student Cohort; Course SuccessCourse Fall 2009 Success Rate Spring 2010 Success Rate

All SL students All SL studentsENG21 108 57.4

%4 100% 19 39.6

%1 100%

ENG22 325 62.1%

5 55.6% 112 50.5%

5 71.4%

MATH24

206 42% 10 83.3% 116 40.6%

3 33.3%

MATH25

216 43.6%

13 65% 142 46.4%

10 66.7%

MATH81

71 60.2%

1 50% 28 56.0%

1 100%

PCM23 123 49.2%

4 80% 48 46.2%

1 100%

College Level

16,165

70.7%

617 88.4% 15,684 70.8%

893 87.8%

Page 9: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Student Cohort; re-enrollment per semester

Terms All students SL students

Fall 09 to Spring 2010

5933 65.2% 287 82.7%

Spring 2010 to Fall 2010

4857 56.1% 218 74.2%

Page 10: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

CCSSE Snapshot Data, 200835% of part-time students and45% of full-time students reported having

participated in “a community-based project as part of a regular course”

For full report, please visit http://ofie.kcc.hawaii.edu

Page 11: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Pre- and Post-test AssessmentsIndicate statistically significant improvement

in Service-Learners’ attitudes about Working as a teamAbility to make a difference in the communityInstructors as caring individuals

Based on a surveys of pre and post-test students in 1996, 1997 and 2006

Will administer again in Spring 2011

Page 12: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Supervisor Evaluations

Supervisor Evaluations of Students (4 = Excellent, 3 = Good, 2 = Fair, 1 = Needs Improvement)

Semester/Year

# of Evals

Student Reliability

Sensitivity to Clients

Willingness to Learn

CommSkills

Overall

Fall 2009

342 3.69 3.87 3.80 3.67 3.77

Spring 2010

311 3.75 3.82 3.82 3.78 3.81

Page 13: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Next StepsInvestigate the following three research

questions:

1.What is happening?2.Is there a systematic effect?3.Why and how is it happening?

Page 14: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

SL Student Profile What is happening? Demographic characteristics – gender,

ethnicity, age, citizenshipCOMPASS scoresFull-time and part-time statusNumber of credits take at the time of service-

learning

Page 15: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Comparison GroupIdentify a comparison group of equal sample

size by stratified random sampling that fits the profile characteristics of the service learning students.

Page 16: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Is there a systematic effect?Examine the effect of service learning experience

on:expected learning gainscourse success rates, specifically in

developmental courses, gatekeeper courses, and cornerstone courses

retention and persistence rate: course withdraw rate, fall-to-spring re-enrollment, and fall-to-fall re-enrollment

academic progress: number of credits earned after 1, 2, and 3 years of academic study

graduation and transfer rates.

Page 17: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Student Engagement Measuresactive-and-collaborative learningstudent-faculty interactionstudent effortacademic challengesupport services student service

CCSSE 2010 being evaluated now, please visit http://ofie.kcc.hawaii.edu in one month.

Page 18: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Student Learning Outcomes Assessmentstudents’ reflection essaysend-of-semester service learning surveypre- and post tests replicatedcontent and theme analysis

Page 19: Robert Franco, Ph.D. Director, Office for Institutional Effectiveness Professor of Anthropology

Questions? Comments?Contact information:

Robert Franco, Phd.

[email protected]

Website:

http://ofie.kcc.hawaii.edu