Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence &...
-
Upload
keith-quinlan -
Category
Documents
-
view
215 -
download
1
Transcript of Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence &...
![Page 1: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/1.jpg)
Using Data to Inform our Practice
with Peer Leader Programs
Brett Bruner, Director of Persistence & Retention
Fort Hays State University
2014 Peer Mentor Institute
Fort Hays State University | Hays, KS
![Page 2: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/2.jpg)
Overview of Session
• Learning Outcomes
• Challenges in Assessment
• Foundations of a Culture of Evidence
• Culp & Dungy’s (2012) Building a Culture of Evidence in Student Affairs: A Guide for Leaders & Practitioners
• Portland State University’s (2011) Division of Enrollment Management & Student Affairs – Assessment Handbook
• Application to Peer Leader Programs – You’ve Collected Data, Now What Do We Do With it?
• The FHSU Experience – Go Tigers!!
• Closing Reflection/Q&A
![Page 3: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/3.jpg)
Learning Outcomes
By attending this educational session, participants will be able to:
• Articulate the definition of a “culture of evidence.”
• Identify the most important data to tell your story with peer leader programs.
• List strategies for using the data to inform our practice.
![Page 4: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/4.jpg)
Background of InstitutionsFort Hays State University
• Regional, comprehensive state university
• 13,000 total students (5,000 on-campus traditional undergrads)
• Located in Hays, KS (halfway between Kansas City & Denver)
• New student cohort (Fall 2013)
• 950 first year students
• 450 transfer students
• 150 international students
![Page 5: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/5.jpg)
Background of InstitutionsBaker University
• Private, Methodist based university
• 800 students
• Located in Baldwin City, KS (1 hour southwest Kansas City)
• New student cohort
• 235 first year students
• 47 transfer students
![Page 6: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/6.jpg)
Challenges in Assessment
• What challenge(s) do you face with your Peer Leader programs regarding assessment?
• New undergraduate student leaders
• Returning undergraduate student leaders
• Undergraduate student staff supervisors
• Graduate students
• New professionals
• Mid-level professionals
![Page 7: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/7.jpg)
Foundations of a Culture of Evidence
“It is important to be clear about the aims of a culture of evidence. The goal is to use evidence to better understand our students & their experiences so we can improve our work with them.”
– Sarah Westfall
Kalamazoo College (pg. 2)
![Page 8: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/8.jpg)
Risks & Rewards Associated with Creating a Culture of
Evidence
Challenge Risk Reward
Funding
Assessment Expertise
Competing Priorities
Building Capacity
Dealing with Fear
![Page 9: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/9.jpg)
What is a Culture of Evidence?
![Page 10: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/10.jpg)
What is a Culture of Evidence?
• A commitment among student affairs professionals to use hard data to show how the programs they offer, the processes they implement, & the services they provide are effective & contribute significantly to an institution’s ability to reach its stated goals & fulfill its mission.
Source: Culp & Dungy (2012) Building a Culture of Evidence in Student Affairs: A Guide for Leaders & Practitioners
![Page 11: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/11.jpg)
What is aCulture of Evidence?
• What’s the most important assessment data to tell our story?
RATHER THAN…
• What assessment data is available?
![Page 12: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/12.jpg)
Application to Peer Leader ProgramsYou’ve Collected Data, Now What
Do We Do With It?
• Analyze, Interpret, Report & Use the Results
• Fun part! Making sense of data
• Use it to inform both your practice & decision making
• Ex.: Look at the characteristics of your respondents. What can you learn to better understand your data? Do responses vary by…
• Age?
• Year in school?
• Cumulative GPA?
• Read through qualitative comments & reflect on its overall meaning
![Page 13: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/13.jpg)
Application to Peer Leader ProgramsYou’ve Collected Data, Now What
Do We Do With It?
• Transparency & Reporting
• Making meaningful, understandable information about student learning & institutional performance readily available to stakeholders
• Tie to institutional goals for student learning
• Draw conclusions that are well-supported & clearly-reasoned
• Future engagement in assessment cycles
![Page 14: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/14.jpg)
Application to Peer Leader Programs
You’ve Collected Data, Now What Do We Do With It?
• Transparency & Reporting
• Publicly share your assessment plan
• Publicly share your results
• Encourage participants’ help in analyzing data
• Share how conclusions impact program development
• Highlight assessment results in your annual report
• Make reports available on departmental websites
![Page 15: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/15.jpg)
Application to Peer Leader ProgramsYou’ve Collected Data, Now What
Do We Do With It?
• Transparency & Reporting
![Page 16: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/16.jpg)
Application to Peer Leader ProgramsYou’ve Collected Data, Now What
Do We Do With It?
• Using Data – Reflection Questions
• How do your results provide evidence for your outcomes?
• What do your results say about your program process & the impact of the program on students’ learning & development?
• Based on the results, what decisions will you make or what action will you take regarding programs, policies, & services as well as improvement/refinements to the assessment process?
![Page 17: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/17.jpg)
Application to Peer Leader ProgramsYou’ve Collected Data, Now What
Do We Do With It?
• Feedback Loops
![Page 18: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/18.jpg)
Application to Peer Leader ProgramsYou’ve Collected Data, Now What
Do We Do With It?
• Feedback Loops
“Good assessment fosters dialogue, not simply data collection.”
– Culp & Dungy (pg. 101)
![Page 19: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/19.jpg)
The FHSU ExperienceENGAGE College
• Administered during Weeks 3-6 of UNIV 101 Freshman Seminar
• Student self-perceptions of behavioral & attitudinal characteristics related to academic success & retention
![Page 20: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/20.jpg)
The FHSU ExperienceENGAGE College
![Page 21: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/21.jpg)
The FHSU ExperienceENGAGE College
• Data shared with variety of campus resources:
• President’s Senior Administrative Group (ISM)
• President’s Extended Cabinet
• Institutional College Completion Team
• Division of Student Affairs – Directors
• UNIV 101 Freshman Seminar Instructors
• Extended trainings with the following:
• Division of Student Affairs – Student Life Cluster
• Office of Residential Life
• Office of First Year Experience/Persistence & Retention – grad/undergrad staff
![Page 22: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/22.jpg)
The FHSU ExperienceENGAGE College
• Programmatic Changes
• Curricular changes in UNIV 101
• Development of new extended orientation & transition social connections
• Policy Changes
• Academic Affairs – mid-term grade conversations
• Partner Collaborations
• Residential Life – revamped programming model around central deficiencies
![Page 23: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/23.jpg)
Closing Reflection
• What is the most important data to tell your story with your Peer Leader program rather than the data that’s most readily available/easily accessible?
• What is 1 area of refinement for your Peer Leader program as it relates to using the data to inform your practice?
![Page 24: Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551c115e550346b24f8b5451/html5/thumbnails/24.jpg)
Using Data to Inform our Practice
with Peer Leader Programs
Brett Bruner, Fort Hays State University
2014 Peer Mentor Institute
Fort Hays State University | Hays, KS