Preparing for the Self-Study with Special Emphasis on Assessments

28
Jason Brashier Mark Steiner Freed-Hardeman University Preparing for the self study with special emphasis on assessments. Perspectives from a recent self study. @ACBSPAccredited #ACBSP2015 jbrash ie [email protected] [email protected]

Transcript of Preparing for the Self-Study with Special Emphasis on Assessments

Page 1: Preparing for the Self-Study with Special Emphasis on Assessments

Jason BrashierMark Steiner

Freed-Hardeman UniversityPreparing for the self study with special emphasis on

assessments.

Perspectives from a recent self study.

@ACBSPAccredited #ACBSP2015

[email protected]@fhu.edu

Page 2: Preparing for the Self-Study with Special Emphasis on Assessments

College of Business at Freed-Hardeman University

Henderson, TennesseeFHU enrollment (fall 2014) – 1,846COB enrollment – (fall 2014) 172Self Study Year – 2013/14Site Visit – fall 2014FT Faculty – 12PT/Adjunct Faculty – 10FTE course load – 10.9

@ACBSPAccredited #ACBSP2015

Small institution

Limited resources

Efficiency was key to the reaffirmation process

Page 3: Preparing for the Self-Study with Special Emphasis on Assessments

Reaffirmation Outcome

Self study report submitted by the stated deadline

Site Visit conducted efficiently and without “overtime”

Ten-year reaffirmation confirmed with only one note

@ACBSPAccredited #ACBSP2015

Page 4: Preparing for the Self-Study with Special Emphasis on Assessments

Session Overview

Key Success Factors

Assessment Emphasis

Reflection on What We Would Do Differently

@ACBSPAccredited #ACBSP2015

Page 5: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #1

Institutional Support

Support from the President

Support from the Provost/ VP Academics

Priority for staff@ACBSPAccredited #ACBSP2015

Page 6: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #2

Attitude / Mindset

Is this a compulsory exercise OR

An opportunity for continuous improvement?

Dean / Champion sets the tone

@ACBSPAccredited #ACBSP2015

Page 7: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #3

Importance of Mission

University

College/School

Ensure direct or indirect linkages to all programs

@ACBSPAccredited #ACBSP2015

Page 8: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #4

Institutional policies and processes

Establish at least two years in advance(29% of criteria narrative directly referenced policy alone)

Emphasis on Standard 4 later

@ACBSPAccredited #ACBSP2015

Page 9: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #5

Organization and Accountability

Content experts

Clearly defined roles, expectations and deadlines

Campus Labs Portal

@ACBSPAccredited #ACBSP2015

Page 10: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #6

Campus LabsUse and maintain dashboard to

manage progress

Organize evidence file by standard and criterion with evidence

transcending multiple criterion placed in “universal” folders

positioned before the standards files.

@ACBSPAccredited #ACBSP2015

Page 11: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #7

Content from subject matter experts

Single author

Editor

Narratives in Single VoiceProfessional trumps scholarly

@ACBSPAccredited #ACBSP2015

Page 12: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #8

Goldilocks Principle

Narrative that is not be overly brief or verbose

Address every element of every criterion

Example: “Criterion 2.1. The business unit must have a formal process by which its strategic direction is determined, its action plans are formulated and deployed and innovation and creativity are encouraged.”

@ACBSPAccredited #ACBSP2015

Page 13: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #9

Foster Evaluation Team EfficiencyInitiate an agenda

Brief all stakeholders who will meet with the team Comfortable, convenient facilities on and off site

Have hard copy of all evidence in workroomView the team as a resource for continuous improvement

@ACBSPAccredited #ACBSP2015

Page 14: Preparing for the Self-Study with Special Emphasis on Assessments

Session Overview

Key Success Factors

Assessment Emphasis

Reflection on What We Would Do Differently

@ACBSPAccredited #ACBSP2015

Page 15: Preparing for the Self-Study with Special Emphasis on Assessments

Self StudyKey Success Factor #10

Culture of Assessment• Frame assessment as a value added activity• Provide support• Share successes and examples• Communicate clearly

@ACBSPAccredited #ACBSP2015

Page 16: Preparing for the Self-Study with Special Emphasis on Assessments

Standard 4: Measurement and Analysis of Student Learning and Performance

Criterion 4.1• Learning objectives by program

• What is considered a program?• Process• Internal/ external assessment

• Embedded assessments inform program and course level improvements

• MFT for Business/MBA informs overall performance and benchmarking

• Formative/ summative assessment

@ACBSPAccredited #ACBSP2015

Page 17: Preparing for the Self-Study with Special Emphasis on Assessments

Assessment: IE Processes

Annual Assessment Plans/Reports

• Mission• Student learning

outcomes• Curriculum map• Goals and measurement

tools• Analysis and

improvements

Academic Program Review• 5-year cycle• Mission and strategic

alignment• Resources• Curriculum• SLO Assessment• Improvements

@ACBSPAccredited #ACBSP2015

Page 18: Preparing for the Self-Study with Special Emphasis on Assessments

Assessment: Tools

Templates and Instructions• Clarifies expectations• Improves efficiency and effectiveness of the

assessment process• Facilitates evaluation of multiple programs

Models• Institutionalizes best practices• Reduces ambiguity and questions• Recognizes innovation and hard work

@ACBSPAccredited #ACBSP2015

Page 19: Preparing for the Self-Study with Special Emphasis on Assessments

Standard 4: Measurement and Analysis of Student Learning and Performance

Criterion 4.2 • Minimum of three assessment cycles to demonstrate trends• Line charts with goal vs. actual results

@ACBSPAccredited #ACBSP2015

Page 20: Preparing for the Self-Study with Special Emphasis on Assessments

Standard 4: Measurement and Analysis of Student Learning and Performance

FHU Assessment

Plan

ACBSP Template

Page 21: Preparing for the Self-Study with Special Emphasis on Assessments

Standard 4: Measurement and Analysis of Student Learning and Performance

Criterion 4.3 Assessment plans should be designed to yield comparative information and data both over time and with respect to benchmarks and intended outcomes. • Use ACBSP template (Figure 4.2)• Line charts with benchmark vs. actual results

@ACBSPAccredited #ACBSP2015

Page 22: Preparing for the Self-Study with Special Emphasis on Assessments

Standard 4: Measurement and Analysis of Student Learning and Performance

@ACBSPAccredited #ACBSP2015

Page 23: Preparing for the Self-Study with Special Emphasis on Assessments

Standard 4: Measurement and Analysis of Student Learning and Performance

Criterion 4.4 • Use of results for improvement • Evidence of continuous improvement efforts (minimum 3 cycles)• Describe specific improvements

@ACBSPAccredited #ACBSP2015

Page 24: Preparing for the Self-Study with Special Emphasis on Assessments

Standard 4: Measurement and Analysis of Student Learning and Performance

Page 25: Preparing for the Self-Study with Special Emphasis on Assessments

Assessment: Impact on ACBSP Reaffirmation

Evidence of established assessment processEvidence of direct, indirect, formative, and summative assessmentEvidence of assessment driven improvementsEvidence of quality of educational programs

Result: No notes or recommendations related to Standard 4.

@ACBSPAccredited #ACBSP2015

Page 26: Preparing for the Self-Study with Special Emphasis on Assessments

Session Overview

Key Success Factors

Assessment Emphasis

Reflection on What We Would Do Differently

@ACBSPAccredited #ACBSP2015

Page 27: Preparing for the Self-Study with Special Emphasis on Assessments

Reflection – What we would have done differently

• Overemphasized the importance of professionalism in verbal communication. • Every comment should be accurate in fact and

perception.• Emphasize caution not to mislead, either favorably or

unfavorably• Not a forum for voicing matters not documented in the

report.

• Do not deviate from the prescribed templates• Use the Boyer model to report research activity

@ACBSPAccredited #ACBSP2015

Page 28: Preparing for the Self-Study with Special Emphasis on Assessments

Questions?

@ACBSPAccredited #ACBSP2015