Engaging Student Affairs Professionals in Division-Wide Assessment

Lisa Garcia-Hanson,University of Washington TacomaCharlotte Tullos, Central Washington UniversityDiane E. Waryas, College of Southern NevadaLeslie Webb, Boise State University

Session Objectives

•To increase participants’ understanding of the value of division-wide assessment practices,

•To explore one approach for widescale assessment training and planning for improvement,

•To increase participant’s understanding of the various implementation strategies employed to enhance assessment practices at CWU,

•To encourage participants to consider how a similar approach may be of value to them.

Section One: Motivation for Intensive Training and PlanningCharlotte Tullos

CWU Student Affairs & Enrollment Management assessment in 2006•Status of Division assessment in 2006

•Specific motivations for consultant visit and intense workshop

Section Two: Two Day Assessment WorkshopDiane E. Waryas

Specific Goals for Workshop

•Attempt to equip all participants with baseline knowledge of assessment practices and the importance of assessment

•Provide participants with an opportunity to practice applying new knowledge

•Provide targeted hands-on assistance to departmental staff charged with assessment

•Provide the Vice President with recommendations for moving practices forward

Workshop Overview

• Structured across two days, on-site at CWU• 30+ individuals participated• First day consisted of training (7 hours)• Second day consisted of individual meetings (8

hours)• Before the workshop:

▫Obtained information and materials regarding status “to date”

• After the workshop:▫Provided Executive Summary with

recommendations

Day One—Assessment Training

•Review of assessment basics (types of outcomes, methods, the assessment process, how to write outcomes, planning and reporting)

•Discussion of organizing assessment •Discussion of links to other evaluation

(e.g. NSSE)•Application through case study

Day Two—Individual Meetings

•Met with departmental assessment team•Focused on departmental objectives and

strategic plan•Tailored to department’s unique needs

▫Outcomes▫Measurement▫Enhancing▫Starting

▫Then….implementation follows

Section Three: Immediate ImplementationLeslie Webb

Strategic Planning Guides the WorkOverarching goal - Develop and

implement a coherent, comprehensive program of environmental analysis, assessment, and evaluation.

(Goals informed by tailored assessment evaluation and recommendations)

Timeline and implementation• (Recap - May 2006, external assessment workshop was

conducted)

• (Recap - Facilitated Strategic Planning work began)

• Summer 07, Division adopted Learning Reconsidered: A Campus Wide Focus on the Student Experience, with the sole purpose of identifying desired learning outcomes for all areas in SAEM

• Fall 07, Appointment of a divisional assessment coordinator

• Fall 07, Divisional assessment catalog developed (1:1 outreach meetings as part of personalizing strategy)

• Winter 08-Spring 08 – Review and Revise SAEM Strategic Plan

Next Steps for Assessment Goals• Winter 08, Planning and Effectiveness website launched–

eventually this will be the central reporting and housing site inc. results published

• Create and universalize assessment plan structure – Examine catalog and identify existing gaps – divisionally and departmentally. ▫ Continue to streamline divisional data coordination and collection ▫ Collaborate around functional lines and look for opportunities to

collaborate instrument design

• Develop Assessment Council – design charge, focus, initiatives

• Require executive summaries of assessment results

Section Four: Recent ImplementationLisa Garcia-Hanson

Building on Assessment Foundation•Different Role•Another temporary position•Took three-pronged approach:

1. Assess current assessment efforts2. Identify new Assessment Council/Goals3. Educate division on assessment

Later ~~Develop sustainable initiatives

SAEM Assessment and Planning Council

 Mission: In order to create a system of accountability in ongoing Divisional assessment practices, the Assessment and Planning Council will assist SAEM departments in understanding how assessment drives the student learning and development process and informs strategic planning.

SAEM Assessment and Planning Council - Goals

•To educate and promote a culture of assessment, in order to ensure that it is infused within the division of SAEM.

•The Council will continue a focus on student learning and development with an emphasis on measurable improvement of programs, services and service delivery.

•Promote the active engagement of all members of SAEM in assessment.

Education: StudentVoice

Education: SV Webinars• How to use Student Voice: Fundamentals • How to use Student Voice: Reporting Site • How to write an effective learning outcome statement• Designing an assessment project: From start to finish • Assessing New Students to Improve Retention and Student

Success • Selecting a method • Survey design and questionnaire writing guidelines • Addressing survey fatigue • Rubrics 101: A tool to assess learning • Mobile data collection • Adding focus groups to your assessment plan • Reporting assessment results

Assessment Planning WorksheetDepartmental Mission:Specific Program/Service

Description:Program/Service Objectives:

Project SpecificsProject Title:Purpose of the project:Assessment method:Timeline/frequency:Population/Sample to be

assessed:Special challenges to this

assessment: Post-Assessment ConsiderationsAssessment Evaluation:

• Method of reporting/sharing data:

• With whom data will be shared:• How data will be used to

improve current practice:

Questions to Address after Data is Collected (Closing the Loop)

• What are the implications of the data?

• What gaps exist? What information is needed in the future?

• What actions were taken as a result of the data?

• How can assessments be improved in the future?

 

StudentVoice Usage at CWU

•As of April 2010, 106 Surveys were active, recently used, or completed

•There were 11,442 survey respondents.•Largest survey: CWU Inclusiveness

Initiative Survey : 2216 respondents in one-month period.

•Surveys used for everything from satisfaction surveys; training evaluations; attitudinal surveys; end-of-year/activity responses; Pre/Post Tests; employee/employer evaluations

Sustainability

•Highlighting SAEM Accomplishments▫http://www.cwu.edu/~saem/uploads/docum

ents/CWU_SAEM_brief.pdf

Discussion and Q&A

*Have you engaged in a similar process?

*How could a similar process be useful to you?

Thank you for coming!