Using SLO Evidence in Planning and Resource AllocationAccreditation Institute – March, 2011

Marie Boyd – Chaffey CollegeRoberta Eisel – Citrus College

Fred Hochstaedter – Monterey Peninsula CollegeDeb Parziale – Ohlone College

Common Ground Rules• All roads lead through Program Review– Senate Resolutions

• There are different forms of “evidence” – none more important than the other– Quantitative versus Qualitative – it is not always all about

“numbers”• None of this should be about accreditation, but

should have EVERYTHING to do with student success• We are already doing much of what is being

requested – we just need to document a little more efficiently/effectively

Program Review is the pathway.

• Comprehensive Program Review: College-wide– Address learning outcomes or support of student

learning-- Academic Programs -- Student Services-- Instructional Support -- Institutional Support

• Annual Program Review or Annual Action Plan

• Comprehensive Assessment Report

Faculty determine evidence.Quantitative data are informative.

Biology 145: Environmental Science has been assessed for

the last three years. Assessment is administered with a multiple-choice quiz at the beginning of semester and same quiz at the end of the semester. The assessment showed gains in student understanding of the topic.

– From annual program review slo reflection

Qualitative evidence is helpful.

Biology 109: In response to their thoughts toward science, students

remarked:“Science has never been my biggest strength but I’ve

felt so strong in this class.”“After taking this class, I realized science is very

interesting. I never knew I could have science as part of my profession.”

-- From annual program review slo reflection

Assessment data are put to use.

• Faculty Needs Assessment Committee

• Curriculum Committee• Educational Programs

Committee• Faculty Learning Institute• Financial Resources Committee• Physical Resources Committee• Steering Committee

“… used by faculty, deans, and administration as a primary rationale for budget, staff, equipment, facilities and other planning decisions.”

“… to prioritize requests and make decisions.”

Comprehensive Assessment Report

Data are incorporated into program review.

Program review processes are in place and implemented regularly.

Dialogue about the results of all program reviews is evident throughout the institution as part of discussion of institutional effectiveness.

Results of program review are clearly and consistently linked to institutional planning processes and resource allocation processes.

The institution reviews and refines its program review processes to improve institutional effectiveness.

The results of program review are used to continually refine and improve program practices resulting in appropriate improvements in student achievement and learning.

“... throughout the institution to … ensure students the opportunity to achieve outcomes in areas of institutional core competencies. “

Program Review at Citrus College web page

Data are foundational to resource requests (faculty, technology, facilities).

• Budget request process

• From annual program review

SLO ASSESSMENT RESULTS:

“Upon reflection with program colleagues, please describe results or faculty recommendations for changes and/or continuations relevant at both the course and program level.”

* Annual program review template

Position Discuss Goals and SLOs

Impact Priority

Equip. Discuss Goals and SLOs

Impact Priority

Assessment data drive institutional planning and resource allocation.

• Program Review Recommendation

from Comprehensive Program Review

Regarding discretionary funds in the unrestricted general fund …

“allocate resources linked to program review and strategic planning. The resource allocation processes follow the college’s institutional goals and will be budgeted as established in the integrated planning manual*.”

From budget assumptions

* Integrated planning manual draft

Impact

Action/Activity Target Date Resp. person

FNIC Facilities Software Equip Personnel Other

Resource requests flow from assessment to program review to resource allocation process.

Integrated Planning key.

SLO (all areas) Assessment Program Review

Program Review (annual and comprehensive)

Resource Allocation

Plan Implementation

Assessment of Institutional Plans

Program Improvement

Monterey Peninsula College Planning and Resource Allocation Process

1. Planning 3-year Institutional Annual Area

2. Program Review 6-year Cycle Annual Report with Action Plans

3. Institutional Review Administration Faculty-led advisory groups

4. Resource Allocation Infrastructure Equipment Personnel

5. Evaluation Institutional Area

Monterey Peninsula College Planning and Resource Allocation Process

1. Planning 3-year Institutional Annual Area

2. Program Review 6-year Cycle Annual Report with Action Plans

3. Institutional Review Administration Faculty-led advisory groups

4. Resource Allocation Infrastructure Equipment Personnel

5. Evaluation Institutional Area

SLOs live here

Data drivenDialog

2. Program Review 6-year Cycle Annual Report with Action Plans

Instructor Reflections on Student Learning

Program Reflections on Student Learning

These Forms/Processes are the Heart of MPC’s SLO Efforts.They are designed to prompt

Dialog Collaboration Improvement Efforts Action Plan Rationale

Code word for SLO

1. Instructor Reflections on

Student Learning

2. Program Reflections on

Student Learning 3. Action Plans

Instructor Reflections …

…leads to…

Program Reflections …

…Two hours during each flex day…

…leads to…

…Annual Report / Action Plans

PRSL = SLO

2. Program Review 6-year Cycle Annual Report with Action Plans

From the Student Learning Section…

And then…

And then…

And finally…

SLOs are fully integrated into the 6-year program review guidelines

At MPC, Student Learning Outcomes are The heart of dialog during flex activities Cited as rational for action plans Well integrated into the Program Review Process Viewed as the basis for dialog Visited at least once per semester Informing the resource allocation process

Ohlone CollegeUsing SLO Evidence in Planning and

Resource Allocation

Deb Parziale, M.S., Program Review, Student Learning Outcomes & Assessment, and Professional

Development Coordinator

• Course Level – CurricUNET Course Module

– Official Course Outline• Contains Course SLOs• Includes an integrated Course Outline: SLOs matched with

content, assignments, evaluation/assessment

– Plan to add an SLO assessment page to document assessment results and improvements.

– Six year Course Review Cycle

• Course Syllabi contain SLOs

Where is Ohlone’s SLO Evidence?

• General Education– CurricUNET Course Module– Course SLOs, content, assignments, and

evaluation/assessment align with GE outcomes. Rationale statement required.

– GE Committee reviews each GE course & rationale statement. Makes recommendation to Curriculum Committee for approval or not.

– Six year GE Review Cycle (with course review).

• College Catalog

Where is Ohlone’s SLO Evidence?

• Program Level – CurricUNET Program Review

• Program Student Learning Outcomes– Broad measurable statements of the knowledge, skills, abilities, and

attitudes a student will have learned upon completion of a cluster of courses - the program.

• Program Student Achievement Outcomes– Consist of a series of measures including course completion, course

retention, persistence, program completion, degree and certificates awarded, graduates' transfer rates, & other.

– Data generated by the Ohlone College Research Office.• SLO Matrix

Where is Ohlone’s SLO Evidence?

• President’s Task Force formed Fall 2008 - Developed plans to link program review directly with Institutional Planning and Resource Allocation

• CurricUNET Program Review Task Force formed - Developed and piloted the CurricUNET Program Review Module

• Programs and Services defined by Activity Center Codes (same as TOP Codes)

Integration of SLOs with Planning & Resource Allocation

• Program Description and Scope

• College Mission: –How program supports:

–College mission, vision, & values–College goals & objectives

CurricUNET Program Review

Broad measurable statements of the knowledge, skills, abilities, and attitudes a student will have learned upon completion of a cluster of courses - the program.

Assessment includes a summary of assessment results from course SLOs.

PSLO & Assessment

• Alignment between courses & programs• Focuses on program coherence• Maps course SLOs, content, assignments, and

evaluation to program SLOs

SLO Matrix

• Analyze the matrix. Sample questions to consider:• Are all program SLOs addressed within the courses? Are

course and program SLOs correlated?• Do some courses not address any of the PSLOS? If not, assess

why.• Does the program progress from simple to more complex?• Are some courses out-of-date and thus not taught anymore?• Are there any stand alone courses? How do they impact the

program?

Include results of this analysis in the SLO & Assessment page.

SLO Matrix Assessment

• Number of students who obtain a Certificate of Completion in Photography.

• Percentage of students who enter the program will meet all requirements for the transfer Associate Degree in Art.

• Number of students in an occupational program who secure an internship/job.

Student Achievement Example Outcomes

• Analyze trends in student achievement over time.• Assess how these trends relate to college goals

and objectives. • Analyze programs use of resources: budget, staff,

equipment, technology, facility, other. Comment on how the program can best use these resources to promote student learning.

• Consider improvements that could be made to promote student learning/success.

Student Achievement Assessment

Analyze and summarize results of the SLO and student achievement assessments.

• Describe program achievements and successes. Celebrate!!

• Describe and prioritize areas for improvement. This information is used to develop Program Improvement Objectives (PIOs).

Program Analysis

• PIO: What, Why, Measurable• Action Plan: How• Resources Needed

– Staffing– Equipment– Technology– Facilities– Other

• Assessment Plan for PIO• Justification: Relation to College goal(s) & objective(s),

impact beyond department, contribution to student success/learning.

Program Improvement Objectives (PIOs) Focus on Student Success!

• Physics: Stimulate and expand students’ scientific insight and imagination by enhancing individual exposure to physical phenomena, process and experiments.

• Includes Action Plan, Resource Requests, Assessment Plan and Rationale for request also included

PIO Statement Example

PIO Assessment

• Analysis of PIO assessment results and use of resources

• How was student learning or success improved

• Current status of PIO

Compiles all PIOs into a searchable data base.• This information is exported into an Excel

spread sheet and is used in the PIO prioritization process.

• All PIOs are included on master list and PIOs can be separated out by program.

• Allows the College to collate, analyze and utilize the PIOs in a variety of ways.

PIO Reporting Tool

• PIOs reviewed by the College Council to identify any college-wide planning implications with regard to priorities in the existing College goals and objectives or the need to dialogue about new goals and objectives.

• PIOs reviewed to inform annual budget allocation decisions.

Use Of PIOs

• Deans and directors use the PIOs as the basis of their dialogue with the Vice President of Administrative Services and the Dean of Financial Services when they meet to plan program/department level budgets.

• Various groups use the PIOs as a guide for the expenditure of existing resources and for grant development.

• A budget analysis team, with representatives from Human Resources, Information Technology, Campus Facilities, Business Services, and College Council, examines PIOs that have budget implications. Using the rubric developed for resource allocation prioritization in the annual planning cycle, this group identifies the top priorities for possible budget allocation and reports their recommendations to the College Council for consideration and approval.

PIOs – Inform Annual Budget Allocation Decisions

• Reviewed by a Task Force of the College Council to identify any college-wide planning implications with regard to priorities in the existing College goals and objectives or the need to dialogue about new goals and objectives.

• Reviewed to inform annual budget allocation decisions.

Use Of PIOs

• Ongoing Annual Program Review time line aligned with college budget process

• PIOs written, updated, assessed annually• Prioritized by Program faculty Deans

AVPs/VPs PIO Committee Resource Allocation, Facilities, Technology Committees and Faculty Senate Budget CommitteeCollege President/Board

• PIO Prioritization Rubric

PIO Resource Allocation Process

• Beginning with the 2011-12 academic year:• Program SLOs and Student Achievements will be

assessed annually – Following the program’s assessment plan

• PIOs will be assessed annually – On a time schedule that lines up with the college

budget planning schedule– PIOs can be deleted, revised, or added as needed

maintaining the key focus of promoting student success

Annual Process

“Though accountability matters, learning still matters

most.”

Tom Angelo (1999), former Director,American Association for Higher Education Assessment

Forum.