1

GETTING STARTED WITH GETTING STARTED WITH ASSESSMENTASSESSMENT

Barbara PennipedeBarbara Pennipede

Associate Director of AssessmentAssociate Director of Assessment

Office of Planning, Assessment and ResearchOffice of Planning, Assessment and Research

March 2002March 2002

2

WORKSHOP TOPICSWORKSHOP TOPICS

What is assessment?What is assessment? Why is assessment important to Pace Why is assessment important to Pace

University?University? Why assessment in Administrative and Why assessment in Administrative and

Educational Support Units (AES)Educational Support Units (AES) Steps in developing an assessment plan for Steps in developing an assessment plan for

your unit.your unit.

3

What is assessment?What is assessment?

ASSESS (V): TO EXAMINE CAREFULLYASSESS (V): TO EXAMINE CAREFULLY

““Assessment is the systematic collection, Assessment is the systematic collection, review and use of information about review and use of information about educational programs undertaken for the educational programs undertaken for the purpose of improving student learning and purpose of improving student learning and development.” ( Marchese 1987)development.” ( Marchese 1987)

4

The Importance of Assessment to The Importance of Assessment to Pace UniversityPace University

To improve the effects of teaching on To improve the effects of teaching on student learning and developmentstudent learning and development

To examine and enhance institutional To examine and enhance institutional effectivenesseffectiveness

To advance the reputation and image of To advance the reputation and image of Pace through the quality of its programsPace through the quality of its programs

5

The Importance of Assessment to The Importance of Assessment to Pace UniversityPace University

To attract and retain qualified studentsTo attract and retain qualified students To maintain and strengthen its standing To maintain and strengthen its standing

among its competitors among its competitors To satisfy the requirements of accrediting To satisfy the requirements of accrediting

agenciesagencies

6

Statement by the Middle States Statement by the Middle States CommissionCommission

An accredited institution is characterized by:An accredited institution is characterized by:

Linkage of outcomes assessment to the Linkage of outcomes assessment to the institution’s ongoing planning and resource institution’s ongoing planning and resource allocation process and to strategic efforts to allocation process and to strategic efforts to improve institutional quality.improve institutional quality.

7

Why Assessment in Why Assessment in Administrative and Education Administrative and Education

Support Units?Support Units?

To know if we are offering the right To know if we are offering the right services and how well we are services and how well we are providing themproviding them

8

Reasons Often CitedReasons Often Cited

Effective linking of AES services to Effective linking of AES services to academic programsacademic programs

Accreditation requirementsAccreditation requirements Continuous quality improvementContinuous quality improvement Institutional effectivenessInstitutional effectiveness

9

Administrative and Education Administrative and Education Support Units Support Units

AdministrativeAdministrative

Provide services Provide services which maintain the which maintain the institutioninstitution

Are essential to its Are essential to its operationsoperations

No direct impact on No direct impact on instructional programsinstructional programs

Educational SupportEducational Support

May not be primarily May not be primarily instructional or instructional or academicacademic

Contributes directly to Contributes directly to student learning or student learning or instructioninstruction

10

Underlying Assumptions for Underlying Assumptions for Assessment in AESAssessment in AES

The primary aim of assessment is the The primary aim of assessment is the continuous improvement of campus continuous improvement of campus operations, especially as they support and operations, especially as they support and promote the University’s teaching and promote the University’s teaching and learning environmentlearning environment

Assessment is to be embedded as part of the Assessment is to be embedded as part of the normal order of businessnormal order of business

Assessment will be a cyclic process and an Assessment will be a cyclic process and an ongoing unit or programmatic activity.ongoing unit or programmatic activity.

11

Steps for Assessment ProcessSteps for Assessment Process Establish a linkage to the University’s Mission Establish a linkage to the University’s Mission

and Goalsand Goals Prepare the Unit Mission StatementPrepare the Unit Mission Statement Formulate Measurable ObjectivesFormulate Measurable Objectives Identify Activities and Strategies to Achieve Identify Activities and Strategies to Achieve

Objectives Objectives Identify Unit Means of Assessment and Criteria Identify Unit Means of Assessment and Criteria

for Successfor Success Conduct Assessment ActivitiesConduct Assessment Activities Document use of Results for Service Document use of Results for Service

ImprovementsImprovements

12

The Pace The Pace UniversityUniversity Mission Mission StatementStatement

“ “In keeping with its motto, In keeping with its motto, Opportunitas,Opportunitas, Pace Pace University offers qualified students the opportunity to University offers qualified students the opportunity to discover and fulfill their potential. At Pace, supportive discover and fulfill their potential. At Pace, supportive and challenging programs prepare graduates for and challenging programs prepare graduates for meaningful lives and successful careers in a rapidly meaningful lives and successful careers in a rapidly changing world. The University’s commitments changing world. The University’s commitments combine respect for traditional academic values with combine respect for traditional academic values with readiness to meet the challenges of the future with readiness to meet the challenges of the future with energy and innovation.”energy and innovation.”

13

Pace Mission Statement Core Pace Mission Statement Core ValuesValues

Giving highest priority to teaching and Giving highest priority to teaching and learninglearning

Placing the liberal arts and sciences at the Placing the liberal arts and sciences at the center of undergraduate educationcenter of undergraduate education

Stressing critical thinking, communication, Stressing critical thinking, communication, and technological competence as essential and technological competence as essential skillsskills

Fostering intellectual growth, ethical Fostering intellectual growth, ethical maturity, and civic responsibilitymaturity, and civic responsibility

14

Core Values continued…Core Values continued…

Balancing theory with practical applicationsBalancing theory with practical applications Responding to the individual needs of an Responding to the individual needs of an

increasingly diverse society and global increasingly diverse society and global economyeconomy

Preparing students for an increasingly Preparing students for an increasingly diverse society and global economydiverse society and global economy

Emphasizing service as an integral part of Emphasizing service as an integral part of teaching and life-long learningteaching and life-long learning

15

Pace Mission Statement Pace Mission Statement CommitmentsCommitments

Access and opportunity for qualified Access and opportunity for qualified students of diverse backgroundsstudents of diverse backgrounds

Maintaining collegiality and the free Maintaining collegiality and the free exchange of ideasexchange of ideas

Engaging students actively in the learning Engaging students actively in the learning processprocess

Involving students and faculty in decision-Involving students and faculty in decision-makingmaking

16

Pace Mission Statement Pace Mission Statement Commitments continued…Commitments continued…

Managing the University responsively, Managing the University responsively, effectively, and with financial responsibilityeffectively, and with financial responsibility

Providing an excellent, affordable private Providing an excellent, affordable private educationeducation

Continuing experimentation in the use of Continuing experimentation in the use of new technologies to support more effective new technologies to support more effective teaching and extend educational teaching and extend educational opportunitiesopportunities

17

Pace Mission StatementPace Mission Statement

““Our assets, values, and commitments Our assets, values, and commitments enable us to further individual opportunities enable us to further individual opportunities to learn, teach, and expand knowledge. to learn, teach, and expand knowledge. Thus, Pace University continues to embody Thus, Pace University continues to embody OpportunitasOpportunitas, renewing this theme for new , renewing this theme for new generations to whom we offer an education generations to whom we offer an education focused on student achievement and the focused on student achievement and the promotion of patterns of living and learning promotion of patterns of living and learning that will enlighten and endure.”that will enlighten and endure.”

18

Characteristics of Unit Mission Characteristics of Unit Mission StatementStatement

Describes the purpose of the unit, services Describes the purpose of the unit, services and clientsand clients

Is brief in lengthIs brief in length Provides linkage to and support of Provides linkage to and support of

University mission and goalsUniversity mission and goals Is understood and accepted by employees Is understood and accepted by employees

within the unitwithin the unit

19

Examples of AES Mission Examples of AES Mission StatementsStatements

Career CenterCareer Center

LibraryLibrary

Accounting OfficeAccounting Office

20

Formulate AES ObjectivesFormulate AES Objectives

Purpose of objectives:Purpose of objectives:

* support the Unit’s mission statement* support the Unit’s mission statement

* provide the linkage to the means of * provide the linkage to the means of

assessmentassessment

21

Types of AES ObjectivesTypes of AES Objectives

Process OrientedProcess Oriented

Volume of unit activityVolume of unit activity

EfficiencyEfficiency

ComplianceCompliance

Outcomes OrientedOutcomes Oriented

EffectivenessEffectiveness

Attitudinal OrientedAttitudinal Oriented

SatisfactionSatisfaction

What unit intends to What unit intends to accomplishaccomplish

What clients are able to do What clients are able to do after receiving AES servicesafter receiving AES services

How satisfied are clients with How satisfied are clients with AES servicesAES services

22

Formulating Unit Administrative Formulating Unit Administrative ObjectivesObjectives

Administrative Objectives should be:Administrative Objectives should be: Linked to the Unit Mission StatementLinked to the Unit Mission Statement RealisticRealistic Limited in numberLimited in number MeasurableMeasurable

23

Choosing the Short List of Choosing the Short List of Administrative ObjectivesAdministrative Objectives

Administrative Objectives initially chosen Administrative Objectives initially chosen should be: should be:

Targeted on those areas that can be Targeted on those areas that can be improved using currently available improved using currently available resources and personnelresources and personnel

Related to the services the unit providesRelated to the services the unit provides Relatively easy to assess within one cycleRelatively easy to assess within one cycle Directly under the control of the AES unitDirectly under the control of the AES unit

24

Identifying the Means of Identifying the Means of AssessmentAssessment

““When” will assessment activities take place?When” will assessment activities take place? Where will we find information that will reflect Where will we find information that will reflect

accomplishment of our objective?accomplishment of our objective? Exactly “How” will the assessment be Exactly “How” will the assessment be

accomplished?accomplished? ““How well” should the unit perform on the means How well” should the unit perform on the means

of assessment identified, if the unit is functioning of assessment identified, if the unit is functioning the way it should?the way it should?

25

Common Assessment ActivitiesCommon Assessment Activities

Client satisfaction measuresClient satisfaction measures Direct countsDirect counts Results of external evaluationResults of external evaluation Outcome measuresOutcome measures

26

Unit Criteria of SuccessUnit Criteria of Success

Identify a reasonable level of service Identify a reasonable level of service improvement to expect given the resources improvement to expect given the resources and personnel of the unitand personnel of the unit

Set performance levels as reference points Set performance levels as reference points or benchmarksor benchmarks

Select a percentage of improvement for its Select a percentage of improvement for its servicesservices

Use peer institutions who provide the same Use peer institutions who provide the same service to help identifyservice to help identify

27

Use of Results for Service Use of Results for Service ImprovementImprovement

Changes in organizational structureChanges in organizational structure Changes in process proceduresChanges in process procedures Relations with the constituenciesRelations with the constituencies Changes in assessment proceduresChanges in assessment procedures Changes to comply with regulatory Changes to comply with regulatory

requirementsrequirements Internal resource reallocationInternal resource reallocation Justification for additional resourcesJustification for additional resources