Getting Started. Decide which type of assessment –Input assessment –Process assessment...

33
Getting Started

Transcript of Getting Started. Decide which type of assessment –Input assessment –Process assessment...

Page 1: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Getting Started

Page 2: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Getting Started

• Decide which type of assessment– Input assessment – Process assessment – Outcomes assessment– Impact assessment

Page 3: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Input Assessment Questions

• Who are our students?– Demographics– Attitudes– Skills– Knowledge

• What do they need in the way of programs and services?

Page 4: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Process Assessment Questions

• Visibility: Do students know about us?

• Importance/Need: Do students want/need our services?

• Use: Do students use our services?

• Satisfaction/Reaction: What do students think of the services and programs we provide?

Page 5: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

D

Program/Service Are you aware of this service?

How important is this service to you?

Have you used this service?

How satisfied are you with this program?

Yes No Not at all

Some-what

Very Important

Yes No Dissatisfied Neutral Satisfied

Academic Advising

Counseling Services

Health Education

Financial Aid Services

Recreational Sports

Learning Support Center

Dean of Students

Residential Life

Process Assessment Template

Page 6: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Outcomes Assessment Questions

• What have students learned?

• Who have they become?

Page 7: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Impact Assessment

• Did our program or service make a difference in what students learned or who they became?

• How will we know?

Page 8: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Moving from Strategic Vision

to Measurable Outcomes

Page 9: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Mission Review

• What business are we in?

• What business should we be in?

Page 10: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Why Mission Review?

• To determine purpose

• To respond to changed assumptions

• To clarify values

• To respond to changed capabilities

• To strengthen decision-making

• To conform actuality with aspirations

• To foster institutional change and renewal

Page 11: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Goals

• Goals state what the institution desires to have (inputs), to be (processes) and to become (outcomes).

Page 12: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Goals

• What do we want the result – outcome, process, or input – to be?

• How will we recognize the result when we have it? What are the concrete behaviors?

• What specific evidence are we willing to accept that these concrete behaviors have actually occurred?

Page 13: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Objectives Consist of:

• Desired outcome

• Criteria

• Indicators

• Standards of attainment

Page 14: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Outcome IndicatorsCriteria

To engage insystematicthinking

Develop scientifichypotheses

Write short stories

Invent shortcut fortransmission repair

Written test:Given data

Writes story:Given theme

Hands on performance

Page 15: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Goal Statement

Objective 1 Objective 2 Objective 3

Criterion 1

Indicator 1

Criterion 2

Indicator

Indicator 2

Criterion 1

Indicator

Criterion 2

Indicator 1

Indicator 2

Criterion 1

Indicator

Page 16: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Linking Goals and Objectives to Assessment and Evaluation

Assessment Results Evaluative Judgment Action to be Taken

Information usefulfor decision making.

Actual outcome compared with apre-specified standardfor an intended outcome.

Changes, if any, tobe made in inputs and processes on basis of evaluation.

Page 17: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Effective Goal Statements

• Begin with the word “To”

• Use verbs that imply action or accomplishment – To construct, To develop

• Use language appropriate to audience

• Include what you want the result to be

Page 18: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Example Goal

• To draw reasonable inferences from observations and logical premises

Page 19: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Effective Objectives

• Begin with the word “To” followed by a verb specifying an action or accomplishment

• Has associated with it one or more observable and therefore assessable results (concrete behavioral criteria)

Page 20: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Effective Objectives

• Identifies a target population

• Specifies or implies a target date for completion

• Identifies one or more indicators (methods of assessment) for its outcome

Page 21: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Effective Objectives

• Has associated with it conditions under which assessment will take place

• Has associated with it one or more standards of attainment for purposes of evaluation

Page 22: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Effective Objectives

• Relates to a specific goal

• Specifies WHAT will be done and WHEN, but not why or how or where

• Relates to a relatively short period of time, typically one year

Page 23: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Effective Objectives

• Is realistic and obtainable

• Specifies the maximum cost allowable

Page 24: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

A Process for Writing Goals and Objectives

• Get the main idea down on paper

• be liberally educated• think critically• have a high standard of ethics• be concerned about important social issues• have good communications skills

Page 25: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

A Process for Writing Goals and Objectives

• Identify concrete behavioral expressions of the outcome

1. What evidence would you be willing to accept?

2. What distinguishes people who have the characteristic from those who do not?

3. What instructions would you give to someone else who had to recognize the outcome?

Page 26: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Example

Outcome: be liberally educated

Concrete behaviors:knows a lotenjoys good booksis articulatetakes leadership roles in the communityunderstands sciencewrites well

Page 27: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

A Process for Writing Goals and Objectives

• Clean up the language used in Step 2• Delete duplications and choose the one statement that best

represents your intent

• Cross out behaviors that do not represent behaviors or conditions

• Eliminate statements that are not behaviors

Page 28: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Example

Outcome: be liberally educated

Concrete behaviors:uses the libraryreads the Great Booksowns a public library cardwrites book reviews for the campus newspaperreads few mass market gothic novels

Page 29: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

A Process for Writing Goals and Objectives

• Write complete sentences to describe each outcome

Concrete behaviors:uses the library = borrows each semester at least ten books from the college library

writes book reviews for the campus newspaper =has had accepted for publication by the campus newspaper during the last year one or more book reviews.

Page 30: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

A Process for Writing Goals and Objectives

• Check for completeness of goal description

• Does this series of concrete behaviors adequately describe the goal?

• If these behaviors or conditions are present, are you willing to accept that the goal has been achieved?

Page 31: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

ExamplesGoal: To graduate seniors who are all prepared for productive roles in society, both as effective participantsleaders.

Objective 1: To graduate students who have well developedhigher-order cognitive skills.

Objective 2: To graduate students who developed an activeawareness of their natural environment

Objective 3: To graduate students who have developed an awareness of themselves

Page 32: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Examples

• See Goal Objective Example

Page 33: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Small Group Exercise

Use Goal Objective Template