Student Learning Outcomes Workshop
description
Transcript of Student Learning Outcomes Workshop
![Page 1: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/1.jpg)
Student Learning Outcomes Workshop
September 26th, 2007
![Page 2: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/2.jpg)
What is Assessment?
Assessment is the systematic gathering and analysis of information to inform and improve student learning in the context of specific educational goals
![Page 3: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/3.jpg)
Assessment Cycle
Develop Plan
Collect Information
Review Results
Revise Program
![Page 4: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/4.jpg)
Why is assessment necessary?
Demanded by accrediting body
![Page 5: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/5.jpg)
From Middle States: “Assessment of student learning demonstrates that
the institution’s students have knowledge, skills, and competencies consistent with institutional goals and that students at graduation have achieved appropriate higher education goals…In order to carry out meaningful assessment activities,
institutions must articulate statements of expected student learning at the institutional, program, and individual course levels…
Course syllabi or guidelines should include expected learning outcomes…Assessment is not an event but a process and
should be an integral part of the life of the institution”
![Page 6: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/6.jpg)
Why is assessment necessary?
Demanded by accrediting body Want it to be based on internal vs.
external standards Spellings Report/ AAC&U Debate
Feedback for department Accountability to students
![Page 7: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/7.jpg)
Assessment vs. Grading
More informative Details what skills have been attained Gives feedback on how to improve
Absorbs individual differences in evaluation
More focused on long-term retention
Qualitative data is more valued
![Page 8: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/8.jpg)
Assessment steps 1. Develop learning objectives 2. Check for alignment between
curriculum & objectives
3. Develop an assessment plan 4. Collect assessment data 5. Use results to improve the program 6. Routinely examine the assessment
process & correct as needed
![Page 9: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/9.jpg)
Important distinctions:
Mission: broad vision of purposes & values of program
Program goals: broad statement re knowledge, values, & skills acquired through student’s program of study
Learning objectives: operationalize program goals
![Page 10: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/10.jpg)
Example: Psychology Dept. Muhlenberg College Mission Statement: The Psychology Department at Muhlenberg
College is a vibrant department with an active faculty and involved students. Through research and coursework, independent theses and informal interactions, the psychology faculty offer students a superior undergraduate experience and strive to fulfill the mission of the college as well as addressing the goals outlined below.
![Page 11: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/11.jpg)
Psychology Dept. Muhlenberg College: Program Goals: students will…
Know the theories, models, and findings of psychology
Develop effective writing, speaking, and listening skills
Learning Objectives: students can… write a report in APA style make an argument supported by
available evidence and reason
![Page 12: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/12.jpg)
Example: U Arizona Math Dept.
http://math.arizona.edu/resources/headoffice/mission.html
![Page 13: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/13.jpg)
Examples: www.Assessment.gmu.edu/ProgramGoal
s/index.html
Communications: http://www.assessment.gmu.edu/ProgramGoals/CHSS/comm-BA/IGoals.cfm
Economics: http://www.assessment.gmu.edu/ProgramGoals/CHSS/econ-BA/IGoals.cfm
Art History: http://www.assessment.gmu.edu/ProgramGoals/CHSS/arth-BA/IGoals.cfm
![Page 14: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/14.jpg)
1. Defining Learning Objectives
Use active verbs to describe a behavior that demonstrates learning
Identify expected depth of processing
Distinguish between absolute and value-added expectations
![Page 15: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/15.jpg)
Exercise: Learning Objectives
Communications students can… speak more effectively when seeking to inform or
persuade.
analyze material written by others in order to effectively interpret and share that material with an audience.
access the information society including basic procedures for effective research, internet access, and writing.
![Page 16: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/16.jpg)
How to: Top-Down
Look at mission statement
![Page 17: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/17.jpg)
AUP Mission statement
![Page 18: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/18.jpg)
General Education Goals: The goal of an AUP education is
ultimately to nurture the development of individuals to become independent thinkers, adaptable lifelong learners, and active contributors to society. Students are encouraged to translate intellectual endeavor into civic responsibility, and to apply the lessons of history to today’s exigencies and those of the future.
![Page 19: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/19.jpg)
General Education Pillars: I: Knowledge and Perspectives
To (examine the influence) of the written word and other media
To apply methods that describe, predict, and intervene in the natural and social worlds
II: Intellectual skills Speaking & debating effectively in public Working efficiently in teams
III: Contexts IV: Creativity and Production
![Page 20: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/20.jpg)
How to: Bottom-up
Look at catalog, syllabi, assignments, & examinations
![Page 21: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/21.jpg)
How to cont’d Discuss with colleagues the value-
added of studying your discipline Describe ideal graduate of program Ask students, alumni, & employers Look at other departments and/or
professional associations Look at criteria for acceptance into
graduate program
![Page 22: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/22.jpg)
2. Aligning to curriculum
Check whether/when learning objectives are introduced and reinforced
More important learning objectives are introduced earlier
Summative learning objectives are built into senior projects
![Page 23: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/23.jpg)
How to: Alignment
Alignment matrix (example) Helps identify whether courses
and/or learning goals should be adjusted
![Page 24: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/24.jpg)
Course L.O. 1 L.O. 2 L.O. 3 L.O. 4 L.O. 5 L.O. 6
100 I I
120 I P
200 P P P
204 P
300 P P
329 D P
400 P D
480
490 D D D DI = Introduced P = Practiced D = Demonstrated
Example Alignment Matrix
![Page 25: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/25.jpg)
3. Developing an Assessment Plan
Multi-year program Select multiple measures Select sample of students
Start small, with areas most competent in
Annual report as record of ongoing assessment
Assessment plan itself should be continually evaluated
![Page 26: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/26.jpg)
Assessment Plan Matrix
Learning Objective
How aligned in curriculum
How assessed
When/ How often?
![Page 27: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/27.jpg)
Examples:
http://www.oir.uiuc.edu/assessment/plans/english_department.htm
http://programs.weber.edu/assessment/participants/assessment%20plan/physicsap.htm
![Page 28: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/28.jpg)
4. Collect Assessment Data
Want different assessment techniques to triangulate (see handout)
Direct (performance) vs. indirect (perception)
Collecting student work Writing samples @ diff stages, senior projects
Exit & Alumni surveys External evaluators Scoring Rubrics
![Page 29: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/29.jpg)
Analytic Rubric for Grading Oral Presentations
Below Expectation
Satisfactory Exemplary Score
Organization
No apparent organization. Evidence is not used to support assertions. (0-2)
The presentation has a focus and provides some evidence that supports conclusions. (3-5)
The presentation is carefully organized and provides convincing evidence to support conclusions (6-8)
Content The content is inaccurate or overly general (0-2)
The content is generally accurate, but incomplete (5-7)
The content is accurate and complete. (10-13)
Style The speaker appears anxious & uncomfortable… dependent on notes… (0-2)
The speaker is generally relaxed & comfortable, but too often relies on notes.(3-6)
The speaker is relaxed & comf, speaks without depending on notes.(7-9)
Total Score
![Page 30: Student Learning Outcomes Workshop](https://reader036.fdocuments.us/reader036/viewer/2022062806/56814ea8550346895dbc54aa/html5/thumbnails/30.jpg)
Assessment Cycle
Develop Plan
Collect Information
Review Results
Revise Program