An Uncommon Approach to Common Assessment of General Education

38
An Uncommon Approach to Common Assessment of General Education Audio Options for this Presentation 1. Broadcast audio If you automatically hear the WebCast audio from your headphones or computer speakers after you join the meeting, you can use this option. 2. Telephone (dial-in) audio If you do not automatically hear the WebCast audio, call 1-877-668-4493, enter the access code (663 032 861), followed by the “#” key, and the Attendee ID provided to you, followed by the “#” key. For assistance, please email TaskStream at

description

An Uncommon Approach to Common Assessment of General Education. Audio Options for this Presentation Broadcast audio If you automatically hear the WebCast audio from your headphones or computer speakers after you join the meeting, you can use this option.  Telephone (dial-in) audio - PowerPoint PPT Presentation

Transcript of An Uncommon Approach to Common Assessment of General Education

Page 1: An Uncommon Approach to  Common Assessment of General Education

An Uncommon Approach to Common Assessment of General Education

Audio Options for this Presentation

1. Broadcast audioIf you automatically hear the WebCast audio from your headphones or computer speakers after you jointhe meeting, you can use this option.

2. Telephone (dial-in) audio If you do not automatically hear the WebCast audio, call 1-877-668-4493, enter the access code (663 032 861), followed by the “#” key, and the Attendee ID provided to you, followed by the “#” key.

For assistance, please email TaskStream at [email protected] or call 1-800-311-5656 and press #1 for support.

Page 2: An Uncommon Approach to  Common Assessment of General Education

Housekeeping

Participants See the names of all Panelists, not Attendees You’re not alone!

Chat Report technical issues Ask the presenters questions about

the content Send messages to “All Panelists”

If you still need assistance, you can also email TaskStream at [email protected] or call 1-800-311-5656 and press #1 for support.

Page 3: An Uncommon Approach to  Common Assessment of General Education

OCTOBER

An Uncommon Approach to Common Assessment of General Education

Jeanne Butler, Ph.D., Director of AssessmentDaren Snider, Ph.D., Director of General Studies

University of Nebraska Kearney

Page 4: An Uncommon Approach to  Common Assessment of General Education

Meet the Presenters

Jeanne Butler Director of Assessment at UNK since 2004 Former faculty member at Boston

University, University of Southern California and Western Governors University

Daren Snider Director of General Studies at UNK since 2006 Associate professor of modern languages Also taught at Skidmore College and BYU

Page 5: An Uncommon Approach to  Common Assessment of General Education

Document learning outcomes Align goals and outcomes Build curriculum maps Create assessment plans Collect program-level data

Assess learning outcomes Manage electronic portfolios Score rubrics Analyze student performance Collect student-level data

Page 6: An Uncommon Approach to  Common Assessment of General Education

Presentation Overview University of Nebraska Kearney Renewing General Education Challenges for GE Renewal Lessons Learned Next Steps Questions

Page 7: An Uncommon Approach to  Common Assessment of General Education

University of Nebraska KearneyRanked as a Top 10 Public Midwest Regional University by U.S. News & World Report Student/faculty ratio of 16 to 1 99% of full-time faculty teach

undergraduate courses.

7,100 students enrolled in: 170 undergraduate majors 25 pre-professional programs 34 graduate programs

Page 8: An Uncommon Approach to  Common Assessment of General Education

2010-2013

2010

2005-2008

2004

No assessment of GE taking place

HLC accreditation visit

GE assessment at the department level

Survey of student and faculty perceptions of GE

HLC visit focused on assessment

Common assignments and rubrics used to assess learning outcomes in the new GE program

Selected TaskStream to facilitate work

Phased implementation of common assessments

The New General Education Program

Page 9: An Uncommon Approach to  Common Assessment of General Education

2004 Accreditation Visit Feedback

Areas for improvement: Infrastructure to Support Assessment Faculty Commitment to Assessment Recognition of Exemplary Assessment Assessment Process Sustainability GE Program Assessment

Page 10: An Uncommon Approach to  Common Assessment of General Education

Faculty and Student SurveysSurveys in 2005 and 2006

Areas for improvement: Lack of clarity in the purpose

and goals of the program Lack of student/faculty

understanding of the program Lack of coherence in the

program

Both students and faculty wanted changes in the program.

Page 11: An Uncommon Approach to  Common Assessment of General Education

2008 Accreditation Visit Feedback

Feedback showed the program needed: Common GE learning outcomes across the university Common assessment measures Standard rubrics for evaluation Coherent, purposeful curriculum

Status report on implementation of the new General Education program requested for 2011

Page 12: An Uncommon Approach to  Common Assessment of General Education

Challenges for GE Renewal

Logistical and financial support Structure of the new program Common assessment assignments Common rubrics Support of the faculty and students

Page 13: An Uncommon Approach to  Common Assessment of General Education

Logistical and Financial Challenges

Analysis of large volumes of data Course, division, and program level data analysis Longitudinal data analysis Financial options

Page 14: An Uncommon Approach to  Common Assessment of General Education

Structure of the New GE ProgramCapstone

Distribution

Portal

Foundational Core

Page 15: An Uncommon Approach to  Common Assessment of General Education

Portal Course (3 hours) Purpose:

– Help students become intentional learners– Analyze critical issues confronting individuals/society– Strengthen critical thinking– Mentor through the process of analyzing, articulating

own conclusions Features:

– Includes “global perspective”– Emphasizes writing

Page 16: An Uncommon Approach to  Common Assessment of General Education

Capstone Course (3 hours) Features:

– Culmination of the GE experience – Integration of two disciplines– Uses rubric similar to Portal to gauge value added– Students apply knowledge, cognitive abilities, and

communication skills from GE – Students complete an original project (50% of course

grade)

Page 17: An Uncommon Approach to  Common Assessment of General Education

Common Assessment Assignments AAC&U VALUE project Best practices at other universities GE Council approval

Course instructor chooses one of six common assignments

Page 18: An Uncommon Approach to  Common Assessment of General Education

Common Portal Assignments Integrated Summary

– Use selected articles and show critical understanding of the topic within the context of the discipline.

Current Events Analysis– Use theories, concepts, and ideas learned in class to

analyze a current event(s). Controversial Issue Analysis

– Contrast two credible sources to analyze a controversial topic in the discipline.

Page 19: An Uncommon Approach to  Common Assessment of General Education

Common Portal Assignments Research Proposal

– Reflect on the value of a study, then propose a follow-up study to correct weaknesses or further understanding of the topic.

Community Introspection– Analyze the relationship between the topic and relevant

social policies, laws, or practices. Media Analysis

– Analyze different cultural perspectives about an issue as portrayed in media reports.

Page 20: An Uncommon Approach to  Common Assessment of General Education

Option 6: Media AnalysisInstructor selects a topic addressed in the global media community that is relevant to course concepts, issues, or theories.

Students are instructed: Utilizing your textbook and the Internet as resources, your task is to find two different cultural perspectives as indicated by media reports about (chosen topic).

You will conduct a web search for the topic and find relevant, reliable media reports that represent different cultural perspectives surrounding the target issue. Compare and contrast how different cultural perspectives describe the topic, then critically apply course concepts to highlight how the academic community in our culture understands the issue. Your media analysis should be 2- 3 pages double-spaced (not including title or reference page) and should be written in a style appropriate to the discipline.

Page 21: An Uncommon Approach to  Common Assessment of General Education

Common Rubrics AAC&U VALUE Rubrics adapted to fit our outcomes Rubrics approved by faculty Rubrics available in TaskStream

Course instructor is trained on the use of the rubrics

Page 22: An Uncommon Approach to  Common Assessment of General Education

Portal RubricDoes not meet criteria

Beginning Developing Proficient Advanced

Student’s position

No stated position.

Position implied but not stated.

Position stated but is simplistic or obvious.

Position considers complexities of issue.

Synthesizes viewpoints in evaluating complexities.

Content development

No content development.

Uses related content to develop simple ideas in some parts of work.

Uses related content to develop ideas throughout work.

Uses relevant, persuasive content to develop ideas throughout.

Uses relevant/compelling content to convey writer’s understanding.

Evaluate information/sources

No awareness of assumptions.

Shows minimal awareness of assumptions.

Shows emerging awareness of others’ assumptions.

Identifies and questions their own and others’ assumptions.

Thoroughly analyzes their own and others’ assumptions.

Conclusions No stated conclusion.

Conclusion stated and loosely connected to information.

Conclusion tied to information and some related implications.

Conclusion logically tied to information and opposing viewpoints.

Conclusion and implications reflect fully informed evaluation.

Page 23: An Uncommon Approach to  Common Assessment of General Education

Faculty Engagement Faculty participation in roundtables Open communication to all faculty Policy related to use of e-portfolio Orientation/training for all faculty Technical support for faculty Incentives for faculty and departments

Page 24: An Uncommon Approach to  Common Assessment of General Education

Student Engagement

Information on TaskStream requirement for GE in: Admissions packet to all students Flyer at New Student Orientation and on Transfer Student Day All syllabi for GE courses Dedicated website for TaskStream at UNK Technical support for students Article in the student newspaper, The Antelope, on the

TaskStream requirement and how to purchase it

Page 25: An Uncommon Approach to  Common Assessment of General Education

Meeting the Challenges

LAT by TaskStream e-portfolio provides:

Analysis of large volumes of data Course, division, and program level data analysis Longitudinal data analysis Faculty and student use reports Reasonable cost for university-wide application Ease of use for students and faculty Full support for students and faculty

Page 26: An Uncommon Approach to  Common Assessment of General Education

Student Interface

Page 27: An Uncommon Approach to  Common Assessment of General Education
Page 28: An Uncommon Approach to  Common Assessment of General Education

Aggregate Assessment Data

Page 29: An Uncommon Approach to  Common Assessment of General Education

Individual Assessment Results

Page 30: An Uncommon Approach to  Common Assessment of General Education
Page 31: An Uncommon Approach to  Common Assessment of General Education

Accomplishments So Far Fulfilled ongoing accreditation mandates Greater validity in assessment of GE program Campus-wide conversation about learning outcomes Increased clarity about purpose of GE Greater vision about teaching critical thinking Use of e-portfolios across the campus

Page 32: An Uncommon Approach to  Common Assessment of General Education

Lessons Learned Obtain approval at all levels—Provost, Deans, Chairs,

Faculty Establish policies to ensure faculty and student

participation Provide incentives to encourage faculty participation Address resistance immediately to minimize impact Provide frequent/accessible communication Provide adequate orientation/training

Page 33: An Uncommon Approach to  Common Assessment of General Education

Next Steps

Implement common instruments and rubrics Foundational Core

– Written Communication– Oral Communication– Democracy in Perspective

Distribution Courses– Natural Science– Social Science– Fine Arts– Wellness

Page 34: An Uncommon Approach to  Common Assessment of General Education

Challenges for the Future Creating a unified orientation for faculty on TaskStream

and on rubrics from different areas of GE Deciding on sample sizes and rotation schedule Continuing information flow to faculty to ensure

continued participation Setting up access to TaskStream for various levels (chair,

dean, provost, assessment committee, etc.) Deciding how to share the data Motivating students to use TaskStream

Page 35: An Uncommon Approach to  Common Assessment of General Education

Achieving Our MissionTaskStream helps UNK meet our General Education Mission:

The UNK General Education program helps students acquire knowledge and abilities to: understand the world, make connections across disciplines, and contribute to the solution of contemporary problems.

Page 36: An Uncommon Approach to  Common Assessment of General Education

OCTOBER

Questions?

Page 37: An Uncommon Approach to  Common Assessment of General Education

TaskStream Contact Information

For more information about TaskStream or to request a copy of this PPT or a recording of today’s WebCast,

please contact:

[email protected] 1-800-311-5656

Page 38: An Uncommon Approach to  Common Assessment of General Education

Contact Information Jeanne Butler

[email protected]

Daren [email protected]

UNK Assessment website: http://www.unk.edu/academicaffairs/assessment.aspx?id=4323

UNK General Studies website:http://www.unk.edu/academicaffairs/generalstudies.aspx?id=14844