Getting to Know UNO’s Course Evaluation

Instrument and its Use in TABS

Brian McKevittLisa Kelly-Vance

Center for Faculty ExcellenceSept. 10, 2015

Presentation Objectives

◦Attendees will gain an understanding of UNO’s course evaluation instrument, the SEEQ.

◦Attendees will gain familiarity with UNO’s Automated Course Evaluation (ACE) procedures.

◦Attendees will learn about the TABS process.

◦Attendees will know how to schedule a TABS administration and consultation if desired.

UNO’s course evaluation instrument◦ Students’ Evaluation of Educational Quality (SEEQ; Herbert

Marsh)

◦ Extensive research◦ Developed from a variety of sources (e.g., review of other

instruments, interviews with teachers and students)

◦ Over 30 studies that included factor analysis of the SEEQ (1980s - 1990s)

◦Nine consistent factors/dimensions

Nine dimensions of the SEEQ• Dimension 1: Learning

• Dimension 2: Enthusiasm

• Dimension 3: Organization

• Dimension 4: Group Interaction

• Dimension 5: Individual Rapport

• Dimension 6: Breadth

• Dimension 7: Assessment & Evaluation

• Dimension 8: Assignments

• Dimension 9: Course workload/difficulty

How do the questions relate to the dimension?

◦Learning/Value (Items 1-4 on SEEQ)◦Enthusiasm (Items 5-8)◦Organization/Clarity (Items 9-12)◦Group interaction (Items 13-16)◦ Individual rapport (Items 17-20)◦Breadth of coverage (Items 21-24) ◦Examinations/Grading (Assessment & Evaluation; Items 25-

27)◦Assignments/Readings (Items 28-29)◦Workload/Difficulty (Items 32-35)

Categories• Skill related dimensions

• Rapport related dimensions

• Course related dimensions

• Dimension 1: Learning

• Dimension 2: Enthusiasm

• Dimension 3: Organization

• Dimension 4: Group Interaction

• Dimension 5: Individual Rapport

• Dimension 6: Breadth

• Dimension 7: Assessment & Evaluation

• Dimension 8: Assignments

• Dimension 9: Course workload/difficulty

Dimension 1: Learning• http://www.unomaha.edu/aandsaffairs/documents/courseeval/dim01.pdf

Dimension 2: Enthusiasm

Dimension 3: Organization

Dimension 4: Group Interaction

Dimension 5: Individual Rapport

Dimension 6: Breadth

Dimension 7: Assessment and Evaluation

Dimension 8: Assignments

Dimension 9: Course Workload/Difficulty

Summary of results on research of SEEQ ratings• Ratings are multidimensional

• Ratings are relatively valid when compared to other assessments of teaching

• Ratings are reliable, consistent over time

• Ratings are relatively unaffected by potential biases

• slide from Bill Addison PowerPoint “Assessing and Using Student Evaluations of Teaching” (http://www.unomaha.edu/aandsaffairs/tabs/academic/courseeval.php)

Automated Course Evaluation (ACE)◦ Piloted Summer & Fall 2014

◦ Full implementation Spring 2015

◦Questions remain unchanged

◦When the evaluation period opens, emails will notify students that links for each of their courses have been added to their Blackboard account. Reminder e-mails will be sent to the student until every evaluation is completed or the evaluation window has closed (usually 2 weeks).

◦ After final grades have been submitted for the term, faculty gain access to cumulative course evaluation results through their Blackboard accounts.

◦ To increase response rates, faculty may allocate class time to have students complete the evaluations using their personal electronic devices

What is TABS?

• Teaching Analysis By Students• Purpose: identify teaching strengths and

weaknesses• Confidential• Uses the current course evaluation instrument, the

Students’ Evaluation of Educational Quality (SEEQ)• Given mid-semester (weeks 5, 6, or 7)• Free service for all UNO faculty and graduate

teaching assistants

How does it work?• Automated Course Evaluation (ACE) administered for TABS

mid-semester• Faculty member choses which one week window for

students to complete the ACE for TABS• Students receive an email requesting ACE completion, and

a follow-up email if they have not completed it. Faculty member should notify students about the procedure.

• Consultation with TABS consultant after results generated• Review results• Identify strengths and areas for possible improvement• Brainstorm strategies

• Can repeat over several semesters to document progress in teaching

Fall 2015 TABS Windows◦Week 5

◦ Apply by 9/14◦ Online evaluation open 9/21-9/26◦ Report available 9/28

◦Week 6◦ Apply by 9/21◦ Online evaluation open 9/28-10/2◦ Report available 10/5

◦Week 7◦ Apply by 9/28◦ Online evaluation open 10/5-10/9◦ Report available 10/12

Spring 2016 TABS Windows◦Week 5

◦ Apply by 2/1◦ Online evaluation open 2/8-2/12◦ Report available 2/15

◦Week 6◦ Apply by 2/8◦ Online evaluation open 2/15-2/19◦ Report available 2/22

◦Week 7◦ Apply by 2/15◦ Online evaluation open 2/22-2/26◦ Report available 2/29

Did we mention…

• CONFIDENTIAL• NO record of your TABS scores is kept. You may

report in your RPT and/or annual review files if you wish.

• TABS results are NOT put into Digital Measures• Results purged from the UNO system on Dec. 1 for

fall TABS and Jun. 1 for spring TABS• If you want to keep your results, save them as a

PDF (paper copy will be provided by the TABS consultant)

Process◦ If you are interested in scheduling a TABS for your class,

they are only scheduled during the fifth, sixth, or seventh weeks of the semester.

1. Contact the Center for Faculty Excellence (554-2427 or unofacdev@unomaha.edu) to request TABS for your class.

2. Send a course syllabus via email to unofacdev@unomaha.edu.

3. Instructions will be sent to you.4. Have students complete the ACE questionnaire during the

specified time window.**We recommend giving time in class (~15 min) to

complete it**5. Results will be processed and a TABS consultant will

contact you promptly to schedule a meeting.

THANK YOU!

• Brian McKevitt: ASH 347Q, 4-2498, bmckevitt@unomaha.edu

• Lisa Kelly-Vance: ASH 347R, 4-3563, lkelly-vance@unomaha.edu

• for more info:• http://www.unomaha.edu/center-for-faculty-excellence/

programs/tabs.php