ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

18
Ensuring quality and determining effectiveness Tanya Joosten, @tjoosten, [email protected]

description

As many institutions have invested in faculty development programming and understand that it is pivotal to the success of innovation in course designs and academic programming, there is a need to ensure that the products resulting from these efforts are meeting institutional standards of quality for student learning and other outcomes. We have seen an array of mediated forms of learning (hybrid, blended, flipped, online, self-paced, competency-based, MOOCs, and more) being diffused across campuses and systems, and many of us have been asked to provide evidence of the effectiveness of our faculty development programming to ensure the quality of classes and programs. Administrators are looking for an ROI in faculty development as we are seeing decreases in funding, enrollments, and budgets. This presentation will share an approach to ensuring quality and evaluating the effectiveness of faculty development, including the sharing of resources. Outcomes: Learn about a life cycle of ensuring quality in faculty development * Identify steps in a backward-design approach to evaluating the effectiveness of faculty development * Share potential resources to use in future efforts Tuesday, Apr 1st, 2014, 12:15 PM - 12:40 PM, Eastern Time

Transcript of ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Page 1: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Ensuring quality and determining effectivenessTanya Joosten, @tjoosten, [email protected]

Page 2: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

What is success?

CC Flickr katherine.a

Page 3: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Desired results

Higher retention

Better grades

Satisfy students

More Learning

Enhance Engagement

Increase Enrollments

Save Money

Recover Space

Page 4: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Defining success

Define pedagogical

model

Design a faculty development

program

What is “it”

Page 5: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Pedagogical model

Content• Text• Images• Audio• Video

Interactivity• Discussions• Groups• Feedback

Assessment• Written and oral examination• Discursive• Portfolio

Page 6: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

• Ten questions • Designing learning modules• Online vs. F2F - Integration

• Decision rubric for content choices

• Learning objects

Content

• Progressive/summative• Before, during, and after• Self evaluation• Peer evaluation• Student evaluation

Course Evaluation

• Rubrics• CATs• Templates • Traditional formats

Assessment

• Synchronous/asynchronous• Establishing voice• Discussion forums• Small groups

Interactivity

• Managing expectations• Time management• Technology support

Helping Your Students• Staying organized• Managing workload• Avoiding course and a half

Course Management

Course Redesign

Transitioning to online and

blended teaching

Faculty development

Page 7: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Did it work?

Input

• Medium (F2F or Online)

• Instructor demographics

• Discipline• Course level

Process

• Defining pedagogical model

• Designing faculty development program

Output

• Course level• Program and

Institutional level

Page 8: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Course evaluation

Page 9: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Who is your audience?What variables will be

examined?How will the data be collected?

analyzed?How (and where) will the data

be presented?Who will be involved in the

evaluation process?When will the evaluation be

completed?

Evaluation plan

Page 10: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Audience

Page 11: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Input Process OutputStudents Interactivity Students/FacultyDemographics Communication Learning Age Engagement Satisfaction Gender Social Presence Performance Ethnicity Content Student Status Assessment

Course/Institutional Data

Full time/Part time RetentionEmployment Status Drop/Withdrawal RateZip Code Grade Course/Instructor

EvaluationCourse Discipline Course Level Instructor Mode of Delivery

Variables

Page 12: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Collecting

Page 13: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Analyzing

Page 14: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Dissemination

CC Flickr bengray

Page 15: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Resources

CC Flickr Vandy CFT

Page 16: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Timeline

CC Flickr zamboni.andrea

Page 17: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Other considerations…

Page 18: ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session

Contact me @tjoosten, [email protected], tanyajoosten.com

Thanks for listening!