Impact of Quality Matters Professional Development on ... · Professional Development on Course...
Transcript of Impact of Quality Matters Professional Development on ... · Professional Development on Course...
![Page 1: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/1.jpg)
Impact of Quality Matters Professional Development on Course Design and Student Evaluations
Ginu EasowInstructional Designer, Quality Matters Coordinator
![Page 2: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/2.jpg)
At UNCW
![Page 3: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/3.jpg)
Research Question(s)
![Page 4: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/4.jpg)
Research Questions
1) Does QM professional development have an impact on course design?
2) What types of changes do instructors report as a result of developing expertise with the QM approach?
3) What is the actual impact of course redesign on student evaluations?
![Page 5: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/5.jpg)
Research Design
![Page 6: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/6.jpg)
Participants
• 65 potential participants
• 15 peer review
• 6 viable participant
• 3 final participants
![Page 7: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/7.jpg)
Exploratory Case Study
Application of QM workshop to course design
Course design
1 2 3
![Page 8: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/8.jpg)
Data Collection
Content Analysis
![Page 9: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/9.jpg)
Quick Check!
![Page 10: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/10.jpg)
![Page 11: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/11.jpg)
![Page 12: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/12.jpg)
Quality Matters Clusters
Eight QM Clusters 1. Clarity of Purpose2. Ease of Use 3. Course Alignment 4. Learner Engagement 5. Accessibility Standards6. Knowledge Acquisition 7. Compliance8. Learner Support
Legon, R. (2015). Measuring the impact of the Quality Matters Rubric: A discussion of possibilities. American Journal of Distance Education, 29(3), 166-173.
![Page 13: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/13.jpg)
Quality Matters Clusters
Learner Support QM Specific Standards
1.8 Self-introduction1.9 Learner introduction3.5 Opportunity to track progress5.2 Active learning6.2 Tools promote engagement6.3 Variety of technology
![Page 14: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/14.jpg)
Cluster Index
Cluster Index=Initial Cluster Score ÷ Cluster Score Post Revision
![Page 15: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/15.jpg)
Data Collection
Instructor interviews
Content Analysis
Student Evaluations
![Page 16: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/16.jpg)
What We Found?
![Page 17: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/17.jpg)
“. . . gives you a little more clarity, understanding how the course looks from the student point of view and tweaking it to make it clearer. My goal is to get almost no emails about little confused things, confusing about the assignment . . .”
Course One Findings
Spring 2015 Spring 2016 Spring 2017
![Page 18: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/18.jpg)
Course One Findings
![Page 19: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/19.jpg)
Course One Findings
2015 - “I feel that this course is definitely in need of some streamlining. The assignments were listed in an illogical, unnecessarily complicated way.”
2017 -“[Professor] has done an excellent job designing this course. . . ”
![Page 20: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/20.jpg)
“. . . I made some changes that I can make quickly before a ... you know, I don't particularly like to make huge changes right before a semester. But if I have time, I'll change what I can. I typically, when I redo bigger courses, or need to do a larger overhaul, I'll do it during the summer.”
Course Two Findings
Spring 2017 Spring 2018 Fall 2018
![Page 21: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/21.jpg)
Course Two Findings
![Page 22: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/22.jpg)
Course Two Findings
Spring 2017 - “I appreciate the clarity and the depth with which he teaches
Spring 2018 - “. . . always responding to emails and questions in a timely manner.”
![Page 23: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/23.jpg)
“It's just forced me, I think, to really think of ways to meet those requirements, those kind of transparent things, but also not make it too, frankly, off-putting. In doing that, I think it's forced me to reexamine what I teach and how I teach because I've been doing it for a really, really, really long time, so in that sense, it was nice to get a refresh. . . .”
Course Three Findings
Spring 2017 Fall 2017 Fall 2018
![Page 24: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/24.jpg)
Course Three Findings
![Page 25: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/25.jpg)
Course Three Findings
Spring 2017 - “Communicates well and responds to emails quickly.”
Fall 2018 - “. . . was very organized and helpful throughout the course.”
![Page 26: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/26.jpg)
Conclusions
![Page 27: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/27.jpg)
Our Findings
Does QM professional development workshops have an impact on course design?
• Ease of Use, Learner Engagement, and Learner Support• Minimal changes to Knowledge Acquisition
What types of changes do instructors report as a result of developing expertise with the QM approach?
• QM revisions not directly linked to student evaluations • No patterns among courses with student evaluations• Qualitative data from Student Evaluations referenced instructor social
presence
How does course redesign impact student evaluations?
![Page 28: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/28.jpg)
Limitations
![Page 29: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/29.jpg)
Exploratory case study-Small sample
Natural disaster
Student evaluation classification to QM clusters
Limitations
![Page 30: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/30.jpg)
Next Steps
![Page 31: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/31.jpg)
Next Steps
Expand current study
Application of QM workshop to course design
Course design
75 potential faculty
![Page 32: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/32.jpg)
Next Steps
Incorporate Community of Inquiry (CoI) into research study
Cognitive Presence
Teaching Presence
Social Presence
![Page 33: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/33.jpg)
Next Steps
QM Research aligning with student outcomes
![Page 34: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/34.jpg)
Questions
![Page 35: Impact of Quality Matters Professional Development on ... · Professional Development on Course Design and Student Evaluations Ginu Easow ... Moving beyond smile sheets: A case study](https://reader033.fdocuments.us/reader033/viewer/2022050301/5f6ad75f022b9d66763e7553/html5/thumbnails/35.jpg)
Brinkley-Etzkorn, K. E. (2018). Learning to teach online: Measuring the influence of faculty development training on teaching effectiveness through a TPACK lens. The Internet in Higher Education, 38, 28-35.
Chen, K., Lowenthal, P. R., Bauer, C., Heaps, A., & Nielson, C. (2017). Moving beyond smile sheets: A case study on the evaluation and iterative improvement of an online faculty development program. Online Learning, 21(1), 85-111.
Kearns, L., & Mancilla, R. (2017). The impact of Quality Matters professional development on teaching across delivery formats. American Journal of Distance Education, 31(3), 185-197.
Legon, R. (2015). Measuring the impact of the Quality Matters Rubric: A discussion of possibilities. American Journal of Distance Education, 29(3), 166-173.
Roehrs, C., Wang, L., & Kendrick, D. (2013). Preparing faculty to use the Quality Matters model for course improvement. Journal of Online Learning and Teaching, 9(1), 52-67.
Shattuck, J., Dubins, B., & Zilberman, D. (2011). MarylandOnline’s interinstitutional project to train higher education adjunct faculty to teach online. International Review of Research in Open and Distance Learning, 12(2), 40-61.
Yang, D. (2017). Instructional strategies and course design for teaching statistics online: Perspectives from online students. International Journal of STEM Education, 4(34), 1-15.