Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process...
Transcript of Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process...
![Page 1: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/1.jpg)
Analytics and Gateway Courses:
Andrew K. Koch, Ph.D.Executive Vice President John N. Gardner Institute
Matthew D. Pistilli, Ph.D.Research ScientistPurdue University
Understanding and Overcoming Roadblocks to College Completion
![Page 2: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/2.jpg)
• The problem• Gateway course data – What we have learned
– Foundations of Excellence® institutions – Building and Scaling Analytic Capacity institutions
• Actions to improve institutional performance in gateway courses
• Learner analytics overview• Summary & conclusions• Questions & discussion
Session Overview
![Page 3: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/3.jpg)
• Courses with high rates of unsuccessful outcomes (DFWI rates)– Courses with DFWI rates of 30% or higher– These courses “kill” a student’s GPA, motivation,
academic progress, etc.– Serve as “gatekeeper” to further study and
degree completion
What is your institution’s definition?
Gateway “Killer” Courses
![Page 4: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/4.jpg)
It’s about . . .
• Teaching
• Learning
• Student Support
• Student Performance– Cliff Adelman’s Inside the
Toolbox and Toolbox Revisited
Why Addressing Gateway Course Performance Matters
![Page 5: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/5.jpg)
It’s also about . . .
• Institutional Performance – Performance-Based Funding
• National Well Being– The Completion Agenda
Why else does it matter to you?
Why Addressing Gateway Course Performance Matters
![Page 6: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/6.jpg)
Focus: The institution
Unit of Analysis: The entire first year
Method: Nine Dimensions
Application: Of data to action
Results: Retention and revenue gains (IPEDS data)
Foundations of Excellence®
(FoE) Institutions
![Page 7: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/7.jpg)
Foundations of Excellence® Institutions
![Page 8: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/8.jpg)
• FoE institutions identified – the 5 courses with the highest
enrollment of new students– the number of new students
enrolled in those courses &– the number new students who
receive a D, F, W, or I
• Rate calculated from these numbers
High Enrollment Coursesand DFWI Rates
![Page 9: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/9.jpg)
Average DFWI Rates for Five Highest Enrollment First-Year
![Page 10: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/10.jpg)
Field Number of Courses DFWI RateMath – developmental 71 46Math – college level 12 42English – developmental 25 41History 12 39Sociology 14 37Computer 26 35PE / Health 3 35English – college level 82 35Political Science 7 32Psychology 46 32Biology 8 31FYS/ Success 21 29Speech 19 25
High Enrollment Courses by DFWI Ratesfor 2-Year Institutions
![Page 11: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/11.jpg)
Field Number of Courses DFWI RateEconomics 4 46Accounting/Finance 3 43Math – developmental 23 40Math – college level 48 38History 21 30Biology 18 29Psychology 51 27Chemistry 7 26Political Science 9 25Philosophy 7 24Fine Arts 5 23Sociology 20 22English – college level 105 21 Computer 8 20Health/PE 12 19Speech 26 18FYS/ success 30 15Religion 6 9
High Enrollment Courses by DFWI Ratesfor 4-Year Institutions
![Page 12: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/12.jpg)
Percent of Courses with DFWI rate of 30% or More
Academic Year 2-Year Institutions 4-Year Institutions
2004-2005 70% 32%
2005-2006 69% 30%
2006-2007 80% 36%
2007-2008 62% 25%
2008-2009 63% 51%
2009-2010 71% 27%
Overall 70% 32%
Percentage of High Enrollment Courses that Are High Risk
![Page 13: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/13.jpg)
• Lack of institutional identification of courses
• Students lack of academic preparation (especially in mathematics)
• Inadequate or nonexistent placement procedures
• Late enrollment; missed classes• Faculty grading pattern; lack of
early feedback• Lack of institutional action/plan• Other
Some Anecdotal Reasons for High DFWI Rates
![Page 14: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/14.jpg)
• Inform departments of DFWI rates• Develop departmental action plans to enhance
success in high DFWI courses.• Examine the reasons for high DFWI rates• Develop increased curricular support services
for courses with high DFWI rates
Actions to Address Issues in Gateway Courses
![Page 15: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/15.jpg)
• Provide Supplemental Instruction for courses with high DFWI rates
• Discuss creating more engaging pedagogies as one way to reduce DFWI rates
• Use early warning and/or early intervention (analytics) tools
• Combine all these elements into a coordinated institutional effort
Actions to Address Issues in Gateway Courses
![Page 16: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/16.jpg)
Challenge: How do you find the student at risk?
http://www.youthareawesome.com/wp-content/uploads/2010/10/wheres-waldo1.jpg
![Page 17: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/17.jpg)
http://www.youthareawesome.com/wp-content/uploads/2010/10/wheres-waldo1.jpg
Challenge: How do you find the student at risk?
![Page 18: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/18.jpg)
INTERVENTIONS – ANALYTICS IS THE TOOL FOR ACTIONABLE INTELLIGENCE
Effective use, best practices, what we know…
![Page 19: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/19.jpg)
Data driven best practices• Faculty involvement
– Timing– Early– Frequent
• Up-to-date (cumulative)
Discussing interventions
![Page 20: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/20.jpg)
• Efficacy research– Alter the messages– Provide
• Facts• Advice
– Demonstrate concern – Keep them short – Make them relevant to current course activities
Message Content
![Page 21: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/21.jpg)
• Data in many places, “owned” by many people/organizations
• Different processes, procedures, and regulations depending on data owner
• Everyone can see potential, but all want something slightly different
• Sustainability – “Can’t you just…”– “Can’t s/he just…”
• Faculty participation is essential
Institutional Challenge
![Page 22: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/22.jpg)
• Using data that exists on campus
• Taking advantages of existing programs
• Bringing a “complete picture” beyond academics
• Focusing on the “action” in “actionable intelligence”
New Possibilities
![Page 23: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/23.jpg)
• Actionable intelligence• Moving research to practice• Basis for design, pedagogy,
self-awareness• Changing institutional culture• Understanding the limitations
and risks
Analytics is about...
![Page 24: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/24.jpg)
Myths of Analytics
Analytics is…• a solitary process• a complex set of
algorithms that no one understands
• a process that doesn’t include students
• just a fad. Institutions can ignore using data to make decisions.
![Page 25: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/25.jpg)
Who cares?!? So what?!?
![Page 26: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/26.jpg)
So what?!?
![Page 27: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/27.jpg)
• Student excellence• Institutional excellence• Society at-large
– Enfranchisement– Social mobility– Social justice
• National economic competitiveness• National Completion Agenda
Summing UpSuccess in gateway courses is about:
![Page 28: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/28.jpg)
Feat
ured
Sp
eake
rs
Freeman A. Hrabowski, IIIPresident, University of Maryland, Baltimore County
Katherine J. Denniston Acting Director, Division of Undergraduate Education, National Science Foundation
www.jngi.org/gateway/
![Page 29: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/29.jpg)
Questions and Discussion
![Page 30: Analytics and Gateway Courses - Inside Higher Ed...Analytics Analytics is… • a solitary process • a complex set of algorithms that no one understands • a process that doesn’t](https://reader034.fdocuments.us/reader034/viewer/2022052612/5f0ad0847e708231d42d797e/html5/thumbnails/30.jpg)
Dr. Andrew (Drew) K. KochExecutive Vice PresidentJohn N. Gardner Institute for Excellence in Undergraduate [email protected]
Dr. Matthew D. PistilliResearch ScientistAcademic TechnologiesInformation Technology at PurduePurdue [email protected]
Contact Information
“ ”