ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most...
Transcript of ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most...
![Page 1: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/1.jpg)
ANALYTICS: A 21ST CENTURY TEAM SPORT
Dr. Linda L. Baer9:15-10:00
Tuesday, April 10, 2018
From Distance to Digital Learning: Shaping the Future
![Page 2: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/2.jpg)
![Page 3: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/3.jpg)
What’s your driving question?
![Page 4: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/4.jpg)
![Page 5: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/5.jpg)
http://strongernation.luminafoundation.org/report/2018/#state/LA
![Page 6: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/6.jpg)
AGENDA FOR THE SESSION
• Right Data • Recruiting and Training Skilled Staff• Building the Team • Equipment/Tools/Playbook • Data -> Insight -> Action
![Page 7: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/7.jpg)
21st Century
![Page 8: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/8.jpg)
Targeting the Right Data
![Page 9: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/9.jpg)
Targeting the Right Data
• What are the targets?• What are the data definitions?• What milestones and destination?• Where are the data?• Who can access?
ADMISSONS
STUDENT INFORMATION
SYSTEM
LEARNING MANAGEMENT
SYSTEMS
STUDENT SERVICES
ACADEMIC & CAREER
SERVICES
DATA SOURCES
![Page 10: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/10.jpg)
Analytics in Higher Education: Establishing a Common Language Angela van Barneveld, Kimberly E. Arnold, and John P. Campbell ELI White Paper 2012
http://net.educause.edu/ir/library/pdf/ELI3026.pdf
![Page 11: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/11.jpg)
Analytics: Evolving From Hindsight to Foresight
Gartner Analytics Model retrieved August 15, 2016.http://timoelliott.com/blog/2013/02/gartnerbiemea-2013-part-1-analytics-moves-to-the-core.html
![Page 12: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/12.jpg)
INTERVENTIONS TIMING:Completion by DesignMeasuring Loss and Momentum Points
CONNECTION ENTRY PROGRESS COMPLETION
INTEREST TOAPPLICATION
ENROLLMENT TOCOMPLETION
OF GATEKEEPERCOURSES
COMPLETECOURSE OF
STUDYTO CREDENTIAL
WITH LABORMARKET VALUE
ENTRY INTOCOURSE OF
STUDYTO 75%
REQUIREMENTSCOMPLETED
![Page 13: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/13.jpg)
https://www.naspa.org/images/uploads/main/PREDICTIVE_FULL_4-7-17_DOWNLOAD.pdf
![Page 14: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/14.jpg)
Metrics for Online Success
• Readiness• Engagement• Persistence• Satisfaction
http://www.unc.edu/tlim/ser/
![Page 15: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/15.jpg)
Factors Contributing to Graduate Completion
• Financial Support• Access to and feedback from mentor/advisor• Family Support• Social Environment• Program Quality• Professional/Career Guidance
PH.D. Completion and Attrition by the Council of Graduate Schools 2009http://www.phdcompletion.org/
![Page 16: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/16.jpg)
Recruiting and Training Skilled Staff
![Page 17: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/17.jpg)
EXAMPLE: PEOPLE AND SKILLS
• Mapping goals, assessing skills needed• Created and repurposed positions:
• AVP for Student Success & Analytics• Repurposed counseling positions to retention
and intervention specialists• Hired a director of institutional analytics• Business operation managers with data
background• Results:
• Data people that were also content experts• Cultivated more faculty buy-in
![Page 18: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/18.jpg)
https://www.schoolofdatascience.amsterdam/news/skills-need-become-modern-data-scientist/
![Page 19: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/19.jpg)
Moving to Insight and Action
![Page 20: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/20.jpg)
Improved Processes Improved Outcomes
Understanding Data
Tools for Data Collection
Systems Interoperability
Analytics
Predictive Modeling Data for Research
Data-Driven Decision Making
Streamlined Data Collection
Data ProtocolsGovernance
Use of Institutional Data
BETTER
http://onlinelibrary.wiley.com/doi/10.1111/bjet.12230/full
Big Data Analytics Outcomes
![Page 21: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/21.jpg)
How many interventions do you have?
![Page 22: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/22.jpg)
SOLVING THE INTERVENTION RIDDLE
INTERVENTION TYPES
INTERVENTION OPPORTUNITIES
INTERVENTIONTRIGGERS
![Page 23: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/23.jpg)
INTERVENTION OPPORTUNITIES FOCUSING ON RISKY TARGET GROUPS
1. Academically under-prepared students2. Undeclared/undecided students3. New students (FTIC)4. Adult learners5. Students of color6. Students in transition7. Students on academic probation8. Marginally involved students9. Others
![Page 24: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/24.jpg)
INTERVENTION TRIGGERS: WHY DO STUDENTS LEAVE?
• Goal change or attainment
• Uncertainty of educational/career plan
• Extra-institutional factors, family emergency
• Adjustment/transition difficulties
• Academic difficulty
• Congruence/fit (boredom, dissonance, irrelevance, isolation)
• Finances
![Page 25: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/25.jpg)
INTERVENTION TYPES1. Early identification
2. Continuous monitoring/tracking
3. Proactive/intrusive academic advising/counseling
4. Improve classroom instruction
5. Special interventions, programs, and services
6. Encouragement of affiliation/engagement activities
7. Removal of obstacles/barriers to success
8. Build personal, caring, and supporting relationships
9. Direct contact with individual students based on predictive analytics-based identification of “risky behavior” and/or risky/choices
![Page 26: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/26.jpg)
Building the TeamEnrollment
ManagementPipeline
Admissions
Student Services
Academic Success
Faculty & Advisors
STUDENT SUCCESS
![Page 27: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/27.jpg)
Federated Knowledge:Strategy, Insights, Interests
![Page 28: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/28.jpg)
Metrics Are Easy; Insight is Hard
“In contrast to abundant data, insights are relatively rare. Insights are defined as actionable, data-driven findings that create business value. They are entirely different beast from raw data. Delivering them requires different people, technology, and skills – specifically including deep domain knowledge. And they’re hard to build.” Irfan Kamal
![Page 29: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/29.jpg)
The Analytics Translator
1. Identifying and prioritizing problems that analytics can assist in solving issues
2. Collecting and preparing data to produce most useful insights3. Building the analytics engine to solve in an efficient and
interpretable form4. Validating and deriving business implications—synthesizing complex
analytics insights into easy-to-understand, actionable recommendations
5. Implementing the solution and executing on insights – drives adoption among the users
![Page 30: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/30.jpg)
Using the Right Equipment/Tools/Playbook
![Page 31: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/31.jpg)
Building A Playbook
• Set Goals• Determine Impact • Get the Right People in the Right Positions• Ensure Repeatability• Determine Focus
• Institutional Goals & Policies• Student-Focused Goals
![Page 32: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/32.jpg)
• Admissions consolidated twelve steps for new student entry to four
• Required information sessions for all students to get the overview of programs and their field of study
• Redesigned 300 degree programs to help more students finish on time and be better prepared for employment
• Grouped similar degrees into broad paths or areas of study
• Repurposed & built talent
EXAMPLE: CHANGING THE PLAYBOOK
![Page 33: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/33.jpg)
Where Are You in the Use of Student Success Solution Tools?
![Page 34: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/34.jpg)
![Page 35: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/35.jpg)
Student Success TechnologiesINSTITUTIONAL PLANNING
STUDENT PLANNING TOOLS
ACADEMIC PLANNING & AUDIT
CAREER PLANNING
CO-CURRICULAR RECOGNITION
ADVISOR TOOLS
DIAGNOSTICS
ALERTS & SIGNALS
CASELOAD MANAGEMENT
TRANSFER EVALUATION
STUDENT SERVICES
TUTORING
AID, BENEFITS & WELLNESS
LIFE SKILLS
PERFORMANCE MEASUREMENT & MANAGEMENT
INTEGRATION SOLUTIONS
TYTON PARTNERS
CHAN
GE M
ANAG
EMEN
TAN
ALYTICS
![Page 36: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/36.jpg)
• Sense of urgency!• Can’t continue with business as usual.• Analytics isn’t a silver bullet but it gives us a
fighting chance.• Data -> “myth busting”• Need real-time data for real-time
interventions.• Continue to build the infrastructure to
support and sustain the data strategy.
LESSONS LEARNED
![Page 37: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/37.jpg)
• Connect with people who can benefit from data.
• Changing job descriptions to match needs.
• This is a game changer. Need to continue to improve.
• This is very disruptive.
• Intentional metrics for change.
LESSONS LEARNED
![Page 38: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/38.jpg)
RESOURCES
![Page 39: ANALYTICS: A 21ST CENTURY SPORT · solving issues 2. Collecting and preparing data to produce most useful insights 3. Building the analytics engine to solve in an efficient and interpretable](https://reader033.fdocuments.us/reader033/viewer/2022053002/5f06a7287e708231d419104c/html5/thumbnails/39.jpg)
Q & A