Innovations 2012 • Closing the Loop
description
Transcript of Innovations 2012 • Closing the Loop
Presentation Font
Innovations 2012 Closing the Loop
1
AgendaCulture of AssessmentUnlocking The DataTracking ImprovementNext StepsQuestions / Conversation Culture of AssessmentGuiding Principles
Systemic; not episodicPurposefulEmbedded in existing curriculumStudent centeredTransparentUsed to improve C&I
7Improvement vs. AccountabilityEwell, P. (2009, November). Assessment, accountability, and improvement: Revisiting the tension. (NILOA Occasional Paper No.1). Urbana, IL: University of Illinois and Indiana University, National Institute of Learning Outcomes Assessment. ImprovementAccountabilityIntentFormative (Improve)Summative (Judge)StanceInternalExternalEthosEngagementCompliance
Peter Ewell, Ph.D.8
Situation on Your Campushttps://docs.google.com/spreadsheet/viewform?pli=1&formkey=dDk3YTVaRXBscjhQQmVtbmhWNl9TeWc6MA#gid=0
http://pollev.com/brianeppIs Assessment Important? What is the % of accreditor sanctions that are related to a campus compliance with student learning outcome requirements?
70%11Assessment Cycle12Moving from the Open Loop to Closing the LoopDevelop Awareness: Left BrainRight Brain.. Data Visualization
Implement Action: Dig Deeper: Horizontally or Vertically Scope: Involve your TeamChange: Enhance Curriculum and Instruction
Refine Roadmap
Unlocking The DataUnlocking SLO Data
?
Information Is Beautifulhttp://www.informationisbeautiful.net/visualizations/What do you want/need to knowQuestionQuestion AgainQuestion Once More
?Correlation Brings ActionHow are my Institutions outcomes performing?What ratio of students mastered their BIO outcomes last year?How many students are mastering their program outcomes?Judge of a man by his questions rather than by his answers.VoltaireGather what you needFind Your NounsFind Your VerbsFind Your Math
Denver Waterhttp://www.denverwater.org/Conservation/UseOnlyWhatYouNeed/What ratio of students mastered their BIO outcomes last year?studentsGather what you need
Grammar what you needBIO outcomeslast yearmasteredratio
Impactful Data
Dont Hate Me Because Im BeautifulThere Is No Single, Magical Silver BulletNo Man/Woman Is An Island
Information is Beautifulhttp://www.informationisbeautiful.net/store/Make It Worth Seeing Make It Instantly Meaningful Make It Prompt More Questions To Your Audience! Immediately Actionable
20Unlocking Student Learning Outcome Data?
Information Is Beautifulhttp://www.informationisbeautiful.net/visualizations/
What ratio of students mastered their BIO outcomes last year?What ratio of students mastered their BIO outcomes last year?
NounsVerbsMath
No BulletNo IslandBeautifulMeaningfulQuestioning
What questions are you asking?Does student outcome performance vary across course sections?Does student outcome performance vary across terms?Does % of students mastering an outcome increase through the program?Which outcomes (in a program, in a course) do most students not master?
Tracking Improvements to C&I
Jump In
with a PlanAsk Tracking Questions
Is this about the student or the SLO?
How frequently will we collect/track?
How much data can we show?
How will stakeholder improvement discussions be tracked?Next Steps
Start Small but Start
28Blaich, C.F. & Wise, K.S. (2011, January). From Gathering to Using Assessment Results: Lessons from the Wabash National Study (NILOA Occasional Paper No.8). Urbana, IL: University for Illinois and Indiana University, National Institute of Learning Outcomes Assessment.
Assessment data has legs only if the evidence collected rises out of extended conversations across constituencies about:(a) what people hunger to know about their teaching and learning environments and (b) how the assessment evidence speaks to those questions. (pg. 12)
29Taking Your Next Steps
Determine your team/audienceArticulate your data questionsEstablish which data to track and how oftenStart!!!Perfect is the Enemy of Good
31
Assessment & Analytics GroupContact email: [email protected]