Ontario CLA Handouts
-
Upload
chris-jackson -
Category
Documents
-
view
215 -
download
0
description
Transcript of Ontario CLA Handouts
![Page 1: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/1.jpg)
aligning teaching,learning, & assessment
Chris JacksonDr. Julie Patterson
![Page 2: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/2.jpg)
![Page 3: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/3.jpg)
“Bad…”
![Page 4: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/4.jpg)
We ask our students,
quite simply, to count fish.
![Page 5: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/5.jpg)
The need for adifferent assessment
![Page 6: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/6.jpg)
![Page 7: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/7.jpg)
Feasibility study in 2003 (n=14)
Formal launch in 2004 (n=61)
CLA longitudinal study 2005-2009
Formal launch of CWRA 2007 (n=11)
St. Louis University in Madrid administers the CLA 2007
Voluntary System of Accountability launches 2007
CLA in the Classroom launches 2007
Douglas College (BC) administers the CLA 2008-2010
OECD selects CAE as the centerpiece of the Generic Skills Strand of AHELO 2008
HETAC (Ireland) Project 2008 (n=8)
Academically Adrift released 2011
Ontario institutions begin piloting the CLA 2012
CAE selected to author performance tasks for next generation of US-based assessments (via Smarter Balanced Assessment Consortium) 2012
![Page 8: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/8.jpg)
Institutions are equipped toimprove higher-order skills
when they connectteaching, learning, and assessment
through authentic,performance-based practices.
![Page 9: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/9.jpg)
![Page 10: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/10.jpg)
![Page 11: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/11.jpg)
![Page 12: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/12.jpg)
![Page 13: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/13.jpg)
![Page 14: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/14.jpg)
![Page 15: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/15.jpg)
(a) William Shakespeare(b) John Updike
(c) Ernest Hemingway(d) None of the above
Rewards content regurgitationFails to gauge transferability
![Page 16: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/16.jpg)
Contentknowledge
Contentskills
Generalknowledge
Generalskills
![Page 17: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/17.jpg)
Contentknowledge
![Page 18: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/18.jpg)
![Page 19: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/19.jpg)
The provision of transferrable skills is
as important as the provision of content.
![Page 20: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/20.jpg)
The top ten in-demand jobs in 2010 did not exist in 2004. We are
currently preparing students for jobs that don’t yet exist, using
technologies that have not yet been invented in order to solve
problems that we don’t even know are problems yet.
![Page 21: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/21.jpg)
SO WHAT?
![Page 22: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/22.jpg)
SO WHAT?
![Page 23: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/23.jpg)
Academically adriftLimited learning on college campuses
![Page 24: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/24.jpg)
Proportion of employers who say colleges should place MORE emphasis than they do on selected
learning outcomes
•The ability to effectively communicate orally and in writing
•Critical thinking and analytic reasoning skills
•The ability to apply knowledge and skills to real-world settings
•The ability to analyze and solve complex problems
89%
81%
79%
75%
AAC&U | 2008 | aacu.org/leap/public_opinion_research.cfm
![Page 25: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/25.jpg)
Okay, enough.What is the [cla]?
![Page 26: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/26.jpg)
bias
![Page 27: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/27.jpg)
small sample
![Page 28: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/28.jpg)
quantitative reasoning
![Page 29: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/29.jpg)
appropriate comparison
group
![Page 30: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/30.jpg)
correlation vs. causation
![Page 31: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/31.jpg)
incorrect (improper?) use of data
![Page 32: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/32.jpg)
ability to filter
![Page 33: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/33.jpg)
metrics
![Page 34: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/34.jpg)
![Page 35: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/35.jpg)
![Page 36: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/36.jpg)
Unadjusted performance
![Page 37: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/37.jpg)
adjusted performance
![Page 38: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/38.jpg)
adjusted performance
![Page 39: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/39.jpg)
moving beyondassessment and
accountability
![Page 40: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/40.jpg)
![Page 41: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/41.jpg)
![Page 42: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/42.jpg)
Females
Males
![Page 43: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/43.jpg)
Writing Ability
Problem Solving
![Page 44: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/44.jpg)
48% 52% 40% 60% 32% 67% 48% 53%
![Page 45: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/45.jpg)
aligning teaching,learning &
assessment:faculty
development
![Page 46: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/46.jpg)
What is authentic assessment?
How does effective teaching support that (and vice versa)?
What are the higher-order skills we value? Why?
How are those skills demonstrated in student responses?
![Page 47: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/47.jpg)
What are the components of a Performance Task?
How do we effectively build them?
Working | Sharing | Feedback
![Page 48: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/48.jpg)
![Page 49: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/49.jpg)
![Page 50: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/50.jpg)
what does thismean for Ontario?
![Page 51: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/51.jpg)
9 piloting institutionsFanshawe College Humber College*
McMaster University Mohawk College (w/ McMaster)
Queen’s University Sheridan College
University of Guelph University of Windsor*
York University*
*to begin next academic year
![Page 52: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/52.jpg)
![Page 53: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/53.jpg)
What can be learned from Ireland?
http://bit.ly/HeILCS
There is a statistically significant increase in test performance between first and final year groups.
CAO points score, which is a measure of learner’s secondary school performance, is correlated with CLA.
Observed mean CLA scores are higher in four year level 8 programs than in three year level 8 programs.
![Page 54: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/54.jpg)
What can be learned from Ireland?
http://bit.ly/HeILCS
Observed mean CLA scores for first and final years are significantly lower than the corresponding means from the US, but their improvement is comparable and slightly higher.
![Page 55: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/55.jpg)
What can be learned from Ireland?
http://bit.ly/HeILCS
The absolute validity of the tests needs further analysis because the scores may (possibly) include cultural and native-language dependencies. Nevertheless, the tests are still useful as they stand because the change in performance either between first and final year or between institutions is presumably less susceptible to such dependencies.
![Page 56: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/56.jpg)
On the Performance Tasks, there was no main effect for task, which indicates that students in Ireland scored about the same on each task (on average).
![Page 57: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/57.jpg)
There was a main effect for MA “America is the land of opportunity.” This same effect exists in the United States.
![Page 58: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/58.jpg)
There was a main effect for CA “Lawyers,” which references the American Bar Association. This same effect exists in the United States.
![Page 59: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/59.jpg)
As expected, Irish graduating students performed significantly better than entering students. In some cases, this growth was greater than observed in the United States.
![Page 60: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/60.jpg)
Next StepsRun similar analyses for the cohort of HEQCO institutions piloting use of the CLA
Convene a panel of Canadian “experts” to suggest modifications to existing CLA tasks
![Page 61: Ontario CLA Handouts](https://reader031.fdocuments.us/reader031/viewer/2022020423/568c2c3a1a28abd8328ccfcd/html5/thumbnails/61.jpg)
chris jackson212.217.0845
[email protected]@cla_beat
collegiatelearningassessment.org/clapresentations