Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for...
-
Upload
jesse-newton -
Category
Documents
-
view
215 -
download
0
Transcript of Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for...
![Page 1: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/1.jpg)
Associate Professor Genevieve McArthurDirector of the Macquarie University Cognition Clinic
for ReadingActing Head of the Department of Cognitive Science
ARC Centre for Cognition and its DisordersMacquarie University
How to make evidence based decisions about literacy interventions
![Page 2: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/2.jpg)
Outline
The difference between the truth (fact) and what we are told (fiction)
Treatments for “dyslexia”
“causal” and “reading” treatments
good examples of evidence-based thinking
a step-by-step guide to the evidence-based treatment of dyslexia
practice
![Page 3: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/3.jpg)
The difference between truth (fact) and what we are told (fiction)
![Page 4: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/4.jpg)
![Page 5: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/5.jpg)
Why am I banging on about flossing?
This represents the size of the gap (i.e., Grand Canyon)
between what science and the media tell us about the
treatment of dyslexia
Steps to close the gap …
![Page 6: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/6.jpg)
Dorothy Bishop
dystalk.com/talks/60-evaluating-alternative-solutions-for-dyslexia
Good examples of evidence-based thinking
Ben Goldacre
http://www.youtube.com/watch?v=O1Q3jZw4FGshttp://www.youtube.com/watch?=_UrhJ8P8iZ8&feature=related
![Page 7: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/7.jpg)
Commercial treatments for dyslexia
Reading treatments“Causal” treatments
![Page 8: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/8.jpg)
“treatment x” review“treatment x” meta analysis
Yes
Go to step 2
No
Found
Use conclusion
Step 1: Find a systematic review (a review of all properly controlled trials of a
“treatment”)
Reading or spelling? Independent? Peer reviewed?
Go to step 2
Not found
“treatment x” systematic review
![Page 9: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/9.jpg)
Yes
Go to step 3
Found
Reading or spelling? Independent? Peer reviewed?
Not found
Control group
Significantly bigger reading gains in
treated group than control group
No difference in reading gains in
treated and control groups
Go to step 3
Go to step 3
No
No control group
Step 2: DIY systematic review
“treatment x” randomised controlled trial “treatment x” study “treatment x” controlled trial
![Page 10: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/10.jpg)
Step 3: Use indirect evidence
a treatment
reading
is k
now
n to
imp
rove
reading
is k
now
n to
imp
rove
trained skill
?? ✗✓
![Page 11: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/11.jpg)
Step 3a: Find out what skill a treatment trains
What does “treatment x” train?
![Page 12: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/12.jpg)
Step 3b: Find out if training that skill improves reading
![Page 13: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/13.jpg)
Step 3: Use indirect evidence
a treatment
reading
is k
now
n to
imp
rove
reading
is k
now
n to
imp
rove
trained skill
?? ✓✓✗ ✗
![Page 14: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/14.jpg)
Step 4: Strike out
No systematic review
No studies for DIY systematic review
No indirect evidence
Conclusion: no scientific evidence
Do not try treatment
Evidence-based decision Stab in dark
Try treatment
![Page 15: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/15.jpg)
Beware of the brain
Brain data cannot tell us if an educational treatment works or not
If a program did not improve reading, but did change the brain, would you buy it?
If a program did improve reading, but did not change the brain, would you not buy it?
Focus on the behaviour (i.e., reading behaviour) and not the brain
![Page 16: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/16.jpg)
Beware of the anecdote
Biased
Subjective
Confounded by other factors (e.g., treatments)
Cognitive dissonance
![Page 17: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/17.jpg)
Examples
“Causal” treatments Reading treatments
![Page 18: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/18.jpg)
Example 1
![Page 19: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/19.jpg)
Yes
Use conclusion
Step 1: Find a systematic review
Reading or spelling? Independent? Peer reviewed?
Found
fast forword systematic review fast forword meta analysis fast forword review
little or no effect
![Page 20: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/20.jpg)
Example 2
![Page 21: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/21.jpg)
Yes
Use conclusion
Step 1: Find a systematic review
Reading or spelling? Independent? Peer reviewed?
Found
Irlen lenses systematic review Irlen lenses meta analysis Irlen lenses review
little or no effect
![Page 22: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/22.jpg)
Example 3
![Page 23: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/23.jpg)
arrowsmith reviewarrowsmith meta analysis
Go to step 2
Step 1: Find a systematic review
Not found
arrowsmith systematic review
![Page 24: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/24.jpg)
Step 2: DIY systematic review
arrowsmith randomised controlled trial arrowsmith study arrowsmith controlled trial
Go to step 3
No studies
![Page 25: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/25.jpg)
Step 3: Use indirect evidence
reading
is k
now
n to
imp
rove
trained skill
✗✓
reading
is k
now
n to
imp
rove
??
![Page 26: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/26.jpg)
Step 3a: Find out what skill a treatment trains
What does arrowsmith train?
The Arrowsmith Program identifies, intervenes and strengthens the weak cognitive capacities that affect learning. Students are able to capitalize on their increased learning capacities and after a three or four year program can function without special education assistance or program accommodations. Upon completion of the program some students may require one to two years to gain experience using their newly strengthened cognitive capacities and some students may need tutoring initially to bring academic skills to grade level given the limited amount of time within the program to address academic skill deficits.
![Page 27: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/27.jpg)
Step 3b: Find out if training that skill improves reading
![Page 28: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/28.jpg)
Step 3: Use indirect evidence
reading
is k
now
n to
imp
rove
trained skill
??
cognitive capacity ?
reading
is k
now
n to
imp
rove
??
![Page 29: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/29.jpg)
Step 4: Strike out
No systematic review
No studies for DIY systematic review
No indirect evidence
Do not try treatment
Conclusion: no scientific evidence
Evidence-based decision Stab in dark
Try treatment
✓✓✓
✓✓✓
![Page 30: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/30.jpg)
If you want a backup or its all a bit too much ...
![Page 31: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/31.jpg)
Outline
Treatments for dyslexia
“causal” and “reading” treatments
good examples of evidence-based thinking
a step-by-step guide to the evidence-based treatment of dyslexia
practice
![Page 32: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/32.jpg)
Good luck
![Page 33: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/33.jpg)
Example 4
![Page 34: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/34.jpg)
reading eggs reviewreading eggs meta analysis
Go to step 2
Step 1: Find a systematic review
Not found
reading eggs systematic review
![Page 35: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/35.jpg)
Step 2: DIY systematic review
reading eggs randomised controlled trial reading eggs study reading eggs controlled trial
Go to step 3
No studies
![Page 36: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/36.jpg)
Step 3: Use indirect evidence
reading
is k
now
n to
imp
rove
trained skill
✗✓
a treatment
reading
is k
now
n to
imp
rove
??
![Page 37: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/37.jpg)
Step 3a: Find out what skill a treatment trains
What does reading eggs train?
phonics
![Page 38: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/38.jpg)
Step 3b: Find out if training that skill improves reading
![Page 39: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/39.jpg)
phonics reviewphonics meta analysis
Yes
Use conclusion
Step 3b: Find a systematic review of that skill
Reading or spelling? Independent? Peer reviewed?
Found
phonics systematic review
moderate to large effects in dyslexia
![Page 40: Associate Professor Genevieve McArthur Director of the Macquarie University Cognition Clinic for Reading Acting Head of the Department of Cognitive Science.](https://reader037.fdocuments.us/reader037/viewer/2022103022/56649d355503460f94a0c957/html5/thumbnails/40.jpg)
Step 3: Use indirect evidence
a treatment
reading
is k
now
n to
imp
rove
reading
is k
now
n to
imp
rove
trained skill
✓✓
phonics