Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD...
-
Upload
aldous-brown -
Category
Documents
-
view
218 -
download
0
Transcript of Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD...
![Page 1: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/1.jpg)
Re-thinking Screening Approaches in the Early Years: From Structure to Process
John Cairney, PhDMcMaster Family Medicine Professor of Child Health
Research
Director of INCH
McMaster University
![Page 2: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/2.jpg)
Early Years Are Critical
• Rapid period of brain development laying the foundation for long-term health and well-being.1
• Environmental influences are critical.2-3 • We must optimize development in this period by
ensuring the child is exposed to developmentally enriching and enhancing environments.1-3
1Hertzman et al. Paediatric Child Health 2011;16:655–7. 2Baker, M. Canadian Journal of Economics/Revue canadienned’économique 2011;44:1069–1105. 3Center on the Developing Child at Harvard University. The Foundations of Lifelong Health Are Built in Early Childhood; 2010. Available: www.developingchild.harvard.edu (accessed 2014 Feb. 4)
![Page 3: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/3.jpg)
Urie Bronfenbrenner
Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge, MA: Harvard University Press
![Page 4: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/4.jpg)
Relationships
A view of each child as competent, capable of complex thinking, curious and rich in potential.
We hold these same views of educators, and families!
How Does Learning Happen?
![Page 5: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/5.jpg)
Early Years Are Critical• Widespread scientific and clinical
consensus that investments in optimizing early development pays off through upstream prevention of health problems, increasing social benefits etc.).
• Delay and disorder, when they occur in this period, require early identification and intervention.
![Page 6: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/6.jpg)
Scope of the Problem• Prevalence of neurodevelopmental
disorders, coupled with overall estimates of delay, are “high”.– Autism / ASD (0.6 to 1.1%)– ADHD/ADD (5%)– DCD (5-6%)– Estimates of any delay (16-20%)– Children at risk owing to social disadvantage
and other psychosocial risks, ~40%
![Page 7: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/7.jpg)
Challenge
• Many children are not identified until school (EDI at kindergarten or later).
• We need a system to identify delay/disorder and risk of developmental problems much earlier than kindergarten.
![Page 8: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/8.jpg)
Before we proceed
• Screening? Monitoring? Assessment? Population Surveillance? Tools? Measures? Scales?
• Lets establish a common language base.
![Page 9: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/9.jpg)
Definitions• Screening:
– Use of tool(s) to identify children at risk for delay and/or disorder.
– Also refers to identification of other risks.– Different than screening for disease (cancer).
• Assessment: – In this context, not a clinical assessment.– Refers to administration of screening tool(s). It
is the process of administration.
![Page 10: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/10.jpg)
Definitions• Measures:
– Scales; checklists; (e.g., NDDS, Bayleys, PLS-4, ASQ). Could be self-reported; could be directly administered.
• Monitoring: – At the individual level = screening. – At the population level = data abstracted from
individual-level screening aggregated up to population.
![Page 11: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/11.jpg)
Definitions
• Toolkit:– A collection of measures intended to be used
for assessments.
![Page 12: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/12.jpg)
A DIFFERENT APPROACH
Improving Early Detection of Delay and Risk in the Early Years in Ontario
![Page 13: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/13.jpg)
Considerations
• Screen Target – What should we be assessing?
• Tools– What will we use to assess?
![Page 14: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/14.jpg)
Considerations
• Place and Time– How will we reach children? Where will this be
done? How often?
• Evaluation – We must evaluate to see if we are achieving
our goals.
![Page 15: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/15.jpg)
SCREEN TARGET
What should we be assessing?
![Page 16: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/16.jpg)
What are we screening for?
• One of the reasons this area is so complex.
• We need to identify delay and disorder when it is present; but also risk for problems that may not yet be manifest.
• Many things to assess, but we can categorize into 3 broad domains.
![Page 17: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/17.jpg)
What are we screening for?
![Page 18: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/18.jpg)
Atypical Motor Dev
Atypical Motor Dev
Atypical Speech/
Language Dev
Atypical Speech/
Language Dev
Atypical Cognitive Dev
Atypical Cognitive Dev
Behavioural Problems/ Difficulty
regulating
Behavioural Problems/ Difficulty
regulating
Psychosocial RisksPsychosocial Risks
AutismAutism
ADHD / ADDADHD / ADD
DCDDCD
Depression / Anxiety
Depression / Anxiety
Atypical Development in 1 or more domains, 0 to 3 yrs
Neurodevelopmental and Mental Disorders in Later Childhood (4 to 6/7)
Life Course
![Page 19: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/19.jpg)
Atypical Motor Dev
Atypical Motor Dev
Atypical Speech/
Language Dev
Atypical Speech/
Language Dev
Atypical Cognitive Dev
Atypical Cognitive Dev
Behavioural Problems/ Difficulty
regulating
Behavioural Problems/ Difficulty
regulating
Psychosocial RisksPsychosocial Risks
AutismAutism
ADHD / ADDADHD / ADD
DCDDCD
Depression / Anxiety
Depression / Anxiety
Atypical Development in 1 or more domains, 0 to 3 yrs
Neurodevelopmental and Mental Disorders in Later Childhood (4 to 6/7)
Life Course
![Page 20: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/20.jpg)
Existing Programs• Healthy Babies Healthy Children
• 18-month Enhanced Well-baby Visit
• EDI school readiness
• It is evident we are screening for some, but not all, of the content in these 3 domains across these programs. Not all programs include all domains.
![Page 21: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/21.jpg)
New Metaphor• What we want to do is take a development
temperature
• If readings are consistently “high” further investigation is required (referral / diagnosis / treatment plan)
• Consistently high readings may be a signal for: autism; ADD/ADHD; etc
• Or not
![Page 22: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/22.jpg)
TOOLKIT
What will we use to screen?
![Page 23: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/23.jpg)
Before we consider what to use…
• We need to consider the challenges of doing developmental screening.
• We also need to think about existing tools and methods and limitations associated with them.
![Page 24: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/24.jpg)
CASE EXAMPLE
DATA form PANS
![Page 25: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/25.jpg)
Psychometric Assessment of the Nipissing District Developmental Screens Study
Research Team:Dr. Jean Clinton, MDDr. Peter Szatmari, MDDr. Cheryl Missiuna, PhD, OTChristine Rodriquez, MScScott Veldhuizen, MA
![Page 26: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/26.jpg)
PANS: Purpose
• To evaluate the validity and reliability of the revised NDDS, the NDDS-2011, in a community-based sample of parents and children
– Criterion validity: Is the NDDS-2011 able to accurately identify children with developmental concerns?
– Test-retest reliability: Do parents answer questions NDDS-2011 the same way when reporting developmental concerns about their child at 2 points in time?
![Page 27: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/27.jpg)
PANS: Methods
• Goal: 800 children between 1 month - 6 years of age–1 month to 36 months: 50 per age band (Group A)– 4 to 6 years: 100 per age band (Group B)
• Parent-child pairs randomized to 3 groups: –Assessment–Assessment + test-retest (n=130: 10 per age band)
–Assessment + interview (n=65: 5 per age band)
• Community-based sampling method
![Page 28: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/28.jpg)
PANS: MethodsDirect assessment – Concurrent Validation• Assessments completed by trained research assistants
using instruments that have been validated in similar populations
• Group A (1month to 3 yrs, 11 months):– Bayley Scale of Infant & Toddler Development-III (BSID-III)
• Group B (4 to 6 yrs):– Preschool Language Scale-4 (PLS-4)– Kaufman Brief Intelligence Test-2 (KBIT)– Movement Assessment Battery for Children-2 (MABC-2)
![Page 29: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/29.jpg)
PANS: Methods
Proxy – Parent Report• Ages and Stages Questionnaire (ASQ; 1 month to 5
years)• Child Behaviour Checklist (CBC-L; 18 months to 6
years)• Developmental Coordination Disorder Questionnaire-07
(DCDQ; 4 to 6 years)
![Page 30: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/30.jpg)
PANS: Results
Sample • 824 parent-
child pairs from 572 families
• 86.3% consent rate
Participant Referrals n=1012
Potential participants n=955
Participants enrolled n=904
Assessments with parent-child pairs
n=824
Final Sample n=812
Unable to contact (n=37) Ineligible (n=8)
oAge (n=5) o Language barrier (n=3)
Unable to test prior to study end
Declined (n=51)
Unable to contact (n=38) Unable to test prior to study end (n=25) Withdrawn prior to assessment (n=17)
Excluded (n=12) o Incomplete appointment (n=6) o Language barrier (n=6)
![Page 31: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/31.jpg)
PANS: Results
Test-retest reliability• 111 parents completed the NDDS-2011 twice• Moderate agreement
– Spearman’s rho=0.61, p<0.001– Kappas:
• One-flag kappa = 0.59• Two-flag kappa = 0.57• Three-flag kappa = 0.48
These results suggest that parents’ ratings on the NDDS-2011 are not consistent over short durations. We would prefer to see fewer changes in responses.
![Page 32: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/32.jpg)
Sensitivity / Specificity Interpretation
<.50 Poor
.50 to .60 Low
.61 to .70 Fair
.71 to .80 good
.81 to .90 Very good
.91 to 1.00 Excellent
![Page 33: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/33.jpg)
PANS: Results
Criterion validity: Agreement among instruments
• Sensitivity: ability of the NDDS-2011 to correctly identify children with developmental delays.
• Specificity: ability of the NDDS-2011 to correctly exclude children without developmental delays.
![Page 34: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/34.jpg)
PANS: Results
Concurrent validity: versus BSID-III
One-flag Rule* Two-flag Rule* Three-flag Rule*
Below avg
Mild delays
Sig delay
Below avg
Mild delays
Sigdelays
Below avg
Mild delays
Sig delays
Sensitivity Low Low Fair Poor Poor Low Poor Poor Poor
Specificity Good Fair FairExcellen
tVery Good
Very Good
Excellent
Excellent
Excellent
*NDDS-2011Children aged 1 month to 3 years 1n=593, 2n=570
![Page 35: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/35.jpg)
PANS: Results
Concurrent validity: versus BSID-III
One-flag Rule* Two-flag Rule* Three-flag Rule*
Below avg
Mild delays
Sig delay
Below avg
Mild delays
Sigdelays
Below avg
Mild delays
Sig delays
Sensitivity Low Low Fair Poor Poor Low Poor Poor Poor
Specificity Good Fair FairExcellen
tVery Good
Very Good
Excellent
Excellent
Excellent
*NDDS-2011Children aged 1 month to 3 years 1n=593, 2n=570
![Page 36: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/36.jpg)
PANS: Results
Concurrent validity: versus BSID-III
One-flag Rule* Two-flag Rule* Three-flag Rule*
Below avg
Mild delays
Sig delay
Below avg
Mild delays
Sigdelays
Below avg
Mild delays
Sig delays
Sensitivity Low Low Fair Poor Poor Low Poor Poor Poor
Specificity Good Fair FairExcellen
tVery Good
Very Good
Excellent
Excellent
Excellent
*NDDS-2011Children aged 1 month to 3 years 1n=593, 2n=570
![Page 37: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/37.jpg)
PANS: ResultsConcurrent validity: NDDS-2011 vs CBC-L1
One-flag Rule*
Two-flag Rule*
Three-flag Rule*
Sensitivity Good Low Poor
Specificity Fair Very Good Excellent
*NDDS-20111Children 18 months to 6 years of age; n=480
![Page 38: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/38.jpg)
Are these results specific to the NDDS?
What about the ASQ?
![Page 39: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/39.jpg)
PANS: ASQ Results
![Page 40: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/40.jpg)
Systematic Review
• Identified 17 studies examining criterion validity of ASQ
Results:
• Methodological quality poor (*some studies published in Pediatrics!)
• Sensitivities ranges from 0 to 100%
• Specificities ranged from 39% to 98%
![Page 41: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/41.jpg)
Lessons Learned From PANS (and the literature)
• Parent-reported tools like the NDDS are ineffective on their own for screening (agreement with direct developmental assessment).
• Could be modified to be more effective in the following ways:– Facilitated administration versus self-report.– Content and response category revisions.
![Page 42: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/42.jpg)
However …
• These changes will still not overcome the inherent limitations of parent-reported surveys / checklists.
• So, what do we need?
![Page 43: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/43.jpg)
What can we agree upon?
• Developmental experts will disagree about the best measures for screening or diagnosis.
• But there is greater consensus about the conditions that need to be in place to optimize screening in this context.
![Page 44: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/44.jpg)
Core Components
• Many Eyes
• Many Measures
• Many Situations
• Many Times
In this context, more = better
![Page 45: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/45.jpg)
Core Components
• Many Eyes– multiple assessors (parents; providers); bring
different perspectives; have different experiences, levels of expertise and opportunities to observe the child.
• Many Measures
• Many Situations
• Many Times
![Page 46: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/46.jpg)
Core Components• Many Eyes
• Many Measures– No single measure can do it all. A toolkit
containing multiple measures completed by different “eyes”, and different methods of administration (survey; direct assessment), increases opportunities to identify delay.
• Many Situations
• Many Times
![Page 47: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/47.jpg)
Core Components
• Many Eyes
• Many Measures
• Many Situations– Being able to observe the child interacting with
parents; other children; other adults etc.
• Many Times
![Page 48: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/48.jpg)
Core Components• Many Eyes
• Many Measures
• Many Situations
• Many Times – The complexity of development requires
repeated assessments over time to achieve trajectories which allows us to disentangle typical from atypical development.
![Page 49: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/49.jpg)
The Importance of Tracking
l
6-m 12-m 18-m 4-6 yrs
Meghan
Connor
TD
D
TD = typical developmentD = delay
![Page 50: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/50.jpg)
Developmental Temperature Taking
• Many Eyes (ME), Many Times (MT), Many Measures (MM), Many Situations (MS)
Chil
Many Measures & Many Situations
Many Eyes
Child
Parent Report
Caregiver
Parents
Provider in Community-based setting
Structured Games & Activities
Structured Observation
Many Times
X
X X
X X
X X
X
X
Global Developmental Temperature Ratings
taken at multiple times
Fine Motor Gross Motor Personal/Social
![Page 51: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/51.jpg)
Global temperature• Not a formal screening or diagnosis
• An indication as to how a child is developing at one point in time across multiple domains
• Provides guidance as to the level of developmental support needed
• Recognizes child development can be enhanced in supportive contexts
![Page 52: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/52.jpg)
Benefits of New Approach• Ongoing support and engagement with families• Builds on existing tools (measures) and processes
(providers engagement with families and children) • Flexible - adapts to the needs of the family and child and
to be integrated with existing work• Improved identification of children referred for formal
screening and intensive developmental support • Can also be strengths based
![Page 53: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/53.jpg)
Toolkit for Developmental Temperature Ratings
Includes existing resources (e.g., NDDS, Bayley) and new information to provide a coverage of multiple domains and sources of information: Parent self-report Direct observation Structured games and activities
Selection of tools and global rating made by providers based on the needs of the child and family
![Page 54: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/54.jpg)
Parent Questionnaires
(facilitated administration)
Parent Questionnaires
(facilitated administration)
A visit: Engagement with families to gather and share information about a child
Structured activities &
Games
Structured activities &
Games
Structured ObservationStructured
Observation
ProviderReport
Parent Report
child, parent, provider are all active participants
![Page 55: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/55.jpg)
When repeated at each visit, multiple temperatures can be used to derive a global developmental picture over time
Visit 1 Visit 2
Visit 3
![Page 56: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/56.jpg)
Sample VAS for Global Ratings
Not at All Concerned
Extremely Concerned
Fine Motor
Gross MotorNot at All Concerned
Extremely Concerned
Not at All Concerned
Extremely Concerned
Cognitive
Not at All Concerned
Extremely Concerned
Language
Not at All Concerned
Extremely Concerned
Socio-Emotive
![Page 57: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/57.jpg)
Summary• Shift from screening to developmental support• Intervention revolves around engagement with
family to support optimal development premised on: – Many eyes– Many measures– Many times– Many situations
• Emphasis is on the process and relationships, temperature taking provides a measure to help match level of developmental support
![Page 58: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/58.jpg)
Anything like this in existing programs?
![Page 59: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/59.jpg)
18-month EWBV
Components: Many eyes (parents / primary care
provider) Many measures (NDDS + Rourke)
× Many situations
× Many times
![Page 60: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/60.jpg)
PLACE AND TIME
Where we will screen? How will we reach children? How often?
![Page 61: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/61.jpg)
In Place Now
New Born Screening
HBHC 18-month 4-6 yrs - EDI
Time
![Page 62: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/62.jpg)
Too Many Time Gaps; Too Much Time Between Points
New Born Screening
HBHC 18-month 4-6 yrs - EDI
Time
![Page 63: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/63.jpg)
Optimal
New Born Screening
HBHC 18-month 4-6 yrs - EDI
Time
Screen Screen Screen Screen
![Page 64: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/64.jpg)
WHY?
![Page 65: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/65.jpg)
The Importance of Tracking
l
6-m 12-m 18-m 4-6 yrs
Meghan
Connor
TD
D
TD = typical developmentD = delay
![Page 66: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/66.jpg)
Where are children prior to school entry?
• At home– Parents.– Extended family.
• In care– Registered Child Care.– Private Child care.
• Community – OEYCs / Family Support/Parenting/Check-it Out Clinics
![Page 67: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/67.jpg)
Where are children prior to school entry?
• Primary Care– Scheduled checkups offer opportunities for
screening (18 EWBV).
![Page 68: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/68.jpg)
Where are children prior to school entry?
• Primary Care– Scheduled checkups offer opportunities for
screening (18 EWBV)
*** can’t be done in primary care alone (many eyes, many tools, many times, but not many situations, among other concerns)
• New system would reach children through these settings.
![Page 69: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/69.jpg)
PHYSICAL LITERACYEXAMPLE (APPLICATION)
![Page 70: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/70.jpg)
Physical Literacy
Skills, Competence, Confidence ,Fun
![Page 71: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/71.jpg)
Fundamental Movement Skills and Physical Activity
Long-term athlete development model
![Page 72: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/72.jpg)
Physical Literacy
• Healthy active living (including sport) is only part of the message
• We need to position physical literacy as part of the foundation for healthy child development
• Healthy development = healthy active living, along with brain development, physical health, social development and academic achievement. It is also about health promotion and prevention.
![Page 73: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/73.jpg)
Physical Literacy =Brain Development
Cognitive Development, Social Development, School Readiness
![Page 74: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/74.jpg)
After school intervention study
• 221 children (7 to 9 yrs) randomly assigned to an after school PA program or wait-list control
• Fitness improved• Cognitive performance
improved, especially for tasks that require more cognitive control
Hillman et al. Effects of the FITKids Randomized Controlled Trial on Executive Control and Brain Function. Pediatrics, 2014 (online)
![Page 75: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/75.jpg)
Palmer, Miller & Robinson (2013)p <.01
Journal of Sport and Exercise Psychology, 2013, 35, 433-37
![Page 76: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/76.jpg)
Animal Fun Program
![Page 77: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/77.jpg)
PLOT – Physical Literacy Observation Tool
![Page 78: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/78.jpg)
PLOT• PLOT is not “scored”• PLOT is used to “assess”, reflect, plan and
implement (process)• Take a temperature using PLOT – how are our
children progressing in the area of physical literacy?
• How can the environment (physical, social, curriculum) be modified to enhance physical literacy?
![Page 79: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/79.jpg)
PLOT in Action
Observe
Reflect
Intervene
Reflect
![Page 80: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/80.jpg)
PLOT in Action
Observe
Reflect
Act
Reflect
Temperature TakingMotor
Social
Cognitive
![Page 81: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/81.jpg)
Reflections
• Is physical literacy changing? If yes, we know we are having a positive impact on global development
• Is there a child who is not progressing? Can we try to other strategies to engage?
• Do we need another set of “eyes” with more specific expertise to advise?
![Page 82: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/82.jpg)
Applying the 4M’s to PLOT
• Many Eyes
• Many Measures
• Many Situations
• Many Times
![Page 83: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/83.jpg)
Applying the 4M’s to PLOT
• Many Eyes ✓ - every one on the team can do a PLOT on every child
• Many Measures
• Many Situations
• Many Times
![Page 84: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/84.jpg)
Applying the 4M’s to PLOT
• Many Eyes ✓ - every one of the team can do a PLOT on every child
• Many Measures ✓ - PLOT; temperature rating – what other tools? NDDS?
• Many Situations
• Many Times
![Page 85: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/85.jpg)
Applying the 4M’s to PLOT
• Many Eyes ✓ - every one of the team can do a PLOT on every child
• Many Measures ✓ - PLOT; temperature rating – what other tools? NDDS?
• Many Situations ✓ - Observe in play (free, structured, alone, with others)
• Many Times
![Page 86: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/86.jpg)
Applying the 4M’s to PLOT
• Many Eyes ✓ - every one of the team can do a PLOT on every child
• Many Measures ✓ - PLOT; temperature rating – what other tools? NDDS?
• Many Situations ✓ - Observe in play (free, structured, alone, with others)
• Many Times ✓ - Keep PLOTing
![Page 87: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/87.jpg)
EVALUATION
Ensuring we are meeting our goals.
![Page 88: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/88.jpg)
Methods• Measurement studies to evaluate reliability
(rater, item, time) of temperature scales
• Mixed-method intervention studies to answer:– Feasibility– Efficacy– Effectiveness
![Page 89: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/89.jpg)
Reach?
• Not all children access parenting support and other community programs..
• What we are proposing is to develop a tool and then work on implementation in other settings (e.g., Child Care).
• Interface with primary care (e.g., 18m) and other existing programs in local communities / province
![Page 90: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/90.jpg)
Other considerations
• Realities of real world settings: parents may want to engage; may only come once to visit a community program.
• Engagement with parents (difficult conversations)
• Changing practice (training / scope of practice)
• IT / Data capture and monitoring component
![Page 91: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/91.jpg)
Values• Developmental support/relationships with
families is at the core
• Celebrate diversity while also identifying when children/families need a different kind of support (referral)
• Universal access, universal benefits to all children and families
![Page 92: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/92.jpg)
Summation• Change they way we “screen”
• Change practice – use multiple tools to “engage” families in a process that is about development
• Take temperature (many times)
• Use that information to identify children/families in need of support
• Build/strengthen links between community, primary care and specialized services
![Page 93: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/93.jpg)
www.inchlab.ca
![Page 94: Re-thinking Screening Approaches in the Early Years: From Structure to Process John Cairney, PhD McMaster Family Medicine Professor of Child Health Research.](https://reader037.fdocuments.us/reader037/viewer/2022102907/56649d2f5503460f94a079c2/html5/thumbnails/94.jpg)