Introduction to Adaptive Interventions and SMART Study Design ...
Transcript of Introduction to Adaptive Interventions and SMART Study Design ...
![Page 1: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/1.jpg)
Introduction to Adaptive Interventions andSMART Study Design Principles
Daniel Almirall1,2 Linda M Collins2,3,5
Susan A Murphy1,2,4
1Institute for Social Research, University of Michigan2The Methodology Center, Penn State University
3Human Development and Family Studies, Pennsylvania State University4Department of Statistics, University of Michigan
5Department of Statistics, Pennsylvania State University
COPTR Workshop on Adaptive Interventions; June 29, 2011
Almirall, Collins, Murphy Building Adaptive Interventions 1 / 42
![Page 2: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/2.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Outline
Adaptive InterventionsWhat? Why?
Evaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)What are SMARTs?
SMART Design PrinciplesKeep it SimpleChoosing Primary and Secondary Hypotheses
Discussion
Almirall, Collins, Murphy Building Adaptive Interventions 2 / 42
![Page 3: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/3.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
What? Why?
ADAPTIVE INTERVENTIONS
Almirall, Collins, Murphy Building Adaptive Interventions 3 / 42
![Page 4: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/4.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
What? Why?
Definition: An Adaptive Intervention is
I a sequence of individually tailored decision rulesI that specify whether, how, and/or whenI to alter the intensity, type, dosage, or delivery of treatmentI at critical decision points in the course of care.
Adaptive Interventions operationalize sequential decisionmaking with the aim of improving clinical practice.
Almirall, Collins, Murphy Building Adaptive Interventions 4 / 42
![Page 5: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/5.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
What? Why?
Concrete Example of Adaptive InterventionPediatric Anxiety Example (SAD, GAD, SoP)
Maintain: CBT
CBT
Add Treatment: CBT + MED
Responder
s
Non-Responders
Tailoring Variable First-line Txt Second-line Txt
I Goal is to minimize the child’s symptom profile/trajectory.
Almirall, Collins, Murphy Building Adaptive Interventions 5 / 42
![Page 6: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/6.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
What? Why?
What makes up an Adaptive Intervention?1. Critical decisions: treatment options and more2. Tailoring variables: to decide how to adapt treatment3. Decision rules: inputs tailoring variable, outputs one or
more recommended treatments
Maintain: CBT
CBT
Add Treatment: CBT + MED
Responder
s
Non-Responders
Tailoring Variable First-line Txt Second-line Txt
Adaptive interventions AKA: dynamic treatment regimes, adaptive treatmentstrategies, treatment algorithms, structured treatment interruptions, practiceparameters, ASAM criteria...
Almirall, Collins, Murphy Building Adaptive Interventions 6 / 42
![Page 7: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/7.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
What? Why?
Why Adaptive Interventions?Necessary because...
I Chronic nature of substance use/mental health disorders
I Waxing and waning course (multiple relapse, recurrence)I Genetic and non-genetic factors influence courseI Co-occuring disorders may arise
I High patient heterogeneity in response to treatment
I Within person (over time) differential response to treatmentI Between person differential response to treatment
All require sequences of treatment decisions.
Almirall, Collins, Murphy Building Adaptive Interventions 7 / 42
![Page 8: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/8.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
EVALUATING VERSUS BUILDING VERSUS GENERATINGHYPOTHESES ABOUT ADAPTIVE INTERVENTIONS?
Almirall, Collins, Murphy Building Adaptive Interventions 8 / 42
![Page 9: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/9.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
3 Different Research Questions/Aims= 3 Different Research Designs
I Aim 1: When evaluating a particular AdaptiveIntervention: e.g. Does the AI have a statisticallysignificant effect as compared to control intervention?
I Aim 2: When building an Adaptive Intervention: e.g, Whatare the best tailoring variables and/or decision rules?
I Aim 3: When generating hypotheses to build anAdaptive Intervention: e.g., Does augmenting txt (asobserved in a previous trial) for non-responders correlatewith better outcomes?
Almirall, Collins, Murphy Building Adaptive Interventions 9 / 42
![Page 10: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/10.jpg)
3 Different Research Questions/Aims= 3 Different Research Designs
Ex. Q1: Does the Adaptive Intervention have a statisticallysignificant effect as compared to control intervention?
Ex. Q2: What are the best tailoring variables or decision rules?
Ex. Q3: Does augmenting txt for non-responders (as observedin a previous trial) correlate with better outcomes?
Analysis ofRCT SMART Previous RCT
Question Aim (Experimental) (Observational)1 Evaluating
√X X
2 Building X√
∼3 Hypothesis Gen. X X
√
![Page 11: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/11.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
What are SMARTs?
SEQUENTIAL MULTIPLE ASSIGNMENTRANDOMIZED TRIALS (SMARTs)
Almirall, Collins, Murphy Building Adaptive Interventions 11 / 42
![Page 12: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/12.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
What are SMARTs?
What is a Sequential Multiple AssignmentRandomized Trial (SMART)?
I Multi-stage trials; same participants throughoutI Each stage corresponds to a critical decision pointI At each stage, subjects randomized to set of treatment
optionsI The goal of a SMART is to inform the development of
adaptive interventions.
I will give you an example SMART, but first...
Almirall, Collins, Murphy Building Adaptive Interventions 12 / 42
![Page 13: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/13.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
What are SMARTs?
Motivation for an Example SMARTChild-Adolescent Anxiety Multi-modal Study (CAMS)
I CAMS: acute-phase, efficacy, RCT for child anxiety
I CBT+MED > MED ≈ CBT > Placebo
I However, some families and clinicians remain concernedabout the use of MED in this population
I So an important next question for clinical practice is“Can we delay the use of MED?”
I Some children may do fine w/ CBT only and not need MED.
Almirall, Collins, Murphy Building Adaptive Interventions 13 / 42
![Page 14: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/14.jpg)
Concrete Example of a SMART: Pediatric AnxietyCourtesy of Scott N Compton, Duke University Medical Center
Add Treatment: CBT + MED + FT Non-Responders
CBT + MED Maintain: CBT + MED
Step Down: CBT Only
R Maintain:
CBT
CBT Add Treatment: CBT + MED
Switch Treatment: MED
Responders R
Responders
Non-Responders R
O2 + Primary
Tailoring Variable First-line Txt Second-line Txt Y O1
![Page 15: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/15.jpg)
One Adaptive Intervention Within the SMART
Add Treatment: CBT + MED + FT Non-Responders
CBT + MED Maintain: CBT + MED
Step Down: CBT Only R Maintain:
CBT
CBT Add Treatment: CBT + MED
Switch Treatment: MED
Responders R
Responders
Non-Responders R
O2 + Primary
Tailoring Variable First-line Txt Second-line Txt Y O1
![Page 16: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/16.jpg)
Another Adaptive Intervention Within the SMART
Add Treatment: CBT + MED + FT Non-Responders
CBT + MED Maintain: CBT + MED
Step Down: CBT Only
R Maintain:
CBT
CBT Add Treatment: CBT + MED
Switch Treatment: MED
Responders R
Responder
s
Non-Responders R
O2 + Primary
Tailoring Variable First-line Txt Second-line Txt Y O1
![Page 17: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/17.jpg)
4 Embedded Adaptive Interventions in this SMART
Add Treatment:CBT + MED + FTNon‐Responders
CBT + MED Step Down:CBT Boost
Responders
Add Treatment:CBT + MED + FT Non‐Responders
CBT + MED Maintain:CBT + MED
Responders
Maintain:CBT BoostResponders
CBT Add Treatment:
CBT + MEDNon‐Responders
Maintain:CBT BoostResponders
CBT Switch Treatment:
MEDNon‐Responders
AI 1
AI 2
AI 3
AI 4
![Page 18: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/18.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Keep it SimpleChoosing Primary and Secondary Hypotheses
SMART DESIGN PRINCIPLES
Almirall, Collins, Murphy Building Adaptive Interventions 18 / 42
![Page 19: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/19.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Keep it SimpleChoosing Primary and Secondary Hypotheses
SMART Design Principles
I KISS Principle: Keep It Simple, Straightforward
I Power for simple important primary hypotheses
I Take Appropriate steps to develop an moredeeply-individualized Adaptive Intervention
Almirall, Collins, Murphy Building Adaptive Interventions 19 / 42
![Page 20: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/20.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Keep it SimpleChoosing Primary and Secondary Hypotheses
Keep It Simple, StraightforwardOverarching Principle
At each stage, or critical decision point,...I Use low dimensional summary to restrict subsequent
treatmentsI Use binary responder statusI Should be easy to use in actual clinical practice
I Restrict class of treatment options by ethical, feasibility, orstrong scientific considerations
I Collect additional, auxiliary time-varying measuresI To develop a more deeply-tailored Adaptive InterventionI Think time-varying effect moderators
Almirall, Collins, Murphy Building Adaptive Interventions 20 / 42
![Page 21: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/21.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Keep it SimpleChoosing Primary and Secondary Hypotheses
SMART Design: Primary Aims
Choose a simple primary aim/question that aids developmentof an adaptive intervention.
Power the SMART to test this hypothesis.
Almirall, Collins, Murphy Building Adaptive Interventions 21 / 42
![Page 22: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/22.jpg)
Primary Aim Example 1What is the main effect of first-line treatment? End of study outcome (e.g., ANOVA).
Add Treatment: CBT + MED + FT Non-Responders
CBT + MED Maintain: CBT + MED
Step Down: CBT Only R Maintain:
CBT
CBT Add Treatment: CBT + MED
Switch Treatmnt: MED
Responders R
Responders
Non-Responders R
O2 + Primary
Tailoring Variable First-line Txt Second-line Txt Y O1
PowerES N0.8 520.5 1280.2 788α = 0.05β = 0.20
![Page 23: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/23.jpg)
Primary Aim Example 2What is the main effect of first-line treatment? Longitudinal outcome (e.g., LMM).
Add Treatment: CBT + MED + FT Non-Responders
CBT + MED Maintain: CBT + MED
Step Down: CBT Only R Maintain:
CBT
CBT Add Treatment: CBT + MED
Switch Treatmnt: MED
Responders R
Responders
Non-Responders R
O2 + Primary
Tailoring Variable First-line Txt Second-line Txt Y O1
PowerES N0.8 340.5 830.2 505ρ = 0.60α = 0.05β = 0.20
![Page 24: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/24.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Keep it SimpleChoosing Primary and Secondary Hypotheses
SMART Design: Secondary Aims
Choose secondary aims/questions that further develop theAdaptive Intervention and take advantage of sequentialrandomization to eliminate confounding.
Almirall, Collins, Murphy Building Adaptive Interventions 24 / 42
![Page 25: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/25.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Keep it SimpleChoosing Primary and Secondary Hypotheses
Secondary Aim Examples 1 and 2Second-line treatment tailoring aim.
O2 = CBT adherence, time to non-response, allegiance with therapist, changes in home environment
Add Treatment: CBT + MED
Switch Treatment: MED
Non-Responders R
O2 + Primary
Tailoring Variable First-line Txt Second-line Txt Y
CBT
Almirall, Collins, Murphy Building Adaptive Interventions 25 / 42
![Page 26: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/26.jpg)
Secondary Aim Example 3Build a more deeply tailored adaptive intervention.
Add Treatment: CBT + MED + FT Non-Responders
CBT + MED Maintain: CBT + MED
Step Down: CBT Only
R Maintain:
CBT
CBT Add Treatment: CBT + MED
Switch Treatment: MED
Responders R
Responders
Non-Responders R
O2 + Primary
Tailoring Variable First-line Txt Second-line Txt Y O1
O1 = demographics, genetics, sub-diagnoses, co-morbidities, etc…
O2 = adherence, time to NR, changes at home, etc…
![Page 27: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/27.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
DISCUSSION
Almirall, Collins, Murphy Building Adaptive Interventions 27 / 42
![Page 28: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/28.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Hypothesis-generating Observational StudiesPost-hoc Analyses Useful for Building Adaptive Interventions
I Give examples of different observational study questionsthey can examine using data from a previous 2-arm RCT
I Standard observational study caveats apply:I No manipulation usually means lack of heterogeneity in txt
options (beyond what is controlled by experimentation inoriginal RCT)
I Some RCTs use samples that are too homogeneousI Confounding by observed baseline and time-varying factorsI Unobserved, unknown, unmeasured confounding by
baseline and time-varying factors
Almirall, Collins, Murphy Building Adaptive Interventions 28 / 42
![Page 29: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/29.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Hypothesis-generating Observational StudiesPost-hoc Analyses Useful for Building Adaptive Interventions
I There exists a literature for examining the impact oftime-varying treatments in observational studies
I Marginal Structural Models (Robins, 1999; Bray, Almirall, etal., 2006) to examine the marginal impact of observedtime-varying sequences of treatment
I Structural Nested Mean Models (Robins, 1994; Almirall, etal., 2010, 2011) to examine time-varying moderators ofobserved time-varying sequences of treatment
I Marginal Mean Models (Murphy, et al., 2001): to examinethe impact of observed adaptive interventions
Almirall, Collins, Murphy Building Adaptive Interventions 29 / 42
![Page 30: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/30.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Adaptive Interventions vs Adaptive Designs?I These ideas are not directly related. Confusing!I Problem 1: word “design” often used in 2 different ways
I Intervention designI Experimental design
I Problem 2: word “adaptive” often used in 2 different waysI Is experimental design adaptive?I Is experimental design used to build an adaptive
intervention?I Adaptive interventions are a type of intervention designI Adaptive experimental designs are particular type of
experimental designI SMARTs are not Adaptive Experimental DesignsI SMARTs do inform development of Adaptive Interventions
Almirall, Collins, Murphy Building Adaptive Interventions 30 / 42
![Page 31: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/31.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Take Home the FollowingI Adaptive Interventions individualize treatment up-front and
throughout
I Adaptive Interventions are guides for clinical practice
I SMARTs are used to build better Adaptive InterventionsI Next trial: SMART-optimized Adaptive Intervention vs.
state-of-the-art treatment
I SMARTs do not necessarily require larger sample sizes
I Existing RCTs can be used to begin to learn aboutadaptive interventions
I Observational study
Almirall, Collins, Murphy Building Adaptive Interventions 31 / 42
![Page 32: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/32.jpg)
Adaptive Treatment for Children with ADHDPI: Pelham, Florida International University
Continue Medication Responders
Medication Increase Medication Dose
Add Behavioral Intervention
R Continue
Behavioral Intervention Behavioral
Intervention Increase Behavioral
Intervention
Add Medication
Non-Responders R
Responders
Non-Responders R
![Page 33: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/33.jpg)
Treatment for Alcohol DependencePI: Oslin, University of Pennsylvania
Early Trigger for NR: 2+ HDD CBI
CBI + Naltrexone
R
Late Trigger for NR: 5+ HDD
CBI
CBI + Naltrexone
Non-Response R
Non-Response R
Naltrexone
TDM + Naltrexone
8 Week Response R
Naltrexone
TDM + Naltrexone
8 Week Response R
![Page 34: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/34.jpg)
Adaptive InterventionsEvaluating versus Building an Adaptive Intervention?
Sequential Multiple Assignment Randomized Trial (SMART)SMART Design Principles
Discussion
Thank you! Questions?
I http://methcenter.psu.edu
Email us with questions about this presentation:I Daniel Almirall: [email protected] Linda M. Collins: [email protected]
These slides will be posted on my website:I http://www-personal.umich.edu/∼dalmiral/
Almirall, Collins, Murphy Building Adaptive Interventions 34 / 42
![Page 35: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/35.jpg)
Extra Slides
Almirall, Collins, Murphy Building Adaptive Interventions 35 / 42
![Page 36: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/36.jpg)
Other Alternatives
I Piecing Together Results from Multiple TrialsI Choose best first-line treatment on the basis of a two-arm
RCT; then choose best second-line treatment on the basisof another separate, two-arm RCT
I Concerns: delayed therapeutic effects, and cohort effects
I Observational (Non-experimental) Comparisons of AIsI Using data from longitudinal randomized trialsI May yield results that inform a SMART proposalI Understand current treatment sequencing practicesI Typical problems associated with observational studies
I Expert Opinion
Almirall, Collins, Murphy Building Adaptive Interventions 36 / 42
![Page 37: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/37.jpg)
Why Not Use Multiple Trials to Construct an AIThree Concerns about Using Multiple Trials as an Alternative to a SMART
1. Concern 1: Delayed Therapeutic Effect
2. Concern 2: Diagnostic Effects
3. Concern 3: Cohort Effects
All three concerns emanate from the basic idea thatconstructing an adaptive intervention based on a myopic, local,study-to-study point of view may not be optimal.
Almirall, Collins, Murphy Building Adaptive Interventions 37 / 42
![Page 38: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/38.jpg)
Why Not Use Multiple Trials to Construct an AIConcern 1: Delayed Therapeutic Effects, or Sequential Treatment Interactions
Positive Synergy Btwn First- and Second-line Treatments
Tapering off medication after 12 weeks of use may not appearbest initially, but may have enhanced long term effectivenesswhen followed by a particular augmentation, switch, ormaintenance strategy.
Tapering off medication after 12 weeks may set the child up forbetter success with any one of the second-line treatments.
Almirall, Collins, Murphy Building Adaptive Interventions 38 / 42
![Page 39: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/39.jpg)
Why Not Use Multiple Trials to Construct an AIConcern 1: Delayed Therapeutic Effects, or Sequential Treatment Interactions
Negative Synergy Btwn First- and Second-line Treatments
Keeping the child on medication an additional 12 weeks mayproduce a higher proportion of responders at first, but may alsoresult in side effects that reduce the variety of subsequenttreatments available if s/he relapses.
The burden associated with continuing medication an additional12 weeks may be so high that non-responders will not adhereto second-line treatments.
Almirall, Collins, Murphy Building Adaptive Interventions 39 / 42
![Page 40: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/40.jpg)
Why Not Use Multiple Trials to Construct an AIConcern 2: Diagnostic Effects
Tapering off medication after 12 weeks initial use may notproduce a higher proportion of responders at first, but may elicitsymptoms that allow you to better match subsequent treatmentto the child.
The improved matching (personalizing) on subsequenttreatments may result in a better response overall as comparedto any sequence of treatments that offered an additional 12weeks of medication after the initial 12 weeks.
Almirall, Collins, Murphy Building Adaptive Interventions 40 / 42
![Page 41: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/41.jpg)
Why Not Use Multiple Trials to Construct an AIConcern 3: Cohort Effects
I Children enrolled in the initial and secondary trials may bedifferent.
I Children who remain in the trial(s) may be different.I Characteristics of adherent children may differ from study
to study.I Children that know they are undergoing adaptive
interventions may have different adherence patterns.
Bottom line: The population of children we are makinginferences about may simply be different from study-to-study.
Almirall, Collins, Murphy Building Adaptive Interventions 41 / 42
![Page 42: Introduction to Adaptive Interventions and SMART Study Design ...](https://reader033.fdocuments.us/reader033/viewer/2022042707/5868de801a28abc3408c2d13/html5/thumbnails/42.jpg)
SMART Design PrinciplesChoose a Longitudinal Response Measure
Why choose a longitudinal outcome, or a with-in personsummary of outcomes over time?
I These are chronic disorders (e.g., child-hood onset anxietydisorder)
I Outcome should incorporate time to initial response as acomponent
I Quick initial relief of symptoms should be valued
Almirall, Collins, Murphy Building Adaptive Interventions 42 / 42