INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true?...
Transcript of INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true?...
![Page 1: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/1.jpg)
INTERPRETATION OF CLINICAL TRIALS
Alberto Sobrero
IRCCS San Martino IST, Genova Italy
![Page 2: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/2.jpg)
DISCLOSURES
Prof Sobrero is member of the Speakers Bureau and of the Advisory Board for:
Roche, Merck, Bristol-Myers Squibb, Celgene, Amgen, Servier, Sanofi, Lilly and Bayer.
![Page 3: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/3.jpg)
CLINICAL TRIALS:
THE 5 PHASES AND THEIR ACTORS
Design Conduct Analysis Reporting Interpretation
The clinical investigators and the statisticians
The patients and an army of people
![Page 4: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/4.jpg)
DESIGN
METHODOLOGY TRUE DATA
ORIGINALITY NEW DATA
RELEVANCE RELEVANT DATA
FEASIBILITY TRIAL FEASIBLE
1
2
3
4
![Page 5: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/5.jpg)
INTERPRETATION
![Page 6: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/6.jpg)
INTERPRETATION
How true ?
How generalizable ?
How relevant ?
1
2
3
![Page 7: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/7.jpg)
INTERNAL VALIDITY
+
INTERNAL and EXTERNAL CONSISTENCY
+
BIOLOGICAL AND CLINICAL PLAUSIBILITY
How true ?1
![Page 8: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/8.jpg)
EXTERNAL VALIDITY
♦ Pt characteristics
♦ Therapeutic regimen
♦ Compliance
♦ Comparator arm
How generalizable ?2
![Page 9: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/9.jpg)
Clinical relevance vs statistical significance
How relevant ?3
![Page 10: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/10.jpg)
1. Size of benefit?
2. Which endpoints? OS PFS RFS RR QOL
3. How were these expressed? Median , HR, % at….
4. Under which condition
5. How generalizable? external validity
6. Which toxicity?
(Which cost?)
How relevant ?3
![Page 11: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/11.jpg)
EFFICACY
Setting - curative vs palliative
- prognosis within palliative
Endpoint - type
- ways to summarize the efficacy endpoint
Size - delta
CLINICAL BENEFIT
TOXICITY CONVENIENCE
![Page 12: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/12.jpg)
A “model” of Kaplan–Meier figure showing the four OS-related parameters.
Reprinted from Clinical Cancer Research , © 2015, 21(5), 1036-1043, Alberto F. Sobrero, et al., Raising the Bar for Antineoplastic Agents: How to Choose
Threshold Values for Superiority Trials in Advanced Solid Tumors , with permission from AACR.
![Page 13: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/13.jpg)
THE FOUR WAYS TO ASSESS
OS BENEFIT
OS BENEFIT
Absolute and
proportional gain in long
term OS (2–3 years)
HR, hazard ratio; MST, median survival time; OS, overall survival.
HR and gain in MST
Sobrero, Bruzzi, Clin Ca Res 2015.
Large benefit for fewSmall benefit for many
![Page 14: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/14.jpg)
INCREASE IN MEDIAN PFS / OS
FOR DIFFERENT HR AS A FUNCTION
OF THE SEVERITY OF PROGNOSIS
MST / PFS in
control (months)
Increase in median values (months) as a function of HR
HR 0.9 HR 0.8 HR 0.7 HR 0.6 HR 0.5 HR 0.4
3 0.3 0.7 1.3 2 3 4.5
6 0.6 1.5 2 4 6 9
12 1.4 2 5 8 12 18
24 2.6 6 10 16 24 36
Clinically worthless Unrealistic
HR, hazard ratio; OS, overall survival; MST, median survival time; PFS, progression-free survival
![Page 15: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/15.jpg)
EFFICACY
♦ Toxic deaths
♦ Hospitalization rate
♦ Impact on QOL
♦ % grade 3-4 of symptomatic toxicity
♦ Need for growth factors
CLINICAL BENEFIT
TOXICITY CONVENIENCE
![Page 16: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/16.jpg)
INTERPRETATION
1. SUPERSTARS
2. INCREMENTALISTS
3. TRADE-OFFS
4. OUTCASTS
![Page 17: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/17.jpg)
INTERPRETATION OF NEW DATA
Are these data true?
Internal validity
Internal consistency
Plausibility
External consistency
Are they relevant?
External validity
Clinical benefit
Are they practice-changing?
‘Relevant enough’
![Page 18: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/18.jpg)
INTERPRETATION OF NEW DATA
Are these data true?
Internal validity stat. design, randomization endpoint , ITT
Internal consistency concordance among RR,PFS,OS
Plausibility philosophycal issue
External consistency results in other trials
Are they relevant?
External validity pt charact, schedule,compliance, comparator
Clinical benefit efficacy, toxicity, convenience
Are they practice-changing?
‘Relevant enough’ clinical benefit, clinical value
![Page 19: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/19.jpg)
CONCLUSIONS
Never be dogmatic
Consider internal validity
Consider external validity
Consider all aspects of efficacy
Consider the entire story, when available
![Page 20: INTERPRETATION OF CLINICAL TRIALS - OncologyPRO · INTERPRETATION OF NEW DATA Are these data true? Internal validity stat. design, randomization endpoint , ITT Internal consistency](https://reader033.fdocuments.us/reader033/viewer/2022060903/609f07746d425b1f5b7c94ec/html5/thumbnails/20.jpg)
Thank you!