Biostatistics Case Studies 2006
description
Transcript of Biostatistics Case Studies 2006
![Page 1: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/1.jpg)
Biostatistics Case Studies 2006
Peter D. Christenson
Biostatistician
http://gcrc.LAbiomed.org/Biostat
Session 1:
Demonstrating Equivalence of Active Treatments:
Non-inferiority Studies
Self-Quiz
![Page 2: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/2.jpg)
Self-Quiz
1. Give an example in your specialty area for a superiority /inferiority study. Now modify it to an equivalence study. Now modify it to a non-inferiority study.
![Page 3: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/3.jpg)
Self-Quiz
1. Answer
Vaccine Testing:
Superiority: New candidate vaccine vs. placebo
Equivalence: Antigen potency between two manufacturing plants or lots.
Non-Inferiority: New candidate vaccine vs. old one.
![Page 4: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/4.jpg)
Self-Quiz
2. T or F: The main point about non-inferiority studies is that we are asking whether a treatment is as good or better vs. worse than another treatment, so it uses a one-sided test.
![Page 5: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/5.jpg)
Self-Quiz
2. Answer
False. That is a feature of these studies, but not their distinguishing feature. They and equivalence studies are used to try to prove sameness, as opposed to typical sydies that try to prove differences.
![Page 6: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/6.jpg)
Self-Quiz
3. Power for a typical superiority test is the likelihood that you will declare treatment differences (p<0.05) if treatments really differ by some magnitude Δ. Explain what power means for a non-inferiority study.
![Page 7: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/7.jpg)
Self-Quiz
3. Answer
Power for a non-inferiority study is the likelihood that you will declare treatment A to be no worse than a pre-specified magnitude E from B (p<0.05) if treatments really differ by some Δ. Of course, Δ is less than E, and is often 0.
![Page 8: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/8.jpg)
Self-Quiz
4. T or F: Last-value-carried-forward is a good way to handle drop-outs in a non-inferiority study. Explain.
![Page 9: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/9.jpg)
Self-Quiz
4. Answer
False. LVCF biases results toward less of a difference. This makes typical superiority studies conservative, but increases the chance of a falsely “proving” the aim.
![Page 10: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/10.jpg)
Self-Quiz
5. Many comparative studies have an evaluator who is masked (blinded) as to subjects’ treatment, especially for subjective outcomes, to prevent bias. Explain how such an evaluator in a non-inferiority study has the power to completely bias the results to prove the aim, if the outcome is a final value rather than change score.
![Page 11: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/11.jpg)
Self-Quiz
5. Answer
The evaluator merely has to rate everyone very similarly to be absolutely sure for the aim to be shown. If he is worried that within-group differences will be too small and arouse suspicion, just randomly rate everyone within normal ranges, to be ~95% sure.
Note that this cannot be done if the outcome is a change score from baseline, and if the evaluator does not know the baseline score.
![Page 12: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/12.jpg)
Self-Quiz
6. T or F: In a non-inferiority study, you should first test for non-inferiority with a confidence interval, and then use a t-test to test for superiority, but only if non-inferiority was established at the first step.
![Page 13: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/13.jpg)
Self-Quiz
6. Answer
False. You must specify a-priori superiority, in order to have a legitimate claim of proving it (beyond a reasonable (5%) doubt). The stated sequential strategy will only allow you to claim an observed result, without a statement about it’s certainty.
![Page 14: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/14.jpg)
Self-Quiz
7. What is the meaning of the equivalence margin, and how do you determine it?
![Page 15: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/15.jpg)
Self-Quiz
7. Answer
The equivalence margin is the maximum difference between treatments that is considered to be negligible or unimportant.
It must be pre-specified in order to prove equivalence or non-inferiority to that degree, rather than just noting it as an observation. Thus, it is ideally determined by peer-agreement or FDA concurrence prior to starting the study.
![Page 16: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/16.jpg)
Self-Quiz
8. What do you conclude if the CI for treatment difference does not lie to the left of the equivalence margin?
![Page 17: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/17.jpg)
Self-Quiz
8. Answer
We conclude that non-inferiority was not proven.
Based on the range of values in the CI, we may also note that the study was underpowered (e.g., CI centered near equivalence and wide), or observe that inferiority is likely (e.g., narrow CI to the right of the equivalence margin.
![Page 18: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/18.jpg)
Self-Quiz
9. Suppose the primary outcome for a study is a serum inflammatory marker. If it’s assay is poor (low reproducibility), then it is more difficult to find treatment differences in a typical superiority/inferiority study than for a better assay, due to this noise. Would it be easier or more difficult to find non-inferiority with this assay, compared to a better assay?
![Page 19: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/19.jpg)
Self-Quiz
9. Answer
It would still be more difficult to show the aim, non-inferiority here, since CIs will be wider, but there will be no bias due to it toward either treatment.
Generally, poorer study conduct is penalized in superiority studies and rewarded in non-inferiority studies, but that is not true for this type of poorer measurement error.
![Page 20: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/20.jpg)
Self-Quiz
10.Does the assumed treatment difference (0.5 here) for power calculations have the same meaning as the difference used for power calculations in a typical superiority/inferiority study?
![Page 21: Biostatistics Case Studies 2006](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814a47550346895db7650c/html5/thumbnails/21.jpg)
Self-Quiz
10.Answer
No. Here, it is our best estimate of true treatment differences.
For superiority studies, the difference is ideally the minimal difference that is “clinically relevant”, not the expected difference, closer in meaning to the equivalence margin here. In practice, it is the smallest difference that logistics, money, time, and effort will allow us to detect with specified certainty.