The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH...
-
Upload
rodolfo-tamblyn -
Category
Documents
-
view
221 -
download
1
Transcript of The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH...
![Page 1: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/1.jpg)
The role of the Statisticianin Data Monitoring Committees (DMC)
Fritz SchindelAccovion GmbH
Marburg - Germany
![Page 2: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/2.jpg)
Apr 18, 2023 2
Overview
Regulatory background
DMC membership
Statistical contents of charter/protocol
Resulting tasks
Efficacy vs. safety monitoring
Sponsor requests to DMC
Other real life experiences…
Interactions with regulatory agencies
Conclusions
![Page 3: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/3.jpg)
Apr 18, 2023 3
Regulatory background
EMEA guideline on DMCs (Jan 2006)
FDA guidance “Establishment & Operation of DMC” (March 2006)
ICH E9 ”statistical principles for clinical trials” (1998)
Some implications discussed in following slides
![Page 4: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/4.jpg)
Apr 18, 2023 4
All studies need safety monitoring ...
but not all need a DMC
DMCs are- expensive- time consuming- cumbersome
preferred use in controlled, large multicenter (pivotal) studies
![Page 5: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/5.jpg)
Apr 18, 2023 5
What trials need a DMC?
When combination of investigator, sponsor, IRB and regulatory agency insufficient to monitor safety
When interim analysis covers efficacy related decisions (e.g. adaptive designs)
Goal: minimize risk to trial participants, while protecting scientific validity
![Page 6: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/6.jpg)
Apr 18, 2023 6
Examples for a DMC need
Life-threatening diseases
Long-term studies with non life-threatening indication
Vulnerable population (e.g. children, pregnancy, ...)
Interim analysis with stopping rule for overwhelming efficacy or futility
Adaptive design with selection of a best treatment or increase of sample size
![Page 7: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/7.jpg)
Apr 18, 2023 7
DMC membership
Scientific expertise with indication / conduct of clinical trials
Chair person with prior DMC experience
Independent of sponsor, except for reasonable reimbursement of efforts within DMC
No conflict of interest
![Page 8: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/8.jpg)
Apr 18, 2023 8
Conflict of interest - Examples
Employees of sponsor
Study investigators
Planned authorship
Financial interest in outcome (e.g., shareholder)
Member of parallel DMC with same indication, but different sponsor
![Page 9: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/9.jpg)
Apr 18, 2023 9
Constitutive DMC meeting
Early enough to give feed back on study protocol
Discuss draft charter (incl. deliverables for DMC tasks)
Plan resource allocation, incl. those of DMC members
Appoint chair person
Rules for face-to-face vs. telecon meetings
![Page 10: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/10.jpg)
Apr 18, 2023 10
Statistical contents of charter / protocol
Essentials (e.g. frequency of interim analyses, control of type I error, futility rules) to be laid down in study protocol
If safety only is addressed, statistical methods may be spelled out in charter document
Charter can define role of statistician as full (voting) member vs. reporting (non voting) member
Restrict distribution of unblinded information to DMC members
![Page 11: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/11.jpg)
Apr 18, 2023 11
Study Sites Clinical DB(sponsor)
DMC statistician DMC
members
Pharmaco-vigilance DB
(sponsor)
Randomization center
SAE
CRFs
blinded unblinded
Flow of information - Example
![Page 12: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/12.jpg)
Apr 18, 2023 12
The experienced DMC statistician ...
is able to draft/contribute to the DMC charter, based on a study protocol and applicable guidelines
takes over full responsibility in DMC
reports/comments the unblinded study results to DMC members
assures confidentiality of the analysis process/resultsin the respective programming environment (e.g., via internal SOP)
![Page 13: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/13.jpg)
Apr 18, 2023 13
The experienced team statistician ...
cannot serve on DMC since access to unblinded data is necessary
plays a critical role in compiling data sets with adequate quality for submission to DMC statistician
is a window person for the DMC statistician to familiarize with complex statistical protocol aspects
![Page 14: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/14.jpg)
Apr 18, 2023 14
Safety vs. efficacy monitoring
Repeated (unadjusted) safety monitoring is usually accepted in view of a reduced consumer (patient) risk
No strict rules given with respect to level of significance
Repeated (unadjusted) efficacy monitoring increases the consumer risk of facing an inefficient drug, while lowering the producer (sponsor) risk of not getting approval for an efficient drug
This requires a strict control of the type 1 error (e.g. via an α spending approach)
![Page 15: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/15.jpg)
Apr 18, 2023 15
Frequent intentions of interim efficacy looks
Stop for overwhelming evidence (α spending with early, low stop boundary)
Stop for futility (conditional power / probability of success low)
Increase the sample size to maintain adequate power in the final analysis
Drop a non-promising treatment arm
![Page 16: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/16.jpg)
Apr 18, 2023 16
Futility and α spending
Futility and α spending rules can be combined
This leads to less conservative rules for claiming efficacy e.g. at a later stage
Caveat: stop boundary for futility must be strictly adhered to, which is sometimes questioned by agencies
![Page 17: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/17.jpg)
Apr 18, 2023 17
Futility and sample size adaptation
Futility and sample size adaptation can be combined
This limits the overall sample size increase (when effect poorer than anticipated), while stopping otherwise (lost cause in terms of budget or clinically non-relevant effect)
Usually, this approach does not require an adjustment of the α level
![Page 18: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/18.jpg)
Apr 18, 2023 18
The overrun case
In the rare case of early, overwhelming efficacy, recruitment will usually progress beyond the point in time from which the stop decision was made
This overrun requires a later, 2-nd analysis with all data acquired
Treatment effects derived from the 2 analyses will usually lead to similar conclusions
A noteworthy, diluted effect in the 2-nd analysis, would cast doubts on the claimed overwhelming evidence, though
![Page 19: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/19.jpg)
Apr 18, 2023 19
Group (A, B, ..) vs. full unblinding
Has triggered controversial discussions in the past
Full access to actual study treatment is now recommended for DMC members (US guideline)
Balancing of risks vs. benefits could be hampered, otherwise
![Page 20: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/20.jpg)
Apr 18, 2023 20
Open vs. closed meetings
Open part involves sponsor (non-voting) representatives (e.g. team statistician)
Closed part reserved to voting members(with insight to unblinded results), & possibly consultants (e.g. from adjudication panel)
Keep meeting minutes on both, for immediate (open part) and later (closed part) transfer to sponsor
![Page 21: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/21.jpg)
Apr 18, 2023 21
DMC recommendations
Continue without changes
Consider steps to improve data quality
Modify study protocol (e.g. stop recruitment to a subgroup, add a safety parameter)
Termination of study
DMC is not bound to stoic (absolute) implementation of study protocol: a DMC recommendation should always consider the totality of evidence emerging from the trial, e.g. risks and benefits
![Page 22: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/22.jpg)
Apr 18, 2023 22
To whom a DMC reports
Trial (steering) committee with executive power
Sponsor responsible body in charge of study conduct
Recommendations are not formally binding…
… but unlikely to be ignored
![Page 23: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/23.jpg)
Apr 18, 2023 23
Sponsor requests to DMC - Examples
Legitimate: provide pooled analyses of criticalAEs, relation to prognostic
variables
Semi-legitimate: provide conditional power at time of
interim analysis, e.g. for futilitydecision
Not legitimate: provide p-value of treatment effect
at interim analysis
![Page 24: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/24.jpg)
Apr 18, 2023 24
Real life experiences - 1
DMC member was also a member of the steering committee for a competing study with another sponsor
… and therefore had to abstain from actual DMC participation
![Page 25: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/25.jpg)
Apr 18, 2023 25
Real life experiences - 2
DMC statistician recommended to exclude from efficacy analyses subjects with non-confirmed disease under study (lab diagnosis)
… which later prompted FDA to disagree, since this was not supported by the protocol or SAP (clinical diagnosis)
![Page 26: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/26.jpg)
Apr 18, 2023 26
Real life experiences - 3
In a large cardiovascular trial, more intracranial bleeds were observed during a planned safety interim analysis with a new substance, as compared to the active reference (0.01 < p < 0.05)
This triggered hard discussions on the required level of statistical significance
Study was stopped in the end, since information from a competing trial with a similar agent went into same direction
![Page 27: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/27.jpg)
Apr 18, 2023 27
Interaction with regulatory agencies
Some DMC recommendations (e.g. stop for overwhelming efficacy) may trigger a controversial reaction from regulatory agencies
Example: efficacy claim is acceptable but safety experience is deemed too small by agency
To avoid surprises, inform agency on intended stop of trial, before execution
![Page 28: The role of the Statistician in Data Monitoring Committees (DMC) Fritz Schindel Accovion GmbH Marburg - Germany.](https://reader036.fdocuments.us/reader036/viewer/2022081513/56649c915503460f9494b922/html5/thumbnails/28.jpg)
Apr 18, 2023 28
Conclusions (Pros & Cons) – DMCs are ...
time consuming, expensive
adding complexity
can maintain study integrity
can implement flexible designs
can speed up a process (early stop saves costs)
… and therefore:
weigh up pros & cons before setting one up
and make sure it has a clear goal