Impact of lack-of-benefit stopping rules on treatment effect estimates of two-arm multi-stage (TAMS) trials with time to event outcome

Trials. 2013 Jan 23:14:23. doi: 10.1186/1745-6215-14-23.

Abstract

Background: In 2011, Royston et al. described technical details of a two-arm, multi-stage (TAMS) design. The design enables a trial to be stopped part-way through recruitment if the accumulating data suggests a lack of benefit of the experimental arm. Such interim decisions can be made using data on an available 'intermediate' outcome. At the conclusion of the trial, the definitive outcome is analyzed. Typical intermediate and definitive outcomes in cancer might be progression-free and overall survival, respectively. In TAMS designs, the stopping rule applied at the interim stage(s) affects the sampling distribution of the treatment effect estimator, potentially inducing bias that needs addressing.

Methods: We quantified the bias in the treatment effect estimator in TAMS trials according to the size of the treatment effect and for different designs. We also retrospectively 'redesigned' completed cancer trials as TAMS trials and used the bootstrap to quantify bias.

Results: In trials in which the experimental treatment is better than the control and which continue to their planned end, the bias in the estimate of treatment effect is small and of no practical importance. In trials stopped for lack of benefit at an interim stage, the treatment effect estimate is biased at the time of interim assessment. This bias is markedly reduced by further patient follow-up and reanalysis at the planned 'end' of the trial.

Conclusions: Provided that all patients in a TAMS trial are followed up to the planned end of the trial, the bias in the estimated treatment effect is of no practical importance. Bias correction is then unnecessary.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Clinical Trials as Topic / methods*
  • Clinical Trials as Topic / statistics & numerical data
  • Computer Simulation
  • Data Interpretation, Statistical
  • Disease-Free Survival
  • Early Termination of Clinical Trials* / statistics & numerical data
  • Endpoint Determination
  • Evidence-Based Medicine* / statistics & numerical data
  • Female
  • Humans
  • Ovarian Neoplasms / mortality
  • Ovarian Neoplasms / therapy
  • Proportional Hazards Models
  • Reproducibility of Results
  • Research Design* / statistics & numerical data
  • Retrospective Studies
  • Sample Size
  • Selection Bias
  • Time Factors
  • Treatment Outcome