Maximum type I error rate inflation from sample size reassessment when investigators are blind to treatment labels

Stat Med. 2016 May 30;35(12):1972-84. doi: 10.1002/sim.6848. Epub 2015 Dec 23.

Abstract

Consider a parallel group trial for the comparison of an experimental treatment to a control, where the second-stage sample size may depend on the blinded primary endpoint data as well as on additional blinded data from a secondary endpoint. For the setting of normally distributed endpoints, we demonstrate that this may lead to an inflation of the type I error rate if the null hypothesis holds for the primary but not the secondary endpoint. We derive upper bounds for the inflation of the type I error rate, both for trials that employ random allocation and for those that use block randomization. We illustrate the worst-case sample size reassessment rule in a case study. For both randomization strategies, the maximum type I error rate increases with the effect size in the secondary endpoint and the correlation between endpoints. The maximum inflation increases with smaller block sizes if information on the block size is used in the reassessment rule. Based on our findings, we do not question the well-established use of blinded sample size reassessment methods with nuisance parameter estimates computed from the blinded interim data of the primary endpoint. However, we demonstrate that the type I error rate control of these methods relies on the application of specific, binding, pre-planned and fully algorithmic sample size reassessment rules and does not extend to general or unplanned sample size adjustments based on blinded data. © 2015 The Authors. Statistics in Medicine Published by John Wiley & Sons Ltd.

Keywords: adaptive clinical trials; blinded interim analysis; block randomization; random allocation; sample size reassessment; type I error rate control.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Clinical Trials, Phase III as Topic / methods
  • Drug Labeling / standards
  • Drug Labeling / statistics & numerical data
  • Endpoint Determination
  • Fingolimod Hydrochloride / adverse effects
  • Fingolimod Hydrochloride / therapeutic use
  • Humans
  • Models, Statistical
  • Multiple Sclerosis, Relapsing-Remitting / drug therapy
  • Random Allocation
  • Randomized Controlled Trials as Topic / methods*
  • Randomized Controlled Trials as Topic / statistics & numerical data
  • Research Design / statistics & numerical data*
  • Sample Size*
  • Single-Blind Method*

Substances

  • Fingolimod Hydrochloride