Please use this identifier to cite or link to this item: http://hdl.handle.net/10419/149767
Year of Publication: 
2016
Series/Report no.: 
cemmap working paper No. CWP21/16
Publisher: 
Centre for Microdata Methods and Practice (cemmap), London
Abstract: 
This paper studies inference for the average treatment effect in randomized controlled trials with covariate-adaptive randomization. Here, by covariate-adaptive randomization, we mean randomization schemes that first stratify according to baseline covariates and then assign treatment status so as to achieve "balance" within each stratum. Such schemes include, for example, Efron's biased-coin design and stratified block randomization. When testing the null hypothesis that the average treatment effect equals a pre-specified value in such settings, we first show that the usual two-sample t-test is conservative in the sense that it has limiting rejection probability under the null hypothesis no greater than and typically strictly less than the nominal level. In a simulation study, we find that the rejection probability may in fact be dramatically less than the nominal level. We show further that these same conclusions remain true for a naive permutation test, but that a modified version of the permutation test yields a test that is non-conservative in the sense that its limiting rejection probability under the null hypothesis equals the nominal level for a wide variety of randomization schemes. The modified version of the permutation test has the additional advantage that it has rejection probability exactly equal to the nominal level for some distributions satisfying the null hypothesis and some randomization schemes. Finally, we show that the usual t-test (on the coefficient on treatment assignment) in a linear regression of outcomes on treatment assignment and indicators for each of the strata yields a non-conservative test as well under even weaker assumptions on the randomization scheme. In a simulation study, we find that the non-conservative tests have substantially greater power than the usual two-sample t-test.
Subjects: 
Covariate-adaptive randomization
stratified block randomization
Efron's biased-coin design
treatment assignment
randomized controlled trial
permutation test
two-sample t-test
strata fixed effects
JEL: 
C12
C14
Persistent Identifier of the first edition: 
Document Type: 
Working Paper

Files in This Item:
File
Size
639.03 kB





Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.