Please use this identifier to cite or link to this item: https://hdl.handle.net/10419/101337 
Year of Publication: 
2014
Series/Report no.: 
IFS Working Papers No. W14/10
Publisher: 
Institute for Fiscal Studies (IFS), London
Abstract: 
One of the most powerful critiques of the use of randomised experiments in the social sciences is the possibility that individuals might react to the randomisation itself, thereby rendering the causal inference from the experiment irrelevant for policy purposes. In this paper we set out a theoretical framework for the systematic consideration of "randomisation bias", and provide what is to our knowledge the first empirical evidence on this form of bias in an actual social experiment, the UK Employment Retention and Advancement (ERA) study. Specifically, we empirically test the extent to which random assignment has affected the process of participation in the ERA study. We further propose a non-experimental way of assessing the extent to which the treatment effects stemming from the experimental sample are representative of the impacts that would have been experienced by the population who would have been exposed to the program in routine mode. We consider both the case of administrative outcome measures available for the entire relevant sample and of survey-based outcome measures. For the case of survey outcomes we extend our estimators to also account for selective non-response based on observed characteristics. Both for the case of administrative and survey data we further extend our proposed estimators to deal with the nonlinear case of binary outcomes.
Subjects: 
social experiments
randomisation bias
sample selection
treatment effects
matching methods
reweighting estimators
JEL: 
C21
J18
J38
Persistent Identifier of the first edition: 
Document Type: 
Working Paper

Files in This Item:
File
Size
605.39 kB





Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.