Please use this identifier to cite or link to this item:
Koetse, Mark J.
Florax, Raymond J.G.M.
de Groot, Henri L.F.
Year of Publication: 
Series/Report no.: 
Tinbergen Institute Discussion Paper 07-052/3
In this paper we use Monte Carlo simulation to investigate the impact of effect size heterogeneity on the results of a meta-analysis. Specifically, we address the small sample behaviour of the OLS, the fixed effects regression and the mixed effects meta-estimators under three alternative scenarios of effect size heterogeneity. We distinguish heterogeneity in effect size variance, heterogeneity due to a varying true underlying effect across primary studies, and heterogeneity due to a non-systematic impact of omitted variable bias in primary studies. Our results show that the mixed effects estimator is to be preferred to the other two estimators in the first two situations. However, in the presence of random effect size variation due to a non-systematic impact of omitted variable bias, using the mixed effects estimator may be suboptimal. We also address the impact of sample size and show that meta-analysis sample size is far more effective in reducing meta-estimator variance and increasing the power of hypothesis testing than primary study sample size.
Effect size heterogeneity
Monte Carlo simulation
fixed effects regression estimator
mixed effects estimator
Document Type: 
Working Paper

Files in This Item:
212.11 kB

Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.