Please use this identifier to cite or link to this item: http://hdl.handle.net/10419/234837
Authors: 
Asanov, Igor
Bühren, Christoph
Zacharodimou, Panagiota
Year of Publication: 
2020
Series/Report no.: 
MAGKS Joint Discussion Paper Series in Economics No. 32-2020
Publisher: 
Philipps-University Marburg, School of Business and Economics, Marburg
Abstract: 
The replicability and credibility crisis in psychology and economics sparked the debate on underpowered experiments, publication biases, and p-hacking. Analyzing the number of independent observations of experiments published in Experimental Economics, Games and Economic Behavior, and the Journal of Economic Behavior and Organization, we observe that we did not learn much from this debate. The median experiment in our sample has too few independent observations and, thus, is underpowered. Moreover, we find indications for biases in reporting highly significant results. We investigate for which papers and experiments it is more likely to find reporting biases, and we suggest remedies that could help to overcome the replicability crisis.
Subjects: 
Statistical power
statistical significance
meta-study
balanced randomization
caliper test
JEL: 
C10
C12
C18
Document Type: 
Working Paper

Files in This Item:
File
Size
651.51 kB





Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.