Publication bias is when academic journals make publication of a paper contingent on the results obtained. How big of an issue is this really?
This podcast is an audio read through of the (initial version of the) article Publication Bias is Real, published on New Things Under the Sun.
Articles mentioned:
Frankel, Alexander and Maximilian Kasy. Forthcoming. Which findings should be published? American Economic Journal: Microeconomics. https://www.aeaweb.org/articles?id=10.1257/mic.20190133&&from=f
Breznau, Nate, Eike Mark Rinke, Alexander Wuttke, Muna Adem, Jule Adriaans, Amalia Alvarez-Benjumea, Henrik K. Andersen, et al. 2021. Observing Many Researchers Using the Same Data and Hypothesis Reveals a Hidden Universe of Uncertainty. MetaArXiv. March 24. doi:10.31222/osf.io/cd5j9.
Dwan, Kerry, Douglas G. Altman, Juan A. Arnaiz, Jill Bloom, An-Wen Chan, Eugenia Cronin, et al. 2008. Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias. PLoS ONE 3(8): e3081. https://doi.org/10.1371/journal.pone.0003081
Franco, Annie, Neil Malhotra, and Gabor Simonovits. 2014. Publication bias in the social sciences: Unlocking the file drawer. Science 345(6203): 1502-1505. DOI: 10.1126/science.1255484
Andrews, Isaiah, and Maximilian Kasy. 2019. Identification of and Correction for Publication Bias. American Economic Review 109(8): 2766-94. https://doi.org/10.1257/aer.20180310
Camerer, Colin F., Anna Deber, Eskil Forsell, Teck-Hua Ho, Jürgen Huber, Magnus Johanson et al. 2016. Evaluating replicability of laboratory experiments in economics. Science 351(6280): 1433-1436. https://doi.org/10.1126/science.aaf0918
Open Science Collaboration. 2015. Estimating the reproducibility of psychological science. Science 349(6251) aac4716. https://doi.org/10.1126/science.aac4716
Christensen, Garret, and Edward Miguel. 2018. Transparency, Reproducibility, and the Credibility of Economics Research. Journal of Economic Literature 56(3): 920-80. https://doi.org/10.1257/jel.20171350
Wolfson, Paul J., and Dale Belman. 2015. 15 years of research on U.S. employment and the minimum wage. Tuck School of Business Working Paper No. 2705499. http://dx.doi.