Can Results-Free Review Reduce Publication Bias? The Results and Implications of a Pilot Study

Loading...
Thumbnail Image

Date

2016-11

Journal Title

Journal ISSN

Volume Title

Repository Usage Stats

115
views
102
downloads

Citation Stats

Attention Stats

Abstract

© 2016, © The Author(s) 2016. In 2015, Comparative Political Studies embarked on a landmark pilot study in research transparency in the social sciences. The editors issued an open call for submissions of manuscripts that contained no mention of their actual results, incentivizing reviewers to evaluate manuscripts based on their theoretical contributions, research designs, and analysis plans. The three papers in this special issue are the result of this process that began with 19 submissions. In this article, we describe the rationale for this pilot, expressly articulating the practices of preregistration and results-free review. We document the process of carrying out the special issue with a discussion of the three accepted papers, and critically evaluate the role of both preregistration and results-free review. Our main conclusions are that results-free review encourages much greater attention to theory and research design, but that it raises thorny problems about how to anticipate and interpret null findings. We also observe that as currently practiced, results-free review has a particular affinity with experimental and cross-case methodologies. Our lack of submissions from scholars using qualitative or interpretivist research suggests limitations to the widespread use of results-free review.

Department

Description

Provenance

Citation

Published Version (Please cite this version)

10.1177/0010414016655539

Publication Info

Findley, MG, NM Jensen, EJ Malesky and TB Pepinsky (2016). Can Results-Free Review Reduce Publication Bias? The Results and Implications of a Pilot Study. Comparative Political Studies, 49(13). pp. 1667–1703. 10.1177/0010414016655539 Retrieved from https://hdl.handle.net/10161/17730.

This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.

Scholars@Duke

Malesky

Edmund Malesky

Professor of Political Science

Malesky is a specialist on Southeast Asia, particularly Vietnam. Currently, Malesky's research agenda is very much at the intersection of Comparative and International Political Economy, falling into three major categories: 1) Authoritarian political institutions and their consequences; 2) The political influence of foreign direct investment and multinational corporations; and 3) Political institutions, private business development, and formalization.


Unless otherwise indicated, scholarly articles published by Duke faculty members are made available here with a CC-BY-NC (Creative Commons Attribution Non-Commercial) license, as enabled by the Duke Open Access Policy. If you wish to use the materials in ways not already permitted under CC-BY-NC, please consult the copyright owner. Other materials are made available here through the author’s grant of a non-exclusive license to make their work openly accessible.