Lessons from a Decade of Replications at the Quarterly Journal of Political Science
Date
2016-04
Authors
Journal Title
Journal ISSN
Volume Title
Repository Usage Stats
views
downloads
Citation Stats
Abstract
<jats:title>ABSTRACT</jats:title><jats:p>To allow researchers to investigate not only whether a paper’s methods are theoretically sound but also whether they have been properly implemented and are robust to alternative specifications, it is necessary that published papers be accompanied by their underlying data and code. This article describes experiences and lessons learned at the<jats:italic>Quarterly Journal of Political Science</jats:italic>since it began requiring authors to provide this type of replication code in 2005. It finds that of the 24 empirical papers subjected to in-house replication review since September 2012, only four packages did not require any modifications. Most troubling, 14 packages (58%) had results in the paper that differed from those generated by the author’s own code. Based on these experiences, this article presents a set of guidelines for authors and journals for improving the reliability and usability of replication packages.</jats:p>
Type
Department
Description
Provenance
Subjects
Citation
Permalink
Published Version (Please cite this version)
Publication Info
Eubank, Nicholas (2016). Lessons from a Decade of Replications at the Quarterly Journal of Political Science. PS: Political Science & Politics, 49(02). pp. 273–276. 10.1017/s1049096516000196 Retrieved from https://hdl.handle.net/10161/25417.
This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.
Collections
Scholars@Duke
Nicholas Eubank
I am an Assistant Research Professor in the Duke Social Science Research Institute (SSRI), where I study a range of topics related to political accountability, include gerrymandering, social networks, election administration and race and incarceration.
Unless otherwise indicated, scholarly articles published by Duke faculty members are made available here with a CC-BY-NC (Creative Commons Attribution Non-Commercial) license, as enabled by the Duke Open Access Policy. If you wish to use the materials in ways not already permitted under CC-BY-NC, please consult the copyright owner. Other materials are made available here through the author’s grant of a non-exclusive license to make their work openly accessible.