Lessons from a Decade of Replications at the Quarterly Journal of Political Science

dc.contributor.author

Eubank, Nicholas

dc.date.accessioned

2022-06-30T17:00:02Z

dc.date.available

2022-06-30T17:00:02Z

dc.date.issued

2016-04

dc.date.updated

2022-06-30T17:00:02Z

dc.description.abstract

<jats:title>ABSTRACT</jats:title><jats:p>To allow researchers to investigate not only whether a paper’s methods are theoretically sound but also whether they have been properly implemented and are robust to alternative specifications, it is necessary that published papers be accompanied by their underlying data and code. This article describes experiences and lessons learned at the<jats:italic>Quarterly Journal of Political Science</jats:italic>since it began requiring authors to provide this type of replication code in 2005. It finds that of the 24 empirical papers subjected to in-house replication review since September 2012, only four packages did not require any modifications. Most troubling, 14 packages (58%) had results in the paper that differed from those generated by the author’s own code. Based on these experiences, this article presents a set of guidelines for authors and journals for improving the reliability and usability of replication packages.</jats:p>

dc.identifier.issn

1049-0965

dc.identifier.issn

1537-5935

dc.identifier.uri

https://hdl.handle.net/10161/25417

dc.language

en

dc.publisher

Cambridge University Press (CUP)

dc.relation.ispartof

PS: Political Science & Politics

dc.relation.isversionof

10.1017/s1049096516000196

dc.title

Lessons from a Decade of Replications at the Quarterly Journal of Political Science

dc.type

Journal article

duke.contributor.orcid

Eubank, Nicholas|0000-0001-5159-4740

pubs.begin-page

273

pubs.end-page

276

pubs.issue

02

pubs.organisational-group

Duke

pubs.organisational-group

Institutes and Provost's Academic Units

pubs.organisational-group

University Institutes and Centers

pubs.organisational-group

Social Science Research Institute

pubs.publication-status

Published

pubs.volume

49

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
lessons-from-a-decade-of-replications-at-the-quarterly-journal-of-political-science.pdf
Size:
91.04 KB
Format:
Adobe Portable Document Format
Description:
Published version