文章基本信息

标题：An empirical analysis of journal policy effectiveness for computational reproducibility
本地全文：下载
作者：Victoria Stodden ; Jennifer Seiler ; Zhaokun Ma 等
期刊名称：Proceedings of the National Academy of Sciences
印刷版ISSN：0027-8424
电子版ISSN：1091-6490
出版年度：2018
卷号：115
期号：11
页码：2584-2589
DOI：10.1073/pnas.1708290115
语种：English
出版社：The National Academy of Sciences of the United States of America
摘要：A key component of scientific communication is sufficient information for other researchers in the field to reproduce published findings. For computational and data-enabled research, this has often been interpreted to mean making available the raw data from which results were generated, the computer code that generated the findings, and any additional information needed such as workflows and input parameters. Many journals are revising author guidelines to include data and code availability. This work evaluates the effectiveness of journal policy that requires the data and code necessary for reproducibility be made available postpublication by the authors upon request. We assess the effectiveness of such a policy by ( i ) requesting data and code from authors and ( ii ) attempting replication of the published findings. We chose a random sample of 204 scientific papers published in the journal Science after the implementation of their policy in February 2011. We found that we were able to obtain artifacts from 44% of our sample and were able to reproduce the findings for 26%. We find this policy—author remission of data and code postpublication upon request—an improvement over no policy, but currently insufficient for reproducibility.
关键词：reproducible research ; data access ; code access ; reproducibility policy ; open science