Reproducible Research in Computational Science
Abstract
Computational science has led to exciting new developments, but the nature of the work has exposed limitations in our ability to evaluate published findings. Reproducibility has the potential to serve as a minimum standard for judging scientific claims when full independent replication of a study is not possible.
Get full access to this article
View all available purchase options and get full access to this article.
References
1
Hanson B., Sugden A., Alberts B., Making data maximally available. Science 331, 649 (2011).
2
Peng R. D., Dominici F., Zeger S. L., Reproducible epidemiologic research. Am. J. Epidemiol. 163, 783 (2006).
3
J. P. Madrid, D. Macchetto, Bull. AAS, http://arxiv.org/abs/0901.4552 (2009).
4
Schwab M., Karrenbach N., Claerbout J., Making scientific computations reproducible. Comput. Sci. Eng. 2, 61 (2000).
5
Laine C., Goodman S. N., Griswold M. E., Sox H. C., Reproducible research: Moving toward research the public can really trust. Ann. Intern. Med. 146, 450 (2007).
6
King G., Replication, Replication. PS: Polit. Sci. Polit. 28, 444 (1995).
7
R. Gentleman, Stat. Appl. Genet. Mol. Biol. 4, article 2 (2005).
8
Yale Law School Roundtable on Data and Code Sharing, Comput. Sci. Eng. 12, 8 (2010).
9
Ioannidis J. P. A., et al., Repeatability of published microarray gene expression analyses. Nat. Genet. 41, 149 (2009).
10
Mesirov J. P., Computer science. Accessible reproducible research. Science 327, 415 (2010).
11
Peng R. D., Reproducible research and biostatistics. Biostatistics 10, 405 (2009).
12
McCullough B. D., McGeary K. A., Harrison T. D., Do economics journal archives promote replicable research? Can. J. Econ. 41, 1406 (2008).
13
Barnes N., Publish your computer code: It is good enough. Nature 467, 753 (2010).
(0)eLetters
eLetters is a forum for ongoing peer review. eLetters are not edited, proofread, or indexed, but they are screened. eLetters should provide substantive and scholarly commentary on the article. Embedded figures cannot be submitted, and we discourage the use of figures within eLetters in general. If a figure is essential, please include a link to the figure within the text of the eLetter. Please read our Terms of Service before submitting an eLetter.
Log In to Submit a ResponseNo eLetters have been published for this article yet.
Information & Authors
Information
Published In
Science
Volume 334 | Issue 6060
2 December 2011
2 December 2011
Copyright
Copyright © 2011, American Association for the Advancement of Science.
Submission history
Published in print: 2 December 2011
Authors
Metrics & Citations
Metrics
Article Usage
Altmetrics
Citations
Cite as
- Roger D. Peng
Export citation
Select the format you want to export the citation of this publication.
Cited by
- Reproducibility challenges in robotic surgery, Frontiers in Robotics and AI, 10, (2023).https://doi.org/10.3389/frobt.2023.1127972
- Maximizing the utility of public data, Frontiers in Genetics, 14, (2023).https://doi.org/10.3389/fgene.2023.1106631
- K-span: Open and reproducible spatial analytics using scientific workflows, Frontiers in Earth Science, 11, (2023).https://doi.org/10.3389/feart.2023.1130262
- A mentorship and incubation program using project-based learning to build a professional bioinformatics pipeline in Kenya, PLOS Computational Biology, 19, 3, (e1010904), (2023).https://doi.org/10.1371/journal.pcbi.1010904
- An implementation framework to improve the transparency and reproducibility of computational models of infectious diseases, PLOS Computational Biology, 19, 3, (e1010856), (2023).https://doi.org/10.1371/journal.pcbi.1010856
- Lyrics and melodies: Do both affect emotions equally? A replication and extension of Ali and Peynircioğlu (2006), Musicae Scientiae, (102986492211491), (2023).https://doi.org/10.1177/10298649221149109
- On Developing Better Practices for Reproducible Data Analysis in Laboratory Medicine, The Journal of Applied Laboratory Medicine, 8, 1, (229-231), (2023).https://doi.org/10.1093/jalm/jfac097
- The Case for Including Data and Code with ML Publications in Laboratory Medicine, The Journal of Applied Laboratory Medicine, 8, 1, (213-216), (2023).https://doi.org/10.1093/jalm/jfac088
- Open data policy and journal impacts: a synthetic difference-in-differences approach, Applied Economics Letters, (1-6), (2023).https://doi.org/10.1080/13504851.2023.2187017
- Multi-level parallel multi-layer block reproducible summation algorithm, Parallel Computing, 115, (102996), (2023).https://doi.org/10.1016/j.parco.2023.102996
- See more
Loading...
View Options
Check Access
Log in to view the full text
AAAS login provides access to Science for AAAS Members, and access to other journals in the Science family to users who have purchased individual subscriptions.
- Become a AAAS Member
- Activate your AAAS ID
- Purchase Access to Other Journals in the Science Family
- Account Help
Log in via OpenAthens.
Log in via Shibboleth.
More options
Purchase digital access to this article
Download and print this article for your personal scholarly, research, and educational use.
Buy a single issue of Science for just $15 USD.