{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T09:29:39Z","timestamp":1772270979270,"version":"3.50.1"},"reference-count":31,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2017,12,18]],"date-time":"2017-12-18T00:00:00Z","timestamp":1513555200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>Computer science offers a large set of tools for prototyping, writing, running, testing, validating, sharing and reproducing results; however, computational science lags behind. In the best case, authors may provide their source code as a compressed archive and they may feel confident their research is reproducible. But this is not exactly true. James Buckheit and David Donoho proposed more than two decades ago that an article about computational results is advertising, not scholarship. The actual scholarship is the full software environment, code, and data that produced the result. This implies new workflows, in particular in peer-reviews. Existing journals have been slow to adapt: source codes are rarely requested and are hardly ever actually executed to check that they produce the results advertised in the article. ReScience is a peer-reviewed journal that targets computational research and encourages the explicit replication of already published research, promoting new and open-source implementations in order to ensure that the original research can be replicated from its description. To achieve this goal, the whole publishing chain is radically different from other traditional scientific journals. ReScience resides on GitHub where each new implementation of a computational study is made available together with comments, explanations, and software tests.<\/jats:p>","DOI":"10.7717\/peerj-cs.142","type":"journal-article","created":{"date-parts":[[2017,12,18]],"date-time":"2017-12-18T03:15:41Z","timestamp":1513566941000},"page":"e142","source":"Crossref","is-referenced-by-count":77,"title":["Sustainable computational science: the ReScience initiative"],"prefix":"10.7717","volume":"3","author":[{"given":"Nicolas P.","family":"Rougier","sequence":"first","affiliation":[{"name":"INRIA Bordeaux Sud-Ouest, Talence, France"}]},{"given":"Konrad","family":"Hinsen","sequence":"additional","affiliation":[{"name":"Centre de Biophysique Mol\u00e9culaire UPR4301, CNRS, Orl\u00e9ans, France"}]},{"given":"Fr\u00e9d\u00e9ric","family":"Alexandre","sequence":"additional","affiliation":[{"name":"INRIA Bordeaux Sud-Ouest, Talence, France"}]},{"given":"Thomas","family":"Arildsen","sequence":"additional","affiliation":[{"name":"Department of Electronic Systems, Technical Faculty of IT and Design, Aalborg University, Aalborg, Denmark"}]},{"given":"Lorena A.","family":"Barba","sequence":"additional","affiliation":[{"name":"Department of Mechanical and Aerospace Engineering, The George Washington University, Washington, D.C., USA"}]},{"given":"Fabien C.Y.","family":"Benureau","sequence":"additional","affiliation":[{"name":"INRIA Bordeaux Sud-Ouest, Talence, France"}]},{"given":"C. Titus","family":"Brown","sequence":"additional","affiliation":[{"name":"Department of Population Health and Reproduction, University of California Davis, Davis, CA, USA"}]},{"given":"Pierre","family":"de Buyl","sequence":"additional","affiliation":[{"name":"Instituut voor Theoretische Fysica, KU Leuven, Leuven, Belgium"}]},{"given":"Ozan","family":"Caglayan","sequence":"additional","affiliation":[{"name":"Laboratoire d\u2019Informatique (LIUM), Le Mans University, Le Mans, France"}]},{"given":"Andrew P.","family":"Davison","sequence":"additional","affiliation":[{"name":"UNIC FRE 3693, CNRS, Gif-sur-Yvette, France"}]},{"given":"Marc-Andr\u00e9","family":"Delsuc","sequence":"additional","affiliation":[{"name":"Institut de G\u00e9n\u00e9tique et de Biologie Mol\u00e9culaire et Cellulaire, Illkirch, France"}]},{"given":"Georgios","family":"Detorakis","sequence":"additional","affiliation":[{"name":"Department of Cognitive Sciences, University of California Irvine, Irvine, CA, USA"}]},{"given":"Alexandra K.","family":"Diem","sequence":"additional","affiliation":[{"name":"Computational Engineering and Design, University of Southampton, Southampton, United Kingdom"}]},{"given":"Damien","family":"Drix","sequence":"additional","affiliation":[{"name":"Humboldt Universit\u00e4t zu Berlin, Berlin, Germany"}]},{"given":"Pierre","family":"Enel","sequence":"additional","affiliation":[{"name":"Department of Neuroscience, Mount Sinai School of Medicine, New York, NY, USA"}]},{"given":"Beno\u00eet","family":"Girard","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Systems and Robotics, Sorbonne Universit\u00e9s - UPMC Univ Paris 06 - CNRS, Paris, France"}]},{"given":"Olivia","family":"Guest","sequence":"additional","affiliation":[{"name":"Experimental Psychology, University College London, London, Greater London, United Kingdom"}]},{"given":"Matt G.","family":"Hall","sequence":"additional","affiliation":[{"name":"UCL Great Ormond St Institute of Child Health, London, United Kingdom"}]},{"given":"Rafael N.","family":"Henriques","sequence":"additional","affiliation":[{"name":"Champalimaud Centre for the Unknown, Champalimaud Neuroscience Program, Lisbon, Portugal"}]},{"given":"Xavier","family":"Hinaut","sequence":"additional","affiliation":[{"name":"INRIA Bordeaux Sud-Ouest, Talence, France"}]},{"given":"Kamil S.","family":"Jaron","sequence":"additional","affiliation":[{"name":"Department of Ecology and Evolution, University of Lausanne, Lausanne, Switzerland"}]},{"given":"Mehdi","family":"Khamassi","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Systems and Robotics, Sorbonne Universit\u00e9s - UPMC Univ Paris 06 - CNRS, Paris, France"}]},{"given":"Almar","family":"Klein","sequence":"additional","affiliation":[{"name":"Independent scholar, Enschede, The Netherlands"}]},{"given":"Tiina","family":"Manninen","sequence":"additional","affiliation":[{"name":"BioMediTech Institute and Faculty of Biomedical Sciences and Engineering, Tampere University of Technology, Tampere, Finland"}]},{"given":"Pietro","family":"Marchesi","sequence":"additional","affiliation":[{"name":"Swammerdam Institute for Life Sciences, University of Amsterdam, Amsterdam, The Netherlands"}]},{"given":"Daniel","family":"McGlinn","sequence":"additional","affiliation":[{"name":"Department of Biology, College of Charleston, Charleston, SC, USA"}]},{"given":"Christoph","family":"Metzner","sequence":"additional","affiliation":[{"name":"Centre for Computer Science and Informatics Research, University of Hertfordshire, Hatfield, United Kingdom"}]},{"given":"Owen","family":"Petchey","sequence":"additional","affiliation":[{"name":"Department of Evolutionary Biology and Environmental Studies, University of Zurich, Zurich, Switzerland"}]},{"given":"Hans Ekkehard","family":"Plesser","sequence":"additional","affiliation":[{"name":"Faculty of Science and Technology, Norwegian University of Life Sciences, Aas, Norway"}]},{"given":"Timoth\u00e9e","family":"Poisot","sequence":"additional","affiliation":[{"name":"D\u00e9partement de Sciences Biologiques, Universit\u00e9 de Montr\u00e9al, Montr\u00e9al, QC, Canada"}]},{"given":"Karthik","family":"Ram","sequence":"additional","affiliation":[{"name":"Berkeley Institute for Data Science, University of California, Berkeley, CA, USA"}]},{"given":"Yoav","family":"Ram","sequence":"additional","affiliation":[{"name":"Department of Biology, Stanford University, Stanford, CA, USA"}]},{"given":"Etienne","family":"Roesch","sequence":"additional","affiliation":[{"name":"Centre for Integrative Neuroscience, University of Reading, Reading, United Kingdom"}]},{"given":"Cyrille","family":"Rossant","sequence":"additional","affiliation":[{"name":"Institute of Neurology, University College London, London, United Kingdom"}]},{"given":"Vahid","family":"Rostami","sequence":"additional","affiliation":[{"name":"Institute of Neuroscience & Medicine, Juelich Forschungszentrum, J\u00fclich, Germany"}]},{"given":"Aaron","family":"Shifman","sequence":"additional","affiliation":[{"name":"Department of Biology, University of Ottawa, Ottawa, Ontario, Canada"}]},{"given":"Jemma","family":"Stachelek","sequence":"additional","affiliation":[{"name":"Department of Fisheries and Wildlife, Michigan State University, East Lansing, MI, USA"}]},{"given":"Marcel","family":"Stimberg","sequence":"additional","affiliation":[{"name":"Sorbonne Universit\u00e9s\/UPMC Univ Paris 06\/INSERM\/CNRS\/Institut de la Vision, Paris, France"}]},{"given":"Frank","family":"Stollmeier","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Dynamics and Self-Organization, G\u00f6ttingen, Lower Saxony, Germany"}]},{"given":"Federico","family":"Vaggi","sequence":"additional","affiliation":[{"name":"Amazon, Seattle, WA, USA"}]},{"given":"Guillaume","family":"Viejo","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Systems and Robotics, Sorbonne Universit\u00e9s - UPMC Univ Paris 06 - CNRS, Paris, France"}]},{"given":"Julien","family":"Vitay","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Chemnitz University of Technology, Chemnitz, Saxony, Germany"}]},{"given":"Anya E.","family":"Vostinar","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Grinnell College, Grinnell, IA, USA"}]},{"given":"Roman","family":"Yurchak","sequence":"additional","affiliation":[{"name":"Symerio, Palaiseau, France"}]},{"given":"Tiziano","family":"Zito","sequence":"additional","affiliation":[{"name":"Neural Information Processing Group, Eberhard Karls Universit\u00e4t T\u00fcbingen, T\u00fcbingen, Germany"}]}],"member":"4443","published-online":{"date-parts":[[2017,12,18]]},"reference":[{"key":"10.7717\/peerj-cs.142\/ref-1","article-title":"Conda","author":"Anaconda Inc","year":"2017"},{"issue":"7604","key":"10.7717\/peerj-cs.142\/ref-2","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1038\/533452a","article-title":"1, 500 scientists lift the lid on reproducibility","volume":"533","author":"Baker","year":"2016","journal-title":"Nature"},{"issue":"3","key":"10.7717\/peerj-cs.142\/ref-3","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1145\/2812803","article-title":"Repeatability in computer systems research","volume":"59","author":"Colberg","year":"2016","journal-title":"Communications of the ACM"},{"issue":"7","key":"10.7717\/peerj-cs.142\/ref-4","doi-asserted-by":"publisher","first-page":"2615","DOI":"10.1021\/acs.chemmater.7b00799","article-title":"Reproducible research in computational chemistry of materials","volume":"29","author":"Coudert","year":"2017","journal-title":"Chemistry of Materials"},{"key":"10.7717\/peerj-cs.142\/ref-5","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-27308-2_47","article-title":"Reproducible and user-controlled software environments in HPC with Guix","volume-title":"Euro-Par 2015: parallel processing workshops","volume":"vol. 9523","author":"Court\u00e8s","year":"2015"},{"key":"10.7717\/peerj-cs.142\/ref-6","first-page":"73","article-title":"20 years of computational neuroscience","volume-title":"Chap. Learning from the past: approaches for reproducibility in computational neuroscience","author":"Crook","year":"2013"},{"key":"10.7717\/peerj-cs.142\/ref-7","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1109\/MCSE.2012.41","article-title":"Automated capture of experiment context for easier reproducibility in computational research","volume":"14","author":"Davison","year":"2012","journal-title":"Computing in Science and Engineering"},{"key":"10.7717\/peerj-cs.142\/ref-8","article-title":"Docker","author":"Docker Inc","year":"2017"},{"issue":"1","key":"10.7717\/peerj-cs.142\/ref-9","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/MCSE.2009.15","article-title":"Reproducible research in computational harmonic analysis","volume":"11","author":"Donoho","year":"2009","journal-title":"Computing in Science Engineering"},{"key":"10.7717\/peerj-cs.142\/ref-10","article-title":"CDE: using system call interposition to automatically create portable software packages","author":"Guo","year":"2011"},{"issue":"1","key":"10.7717\/peerj-cs.142\/ref-11","doi-asserted-by":"publisher","DOI":"10.1186\/s13742-015-0072-7","article-title":"Four aspects to make science open \u201cby design\u201d and not as an after-thought","volume":"4","author":"Halchenko","year":"2015","journal-title":"GigaScience"},{"issue":"3","key":"10.7717\/peerj-cs.142\/ref-12","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/mcse.2015.64","article-title":"Writing software specifications","volume":"17","author":"Hinsen","year":"2015","journal-title":"Computing in Science & Engineering"},{"issue":"8","key":"10.7717\/peerj-cs.142\/ref-13","doi-asserted-by":"publisher","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false","volume":"2","author":"Ioannidis","year":"2005","journal-title":"PLOS Medicine"},{"issue":"1","key":"10.7717\/peerj-cs.142\/ref-14","doi-asserted-by":"publisher","first-page":"e1002333","DOI":"10.1371\/journal.pbio.1002333","article-title":"Reproducible research practices and transparency across the biomedical literature","volume":"14","author":"Iqbal","year":"2016","journal-title":"PLOS Biology"},{"key":"10.7717\/peerj-cs.142\/ref-15","doi-asserted-by":"publisher","DOI":"10.1111\/insp.12104","article-title":"Bringing the gold standard into the class room: replication in university teaching","author":"Janz","year":"2015","journal-title":"International Studies Perspectives"},{"key":"10.7717\/peerj-cs.142\/ref-16","volume-title":"The practice of reproducible research: case studies and lessons from the data-intensive sciences","year":"2017"},{"key":"10.7717\/peerj-cs.142\/ref-17","volume-title":"Java virtual machine specification","author":"Lindholm","year":"1999","edition":"2"},{"key":"10.7717\/peerj-cs.142\/ref-18","doi-asserted-by":"publisher","first-page":"11","DOI":"10.3389\/fninf.2017.00011","article-title":"Reproducibility and comparability of computational models for astrocyte calcium excitability","volume":"11","author":"Manninen","year":"2017","journal-title":"Frontiers in Neuroinformatics"},{"issue":"4","key":"10.7717\/peerj-cs.142\/ref-19","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1109\/mcse.2017.3151254","article-title":"Reproducible and replicable CFD: it\u2019s harder than you think","volume":"19","author":"Mesnard","year":"2017","journal-title":"IEEE\/AIP Computing in Science and Engineering"},{"issue":"1","key":"10.7717\/peerj-cs.142\/ref-20","doi-asserted-by":"publisher","first-page":"0021","DOI":"10.1038\/s41562-016-0021","article-title":"A manifesto for reproducible science","volume":"1","author":"Munaf\u00f2","year":"2017","journal-title":"Nature Human Behaviour"},{"key":"10.7717\/peerj-cs.142\/ref-21","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/978-3-319-16462-5_6","article-title":"noWorkflow: capturing and analyzing provenance of scripts","volume-title":"Provenance and annotation of data and processes","volume":"vol. 8628","author":"Murta","year":"2015"},{"issue":"6251","key":"10.7717\/peerj-cs.142\/ref-22","doi-asserted-by":"publisher","first-page":"aac4716\u2013aac4716","DOI":"10.1126\/science.aac4716","article-title":"Estimating the reproducibility of psychological science","volume":"349","author":"Open Science Collaboration","year":"2015","journal-title":"Science"},{"issue":"7623","key":"10.7717\/peerj-cs.142\/ref-23","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1038\/538127a","article-title":"Democratic databases: science on GitHub","volume":"538","author":"Perkel","year":"2016","journal-title":"Nature"},{"issue":"10","key":"10.7717\/peerj-cs.142\/ref-24","doi-asserted-by":"publisher","first-page":"e1003285","DOI":"10.1371\/journal.pcbi.1003285","article-title":"Ten simple rules for reproducible computational research","volume":"9","author":"Sandve","year":"2013","journal-title":"PLOS Compututational Biology"},{"key":"10.7717\/peerj-cs.142\/ref-25","article-title":"Journal of Open Source Software (JOSS): design and first-year review","author":"Smith","year":"2017"},{"issue":"1","key":"10.7717\/peerj-cs.142\/ref-26","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.45852","article-title":"[Re] least-cost modelling on irregular landscape graphs","volume":"2","author":"Stachelek","year":"2016","journal-title":"ReScience"},{"key":"10.7717\/peerj-cs.142\/ref-27","doi-asserted-by":"publisher","first-page":"30","DOI":"10.3389\/fncom.2015.00030","article-title":"A long journey into reproducible computational neuroscience","volume":"9","author":"Topalidou","year":"2015","journal-title":"Frontiers in Computational Neuroscience"},{"issue":"1","key":"10.7717\/peerj-cs.142\/ref-28","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.47146","article-title":"[Re] interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study","volume":"1","author":"Topalidou","year":"2015","journal-title":"ReScience"},{"issue":"1","key":"10.7717\/peerj-cs.142\/ref-29","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.27944","article-title":"[Re] speed\/accuracy trade-off between the habitual and the goal-directed process","volume":"2","author":"Viejo","year":"2016","journal-title":"ReScience"},{"key":"10.7717\/peerj-cs.142\/ref-30","doi-asserted-by":"publisher","first-page":"62","DOI":"10.12688\/f1000research.3-62.v2","article-title":"Software carpentry: lessons learned","volume":"3","author":"Wilson","year":"2016","journal-title":"F1000Research"},{"issue":"1","key":"10.7717\/peerj-cs.142\/ref-31","doi-asserted-by":"publisher","first-page":"e1001745","DOI":"10.1371\/journal.pbio.1001745","article-title":"Best practices for scientific computing","volume":"12","author":"Wilson","year":"2014","journal-title":"PLOS Biology"}],"container-title":["PeerJ Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/cs-142.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-142.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-142.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-142.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,11]],"date-time":"2021-11-11T12:46:09Z","timestamp":1636634769000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/cs-142"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,18]]},"references-count":31,"alternative-id":["10.7717\/peerj-cs.142"],"URL":"https:\/\/doi.org\/10.7717\/peerj-cs.142","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{"has-review":[{"id-type":"doi","id":"10.7287\/peerj-cs.142v0.1\/reviews\/2","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj-cs.142v0.1\/reviews\/1","asserted-by":"object"}]},"ISSN":["2376-5992"],"issn-type":[{"value":"2376-5992","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12,18]]},"article-number":"e142"}}