Caching and Reproducibility: Making Data Science Experiments Faster and FAIRer. Schubotz, M., Satpute, A., Greiner-Petter, A., Aizawa, A., & Gipp, B. Frontiers in Research Metrics and Analytics, 7:861944, April, 2022.
Paper doi abstract bibtex 2 downloads Small to medium-scale data science experiments often rely on research software developed ad-hoc by individual scientists or small teams. Often there is no time to make the research software fast, reusable, and open access. The consequence is twofold. First, subsequent researchers must spend significant work hours building upon the proposed hypotheses or experimental framework. In the worst case, others cannot reproduce the experiment and reuse the findings for subsequent research. Second, suppose the ad-hoc research software fails during often long-running computational expensive experiments. In that case, the overall effort to iteratively improve the software and rerun the experiments creates significant time pressure on the researchers. We suggest making caching an integral part of the research software development process, even before the first line of code is written. This article outlines caching recommendations for developing research software in data science projects. Our recommendations provide a perspective to circumvent common problems such as propriety dependence, speed, etc. At the same time, caching contributes to the reproducibility of experiments in the open science workflow. Concerning the four guiding principles, i.e., Findability, Accessibility, Interoperability, and Reusability (FAIR), we foresee that including the proposed recommendation in a research software development will make the data related to that software FAIRer for both machines and humans. We exhibit the usefulness of some of the proposed recommendations on our recently completed research software project in mathematical information retrieval.
@article{BibbaseSchubotzSGA22,
title = {Caching and {Reproducibility}: {Making} {Data} {Science} {Experiments} {Faster} and {FAIRer}},
volume = {7},
issn = {2504-0537},
shorttitle = {Caching and {Reproducibility}},
url = {https://www.frontiersin.org/articles/10.3389/frma.2022.861944/full},
doi = {10.3389/frma.2022.861944},
abstract = {Small to medium-scale data science experiments often rely on research software developed
ad-hoc
by individual scientists or small teams. Often there is no time to make the research software fast, reusable, and open access. The consequence is twofold. First, subsequent researchers must spend significant work hours building upon the proposed hypotheses or experimental framework. In the worst case, others cannot reproduce the experiment and reuse the findings for subsequent research. Second, suppose the
ad-hoc
research software fails during often long-running computational expensive experiments. In that case, the overall effort to iteratively improve the software and rerun the experiments creates significant time pressure on the researchers. We suggest making caching an integral part of the research software development process, even before the first line of code is written. This article outlines caching recommendations for developing research software in data science projects. Our recommendations provide a perspective to circumvent common problems such as propriety dependence, speed, etc. At the same time, caching contributes to the reproducibility of experiments in the open science workflow. Concerning the four guiding principles, i.e., Findability, Accessibility, Interoperability, and Reusability (FAIR), we foresee that including the proposed recommendation in a research software development will make the data related to that software FAIRer for both machines and humans. We exhibit the usefulness of some of the proposed recommendations on our recently completed research software project in mathematical information retrieval.},
urldate = {2022-08-24},
journal = {Frontiers in Research Metrics and Analytics},
author = {Schubotz, Moritz and Satpute, Ankit and Greiner-Petter, Andre and Aizawa, Akiko and Gipp, Bela},
month = apr,
year = {2022},
pages = {861944},
}
Downloads: 2
{"_id":"ABqpgkKDJrZkzsmM4","bibbaseid":"schubotz-satpute-greinerpetter-aizawa-gipp-cachingandreproducibilitymakingdatascienceexperimentsfasterandfairer-2022","author_short":["Schubotz, M.","Satpute, A.","Greiner-Petter, A.","Aizawa, A.","Gipp, B."],"bibdata":{"bibtype":"article","type":"article","title":"Caching and Reproducibility: Making Data Science Experiments Faster and FAIRer","volume":"7","issn":"2504-0537","shorttitle":"Caching and Reproducibility","url":"https://www.frontiersin.org/articles/10.3389/frma.2022.861944/full","doi":"10.3389/frma.2022.861944","abstract":"Small to medium-scale data science experiments often rely on research software developed ad-hoc by individual scientists or small teams. Often there is no time to make the research software fast, reusable, and open access. The consequence is twofold. First, subsequent researchers must spend significant work hours building upon the proposed hypotheses or experimental framework. In the worst case, others cannot reproduce the experiment and reuse the findings for subsequent research. Second, suppose the ad-hoc research software fails during often long-running computational expensive experiments. In that case, the overall effort to iteratively improve the software and rerun the experiments creates significant time pressure on the researchers. We suggest making caching an integral part of the research software development process, even before the first line of code is written. This article outlines caching recommendations for developing research software in data science projects. Our recommendations provide a perspective to circumvent common problems such as propriety dependence, speed, etc. At the same time, caching contributes to the reproducibility of experiments in the open science workflow. Concerning the four guiding principles, i.e., Findability, Accessibility, Interoperability, and Reusability (FAIR), we foresee that including the proposed recommendation in a research software development will make the data related to that software FAIRer for both machines and humans. We exhibit the usefulness of some of the proposed recommendations on our recently completed research software project in mathematical information retrieval.","urldate":"2022-08-24","journal":"Frontiers in Research Metrics and Analytics","author":[{"propositions":[],"lastnames":["Schubotz"],"firstnames":["Moritz"],"suffixes":[]},{"propositions":[],"lastnames":["Satpute"],"firstnames":["Ankit"],"suffixes":[]},{"propositions":[],"lastnames":["Greiner-Petter"],"firstnames":["Andre"],"suffixes":[]},{"propositions":[],"lastnames":["Aizawa"],"firstnames":["Akiko"],"suffixes":[]},{"propositions":[],"lastnames":["Gipp"],"firstnames":["Bela"],"suffixes":[]}],"month":"April","year":"2022","pages":"861944","bibtex":"@article{BibbaseSchubotzSGA22,\n\ttitle = {Caching and {Reproducibility}: {Making} {Data} {Science} {Experiments} {Faster} and {FAIRer}},\n\tvolume = {7},\n\tissn = {2504-0537},\n\tshorttitle = {Caching and {Reproducibility}},\n\turl = {https://www.frontiersin.org/articles/10.3389/frma.2022.861944/full},\n\tdoi = {10.3389/frma.2022.861944},\n\tabstract = {Small to medium-scale data science experiments often rely on research software developed\n ad-hoc\n by individual scientists or small teams. Often there is no time to make the research software fast, reusable, and open access. The consequence is twofold. First, subsequent researchers must spend significant work hours building upon the proposed hypotheses or experimental framework. In the worst case, others cannot reproduce the experiment and reuse the findings for subsequent research. Second, suppose the\n ad-hoc\n research software fails during often long-running computational expensive experiments. In that case, the overall effort to iteratively improve the software and rerun the experiments creates significant time pressure on the researchers. We suggest making caching an integral part of the research software development process, even before the first line of code is written. This article outlines caching recommendations for developing research software in data science projects. Our recommendations provide a perspective to circumvent common problems such as propriety dependence, speed, etc. At the same time, caching contributes to the reproducibility of experiments in the open science workflow. Concerning the four guiding principles, i.e., Findability, Accessibility, Interoperability, and Reusability (FAIR), we foresee that including the proposed recommendation in a research software development will make the data related to that software FAIRer for both machines and humans. We exhibit the usefulness of some of the proposed recommendations on our recently completed research software project in mathematical information retrieval.},\n\turldate = {2022-08-24},\n\tjournal = {Frontiers in Research Metrics and Analytics},\n\tauthor = {Schubotz, Moritz and Satpute, Ankit and Greiner-Petter, Andre and Aizawa, Akiko and Gipp, Bela},\n\tmonth = apr,\n\tyear = {2022},\n\tpages = {861944},\n}\n\n","author_short":["Schubotz, M.","Satpute, A.","Greiner-Petter, A.","Aizawa, A.","Gipp, B."],"key":"BibbaseSchubotzSGA22","id":"BibbaseSchubotzSGA22","bibbaseid":"schubotz-satpute-greinerpetter-aizawa-gipp-cachingandreproducibilitymakingdatascienceexperimentsfasterandfairer-2022","role":"author","urls":{"Paper":"https://www.frontiersin.org/articles/10.3389/frma.2022.861944/full"},"metadata":{"authorlinks":{}},"downloads":2},"bibtype":"article","biburl":"https://api.zotero.org/users/7689706/collections/IBJGRWZX/items?key=R0b523dc3oYLxTGap1H4YXgd&format=bibtex&limit=100","dataSources":["wZtCXbB8M6GYSQHMx","QGwcHf7xnb5mCCQi7"],"keywords":[],"search_terms":["caching","reproducibility","making","data","science","experiments","faster","fairer","schubotz","satpute","greiner-petter","aizawa","gipp"],"title":"Caching and Reproducibility: Making Data Science Experiments Faster and FAIRer","year":2022,"downloads":2}