The data, they are a-changin'. Missier, P., Cala, J., & Wijaya, E. In Proc. TAPP'16 (Theory and Practice of Provenance), Washington D.C., USA, 2016. USENIX Association. ![The data, they are a-changin' [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper abstract bibtex The cost of deriving actionable knowledge from large datasets has been decreasing thanks to a convergence of positive fac- tors: low cost data generation, inexpensively scalable stor- age and processing infrastructure (cloud), software frame- works and tools for massively distributed data processing, and parallelisable data analytics algorithms. One observa- tion that is often overlooked, however, is that each of these elements is not immutable, rather they all evolve over time. This suggests that the value of such derivative knowledge may decay over time, unless it is preserved by reacting to those changes. Our broad research goal is to develop mod- els, methods, and tools for selectively reacting to changes by balancing costs and benefits, i.e. through complete or partial re-computation of some of the underlying processes. In this paper we present an initial model for reasoning about change and re-computations, and show how analysis of detailed provenance of derived knowledge informs re-computation decisions. We illustrate the main ideas through a real-world case study in genomics, namely on the interpretation of hu- man variants in support of genetic diagnosis.
@inproceedings{missier_data_2016,
address = {Washington D.C., USA},
title = {The data, they are a-changin'},
url = {https://arxiv.org/abs/1604.06412},
abstract = {The cost of deriving actionable knowledge from large datasets has been decreasing thanks to a convergence of positive fac- tors: low cost data generation, inexpensively scalable stor- age and processing infrastructure (cloud), software frame- works and tools for massively distributed data processing, and parallelisable data analytics algorithms. One observa- tion that is often overlooked, however, is that each of these elements is not immutable, rather they all evolve over time. This suggests that the value of such derivative knowledge may decay over time, unless it is preserved by reacting to those changes. Our broad research goal is to develop mod- els, methods, and tools for selectively reacting to changes by balancing costs and benefits, i.e. through complete or partial re-computation of some of the underlying processes. In this paper we present an initial model for reasoning about change and re-computations, and show how analysis of detailed provenance of derived knowledge informs re-computation decisions. We illustrate the main ideas through a real-world case study in genomics, namely on the interpretation of hu- man variants in support of genetic diagnosis.},
booktitle = {Proc. {TAPP}'16 ({Theory} and {Practice} of {Provenance})},
publisher = {USENIX Association},
author = {Missier, Paolo and Cala, Jacek and Wijaya, Eldarina},
editor = {Cohen-Boulakia, Sarah},
year = {2016},
keywords = {\#provenance, \#re-computation, \#big data processing, \#data change},
}
Downloads: 0
{"_id":"wrpCf3kfXLPDXkhqg","bibbaseid":"missier-cala-wijaya-thedatatheyareachangin-2016","downloads":0,"creationDate":"2016-06-16T13:09:14.892Z","title":"The data, they are a-changin'","author_short":["Missier, P.","Cala, J.","Wijaya, E."],"year":2016,"bibtype":"inproceedings","biburl":"https://bibbase.org/f/MTSG9SdhWPisKNpZX/MyPublications-bibbase.bib","bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"Washington D.C., USA","title":"The data, they are a-changin'","url":"https://arxiv.org/abs/1604.06412","abstract":"The cost of deriving actionable knowledge from large datasets has been decreasing thanks to a convergence of positive fac- tors: low cost data generation, inexpensively scalable stor- age and processing infrastructure (cloud), software frame- works and tools for massively distributed data processing, and parallelisable data analytics algorithms. One observa- tion that is often overlooked, however, is that each of these elements is not immutable, rather they all evolve over time. This suggests that the value of such derivative knowledge may decay over time, unless it is preserved by reacting to those changes. Our broad research goal is to develop mod- els, methods, and tools for selectively reacting to changes by balancing costs and benefits, i.e. through complete or partial re-computation of some of the underlying processes. In this paper we present an initial model for reasoning about change and re-computations, and show how analysis of detailed provenance of derived knowledge informs re-computation decisions. We illustrate the main ideas through a real-world case study in genomics, namely on the interpretation of hu- man variants in support of genetic diagnosis.","booktitle":"Proc. TAPP'16 (Theory and Practice of Provenance)","publisher":"USENIX Association","author":[{"propositions":[],"lastnames":["Missier"],"firstnames":["Paolo"],"suffixes":[]},{"propositions":[],"lastnames":["Cala"],"firstnames":["Jacek"],"suffixes":[]},{"propositions":[],"lastnames":["Wijaya"],"firstnames":["Eldarina"],"suffixes":[]}],"editor":[{"propositions":[],"lastnames":["Cohen-Boulakia"],"firstnames":["Sarah"],"suffixes":[]}],"year":"2016","keywords":"#provenance, #re-computation, #big data processing, #data change","bibtex":"@inproceedings{missier_data_2016,\n\taddress = {Washington D.C., USA},\n\ttitle = {The data, they are a-changin'},\n\turl = {https://arxiv.org/abs/1604.06412},\n\tabstract = {The cost of deriving actionable knowledge from large datasets has been decreasing thanks to a convergence of positive fac- tors: low cost data generation, inexpensively scalable stor- age and processing infrastructure (cloud), software frame- works and tools for massively distributed data processing, and parallelisable data analytics algorithms. One observa- tion that is often overlooked, however, is that each of these elements is not immutable, rather they all evolve over time. This suggests that the value of such derivative knowledge may decay over time, unless it is preserved by reacting to those changes. Our broad research goal is to develop mod- els, methods, and tools for selectively reacting to changes by balancing costs and benefits, i.e. through complete or partial re-computation of some of the underlying processes. In this paper we present an initial model for reasoning about change and re-computations, and show how analysis of detailed provenance of derived knowledge informs re-computation decisions. We illustrate the main ideas through a real-world case study in genomics, namely on the interpretation of hu- man variants in support of genetic diagnosis.},\n\tbooktitle = {Proc. {TAPP}'16 ({Theory} and {Practice} of {Provenance})},\n\tpublisher = {USENIX Association},\n\tauthor = {Missier, Paolo and Cala, Jacek and Wijaya, Eldarina},\n\teditor = {Cohen-Boulakia, Sarah},\n\tyear = {2016},\n\tkeywords = {\\#provenance, \\#re-computation, \\#big data processing, \\#data change},\n}\n\n","author_short":["Missier, P.","Cala, J.","Wijaya, E."],"editor_short":["Cohen-Boulakia, S."],"key":"missier_data_2016","id":"missier_data_2016","bibbaseid":"missier-cala-wijaya-thedatatheyareachangin-2016","role":"author","urls":{"Paper":"https://arxiv.org/abs/1604.06412"},"keyword":["#provenance","#re-computation","#big data processing","#data change"],"metadata":{"authorlinks":{}},"downloads":0},"search_terms":["data","changin","missier","cala","wijaya"],"keywords":["#provenance","#re-computation","#big data processing","#data change"],"authorIDs":[],"dataSources":["zh27EpT9RPew3MWSE","ner3YxPo3mvD9E5ym","nF6KkFb4XxGruanwy","BDjqJntjXzyBmLxhv","oiWqtmpFQ6ZtiMEK2","k75vCTghu54BjX5qH","j9tnaL2u4rifwAc2v","NCorZq2vkXK6BnhLF","ze2X9uz8Dcv2oGipf","coF7QgJraNKfmikbB","afppXLgSuddAzAL9e","wJE4ynGem9MRsXBRn","9zrgMZfGdRkdkNXfZ","qTQGxWDYeue2pHBus"]}