Efficient Stream Provenance via Operator Instrumentation. Glavic, B., Esmaili, K. S., Fischer, P. M., & Tatbul, N. Transactions on Internet Technology (TOIT), 13(1):7:1-7:26, 2014. ![Efficient Stream Provenance via Operator Instrumentation [pdf]](https://bibbase.org/img/filetypes/pdf.svg "pdf")
Paper abstract bibtex Managing fine-grained provenance is a critical requirement for data stream management systems (DSMS), not only to address complex applications that require diagnostic capabilities and assurance, but also for providing advanced functionality such as revision processing or query debugging. This paper introduces a novel approach that uses operator instrumentation, i.e., modifying the behavior of operators, to generate and propagate fine-grained provenance through several operators of a query network. In addition to applying this technique to compute provenance eagerly during query execution, we also study how to decouple provenance computation from query processing to reduce run-time overhead and avoid unnecessary provenance retrieval. Our proposals include computing a concise superset of the provenance (to allow lazily replaying a query and reconstruct its provenance) as well as lazy retrieval (to avoid unnecessary reconstruction of provenance). We develop stream-specific compression methods to reduce the computational and storage overhead of provenance generation and retrieval. Ariadne, our provenance-aware extension of the Borealis DSMS implements these techniques. Our experiments confirm that Ariadne manages provenance with minor overhead and clearly outperforms query rewrite, the current state-of-the-art.
@article{GE14,
Abstract = {Managing fine-grained provenance is a critical requirement for data stream management systems (DSMS), not only to address complex applications that require diagnostic capabilities and assurance, but also for providing advanced functionality such as revision processing or query debugging. This paper introduces a novel approach that uses operator instrumentation, i.e., modifying the behavior of operators, to generate and propagate fine-grained provenance through several operators of a query network. In addition to applying this technique to compute provenance eagerly during query execution, we also study how to decouple provenance computation from query processing to reduce run-time overhead and avoid unnecessary provenance retrieval. Our proposals include computing a concise superset of the provenance (to allow lazily replaying a query and reconstruct its provenance) as well as lazy retrieval (to avoid unnecessary reconstruction of provenance). We develop stream-specific compression methods to reduce the computational and storage overhead of provenance generation and retrieval. Ariadne, our provenance-aware extension of the Borealis DSMS implements these techniques. Our experiments confirm that Ariadne manages provenance with minor overhead and clearly outperforms query rewrite, the current state-of-the-art.},
Author = {Boris Glavic and Kyumars Sheykh Esmaili and Peter M. Fischer and Nesime Tatbul},
Date-Added = {2014-05-11 17:49:19 +0000},
Date-Modified = {2014-05-11 17:55:40 +0000},
Journal = {Transactions on Internet Technology (TOIT)},
Keywords = {Ariadne; Provenance},
Number = {1},
Pages = {7:1-7:26},
Title = {Efficient Stream Provenance via Operator Instrumentation},
Url = {http://cs.iit.edu/%7edbgroup/pdfpubls/GE14.pdf},
Venueshort = {TOIT},
Volume = {13},
Year = {2014},
Bdsk-Url-1 = {http://cs.iit.edu/%7edbgroup/pdfpubls/GE14.pdf}}
Downloads: 0
{"_id":"Dot6sLFR8jZS6NoJ7","bibbaseid":"glavic-esmaili-fischer-tatbul-efficientstreamprovenanceviaoperatorinstrumentation-2014","downloads":0,"creationDate":"2017-03-23T18:05:47.062Z","title":"Efficient Stream Provenance via Operator Instrumentation","author_short":["Glavic, B.","Esmaili, K. S.","Fischer, P. M.","Tatbul, N."],"year":2014,"bibtype":"article","biburl":"http://cs.iit.edu/~dbgroup/files/dbgroup.bib","bibdata":{"bibtype":"article","type":"article","abstract":"Managing fine-grained provenance is a critical requirement for data stream management systems (DSMS), not only to address complex applications that require diagnostic capabilities and assurance, but also for providing advanced functionality such as revision processing or query debugging. This paper introduces a novel approach that uses operator instrumentation, i.e., modifying the behavior of operators, to generate and propagate fine-grained provenance through several operators of a query network. In addition to applying this technique to compute provenance eagerly during query execution, we also study how to decouple provenance computation from query processing to reduce run-time overhead and avoid unnecessary provenance retrieval. Our proposals include computing a concise superset of the provenance (to allow lazily replaying a query and reconstruct its provenance) as well as lazy retrieval (to avoid unnecessary reconstruction of provenance). We develop stream-specific compression methods to reduce the computational and storage overhead of provenance generation and retrieval. Ariadne, our provenance-aware extension of the Borealis DSMS implements these techniques. Our experiments confirm that Ariadne manages provenance with minor overhead and clearly outperforms query rewrite, the current state-of-the-art.","author":[{"firstnames":["Boris"],"propositions":[],"lastnames":["Glavic"],"suffixes":[]},{"firstnames":["Kyumars","Sheykh"],"propositions":[],"lastnames":["Esmaili"],"suffixes":[]},{"firstnames":["Peter","M."],"propositions":[],"lastnames":["Fischer"],"suffixes":[]},{"firstnames":["Nesime"],"propositions":[],"lastnames":["Tatbul"],"suffixes":[]}],"date-added":"2014-05-11 17:49:19 +0000","date-modified":"2014-05-11 17:55:40 +0000","journal":"Transactions on Internet Technology (TOIT)","keywords":"Ariadne; Provenance","number":"1","pages":"7:1-7:26","title":"Efficient Stream Provenance via Operator Instrumentation","url":"http://cs.iit.edu/%7edbgroup/pdfpubls/GE14.pdf","venueshort":"TOIT","volume":"13","year":"2014","bdsk-url-1":"http://cs.iit.edu/%7edbgroup/pdfpubls/GE14.pdf","bibtex":"@article{GE14,\n\tAbstract = {Managing fine-grained provenance is a critical requirement for data stream management systems (DSMS), not only to address complex applications that require diagnostic capabilities and assurance, but also for providing advanced functionality such as revision processing or query debugging. This paper introduces a novel approach that uses operator instrumentation, i.e., modifying the behavior of operators, to generate and propagate fine-grained provenance through several operators of a query network. In addition to applying this technique to compute provenance eagerly during query execution, we also study how to decouple provenance computation from query processing to reduce run-time overhead and avoid unnecessary provenance retrieval. Our proposals include computing a concise superset of the provenance (to allow lazily replaying a query and reconstruct its provenance) as well as lazy retrieval (to avoid unnecessary reconstruction of provenance). We develop stream-specific compression methods to reduce the computational and storage overhead of provenance generation and retrieval. Ariadne, our provenance-aware extension of the Borealis DSMS implements these techniques. Our experiments confirm that Ariadne manages provenance with minor overhead and clearly outperforms query rewrite, the current state-of-the-art.},\n\tAuthor = {Boris Glavic and Kyumars Sheykh Esmaili and Peter M. Fischer and Nesime Tatbul},\n\tDate-Added = {2014-05-11 17:49:19 +0000},\n\tDate-Modified = {2014-05-11 17:55:40 +0000},\n\tJournal = {Transactions on Internet Technology (TOIT)},\n\tKeywords = {Ariadne; Provenance},\n\tNumber = {1},\n\tPages = {7:1-7:26},\n\tTitle = {Efficient Stream Provenance via Operator Instrumentation},\n\tUrl = {http://cs.iit.edu/%7edbgroup/pdfpubls/GE14.pdf},\n\tVenueshort = {TOIT},\n\tVolume = {13},\n\tYear = {2014},\n\tBdsk-Url-1 = {http://cs.iit.edu/%7edbgroup/pdfpubls/GE14.pdf}}\n\n","author_short":["Glavic, B.","Esmaili, K. S.","Fischer, P. M.","Tatbul, N."],"key":"GE14","id":"GE14","bibbaseid":"glavic-esmaili-fischer-tatbul-efficientstreamprovenanceviaoperatorinstrumentation-2014","role":"author","urls":{"Paper":"http://cs.iit.edu/%7edbgroup/pdfpubls/GE14.pdf"},"keyword":["Ariadne; Provenance"],"downloads":0},"search_terms":["efficient","stream","provenance","via","operator","instrumentation","glavic","esmaili","fischer","tatbul"],"keywords":["ariadne; provenance"],"authorIDs":[],"dataSources":["wggPihCAGht7DMsu5"]}