Karma2: Provenance Management for Data Driven Workflows Extended and invited from ICWS 2006 with id 217. Simmhan, Y., L., Plale, B., & Gannon, D. International Journal of Web Services Research, 2001. abstract bibtex The increasing ability for the sciences to sense the world around us is resulting in a growing need for data driven applications that are under the control of workflows composed of services on the Grid. The focus of our work is on provenance collection for these workflows, necessary to validate the workflow and to determine quality of generated data products. The challenge we address is to record uniform and usable provenance metadata that meets the domain needs while minimizing the modification burden on the service authors and the performance overhead on the workflow engine and the services. The framework is based on generating discrete provenance activities during the lifecycle of a workflow execution that can be aggregated to form complex data and process provenance graphs that can span across workflows. The implementation uses a loosely-coupled publish-subscribe architecture for propagating these activities and the capabilities of the system satisfies the needs of detailed provenance collection. A performance evaluation of a prototype finds a minimal performance overhead (in the range of 1% for an eight service workflow using 271 data products).
@article{
title = {Karma2: Provenance Management for Data Driven Workflows Extended and invited from ICWS 2006 with id 217},
type = {article},
year = {2001},
id = {a83f4311-c259-3d9e-8787-39885de3afcf},
created = {2018-01-19T07:02:28.490Z},
file_attached = {false},
profile_id = {42d295c0-0737-38d6-8b43-508cab6ea85d},
last_modified = {2020-05-11T14:43:38.315Z},
read = {false},
starred = {false},
authored = {true},
confirmed = {true},
hidden = {false},
citation_key = {Simmhan2001},
source_type = {JOUR},
folder_uuids = {023ec473-8727-4d72-856c-6687cf1caa00},
private_publication = {false},
abstract = {The increasing ability for the sciences to sense the world around us is resulting in a growing need for data driven applications that are under the control of workflows composed of services on the Grid. The focus of our work is on provenance collection for these workflows, necessary to validate the workflow and to determine quality of generated data products. The challenge we address is to record uniform and usable provenance metadata that meets the domain needs while minimizing the modification burden on the service authors and the performance overhead on the workflow engine and the services. The framework is based on generating discrete provenance activities during the lifecycle of a workflow execution that can be aggregated to form complex data and process provenance graphs that can span across workflows. The implementation uses a loosely-coupled publish-subscribe architecture for propagating these activities and the capabilities of the system satisfies the needs of detailed provenance collection. A performance evaluation of a prototype finds a minimal performance overhead (in the range of 1% for an eight service workflow using 271 data products).},
bibtype = {article},
author = {Simmhan, Yogesh L and Plale, Beth and Gannon, Dennis},
journal = {International Journal of Web Services Research}
}
Downloads: 0
{"_id":"TBeJbY64uNJrYRyho","bibbaseid":"simmhan-plale-gannon-karma2provenancemanagementfordatadrivenworkflowsextendedandinvitedfromicws2006withid217-2001","downloads":0,"creationDate":"2018-03-12T19:10:28.186Z","title":"Karma2: Provenance Management for Data Driven Workflows Extended and invited from ICWS 2006 with id 217","author_short":["Simmhan, Y., L.","Plale, B.","Gannon, D."],"year":2001,"bibtype":"article","biburl":"https://bibbase.org/service/mendeley/42d295c0-0737-38d6-8b43-508cab6ea85d","bibdata":{"title":"Karma2: Provenance Management for Data Driven Workflows Extended and invited from ICWS 2006 with id 217","type":"article","year":"2001","id":"a83f4311-c259-3d9e-8787-39885de3afcf","created":"2018-01-19T07:02:28.490Z","file_attached":false,"profile_id":"42d295c0-0737-38d6-8b43-508cab6ea85d","last_modified":"2020-05-11T14:43:38.315Z","read":false,"starred":false,"authored":"true","confirmed":"true","hidden":false,"citation_key":"Simmhan2001","source_type":"JOUR","folder_uuids":"023ec473-8727-4d72-856c-6687cf1caa00","private_publication":false,"abstract":"The increasing ability for the sciences to sense the world around us is resulting in a growing need for data driven applications that are under the control of workflows composed of services on the Grid. The focus of our work is on provenance collection for these workflows, necessary to validate the workflow and to determine quality of generated data products. The challenge we address is to record uniform and usable provenance metadata that meets the domain needs while minimizing the modification burden on the service authors and the performance overhead on the workflow engine and the services. The framework is based on generating discrete provenance activities during the lifecycle of a workflow execution that can be aggregated to form complex data and process provenance graphs that can span across workflows. The implementation uses a loosely-coupled publish-subscribe architecture for propagating these activities and the capabilities of the system satisfies the needs of detailed provenance collection. A performance evaluation of a prototype finds a minimal performance overhead (in the range of 1% for an eight service workflow using 271 data products).","bibtype":"article","author":"Simmhan, Yogesh L and Plale, Beth and Gannon, Dennis","journal":"International Journal of Web Services Research","bibtex":"@article{\n title = {Karma2: Provenance Management for Data Driven Workflows Extended and invited from ICWS 2006 with id 217},\n type = {article},\n year = {2001},\n id = {a83f4311-c259-3d9e-8787-39885de3afcf},\n created = {2018-01-19T07:02:28.490Z},\n file_attached = {false},\n profile_id = {42d295c0-0737-38d6-8b43-508cab6ea85d},\n last_modified = {2020-05-11T14:43:38.315Z},\n read = {false},\n starred = {false},\n authored = {true},\n confirmed = {true},\n hidden = {false},\n citation_key = {Simmhan2001},\n source_type = {JOUR},\n folder_uuids = {023ec473-8727-4d72-856c-6687cf1caa00},\n private_publication = {false},\n abstract = {The increasing ability for the sciences to sense the world around us is resulting in a growing need for data driven applications that are under the control of workflows composed of services on the Grid. The focus of our work is on provenance collection for these workflows, necessary to validate the workflow and to determine quality of generated data products. The challenge we address is to record uniform and usable provenance metadata that meets the domain needs while minimizing the modification burden on the service authors and the performance overhead on the workflow engine and the services. The framework is based on generating discrete provenance activities during the lifecycle of a workflow execution that can be aggregated to form complex data and process provenance graphs that can span across workflows. The implementation uses a loosely-coupled publish-subscribe architecture for propagating these activities and the capabilities of the system satisfies the needs of detailed provenance collection. A performance evaluation of a prototype finds a minimal performance overhead (in the range of 1% for an eight service workflow using 271 data products).},\n bibtype = {article},\n author = {Simmhan, Yogesh L and Plale, Beth and Gannon, Dennis},\n journal = {International Journal of Web Services Research}\n}","author_short":["Simmhan, Y., L.","Plale, B.","Gannon, D."],"biburl":"https://bibbase.org/service/mendeley/42d295c0-0737-38d6-8b43-508cab6ea85d","bibbaseid":"simmhan-plale-gannon-karma2provenancemanagementfordatadrivenworkflowsextendedandinvitedfromicws2006withid217-2001","role":"author","urls":{},"metadata":{"authorlinks":{}},"downloads":0},"search_terms":["karma2","provenance","management","data","driven","workflows","extended","invited","icws","2006","217","simmhan","plale","gannon"],"keywords":[],"authorIDs":[],"dataSources":["zgahneP4uAjKbudrQ","ya2CyA73rpZseyrZ8","2252seNhipfTmjEBQ"]}