Design and evaluation of a genomics variant analysis pipeline using GATK Spark tools

Design and evaluation of a genomics variant analysis pipeline using GATK Spark tools. Tucci, N., Cala, J., Steyn, J., & Missier, P. In Procs. SEBD '18 – 26TH Italian Symposium on Advanced Database Systems, Bari, italy, 2018.
abstract bibtex

Scalable and efficient processing of genome sequence data, i.e. for variant discovery, is key to the mainstream adoption of High Throughput technology for disease prevention and for clinical use. Achieving scalability, however, requires a significant effort to enable the parallel execution of the analysis tools that make up the pipelines. This is facilitated by the new Spark versions of the well-known GATK toolkit, which offer a black-box approach by transparently exploiting the underlying Map Reduce architecture. In this paper we report on our experience implementing a standard variant discovery pipeline using GATK 4.0 with Docker-based deployment over a cluster. We provide a preliminary performance analysis, comparing the processing times and cost to those of the new Microsoft Genomics Services.

@inproceedings{tucci_design_2018,
	address = {Bari, italy},
	title = {Design and evaluation of a genomics variant analysis pipeline using {GATK} {Spark} tools},
	abstract = {Scalable and efficient processing of genome sequence data, i.e. for variant discovery, is key to the mainstream adoption of High Throughput technology for disease prevention and for clinical use. Achieving scalability, however, requires a significant effort to enable the parallel execution of the analysis tools that make up the pipelines. This is facilitated by the new Spark versions of the well-known GATK toolkit, which offer a black-box approach by transparently exploiting the underlying Map Reduce architecture. In this paper we report on our experience implementing a standard variant discovery pipeline using GATK 4.0 with Docker-based deployment over a cluster. We provide a preliminary performance analysis, comparing the processing times and cost to those of the new Microsoft Genomics Services.},
	booktitle = {Procs. {SEBD} '18 – {26TH} {Italian} {Symposium} on {Advanced} {Database} {Systems}},
	author = {Tucci, Nicholas and Cala, Jacek and Steyn, Jannetta and Missier, Paolo},
	year = {2018},
	keywords = {\#genomics, \#spark},
}

Downloads: 0

{"_id":"rSZ7J9icrFqqizHzt","bibbaseid":"tucci-cala-steyn-missier-designandevaluationofagenomicsvariantanalysispipelineusinggatksparktools-2018","downloads":0,"creationDate":"2018-06-03T14:06:35.440Z","title":"Design and evaluation of a genomics variant analysis pipeline using GATK Spark tools","author_short":["Tucci, N.","Cala, J.","Steyn, J.","Missier, P."],"year":2018,"bibtype":"inproceedings","biburl":"https://bibbase.org/f/MTSG9SdhWPisKNpZX/MyPublications-bibbase.bib","bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"Bari, italy","title":"Design and evaluation of a genomics variant analysis pipeline using GATK Spark tools","abstract":"Scalable and efficient processing of genome sequence data, i.e. for variant discovery, is key to the mainstream adoption of High Throughput technology for disease prevention and for clinical use. Achieving scalability, however, requires a significant effort to enable the parallel execution of the analysis tools that make up the pipelines. This is facilitated by the new Spark versions of the well-known GATK toolkit, which offer a black-box approach by transparently exploiting the underlying Map Reduce architecture. In this paper we report on our experience implementing a standard variant discovery pipeline using GATK 4.0 with Docker-based deployment over a cluster. We provide a preliminary performance analysis, comparing the processing times and cost to those of the new Microsoft Genomics Services.","booktitle":"Procs. SEBD '18 – 26TH Italian Symposium on Advanced Database Systems","author":[{"propositions":[],"lastnames":["Tucci"],"firstnames":["Nicholas"],"suffixes":[]},{"propositions":[],"lastnames":["Cala"],"firstnames":["Jacek"],"suffixes":[]},{"propositions":[],"lastnames":["Steyn"],"firstnames":["Jannetta"],"suffixes":[]},{"propositions":[],"lastnames":["Missier"],"firstnames":["Paolo"],"suffixes":[]}],"year":"2018","keywords":"#genomics, #spark","bibtex":"@inproceedings{tucci_design_2018,\n\taddress = {Bari, italy},\n\ttitle = {Design and evaluation of a genomics variant analysis pipeline using {GATK} {Spark} tools},\n\tabstract = {Scalable and efficient processing of genome sequence data, i.e. for variant discovery, is key to the mainstream adoption of High Throughput technology for disease prevention and for clinical use. Achieving scalability, however, requires a significant effort to enable the parallel execution of the analysis tools that make up the pipelines. This is facilitated by the new Spark versions of the well-known GATK toolkit, which offer a black-box approach by transparently exploiting the underlying Map Reduce architecture. In this paper we report on our experience implementing a standard variant discovery pipeline using GATK 4.0 with Docker-based deployment over a cluster. We provide a preliminary performance analysis, comparing the processing times and cost to those of the new Microsoft Genomics Services.},\n\tbooktitle = {Procs. {SEBD} '18 – {26TH} {Italian} {Symposium} on {Advanced} {Database} {Systems}},\n\tauthor = {Tucci, Nicholas and Cala, Jacek and Steyn, Jannetta and Missier, Paolo},\n\tyear = {2018},\n\tkeywords = {\\#genomics, \\#spark},\n}\n\n","author_short":["Tucci, N.","Cala, J.","Steyn, J.","Missier, P."],"key":"tucci_design_2018","id":"tucci_design_2018","bibbaseid":"tucci-cala-steyn-missier-designandevaluationofagenomicsvariantanalysispipelineusinggatksparktools-2018","role":"author","urls":{},"keyword":["#genomics","#spark"],"metadata":{"authorlinks":{}},"downloads":0},"search_terms":["design","evaluation","genomics","variant","analysis","pipeline","using","gatk","spark","tools","tucci","cala","steyn","missier"],"keywords":["#genomics","#spark"],"authorIDs":[],"dataSources":["zh27EpT9RPew3MWSE","ner3YxPo3mvD9E5ym","nF6KkFb4XxGruanwy","BDjqJntjXzyBmLxhv","25kjbmCDwcgy8vnRq","oiWqtmpFQ6ZtiMEK2","k75vCTghu54BjX5qH","j9tnaL2u4rifwAc2v","NCorZq2vkXK6BnhLF","ze2X9uz8Dcv2oGipf","coF7QgJraNKfmikbB","afppXLgSuddAzAL9e","wJE4ynGem9MRsXBRn","9zrgMZfGdRkdkNXfZ","qTQGxWDYeue2pHBus"]}