Searching the Sequence Read Archive Using Jetstream and Wrangler. Levi, K., Rynge, M., Abeysinghe, E., & Edwards, R., A. In Proceedings of the Practice and Experience on Advanced Research Computing (PEARC '18), of PEARC '18, pages 50:1--50:7, 7, 2018. ACM. Paper Website doi abstract bibtex The Sequence Read Archive (SRA), the world’s largest database of sequences, hosts approximately 10 petabases (1016 bp) of sequence data and is growing at the alarming rate of 10 TB per day. Yet this rich trove of data is inaccessible to most researchers: searching through the SRA requires large storage and computing facilities that are beyond the capacity of most laboratories. Enabling scientists to analyze existing sequence data will provide insight into ecology, medicine, and industrial applications. In this project we specifi- cally focus on metagenomic sequences (whole community data sets from different environments). We are developing a set of tools to enable biologists to mine the metagenomes in the SRA using the NSF-funded cloud computing resources, Jetstream and Wrangler. We have developed a proof-of-principle pipeline to demonstrate the feasibility of the approach. We are leveraging our existing in- frastructure to enable all scientists to access the SRA metagenomes regardless of their computational ability and are working to create a stable pipeline with a science gateway portal that is accessible to all researchers.تنيىسبت
@inproceedings{
title = {Searching the Sequence Read Archive Using Jetstream and Wrangler},
type = {inproceedings},
year = {2018},
keywords = {Apache Airavata,Bacteriophage,Credential Store,Jetstream,Metagenomics,Metagenomics Discovery Challenge,SRA,SRA Gateway,SciGaP,Search SRA,Sequence Read Archive,Wrangler},
pages = {50:1--50:7},
websites = {http://doi.acm.org/10.1145/3219104.3229278},
month = {7},
publisher = {ACM},
day = {22},
city = {New York, NY, USA},
series = {PEARC '18},
id = {0aa8664d-88c2-338b-bb19-e0153c638275},
created = {2019-10-01T17:21:06.731Z},
accessed = {2019-09-12},
file_attached = {true},
profile_id = {42d295c0-0737-38d6-8b43-508cab6ea85d},
last_modified = {2019-10-01T17:30:53.978Z},
read = {false},
starred = {false},
authored = {true},
confirmed = {true},
hidden = {false},
citation_key = {Levi:2018:SSR:3219104.3229278},
source_type = {inproceedings},
private_publication = {false},
abstract = {The Sequence Read Archive (SRA), the world’s largest database of sequences, hosts approximately 10 petabases (1016 bp) of sequence data and is growing at the alarming rate of 10 TB per day. Yet this rich trove of data is inaccessible to most researchers: searching through the SRA requires large storage and computing facilities that are beyond the capacity of most laboratories. Enabling scientists to analyze existing sequence data will provide insight into ecology, medicine, and industrial applications. In this project we specifi- cally focus on metagenomic sequences (whole community data sets from different environments). We are developing a set of tools to enable biologists to mine the metagenomes in the SRA using the NSF-funded cloud computing resources, Jetstream and Wrangler. We have developed a proof-of-principle pipeline to demonstrate the feasibility of the approach. We are leveraging our existing in- frastructure to enable all scientists to access the SRA metagenomes regardless of their computational ability and are working to create a stable pipeline with a science gateway portal that is accessible to all researchers.تنيىسبت},
bibtype = {inproceedings},
author = {Levi, Kyle and Rynge, Mats and Abeysinghe, Eroma and Edwards, Robert A},
doi = {10.1145/3219104.3229278},
booktitle = {Proceedings of the Practice and Experience on Advanced Research Computing (PEARC '18)}
}
Downloads: 0
{"_id":"H33aSrXvX8T9traf9","bibbaseid":"levi-rynge-abeysinghe-edwards-searchingthesequencereadarchiveusingjetstreamandwrangler-2018","downloads":0,"creationDate":"2018-08-10T03:55:30.678Z","title":"Searching the Sequence Read Archive Using Jetstream and Wrangler","author_short":["Levi, K.","Rynge, M.","Abeysinghe, E.","Edwards, R., A."],"year":2018,"bibtype":"inproceedings","biburl":"https://bibbase.org/service/mendeley/42d295c0-0737-38d6-8b43-508cab6ea85d","bibdata":{"title":"Searching the Sequence Read Archive Using Jetstream and Wrangler","type":"inproceedings","year":"2018","keywords":"Apache Airavata,Bacteriophage,Credential Store,Jetstream,Metagenomics,Metagenomics Discovery Challenge,SRA,SRA Gateway,SciGaP,Search SRA,Sequence Read Archive,Wrangler","pages":"50:1--50:7","websites":"http://doi.acm.org/10.1145/3219104.3229278","month":"7","publisher":"ACM","day":"22","city":"New York, NY, USA","series":"PEARC '18","id":"0aa8664d-88c2-338b-bb19-e0153c638275","created":"2019-10-01T17:21:06.731Z","accessed":"2019-09-12","file_attached":"true","profile_id":"42d295c0-0737-38d6-8b43-508cab6ea85d","last_modified":"2019-10-01T17:30:53.978Z","read":false,"starred":false,"authored":"true","confirmed":"true","hidden":false,"citation_key":"Levi:2018:SSR:3219104.3229278","source_type":"inproceedings","private_publication":false,"abstract":"The Sequence Read Archive (SRA), the world’s largest database of sequences, hosts approximately 10 petabases (1016 bp) of sequence data and is growing at the alarming rate of 10 TB per day. Yet this rich trove of data is inaccessible to most researchers: searching through the SRA requires large storage and computing facilities that are beyond the capacity of most laboratories. Enabling scientists to analyze existing sequence data will provide insight into ecology, medicine, and industrial applications. In this project we specifi- cally focus on metagenomic sequences (whole community data sets from different environments). We are developing a set of tools to enable biologists to mine the metagenomes in the SRA using the NSF-funded cloud computing resources, Jetstream and Wrangler. We have developed a proof-of-principle pipeline to demonstrate the feasibility of the approach. We are leveraging our existing in- frastructure to enable all scientists to access the SRA metagenomes regardless of their computational ability and are working to create a stable pipeline with a science gateway portal that is accessible to all researchers.تنيىسبت","bibtype":"inproceedings","author":"Levi, Kyle and Rynge, Mats and Abeysinghe, Eroma and Edwards, Robert A","doi":"10.1145/3219104.3229278","booktitle":"Proceedings of the Practice and Experience on Advanced Research Computing (PEARC '18)","bibtex":"@inproceedings{\n title = {Searching the Sequence Read Archive Using Jetstream and Wrangler},\n type = {inproceedings},\n year = {2018},\n keywords = {Apache Airavata,Bacteriophage,Credential Store,Jetstream,Metagenomics,Metagenomics Discovery Challenge,SRA,SRA Gateway,SciGaP,Search SRA,Sequence Read Archive,Wrangler},\n pages = {50:1--50:7},\n websites = {http://doi.acm.org/10.1145/3219104.3229278},\n month = {7},\n publisher = {ACM},\n day = {22},\n city = {New York, NY, USA},\n series = {PEARC '18},\n id = {0aa8664d-88c2-338b-bb19-e0153c638275},\n created = {2019-10-01T17:21:06.731Z},\n accessed = {2019-09-12},\n file_attached = {true},\n profile_id = {42d295c0-0737-38d6-8b43-508cab6ea85d},\n last_modified = {2019-10-01T17:30:53.978Z},\n read = {false},\n starred = {false},\n authored = {true},\n confirmed = {true},\n hidden = {false},\n citation_key = {Levi:2018:SSR:3219104.3229278},\n source_type = {inproceedings},\n private_publication = {false},\n abstract = {The Sequence Read Archive (SRA), the world’s largest database of sequences, hosts approximately 10 petabases (1016 bp) of sequence data and is growing at the alarming rate of 10 TB per day. Yet this rich trove of data is inaccessible to most researchers: searching through the SRA requires large storage and computing facilities that are beyond the capacity of most laboratories. Enabling scientists to analyze existing sequence data will provide insight into ecology, medicine, and industrial applications. In this project we specifi- cally focus on metagenomic sequences (whole community data sets from different environments). We are developing a set of tools to enable biologists to mine the metagenomes in the SRA using the NSF-funded cloud computing resources, Jetstream and Wrangler. We have developed a proof-of-principle pipeline to demonstrate the feasibility of the approach. We are leveraging our existing in- frastructure to enable all scientists to access the SRA metagenomes regardless of their computational ability and are working to create a stable pipeline with a science gateway portal that is accessible to all researchers.تنيىسبت},\n bibtype = {inproceedings},\n author = {Levi, Kyle and Rynge, Mats and Abeysinghe, Eroma and Edwards, Robert A},\n doi = {10.1145/3219104.3229278},\n booktitle = {Proceedings of the Practice and Experience on Advanced Research Computing (PEARC '18)}\n}","author_short":["Levi, K.","Rynge, M.","Abeysinghe, E.","Edwards, R., A."],"urls":{"Paper":"https://bibbase.org/service/mendeley/42d295c0-0737-38d6-8b43-508cab6ea85d/file/1949897f-8195-6ea1-6ed4-5eba7c67d036/Levi_et_al___2018___Searching_the_sequence_read_archive_using_Jetstream_and_Wrangler.pdf.pdf","Website":"http://doi.acm.org/10.1145/3219104.3229278"},"biburl":"https://bibbase.org/service/mendeley/42d295c0-0737-38d6-8b43-508cab6ea85d","bibbaseid":"levi-rynge-abeysinghe-edwards-searchingthesequencereadarchiveusingjetstreamandwrangler-2018","role":"author","keyword":["Apache Airavata","Bacteriophage","Credential Store","Jetstream","Metagenomics","Metagenomics Discovery Challenge","SRA","SRA Gateway","SciGaP","Search SRA","Sequence Read Archive","Wrangler"],"metadata":{"authorlinks":{"pierce, m":"https://bibbase.org/service/mendeley/42d295c0-0737-38d6-8b43-508cab6ea85d/group/0e433c5b-85c4-32aa-851c-c145aac9f80f"}},"downloads":0},"search_terms":["searching","sequence","read","archive","using","jetstream","wrangler","levi","rynge","abeysinghe","edwards"],"keywords":["apache airavata","bacteriophage","credential store","jetstream","metagenomics","metagenomics discovery challenge","sra","sra gateway","scigap","search sra","sequence read archive","wrangler"],"authorIDs":["jQQtqgyqXNWFo8FY3"],"dataSources":["zgahneP4uAjKbudrQ","ya2CyA73rpZseyrZ8","YQaWajsCRKJEpqDSK","sBTFeXzymyJsrtXYW","xLGm89T2Bei8G9ivR","bEKX7Racf7sDbmaBk","rWqHi9YGCqPaR2XHv","RbqMf65z5GHY5y4Zd","2252seNhipfTmjEBQ"]}