Repeat it without me: Crowdsourcing the T1 mapping common ground via the ISMRM reproducibility challenge. Boudreau, M., Karakuzu, A., Cohen-Adad, J., Bozkurt, E., Carr, M., Castellaro, M., Concha, L., Doneva, M., Dual, S. A., Ensworth, A., Foias, A., Fortier, V., Gabr, R. E., Gilbert, G., Glide-Hurst, C. K., Grech-Sollars, M., Hu, S., Jalnefjord, O., Jovicich, J., Keskin, K., Koken, P., Kolokotronis, A., Kukran, S., Lee, N. G., Levesque, I. R., Li, B., Ma, D., Mädler, B., Maforo, N. G., Near, J., Pasaye, E., Ramirez-Manzanares, A., Statton, B., Stehning, C., Tambalo, S., Tian, Y., Wang, C., Weiss, K., Zakariaei, N., Zhang, S., Zhao, Z., Stikov, N., the ISMRM Reproducible Research Study Group, & Group, t. I. Q. M. S. Magnetic Resonance in Medicine. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/mrm.30111
Paper doi abstract bibtex Purpose T1 mapping is a widely used quantitative MRI technique, but its tissue-specific values remain inconsistent across protocols, sites, and vendors. The ISMRM Reproducible Research and Quantitative MR study groups jointly launched a challenge to assess the reproducibility of a well-established inversion-recovery T1 mapping technique, using acquisition details from a seminal T1 mapping paper on a standardized phantom and in human brains. Methods The challenge used the acquisition protocol from Barral et al. (2010). Researchers collected T1 mapping data on the ISMRM/NIST phantom and/or in human brains. Data submission, pipeline development, and analysis were conducted using open-source platforms. Intersubmission and intrasubmission comparisons were performed. Results Eighteen submissions (39 phantom and 56 human datasets) on scanners by three MRI vendors were collected at 3 T (except one, at 0.35 T). The mean coefficient of variation was 6.1% for intersubmission phantom measurements, and 2.9% for intrasubmission measurements. For humans, the intersubmission/intrasubmission coefficient of variation was 5.9/3.2% in the genu and 16/6.9% in the cortex. An interactive dashboard for data visualization was also developed: https://rrsg2020.dashboards.neurolibre.org. Conclusion The T1 intersubmission variability was twice as high as the intrasubmission variability in both phantoms and human brains, indicating that the acquisition details in the original paper were insufficient to reproduce a quantitative MRI protocol. This study reports the inherent uncertainty in T1 measures across independent research groups, bringing us one step closer to a practical clinical baseline of T1 variations in vivo.
@article{boudreau_repeat_nodate,
title = {Repeat it without me: {Crowdsourcing} the {T1} mapping common ground via the {ISMRM} reproducibility challenge},
volume = {n/a},
copyright = {© 2024 The Authors. Magnetic Resonance in Medicine published by Wiley Periodicals LLC on behalf of International Society for Magnetic Resonance in Medicine.},
issn = {1522-2594},
shorttitle = {Repeat it without me},
url = {https://onlinelibrary.wiley.com/doi/abs/10.1002/mrm.30111},
doi = {10.1002/mrm.30111},
abstract = {Purpose T1 mapping is a widely used quantitative MRI technique, but its tissue-specific values remain inconsistent across protocols, sites, and vendors. The ISMRM Reproducible Research and Quantitative MR study groups jointly launched a challenge to assess the reproducibility of a well-established inversion-recovery T1 mapping technique, using acquisition details from a seminal T1 mapping paper on a standardized phantom and in human brains. Methods The challenge used the acquisition protocol from Barral et al. (2010). Researchers collected T1 mapping data on the ISMRM/NIST phantom and/or in human brains. Data submission, pipeline development, and analysis were conducted using open-source platforms. Intersubmission and intrasubmission comparisons were performed. Results Eighteen submissions (39 phantom and 56 human datasets) on scanners by three MRI vendors were collected at 3 T (except one, at 0.35 T). The mean coefficient of variation was 6.1\% for intersubmission phantom measurements, and 2.9\% for intrasubmission measurements. For humans, the intersubmission/intrasubmission coefficient of variation was 5.9/3.2\% in the genu and 16/6.9\% in the cortex. An interactive dashboard for data visualization was also developed: https://rrsg2020.dashboards.neurolibre.org. Conclusion The T1 intersubmission variability was twice as high as the intrasubmission variability in both phantoms and human brains, indicating that the acquisition details in the original paper were insufficient to reproduce a quantitative MRI protocol. This study reports the inherent uncertainty in T1 measures across independent research groups, bringing us one step closer to a practical clinical baseline of T1 variations in vivo.},
language = {en},
number = {n/a},
urldate = {2024-05-14},
journal = {Magnetic Resonance in Medicine},
author = {Boudreau, Mathieu and Karakuzu, Agah and Cohen-Adad, Julien and Bozkurt, Ecem and Carr, Madeline and Castellaro, Marco and Concha, Luis and Doneva, Mariya and Dual, Seraina A. and Ensworth, Alex and Foias, Alexandru and Fortier, Véronique and Gabr, Refaat E. and Gilbert, Guillaume and Glide-Hurst, Carri K. and Grech-Sollars, Matthew and Hu, Siyuan and Jalnefjord, Oscar and Jovicich, Jorge and Keskin, Kübra and Koken, Peter and Kolokotronis, Anastasia and Kukran, Simran and Lee, Nam G. and Levesque, Ives R. and Li, Bochao and Ma, Dan and Mädler, Burkhard and Maforo, Nyasha G. and Near, Jamie and Pasaye, Erick and Ramirez-Manzanares, Alonso and Statton, Ben and Stehning, Christian and Tambalo, Stefano and Tian, Ye and Wang, Chenyang and Weiss, Kilian and Zakariaei, Niloufar and Zhang, Shuo and Zhao, Ziwei and Stikov, Nikola and {the ISMRM Reproducible Research Study Group and the ISMRM Quantitative MR Study Group}},
note = {\_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/mrm.30111},
keywords = {T1 mapping, inversion recovery, open data, quantitative MRI, reproducibility},
}
Downloads: 0
{"_id":"Syighp2XqycQxMQ7H","bibbaseid":"boudreau-karakuzu-cohenadad-bozkurt-carr-castellaro-concha-doneva-etal-repeatitwithoutmecrowdsourcingthet1mappingcommongroundviatheismrmreproducibilitychallenge","author_short":["Boudreau, M.","Karakuzu, A.","Cohen-Adad, J.","Bozkurt, E.","Carr, M.","Castellaro, M.","Concha, L.","Doneva, M.","Dual, S. A.","Ensworth, A.","Foias, A.","Fortier, V.","Gabr, R. E.","Gilbert, G.","Glide-Hurst, C. K.","Grech-Sollars, M.","Hu, S.","Jalnefjord, O.","Jovicich, J.","Keskin, K.","Koken, P.","Kolokotronis, A.","Kukran, S.","Lee, N. G.","Levesque, I. R.","Li, B.","Ma, D.","Mädler, B.","Maforo, N. G.","Near, J.","Pasaye, E.","Ramirez-Manzanares, A.","Statton, B.","Stehning, C.","Tambalo, S.","Tian, Y.","Wang, C.","Weiss, K.","Zakariaei, N.","Zhang, S.","Zhao, Z.","Stikov, N.","the ISMRM Reproducible Research Study Group","Group, t. I. Q. M. S."],"bibdata":{"bibtype":"article","type":"article","title":"Repeat it without me: Crowdsourcing the T1 mapping common ground via the ISMRM reproducibility challenge","volume":"n/a","copyright":"© 2024 The Authors. Magnetic Resonance in Medicine published by Wiley Periodicals LLC on behalf of International Society for Magnetic Resonance in Medicine.","issn":"1522-2594","shorttitle":"Repeat it without me","url":"https://onlinelibrary.wiley.com/doi/abs/10.1002/mrm.30111","doi":"10.1002/mrm.30111","abstract":"Purpose T1 mapping is a widely used quantitative MRI technique, but its tissue-specific values remain inconsistent across protocols, sites, and vendors. The ISMRM Reproducible Research and Quantitative MR study groups jointly launched a challenge to assess the reproducibility of a well-established inversion-recovery T1 mapping technique, using acquisition details from a seminal T1 mapping paper on a standardized phantom and in human brains. Methods The challenge used the acquisition protocol from Barral et al. (2010). Researchers collected T1 mapping data on the ISMRM/NIST phantom and/or in human brains. Data submission, pipeline development, and analysis were conducted using open-source platforms. Intersubmission and intrasubmission comparisons were performed. Results Eighteen submissions (39 phantom and 56 human datasets) on scanners by three MRI vendors were collected at 3 T (except one, at 0.35 T). The mean coefficient of variation was 6.1% for intersubmission phantom measurements, and 2.9% for intrasubmission measurements. For humans, the intersubmission/intrasubmission coefficient of variation was 5.9/3.2% in the genu and 16/6.9% in the cortex. An interactive dashboard for data visualization was also developed: https://rrsg2020.dashboards.neurolibre.org. Conclusion The T1 intersubmission variability was twice as high as the intrasubmission variability in both phantoms and human brains, indicating that the acquisition details in the original paper were insufficient to reproduce a quantitative MRI protocol. This study reports the inherent uncertainty in T1 measures across independent research groups, bringing us one step closer to a practical clinical baseline of T1 variations in vivo.","language":"en","number":"n/a","urldate":"2024-05-14","journal":"Magnetic Resonance in Medicine","author":[{"propositions":[],"lastnames":["Boudreau"],"firstnames":["Mathieu"],"suffixes":[]},{"propositions":[],"lastnames":["Karakuzu"],"firstnames":["Agah"],"suffixes":[]},{"propositions":[],"lastnames":["Cohen-Adad"],"firstnames":["Julien"],"suffixes":[]},{"propositions":[],"lastnames":["Bozkurt"],"firstnames":["Ecem"],"suffixes":[]},{"propositions":[],"lastnames":["Carr"],"firstnames":["Madeline"],"suffixes":[]},{"propositions":[],"lastnames":["Castellaro"],"firstnames":["Marco"],"suffixes":[]},{"propositions":[],"lastnames":["Concha"],"firstnames":["Luis"],"suffixes":[]},{"propositions":[],"lastnames":["Doneva"],"firstnames":["Mariya"],"suffixes":[]},{"propositions":[],"lastnames":["Dual"],"firstnames":["Seraina","A."],"suffixes":[]},{"propositions":[],"lastnames":["Ensworth"],"firstnames":["Alex"],"suffixes":[]},{"propositions":[],"lastnames":["Foias"],"firstnames":["Alexandru"],"suffixes":[]},{"propositions":[],"lastnames":["Fortier"],"firstnames":["Véronique"],"suffixes":[]},{"propositions":[],"lastnames":["Gabr"],"firstnames":["Refaat","E."],"suffixes":[]},{"propositions":[],"lastnames":["Gilbert"],"firstnames":["Guillaume"],"suffixes":[]},{"propositions":[],"lastnames":["Glide-Hurst"],"firstnames":["Carri","K."],"suffixes":[]},{"propositions":[],"lastnames":["Grech-Sollars"],"firstnames":["Matthew"],"suffixes":[]},{"propositions":[],"lastnames":["Hu"],"firstnames":["Siyuan"],"suffixes":[]},{"propositions":[],"lastnames":["Jalnefjord"],"firstnames":["Oscar"],"suffixes":[]},{"propositions":[],"lastnames":["Jovicich"],"firstnames":["Jorge"],"suffixes":[]},{"propositions":[],"lastnames":["Keskin"],"firstnames":["Kübra"],"suffixes":[]},{"propositions":[],"lastnames":["Koken"],"firstnames":["Peter"],"suffixes":[]},{"propositions":[],"lastnames":["Kolokotronis"],"firstnames":["Anastasia"],"suffixes":[]},{"propositions":[],"lastnames":["Kukran"],"firstnames":["Simran"],"suffixes":[]},{"propositions":[],"lastnames":["Lee"],"firstnames":["Nam","G."],"suffixes":[]},{"propositions":[],"lastnames":["Levesque"],"firstnames":["Ives","R."],"suffixes":[]},{"propositions":[],"lastnames":["Li"],"firstnames":["Bochao"],"suffixes":[]},{"propositions":[],"lastnames":["Ma"],"firstnames":["Dan"],"suffixes":[]},{"propositions":[],"lastnames":["Mädler"],"firstnames":["Burkhard"],"suffixes":[]},{"propositions":[],"lastnames":["Maforo"],"firstnames":["Nyasha","G."],"suffixes":[]},{"propositions":[],"lastnames":["Near"],"firstnames":["Jamie"],"suffixes":[]},{"propositions":[],"lastnames":["Pasaye"],"firstnames":["Erick"],"suffixes":[]},{"propositions":[],"lastnames":["Ramirez-Manzanares"],"firstnames":["Alonso"],"suffixes":[]},{"propositions":[],"lastnames":["Statton"],"firstnames":["Ben"],"suffixes":[]},{"propositions":[],"lastnames":["Stehning"],"firstnames":["Christian"],"suffixes":[]},{"propositions":[],"lastnames":["Tambalo"],"firstnames":["Stefano"],"suffixes":[]},{"propositions":[],"lastnames":["Tian"],"firstnames":["Ye"],"suffixes":[]},{"propositions":[],"lastnames":["Wang"],"firstnames":["Chenyang"],"suffixes":[]},{"propositions":[],"lastnames":["Weiss"],"firstnames":["Kilian"],"suffixes":[]},{"propositions":[],"lastnames":["Zakariaei"],"firstnames":["Niloufar"],"suffixes":[]},{"propositions":[],"lastnames":["Zhang"],"firstnames":["Shuo"],"suffixes":[]},{"propositions":[],"lastnames":["Zhao"],"firstnames":["Ziwei"],"suffixes":[]},{"propositions":[],"lastnames":["Stikov"],"firstnames":["Nikola"],"suffixes":[]},{"firstnames":[],"propositions":[],"lastnames":["the ISMRM Reproducible Research Study Group"],"suffixes":[]},{"firstnames":["the","ISMRM","Quantitative","MR","Study"],"propositions":[],"lastnames":["Group"],"suffixes":[]}],"note":"_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/mrm.30111","keywords":"T1 mapping, inversion recovery, open data, quantitative MRI, reproducibility","bibtex":"@article{boudreau_repeat_nodate,\n\ttitle = {Repeat it without me: {Crowdsourcing} the {T1} mapping common ground via the {ISMRM} reproducibility challenge},\n\tvolume = {n/a},\n\tcopyright = {© 2024 The Authors. Magnetic Resonance in Medicine published by Wiley Periodicals LLC on behalf of International Society for Magnetic Resonance in Medicine.},\n\tissn = {1522-2594},\n\tshorttitle = {Repeat it without me},\n\turl = {https://onlinelibrary.wiley.com/doi/abs/10.1002/mrm.30111},\n\tdoi = {10.1002/mrm.30111},\n\tabstract = {Purpose T1 mapping is a widely used quantitative MRI technique, but its tissue-specific values remain inconsistent across protocols, sites, and vendors. The ISMRM Reproducible Research and Quantitative MR study groups jointly launched a challenge to assess the reproducibility of a well-established inversion-recovery T1 mapping technique, using acquisition details from a seminal T1 mapping paper on a standardized phantom and in human brains. Methods The challenge used the acquisition protocol from Barral et al. (2010). Researchers collected T1 mapping data on the ISMRM/NIST phantom and/or in human brains. Data submission, pipeline development, and analysis were conducted using open-source platforms. Intersubmission and intrasubmission comparisons were performed. Results Eighteen submissions (39 phantom and 56 human datasets) on scanners by three MRI vendors were collected at 3 T (except one, at 0.35 T). The mean coefficient of variation was 6.1\\% for intersubmission phantom measurements, and 2.9\\% for intrasubmission measurements. For humans, the intersubmission/intrasubmission coefficient of variation was 5.9/3.2\\% in the genu and 16/6.9\\% in the cortex. An interactive dashboard for data visualization was also developed: https://rrsg2020.dashboards.neurolibre.org. Conclusion The T1 intersubmission variability was twice as high as the intrasubmission variability in both phantoms and human brains, indicating that the acquisition details in the original paper were insufficient to reproduce a quantitative MRI protocol. This study reports the inherent uncertainty in T1 measures across independent research groups, bringing us one step closer to a practical clinical baseline of T1 variations in vivo.},\n\tlanguage = {en},\n\tnumber = {n/a},\n\turldate = {2024-05-14},\n\tjournal = {Magnetic Resonance in Medicine},\n\tauthor = {Boudreau, Mathieu and Karakuzu, Agah and Cohen-Adad, Julien and Bozkurt, Ecem and Carr, Madeline and Castellaro, Marco and Concha, Luis and Doneva, Mariya and Dual, Seraina A. and Ensworth, Alex and Foias, Alexandru and Fortier, Véronique and Gabr, Refaat E. and Gilbert, Guillaume and Glide-Hurst, Carri K. and Grech-Sollars, Matthew and Hu, Siyuan and Jalnefjord, Oscar and Jovicich, Jorge and Keskin, Kübra and Koken, Peter and Kolokotronis, Anastasia and Kukran, Simran and Lee, Nam G. and Levesque, Ives R. and Li, Bochao and Ma, Dan and Mädler, Burkhard and Maforo, Nyasha G. and Near, Jamie and Pasaye, Erick and Ramirez-Manzanares, Alonso and Statton, Ben and Stehning, Christian and Tambalo, Stefano and Tian, Ye and Wang, Chenyang and Weiss, Kilian and Zakariaei, Niloufar and Zhang, Shuo and Zhao, Ziwei and Stikov, Nikola and {the ISMRM Reproducible Research Study Group and the ISMRM Quantitative MR Study Group}},\n\tnote = {\\_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/mrm.30111},\n\tkeywords = {T1 mapping, inversion recovery, open data, quantitative MRI, reproducibility},\n}\n\n\n\n\n\n\n\n","author_short":["Boudreau, M.","Karakuzu, A.","Cohen-Adad, J.","Bozkurt, E.","Carr, M.","Castellaro, M.","Concha, L.","Doneva, M.","Dual, S. A.","Ensworth, A.","Foias, A.","Fortier, V.","Gabr, R. E.","Gilbert, G.","Glide-Hurst, C. K.","Grech-Sollars, M.","Hu, S.","Jalnefjord, O.","Jovicich, J.","Keskin, K.","Koken, P.","Kolokotronis, A.","Kukran, S.","Lee, N. G.","Levesque, I. R.","Li, B.","Ma, D.","Mädler, B.","Maforo, N. G.","Near, J.","Pasaye, E.","Ramirez-Manzanares, A.","Statton, B.","Stehning, C.","Tambalo, S.","Tian, Y.","Wang, C.","Weiss, K.","Zakariaei, N.","Zhang, S.","Zhao, Z.","Stikov, N.","the ISMRM Reproducible Research Study Group","Group, t. I. Q. M. S."],"key":"boudreau_repeat_nodate","id":"boudreau_repeat_nodate","bibbaseid":"boudreau-karakuzu-cohenadad-bozkurt-carr-castellaro-concha-doneva-etal-repeatitwithoutmecrowdsourcingthet1mappingcommongroundviatheismrmreproducibilitychallenge","role":"author","urls":{"Paper":"https://onlinelibrary.wiley.com/doi/abs/10.1002/mrm.30111"},"keyword":["T1 mapping","inversion recovery","open data","quantitative MRI","reproducibility"],"metadata":{"authorlinks":{}},"downloads":0,"html":""},"bibtype":"article","biburl":"https://bibbase.org/zotero/lconcha","dataSources":["vCGHbq7YMoL4xbgTv"],"keywords":["t1 mapping","inversion recovery","open data","quantitative mri","reproducibility"],"search_terms":["repeat","without","crowdsourcing","mapping","common","ground","via","ismrm","reproducibility","challenge","boudreau","karakuzu","cohen-adad","bozkurt","carr","castellaro","concha","doneva","dual","ensworth","foias","fortier","gabr","gilbert","glide-hurst","grech-sollars","hu","jalnefjord","jovicich","keskin","koken","kolokotronis","kukran","lee","levesque","li","ma","mädler","maforo","near","pasaye","ramirez-manzanares","statton","stehning","tambalo","tian","wang","weiss","zakariaei","zhang","zhao","stikov","the ismrm reproducible research study group","group"],"title":"Repeat it without me: Crowdsourcing the T1 mapping common ground via the ISMRM reproducibility challenge","year":null}