Labeling Noncontrast Head CT Reports for Common Findings Using Natural Language Processing

Labeling Noncontrast Head CT Reports for Common Findings Using Natural Language Processing. Iorga, M., Drakopoulos, M., Naidech, A., Katsaggelos, A., Parrish, T., & Hill, V. American Journal of Neuroradiology, 43(5):721–726, may, 2022.

Paper doi abstract bibtex

BACKGROUND AND PURPOSE: Prioritizing reading of noncontrast head CT examinations through an automated triage system may improve time to care for patients with acute neuroradiologic findings. We present a natural language-processing approach for labeling findings in noncontrast head CT reports, which permits creation of a large, labeled dataset of head CT images for development of emergent-finding detection and reading-prioritization algorithms. MATERIALS AND METHODS: In this retrospective study, 1002 clinical radiology reports from noncontrast head CTs collected between 2008 and 2013 were manually labeled across 12 common neuroradiologic finding categories. Each report was then encoded using an n-gram model of unigrams, bigrams, and trigrams. A logistic regression model was then trained to label each report for every common finding. Models were trained and assessed using a combination of L2 regularization and 5-fold cross-validation. RESULTS: Model performance was strongest for the fracture, hemorrhage, herniation, mass effect, pneumocephalus, postoperative status, and volume loss models in which the area under the receiver operating characteristic curve exceeded 0.95. Performance was relatively weaker for the edema, hydrocephalus, infarct, tumor, and white-matter disease models (area under the receiver operating characteristic curve > 0.85). Analysis of coefficients revealed finding-specific words among the top coefficients in each model. Class output probabilities were found to be a useful indicator of predictive error on individual report examples in higher-performing models. CONCLUSIONS: Combining logistic regression with n-gram encoding is a robust approach to labeling common findings in noncontrast head CT reports.

@article{Michael2022a,
abstract = {BACKGROUND AND PURPOSE: Prioritizing reading of noncontrast head CT examinations through an automated triage system may improve time to care for patients with acute neuroradiologic findings. We present a natural language-processing approach for labeling findings in noncontrast head CT reports, which permits creation of a large, labeled dataset of head CT images for development of emergent-finding detection and reading-prioritization algorithms. MATERIALS AND METHODS: In this retrospective study, 1002 clinical radiology reports from noncontrast head CTs collected between 2008 and 2013 were manually labeled across 12 common neuroradiologic finding categories. Each report was then encoded using an n-gram model of unigrams, bigrams, and trigrams. A logistic regression model was then trained to label each report for every common finding. Models were trained and assessed using a combination of L2 regularization and 5-fold cross-validation. RESULTS: Model performance was strongest for the fracture, hemorrhage, herniation, mass effect, pneumocephalus, postoperative status, and volume loss models in which the area under the receiver operating characteristic curve exceeded 0.95. Performance was relatively weaker for the edema, hydrocephalus, infarct, tumor, and white-matter disease models (area under the receiver operating characteristic curve > 0.85). Analysis of coefficients revealed finding-specific words among the top coefficients in each model. Class output probabilities were found to be a useful indicator of predictive error on individual report examples in higher-performing models. CONCLUSIONS: Combining logistic regression with n-gram encoding is a robust approach to labeling common findings in noncontrast head CT reports.},
author = {Iorga, Michael and Drakopoulos, M. and Naidech, A.M. and Katsaggelos, A.K. and Parrish, T.B. and Hill, V.B.},
doi = {10.3174/ajnr.A7500},
issn = {0195-6108},
journal = {American Journal of Neuroradiology},
month = {may},
number = {5},
pages = {721--726},
pmid = {35483905},
title = {{Labeling Noncontrast Head CT Reports for Common Findings Using Natural Language Processing}},
url = {http://www.ajnr.org/lookup/doi/10.3174/ajnr.A7500},
volume = {43},
year = {2022}
}

Downloads: 0

{"_id":"oHat5oyWqyEHwJEJy","bibbaseid":"iorga-drakopoulos-naidech-katsaggelos-parrish-hill-labelingnoncontrastheadctreportsforcommonfindingsusingnaturallanguageprocessing-2022","author_short":["Iorga, M.","Drakopoulos, M.","Naidech, A.","Katsaggelos, A.","Parrish, T.","Hill, V."],"bibdata":{"bibtype":"article","type":"article","abstract":"BACKGROUND AND PURPOSE: Prioritizing reading of noncontrast head CT examinations through an automated triage system may improve time to care for patients with acute neuroradiologic findings. We present a natural language-processing approach for labeling findings in noncontrast head CT reports, which permits creation of a large, labeled dataset of head CT images for development of emergent-finding detection and reading-prioritization algorithms. MATERIALS AND METHODS: In this retrospective study, 1002 clinical radiology reports from noncontrast head CTs collected between 2008 and 2013 were manually labeled across 12 common neuroradiologic finding categories. Each report was then encoded using an n-gram model of unigrams, bigrams, and trigrams. A logistic regression model was then trained to label each report for every common finding. Models were trained and assessed using a combination of L2 regularization and 5-fold cross-validation. RESULTS: Model performance was strongest for the fracture, hemorrhage, herniation, mass effect, pneumocephalus, postoperative status, and volume loss models in which the area under the receiver operating characteristic curve exceeded 0.95. Performance was relatively weaker for the edema, hydrocephalus, infarct, tumor, and white-matter disease models (area under the receiver operating characteristic curve > 0.85). Analysis of coefficients revealed finding-specific words among the top coefficients in each model. Class output probabilities were found to be a useful indicator of predictive error on individual report examples in higher-performing models. CONCLUSIONS: Combining logistic regression with n-gram encoding is a robust approach to labeling common findings in noncontrast head CT reports.","author":[{"propositions":[],"lastnames":["Iorga"],"firstnames":["Michael"],"suffixes":[]},{"propositions":[],"lastnames":["Drakopoulos"],"firstnames":["M."],"suffixes":[]},{"propositions":[],"lastnames":["Naidech"],"firstnames":["A.M."],"suffixes":[]},{"propositions":[],"lastnames":["Katsaggelos"],"firstnames":["A.K."],"suffixes":[]},{"propositions":[],"lastnames":["Parrish"],"firstnames":["T.B."],"suffixes":[]},{"propositions":[],"lastnames":["Hill"],"firstnames":["V.B."],"suffixes":[]}],"doi":"10.3174/ajnr.A7500","issn":"0195-6108","journal":"American Journal of Neuroradiology","month":"may","number":"5","pages":"721–726","pmid":"35483905","title":"Labeling Noncontrast Head CT Reports for Common Findings Using Natural Language Processing","url":"http://www.ajnr.org/lookup/doi/10.3174/ajnr.A7500","volume":"43","year":"2022","bibtex":"@article{Michael2022a,\nabstract = {BACKGROUND AND PURPOSE: Prioritizing reading of noncontrast head CT examinations through an automated triage system may improve time to care for patients with acute neuroradiologic findings. We present a natural language-processing approach for labeling findings in noncontrast head CT reports, which permits creation of a large, labeled dataset of head CT images for development of emergent-finding detection and reading-prioritization algorithms. MATERIALS AND METHODS: In this retrospective study, 1002 clinical radiology reports from noncontrast head CTs collected between 2008 and 2013 were manually labeled across 12 common neuroradiologic finding categories. Each report was then encoded using an n-gram model of unigrams, bigrams, and trigrams. A logistic regression model was then trained to label each report for every common finding. Models were trained and assessed using a combination of L2 regularization and 5-fold cross-validation. RESULTS: Model performance was strongest for the fracture, hemorrhage, herniation, mass effect, pneumocephalus, postoperative status, and volume loss models in which the area under the receiver operating characteristic curve exceeded 0.95. Performance was relatively weaker for the edema, hydrocephalus, infarct, tumor, and white-matter disease models (area under the receiver operating characteristic curve > 0.85). Analysis of coefficients revealed finding-specific words among the top coefficients in each model. Class output probabilities were found to be a useful indicator of predictive error on individual report examples in higher-performing models. CONCLUSIONS: Combining logistic regression with n-gram encoding is a robust approach to labeling common findings in noncontrast head CT reports.},\nauthor = {Iorga, Michael and Drakopoulos, M. and Naidech, A.M. and Katsaggelos, A.K. and Parrish, T.B. and Hill, V.B.},\ndoi = {10.3174/ajnr.A7500},\nissn = {0195-6108},\njournal = {American Journal of Neuroradiology},\nmonth = {may},\nnumber = {5},\npages = {721--726},\npmid = {35483905},\ntitle = {{Labeling Noncontrast Head CT Reports for Common Findings Using Natural Language Processing}},\nurl = {http://www.ajnr.org/lookup/doi/10.3174/ajnr.A7500},\nvolume = {43},\nyear = {2022}\n}\n","author_short":["Iorga, M.","Drakopoulos, M.","Naidech, A.","Katsaggelos, A.","Parrish, T.","Hill, V."],"key":"Michael2022a","id":"Michael2022a","bibbaseid":"iorga-drakopoulos-naidech-katsaggelos-parrish-hill-labelingnoncontrastheadctreportsforcommonfindingsusingnaturallanguageprocessing-2022","role":"author","urls":{"Paper":"http://www.ajnr.org/lookup/doi/10.3174/ajnr.A7500"},"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://sites.northwestern.edu/ivpl/files/2023/06/IVPL_Updated_publications-1.bib","dataSources":["ePKPjG8C6yvpk4mEK","ya2CyA73rpZseyrZ8","zFPgsTDAW8aDnb5iN","E6Bth2QB5BYjBMZE7","nbnEjsN7MJhurAK9x","PNQZj6FjzoxxJk4Yi","7FpDWDGJ4KgpDiGfB","bod9ms4MQJHuJgPpp","QR9t5P2cLdJuzhfzK","D8k2SxfC5dKNRFgro","7Dwzbxq93HWrJEhT6","qhF8zxmGcJfvtdeAg","fvDEHD49E2ZRwE3fb","H7crv8NWhZup4d4by","DHqokWsryttGh7pJE","vRJd4wNg9HpoZSMHD","sYxQ6pxFgA59JRhxi","w2WahSbYrbcCKBDsC","XasdXLL99y5rygCmq","3gkSihZQRfAD2KBo3","t5XMbyZbtPBo4wBGS","bEpHM2CtrwW2qE8FP","teJzFLHexaz5AQW5z"],"keywords":[],"search_terms":["labeling","noncontrast","head","reports","common","findings","using","natural","language","processing","iorga","drakopoulos","naidech","katsaggelos","parrish","hill"],"title":"Labeling Noncontrast Head CT Reports for Common Findings Using Natural Language Processing","year":2022}