Learning Latent Space Representations to Predict Patient Outcomes: Model Development and Validation. Rongali, S., Rose, A. J., McManus, D. D., Bajracharya, A. S., Kapoor, A., Granillo, E., & Yu, H. Journal of Medical Internet Research, 22(3):e16374, 2020. Company: Journal of Medical Internet Research Distributor: Journal of Medical Internet Research Institution: Journal of Medical Internet Research Label: Journal of Medical Internet Research Publisher: JMIR Publications Inc., Toronto, CanadaPaper doi abstract bibtex Background: Scalable and accurate health outcome prediction using electronic health record (EHR) data has gained much attention in research recently. Previous machine learning models mostly ignore relations between different types of clinical data (ie, laboratory components, International Classification of Diseases codes, and medications). Objective: This study aimed to model such relations and build predictive models using the EHR data from intensive care units. We developed innovative neural network models and compared them with the widely used logistic regression model and other state-of-the-art neural network models to predict the patient’s mortality using their longitudinal EHR data. Methods: We built a set of neural network models that we collectively called as long short-term memory (LSTM) outcome prediction using comprehensive feature relations or in short, CLOUT. Our CLOUT models use a correlational neural network model to identify a latent space representation between different types of discrete clinical features during a patient’s encounter and integrate the latent representation into an LSTM-based predictive model framework. In addition, we designed an ablation experiment to identify risk factors from our CLOUT models. Using physicians’ input as the gold standard, we compared the risk factors identified by both CLOUT and logistic regression models. Results: Experiments on the Medical Information Mart for Intensive Care-III dataset (selected patient population: 7537) show that CLOUT (area under the receiver operating characteristic curve=0.89) has surpassed logistic regression (0.82) and other baseline NN models (<0.86). In addition, physicians’ agreement with the CLOUT-derived risk factor rankings was statistically significantly higher than the agreement with the logistic regression model. Conclusions: Our results support the applicability of CLOUT for real-world clinical use in identifying patients at high risk of mortality. Trial Registration: [J Med Internet Res 2020;22(3):e16374]
@article{rongali_learning_2020,
title = {Learning {Latent} {Space} {Representations} to {Predict} {Patient} {Outcomes}: {Model} {Development} and {Validation}},
volume = {22},
shorttitle = {Learning {Latent} {Space} {Representations} to {Predict} {Patient} {Outcomes}},
url = {https://www.jmir.org/2020/3/e16374/},
doi = {10.2196/16374},
abstract = {Background: Scalable and accurate health outcome prediction using electronic health record (EHR) data has gained much attention in research recently. Previous machine learning models mostly ignore relations between different types of clinical data (ie, laboratory components, International Classification of Diseases codes, and medications).
Objective: This study aimed to model such relations and build predictive models using the EHR data from intensive care units. We developed innovative neural network models and compared them with the widely used logistic regression model and other state-of-the-art neural network models to predict the patient’s mortality using their longitudinal EHR data.
Methods: We built a set of neural network models that we collectively called as long short-term memory (LSTM) outcome prediction using comprehensive feature relations or in short, CLOUT. Our CLOUT models use a correlational neural network model to identify a latent space representation between different types of discrete clinical features during a patient’s encounter and integrate the latent representation into an LSTM-based predictive model framework. In addition, we designed an ablation experiment to identify risk factors from our CLOUT models. Using physicians’ input as the gold standard, we compared the risk factors identified by both CLOUT and logistic regression models.
Results: Experiments on the Medical Information Mart for Intensive Care-III dataset (selected patient population: 7537) show that CLOUT (area under the receiver operating characteristic curve=0.89) has surpassed logistic regression (0.82) and other baseline NN models (\<0.86). In addition, physicians’ agreement with the CLOUT-derived risk factor rankings was statistically significantly higher than the agreement with the logistic regression model.
Conclusions: Our results support the applicability of CLOUT for real-world clinical use in identifying patients at high risk of mortality.
Trial Registration:
[J Med Internet Res 2020;22(3):e16374]},
language = {en},
number = {3},
urldate = {2020-04-07},
journal = {Journal of Medical Internet Research},
author = {Rongali, Subendhu and Rose, Adam J. and McManus, David D. and Bajracharya, Adarsha S. and Kapoor, Alok and Granillo, Edgard and Yu, Hong},
year = {2020},
pmid = {32202503 PMCID: PMC7136840},
note = {Company: Journal of Medical Internet
Research
Distributor: Journal of Medical Internet Research
Institution: Journal of Medical Internet Research
Label: Journal of Medical Internet Research
Publisher: JMIR Publications Inc., Toronto, Canada},
pages = {e16374},
}
Downloads: 0
{"_id":"PxcM3Nw3YpSkJzuz4","bibbaseid":"rongali-rose-mcmanus-bajracharya-kapoor-granillo-yu-learninglatentspacerepresentationstopredictpatientoutcomesmodeldevelopmentandvalidation-2020","author_short":["Rongali, S.","Rose, A. J.","McManus, D. D.","Bajracharya, A. S.","Kapoor, A.","Granillo, E.","Yu, H."],"bibdata":{"bibtype":"article","type":"article","title":"Learning Latent Space Representations to Predict Patient Outcomes: Model Development and Validation","volume":"22","shorttitle":"Learning Latent Space Representations to Predict Patient Outcomes","url":"https://www.jmir.org/2020/3/e16374/","doi":"10.2196/16374","abstract":"Background: Scalable and accurate health outcome prediction using electronic health record (EHR) data has gained much attention in research recently. Previous machine learning models mostly ignore relations between different types of clinical data (ie, laboratory components, International Classification of Diseases codes, and medications). Objective: This study aimed to model such relations and build predictive models using the EHR data from intensive care units. We developed innovative neural network models and compared them with the widely used logistic regression model and other state-of-the-art neural network models to predict the patient’s mortality using their longitudinal EHR data. Methods: We built a set of neural network models that we collectively called as long short-term memory (LSTM) outcome prediction using comprehensive feature relations or in short, CLOUT. Our CLOUT models use a correlational neural network model to identify a latent space representation between different types of discrete clinical features during a patient’s encounter and integrate the latent representation into an LSTM-based predictive model framework. In addition, we designed an ablation experiment to identify risk factors from our CLOUT models. Using physicians’ input as the gold standard, we compared the risk factors identified by both CLOUT and logistic regression models. Results: Experiments on the Medical Information Mart for Intensive Care-III dataset (selected patient population: 7537) show that CLOUT (area under the receiver operating characteristic curve=0.89) has surpassed logistic regression (0.82) and other baseline NN models (<0.86). In addition, physicians’ agreement with the CLOUT-derived risk factor rankings was statistically significantly higher than the agreement with the logistic regression model. Conclusions: Our results support the applicability of CLOUT for real-world clinical use in identifying patients at high risk of mortality. Trial Registration: [J Med Internet Res 2020;22(3):e16374]","language":"en","number":"3","urldate":"2020-04-07","journal":"Journal of Medical Internet Research","author":[{"propositions":[],"lastnames":["Rongali"],"firstnames":["Subendhu"],"suffixes":[]},{"propositions":[],"lastnames":["Rose"],"firstnames":["Adam","J."],"suffixes":[]},{"propositions":[],"lastnames":["McManus"],"firstnames":["David","D."],"suffixes":[]},{"propositions":[],"lastnames":["Bajracharya"],"firstnames":["Adarsha","S."],"suffixes":[]},{"propositions":[],"lastnames":["Kapoor"],"firstnames":["Alok"],"suffixes":[]},{"propositions":[],"lastnames":["Granillo"],"firstnames":["Edgard"],"suffixes":[]},{"propositions":[],"lastnames":["Yu"],"firstnames":["Hong"],"suffixes":[]}],"year":"2020","pmid":"32202503 PMCID: PMC7136840","note":"Company: Journal of Medical Internet Research Distributor: Journal of Medical Internet Research Institution: Journal of Medical Internet Research Label: Journal of Medical Internet Research Publisher: JMIR Publications Inc., Toronto, Canada","pages":"e16374","bibtex":"@article{rongali_learning_2020,\n\ttitle = {Learning {Latent} {Space} {Representations} to {Predict} {Patient} {Outcomes}: {Model} {Development} and {Validation}},\n\tvolume = {22},\n\tshorttitle = {Learning {Latent} {Space} {Representations} to {Predict} {Patient} {Outcomes}},\n\turl = {https://www.jmir.org/2020/3/e16374/},\n\tdoi = {10.2196/16374},\n\tabstract = {Background: Scalable and accurate health outcome prediction using electronic health record (EHR) data has gained much attention in research recently. Previous machine learning models mostly ignore relations between different types of clinical data (ie, laboratory components, International Classification of Diseases codes, and medications).\n Objective: This study aimed to model such relations and build predictive models using the EHR data from intensive care units. We developed innovative neural network models and compared them with the widely used logistic regression model and other state-of-the-art neural network models to predict the patient’s mortality using their longitudinal EHR data.\n Methods: We built a set of neural network models that we collectively called as long short-term memory (LSTM) outcome prediction using comprehensive feature relations or in short, CLOUT. Our CLOUT models use a correlational neural network model to identify a latent space representation between different types of discrete clinical features during a patient’s encounter and integrate the latent representation into an LSTM-based predictive model framework. In addition, we designed an ablation experiment to identify risk factors from our CLOUT models. Using physicians’ input as the gold standard, we compared the risk factors identified by both CLOUT and logistic regression models.\n Results: Experiments on the Medical Information Mart for Intensive Care-III dataset (selected patient population: 7537) show that CLOUT (area under the receiver operating characteristic curve=0.89) has surpassed logistic regression (0.82) and other baseline NN models (\\<0.86). In addition, physicians’ agreement with the CLOUT-derived risk factor rankings was statistically significantly higher than the agreement with the logistic regression model.\n Conclusions: Our results support the applicability of CLOUT for real-world clinical use in identifying patients at high risk of mortality.\n Trial Registration: \n [J Med Internet Res 2020;22(3):e16374]},\n\tlanguage = {en},\n\tnumber = {3},\n\turldate = {2020-04-07},\n\tjournal = {Journal of Medical Internet Research},\n\tauthor = {Rongali, Subendhu and Rose, Adam J. and McManus, David D. and Bajracharya, Adarsha S. and Kapoor, Alok and Granillo, Edgard and Yu, Hong},\n\tyear = {2020},\n\tpmid = {32202503 PMCID: PMC7136840},\n\tnote = {Company: Journal of Medical Internet \nResearch\nDistributor: Journal of Medical Internet Research\nInstitution: Journal of Medical Internet Research\nLabel: Journal of Medical Internet Research\nPublisher: JMIR Publications Inc., Toronto, Canada},\n\tpages = {e16374},\n}\n\n","author_short":["Rongali, S.","Rose, A. J.","McManus, D. D.","Bajracharya, A. S.","Kapoor, A.","Granillo, E.","Yu, H."],"key":"rongali_learning_2020","id":"rongali_learning_2020","bibbaseid":"rongali-rose-mcmanus-bajracharya-kapoor-granillo-yu-learninglatentspacerepresentationstopredictpatientoutcomesmodeldevelopmentandvalidation-2020","role":"author","urls":{"Paper":"https://www.jmir.org/2020/3/e16374/"},"metadata":{"authorlinks":{}},"html":""},"bibtype":"article","biburl":"http://fenway.cs.uml.edu/papers/pubs-all.bib","dataSources":["TqaA9miSB65nRfS5H"],"keywords":[],"search_terms":["learning","latent","space","representations","predict","patient","outcomes","model","development","validation","rongali","rose","mcmanus","bajracharya","kapoor","granillo","yu"],"title":"Learning Latent Space Representations to Predict Patient Outcomes: Model Development and Validation","year":2020}