Remaining useful life estimation of engineered systems using vanilla LSTM neural networks

Remaining useful life estimation of engineered systems using vanilla LSTM neural networks. Wu, Y., Yuan, M., Dong, S., Lin, L., & Liu, Y. Neurocomputing, 275:167–179, January, 2018.

Paper doi abstract bibtex

Long Short-Term Memory (LSTM) networks are a significant branch of Recurrent Neural Networks (RNN), capable of learning long-term dependencies. In recent years, vanilla LSTM (a variation of original LSTM above) has become the state-of-the-art model for a variety of machine learning problems, especially Natural Language Processing (NLP). However, in industry, this powerful Deep Neural Network (DNN) has not aroused wide concern. In research focusing on Prognostics and Health Management (PHM) technology for complex engineered systems, Remaining Useful Life (RUL) estimation is one of the most challenging problems, which can lead to appropriate maintenance actions to be scheduled proactively to avoid catastrophic failures and minimize economic losses of the systems. Following that, this paper aims to propose utilizing vanilla LSTM neural networks to get good RUL prediction accuracy which makes the most of long short-term memory ability, in the cases of complicated operations, working conditions, model degradations and strong noises. In addition, to promote cognition ability about model degradation processes, a dynamic differential technology was proposed to extract inter-frame information. The whole proposition is illustrated and discussed by performing tests on a case of the health monitoring of aircraft turbofan engines which have four different issues. Performances of vanilla LSTM are benchmarked with standard RNN and Gated Recurrent Unit (GRU) LSTM. Results show the significance of performance improvement achieved by vanilla LSTM.

@article{wu_remaining_2018,
	title = {Remaining useful life estimation of engineered systems using vanilla {LSTM} neural networks},
	volume = {275},
	issn = {0925-2312},
	url = {https://www.sciencedirect.com/science/article/pii/S0925231217309505},
	doi = {10.1016/j.neucom.2017.05.063},
	abstract = {Long Short-Term Memory (LSTM) networks are a significant branch of Recurrent Neural Networks (RNN), capable of learning long-term dependencies. In recent years, vanilla LSTM (a variation of original LSTM above) has become the state-of-the-art model for a variety of machine learning problems, especially Natural Language Processing (NLP). However, in industry, this powerful Deep Neural Network (DNN) has not aroused wide concern. In research focusing on Prognostics and Health Management (PHM) technology for complex engineered systems, Remaining Useful Life (RUL) estimation is one of the most challenging problems, which can lead to appropriate maintenance actions to be scheduled proactively to avoid catastrophic failures and minimize economic losses of the systems. Following that, this paper aims to propose utilizing vanilla LSTM neural networks to get good RUL prediction accuracy which makes the most of long short-term memory ability, in the cases of complicated operations, working conditions, model degradations and strong noises. In addition, to promote cognition ability about model degradation processes, a dynamic differential technology was proposed to extract inter-frame information. The whole proposition is illustrated and discussed by performing tests on a case of the health monitoring of aircraft turbofan engines which have four different issues. Performances of vanilla LSTM are benchmarked with standard RNN and Gated Recurrent Unit (GRU) LSTM. Results show the significance of performance improvement achieved by vanilla LSTM.},
	language = {en},
	urldate = {2021-09-28},
	journal = {Neurocomputing},
	author = {Wu, Yuting and Yuan, Mei and Dong, Shaopeng and Lin, Li and Liu, Yingqi},
	month = jan,
	year = {2018},
	keywords = {Dynamic differential feature, Long short-term memory neural network, Prognostics and health management, Remaining useful life estimation},
	pages = {167--179},
}

Downloads: 0

{"_id":"QxpZerWrQdCE9cCzb","bibbaseid":"wu-yuan-dong-lin-liu-remainingusefullifeestimationofengineeredsystemsusingvanillalstmneuralnetworks-2018","downloads":0,"creationDate":"2018-10-30T20:10:26.001Z","title":"Remaining useful life estimation of engineered systems using vanilla LSTM neural networks","author_short":["Wu, Y.","Yuan, M.","Dong, S.","Lin, L.","Liu, Y."],"year":2018,"bibtype":"article","biburl":"https://bibbase.org/zotero/mh_lenguyen","bibdata":{"bibtype":"article","type":"article","title":"Remaining useful life estimation of engineered systems using vanilla LSTM neural networks","volume":"275","issn":"0925-2312","url":"https://www.sciencedirect.com/science/article/pii/S0925231217309505","doi":"10.1016/j.neucom.2017.05.063","abstract":"Long Short-Term Memory (LSTM) networks are a significant branch of Recurrent Neural Networks (RNN), capable of learning long-term dependencies. In recent years, vanilla LSTM (a variation of original LSTM above) has become the state-of-the-art model for a variety of machine learning problems, especially Natural Language Processing (NLP). However, in industry, this powerful Deep Neural Network (DNN) has not aroused wide concern. In research focusing on Prognostics and Health Management (PHM) technology for complex engineered systems, Remaining Useful Life (RUL) estimation is one of the most challenging problems, which can lead to appropriate maintenance actions to be scheduled proactively to avoid catastrophic failures and minimize economic losses of the systems. Following that, this paper aims to propose utilizing vanilla LSTM neural networks to get good RUL prediction accuracy which makes the most of long short-term memory ability, in the cases of complicated operations, working conditions, model degradations and strong noises. In addition, to promote cognition ability about model degradation processes, a dynamic differential technology was proposed to extract inter-frame information. The whole proposition is illustrated and discussed by performing tests on a case of the health monitoring of aircraft turbofan engines which have four different issues. Performances of vanilla LSTM are benchmarked with standard RNN and Gated Recurrent Unit (GRU) LSTM. Results show the significance of performance improvement achieved by vanilla LSTM.","language":"en","urldate":"2021-09-28","journal":"Neurocomputing","author":[{"propositions":[],"lastnames":["Wu"],"firstnames":["Yuting"],"suffixes":[]},{"propositions":[],"lastnames":["Yuan"],"firstnames":["Mei"],"suffixes":[]},{"propositions":[],"lastnames":["Dong"],"firstnames":["Shaopeng"],"suffixes":[]},{"propositions":[],"lastnames":["Lin"],"firstnames":["Li"],"suffixes":[]},{"propositions":[],"lastnames":["Liu"],"firstnames":["Yingqi"],"suffixes":[]}],"month":"January","year":"2018","keywords":"Dynamic differential feature, Long short-term memory neural network, Prognostics and health management, Remaining useful life estimation","pages":"167–179","bibtex":"@article{wu_remaining_2018,\n\ttitle = {Remaining useful life estimation of engineered systems using vanilla {LSTM} neural networks},\n\tvolume = {275},\n\tissn = {0925-2312},\n\turl = {https://www.sciencedirect.com/science/article/pii/S0925231217309505},\n\tdoi = {10.1016/j.neucom.2017.05.063},\n\tabstract = {Long Short-Term Memory (LSTM) networks are a significant branch of Recurrent Neural Networks (RNN), capable of learning long-term dependencies. In recent years, vanilla LSTM (a variation of original LSTM above) has become the state-of-the-art model for a variety of machine learning problems, especially Natural Language Processing (NLP). However, in industry, this powerful Deep Neural Network (DNN) has not aroused wide concern. In research focusing on Prognostics and Health Management (PHM) technology for complex engineered systems, Remaining Useful Life (RUL) estimation is one of the most challenging problems, which can lead to appropriate maintenance actions to be scheduled proactively to avoid catastrophic failures and minimize economic losses of the systems. Following that, this paper aims to propose utilizing vanilla LSTM neural networks to get good RUL prediction accuracy which makes the most of long short-term memory ability, in the cases of complicated operations, working conditions, model degradations and strong noises. In addition, to promote cognition ability about model degradation processes, a dynamic differential technology was proposed to extract inter-frame information. The whole proposition is illustrated and discussed by performing tests on a case of the health monitoring of aircraft turbofan engines which have four different issues. Performances of vanilla LSTM are benchmarked with standard RNN and Gated Recurrent Unit (GRU) LSTM. Results show the significance of performance improvement achieved by vanilla LSTM.},\n\tlanguage = {en},\n\turldate = {2021-09-28},\n\tjournal = {Neurocomputing},\n\tauthor = {Wu, Yuting and Yuan, Mei and Dong, Shaopeng and Lin, Li and Liu, Yingqi},\n\tmonth = jan,\n\tyear = {2018},\n\tkeywords = {Dynamic differential feature, Long short-term memory neural network, Prognostics and health management, Remaining useful life estimation},\n\tpages = {167--179},\n}\n\n","author_short":["Wu, Y.","Yuan, M.","Dong, S.","Lin, L.","Liu, Y."],"key":"wu_remaining_2018","id":"wu_remaining_2018","bibbaseid":"wu-yuan-dong-lin-liu-remainingusefullifeestimationofengineeredsystemsusingvanillalstmneuralnetworks-2018","role":"author","urls":{"Paper":"https://www.sciencedirect.com/science/article/pii/S0925231217309505"},"keyword":["Dynamic differential feature","Long short-term memory neural network","Prognostics and health management","Remaining useful life estimation"],"metadata":{"authorlinks":{}}},"search_terms":["remaining","useful","life","estimation","engineered","systems","using","vanilla","lstm","neural","networks","wu","yuan","dong","lin","liu"],"keywords":["dynamic differential feature","long short-term memory neural network","prognostics and health management","remaining useful life estimation"],"authorIDs":[],"dataSources":["ehFTfKMMaY3aAXnje","iwKepCrWBps7ojhDx"]}