A Bayesian approach to comparing human reliability analysis methods using human performance data

A Bayesian approach to comparing human reliability analysis methods using human performance data. Zhao, Y. Reliability Engineering & System Safety, 219:108213, March, 2022.

Paper doi abstract bibtex

Various methods for human reliability analysis have been developed, but a rigorous approach to quantitatively comparing these methods is still lacking. This research proposed a Bayesian approach with an attempt to address this problem. The Bayesian approach is based on ensemble modeling, which outputs the weighted average of the human error probability predictions by the human reliability analysis methods to be compared. Before incorporating any human performance data, the weights in the ensemble model represent the prior probabilities of or one’s prior beliefs in the human reliability analysis methods. Using human performance data, the weights can be updated based on Bayes’ rule to reflect one’s updated beliefs in the human reliability analysis methods. The ensemble model with updated weights itself can be further used as a posterior predictive model for human reliability. The proposed approach is demonstrated using the human performance data collected from the international human reliability analysis empirical study. The results show that the posterior beliefs vary with the data set used in the analysis. Future research using a larger human performance data set is expected to reach more conclusive comparisons.

@article{zhao_bayesian_2022,
	title = {A {Bayesian} approach to comparing human reliability analysis methods using human performance data},
	volume = {219},
	issn = {0951-8320},
	url = {https://www.sciencedirect.com/science/article/pii/S0951832021006918},
	doi = {10.1016/j.ress.2021.108213},
	abstract = {Various methods for human reliability analysis have been developed, but a rigorous approach to quantitatively comparing these methods is still lacking. This research proposed a Bayesian approach with an attempt to address this problem. The Bayesian approach is based on ensemble modeling, which outputs the weighted average of the human error probability predictions by the human reliability analysis methods to be compared. Before incorporating any human performance data, the weights in the ensemble model represent the prior probabilities of or one’s prior beliefs in the human reliability analysis methods. Using human performance data, the weights can be updated based on Bayes’ rule to reflect one’s updated beliefs in the human reliability analysis methods. The ensemble model with updated weights itself can be further used as a posterior predictive model for human reliability. The proposed approach is demonstrated using the human performance data collected from the international human reliability analysis empirical study. The results show that the posterior beliefs vary with the data set used in the analysis. Future research using a larger human performance data set is expected to reach more conclusive comparisons.},
	language = {en},
	urldate = {2021-12-28},
	journal = {Reliability Engineering \& System Safety},
	author = {Zhao, Yunfei},
	month = mar,
	year = {2022},
	keywords = {Analyst-to-analyst variability, Bayesian analysis, Ensemble modeling, Human error probability, Human performance data, Human reliability analysis, Quantitative comparison},
	pages = {108213},
}

Downloads: 0

{"_id":"pSgyZ4znEsbSNCMxX","bibbaseid":"zhao-abayesianapproachtocomparinghumanreliabilityanalysismethodsusinghumanperformancedata-2022","author_short":["Zhao, Y."],"bibdata":{"bibtype":"article","type":"article","title":"A Bayesian approach to comparing human reliability analysis methods using human performance data","volume":"219","issn":"0951-8320","url":"https://www.sciencedirect.com/science/article/pii/S0951832021006918","doi":"10.1016/j.ress.2021.108213","abstract":"Various methods for human reliability analysis have been developed, but a rigorous approach to quantitatively comparing these methods is still lacking. This research proposed a Bayesian approach with an attempt to address this problem. The Bayesian approach is based on ensemble modeling, which outputs the weighted average of the human error probability predictions by the human reliability analysis methods to be compared. Before incorporating any human performance data, the weights in the ensemble model represent the prior probabilities of or one’s prior beliefs in the human reliability analysis methods. Using human performance data, the weights can be updated based on Bayes’ rule to reflect one’s updated beliefs in the human reliability analysis methods. The ensemble model with updated weights itself can be further used as a posterior predictive model for human reliability. The proposed approach is demonstrated using the human performance data collected from the international human reliability analysis empirical study. The results show that the posterior beliefs vary with the data set used in the analysis. Future research using a larger human performance data set is expected to reach more conclusive comparisons.","language":"en","urldate":"2021-12-28","journal":"Reliability Engineering & System Safety","author":[{"propositions":[],"lastnames":["Zhao"],"firstnames":["Yunfei"],"suffixes":[]}],"month":"March","year":"2022","keywords":"Analyst-to-analyst variability, Bayesian analysis, Ensemble modeling, Human error probability, Human performance data, Human reliability analysis, Quantitative comparison","pages":"108213","bibtex":"@article{zhao_bayesian_2022,\n\ttitle = {A {Bayesian} approach to comparing human reliability analysis methods using human performance data},\n\tvolume = {219},\n\tissn = {0951-8320},\n\turl = {https://www.sciencedirect.com/science/article/pii/S0951832021006918},\n\tdoi = {10.1016/j.ress.2021.108213},\n\tabstract = {Various methods for human reliability analysis have been developed, but a rigorous approach to quantitatively comparing these methods is still lacking. This research proposed a Bayesian approach with an attempt to address this problem. The Bayesian approach is based on ensemble modeling, which outputs the weighted average of the human error probability predictions by the human reliability analysis methods to be compared. Before incorporating any human performance data, the weights in the ensemble model represent the prior probabilities of or one’s prior beliefs in the human reliability analysis methods. Using human performance data, the weights can be updated based on Bayes’ rule to reflect one’s updated beliefs in the human reliability analysis methods. The ensemble model with updated weights itself can be further used as a posterior predictive model for human reliability. The proposed approach is demonstrated using the human performance data collected from the international human reliability analysis empirical study. The results show that the posterior beliefs vary with the data set used in the analysis. Future research using a larger human performance data set is expected to reach more conclusive comparisons.},\n\tlanguage = {en},\n\turldate = {2021-12-28},\n\tjournal = {Reliability Engineering \\& System Safety},\n\tauthor = {Zhao, Yunfei},\n\tmonth = mar,\n\tyear = {2022},\n\tkeywords = {Analyst-to-analyst variability, Bayesian analysis, Ensemble modeling, Human error probability, Human performance data, Human reliability analysis, Quantitative comparison},\n\tpages = {108213},\n}\n\n","author_short":["Zhao, Y."],"key":"zhao_bayesian_2022","id":"zhao_bayesian_2022","bibbaseid":"zhao-abayesianapproachtocomparinghumanreliabilityanalysismethodsusinghumanperformancedata-2022","role":"author","urls":{"Paper":"https://www.sciencedirect.com/science/article/pii/S0951832021006918"},"keyword":["Analyst-to-analyst variability","Bayesian analysis","Ensemble modeling","Human error probability","Human performance data","Human reliability analysis","Quantitative comparison"],"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://bibbase.org/zotero/mh_lenguyen","dataSources":["iwKepCrWBps7ojhDx"],"keywords":["analyst-to-analyst variability","bayesian analysis","ensemble modeling","human error probability","human performance data","human reliability analysis","quantitative comparison"],"search_terms":["bayesian","approach","comparing","human","reliability","analysis","methods","using","human","performance","data","zhao"],"title":"A Bayesian approach to comparing human reliability analysis methods using human performance data","year":2022}