A comparative analysis of machine learning methods for class imbalance in a smoking cessation intervention. Davagdorj, K., Lee, J. S., Pham, V. H., & Ryu, K. H. Applied Sciences (Switzerland), 2020. doi abstract bibtex Smoking is one of the major public health issues, which has a significant impact on premature death. In recent years, numerous decision support systems have been developed to deal with smoking cessation based on machine learning methods. However, the inevitable class imbalance is considered a major challenge in deploying such systems. In this paper, we study an empirical comparison of machine learning techniques to deal with the class imbalance problem in the prediction of smoking cessation intervention among the Korean population. For the class imbalance problem, the objective of this paper is to improve the prediction performance based on the utilization of synthetic oversampling techniques, which we called the synthetic minority over-sampling technique (SMOTE) and an adaptive synthetic (ADASYN). This has been achieved by the experimental design, which comprises three components. First, the selection of the best representative features is performed in two phases: the lasso method and multicollinearity analysis. Second, generate the newly balanced data utilizing SMOTE and ADASYN technique. Third, machine learning classifiers are applied to construct the prediction models among all subjects and each gender. In order to justify the effectiveness of the prediction models, the f-score, type I error, type II error, balanced accuracy and geometric mean indices are used. Comprehensive analysis demonstrates that Gradient Boosting Trees (GBT), Random Forest (RF) and multilayer perceptron neural network (MLP) classifiers achieved the best performances in all subjects and each gender when SMOTE and ADASYN were utilized. The SMOTE with GBT and RF models also provide feature importance scores that enhance the interpretability of the decision-support system. In addition, it is proven that the presented synthetic oversampling techniques with machine learning models outperformed baseline models in smoking cessation prediction.
@article{Pham2020,
title = {A comparative analysis of machine learning methods for class imbalance in a smoking cessation intervention},
volume = {10},
issn = {20763417},
doi = {10.3390/app10093307},
abstract = {Smoking is one of the major public health issues, which has a significant impact on premature death. In recent years, numerous decision support systems have been developed to deal with smoking cessation based on machine learning methods. However, the inevitable class imbalance is considered a major challenge in deploying such systems. In this paper, we study an empirical comparison of machine learning techniques to deal with the class imbalance problem in the prediction of smoking cessation intervention among the Korean population. For the class imbalance problem, the objective of this paper is to improve the prediction performance based on the utilization of synthetic oversampling techniques, which we called the synthetic minority over-sampling technique (SMOTE) and an adaptive synthetic (ADASYN). This has been achieved by the experimental design, which comprises three components. First, the selection of the best representative features is performed in two phases: the lasso method and multicollinearity analysis. Second, generate the newly balanced data utilizing SMOTE and ADASYN technique. Third, machine learning classifiers are applied to construct the prediction models among all subjects and each gender. In order to justify the effectiveness of the prediction models, the f-score, type I error, type II error, balanced accuracy and geometric mean indices are used. Comprehensive analysis demonstrates that Gradient Boosting Trees (GBT), Random Forest (RF) and multilayer perceptron neural network (MLP) classifiers achieved the best performances in all subjects and each gender when SMOTE and ADASYN were utilized. The SMOTE with GBT and RF models also provide feature importance scores that enhance the interpretability of the decision-support system. In addition, it is proven that the presented synthetic oversampling techniques with machine learning models outperformed baseline models in smoking cessation prediction.},
number = {9},
journal = {Applied Sciences (Switzerland)},
author = {Davagdorj, Khishigsuren and Lee, Jong Seol and Pham, Van Huy and Ryu, Keun Ho},
year = {2020},
keywords = {Class imbalance, Decision making, Feature importance, Machine learning, Smoking, Synthetic oversampling},
}
Downloads: 0
{"_id":"phhLhQf4YeHC236e9","bibbaseid":"davagdorj-lee-pham-ryu-acomparativeanalysisofmachinelearningmethodsforclassimbalanceinasmokingcessationintervention-2020","author_short":["Davagdorj, K.","Lee, J. S.","Pham, V. H.","Ryu, K. H."],"bibdata":{"bibtype":"article","type":"article","title":"A comparative analysis of machine learning methods for class imbalance in a smoking cessation intervention","volume":"10","issn":"20763417","doi":"10.3390/app10093307","abstract":"Smoking is one of the major public health issues, which has a significant impact on premature death. In recent years, numerous decision support systems have been developed to deal with smoking cessation based on machine learning methods. However, the inevitable class imbalance is considered a major challenge in deploying such systems. In this paper, we study an empirical comparison of machine learning techniques to deal with the class imbalance problem in the prediction of smoking cessation intervention among the Korean population. For the class imbalance problem, the objective of this paper is to improve the prediction performance based on the utilization of synthetic oversampling techniques, which we called the synthetic minority over-sampling technique (SMOTE) and an adaptive synthetic (ADASYN). This has been achieved by the experimental design, which comprises three components. First, the selection of the best representative features is performed in two phases: the lasso method and multicollinearity analysis. Second, generate the newly balanced data utilizing SMOTE and ADASYN technique. Third, machine learning classifiers are applied to construct the prediction models among all subjects and each gender. In order to justify the effectiveness of the prediction models, the f-score, type I error, type II error, balanced accuracy and geometric mean indices are used. Comprehensive analysis demonstrates that Gradient Boosting Trees (GBT), Random Forest (RF) and multilayer perceptron neural network (MLP) classifiers achieved the best performances in all subjects and each gender when SMOTE and ADASYN were utilized. The SMOTE with GBT and RF models also provide feature importance scores that enhance the interpretability of the decision-support system. In addition, it is proven that the presented synthetic oversampling techniques with machine learning models outperformed baseline models in smoking cessation prediction.","number":"9","journal":"Applied Sciences (Switzerland)","author":[{"propositions":[],"lastnames":["Davagdorj"],"firstnames":["Khishigsuren"],"suffixes":[]},{"propositions":[],"lastnames":["Lee"],"firstnames":["Jong","Seol"],"suffixes":[]},{"propositions":[],"lastnames":["Pham"],"firstnames":["Van","Huy"],"suffixes":[]},{"propositions":[],"lastnames":["Ryu"],"firstnames":["Keun","Ho"],"suffixes":[]}],"year":"2020","keywords":"Class imbalance, Decision making, Feature importance, Machine learning, Smoking, Synthetic oversampling","bibtex":"@article{Pham2020,\n\ttitle = {A comparative analysis of machine learning methods for class imbalance in a smoking cessation intervention},\n\tvolume = {10},\n\tissn = {20763417},\n\tdoi = {10.3390/app10093307},\n\tabstract = {Smoking is one of the major public health issues, which has a significant impact on premature death. In recent years, numerous decision support systems have been developed to deal with smoking cessation based on machine learning methods. However, the inevitable class imbalance is considered a major challenge in deploying such systems. In this paper, we study an empirical comparison of machine learning techniques to deal with the class imbalance problem in the prediction of smoking cessation intervention among the Korean population. For the class imbalance problem, the objective of this paper is to improve the prediction performance based on the utilization of synthetic oversampling techniques, which we called the synthetic minority over-sampling technique (SMOTE) and an adaptive synthetic (ADASYN). This has been achieved by the experimental design, which comprises three components. First, the selection of the best representative features is performed in two phases: the lasso method and multicollinearity analysis. Second, generate the newly balanced data utilizing SMOTE and ADASYN technique. Third, machine learning classifiers are applied to construct the prediction models among all subjects and each gender. In order to justify the effectiveness of the prediction models, the f-score, type I error, type II error, balanced accuracy and geometric mean indices are used. Comprehensive analysis demonstrates that Gradient Boosting Trees (GBT), Random Forest (RF) and multilayer perceptron neural network (MLP) classifiers achieved the best performances in all subjects and each gender when SMOTE and ADASYN were utilized. The SMOTE with GBT and RF models also provide feature importance scores that enhance the interpretability of the decision-support system. In addition, it is proven that the presented synthetic oversampling techniques with machine learning models outperformed baseline models in smoking cessation prediction.},\n\tnumber = {9},\n\tjournal = {Applied Sciences (Switzerland)},\n\tauthor = {Davagdorj, Khishigsuren and Lee, Jong Seol and Pham, Van Huy and Ryu, Keun Ho},\n\tyear = {2020},\n\tkeywords = {Class imbalance, Decision making, Feature importance, Machine learning, Smoking, Synthetic oversampling},\n}\n\n","author_short":["Davagdorj, K.","Lee, J. S.","Pham, V. H.","Ryu, K. H."],"key":"Pham2020-1-1-1-1-1-1-1","id":"Pham2020-1-1-1-1-1-1-1","bibbaseid":"davagdorj-lee-pham-ryu-acomparativeanalysisofmachinelearningmethodsforclassimbalanceinasmokingcessationintervention-2020","role":"author","urls":{},"keyword":["Class imbalance","Decision making","Feature importance","Machine learning","Smoking","Synthetic oversampling"],"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://api.zotero.org/groups/2168152/items?key=VCdsaROd5deDY3prqqG8kI0c&format=bibtex&limit=100","dataSources":["syJjwTDDM32TsM2iF","QwrFbRJvXF69SEShv","HbngRCZLbLed2q9QT","LtEFvT85hYpNg4Esp","iHfnnAr7wKJJxkNMt","PrvBTxn4Zgeep29e5","78Yd9ZHcx783Wkffe","SKRhTA7ok4L4waPkZ","GfrMfnKTkYdcYTRsy","RqqCdXGEyWH4dZ76k","cbiwaQPQJSZeJDDY9","2Jak7xK39ytqcgqQ4","CDfDBPD6CDScj6Ty4","WgiCycoQjRx6KArBy","KBdipwowTNXWiKqYd","yjd6eECyb3TYZpZ3R","D9jmZ7aoHfJnYQ4ES","R8dLFAvyQ2oFRijDJ","dc6SzEK4S9LfC3XpA","kGWABmrDfhF29uibh","YE9GesxGLCsBc3vvC","v3qfuosZ66nvD85FK","BSxBG5ms26R2teZn9"],"keywords":["class imbalance","decision making","feature importance","machine learning","smoking","synthetic oversampling"],"search_terms":["comparative","analysis","machine","learning","methods","class","imbalance","smoking","cessation","intervention","davagdorj","lee","pham","ryu"],"title":"A comparative analysis of machine learning methods for class imbalance in a smoking cessation intervention","year":2020}