Evaluation of feature selection methods based on artificial neural network weights. Luíza da Costa, N., Dias de Lima, M., & Barbosa, R. Expert Systems with Applications, 168:114312, 2021.
Evaluation of feature selection methods based on artificial neural network weights [link]Paper  doi  abstract   bibtex   
Weight-based feature selection (WBFS) are methods used to measure the contribution of input to output in a trained artificial neural network (ANN). Furthermore, algorithms such as Garson’s rely upon a single best neural network model or the mean importance value of several ANNs. However, different initialization weights lead to different importance values, as reported in other studies. These differences are misleading since each rank could result in different scores, altering the position of a variable in a given rank. Therefore, we propose a new methodology to assess the stability of a WBFS method. In essence, the idea is to use a voting approach to evaluate the importance of rankings. The results showed that Garson’s, Olden’s and Yoon’s algorithms are more stable methods when applied to artificial datasets. Nevertheless, its stability is considerably reduced when applied to real-world datasets. Hence, we concluded that future work should take into consideration the aforementioned instability of existing WBFS methods as applied to complex real-world data.
@article{luiza_da_costa_evaluation_2021,
	title = {Evaluation of feature selection methods based on artificial neural network weights},
	volume = {168},
	issn = {0957-4174},
	url = {https://www.sciencedirect.com/science/article/pii/S0957417420310083},
	doi = {10.1016/j.eswa.2020.114312},
	abstract = {Weight-based feature selection (WBFS) are methods used to measure the contribution of input to output in a trained artificial neural network (ANN). Furthermore, algorithms such as Garson’s rely upon a single best neural network model or the mean importance value of several ANNs. However, different initialization weights lead to different importance values, as reported in other studies. These differences are misleading since each rank could result in different scores, altering the position of a variable in a given rank. Therefore, we propose a new methodology to assess the stability of a WBFS method. In essence, the idea is to use a voting approach to evaluate the importance of rankings. The results showed that Garson’s, Olden’s and Yoon’s algorithms are more stable methods when applied to artificial datasets. Nevertheless, its stability is considerably reduced when applied to real-world datasets. Hence, we concluded that future work should take into consideration the aforementioned instability of existing WBFS methods as applied to complex real-world data.},
	journal = {Expert Systems with Applications},
	author = {Luíza da Costa, Nattane and Dias de Lima, Márcio and Barbosa, Rommel},
	year = {2021},
	keywords = {\#nosource},
	pages = {114312},
}

Downloads: 0