Feature Selection using Partial Least Squares regression and optimal experiment design. Nagaraja, V. & Abd-almageed, W. In 2015 International Joint Conference on Neural Networks IJCNN, pages 1–8, 2015. ![Feature Selection using Partial Least Squares regression and optimal experiment design [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex \textlessp\textgreaterWe propose a supervised feature selection technique called the Optimal Loadings, that is based on applying the theory of Optimal Experiment Design (OED) to Partial Least Squares (PLS) regression. We apply the OED criterions to PLS with the goal of selecting an optimal feature subset that minimizes the variance of the regression model and hence minimize its prediction error. We show that the variance of the PLS model can be minimized by employing the OED criterions on the loadings covariance matrix obtained from PLS. We also provide an intuitive viewpoint to the technique by deriving the Aoptimality version of the Optimal Loadings criterion using the properties of maximum relevance and minimum redundancy for PLS models. In our experiments we use the D-optimality version of the criterion which maximizes the determinant of the loadings covariance matrix. To overcome the computational challenges in this criterion, we provide an approximate D-optimality criterion along with the theoretical justification.\textless/p\textgreater
@inproceedings{nagaraja_feature_2015,
title = {Feature {Selection} using {Partial} {Least} {Squares} regression and optimal experiment design},
url = {http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7280341},
doi = {10.1109/IJCNN.2015.7280341},
abstract = {{\textless}p{\textgreater}We propose a supervised feature selection technique called the Optimal Loadings, that is based on applying the theory of Optimal Experiment Design (OED) to Partial Least Squares (PLS) regression. We apply the OED criterions to PLS with the goal of selecting an optimal feature subset that minimizes the variance of the regression model and hence minimize its prediction error. We show that the variance of the PLS model can be minimized by employing the OED criterions on the loadings covariance matrix obtained from PLS. We also provide an intuitive viewpoint to the technique by deriving the Aoptimality version of the Optimal Loadings criterion using the properties of maximum relevance and minimum redundancy for PLS models. In our experiments we use the D-optimality version of the criterion which maximizes the determinant of the loadings covariance matrix. To overcome the computational challenges in this criterion, we provide an approximate D-optimality criterion along with the theoretical justification.{\textless}/p{\textgreater}},
booktitle = {2015 {International} {Joint} {Conference} on {Neural} {Networks} {IJCNN}},
author = {Nagaraja, V.K. and Abd-almageed, W.},
year = {2015},
keywords = {Computational modeling, Irrigation, Load modeling, OED, PLS regression, Predictive models, covariance matrices, covariance matrix, feature selection, least squares approximations, optimal experiment design, optimal loadings, partial least squares regression, regression analysis, supervised feature selection technique},
pages = {1--8},
}
Downloads: 0
{"_id":"u4Gkugdhxf5mZwCvb","bibbaseid":"nagaraja-abdalmageed-featureselectionusingpartialleastsquaresregressionandoptimalexperimentdesign-2015","downloads":0,"creationDate":"2018-03-03T21:29:22.016Z","title":"Feature Selection using Partial Least Squares regression and optimal experiment design","author_short":["Nagaraja, V.","Abd-almageed, W."],"year":2015,"bibtype":"inproceedings","biburl":"http://bibbase.org/zotero/vita_pubs","bibdata":{"bibtype":"inproceedings","type":"inproceedings","title":"Feature Selection using Partial Least Squares regression and optimal experiment design","url":"http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7280341","doi":"10.1109/IJCNN.2015.7280341","abstract":"\\textlessp\\textgreaterWe propose a supervised feature selection technique called the Optimal Loadings, that is based on applying the theory of Optimal Experiment Design (OED) to Partial Least Squares (PLS) regression. We apply the OED criterions to PLS with the goal of selecting an optimal feature subset that minimizes the variance of the regression model and hence minimize its prediction error. We show that the variance of the PLS model can be minimized by employing the OED criterions on the loadings covariance matrix obtained from PLS. We also provide an intuitive viewpoint to the technique by deriving the Aoptimality version of the Optimal Loadings criterion using the properties of maximum relevance and minimum redundancy for PLS models. In our experiments we use the D-optimality version of the criterion which maximizes the determinant of the loadings covariance matrix. To overcome the computational challenges in this criterion, we provide an approximate D-optimality criterion along with the theoretical justification.\\textless/p\\textgreater","booktitle":"2015 International Joint Conference on Neural Networks IJCNN","author":[{"propositions":[],"lastnames":["Nagaraja"],"firstnames":["V.K."],"suffixes":[]},{"propositions":[],"lastnames":["Abd-almageed"],"firstnames":["W."],"suffixes":[]}],"year":"2015","keywords":"Computational modeling, Irrigation, Load modeling, OED, PLS regression, Predictive models, covariance matrices, covariance matrix, feature selection, least squares approximations, optimal experiment design, optimal loadings, partial least squares regression, regression analysis, supervised feature selection technique","pages":"1–8","bibtex":"@inproceedings{nagaraja_feature_2015,\n\ttitle = {Feature {Selection} using {Partial} {Least} {Squares} regression and optimal experiment design},\n\turl = {http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7280341},\n\tdoi = {10.1109/IJCNN.2015.7280341},\n\tabstract = {{\\textless}p{\\textgreater}We propose a supervised feature selection technique called the Optimal Loadings, that is based on applying the theory of Optimal Experiment Design (OED) to Partial Least Squares (PLS) regression. We apply the OED criterions to PLS with the goal of selecting an optimal feature subset that minimizes the variance of the regression model and hence minimize its prediction error. We show that the variance of the PLS model can be minimized by employing the OED criterions on the loadings covariance matrix obtained from PLS. We also provide an intuitive viewpoint to the technique by deriving the Aoptimality version of the Optimal Loadings criterion using the properties of maximum relevance and minimum redundancy for PLS models. In our experiments we use the D-optimality version of the criterion which maximizes the determinant of the loadings covariance matrix. To overcome the computational challenges in this criterion, we provide an approximate D-optimality criterion along with the theoretical justification.{\\textless}/p{\\textgreater}},\n\tbooktitle = {2015 {International} {Joint} {Conference} on {Neural} {Networks} {IJCNN}},\n\tauthor = {Nagaraja, V.K. and Abd-almageed, W.},\n\tyear = {2015},\n\tkeywords = {Computational modeling, Irrigation, Load modeling, OED, PLS regression, Predictive models, covariance matrices, covariance matrix, feature selection, least squares approximations, optimal experiment design, optimal loadings, partial least squares regression, regression analysis, supervised feature selection technique},\n\tpages = {1--8},\n}\n\n","author_short":["Nagaraja, V.","Abd-almageed, W."],"key":"nagaraja_feature_2015","id":"nagaraja_feature_2015","bibbaseid":"nagaraja-abdalmageed-featureselectionusingpartialleastsquaresregressionandoptimalexperimentdesign-2015","role":"author","urls":{"Paper":"http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7280341"},"keyword":["Computational modeling","Irrigation","Load modeling","OED","PLS regression","Predictive models","covariance matrices","covariance matrix","feature selection","least squares approximations","optimal experiment design","optimal loadings","partial least squares regression","regression analysis","supervised feature selection technique"],"metadata":{"authorlinks":{}}},"search_terms":["feature","selection","using","partial","squares","regression","optimal","experiment","design","nagaraja","abd-almageed"],"keywords":["computational modeling","irrigation","load modeling","oed","pls regression","predictive models","covariance matrices","covariance matrix","feature selection","least squares approximations","optimal experiment design","optimal loadings","partial least squares regression","regression analysis","supervised feature selection technique"],"authorIDs":[],"dataSources":["dDcybAPCHBAZER5nc","AfBybHaxyt33K5MBP"]}