Sparse Wavelet Networks. Sadri, A., Celebi, M., Rahnavard, N., & Viswanath, S. IEEE Signal Processing Letters, 2020.
doi  abstract   bibtex   
A wavelet network (WN) is a feed-forward neural network that uses wavelets as activation functions for the neurons in its hidden layer. By predetermining the wavelet positions and dilations, the WN can turn into a linear regression model. The common approach for the construction of these WN families is to use least-squares type algorithms. In this letter, we propose a novel approach by formulating a WN as a sparse linear regression problem, which we call a sparse wavelet network (SWN). In this WN, the problem of calculating the unknown inner parameters of the network becomes that of finding the sparse solution of an under-determined system of linear equations. Our sparse solution algorithm is a non-convex sparse relaxation approach inspired by smoothed L0 (SL0), a distinguished sparse recovery algorithm. The proposed SWN can be applied as a tool for the prediction and identification of dynamical systems.
@article{Sadri2020,
   abstract = {A wavelet network (WN) is a feed-forward neural network that uses wavelets as activation functions for the neurons in its hidden layer. By predetermining the wavelet positions and dilations, the WN can turn into a linear regression model. The common approach for the construction of these WN families is to use least-squares type algorithms. In this letter, we propose a novel approach by formulating a WN as a sparse linear regression problem, which we call a sparse wavelet network (SWN). In this WN, the problem of calculating the unknown inner parameters of the network becomes that of finding the sparse solution of an under-determined system of linear equations. Our sparse solution algorithm is a non-convex sparse relaxation approach inspired by smoothed L0 (SL0), a distinguished sparse recovery algorithm. The proposed SWN can be applied as a tool for the prediction and identification of dynamical systems.},
   author = {A.R. Sadri and M.E. Celebi and N. Rahnavard and S.E. Viswanath},
   doi = {10.1109/LSP.2019.2959219},
   issn = {15582361},
   journal = {IEEE Signal Processing Letters},
   keywords = {Wavelet network,non-convex regularization,sparse representation,system identification},
   title = {Sparse Wavelet Networks},
   volume = {27},
   year = {2020},
}

Downloads: 0