Kernel Machine Based Feature Extraction Algorithm for Regression Problems

Kernel Machine Based Feature Extraction Algorithm for Regression Problems. Szepesvári, C., Kornél, K., & Kocsor, A. In ECAI, pages 1– 2, 2004.

Paper abstract bibtex

In this paper we consider two novel kernel machine based feature extraction algorithms in a regression settings. The first method is derived based on the principles underlying the recently introduced Maximum Margin Discrimination Analysis (MMDA) algorithm. However, here it is shown that the orthogonalization principle employed by the original MMDA algorithm can be motivated using the well-known ambiguity decomposition, thus providing a firm ground for the good performance of the algorithm. The second algorithm combines kernel machines with average derivative estimation and is derived from the assumption that the true regressor function depends only on a subspace of the original input space. The proposed algorithms are evaluated in preliminary experiments conducted with artificial and real datasets.

@inproceedings{cs.Szepesvari2004,
	abstract = {In this paper we consider two novel kernel machine based feature extraction algorithms in a regression settings. The first method is derived based on the principles underlying the recently introduced Maximum Margin Discrimination Analysis (MMDA) algorithm. However, here it is shown that the orthogonalization principle employed by the original MMDA algorithm can be motivated using the well-known ambiguity decomposition, thus providing a firm ground for the good performance of the algorithm. The second algorithm combines kernel machines with average derivative estimation and is derived from the assumption that the true regressor function depends only on a subspace of the original input space. The proposed algorithms are evaluated in preliminary experiments conducted with artificial and real datasets. },
	author = {Szepesv{\'a}ri, Cs. and Korn{\'e}l, K. and Kocsor, A.},
	booktitle = {ECAI},
	keywords = {supervised feature extraction, supervised learning, regression},
	owner = {Beata},
	pages = {1-- 2},
	timestamp = {2010.08.31},
	title = {Kernel Machine Based Feature Extraction Algorithm for Regression Problems},
	url_paper = {ecai-mmda.pdf},
	year = {2004}}

Downloads: 0