Accessibility navigation

Sparse kernel density construction using orthogonal forward regression with leave-one-out test score and local regularization

Chen, S., Hong, X. and Harris, C. J. (2004) Sparse kernel density construction using orthogonal forward regression with leave-one-out test score and local regularization. IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics, 34 (4). pp. 1708-1717. ISSN 1083-4419

Full text not archived in this repository.

It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

To link to this item DOI: 10.1109/tsmcb.2004.828199


This paper presents an efficient construction algorithm for obtaining sparse kernel density estimates based on a regression approach that directly optimizes model generalization capability. Computational efficiency of the density construction is ensured using an orthogonal forward regression, and the algorithm incrementally minimizes the leave-one-out test score. A local regularization method is incorporated naturally into the density construction process to further enforce sparsity. An additional advantage of the proposed algorithm is that it is fully automatic and the user is not required to specify any criterion to terminate the density construction procedure. This is in contrast to an existing state-of-art kernel density estimation method using the support vector machine (SVM), where the user is required to specify some critical algorithm parameter. Several examples are included to demonstrate the ability of the proposed algorithm to effectively construct a very sparse kernel density estimate with comparable accuracy to that of the full sample optimized Parzen window density estimate. Our experimental results also demonstrate that the proposed algorithm compares favorably with the SVM method, in terms of both test accuracy and sparsity, for constructing kernel density estimates.

Item Type:Article
Divisions:Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
ID Code:15167
Uncontrolled Keywords:cross validation, leave-one-out test score, orthogonal least squares, Parzen window estimate, probability density function, regularization, sparse kernel modeling, LEAST-SQUARES, IDENTIFICATION, ALGORITHM

University Staff: Request a correction | Centaur Editors: Update this record

Page navigation