The kernel PCA algorithms for wide data. Part I: theory and algorithms

Authors
W. Wu, D. Luc Massart and Sijmen de Jong
Published
1997
DOI
10.1016/S0169-7439(97)00010-5
Citation
Wu et al.: "The kernel PCA algorithms for wide data. Part I: theory and algorithms", Chemometrics and Intelligent Laboratory Systems, 36, 165-172, 1997.
Abstract
Four classic PCA algorithms: NIPALS, the power method (POWER), singular value decomposition (SVD) and eigenvalue decomposition (EVD) are modified into their kernel version to analyse wide data sets. For such data sets with many variables and fewer objects, the classic algorithms become very inefficient, because the size of the associated matrix X' X (p × p) is very large. Based on the kernel matrix XX' (n × n), the kernel algorithms are developed. They yield the same principal components but, when the number of variables is higher than the number of objects, they are faster than the corresponding classic algorithms. Simulation results confirm this property and also show that the kernel EVD is the most efficient algorithm for wide data sets, and that the difference between the kernel SVD and EVD is not very large. Therefore, it is recommended to use the kernel EVD for wide data sets whether all PCs or only the first few are required. A Matlab PCA program which efficiently deals with all kinds of data sets was developed.
Tags