Home » Posts tagged "dimensionality reduction"

Feature extraction using PCA

Eigenfaces
In this article, we discuss how Principal Component Analysis (PCA) works, and how it can be used as a dimensionality reduction technique for classification problems. At the end of this article, Matlab source code is provided for demonstration purposes. In an earlier article, we discussed the so called...
Continue reading »

The Curse of Dimensionality in classification

Linear classifier
In this article, we will discuss the so called ‘Curse of Dimensionality’, and explain why it is important when designing a classifier. In the following sections I will provide an intuitive explanation of this concept, illustrated by a clear example of overfitting due to the curse of dimensionality....
Continue reading »