Nonnegative Matrix Factorization (NMF) Based Supervised Feature Selection and Adaptation

Abstract

We proposed a novel algorithm of supervised feature selection and adaptation for enhancing the classification accuracy of unsupervised Nonnegative Matrix Factorization (NMF) feature extraction algorithm. At first the algorithm extracts feature vectors for a given high dimensional data then reduce the feature dimension using mutual information based relevant feature selection and finally adapt the selected NMF features using the proposed Non-negative Supervised Feature Adaptation (NSFA) learning algorithm. The supervised feature selection and adaptation improve the classification performance which is fully confirmed by simulations with text-document classification problem. Moreover, the non-negativity constraint, of this algorithm, provides biologically plausible and meaningful feature.