Representation of a Fisher Criterion Function in a Kernel Feature Space

Abstract

In this brief, we consider kernel methods for classification (Shawe-Taylor and Cristianini, 2004) from a separability point of view and provide a representation of the Fisher criterion function in a kernel feature space. We then show that the value of the Fisher function can be simply computed by using averages of diagonal and off-diagonal blocks of a kernel matrix. This result further serves to reveal that the ideal kernel matrix is a global solution to the problem of maximizing the Fisher criterion function. Its relation to an empirical kernel target alignment is then reported. To demonstrate the usefulness of these theories, we provide an application study for classification of prostate cancer based on microarray data sets. The results show that the parameter of a kernel function can be readily optimized.