In this paper, a multi-stage face detection method using hybrid neural networks is presented. The method consists of three stages: preprocessing, feature extraction and pattern classification. We introduce an adaptive filtering technique which is based on a skin-color analysis using fuzzy min-max (FMM) neural networks. A modified convolutional neural network (CNN) is used to extract translation invariant feature maps for face detection. We present an extended version of fuzzy min-max (FMM) neural network which can be used not only for feature analysis but also for pattern classification. Two kinds of relevance factors between features and pattern classes are defined to analyze the saliency of features. These measures can be utilized to select more relevant features for the skin-color filtering process as well as the face detection process.