Face finding is a very important initial step towards building up a fully automated face recognition system. Face detection by detecting skin like colors can achieve a high detection rate. In this paper, we presented a novel algorithm for face detection in color images with complex backgrounds. First a parallel structure for skin color detection is proposed to improve the accuracy of detections. The concept of the probability image has been introduced to utilize the color information in the traditional face detection methods specific for gray-scale images. After that, a classifier obtained from Adaboost training is applied to the result of skin detection to reduce the false positives. An experiment has been implemented to verify the improvement of this proposed research. And the proposed approach achieved a better result in this experiment.