Media-integrated biometric person recognition based on the Dempster-Shafer theory

The present paper describes a new integration method of speech and facial image information for person recognition problems based on the Dempster-Shafer probability theory. The Dempster-Shafer theory provides an attractive methodology by which to integrate multiple numerical evidences containing ambiguities. However, no concrete and reasonable methodology exists to enumerate the reliability of evidences. In the present paper, this problem is solved using the cumulative density function of both the correct and incorrect categories. The proposed enumerating method allows the Dempster-Shafer theory to be applied to media integration. We show that the total performance of person recognition, including rejection of unregistered users, is improved significantly using the proposed method.