ARTICLE sanders-dsp-14-5-2004/IDIAP Identity verification using speech and face information Sanderson, Conrad Paliwal, Kuldip K. https://publications.idiap.ch/index.php/publications/showcite/sanders-rr-04-10 Related documents Digital Signal Processing 14 5 449-480 2004 10.1016/j.dsp.2004.05.001 doi REPORT sanders-rr-04-10/IDIAP On the Use of Speech and Face Information for Identity Verification Sanderson, Conrad Paliwal, Kuldip K. EXTERNAL https://publications.idiap.ch/attachments/reports/2004/rr04-10.pdf PUBLIC Idiap-RR-10-2004 2004 IDIAP March 2004 {T}his report first provides a review of important concepts in the field of information fusion, followed by a review of important milestones in audio-visual person identification and verification. {S}everal recent adaptive and non-adaptive techniques for reaching the verification decision (i.e., to accept or reject the claimant,',','), based on speech and face information, are then evaluated in clean and noisy audio conditions on a common database; it is shown that in clean conditions most of the non-adaptive approaches provide similar performance and in noisy conditions most exhibit a severe deterioration in performance; it is also shown that current adaptive approaches are either inadequate or utilize restrictive assumptions. A new category of classifiers is then introduced, where the decision boundary is fixed but constructed to take into account how the distributions of opinions are likely to change due to noisy conditions; compared to a previously proposed adaptive approach, the proposed classifiers do not make a direct assumption about the type of noise that causes the mismatch between training and testing conditions. {T}his report is an extended and revised version of {IDIAP-RR} 02-33.