logo Idiap Research Institute        
 [BibTeX] [Marc21]
Visual Speech Recognition using Active Shape Models and Hidden Markov Models
Type of publication: Conference paper
Citation: luettin-icassp96
Booktitle: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'96)
Volume: 2
Year: 1996
Abstract: This paper describes a novel approach for visual speech recognition. The shape of the mouth is modelled by an Active Shape Model which is derived from the statistics of a training set and used to locate, track and parameterise the speaker�s lip movements. The extracted parameters representing the lip shape are modelled as continuous probability distributions and their temporal dependencies are modelled by Hidden Markov Models. We present recognition tests performed on a database of a broad variety of speakers and illumination conditions. The system achieved an accuracy of 85.42 % for a speaker independent recognition task of the first four digits using lip shape information only.
Userfields: ipdmembership={vision},
Projects Idiap
Authors Luettin, Juergen
Thacker, Neil A.
Beet, Steve W.
Added by: [UNK]
Total mark: 0
  • mai96.pdf
  • luettin_icassp96.ps.gz