logo Idiap Research Institute        
 [BibTeX] [Marc21]
Statistical lip modelling for visual speech recognition
Type of publication: Conference paper
Citation: luettin-eusipco96
Booktitle: Proceedings of the 8th European Signal Processing Conference (Eusipco'96)
Volume: I
Year: 1996
Abstract: We describe a speechreading (lipreading) system purely based on visual features extracted from grey level image sequences of the speakers lips. Active shape models are used to track the lip contours while visual speech information is extracted from the shape of the contours. The distribution and temporal dependencies of the shape features are modelled by continuous density Hidden Markov Models. Experiments are reported for speaker independent recognition tests of isolated digits. The analysis of individual feature components suggests that speech relevant information is embedded in a low dimensional space and fairly robust to inter- and intra- speaker variability.
Userfields: ipdmembership={vision},
Keywords:
Projects Idiap
Authors Luettin, Juergen
Thacker, Neil A.
Beet, Steve W.
Added by: [UNK]
Total mark: 0
Attachments
  • lip_mod.pdf
  • luettin_eusipco96.ps.gz
Notes