logo Idiap Research Institute        
 [BibTeX] [Marc21]
Speachreading using shape and intensity information
Type of publication: Conference paper
Citation: luettin-icslp96speech
Booktitle: Proceedings of the 4th International Conference on Spoken Language Processing (ICSLP'96)
Volume: 1
Year: 1996
Abstract: We describe a speechreading system that uses both, shape information from the lip contours and intensity information from the mouth area. Shape information is obtained by tracking and parameterising the inner and outer lip boundary in an image sequence. Intensity information is extracted from a grey level model, based on principal component analysis. In comparison to other approaches, the intensity area deforms with the shape model to ensure that similar object features are represented after non-rigid deformation of the lips. We describe speaker independent recognition experiments based on these features and Hidden Markov Models. Preliminary results suggest that similar performance can be achieved by using either shape or intensity information and slightly higher performance by their combined use.
Userfields: ipdmembership={vision},
Keywords:
Projects Idiap
Authors Luettin, Juergen
Thacker, Neil A.
Beet, Steve W.
Added by: [UNK]
Total mark: 0
Attachments
  • speech96.pdf
  • luettin_icslp96speech.ps.gz
Notes