logo Idiap Research Institute        
 [BibTeX] [Marc21]
Continuous Audio-Visual Speech Recognition
Type of publication: Idiap-RR
Citation: luettin-RR-98-02
Number: Idiap-RR-02-1998
Year: 1998
Institution: IDIAP
Note: Published in Proc. 5th European Conference on Computer Vision, 1998
Abstract: We address the problem of robust lip tracking, visual speech feature extraction, and sensor integration for audio-visual speech recognition applications. An appearance based model of the articulators, which represents linguistically important features, is learned from example images and is used to locate, track, and recover visual speech information. We tackle the problem of joint temporal modelling of the acoustic and visual speech signals by applying Multi-Stream hidden Markov models. This approach allows the use of different temporal topologies and levels of stream integration and hence enables to model temporal dependencies more accurately. The system has been evaluated for a continuously spoken digit recognition task of 37 subjects.
Userfields: ipdmembership={vision},
Keywords:
Projects Idiap
Authors Luettin, Juergen
Dupont, Stéphane
Crossref by luettin-eccv98
Added by: [UNK]
Total mark: 0
Attachments
  • rr98-02.pdf
  • rr98-02.ps.gz
Notes