logo Idiap Research Institute        
 [BibTeX] [Marc21]
Just-in-Time Multimodal Association and Fusion from Home Entertainment
Type of publication: Idiap-RR
Citation: Korchagin_Idiap-RR-10-2011
Number: Idiap-RR-10-2011
Year: 2011
Month: 5
Institution: Idiap
Address: Martigny, Switzerland
Abstract: In this paper, we describe a real-time multimodal analysis system with just-in-time multimodal association and fusion for a living room environment, where multiple people may enter, interact and leave the observable world with no constraints. It comprises detection and tracking of up to 4 faces, detection and localisation of verbal and paralinguistic events, their association and fusion. The system is designed to be used in open, unconstrained environments like in next generation video conferencing systems that automatically “orchestrate” the transmitted video streams to improve the overall experience of interaction between spatially separated families and friends. Performance levels achieved to date on hand-labelled dataset have shown sufficient reliability at the same time as fulfilling real-time processing requirements.
Keywords: association rules, data analysis, multimodal signal processing, sensor fusion
Projects Idiap
Authors Korchagin, Danil
Motlicek, Petr
Duffner, Stefan
Bourlard, Hervé
Crossref by Korchagin_ICME-2_2011
Added by: [ADM]
Total mark: 0
  • Korchagin_Idiap-RR-10-2011.pdf (MD5: 421a2f8775cbe990333dd880900269f3)