logo Idiap Research Institute        
 [BibTeX] [Marc21]
Just-in-Time Multimodal Association and Fusion from Home Entertainment
Type of publication: Conference paper
Citation: Korchagin_ICME-2_2011
Booktitle: Proceedings IEEE International Conference on Multimedia & Expo
Year: 2011
Month: July
Location: Barcelona, Spain
Crossref: Korchagin_Idiap-RR-10-2011:
Abstract: In this paper, we describe a real-time multimodal analysis system with just-in-time multimodal association and fusion for a living room environment, where multiple people may enter, interact and leave the observable world with no constraints. It comprises detection and tracking of up to 4 faces, detection and localisation of verbal and paralinguistic events, their association and fusion. The system is designed to be used in open, unconstrained environments like in next generation video conferencing systems that automatically “orchestrate” the transmitted video streams to improve the overall experience of interaction between spatially separated families and friends. Performance levels achieved to date on hand-labelled dataset have shown sufficient reliability at the same time as fulfilling real-time processing requirements.
Keywords: association rules, data analysis, multimodal signal processing, sensor fusion
Projects Idiap
Authors Korchagin, Danil
Motlicek, Petr
Duffner, Stefan
Bourlard, Hervé
Added by: [UNK]
Total mark: 0
  • Korchagin_ICME-2_2011.pdf