logo Idiap Research Institute        
 [BibTeX] [Marc21]
Fusing Audio-Visual Nonverbal Cues to Detect Dominant People in Conversations
Type of publication: Idiap-RR
Citation: Aran_Idiap-RR-17-2010
Number: Idiap-RR-17-2010
Year: 2010
Month: 7
Institution: Idiap
Abstract: This paper addresses the multimodal nature of social dominance and presents multimodal fusion techniques to combine audio and visual nonverbal cues for dominance estimation in small group conversations. We combine the two modalities both at the feature extraction level and at the classifier level via score and rank level fusion. The classification is done by a simple rule-based estimator. We perform experiments on a new 10-hour dataset derived from the popular AMI meeting corpus. We objectively evaluate the performance of each modality and each cue alone and in combination. Our results show that the combination of audio and visual cues is necessary to achieve the best performance.
Keywords:
Projects Idiap
NOVICOM
Authors Aran, Oya
Gatica-Perez, Daniel
Crossref by Aran_ICPR2010_2010
Added by: [ADM]
Total mark: 0
Attachments
  • Aran_Idiap-RR-17-2010.pdf (MD5: 52a75f27c25b79dcfe7f66c63df81b13)
Notes