logo Idiap Research Institute        
 [BibTeX] [Marc21]
Exploiting observers' judgements for nonverbal group interaction analysis
Type of publication: Conference paper
Citation: Chittaranjan_FG11_2011
Publication status: Published
Booktitle: IEEE Conference on Automatic Face and Gesture Recognition
Year: 2011
Month: March
Pages: 6
Publisher: IEEE
Abstract: Incorporating annotators' knowledge into a machine-learning framework for detecting psychological traits using multimodal data is an open issue in human communication and social computing. We present a model that is designed to exploit the subjective judgements of multiple annotators on a social trait labeling task. Our two-stage model first estimates a ground truth by modeling the annotators using both the annotations and annotators’ self-reported confidences. In the second stage, we train a classifier using the estimated ground truth as labels. We also define ways to verify the consistency of our model and validate it using annotations and nonverbal cues for a dominance estimation task in a group interaction scenario on the publicly available DOME corpus, in addition to synthetically generated data. Our models give satisfactory results, outperforming the commonly used majority voting as well as other approaches in the literature.
Projects Idiap
Authors Chittaranjan, Gokul
Aran, Oya
Gatica-Perez, Daniel
Added by: [UNK]
Total mark: 0
  • Chittaranjan_FG11_2011.pdf