logo Idiap Research Institute        
 [BibTeX] [Marc21]
Facing Employers and Customers: What Do Gaze and Expressions Tell About Soft Skills?
Type of publication: Conference paper
Citation: Muralidhar_MUM_2018
Publication status: Published
Booktitle: Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia
Year: 2018
Month: November
Pages: 121-126
Location: Cairo, Egypt
Address: New York
ISBN: 978-1-4503-6594-9
DOI: 10.1145/3282894.3282925
Abstract: Eye gaze and facial expressions are central to face-to-face social interactions. These behavioral cues and their connections to first impressions have been widely studied in psychology and computing literature, but limited to a single situation. Utilizing ubiquitous multimodal sensors coupled with advances in computer vision and machine learning, we investigate the connections between these behavioral cues and perceived soft skills in two diverse workplace situations (job interviews and reception desk). Pearson's correlation analysis shows a moderate connection between certain facial expressions, eye gaze cues and perceived soft skills in job interviews (r is an element of [-30,30]) and desk (r is an element of [20,36]) situations. Results of our computational framework to infer perceived soft skills indicates a low predictive power of eye gaze, facial expressions, and their combination in both interviews (R-2 is an element of [0.02,0.21]) and desk (R-2 is an element of [0.05, 0.15]) situations. Our work has important implications for employee training and behavioral feedback systems.
Projects Idiap
Authors Muralidhar, Skanda
Siegfried, Remy
Odobez, Jean-Marc
Gatica-Perez, Daniel
Added by: [UNK]
Total mark: 0
  • Muralidhar_MUM_2018.pdf