logo Idiap Research Institute        
 [BibTeX] [Marc21]
Nonverbal Social Sensing in Action: Unobtrusive Recording and Extracting of Nonverbal Behavior in Social Interactions Illustrated with a Research Example
Type of publication: Journal paper
Citation: Frauendorfer_JNONVERBALBEHAV_2014
Journal: Journal of Nonverbal Behavior
Volume: 38
Number: 2
Year: 2014
Month: June
Pages: 231-245
DOI: 10.1007/s10919-014-0173-5
Abstract: Nonverbal behavior coding is typically conducted by ‘‘hand’’. To remedy this time and resource intensive undertaking, we illustrate how nonverbal social sensing, defined as the automated recording and extracting of nonverbal behavior via ubiquitous social sensing platforms, can be achieved. More precisely, we show how and what kind of nonverbal cues can be extracted and to what extent automated extracted nonverbal cues can be validly obtained with an illustrative research example. In a job interview, the applicant’s vocal and visual nonverbal immediacy behavior was automatically sensed and extracted. Results show that the applicant’s nonverbal behavior can be validly extracted. Moreover, both visual and vocal applicant nonverbal behavior predict recruiter hiring decision, which is in line with previous findings on manually coded applicant nonverbal behavior. Finally, applicant average turn duration, tempo variation, and gazing best predict recruiter hiring decision. Results and implications of such a nonverbal social sensing for future research are discussed.
Projects SONVB
Authors Frauendorfer, Denise
Schmid Mast, Marianne
Nguyen, Laurent Son
Gatica-Perez, Daniel
Added by: [UNK]
Total mark: 0
  • Frauendorfer_JNONVERBALBEHAV_2014.pdf