logo Idiap Research Institute        
 [BibTeX] [Marc21]
3D Head Pose and Gaze Tracking and Their Application to Diverse Multimodal Tasks
Type of publication: Conference paper
Citation: FunesMora_ICMI_DC_2013
Publication status: Published
Booktitle: Doctoral consortium of the 15th ACM International Conference on Multimodal Interaction
Year: 2013
Month: December
Location: Sydney, Australia
DOI: 10.1145/2522848.2532192
Abstract: In this PhD thesis the problem of 3D head pose and gaze tracking from minimal user cooperation is addressed. By exploiting characteristics of RGB-D sensors, contributions have been made related to consequent problems of the lack of cooperation: in particular, head pose and inter-person appearance variability; in addition to low resolution handling. The resulting system enabled diverse multimodal applications. In particular, recent work combined multiple RGB-D sensors to detect gazing events in dyadic interactions. The research plan consists of: i) Improving the robustness, accuracy and usability of the head pose and gaze tracking system; ii) To use additional multimodal cues, such as speech and dynamic context, to train and adapt gaze models in an unsupervised manner; iii) To extend the application of 3D gaze estimation to diverse multimodal applications. This includes visual focus of attention tasks involving multiple visual targets, e.g. people in a meeting-like setup.
Keywords: Gaze estimation, HCI, Head pose tracking, HHI, HRI, Speech
Projects Idiap
Authors Funes Mora, Kenneth Alberto
Added by: [UNK]
Total mark: 0