logo Idiap Research Institute        
 [BibTeX] [Marc21]
Gaze Estimation From Multimodal Kinect Data
Type of publication: Conference paper
Citation: Funes_CVPRWP_2012
Booktitle: IEEE Conference in Computer Vision and Pattern Recognition, Workshop on Gesture Recognition
Year: 2012
Month: June
Location: Providence, RI, USA
ISSN: 2160-7508
ISBN: 978-1-4673-1610-1
DOI: 10.1109/CVPRW.2012.6239182
Abstract: This paper addresses the problem of free gaze estimation under unrestricted head motion. More precisely, unlike previous approaches that mainly focus on estimating gaze towards a small planar screen, we propose a method to estimate the gaze direction in the 3D space. In this context the paper makes the following contributions: (i) leveraging on Kinect device, we propose a multimodal method that rely on depth sensing to obtain robust and accurate head pose tracking even under large head pose, and on the visual data to obtain the remaining eye-in-head gaze directional information from the eye image; (ii) a rectification scheme of the image that exploits the 3D mesh tracking, allowing to conduct a head pose free eye-in-head gaze directional estimation; (iii) a simple way of collecting ground truth data thanks to the Kinect device. Results on three users demonstrate the great potential of our approach.
Keywords: Gaze estimation, Head pose, RGB-D
Projects Idiap
Authors Funes Mora, Kenneth Alberto
Odobez, Jean-Marc
Added by: [UNK]
Total mark: 0
  • Funes_CVPRWP_2012.pdf