CONF Funes_CVPRWP_2012/IDIAP Gaze Estimation From Multimodal Kinect Data Funes Mora, Kenneth Alberto Odobez, Jean-Marc Gaze estimation Head pose RGB-D EXTERNAL http://publications.idiap.ch/attachments/papers/2012/Funes_CVPRWP_2012.pdf PUBLIC IEEE Conference in Computer Vision and Pattern Recognition, Workshop on Gesture Recognition Providence, RI, USA 2012 2160-7508 978-1-4673-1610-1 10.1109/CVPRW.2012.6239182 doi This paper addresses the problem of free gaze estimation under unrestricted head motion. More precisely, unlike previous approaches that mainly focus on estimating gaze towards a small planar screen, we propose a method to estimate the gaze direction in the 3D space. In this context the paper makes the following contributions: (i) leveraging on Kinect device, we propose a multimodal method that rely on depth sensing to obtain robust and accurate head pose tracking even under large head pose, and on the visual data to obtain the remaining eye-in-head gaze directional information from the eye image; (ii) a rectification scheme of the image that exploits the 3D mesh tracking, allowing to conduct a head pose free eye-in-head gaze directional estimation; (iii) a simple way of collecting ground truth data thanks to the Kinect device. Results on three users demonstrate the great potential of our approach.