Gaze Estimation From Multimodal Kinect Data
| Type of publication: | Conference paper |
| Citation: | Funes_CVPRWP_2012 |
| Booktitle: | IEEE Conference in Computer Vision and Pattern Recognition, Workshop on Gesture Recognition |
| Year: | 2012 |
| Month: | June |
| Location: | Providence, RI, USA |
| ISSN: | 2160-7508 |
| ISBN: | 978-1-4673-1610-1 |
| DOI: | 10.1109/CVPRW.2012.6239182 |
| Abstract: | This paper addresses the problem of free gaze estimation under unrestricted head motion. More precisely, unlike previous approaches that mainly focus on estimating gaze towards a small planar screen, we propose a method to estimate the gaze direction in the 3D space. In this context the paper makes the following contributions: (i) leveraging on Kinect device, we propose a multimodal method that rely on depth sensing to obtain robust and accurate head pose tracking even under large head pose, and on the visual data to obtain the remaining eye-in-head gaze directional information from the eye image; (ii) a rectification scheme of the image that exploits the 3D mesh tracking, allowing to conduct a head pose free eye-in-head gaze directional estimation; (iii) a simple way of collecting ground truth data thanks to the Kinect device. Results on three users demonstrate the great potential of our approach. |
| Keywords: | Gaze estimation, Head pose, RGB-D |
| Projects |
Idiap |
| Authors | |
| Added by: | [UNK] |
| Total mark: | 0 |
|
Attachments
|
|
|
|
|
Notes
|
|
|
|
|
