CHAPTER luettin-nato96/IDIAP Active Shape Models for Visual Speech Feature Extraction Luettin, Juergen Thacker, Neil A. Beet, Steve W. Storck, D. G. Ed. Hennecke, Hennecke Ed. EXTERNAL http://publications.idiap.ch/attachments/reports/1996/nato96.pdf PUBLIC Speechreading by Humans and Machines NATO ASI Series, Series F: Computer and Systems Sciences 150 383-390 1996 Springer Verlag Berlin Most approaches for lip modelling are based on heuristic constraints imposed by the user. We describe the use of Active Shape Models for extracting visual speech features for use by automatic speechreading systems, where the deformation of the lip model as well as image search is based on a priori knowledge learned from a training set. We demonstrate the robustness and accuracy of the technique for locating and tracking lips on a database consisting of a broad variety of talkers and lighting conditions.