Face tracking and pose estimation with automatic three-dimensional model construction
AuthorsJiménez Molina, Pedro; Nuevo Chiquero, Jesús; Bergasa Pascual, Luis Miguel; Sotelo Vázquez, Miguel Ángel
IdentifiersPermanent link (URI): http://hdl.handle.net/10017/45487
Institution of Engineering and Technology
Ministerio de Educación y Ciencia
Comunidad de Madrid
Jiménez, P., Nuevo, J., Bergasa, L.M. & Sotelo, M.A. 2009, "Face tracking and pose estimation with automatic three-dimensional model construction", IET Computer Vision, vol. 3, no. 2, pp. 93-102.
Attribution-NonCommercial-NoDerivatives 4.0 Internacional
© 2009 Institution of Engineering and Technology
A method for robustly tracking and estimating the face pose of a person using stereo vision is presented. The method is invariant to identity and does not require previous training. A face model is automatically initialised and constructed online: a fixed point distribution is superposed over the face when it is frontal to the cameras, and several appropriate points close to those locations are chosen for tracking. Using the stereo correspondence of the cameras, the three-dimensional (3D) coordinates of these points are extracted, and the 3D model is created. The 2D projections of the model points are tracked separately on the left and right images using SMAT. RANSAC and POSIT are used for 3D pose estimation. Head rotations up to ±45° are correctly estimated. The approach runs in real time. The purpose of this method is to serve as the basis of a driver monitoring system, and has been tested on sequences recorded in a moving car.