1. In a face tracking system, a method of tracking facial features, the method including the step of: (a) determining if glass rims, frames or arms form part of the face being tracked; and (b) where said rims, frames or arms form part of the structure, utilizing the appearance of the rims, frames or arms to track a 2D image position or 3D pose of the glasses frame or the head/face.