Human Face Recognition systems are an identification procedure in which a person is verified based on human traits. This paper describes a fast face detection algorithm with accurate result. Lip Tracking is one of the biometric systems based on which a genuine system can be developed. Since the uttering characteristics of an individual are unique and difficult to imitate, lip tracking holds an advantage of making the system secure. We use pre- recorded visual utterance of speakers has been generated and stored in the database for future verification. The entire project occurs in four different stages in which the first stage includes obtaining face region from the original image, the second stage includes mouth region extraction by background subtraction, the third stage includes key points extraction by considering the lip centroid as origin of co-ordinates and the fourth stage includes storing the obtained feature vector in the database. The user who wants to be identified by the system provides the new live information, which is then compared with the existing template in the database. The feedback provided by the system will be ‘a match or a miss-match’. This project will increase the accuracy level of biometric systems.