Fusion of visual and infrared images for face recognition

This paper proposes a robust face recognition method by fusing images acquired from visual and infrared (IR) sensors. Although current 2D image face recognition systems have reached a certain level of maturity, the performance of these systems has been limited by external conditions such as pose, expression and illumination. To alleviate some of these problems, infrared sensor based methods have been suggested. These methods showed very good performance when used in illumination variation environments. However, one of the main drawbacks of using IR sensors for recognition is that they are very sensitive to ambient temperatures. To solve this problem, we suggest a face recognition method that fuses both visual and IR techniques. We developed a visual and IR face image database with photographs taken under a wide range of imaging conditions. With this database, we are able to produce full combinations of comparative experiments in the field of face recognition. Our experiments showed that when using both modalities, results are far better in terms of recognition performance than when using only one modality. The overall average performance was observed to have improved under all imaging conditions.