A comparative analysis of multi-biometrics performance in human and action recognition using silhouette thermal-face and skeletal data

KURBAN O. C., YILDIRIM T.

Neural Networks, cilt.170, ss.1-17, 2024 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 170
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1016/j.neunet.2023.10.016
  • Dergi Adı: Neural Networks
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Applied Science & Technology Source, BIOSIS, Biotechnology Research Abstracts, Communication Abstracts, Compendex, Computer & Applied Sciences, INSPEC, MEDLINE, Psycinfo, zbMATH
  • Sayfa Sayıları: ss.1-17
  • Anahtar Kelimeler: Behavioural biometrics, Deep learning, Energy images, Thermal face
  • Yıldız Teknik Üniversitesi Adresli: Evet

Özet

Biometrics is a field that has been given importance in recent years and has been extensively studied. Biometrics can use physical and behavioural differences that are unique to individuals to recognize and identify them. Today, biometric information is used in many areas such as computer vision systems, entrance systems, security and recognition. In this study, a new biometrics database containing silhouette, thermal face and skeletal data based on the distance between the joints was created to be used in behavioural and physical biometrics studies. The fact that many cameras were used in previous studies increases both the processing intensity and the material cost. This study aimed to both increase the recognition performance and reduce material costs by adding thermal face data in addition to soft and behavioural biometrics with the optimum camera. The presented data set was created in accordance with both motion recognition and person identification. Various data loss scenarios and multi-biometrics approaches based on data fusion have been tried on the created data sets and the results have been given comparatively. In addition, the correlation coefficient of the motion frames method to obtain energy images from silhouette data was tested on this dataset and yielded high-accuracy results for both motion and person recognition.