Stress recognition from facial images in children during physiotherapy with serious games[Formula presented]


Vural Ş. F., Yurdusever B., OKTAY A. B., Uzun I.

Expert Systems with Applications, cilt.238, 2024 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 238
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1016/j.eswa.2023.121837
  • Dergi Adı: Expert Systems with Applications
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Anahtar Kelimeler: Children facial emotion recognition, Deep learning, Physiotherapy, Stress recognition
  • Yıldız Teknik Üniversitesi Adresli: Evet

Özet

Serious games have emerged as promising tools for physiotherapy, offering an engaging way to motivate patients and improve physical functions. Stress, a common physiological response, can impede patient performance and hinder recovery in physiotherapy. However, there is limited research on stress recognition for children during physiotherapeutic serious games. This study proposes a deep and machine learning based method for stress detection from facial images of children. The contributions include the utilization of a novel dataset comprising videos of 25 children, including children with specific conditions, and the exploration of using adults’ facial images for data augmentation. The proposed method employs a modified deep network architecture, VGG-Face, for facial emotion recognition and utilizes three machine learning models for stress recognition. This study represents the first attempt to recognize stress in children's facial images during physiotherapy with serious games. The findings hold the potential to optimize patient outcomes and contribute to monitoring patients during home therapy.