Increasing the effect of fingers in fingerspelling hand shapes by thick edge detection and correlation with penalization

ALTUN O., VARLI S.

1st Pacific Rim Symposium on Image and Video Technology, PSIVT 2006, Hsin-chu, Tayvan, 10 - 13 Aralık 2006, cilt.4319 LNCS, ss.1133-1141, (Tam Metin Bildiri) identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 4319 LNCS
  • Doi Numarası: 10.1007/11949534_114
  • Basıldığı Şehir: Hsin-chu
  • Basıldığı Ülke: Tayvan
  • Sayfa Sayıları: ss.1133-1141
  • Anahtar Kelimeler: Angle of orientation, Axis of least inertia, Correlation with penalization, Fast alignment, Thick edges, Turkish fingerspelling recognition
  • Yıldız Teknik Üniversitesi Adresli: Evet

Özet

Fingerspelling is used in sign language to spell out names of people and places for which there is no sign or for which the sign is not known. In this work we describe a method for increasing the effect of fingers in Fingerspelling hand shapes. Hand shape objects are obtained by extraction of representative frames, color segmentation in YCrCb space and angle of least inertia based fast alignment [1]. Thick edges of the hand shape objects are extracted with a distance to edge based method. Finally a calculation that penalizes similarity for not-corresponding pixels is employed to correlation based template matching. The experimental Turkish fingerspelling recognition system recognizes all 29 letters of the Turkish alphabet. The train video database is created by three signers, and has a set of 290 videos. The test video database is created by four signers, and has a set of 203 videos. Our methods achieve a success rate of 99%. © 2006 Springer-Verlag.