A Deep Learning-based Method for Turkish Text Detection from Videos

Rasheed J., Jamil A., Dogru H. B., Tilki S., YEŞİLTEPE M.

11th International Conference on Electrical and Electronics Engineering (ELECO), Bursa, Turkey, 28 - 30 November 2019, pp.935-939 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume:
  • Doi Number: 10.23919/eleco47770.2019.8990633
  • City: Bursa
  • Country: Turkey
  • Page Numbers: pp.935-939
  • Yıldız Technical University Affiliated: Yes


The text appearing in videos provides useful information, which can be exploited for developing automatic video indexing and retrieval systems. In this study, we integrated a heuristic and a deep learning-based method using Convolutional Neural Network (CNN) for automatic text extraction from videos. The two independent steps used for text extraction are; candidate text region detection and classification. In first step, rectangular regions were detected that potentially contain text by applying heuristics, which includes morphological processing and geometrical constraints. Then, the obtained candidate text regions were passed through several layers of CNN, that first produced convolutional feature map and then classified the candidate regions into either text or not-text classes. A dataset was prepared by collecting videos from various Turkish channels. 70% of the data was used to train the network while 30% for validation. Experiments showed that our proposed method achieved state-of-the-art performance on our dataset.