Masked Word Prediction with Statistical and Neural Language Models

Atlinar F., Ayar T., Darrige A., Alqays S., Bagci A., Amasyali M. F.

2020 Innovations in Intelligent Systems and Applications Conference, ASYU 2020, İstanbul, Türkiye, 15 - 17 Ekim 2020 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası:
  • Doi Numarası: 10.1109/asyu50717.2020.9259862
  • Basıldığı Şehir: İstanbul
  • Basıldığı Ülke: Türkiye
  • Yıldız Teknik Üniversitesi Adresli: Evet

Özet

© 2020 IEEE.Language modeling is one of the main tools used in most of the natural language processing problems. Neural language models became popular with the approach of transfer learning (using a model trained for one task to another task). However, studies with neural language models on Turkish have not yet reached the desired levels. In this study, statistical and neural language models were compared using the prediction of a word that was closed randomly in a sentence. Neural language models were found to have higher success.