Masked Word Prediction with Statistical and Neural Language Models

Atlinar F., Ayar T., Darrige A., Alqays S., Bagci A., Amasyali M. F.

2020 Innovations in Intelligent Systems and Applications Conference, ASYU 2020, İstanbul, Turkey, 15 - 17 October 2020 identifier

  • Publication Type: Conference Paper / Full Text
  • Volume:
  • Doi Number: 10.1109/asyu50717.2020.9259862
  • City: İstanbul
  • Country: Turkey
  • Yıldız Technical University Affiliated: Yes


© 2020 IEEE.Language modeling is one of the main tools used in most of the natural language processing problems. Neural language models became popular with the approach of transfer learning (using a model trained for one task to another task). However, studies with neural language models on Turkish have not yet reached the desired levels. In this study, statistical and neural language models were compared using the prediction of a word that was closed randomly in a sentence. Neural language models were found to have higher success.