A new initialization method for artificial neural networks: Laplacian Yapay sinir aǧlarinda yeni bir ön deǧer atama yöntemi: Laplasyen

Creative Commons License

Çatalbas B., Çatalbaş B., Morgul Ö.

26th IEEE Signal Processing and Communications Applications Conference, SIU 2018, İzmir, Türkiye, 2 - 05 Mayıs 2018, ss.1-4 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/siu.2018.8404491
  • Basıldığı Şehir: İzmir
  • Basıldığı Ülke: Türkiye
  • Sayfa Sayıları: ss.1-4
  • Anahtar Kelimeler: Artificial neural networks, Classifier-initialization, Deep learning
  • Yıldız Teknik Üniversitesi Adresli: Evet

Özet

Artificial neural networks' popularity in the field of machine learning increases day by day since 2006, foundation date of deep learning. One of the factors which greatly affects the success percentages of deep neural networks is their initialization. In this article, new initialization methods based on Laplacian distribution is proposed. With the use of these new initialization methods, it is aimed to assign appropriate initial values to the network parameters so as to better train the network. Results of our methods on University of California, Irvine (UCI) Human Activity Recognition and CIFAR-10 datasets are compared with the networks which are initialized with well-known methods, such as Gaussian and Uniform initialization, while network formation and layer structure are left unchanged. With this comparison, the advantages of Laplacian-based initialization methods compared to existing methods were discussed considering the test success.