Implementation of Hyperparameter Algorithms on Big Data Platforms: A Case Study


Mangliyeva M., Tanrıverdi B., AKTAŞ M. S. , KALIPSIZ O., Balçık E.

4. Uluslararası Bilgisayar Bilimleri ve Mühendisliği Konferansı (UBMK 2019), 11 - 15 September 2019 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/ubmk.2019.8907145
  • Keywords: Hyperparameter Selection, Big Data, Data Analytics, Spark, Simulated Annealing, Bayesian Search, Tree-structured Parzen Estimators, Differential Evolution, Basin Hopping

Abstract

Algorithms in each step of data analytics application include hyperparameters which are independent of the data itself. The choice of hyperparameters is one of the most time consuming part of data analytics, since it cannot be performed precisely without the use of heuristic or empirical methods. In our project we have implemented hyperparameter selection algorithms: Simulated Annealing, Bayesian Search, Tree-structured Parzen Estimators, Differential Evolution, Basin Hopping on Spark, distributed big data processing platform. The performance is measured by comparing results we get from each algorithm with results of Random Search algorithm. We have tested the scalability and ability for parallelization of algorithms.