A comprehensive review on deep learning based remote sensing image super-resolution methods

Wang P., BAYRAM B., Sertel E.

EARTH-SCIENCE REVIEWS, vol.232, 2022 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Review
  • Volume: 232
  • Publication Date: 2022
  • Doi Number: 10.1016/j.earscirev.2022.104110
  • Journal Name: EARTH-SCIENCE REVIEWS
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Aerospace Database, Aquatic Science & Fisheries Abstracts (ASFA), Artic & Antarctic Regions, CAB Abstracts, Communication Abstracts, Environment Index, INSPEC, Metadex, Veterinary Science Database, DIALNET, Civil Engineering Abstracts
  • Keywords: Deep learning, Remote sensing, Super-resolution, SUPER RESOLUTION, NEURAL-NETWORK
  • Yıldız Technical University Affiliated: Yes

Abstract

Satellite imageries are an important geoinformation source for different applications in the Earth Science field. However, due to the limitation of the optic and sensor technologies and the high cost to update the sensors and equipments, the spectral and spatial resolution of the Earth Observation satellites may not meet the desired requirements. Thus, Remote Sensing Image Super-resolution (RSISR) which aims at restoring the high-resolution (HR) remote sensing images from the given low-resolution (LR) images has drawn considerable attention and witnessed the rapid development of the deep learning (DL) algorithms. In this research, we aim to compre-hensively review the DL-based single image super-resolution (SISR) methods on optical remote sensing images. First, we introduce the DL techniques utilized in SISR. Second, we summarize the RSISR algorithms thoroughly, including the DL models, commonly used remote sensing datasets, loss functions, and performance evaluation metrics. Third, we present a new multi-sensor dataset that consists of Very High-Resolution satellite images from different satellites of various landscapes and evaluate the performance of some state-of-the-art super-resolution methods on this dataset. Finally, we envision the challenges and future research in the RSISR field.