Deep learning approaches to inverse problems in imaging: Past, present and future. López-Tapia, S., Molina, R., & Katsaggelos, A. K. Digital Signal Processing, 119:103285, dec, 2021.
Deep learning approaches to inverse problems in imaging: Past, present and future [link]Paper  doi  abstract   bibtex   
In recent years, deep learning-based models have gained momentum in imaging problems such as image and video super-resolution, image restoration or inpainting. The analytical approaches that have traditionally been used to solve image inverse problems have started to be replaced by deep learning ones, being outperformed in terms of efficacy and efficiency in many applications. However, deep learning-based models lack the adaptability of analytical models, thus making them unsuitable for dealing simultaneously with different forward image formation models. In contrast to analytical methods, deep learning models typically do not use domain knowledge and rely on learning the solution to the inverse problem from large data sets. This is making them susceptible to errors caused by the presence of degradations not seen during training. Hybrid models combining analytical and deep learning approaches have been introduced to solve such generalization issues while retaining the efficacy of deep learning models. In this work, we review deep learning and hybrid methods for solving imaging inverse problems, focusing on image and video super-resolution and image restoration. Furthermore, we discuss open problems in this area that would be of critical importance in the future, the challenges of applying deep learning models to solve them, and how future research could address them.
@article{Santiago2021,
abstract = {In recent years, deep learning-based models have gained momentum in imaging problems such as image and video super-resolution, image restoration or inpainting. The analytical approaches that have traditionally been used to solve image inverse problems have started to be replaced by deep learning ones, being outperformed in terms of efficacy and efficiency in many applications. However, deep learning-based models lack the adaptability of analytical models, thus making them unsuitable for dealing simultaneously with different forward image formation models. In contrast to analytical methods, deep learning models typically do not use domain knowledge and rely on learning the solution to the inverse problem from large data sets. This is making them susceptible to errors caused by the presence of degradations not seen during training. Hybrid models combining analytical and deep learning approaches have been introduced to solve such generalization issues while retaining the efficacy of deep learning models. In this work, we review deep learning and hybrid methods for solving imaging inverse problems, focusing on image and video super-resolution and image restoration. Furthermore, we discuss open problems in this area that would be of critical importance in the future, the challenges of applying deep learning models to solve them, and how future research could address them.},
author = {L{\'{o}}pez-Tapia, Santiago and Molina, Rafael and Katsaggelos, Aggelos K.},
doi = {10.1016/j.dsp.2021.103285},
issn = {10512004},
journal = {Digital Signal Processing},
keywords = {Convolutional neural network,Deep learning,Inverse imaging problems,Video super-resolution},
month = {dec},
pages = {103285},
title = {{Deep learning approaches to inverse problems in imaging: Past, present and future}},
url = {https://linkinghub.elsevier.com/retrieve/pii/S1051200421003249},
volume = {119},
year = {2021}
}

Downloads: 0