Gated Recurrent Networks for Video Super Resolution. Lopez-Tapia, S., Lucas, A., Molina, R., & Katsaggelos, A. K. In 2020 28th European Signal Processing Conference (EUSIPCO), volume 2021-Janua, pages 700–704, jan, 2021. IEEE.
Gated Recurrent Networks for Video Super Resolution [link]Paper  doi  abstract   bibtex   
Despite the success of Recurrent Neural Networks in tasks involving temporal video processing, few works in Video Super-Resolution (VSR) have employed them. In this work we propose a new Gated Recurrent Convolutional Neural Network for VSR adapting some of the key components of a Gated Recurrent Unit. Our model employs a deformable attention module to align the features calculated at the previous time step with the ones in the current step and then uses a gated operation to combine them. This allows our model to effectively reuse previously calculated features and exploit longer temporal relationships between frames without the need of explicit motion compensation. The experimental validation shows that our approach outperforms current VSR learning based models in terms of perceptual quality and temporal consistency.
@inproceedings{Santiago2021b,
abstract = {Despite the success of Recurrent Neural Networks in tasks involving temporal video processing, few works in Video Super-Resolution (VSR) have employed them. In this work we propose a new Gated Recurrent Convolutional Neural Network for VSR adapting some of the key components of a Gated Recurrent Unit. Our model employs a deformable attention module to align the features calculated at the previous time step with the ones in the current step and then uses a gated operation to combine them. This allows our model to effectively reuse previously calculated features and exploit longer temporal relationships between frames without the need of explicit motion compensation. The experimental validation shows that our approach outperforms current VSR learning based models in terms of perceptual quality and temporal consistency.},
author = {Lopez-Tapia, Santiago and Lucas, Alice and Molina, Rafael and Katsaggelos, Aggelos K.},
booktitle = {2020 28th European Signal Processing Conference (EUSIPCO)},
doi = {10.23919/Eusipco47968.2020.9287713},
isbn = {978-9-0827-9705-3},
issn = {22195491},
keywords = {Convolutional Neuronal Networks,Recurrent Neural Networks,Super-resolution,Video},
month = {jan},
pages = {700--704},
publisher = {IEEE},
title = {{Gated Recurrent Networks for Video Super Resolution}},
url = {https://ieeexplore.ieee.org/document/9287713/},
volume = {2021-Janua},
year = {2021}
}

Downloads: 0