Visual Distortions in 360° Videos. Azevedo, R. G. d. A., Birkbeck, N., De Simone, F., Janatra, I., Adsumilli, B., & Frossard, P. IEEE Transactions on Circuits and Systems for Video Technology, 30(8):2524-2537, Aug, 2020.
doi  abstract   bibtex   14 downloads  
Omnidirectional (or 360°) images and videos are emergent signals being used in many areas, such as robotics and virtual/augmented reality. In particular, for virtual reality applications, they allow an immersive experience in which the user can interactively navigate through a scene with three degrees of freedom, wearing a head-mounted display. Current approaches for capturing, processing, delivering, and displaying 360° content, however, present many open technical challenges and introduce several types of distortions in the visual signal. Some of the distortions are specific to the nature of 360° images and often differ from those encountered in classical visual communication frameworks. This paper provides a first comprehensive review of the most common visual distortions that alter 360° signals going through the different processing elements of the visual communication pipeline. While their impact on viewers’ visual perception and the immersive experience at large is still unknown—thus, it is an open research topic—this review serves the purpose of proposing a taxonomy of the visual distortions that can be encountered in 360° signals. Their underlying causes in the end-to-end 360° content distribution pipeline are identified. This taxonomy is essential as a basis for comparing different processing techniques, such as visual enhancement, encoding, and streaming strategies, and allowing the effective design of new algorithms and applications. It is also a useful resource for the design of psycho-visual studies aiming to characterize human perception of 360° content in interactive and immersive applications.
@article{2020_08_azevedo,
author={Azevedo, Roberto Gerson de Albuquerque and Birkbeck, Neil, and De
Simone, Francesca and Janatra, Ivan and Adsumilli, Balu and Frossard,
Pascal},
journal={IEEE Transactions on Circuits and Systems for Video Technology},
title={Visual Distortions in 360° Videos},
year={2020},
volume={30},
number={8},
pages={2524-2537},
abstract={Omnidirectional (or 360°) images and videos are emergent signals
being used in many areas, such as robotics and virtual/augmented reality. In
particular, for virtual reality applications, they allow an immersive
experience in which the user can interactively navigate through a scene with
three degrees of freedom, wearing a head-mounted display. Current approaches
for capturing, processing, delivering, and displaying 360° content, however,
present many open technical challenges and introduce several types of
distortions in the visual signal. Some of the distortions are specific to the
nature of 360° images and often differ from those encountered in classical
visual communication frameworks. This paper provides a first comprehensive
review of the most common visual distortions that alter 360° signals going
through the different processing elements of the visual communication
pipeline. While their impact on viewers’ visual perception and the
immersive experience at large is still unknown—thus, it is an open research
topic—this review serves the purpose of proposing a taxonomy of the visual
distortions that can be encountered in 360° signals. Their underlying causes
in the end-to-end 360° content distribution pipeline are identified. This
taxonomy is essential as a basis for comparing different processing
techniques, such as visual enhancement, encoding, and streaming strategies,
and allowing the effective design of new algorithms and applications. It is
also a useful resource for the design of psycho-visual studies aiming to
characterize human perception of 360° content in interactive and immersive
applications.},
keywords={Visualization;Videos;Distortion;Cameras;Pipelines;Encoding;Signal
processing algorithms;Omnidirectional video;360-degree video;visual
distortions;artifacts;compression},
doi={10.1109/TCSVT.2019.2927344},
issn={1558-2205},
month={Aug},
}

Downloads: 14