Subjective evaluation of image quality. Sudhama, A., Deas, L. M., Goel, J, Allison, R. S., & Wilcox, L. M. In Centre for Vision Research International Conference on Vision in the Real World, pages 33. 2017.
abstract   bibtex   
Advances in high-dynamic range, wide-colour-gamut displays have created unparalleled opportunities for improving image quality, but have also driven rapid expansion of data bandwidth requirements. To meet these needs, there is increasing demand for low-impairment display stream compression (DSC). The goal of low-impairment DSC is to ensure that the final product meets demanding compression targets, while being perceptually identical to the original image. Objective approaches, based on error metrics, are useful to a point, but cannot reliably predict the visibility of artefacts near the limits of detection. Thus, subjective assessments are required to confirm that compression is visually lossless, a task that is is made more complex by the fact that the benchmarks (e.g., what is visually lossless) are not well defined, and by a lack of theory linking these perceptual outcomes to objective error metrics. Subjective quality measures can be dramatically affected by choice of methodology, content and participant experience. Here we will discuss this issue in the context of our recent experiments in which we evaluated leading low impairment algorithms using a common image set, and a side-by-side flicker detection paradigm (ISO/IEC 29170-2). In follow-up trials we evaluated these same codecs using a modified motion-based paradigm and show that in this more realistic viewing scenario, viewers are often less sensitive to compression-related artefacts.
@incollection{Aishwarya-Sudhama:2017jk,
	abstract = {Advances in high-dynamic range, wide-colour-gamut displays have created unparalleled opportunities for improving image quality, but have also driven rapid expansion of data bandwidth requirements. To meet these needs, there is increasing demand for low-impairment display stream compression (DSC). The goal of low-impairment DSC is to ensure that the final product meets demanding compression targets, while being perceptually identical to the original image. Objective approaches, based on error metrics, are useful to a point, but cannot reliably predict the visibility of artefacts near the limits of detection.  Thus, subjective assessments are required to confirm that compression is visually lossless, a task that is is made more complex by the fact that the benchmarks (e.g., what is visually lossless) are not well defined, and by a lack of theory linking these perceptual outcomes to objective error metrics. Subjective quality measures can be dramatically affected by choice of methodology, content and participant experience. Here we will discuss this issue in the context of our recent experiments in which we evaluated leading low impairment algorithms using a common image set, and a side-by-side flicker detection paradigm (ISO/IEC 29170-2).  In follow-up trials we evaluated these same codecs using a modified motion-based paradigm and show that in this more realistic viewing scenario, viewers are often less sensitive to compression-related artefacts.


},
	annote = {Toronto June 2017},
	author = {Sudhama, A. and Deas, L. M. and Goel, J and Allison, R. S. and Wilcox, L. M.},
	booktitle = {Centre for Vision Research International Conference on Vision in the Real World},
	date-added = {2017-06-08 17:40:28 +0000},
	date-modified = {2017-09-03 18:24:20 +0000},
	keywords = {Image Quality},
	pages = {33},
	title = {Subjective evaluation of image quality},
	year = {2017}}

Downloads: 0