IEEE transactions on pattern analysis and machine intelligence, 1, 2012. Paper abstract bibtex
We present an extensive evaluation of 17 confidence measures for stereo matching that compares the most widely used measures as well as several novel techniques proposed here. We begin by categorizing these methods according to which aspects of stereo cost estimation they take into account and, then, assess their strengths and weaknesses. The evaluation is conducted using a winner-take-all framework on binocular and multi-baseline datasets with ground truth. It measures the capability of each confidence method to rank depth estimates according to their likelihood for being correct, to detect occluded pixels and to generate low-error depth maps by selecting among multiple hypotheses for each pixel. Our work was motivated by the observation that such an evaluation is missing from the rapidly maturing stereo literature and that our findings would be helpful to researchers binocular and multi-view stereo.