Method

Stereo matching based on classification of materials [SMCM]


Submitted on 17 Feb. 2016 13:00 by
Menglong Yang (Sichuan University)

Running time:1800 s
Environment:Nvidia GTX 1080 (Caffe)

Method Description:
Stereo matching is one of the most important and
fundamental topics in computer vision. Encouraging
self-similar
pixels to be assigned to the same label has been
proved to be effective for stereo. A typical way
of taking advantage
of self-similarity is performing a color
segmentation on the image and motivating the
pixels within each segment
to share an identical label. However, some cases
cannot be handled by image segmentation, such as
the pixels in
disconnected regions. This paper proposes a stereo
method based on the assumption, that a 3D scene is
a collection
of a few smooth surfaces and a few classes of
reflective materials, such that the 3D points
belonging to an identical
material are likely to lie on a small number of
surfaces and the 3D points lying on a single
surface belong to a few
classes of reflective materials. Each material is
expected to have specific albedo properties. This
paper presents two
methods for classifying the albedo properties
depending on whether the illumination environment
is known, without
recovering the albedo parameters. The proposed
model is formulated as an energy function
incorporating some new
priors, that is optimized via fusion move
algorithm.
Parameters:
comming soon
Latex Bibtex:
@article{yang2016stereo,
title={Stereo matching based on classification of
materials},
author={Yang, Menglong and Liu, Yiguang and Cai,
Ying and You, Zhisheng},
journal={Neurocomputing},
volume={194},
pages={308--316},
year={2016}}

Detailed Results

This page provides detailed results for the method(s) selected. For each of the first 20 test images, the number of erroneous pixels at all thresholds is depicted in the table. Underneath, the left input image, the disparity / end-point error map and the estimated (and interpolated) disparity / optical flow map are shown. The error map scales linearly between 0 (black) and >=5 (white) pixels error. Red denotes all occluded pixels, falling outside the image boundaries. The false color map is scaled to the largest ground truth disparity / flow value.

Test Set Average

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.60 % 7.14 % 0.9 px 1.1 px
3 pixels 3.94 % 5.24 % 0.9 px 1.1 px
4 pixels 3.13 % 4.23 % 0.9 px 1.1 px
5 pixels 2.61 % 3.57 % 0.9 px 1.1 px
This table as LaTeX

Reflective Regions

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 24.46 % 28.54 % 2.8 px 4.8 px
3 pixels 17.46 % 21.74 % 2.8 px 4.8 px
4 pixels 13.64 % 17.93 % 2.8 px 4.8 px
5 pixels 11.28 % 15.52 % 2.8 px 4.8 px
This table as LaTeX

Test Image 0

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 4.28 % 5.61 % 0.7 px 0.9 px
3 pixels 2.95 % 3.84 % 0.7 px 0.9 px
4 pixels 2.02 % 2.73 % 0.7 px 0.9 px
5 pixels 1.71 % 2.34 % 0.7 px 0.9 px
This table as LaTeX





Test Image 1

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.43 % 7.75 % 0.8 px 1.0 px
3 pixels 3.30 % 5.23 % 0.8 px 1.0 px
4 pixels 2.60 % 4.35 % 0.8 px 1.0 px
5 pixels 2.17 % 3.72 % 0.8 px 1.0 px
This table as LaTeX





Test Image 2

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 4.83 % 5.65 % 0.6 px 0.7 px
3 pixels 2.90 % 3.55 % 0.6 px 0.7 px
4 pixels 1.99 % 2.55 % 0.6 px 0.7 px
5 pixels 1.50 % 2.01 % 0.6 px 0.7 px
This table as LaTeX





Test Image 3

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.03 % 7.08 % 0.6 px 1.1 px
3 pixels 2.76 % 4.51 % 0.6 px 1.1 px
4 pixels 1.78 % 3.54 % 0.6 px 1.1 px
5 pixels 1.30 % 3.07 % 0.6 px 1.1 px
This table as LaTeX





Test Image 4

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 3.49 % 4.08 % 0.6 px 0.7 px
3 pixels 2.15 % 2.59 % 0.6 px 0.7 px
4 pixels 1.51 % 1.85 % 0.6 px 0.7 px
5 pixels 0.95 % 1.20 % 0.6 px 0.7 px
This table as LaTeX





Test Image 5

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 1.95 % 2.14 % 0.5 px 0.5 px
3 pixels 1.34 % 1.44 % 0.5 px 0.5 px
4 pixels 1.01 % 1.06 % 0.5 px 0.5 px
5 pixels 0.80 % 0.82 % 0.5 px 0.5 px
This table as LaTeX





Test Image 6

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 6.64 % 8.59 % 1.0 px 1.7 px
3 pixels 4.13 % 6.08 % 1.0 px 1.7 px
4 pixels 3.05 % 4.98 % 1.0 px 1.7 px
5 pixels 2.65 % 4.54 % 1.0 px 1.7 px
This table as LaTeX





Test Image 7

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 7.72 % 9.74 % 1.1 px 1.8 px
3 pixels 5.08 % 6.84 % 1.1 px 1.8 px
4 pixels 4.06 % 5.63 % 1.1 px 1.8 px
5 pixels 3.50 % 5.05 % 1.1 px 1.8 px
This table as LaTeX





Test Image 8

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 2.42 % 3.32 % 0.5 px 0.6 px
3 pixels 1.43 % 2.06 % 0.5 px 0.6 px
4 pixels 1.01 % 1.50 % 0.5 px 0.6 px
5 pixels 0.86 % 1.30 % 0.5 px 0.6 px
This table as LaTeX





Test Image 9

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 11.38 % 13.56 % 1.3 px 1.8 px
3 pixels 7.63 % 9.89 % 1.3 px 1.8 px
4 pixels 6.07 % 8.28 % 1.3 px 1.8 px
5 pixels 4.94 % 7.16 % 1.3 px 1.8 px
This table as LaTeX





Test Image 10

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 2.95 % 4.27 % 0.5 px 0.6 px
3 pixels 1.57 % 2.59 % 0.5 px 0.6 px
4 pixels 1.08 % 1.80 % 0.5 px 0.6 px
5 pixels 0.85 % 1.38 % 0.5 px 0.6 px
This table as LaTeX





Test Image 11

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 9.13 % 11.64 % 1.6 px 1.7 px
3 pixels 6.04 % 7.50 % 1.6 px 1.7 px
4 pixels 4.74 % 5.36 % 1.6 px 1.7 px
5 pixels 3.85 % 4.14 % 1.6 px 1.7 px
This table as LaTeX





Test Image 12

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.76 % 8.01 % 1.2 px 2.7 px
3 pixels 4.40 % 6.62 % 1.2 px 2.7 px
4 pixels 3.84 % 6.05 % 1.2 px 2.7 px
5 pixels 3.51 % 5.73 % 1.2 px 2.7 px
This table as LaTeX





Test Image 13

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.13 % 6.41 % 1.0 px 1.2 px
3 pixels 3.91 % 5.12 % 1.0 px 1.2 px
4 pixels 3.30 % 4.46 % 1.0 px 1.2 px
5 pixels 3.08 % 4.21 % 1.0 px 1.2 px
This table as LaTeX





Test Image 14

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 2.56 % 4.27 % 0.5 px 0.7 px
3 pixels 1.54 % 2.73 % 0.5 px 0.7 px
4 pixels 1.24 % 2.18 % 0.5 px 0.7 px
5 pixels 0.98 % 1.81 % 0.5 px 0.7 px
This table as LaTeX





Test Image 15

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 6.16 % 6.89 % 0.8 px 0.8 px
3 pixels 3.88 % 4.10 % 0.8 px 0.8 px
4 pixels 2.65 % 2.70 % 0.8 px 0.8 px
5 pixels 1.94 % 1.90 % 0.8 px 0.8 px
This table as LaTeX





Test Image 16

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 3.45 % 3.39 % 0.6 px 0.6 px
3 pixels 1.58 % 1.55 % 0.6 px 0.6 px
4 pixels 1.07 % 1.05 % 0.6 px 0.6 px
5 pixels 0.67 % 0.66 % 0.6 px 0.6 px
This table as LaTeX





Test Image 17

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 7.22 % 7.97 % 1.0 px 1.1 px
3 pixels 5.83 % 6.37 % 1.0 px 1.1 px
4 pixels 4.99 % 5.31 % 1.0 px 1.1 px
5 pixels 3.90 % 4.13 % 1.0 px 1.1 px
This table as LaTeX





Test Image 18

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.45 % 5.88 % 0.6 px 0.6 px
3 pixels 4.19 % 4.45 % 0.6 px 0.6 px
4 pixels 3.33 % 3.47 % 0.6 px 0.6 px
5 pixels 2.54 % 2.55 % 0.6 px 0.6 px
This table as LaTeX





Test Image 19

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 2.58 % 3.55 % 0.7 px 0.7 px
3 pixels 1.87 % 2.39 % 0.7 px 0.7 px
4 pixels 1.56 % 1.75 % 0.7 px 0.7 px
5 pixels 1.40 % 1.39 % 0.7 px 0.7 px
This table as LaTeX







eXTReMe Tracker