## Method

Optical Flow with Geometric Occlusion Estimation and Fusion of Multiple Frames [mv] [TF+OFM]
http://www.seas.upenn.edu/~kenry/

Submitted on 9 Jul. 2014 17:27 by
Ryan Kennedy (University of Pennsylvania)

 Running time: 350 s Environment: 1 cores @ 2.5 Ghz (Matlab + C/C++)

 Method Description: Uses a triangulation of the image domain and estimates flow for each triangle. Occlusions are estimated by determining the overlap of triangles. Multiple "intertial estimates" of optical flow are found by assuming linear flow over a short period of time, and these results are fused using a classifier. Parameters: Latex Bibtex: @inproceedings{kennedy2015optical,title={Optical Flow with Geometric Occlusion Estimation and Fusion of Multiple Frames},author={Kennedy, Ryan and Taylor, C.J.},booktitle={EMMCVPR},year={2015}}

## Detailed Results

This page provides detailed results for the method(s) selected. For each of the first 20 test images, the number of erroneous pixels at all thresholds is depicted in the table. Underneath, the left input image, the disparity / end-point error map and the estimated (and interpolated) disparity / optical flow map are shown. The error map scales linearly between 0 (black) and >=5 (white) pixels error. Red denotes all occluded pixels, falling outside the image boundaries. The false color map is scaled to the largest ground truth disparity / flow value.

## Test Set Average

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 13.12 % 21.85 % 2.0 px 5.0 px 3 pixels 10.22 % 18.46 % 2.0 px 5.0 px 4 pixels 8.59 % 16.40 % 2.0 px 5.0 px 5 pixels 7.45 % 14.90 % 2.0 px 5.0 px
This table as LaTeX

## Test Image 0

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 12.50 % 21.10 % 1.2 px 2.6 px 3 pixels 8.83 % 16.18 % 1.2 px 2.6 px 4 pixels 6.81 % 13.22 % 1.2 px 2.6 px 5 pixels 5.50 % 11.31 % 1.2 px 2.6 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 1

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 7.44 % 15.73 % 0.9 px 1.8 px 3 pixels 5.28 % 12.13 % 0.9 px 1.8 px 4 pixels 4.02 % 10.01 % 0.9 px 1.8 px 5 pixels 3.08 % 8.46 % 0.9 px 1.8 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 2

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 10.99 % 21.52 % 1.1 px 3.3 px 3 pixels 7.84 % 17.48 % 1.1 px 3.3 px 4 pixels 6.07 % 14.89 % 1.1 px 3.3 px 5 pixels 4.77 % 13.11 % 1.1 px 3.3 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 3

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 18.88 % 29.66 % 2.4 px 5.4 px 3 pixels 14.31 % 24.79 % 2.4 px 5.4 px 4 pixels 11.31 % 21.58 % 2.4 px 5.4 px 5 pixels 9.10 % 19.09 % 2.4 px 5.4 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 4

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 2.58 % 5.23 % 0.5 px 0.7 px 3 pixels 1.22 % 2.70 % 0.5 px 0.7 px 4 pixels 0.85 % 1.96 % 0.5 px 0.7 px 5 pixels 0.68 % 1.56 % 0.5 px 0.7 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 5

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 21.58 % 31.67 % 4.3 px 8.1 px 3 pixels 19.59 % 28.82 % 4.3 px 8.1 px 4 pixels 18.37 % 26.84 % 4.3 px 8.1 px 5 pixels 17.43 % 25.32 % 4.3 px 8.1 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 6

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 9.61 % 18.22 % 1.0 px 2.2 px 3 pixels 6.35 % 14.02 % 1.0 px 2.2 px 4 pixels 5.04 % 11.73 % 1.0 px 2.2 px 5 pixels 4.14 % 10.03 % 1.0 px 2.2 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 7

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 14.78 % 26.22 % 2.7 px 7.5 px 3 pixels 11.59 % 22.39 % 2.7 px 7.5 px 4 pixels 9.64 % 19.87 % 2.7 px 7.5 px 5 pixels 8.33 % 17.99 % 2.7 px 7.5 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 8

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 17.56 % 30.75 % 3.1 px 11.5 px 3 pixels 14.82 % 27.79 % 3.1 px 11.5 px 4 pixels 13.19 % 25.87 % 3.1 px 11.5 px 5 pixels 11.89 % 24.31 % 3.1 px 11.5 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 9

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 20.03 % 29.70 % 2.2 px 5.5 px 3 pixels 15.07 % 24.02 % 2.2 px 5.5 px 4 pixels 11.65 % 20.01 % 2.2 px 5.5 px 5 pixels 9.33 % 17.19 % 2.2 px 5.5 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 10

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 13.56 % 27.16 % 1.7 px 7.7 px 3 pixels 9.51 % 22.73 % 1.7 px 7.7 px 4 pixels 7.40 % 20.10 % 1.7 px 7.7 px 5 pixels 6.14 % 18.51 % 1.7 px 7.7 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 11

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 10.00 % 21.85 % 1.3 px 4.3 px 3 pixels 6.23 % 17.53 % 1.3 px 4.3 px 4 pixels 4.33 % 14.70 % 1.3 px 4.3 px 5 pixels 3.40 % 12.42 % 1.3 px 4.3 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 12

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 16.69 % 28.70 % 2.2 px 6.3 px 3 pixels 13.18 % 25.00 % 2.2 px 6.3 px 4 pixels 10.63 % 22.11 % 2.2 px 6.3 px 5 pixels 8.77 % 19.94 % 2.2 px 6.3 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 13

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 12.76 % 20.47 % 1.7 px 4.1 px 3 pixels 10.25 % 17.54 % 1.7 px 4.1 px 4 pixels 8.77 % 15.86 % 1.7 px 4.1 px 5 pixels 7.81 % 14.65 % 1.7 px 4.1 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 14

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 17.38 % 29.83 % 3.7 px 10.4 px 3 pixels 14.65 % 26.80 % 3.7 px 10.4 px 4 pixels 12.95 % 24.66 % 3.7 px 10.4 px 5 pixels 11.75 % 22.96 % 3.7 px 10.4 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 15

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 16.70 % 30.62 % 1.6 px 8.0 px 3 pixels 10.81 % 25.03 % 1.6 px 8.0 px 4 pixels 8.43 % 22.41 % 1.6 px 8.0 px 5 pixels 6.63 % 20.26 % 1.6 px 8.0 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 16

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 2.82 % 9.25 % 0.6 px 2.4 px 3 pixels 1.60 % 7.72 % 0.6 px 2.4 px 4 pixels 1.17 % 7.18 % 0.6 px 2.4 px 5 pixels 0.89 % 6.79 % 0.6 px 2.4 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 17

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 11.79 % 21.25 % 1.4 px 4.4 px 3 pixels 8.87 % 17.00 % 1.4 px 4.4 px 4 pixels 7.19 % 14.14 % 1.4 px 4.4 px 5 pixels 6.06 % 12.08 % 1.4 px 4.4 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 18

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 1.61 % 7.14 % 0.5 px 2.1 px 3 pixels 1.03 % 6.14 % 0.5 px 2.1 px 4 pixels 0.73 % 5.51 % 0.5 px 2.1 px 5 pixels 0.50 % 5.03 % 0.5 px 2.1 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot

## Test Image 19

 Error Out-Noc Out-All Avg-Noc Avg-All 2 pixels 4.05 % 9.59 % 0.6 px 1.4 px 3 pixels 2.96 % 7.42 % 0.6 px 1.4 px 4 pixels 2.27 % 5.93 % 0.6 px 1.4 px 5 pixels 1.88 % 4.91 % 0.6 px 1.4 px
This table as LaTeX

This figure as: png eps pdf txt gnuplot