Method

EPNet: Enhancing Point Features with Image Semantics for 3D Object Detection [EPNet]
https://github.com/happinesslz/EPNet

Submitted on 1 Nov. 2019 13:22 by
Zhe Liu (Huazhong University of Science and Technology)

Running time:0.1 s
Environment:1 core @ 2.5 Ghz (Python + C/C++)

Method Description:
In this paper, we aim at addressing two critical issues in the 3D detection task, including the exploitation of multiple sensors~(namely LiDAR point cloud and camera image), as well as the inconsistency between the localization and classification confidence. To this end, we propose a novel fusion module to enhance the point features with semantic image features in a point-wise manner without any image annotations. Besides, a consistency enforcing loss is employed to explicitly encourage the consistency of both the localization and classification confidence. We design an end-to-end learnable framework named EPNet to integrate these two components. Extensive experiments on the KITTI and SUN-RGBD datasets demonstrate the superiority of EPNet over the state-of-the-art methods.
\url{https://github.com/happinesslz/EPNet}.
Parameters:
TBA
Latex Bibtex:
@misc{huang2020epnet,
title={EPNet: Enhancing Point Features with Image Semantics for 3D Object Detection},
author={Tengteng Huang and Zhe Liu and Xiwu Chen and Xiang Bai},
year={ECCV 2020},
eprint={2007.08856},
archivePrefix={arXiv},
primaryClass={cs.CV}
}

Detailed Results

Object detection and orientation estimation results. Results for object detection are given in terms of average precision (AP) and results for joint object detection and orientation estimation are provided in terms of average orientation similarity (AOS).


Benchmark Easy Moderate Hard
Car (Detection) 96.15 % 94.44 % 89.99 %
Car (Orientation) 96.13 % 94.22 % 89.68 %
Car (3D Detection) 89.81 % 79.28 % 74.59 %
Car (Bird's Eye View) 94.22 % 88.47 % 83.69 %
This table as LaTeX


2D object detection results.
This figure as: png eps pdf txt gnuplot



Orientation estimation results.
This figure as: png eps pdf txt gnuplot



3D object detection results.
This figure as: png eps pdf txt gnuplot



Bird's eye view results.
This figure as: png eps pdf txt gnuplot




eXTReMe Tracker