Method

Camera-LiDAR Semantic and Geometric Fusion for 3D Object Detection [SGFusion]


Submitted on 25 Jun. 2022 05:03 by
Chen Hua (Fudan University)

Running time:0.06 s
Environment:1 core @ 2.5 Ghz (C/C++)

Method Description:
Camera and lidar are considered as important
sensor to achieve higher-level autonomous driving.
And the complementary information provided by
these sensors offer more opportunities for
improving performance. However, it is difficulty
to fuse them because of different representation
of both. In this work, we propose a novel fusion
framework SGFusion, which fuse the image and point
clouds at semantic and geometric level. The
SGFusion framework is divided in sequence into two
stages: semantic fusion stage and geometric fusion
stage. First, the point clouds are painted with
the object-level semantic information obtained
from an 2D object detector on the semantic fusion
stage . At the same time, the output candidates
of 2D object detector will be saved. Then, the
painted point clouds fed to one LiDAR-based
detector for obtaining high-quality 3D detection
candidates. Finally, on the geometric fusion
stage, these 3D detection candidates and the 2D
detection candidates just saved are combin
Parameters:
alpha=0.2
Latex Bibtex:
\inproceedings{...}

Detailed Results

Object detection and orientation estimation results. Results for object detection are given in terms of average precision (AP) and results for joint object detection and orientation estimation are provided in terms of average orientation similarity (AOS).


Benchmark Easy Moderate Hard
Car (Detection) 96.57 % 95.67 % 92.69 %
Car (Orientation) 96.54 % 95.44 % 92.29 %
Car (3D Detection) 91.13 % 82.64 % 77.53 %
Car (Bird's Eye View) 94.76 % 91.11 % 86.27 %
This table as LaTeX


2D object detection results.
This figure as: png eps pdf txt gnuplot



Orientation estimation results.
This figure as: png eps pdf txt gnuplot



3D object detection results.
This figure as: png eps pdf txt gnuplot



Bird's eye view results.
This figure as: png eps pdf txt gnuplot




eXTReMe Tracker