Method

Voxel-Dense Fusion [VDF]
[Anonymous Submission]

Submitted on 14 Apr. 2023 15:52 by
[Anonymous Submission]

Running time:0.03 s
Environment:GPU @ 2.5 Ghz (Python)

Method Description:
We propose Voxel-Dense Fusion (VDF), a 3D target
detection algorithm based on point cloud and image
fusion. The voxelised point cloud data is first
converted into a meaningful high-dimensional
feature representation through a voxel set
attention coding process. At the same time, a
region of interest (ROI) can be provided for the
dense point cloud branch.
The dense point cloud branch uses PointMLP, a
dense point cloud feature encoding scheme based on
neighbourhood feature aggregation, as the backbone
network to obtain the output features of the dense
point cloud branch.
To fuse the features from the voxel branch and the
dense point cloud branch, the fusion module
performs feature alignment using Region of
Interest Grid Pooling (ROI Grid Pool). Finally,
the aligned features are fed into the 3D voxel
Recursive Gated Convolution fusion network to
achieve an efficient fusion of the features from
both data sources.
Parameters:
Adam,lr=0.01,Experiments were conducted using an
NMS threshold of 0.8 to generate 128 object
suggestions with a positive and negative sample of
1:1. During testing, an NMS threshold of 0.1 was
used to remove redundant boxes after suggestion
refinement.
Latex Bibtex:

Detailed Results

Object detection and orientation estimation results. Results for object detection are given in terms of average precision (AP) and results for joint object detection and orientation estimation are provided in terms of average orientation similarity (AOS).


Benchmark Easy Moderate Hard
Car (Detection) 98.58 % 95.58 % 92.72 %
Car (Orientation) 98.55 % 95.37 % 92.41 %
Car (3D Detection) 91.39 % 84.25 % 78.96 %
Car (Bird's Eye View) 94.80 % 91.28 % 86.43 %
This table as LaTeX


2D object detection results.
This figure as: png eps txt gnuplot



Orientation estimation results.
This figure as: png eps txt gnuplot



3D object detection results.
This figure as: png eps txt gnuplot



Bird's eye view results.
This figure as: png eps txt gnuplot




eXTReMe Tracker