Method

Virtual Sparse Convolution for Multimodal 3D Object Detection [VirConv-S]
https://github.com/hailanyi/VirConv

Submitted on 9 Nov. 2022 03:10 by
hai wu (xiamen university)

Running time:0.09 s
Environment:1 core @ 2.5 Ghz (C/C++)

Method Description:
We proposes a fast yet effective backbone, termed
VirConvNet, based on a new operator VirConv
(Virtual Sparse Convolution), for virtual-point-
based 3D object detection. VirConv consists of two
key designs: (1) StVD (Stochastic Voxel Discard)
and (2) NRConv (Noise-Resistant Submanifold
Convolution). StVD alleviates the computation
problem by discarding large amounts of nearby
redundant voxels. NRConv tackles the noise problem
by encoding voxel features in both 2D image and 3D
LiDAR space. By integrating VirConv, we first
develop an efficient pipeline VirConv-L based on
an early fusion design. Then, we build a high-
precision pipeline VirConv-T based on a
transformed refinement scheme. Finally, we develop
a semi-supervised pipeline VirConv-S based on a
pseudo-label framework.
Parameters:
TBD
Latex Bibtex:
@inproceedings{VirConv,
title={Virtual Sparse Convolution for Multimodal
3D Object Detection},
author={Wu, Hai and Wen,Chenglu and Shi,
Shaoshuai and Wang, Cheng},
booktitle={CVPR},
year={2023}
}

Detailed Results

Object detection and orientation estimation results. Results for object detection are given in terms of average precision (AP) and results for joint object detection and orientation estimation are provided in terms of average orientation similarity (AOS).


Benchmark Easy Moderate Hard
Car (Detection) 98.00 % 97.27 % 94.53 %
Car (Orientation) 96.99 % 96.46 % 93.74 %
Car (3D Detection) 92.48 % 87.20 % 82.45 %
Car (Bird's Eye View) 95.99 % 93.52 % 90.38 %
This table as LaTeX


2D object detection results.
This figure as: png eps txt gnuplot



Orientation estimation results.
This figure as: png eps txt gnuplot



3D object detection results.
This figure as: png eps txt gnuplot



Bird's eye view results.
This figure as: png eps txt gnuplot




eXTReMe Tracker