Method

3D Object Detection with Geometric Shapes and 2D Labels Only [ODGS]


Submitted on 15 Sep. 2023 20:05 by
Saad Lahlali (CEA)

Running time:0.1 s
Environment:1 core @ 2.5 Ghz (C/C++)

Method Description:
we propose a weakly supervised 3D detection model that relies solely on readily available \emph{2D} bounding box annotations from images, along with prior information on object size, eliminating the need for costly 3D annotations.
Nevertheless, supervision with 2D bounding-boxes only introduces inherent projection ambiguities in determining the actual 3D object poses.
To this end, for each class, we build a corresponding synthetic class made of basic geometric shapes (ex: 3D boxes) that reproduce the coarse dimensions of their associated real class.
Furthermore, contrary to traditional 3D losses, we notice that 2D supervision losses do not verify range-invariance properties.
For this reason, we introduce a novel range-normalized 2D loss
Parameters:
\alpha=0.2
Latex Bibtex:

Detailed Results

Object detection and orientation estimation results. Results for object detection are given in terms of average precision (AP) and results for joint object detection and orientation estimation are provided in terms of average orientation similarity (AOS).


Benchmark Easy Moderate Hard
Car (Detection) 95.79 % 90.20 % 85.23 %
Car (Orientation) 80.49 % 76.22 % 71.64 %
Car (3D Detection) 78.39 % 70.85 % 64.81 %
Car (Bird's Eye View) 89.59 % 84.82 % 78.20 %
Pedestrian (Detection) 46.01 % 37.12 % 34.56 %
Pedestrian (Orientation) 44.76 % 35.75 % 33.14 %
Pedestrian (3D Detection) 34.09 % 27.87 % 25.62 %
Pedestrian (Bird's Eye View) 37.54 % 31.23 % 28.97 %
This table as LaTeX


2D object detection results.
This figure as: png eps txt gnuplot



Orientation estimation results.
This figure as: png eps txt gnuplot



3D object detection results.
This figure as: png eps txt gnuplot



Bird's eye view results.
This figure as: png eps txt gnuplot



2D object detection results.
This figure as: png eps txt gnuplot



Orientation estimation results.
This figure as: png eps txt gnuplot



3D object detection results.
This figure as: png eps txt gnuplot



Bird's eye view results.
This figure as: png eps txt gnuplot




eXTReMe Tracker