References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: UniMODE: Unified Monocular 3D Object Detection
(Submitted on 28 Feb 2024 (v1), last revised 9 May 2024 (this version, v3))
Abstract: Realizing unified monocular 3D object detection, including both indoor and outdoor scenes, holds great importance in applications like robot navigation. However, involving various scenarios of data to train models poses challenges due to their significantly different characteristics, e.g., diverse geometry properties and heterogeneous domain distributions. To address these challenges, we build a detector based on the bird's-eye-view (BEV) detection paradigm, where the explicit feature projection is beneficial to addressing the geometry learning ambiguity when employing multiple scenarios of data to train detectors. Then, we split the classical BEV detection architecture into two stages and propose an uneven BEV grid design to handle the convergence instability caused by the aforementioned challenges. Moreover, we develop a sparse BEV feature projection strategy to reduce computational cost and a unified domain alignment method to handle heterogeneous domains. Combining these techniques, a unified detector UniMODE is derived, which surpasses the previous state-of-the-art on the challenging Omni3D dataset (a large-scale dataset including both indoor and outdoor scenes) by 4.9% AP_3D, revealing the first successful generalization of a BEV detector to unified 3D object detection.
Submission history
From: Zhuoling Li [view email][v1] Wed, 28 Feb 2024 18:59:31 GMT (2621kb,D)
[v2] Fri, 26 Apr 2024 07:38:28 GMT (2621kb,D)
[v3] Thu, 9 May 2024 04:04:50 GMT (2621kb,D)
Link back to: arXiv, form interface, contact.