C2L3-Fusion: An Integrated 3D Object Detection Method for Autonomous Vehicles
Binh Ngo, Long Thanh Ngo, Anh Vu Phi, Trung Thị Hoa Trang Nguyen, Andy Nguyễn, Jason Brown, Asanka G. Perera
Abstract
Accurate 3D object detection is crucial for autonomous vehicles (AVs) to navigate safely in complex environments. This paper introduces a novel fusion framework that integrates Camera image-based 2D object detection using YOLOv8 and LiDAR data-based 3D object detection using PointPillars, hence named C2L3-Fusion. Unlike conventional fusion approaches, which often struggle with feature misalignment, C2L3-Fusion enhances spatial consistency and multi-level feature aggregation, significantly improving detection accuracy. Our method outperforms state-of-the-art approaches such as YoPi-CLOCs Fusion Network, standalone YOLOv8, and standalone PointPillars, achieving mean Average Precision (mAP) scores of 89.91% (easy), 79.26% (moderate), and 78.01% (hard) on the KITTI dataset. Successfully implemented on the Nvidia Jetson AGX Xavier embedded platform, C2L3-Fusion maintains real-time performance while enhancing robustness, making it highly suitable for self-driving vehicles. This paper details the methodology, mathematical formulations, algorithmic advancements, and real-world testing of C2L3-Fusion, offering a comprehensive solution for 3D object detection in autonomous navigation.