文章基本信息

标题：A Novel Regional Fusion Network for 3D Object Detection based on RGB Images and Point Clouds
本地全文：下载
作者：Hung-Hao Chen ; Chia-Hung Wang ; Hsueh-Wei Chen 等
期刊名称：Computer Science & Information Technology
电子版ISSN：2231-5403
出版年度：2021
卷号：11
期号：18
语种：English
出版社：Academy & Industry Research Collaboration Center (AIRCC)
摘要：The current fusion-based methods transform LiDAR data into bird’s eye view (BEV) representations or 3D voxel, leading to information loss and heavy computation cost of 3D convolution. In contrast, we directly consume raw point clouds and perform fusion between two modalities. We employ the concept of region proposal network to generate proposals from two streams, respectively. In order to make two sensors compensate the weakness of each other, we utilize the calibration parameters to project proposals from one stream onto the other. With the proposed multi-scale feature aggregation module, we are able to combine the extracted regionof-interest-level (RoI-level) features of RGB stream from different receptive fields, resulting in fertilizing feature richness. Experiments on KITTI dataset show that our proposed network outperforms other fusion-based methods with meaningful improvements as compared to 3D object detection methods under challenging setting.
关键词：Machine Learning;3D Object Detection;Data Fusion;Autonomous Driving