SENSOR FUSION OF CAMERA AND MMW RADAR BASED ON MACHINE LEARNING FOR VEHICLES

Yi Horng Lai, Yu Wen Chen, Jau Woei Perng*

*此作品的通信作者

研究成果: Article同行評審

5 引文 斯高帕斯(Scopus)

摘要

This study develops a forward collision warning system for vehicles based on sensor fusion of a camera and a millimeter wave radar. The proposed system has a parallel architecture. The algorithm of the millimeter wave radar subsystem includes density-based spatial clustering of applications with noise, particle filter, and multi-objective decision-making algorithms. The image subsystem uses the You Only Look Once v3 network and a Kalman filter to detect and track four types of objects (i.e., cars, motorcycles, bikes, and pedestrians). All radar objects are projected onto the image coordinates using a radial basis function neural network. Only the objects inside the region of interest of the on-road lane are tracked by the sensor fusion mechanism. The proposed system is evaluated in four types of weather scenarios: daytime, nighttime, rainy daytime, and rainy nighttime. The experimental results validate that the fusion strategy can effectively compensate any single-sensor failure. In the four scenarios, the average detection rate of the sensor fusion reaches 98.7%, which is higher than those of the single-sensor systems.

原文English
頁(從 - 到)271-287
頁數17
期刊International Journal of Innovative Computing, Information and Control
18
發行號1
DOIs
出版狀態Published - 2月 2022

指紋

深入研究「SENSOR FUSION OF CAMERA AND MMW RADAR BASED ON MACHINE LEARNING FOR VEHICLES」主題。共同形成了獨特的指紋。

引用此