Invention Grant
- Patent Title: All-weather target detection method based on vision and millimeter wave fusion
-
Application No.: US17543777Application Date: 2021-12-07
-
Publication No.: US11380089B1Publication Date: 2022-07-05
- Inventor: Xinyu Zhang , Jun Li , Zhiwei Li , Huaping Liu , Xingang Wu
- Applicant: Tsinghua University
- Applicant Address: CN Beijing
- Assignee: Tsinghua University
- Current Assignee: Tsinghua University
- Current Assignee Address: CN Beijing
- Agency: Bayramoglu Law Offices LLC
- Priority: CN202011595732.1 20201229
- Main IPC: G06V10/80
- IPC: G06V10/80 ; G06V10/77 ; G06V10/774 ; G01S7/41 ; G06V10/82 ; G01S13/86 ; G01S13/931 ; G01S13/89 ; G06V20/56

Abstract:
An all-weather target detection method based on a vision and millimeter wave fusion includes: simultaneously acquiring continuous image data and point cloud data using two types of sensors of a vehicle-mounted camera and a millimeter wave radar; pre-processing the image data and point cloud data; fusing the pre-processed image data and point cloud data by using a pre-established fusion model, and outputting a fused feature map; and inputting the fused feature map into a YOLOv5 detection network for detection, and outputting a target detection result by non-maximum suppression. The method fully fuses millimeter wave radar echo intensity and distance information with the vehicle-mounted camera images. It analyzes different features of a millimeter wave radar point cloud and fuses the features with image information by using different feature extraction structures and ways, so that the advantages of the two types of sensor data complement each other.
Public/Granted literature
- US20220207868A1 ALL-WEATHER TARGET DETECTION METHOD BASED ON VISION AND MILLIMETER WAVE FUSION Public/Granted day:2022-06-30
Information query