-
公开(公告)号:US11450120B2
公开(公告)日:2022-09-20
申请号:US16923823
申请日:2020-07-08
Applicant: Waymo LLC
Inventor: Jonathon Shlens , Patrick An Phu Nguyen , Benjamin James Caine , Jiquan Ngiam , Wei Han , Brandon Chauloon Yang , Yuning Chai , Pei Sun , Yin Zhou , Xi Yi , Ouais Alsharif , Zhifeng Chen , Vijay Vasudevan
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data representing a sensor measurement of a scene captured by one or more sensors to generate an object detection output that identifies locations of one or more objects in the scene. When deployed within an on-board system of a vehicle, the object detection output that is generated can be used to make autonomous driving decisions for the vehicle with enhanced accuracy.
-
公开(公告)号:US11164363B2
公开(公告)日:2021-11-02
申请号:US16924080
申请日:2020-07-08
Applicant: Waymo LLC
Inventor: Yin Zhou , Pei Sun , Yu Zhang , Dragomir Anguelov , Jiyang Gao , Yu Ouyang , Zijian Guo , Jiquan Ngiam , Vijay Vasudevan
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data using dynamic voxelization. When deployed within an on-board system of a vehicle, processing the point cloud data using dynamic voxelization can be used to make autonomous driving decisions for the vehicle with enhanced accuracy, for example by combining representations of point cloud data characterizing a scene from multiple views of the scene.
-
公开(公告)号:US20250166366A1
公开(公告)日:2025-05-22
申请号:US18950830
申请日:2024-11-18
Applicant: Waymo LLC
Inventor: Yin Zhou , Jingwei Ji , Zhenpei Yang , Nathan Paul Harada , Kan Chen , Rami Al-Rfou
Abstract: Methods, systems, and apparatus for predicting future trajectories of agents in an environment. In one aspect, a system comprises one or more computers configured to receive sensor data of an environment having one or more agents. The system decomposes the sensor data into a plurality of scene elements in the environment, and the system generates multiple tokens including a respective token for each respective scene element of the multiple scene elements in the environment. The system processes the multiple tokens using a decoder model to generate a respective predicted trajectory for the one or more agents in the environment.
-
公开(公告)号:US20250155578A1
公开(公告)日:2025-05-15
申请号:US18506925
申请日:2023-11-10
Applicant: Waymo LLC
Inventor: Yingwei Li , Ruizhongtai Qi , Yin Zhou , Chenxi Liu , Dragomir Anguelov
IPC: G01S17/931
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing point cloud data to generate an output. In one aspect, a method includes obtaining a sequence of multiple point cloud frames, wherein the sequence of multiple point cloud frames comprise a target point cloud frame and a plurality of other point cloud frames; processing one or more other point cloud frames to generate one or more respective predicted locations at the target timestamp for each of one or more objects detected in the one or more other point cloud frames; generating, based on the respective predicted locations at the target timestamp for each of one or more objects, a synthetic point cloud frame that is associated with the target timestamp; and processing at least the synthetic point cloud frame to generate one or more outputs that characterize an environment at the target timestamp.
-
公开(公告)号:US20250037303A1
公开(公告)日:2025-01-30
申请号:US18614254
申请日:2024-03-22
Applicant: Waymo LLC
Inventor: Jingxiao Zheng , Xinwei Shi , Alexander Gorban , Junhua Mao , Andre Liang Cornman , Yang Song , Ting Liu , Ruizhongtai Qi , Yin Zhou , Congcong Li , Dragomir Anguelov
IPC: G06T7/73 , G06F18/214 , G06F18/25 , G06V20/58
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for estimating a 3-D pose of an object of interest from image and point cloud data. In one aspect, a method includes obtaining an image of an environment; obtaining a point cloud of a three-dimensional region of the environment; generating a fused representation of the image and the point cloud; and processing the fused representation using a pose estimation neural network and in accordance with current values of a plurality of pose estimation network parameters to generate a pose estimation network output that specifies, for each of multiple keypoints, a respective estimated position in the three-dimensional region of the environment.
-
公开(公告)号:US12073575B2
公开(公告)日:2024-08-27
申请号:US17407795
申请日:2021-08-20
Applicant: Waymo LLC
Inventor: Ruizhongtai Qi , Yin Zhou , Dragomir Anguelov , Pei Sun
CPC classification number: G06T7/521 , G06T7/20 , G06T2207/10028 , G06T2207/20084
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing three-dimensional auto-labeling on sensor data. The system obtains a sensor data segment that includes a temporal sequence of three-dimensional point clouds generated from sensor readings of an environment by one or more sensors. The system identifies, from the sensor data segment, (i) a plurality of object tracks that each corresponds to a different object in the environment and (ii) for each object track, respective initial three-dimensional regions in each of one or more of the point clouds in which the corresponding object appears. The system generates, for each object track, extracted object track data that includes at least the points in the respective initial three-dimensional regions for the object track. The system further generates, for each object track and from the extracted object track data for the object track, an auto labeling output that defines respective refined three-dimensional regions in each of the one or more point clouds.
-
公开(公告)号:US11295517B2
公开(公告)日:2022-04-05
申请号:US17099589
申请日:2020-11-16
Applicant: Waymo LLC
Inventor: Yin Zhou , Dragomir Anguelov , Zhangjie Cao
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating realistic full-scene point clouds. One of the methods includes obtaining an initial scene point cloud characterizing an initial scene in an environment; obtaining, for each of one or more objects, an object point cloud that characterizes the object; and processing a first input comprising the initial scene point cloud and the one or more object point clouds using a first neural network that is configured to process the first input to generate a final scene point cloud that characterizes a transformed scene that has the one or more objects added to the initial scene.
-
公开(公告)号:US20210012089A1
公开(公告)日:2021-01-14
申请号:US16923823
申请日:2020-07-08
Applicant: Waymo LLC
Inventor: Jonathon Shlens , Patrick An Phu Nguyen , Benjamin James Caine , Jiquan Ngiam , Wei Han , Brandon Chauloon Yang , Yuning Chai , Pei Sun , Yin Zhou , Xi Yi , Ouais Alsharif , Zhifeng Chen , Vijay Vasudevan
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data representing a sensor measurement of a scene captured by one or more sensors to generate an object detection output that identifies locations of one or more objects in the scene. When deployed within an on-board system of a vehicle, the object detection output that is generated can be used to make autonomous driving decisions for the vehicle with enhanced accuracy.
-
公开(公告)号:US11922569B2
公开(公告)日:2024-03-05
申请号:US17713108
申请日:2022-04-04
Applicant: Waymo LLC
Inventor: Yin Zhou , Dragomir Anguelov , Zhangjie Cao
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating realistic full-scene point clouds. One of the methods includes obtaining an initial scene point cloud characterizing an initial scene in an environment; obtaining, for each of one or more objects, an object point cloud that characterizes the object; and processing a first input comprising the initial scene point cloud and the one or more object point clouds using a first neural network that is configured to process the first input to generate a final scene point cloud that characterizes a transformed scene that has the one or more objects added to the initial scene.
-
公开(公告)号:US20240062386A1
公开(公告)日:2024-02-22
申请号:US18235292
申请日:2023-08-17
Applicant: Waymo LLC
Inventor: Ruizhongtai Qi , Yurong You , Yingwei Li , Chenxi Liu , Yin Zhou
CPC classification number: G06T7/246 , G06T7/215 , G06T2207/10016 , G06T2207/10028 , G06T2207/20084 , G06T2207/30252
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing sensor data, e.g., laser sensor data, using neural networks. One of the methods includes obtaining a temporal sequence of multiple three-dimensional point clouds generated from sensor readings of an environment collected by one or more sensors within a given time period, each three-dimensional point cloud comprising a respective plurality of points in a first coordinate system; processing, using a feature extraction neural network, an input that comprises data derived from the temporal sequence of multiple three-dimensional point clouds to generate a feature embedding; receiving a query that specifies one time point within the given time period; and generating, from the feature embedding and conditioned on the query, one or more outputs that characterize one or more objects in the environment at the time point specified in the received query.
-
-
-
-
-
-
-
-
-