-
公开(公告)号:US12210344B2
公开(公告)日:2025-01-28
申请号:US18513119
申请日:2023-11-17
Applicant: Aurora Operations, Inc.
Inventor: Raquel Urtasun , Mengye Ren , Andrei Pokrovsky , Bin Yang
IPC: G05D1/00 , G01S17/86 , G01S17/89 , G01S17/931
Abstract: The present disclosure provides systems and methods that apply neural networks such as, for example, convolutional neural networks, to sparse imagery in an improved manner. For example, the systems and methods of the present disclosure can be included in or otherwise leveraged by an autonomous vehicle. In one example, a computing system can extract one or more relevant portions from imagery, where the relevant portions are less than an entirety of the imagery. The computing system can provide the relevant portions of the imagery to a machine-learned convolutional neural network and receive at least one prediction from the machine-learned convolutional neural network based at least in part on the one or more relevant portions of the imagery. Thus, the computing system can skip performing convolutions over regions of the imagery where the imagery is sparse and/or regions of the imagery that are not relevant to the prediction being sought.
-
2.
公开(公告)号:US20240427022A1
公开(公告)日:2024-12-26
申请号:US18672986
申请日:2024-05-23
Applicant: Aurora Operations, Inc.
Inventor: Raquel Urtasun , Min Bai , Shenlong Wang
IPC: G01S17/931 , G06T7/10 , G06T7/70 , G06T17/00 , G06T17/10 , G06V10/26 , G06V10/80 , G06V20/56 , G06V20/58
Abstract: Systems and methods for identifying travel way features in real time are provided. A method can include receiving two-dimensional and three-dimensional data associated with the surrounding environment of a vehicle. The method can include providing the two-dimensional data as one or more input into a machine-learned segmentation model to output a two-dimensional segmentation. The method can include fusing the two-dimensional segmentation with the three-dimensional data to generate a three-dimensional segmentation. The method can include storing the three-dimensional segmentation in a classification database with data indicative of one or more previously generated three-dimensional segmentations. The method can include providing one or more datapoint sets from the classification database as one or more inputs into a machine-learned enhancing model to obtain an enhanced three-dimensional segmentation. And, the method can include identifying one or more travel way features based at least in part on the enhanced three-dimensional segmentation.
-
公开(公告)号:US20240367688A1
公开(公告)日:2024-11-07
申请号:US18658674
申请日:2024-05-08
Applicant: Aurora Operations, Inc.
Inventor: Alexander Yuhao Cui , Abbas Sadat , Sergio Casas , Renjie Liao , Raquel Urtasun
Abstract: Systems and methods are disclosed for motion forecasting and planning for autonomous vehicles. For example, a plurality of future traffic scenarios are determined by modeling a joint distribution of actor trajectories for a plurality of actors, as opposed to an approach that models actors individually. As another example, a diversity objective is evaluated that rewards sampling of the future traffic scenarios that require distinct reactions from the autonomous vehicle. An estimated probability for the plurality of future traffic scenarios can be determined and used to generate a contingency plan for motion of the autonomous vehicle. The contingency plan can include at least one initial short-term trajectory intended for immediate action of the AV and a plurality of subsequent long-term trajectories associated with the plurality of future traffic scenarios.
-
公开(公告)号:US20250123620A1
公开(公告)日:2025-04-17
申请号:US18990684
申请日:2024-12-20
Applicant: Aurora Operations, Inc.
Inventor: Raquel Urtasun , Mengye Ren , Andrei Pokrovsky , Bin Yang
IPC: G05D1/00 , G01S17/86 , G01S17/89 , G01S17/931
Abstract: The present disclosure provides systems and methods that apply neural networks such as, for example, convolutional neural networks, to sparse imagery in an improved manner. For example, the systems and methods of the present disclosure can be included in or otherwise leveraged by an autonomous vehicle. In one example, a computing system can extract one or more relevant portions from imagery, where the relevant portions are less than an entirety of the imagery. The computing system can provide the relevant portions of the imagery to a machine-learned convolutional neural network and receive at least one prediction from the machine-learned convolutional neural network based at least in part on the one or more relevant portions of the imagery. Thus, the computing system can skip performing convolutions over regions of the imagery where the imagery is sparse and/or regions of the imagery that are not relevant to the prediction being sought.
-
公开(公告)号:US12223705B2
公开(公告)日:2025-02-11
申请号:US18299970
申请日:2023-04-13
Applicant: Aurora Operations, Inc.
Inventor: Chris Jia-Han Zhang , Wenjie Luo , Raquel Urtasun
IPC: G06V10/82 , G01S7/48 , G06T3/06 , G06V10/764 , G06V10/776 , G06V20/10 , G06V20/40 , G06V20/56 , G06V20/64 , G01S17/89
Abstract: Systems and methods for performing semantic segmentation of three-dimensional data are provided. In one example embodiment, a computing system can be configured to obtain sensor data including three-dimensional data associated with an environment. The three-dimensional data can include a plurality of points and can be associated with one or more times. The computing system can be configured to determine data indicative of a two-dimensional voxel representation associated with the environment based at least in part on the three-dimensional data. The computing system can be configured to determine a classification for each point of the plurality of points within the three-dimensional data based at least in part on the two-dimensional voxel representation associated with the environment and a machine-learned semantic segmentation model. The computing system can be configured to initiate one or more actions based at least in part on the per-point classifications.
-
6.
公开(公告)号:US12214801B2
公开(公告)日:2025-02-04
申请号:US17528549
申请日:2021-11-17
Applicant: Aurora Operations, Inc.
Inventor: Jingkang Wang , Ava Alison Pun , Xuanyuan Tu , Mengye Ren , Abbas Sadat , Sergio Casas , Sivabalan Manivasagam , Raquel Urtasun
Abstract: Techniques for generating testing data for an autonomous vehicle (AV) are described herein. A system can obtain sensor data descriptive of a traffic scenario. The traffic scenario can include a subject vehicle and actors in an environment. Additionally, the system can generate a perturbed trajectory for a first actor in the environment based on perturbation values. Moreover, the system can generate simulated sensor data. The simulated sensor data can include data descriptive of the perturbed trajectory for the first actor in the environment. Furthermore, the system can provide the simulated sensor data as input to an AV control system. The AV control system can be configured to process the simulated sensor data to generate an updated trajectory for the subject vehicle in the environment. Subsequently, the system can evaluate an adversarial loss function based on the updated trajectory for the subject vehicle to generate an adversarial loss value.
-
公开(公告)号:US20240391504A1
公开(公告)日:2024-11-28
申请号:US18676029
申请日:2024-05-28
Applicant: Aurora Operations, Inc.
Inventor: Shun Da Suo , Sebastián David Regalado Lozano , Sergio Casas , Raquel Urtasun
IPC: B60W60/00 , G06F18/214 , G06N3/045 , G06V20/58
Abstract: Systems and methods for generating synthetic testing data for autonomous vehicles are provided. A computing system can obtain map data descriptive of an environment and object data descriptive of a plurality of objects within the environment. The computing system can generate context data including deep or latent features extracted from the map and object data by one or more machine-learned models. The computing system can process the context data with a machine-learned model to generate synthetic motion prediction for the plurality of objects. The synthetic motion predictions for the objects can include one or more synthesized states for the objects at future times. The computing system can provide, as an output, synthetic testing data that includes the plurality of synthetic motion predictions for the objects. The synthetic testing data can be used to test an autonomous vehicle control system in a simulation.
-
公开(公告)号:US12127085B2
公开(公告)日:2024-10-22
申请号:US17150998
申请日:2021-01-15
Applicant: Aurora Operations, Inc.
Inventor: Nicholas Baskar Vadivelu , Mengye Ren , Xuanyuan Tu , Raquel Urtasun , Jingkang Wang
CPC classification number: H04W4/46 , B60W60/00272 , B60W60/00276 , G05D1/0088 , G05D1/0274 , G06F18/2415 , G06N20/00 , G06V20/56
Abstract: Systems and methods for improved vehicle-to-vehicle communications are provided. A system can obtain sensor data depicting its surrounding environment and input the sensor data (or processed sensor data) to a machine-learned model to perceive its surrounding environment based on its location within the environment. The machine-learned model can generate an intermediate environmental representation that encodes features within the surrounding environment. The system can receive a number of different intermediate environmental representations and corresponding locations from various other systems, aggregate the representations based on the corresponding locations, and perceive its surrounding environment based on the aggregated representations. The system can determine relative poses between the each of the systems and an absolute pose for each system based on the representations. Each representation can be aggregated based on the relative or absolute poses of each system and weighted according to an estimated accuracy of the location corresponding to the representation.
-
9.
公开(公告)号:US12124269B2
公开(公告)日:2024-10-22
申请号:US17515923
申请日:2021-11-01
Applicant: Aurora Operations, Inc.
Inventor: Anqi Joyce Yang , Can Cui , Ioan Andrei Bârsan , Shenlong Wang , Raquel Urtasun
IPC: G05D1/00 , B60R1/27 , G01S17/894
CPC classification number: G05D1/0251 , B60R1/27 , G01S17/894 , G05D1/0212 , G05D1/0248 , B60R2300/303 , B60R2300/304
Abstract: Systems and methods for the simultaneous localization and mapping of autonomous vehicle systems are provided. A method includes receiving a plurality of input image frames from the plurality of asynchronous image devices triggered at different times to capture the plurality of input image frames. The method includes identifying reference image frame(s) corresponding to a respective input image frame by matching the field of view of the respective input image frame to the fields of view of the reference image frame(s). The method includes determining association(s) between the respective input image frame and three-dimensional map point(s) based on a comparison of the respective input image frame to the one or more reference image frames. The method includes generating an estimated pose for the autonomous vehicle the one or more three-dimensional map points. The method includes updating a continuous-time motion model of the autonomous vehicle based on the estimated pose.
-
公开(公告)号:US12282328B2
公开(公告)日:2025-04-22
申请号:US17150987
申请日:2021-01-15
Applicant: Aurora Operations, Inc.
Inventor: Raquel Urtasun , Bob Qingyuan Wei , Mengye Ren , Wenyuan Zeng , Ming Liang , Bin Yang
Abstract: Systems and methods for generating attention masks are provided. In particular, a computing system can access sensor data and map data for an area around an autonomous vehicle. The computing system can generate a voxel grid representation of the sensor data and map data. The computing system can generate an attention mask based on the voxel grid representation. The computing system can generate, by using the voxel grid representation and the attention mask as input to a machine-learned model, an attention weighted feature map. The computing system can determine using the attention weighted feature map, a planning cost volume for an area around the autonomous vehicle. The computing system can select a trajectory for the autonomous vehicle based, at least in part, on the planning cost volume.
-
-
-
-
-
-
-
-
-