Automatic Annotation of Object Trajectories in Multiple Dimensions

    公开(公告)号:US20250002050A1

    公开(公告)日:2025-01-02

    申请号:US18883299

    申请日:2024-09-12

    Abstract: Techniques for improving the performance of an autonomous vehicle (AV) by automatically annotating objects surrounding the AV are described herein. A system can obtain sensor data from a sensor coupled to the AV and generate an initial object trajectory for an object using the sensor data. Additionally, the system can determine a fixed value for the object size of the object based on the initial object trajectory. Moreover, the system can generate an updated initial object trajectory, wherein the object size corresponds to the fixed value. Furthermore, the system can determine, based on the sensor data and the updated initial object trajectory, a refined object trajectory. Subsequently, the system can generate a multi-dimensional label for the object based on the refined object trajectory. A motion plan for controlling the AV can be generated based on the multi-dimensional label.

    LIDAR pixel with active polarization control

    公开(公告)号:US12181606B2

    公开(公告)日:2024-12-31

    申请号:US17870493

    申请日:2022-07-21

    Abstract: A light detection and ranging (LIDAR) pixel includes a splitter, a grating coupler, and a phase shifter. The grating coupler is configured to emit a transmit beam that is based on a combination of a first portion of light and a second portion of light received from a laser. One or more first interconnects and one or more second interconnects couple the splitter to the grating coupler. The phase shifter is coupled to the one or more first interconnects and configured to vary a phase of the first portion of the light relative to a phase of the second portion of the light.

    Visual language models for perception

    公开(公告)号:US12158762B1

    公开(公告)日:2024-12-03

    申请号:US18244770

    申请日:2023-09-11

    Abstract: A method is provided, that includes: receiving camera data from a perception system of an autonomous vehicle; and providing the camera data to a visual language model, where the visual language model includes a mapping of a corpus of images and a corpus of text to a common parameter space. The method further includes: receiving from the visual language model an output corresponding to one or more text tokens; accessing a configuration file comprising a plurality of text tokens representing a plurality of objects or events of interest to the autonomous vehicle; and identifying a respective object or event of interest in an environment of the autonomous vehicle by determining that a text token of the output matches a respective one of the plurality of text tokens in the configuration file. The autonomous vehicle can then be controlled based at least in part on the respective object or event of interest.

    Autonomous vehicle interface system with multiple interface devices featuring redundant vehicle commands

    公开(公告)号:US12157368B2

    公开(公告)日:2024-12-03

    申请号:US17686852

    申请日:2022-03-04

    Abstract: The present disclosure provides an autonomous vehicle and associated interface system that includes multiple vehicle interface computing devices that provide redundant vehicle commands. As one example, an autonomous vehicle interface system can include a first vehicle interface computing device located within the autonomous vehicle and physically coupled to the autonomous vehicle. The first vehicle interface computing device can provide a first plurality of selectable vehicle commands to a human passenger of the autonomous vehicle. The autonomous vehicle interface system can further include a second vehicle interface computing device that provides a second plurality of selectable vehicle commands to the human passenger. For example, the second vehicle interface computing device can be the passenger's own device (e.g., smartphone). The second plurality of selectable vehicle commands can include at least some of the same vehicle commands as the first plurality of selectable vehicle commands.

    Systems and Methods for Sensor Data Packet Processing and Spatial Memory Updating for Robotic Platforms

    公开(公告)号:US20240391097A1

    公开(公告)日:2024-11-28

    申请号:US18670288

    申请日:2024-05-21

    Abstract: Systems and methods for streaming sensor packets in real-time are provided. An example method includes obtaining a sensor data packet representing a first portion of a three-hundred and sixty degree view of a surrounding environment of a robotic platform. The method includes generating, using machine-learned model(s), a local feature map based at least in part on the sensor data packet. The local feature map is indicative of local feature(s) associated with the first portion of the three-hundred and sixty degree view. The method includes updating, based at least in part on the local feature map, a spatial map to include the local feature(s). The spatial map includes previously extracted local features associated with a previous sensor data packet representing a different portion of the three-hundred and sixty degree view than the first portion. The method includes determining an object within the surrounding environment based on the updated spatial map.

    Learned validation metric for evaluating autonomous vehicle motion planning performance

    公开(公告)号:US12151707B1

    公开(公告)日:2024-11-26

    申请号:US18633191

    申请日:2024-04-11

    Abstract: The present disclosure provides an example method for validating a trajectory generated by an autonomous vehicle control system (AV trajectory) in a driving scenario. The example method includes (a) obtaining the AV trajectory and a reference trajectory, wherein the reference trajectory describes a desired motion of a vehicle in the driving scenario; (b) determining a plurality of component divergence values for a plurality of divergence metrics, wherein a respective divergence value characterizes a respective difference between the AV trajectory and the reference trajectory; (c) providing the plurality of component divergence values to a machine-learned model to generate a score that indicates an aggregate divergence between the AV trajectory and the reference trajectory, wherein the machine-learned model comprises a plurality of learned parameters defining an influence of the plurality of component divergence values on the score; and (d) validating the AV trajectory based on the score.

    Brake preload system for autonomous vehicles

    公开(公告)号:US12145556B2

    公开(公告)日:2024-11-19

    申请号:US18364274

    申请日:2023-08-02

    Abstract: Vehicles according to at least some embodiments of the disclosure include a sensor, and a computing device comprising at least one hardware processing unit. The computing device is programmed to perform operations comprising capturing an image with the sensor, identifying an object in the image, and in response to an accuracy of the identification meeting a first criterion, pre-loading a braking system of the autonomous vehicle. In some aspects, the computing device may predict that an object not currently within a path of the vehicle has a probability of entering the path of the vehicle that meets a second criterion. When the probability of entering the path meets the second criterion, some of the disclosed embodiments may pre-load the braking system.

Patent Agency Ranking