-
公开(公告)号:US20230339504A1
公开(公告)日:2023-10-26
申请号:US17730048
申请日:2022-04-26
Applicant: Perceptive Automata, Inc.
Inventor: Elon Gaffin-Cahn
CPC classification number: B60W60/0011 , B60W40/04 , B60W2554/402 , B60W2554/4041 , B60W2556/10
Abstract: A system receives information describing paths traversed by vehicles of a vehicle type, for example, a bicycle or a motorcycle. The system determines locations along the paths. For each location the system determines a measure of likelihood of encountering vehicles of the vehicle type in traffic at the location. The system selects a subset of locations based on the measure of likelihood and obtains sensor data captured at the subset of locations. The system uses the sensor data as training dataset for training a machine learning based model configured to receive input sensor data describing traffic and output a score used for navigation of autonomous vehicles. The machine learning model is provided to a vehicle, for example, an autonomous vehicle for navigation of the autonomous vehicle.
-
公开(公告)号:US11772663B2
公开(公告)日:2023-10-03
申请号:US16709790
申请日:2019-12-10
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony
CPC classification number: B60W50/0097 , B60W40/04 , B60W60/0011 , B60W60/0015 , G05D1/0088 , G06N3/08 , G06V20/56 , G08G1/0125 , G08G1/0145 , B60W2554/00 , G05D2201/0213
Abstract: A system performs modeling and simulation of non-stationary traffic entities for testing and development of modules used in an autonomous vehicle system. The system uses a machine learning based model that predicts hidden context attributes for traffic entities that may be encountered by a vehicle in traffic. The system generates simulation data for testing and development of modules that help navigate autonomous vehicles. The generated simulation data may be image or video data including representations of traffic entities, for example, pedestrians, bicyclists, and other vehicles. The system may generate simulation data using generative adversarial neural networks.
-
公开(公告)号:US11753046B2
公开(公告)日:2023-09-12
申请号:US17468516
申请日:2021-09-07
Applicant: Perceptive Automata Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
IPC: G06N3/08 , B60W60/00 , G06N3/04 , G08G1/16 , G08G1/04 , G05D1/00 , B60W30/00 , G06N3/084 , G06V20/40 , G06V20/58 , G06V40/20 , G06F18/40 , G06F18/214 , G06V10/778 , G06N20/10 , G06N5/01
CPC classification number: B60W60/00274 , B60W30/00 , G05D1/0088 , G06F18/214 , G06F18/41 , G06N3/04 , G06N3/08 , G06N3/084 , G06V10/7784 , G06V20/41 , G06V20/58 , G06V40/20 , G08G1/04 , G08G1/166 , G05D2201/0213 , G06N5/01 , G06N20/10
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US11733703B2
公开(公告)日:2023-08-22
申请号:US16777386
申请日:2020-01-30
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony
CPC classification number: G05D1/0221 , B60W30/09 , B60W30/095 , B60W40/09 , B60W60/0015 , B60W60/0027 , G05D1/0088 , G05D1/0214 , G05D1/0231 , G06N20/00 , B60W2420/42 , B60W2420/52 , B60W2554/40 , G05D2201/0213
Abstract: An autonomous vehicle uses machine learning based models to predict hidden context attributes associated with traffic entities. The system uses the hidden context to predict behavior of people near a vehicle in a way that more closely resembles how human drivers would judge the behavior. The system determines an activation threshold value for a braking system of the autonomous vehicle based on the hidden context. The system modifies a world model based on the hidden context predicted by the machine learning based model. The autonomous vehicle is safely navigated, such that the vehicle stays at least a threshold distance away from traffic entities.
-
公开(公告)号:US11615266B2
公开(公告)日:2023-03-28
申请号:US17081211
申请日:2020-10-27
Applicant: Perceptive Automata Inc.
Inventor: Avery Wagner Faller
Abstract: A vehicle collects video data of an environment surrounding the vehicle including traffic entities, e.g., pedestrians, bicyclists, or other vehicles. The captured video data is sampled and presented to users to provide input on a traffic entity's state of mind. The user responses on the captured video data is used to generate a training dataset. A machine learning based model configured to predict a traffic entity's state of mind is trained with the training dataset. The system determines input video frames and associated dimension attributes for which the model performs poorly. The dimension attributes characterize stimuli and/or an environment shown in the input video frames. The system generates a second training dataset based on video frames that have the dimension attributes for which the model performed poorly. The model is retrained using the second training dataset and provided to an autonomous vehicle to assist with navigation in traffic.
-
公开(公告)号:US20210182604A1
公开(公告)日:2021-06-17
申请号:US17190619
申请日:2021-03-03
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US20210133500A1
公开(公告)日:2021-05-06
申请号:US17081202
申请日:2020-10-27
Applicant: Perceptive Automata Inc.
Inventor: Avery Wagner Faller
IPC: G06K9/62 , G06K9/00 , G06N20/00 , B60W60/00 , B60W30/095
Abstract: A vehicle collects video data of an environment surrounding the vehicle including traffic entities, e.g., pedestrians, bicyclists, or other vehicles. The captured video data is sampled and the sampled video frames are presented to users to provide input on a traffic entity's state of mind. The system determines an attribute value that describes a statistical distribution of user responses for the traffic entity. If the attribute for a sampled video frame is within a threshold of the attribute of another video frame, the system interpolates attribute for a third video frame between the two sampled video frames. Otherwise, the system requests further user input for a video frame captured between the two sampled video frames. The interpolated and/or user based attributes are used to train a machine learning based model that predicts a hidden context of the traffic entity. The trained model is used for navigation of autonomous vehicles.
-
18.
公开(公告)号:US20200247432A1
公开(公告)日:2020-08-06
申请号:US16709788
申请日:2019-12-10
Applicant: Perceptive Automata, Inc.
Inventor: Kshitij Misra , Samuel English Anthony
Abstract: A system performs modeling and simulation of non-stationary traffic entities for testing and development of modules used in an autonomous vehicle system. The system uses a machine learning based model that predicts hidden context attributes for traffic entities that may be encountered by a vehicle in traffic. The system generates simulation data for testing and development of modules that help navigate autonomous vehicles. The generated simulation data may be image or video data including representations of traffic entities, for example, pedestrians, bicyclists, and other vehicles. The system may generate simulation data using generative adversarial neural networks.
-
公开(公告)号:US20190340465A1
公开(公告)日:2019-11-07
申请号:US16512560
申请日:2019-07-16
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US11840261B2
公开(公告)日:2023-12-12
申请号:US17321297
申请日:2021-05-14
Applicant: Perceptive Automata, Inc.
Inventor: Till S. Hartmann , Jeffrey D. Zaremba , Samuel English Anthony
IPC: G05D1/02 , G06N20/00 , G06N5/04 , G06N3/08 , G06V20/40 , G06V20/56 , G06F18/40 , G06F18/214 , G06F18/21 , G06F18/2113 , G06V10/764 , G06V10/82 , G06V20/58 , G06V40/20 , B60W60/00
CPC classification number: B60W60/00272 , B60W60/001 , G05D1/0221 , G05D1/0246 , G06F18/214 , G06F18/217 , G06F18/2113 , G06F18/40 , G06N3/08 , G06N5/04 , G06N20/00 , G06V10/764 , G06V10/82 , G06V20/41 , G06V20/56 , G06V20/58 , G06V40/23 , B60W2420/42 , B60W2420/52 , B60W2552/05 , B60W2554/408 , B60W2554/4029 , B60W2554/4041 , B60W2554/4044 , B60W2554/4045 , B60W2554/4046 , B60W2554/801 , G05D2201/0213
Abstract: A system uses a machine learning based model to determine attributes describing states of mind and behavior of traffic entities in video frames captured by an autonomous vehicle. The system classifies video frames according to traffic scenarios depicted, where each scenario is associated with a filter based on vehicle attributes, traffic attributes, and road attributes. The system identifies a set of video frames associated with ground truth scenarios for validating the accuracy of the machine learning based model and predicts attributes of traffic entities in the video frames. The system analyzes video frames captured after the set of video frames to determine actual attributes of the traffic entities. Based on a comparison of the predicted attributes and actual attributes, the system determines a likelihood of the machine learning based model making accurate predictions and uses the likelihood to generate a navigation action table for controlling the autonomous vehicle.
-
-
-
-
-
-
-
-
-