-
公开(公告)号:US12012118B2
公开(公告)日:2024-06-18
申请号:US17081202
申请日:2020-10-27
Applicant: Perceptive Automata Inc.
Inventor: Avery Wagner Faller
IPC: G06V40/00 , B60W30/095 , B60W60/00 , G06F18/214 , G06N20/00 , G06V10/774 , G06V10/778 , G06V20/40 , G06V20/58 , G06V40/20
CPC classification number: B60W60/001 , B60W30/0956 , G06F18/214 , G06N20/00 , G06V10/774 , G06V10/7788 , G06V20/46 , G06V20/48 , G06V20/58 , G06V40/20 , B60W2420/403
Abstract: A vehicle collects video data of an environment surrounding the vehicle including traffic entities, e.g., pedestrians, bicyclists, or other vehicles. The captured video data is sampled and the sampled video frames are presented to users to provide input on a traffic entity's state of mind. The system determines an attribute value that describes a statistical distribution of user responses for the traffic entity. If the attribute for a sampled video frame is within a threshold of the attribute of another video frame, the system interpolates attribute for a third video frame between the two sampled video frames. Otherwise, the system requests further user input for a video frame captured between the two sampled video frames. The interpolated and/or user based attributes are used to train a machine learning based model that predicts a hidden context of the traffic entity. The trained model is used for navigation of autonomous vehicles.
-
公开(公告)号:US20210182605A1
公开(公告)日:2021-06-17
申请号:US17190631
申请日:2021-03-03
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US11981352B2
公开(公告)日:2024-05-14
申请号:US17190631
申请日:2021-03-03
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
IPC: G06N3/04 , B60W30/00 , B60W60/00 , G05D1/00 , G06F18/214 , G06F18/40 , G06N3/08 , G06N3/084 , G06V10/778 , G06V20/40 , G06V20/58 , G06V40/20 , G08G1/04 , G08G1/16 , G06N5/01 , G06N20/10
CPC classification number: B60W60/00274 , B60W30/00 , G05D1/0088 , G06F18/214 , G06F18/41 , G06N3/04 , G06N3/08 , G06N3/084 , G06V10/7784 , G06V20/41 , G06V20/58 , G06V40/20 , G08G1/04 , G08G1/166 , G05D2201/0213 , G06N5/01 , G06N20/10
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US11126889B2
公开(公告)日:2021-09-21
申请号:US16828823
申请日:2020-03-24
Applicant: Perceptive Automata Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
IPC: G06K9/00 , G06K9/62 , G06N3/08 , G06N3/04 , G08G1/16 , G08G1/04 , G05D1/00 , B60W30/00 , G06N5/00 , G06N20/10
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US20210133497A1
公开(公告)日:2021-05-06
申请号:US17081211
申请日:2020-10-27
Applicant: Perceptive Automata Inc.
Inventor: Avery Wagner Faller
Abstract: A vehicle collects video data of an environment surrounding the vehicle including traffic entities, e.g., pedestrians, bicyclists, or other vehicles. The captured video data is sampled and presented to users to provide input on a traffic entity's state of mind. The user responses on the captured video data is used to generate a training dataset. A machine learning based model configured to predict a traffic entity's state of mind is trained with the training dataset. The system determines input video frames and associated dimension attributes for which the model performs poorly. The dimension attributes characterize stimuli and/or an environment shown in the input video frames. The system generates a second training dataset based on video frames that have the dimension attributes for which the model performed poorly. The model is retrained using the second training dataset and provided to an autonomous vehicle to assist with navigation in traffic.
-
公开(公告)号:USD928804S1
公开(公告)日:2021-08-24
申请号:US29694709
申请日:2019-06-12
Applicant: Perceptive Automata, Inc.
Designer: Avery Wagner Faller , Samuel English Anthony
-
公开(公告)号:USD928803S1
公开(公告)日:2021-08-24
申请号:US29694706
申请日:2019-06-12
Applicant: Perceptive Automata, Inc.
Designer: Avery Wagner Faller , Samuel English Anthony
-
公开(公告)号:US20200293822A1
公开(公告)日:2020-09-17
申请号:US16828823
申请日:2020-03-24
Applicant: Perceptive Automata Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US11753046B2
公开(公告)日:2023-09-12
申请号:US17468516
申请日:2021-09-07
Applicant: Perceptive Automata Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
IPC: G06N3/08 , B60W60/00 , G06N3/04 , G08G1/16 , G08G1/04 , G05D1/00 , B60W30/00 , G06N3/084 , G06V20/40 , G06V20/58 , G06V40/20 , G06F18/40 , G06F18/214 , G06V10/778 , G06N20/10 , G06N5/01
CPC classification number: B60W60/00274 , B60W30/00 , G05D1/0088 , G06F18/214 , G06F18/41 , G06N3/04 , G06N3/08 , G06N3/084 , G06V10/7784 , G06V20/41 , G06V20/58 , G06V40/20 , G08G1/04 , G08G1/166 , G05D2201/0213 , G06N5/01 , G06N20/10
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US11615266B2
公开(公告)日:2023-03-28
申请号:US17081211
申请日:2020-10-27
Applicant: Perceptive Automata Inc.
Inventor: Avery Wagner Faller
Abstract: A vehicle collects video data of an environment surrounding the vehicle including traffic entities, e.g., pedestrians, bicyclists, or other vehicles. The captured video data is sampled and presented to users to provide input on a traffic entity's state of mind. The user responses on the captured video data is used to generate a training dataset. A machine learning based model configured to predict a traffic entity's state of mind is trained with the training dataset. The system determines input video frames and associated dimension attributes for which the model performs poorly. The dimension attributes characterize stimuli and/or an environment shown in the input video frames. The system generates a second training dataset based on video frames that have the dimension attributes for which the model performed poorly. The model is retrained using the second training dataset and provided to an autonomous vehicle to assist with navigation in traffic.
-
-
-
-
-
-
-
-
-