Invention Grant
- Patent Title: Method of selection of an action for an object using a neural network
-
Application No.: US15724939Application Date: 2017-10-04
-
Publication No.: US10935982B2Publication Date: 2021-03-02
- Inventor: Hengshuai Yao , Hao Chen , Seyed Masoud Nosrati , Peyman Yadmellat , Yunfei Zhang
- Applicant: Hengshuai Yao , Hao Chen , Seyed Masoud Nosrati , Peyman Yadmellat , Yunfei Zhang
- Applicant Address: CA Markham; CA Ottawa; CA Markham; CA North York; CA Aurora
- Assignee: Hengshuai Yao,Hao Chen,Seyed Masoud Nosrati,Peyman Yadmellat,Yunfei Zhang
- Current Assignee: Hengshuai Yao,Hao Chen,Seyed Masoud Nosrati,Peyman Yadmellat,Yunfei Zhang
- Current Assignee Address: CA Markham; CA Ottawa; CA Markham; CA North York; CA Aurora
- Main IPC: G05D1/02
- IPC: G05D1/02 ; G06N3/04 ; G06N3/00 ; B60W40/12 ; G06N3/08 ; G06N3/02

Abstract:
A method, device and system of prediction of a state of an object in the environment using a pre-trained action model defined by an action model neural network. A control system for an object comprises a plurality of sensors for sensing a current state and an environment in which the object is located, and a first neural network. Predicted subsequent states of the object in the environment are obtained using the action model and a current state of the object in the environment The action model maps a plurality of state-action pairs (s, a), each state-action pair encoding a state (s) of the object in the environment and an action (a) performed by the object to a predicted subsequent state (s′) of the object in the environment. An action that maximizes a value of a target, based at least on a reward for each of the predicted subsequent states, is determined. The determined action is caused to be performed.
Public/Granted literature
- US20190101917A1 METHOD OF SELECTION OF AN ACTION FOR AN OBJECT USING A NEURAL NETWORK Public/Granted day:2019-04-04
Information query