A multi layer learning based control system and method for an autonomous vehicle or mobile robot. A mission planning layer, behavior planning layer and motion planning layer each having one or more neural neworks are used to develop an optimal route for the autonomous vehicle or mobile robot, provide a series of functional tasks associated with at least one or more of the neural networks to follow the planned optimal route and develop commands to implement the functional tasks.