Methods and systems for operating an autonomous driving vehicle (ADV) are disclosed. A current state of an ADV is sampled at a first time to obtain a set of parameters. A cost, from a cost function that reflects desired control goals, is generated for a future time horizon based at least in part on the set of parameters. The cost is minimized with one or more constraints to obtain target control input values. For each of the target control input values, a lookup operation is performed using the control input value to locate a first mapping entry that approximately corresponds to the control input value. A first control command is derived from the first mapping entry. The ADV is controlled using the derived first control command.