A system for controlling an operation of a machine for performing a task is disclosed. The system submits a sequence of control inputs to the machine and receives a feedback signal. The system further determines, at each control step, a current control input for controlling the machine based on the feedback signal including a current measurement of a current state of the system by applying a control policy transforming the current measurement into the current control input based on current values of control parameters in a set of control parameters of a feedback controller. Furthermore, the system may iteratively update a state of the feedback controller defined by the control parameters using a prediction model predicting values of the control parameters and a measurement model updating the predicted values to produce the current values of the control parameters that explain the sequence of measurements according to a performance objective.