One or more embodiments are described for facilitating a vision based active steering system. An example steering system includes a handwheel actuator that generates a first feedback torque based on road surface forces at a roadwheel. The steering system further includes a controller that receives, from an image-based system, a control signal indicative of a type of road surface based on an image of the road surface. Further, in response, the controller adjusts one or more parameters of the handwheel actuator to generate a second feedback torque based on the road surface forces at the roadwheel.