A damper control system for a vehicle may include a damper-relative-velocity estimation module measuring a vertical acceleration of a vehicle body through a sensor mounted on the vehicle and estimating a damper velocity of a suspension based on the measured vertical acceleration, and a control module reducing movement of the vehicle body by actuating a damper using the damper velocity of the suspension estimated through the damper-relative-velocity estimation module.