A shutter device with a multi-stage diaphragm includes a base, a shutter unit pivoted on the base, a driving unit, and an actuator unit. The base includes a first optical opening defining an optical axle passing through the first optical opening. The shutter unit is adjusted to cover the first optical opening. The driving unit includes a main axle perpendicular to the optical axle and installed on the base, and a driving bar moving along the main axle and linking to the shutter unit. The actuator unit includes a coil board installed on one of the base and the driving bar, and an actuator magnet installed on the other of the base and the driving bar corresponding to the coil board. The coil board receives signals to change the relative position between the coil with pattern and the actuator magnet, whereby the actuator unit drives the shutter unit in multi-stages.