An actuator with a multipolar magnet structure includes a carrier configured so that a lens is loaded thereon, the carrier being configured to linearly move along an optical axis direction, a housing configured to accommodate the carrier, a coil unit provided in the housing and having an n number of coils arranged along the optical axis direction, where n is a natural number of 2 or above, and a magnet mounted to the carrier to face the coil unit, the magnet having an n+1 number of magnetic poles facing the coil unit.