A position controller for an optical element includes a movable member and is supported by a support member to be movable from an anti-shake driving range to a removed position, an image-shake correction driver, and an insertion/removal operational member. The insertion/removal operational member includes a first press portion which presses the movable member from the anti-shake driving range to the removed position by the insertion/removal operational member moving from an insertion position to the removed holding position, a second press portion which presses the movable member to the anti-shake driving range by the insertion/removal operational member moving from the removed holding position to the insertion position, and a displacement prevention portion which allows the movable member to move within the anti-shake driving range and prevents the movable member from moving beyond the anti-shake driving range when the insertion/removal operational member is in the insertion position.