A position controller for an optical element includes an advancing/retracting member, an anti-shake moving member, an insertable/removable moving member holding the optical element and supported by the anti-shake moving member to move between insertion and removed positions, an insertion holder holding the insertable/removable moving member in the insertion position in the ready-to-photograph state, a removal drive member supported by the advancing/retracting member between a position allowing the anti-shake moving member to move in a moving range and a forced removing position to move the insertable/removable moving member to the removed position, and an insertion/removal controller which holds the removal drive member in the insertion allowance position in the ready-to-photograph state and moves the removal drive member to the forced removing position in the accommodated state.