An optical unit with a shake correction function include a fixed body, a movable body having an optical element, a swing support mechanism swingably supporting the movable body, and a shake correction drive mechanism structured to swing the movable body. The movable body includes a first abutting part abutted with a first stopper part of the fixed body at a time of a maximum swing, and a second abutting part abutted with a second stopper part of the fixed body at a time of a movement in an optical axis direction. The second stopper part and the second abutting part are separated so as not to contact with each other when the movable body is swung, and a separated distance along the optical axis direction between the second stopper part and the second abutting part is smaller than a separated distance between the first abutting part and the fixed body.