An optical unit with a shake correction function has a shake correction function for correcting a shake of an optical module. The optical unit with a shake correction function includes: a movable body including the optical module; a fixed body disposed outward of the movable body in a radial direction with respect to an optical axis of the optical module; and a support part disposed between the movable body and the fixed body in the radial direction and structured to support the movable body such that the movable body is swingable relative to the fixed body. The movable body and the support part or the support part and the fixed body have, in a pair, a swing mechanism structured to allow the movable body to swing relative to the fixed body. The swing mechanism includes a protruded spherical portion and a recessed spherical portion that is larger in radius of curvature than the protruded spherical portion.