A phase difference element capable of decreasing deterioration of 3D characteristics and a display unit including the phase difference element are provided. The phase difference element includes a phase difference film, and an anti-glare film. The phase difference film has a phase difference layer composed of two or more phase difference regions each having different direction of a slow axis that are regularly arranged in a plane. Retardation of the anti-glare film is 20 nm or less and total haze of the anti-glare film is 30% or less.