To provide a confocal displacement sensor capable of reducing a measurement error. Light having a plurality of wavelengths is emitted by a light processing section 120. A chromatic aberration along an optical axis direction is caused by a lens unit 220 in the light emitted by the light projecting section 120. The light having the chromatic aberration converged and irradiated on a measurement object S by the lens unit 220. In the light irradiated on the measurement object S by the lens unit 220, light having a wavelength reflected while focusing on the surface of the measurement object S passes through a plurality of pinholes. Displacement of the measurement object S is calculated by an arithmetic processing section 150 on the basis of signal intensity for each wavelength of an average signal corresponding to an average of intensities for each wavelength concerning a plurality of lights passed through the plurality of pinholes.