A displacement detecting apparatus includes: a detector which detects displacement, which is spatial displacement over time, of each of a plurality of measurement points which have been set on an object, using a plurality of images of the object captured at a plurality of time points; an extractor which extracts characteristic displacement specific to the object, based on the displacement detected by the detector; and a calculator which calculates overall displacement indicating displacement of the entirety of the object, from the characteristic displacement extracted by the extractor.