A shape measurement device composes shape information indicating a three-dimensional shape of a subject based on normal information and distance information acquired for the subject. The normal and distance information are two-dimensional information and have a pixel structure corresponding to the two-dimensional image. The device acquires the normal and distance information, sets processing-target segment regions with respect to the two-dimensional image upon composition of the shape information of the subject, composes, for each of the segment regions, first shape information based on the normal information, composes, for each of the segment regions, second shape information acquired by changing the first shape information based on the distance information, and composes combined shape information indicating the three-dimensional shape of the subject by combining the second shape information for a plurality of the segment regions.