A 3D-object recognition device includes: a matching unit to compare a 3D-object in an image based on the image data with a 3D-shape model corresponding to the 3D-object to associate correlated feature points with each other by pattern matching; a model updating unit to update the 3D-shape model based on the feature points associated by the matching unit; a motion estimation unit to estimate motion of the 3D-object based on a history of the position and attitude of the 3D-shape model updated by the model updating unit to estimate a 3D-shape model at an arbitrary time in the future; and a validity determination unit to compare the feature points associated by the matching unit with the 3D-shape model estimated by the motion estimation unit and cause the model updating unit to update the 3D-shape model based on only the feature points determined to be valid.