Among motion vectors detected relative to a reference image for each of a plurality of areas of a base image, motion vectors related to a moving object are determined. Based on a point of interest and a movement direction of the moving object, one of more of the motion vectors related to the moving object are determined as candidate vector(s), and a representative vector of the moving object is calculated based on the candidate vector(s). A motion vector detection apparatus capable of calculating a motion vector that expresses an angular velocity at a specific position of an object, and a method of controlling the motion vector detection apparatus, are provided.