The purpose of the present invention is to provide a surrounding environment recognition device such that even in a situation where a certain moving three-dimensional object is apparently overlapped with another three-dimensional object, early detection of the certain moving three-dimensional object is enabled. To this end, a surrounding environment recognition device for a moving body is equipped with: imaging units for photographing multiple images in a time series; a three-dimensional object detection unit for detecting three-dimensional objects on the basis of distances of the objects from the imaging units; a vector detection unit for tracking feature points within predetermined areas of the multiple images containing the three-dimensional objects, thereby detecting motion vectors of the feature points; and a moving three-dimensional object detection unit for detecting three-dimensional objects which are present in the areas on the basis of detection results of the vector detection unit.