A behavior control system includes: a behavior control device for changing a behavior of a moving body; an imaging device for acquiring images ahead of the moving body; and a control device for controlling the behavior of the moving body based on the images acquired by the imaging device. The control device includes: a feature point extraction unit configured to extract feature points from the images acquired by the imaging device; a straight moving state storing unit configured to store, as a reference feature point state, a feature point state when the moving body is in a straight moving state, the feature point state being obtained based on a temporal change of the feature points; and a moving body control unit configured to control the behavior control device when the feature point state obtained based on the temporal change of the feature points differs from the reference feature point state.