An illumination control system includes: illumination apparatuses having respective addresses and perform a dimming control in response to a dimming signal inputted from an outside, and an illumination control terminal which has an imaging device, a capturing range of which is set to include illumination ranges of the illumination apparatuses. The illumination control terminal segments an image captured by the imaging device into a plurality of areas so that the areas correspond to the illumination ranges, detects a person based on the captured image, determines a segmented area in which the person is present if the person has been detected and performs dimming control on an illumination apparatus corresponding to the determined segmented area.