In a system and a method of controlling an imaging direction and an angle of view of a camera according to an aspect of the present disclosure, infrared light may be irradiated toward pupils of eyes of a user, and a position of infrared light reflected from the pupils of the eyes of the user may be detected by a first camera to track a line of sight of the user and calculate a viewing angle of the user. In addition, an imaging direction of a second camera may coincide with the line of sight of the user and an angle of view of the second camera may coincide with the viewing angle of the user to allow an image actually viewed by the user and an image captured by the camera to coincide with each other.