Disclosed herein is a posture control system containing a posture control unit that changes a direction of a user's body and a display unit mounted on a user's head. The posture control system includes: a posture data acquiring unit configured to acquire posture data indicating the direction of the user's body; a motion sensor data acquiring unit configured to acquire motion sensor data indicating a direction of a user's face in a real space which is detected by a motion sensor; a camera image data acquiring unit configured to acquire camera image data indicating the face direction with reference to the direction of the user's body which is specified based on a camera image; and a face direction specifying unit configured to specify the direction of the user's face based on the posture data, the motion sensor data, and the camera image data.