Disclosed is a system for determining transfer of driving control authority of a self-driving vehicle. The system includes: a risk calculation device that recognizes a sight line of a driver to calculate a risk when the driving control authority of the self-driving vehicle is transferred, a determination reference calculation device that calculates a determination reference to determine whether the driving control authority of an acceleration pedal, a deceleration pedal, and a steering wheel of the self-driving vehicle is able to be transferred based on the calculated risk, and a determination device that determines whether to transfer the driving control authority of the self-driving vehicle based on the calculated determination reference.