Disclosed is a vehicle door control technology such as a vehicle door control system. The vehicle door control system includes a communication unit configured to wirelessly communicate with a smart key or a portable terminal located around a vehicle, a controller configured to communicate with the smart key or the portable terminal using the communication unit, perform authentication on the smart key or the portable terminal based on a received signal, and output a door control signal for controlling a vehicle door when the authentication is successful, and a motor driver configured to lock or unlock the vehicle door according to the door control signal.