A speech recognition based vehicle control method includes transmitting a speech command to a first server through a first path via a speech recognition service apparatus in response to a generation of the speech command, transmitting authentication data of a portable device and the speech command to the first server through a second path via the portable device in response to the generation of the speech command, and performing, by the first server, authentication of the portable device on the basis of the authentication data, and recognizing the speech command as a valid speech command when the authentication of the portable device is completed.