A vehicle sound synthesis system is provided with a loudspeaker, a microphone and a controller. The loudspeaker is adapted to project sound indicative of synthesized engine noise (SEN) within a cabin of a vehicle in response to receiving an adjusted SEN signal. The microphone is disposed in the cabin and adapted to provide a microphone signal having a SEN component and a noise component. The controller is programmed to receive the microphone signal, adjust a SEN signal based on the microphone signal, and provide the adjusted SEN signal to the loudspeaker.