A computer implemented method and system for customizing speech recognition for users with accents. A spoken language of a user is identified. An indicator of a speech accent language can be initiated by the user using a computer. The indicator identifies the speech accent language and defines an influence of the speech accent language on the spoken language. Speech recognition characteristics are set according to the spoken language and the indicator. An automatic speech recognition (ASR) conversion is adjusted based on the speech recognition characteristics.