Methods and systems are provided for adaptively controlling audio associated with users. In an audio system configured to output audio to a user of the system, reference data may be obtained and processed, and one or more audio control settings may be determined, based on the processing of the reference data, for adjusting audio in the system, with at least one of the one or more audio control settings configured to adjust or modify a voice associated with the user. The reference data may be obtained from a database associated with operation of the system by the user. The reference data may include a reference audio, with the reference audio being processed to determine at least one of the one or more audio control settings based on characteristics and/or parameters of the reference audio.