Presented herein are techniques for extracting features from sound signals received at a hearing prosthesis at least partially based on an environmental classification of the sound signals. More specifically, one or more sound signals are received at a hearing prosthesis and are converted in to stimulation control signals for use in delivering stimulation to a recipient of the hearing prosthesis. The hearing prosthesis determines an environmental classification of the sound environment associated with the one or more sound signals and is configured to use the environmental classification in the determination of a feature-based adjustment for incorporation into the stimulation control signals.