A voice data processing method includes acquiring historical voice data, acquiring historical voice feature vectors corresponding to the historical voice data, and performing clustering on the historical voice feature vectors to obtain a voice feature cluster, the voice feature cluster comprising at least one historical voice feature vector with a similar feature. The method also includes, when the voice feature cluster matches a high-frequency user condition, training a corresponding user voice model according to the historical voice feature vectors contained in the voice feature cluster; after a current voice feature vector of the current voice data matches the user voice model, initiating a user identity association request associated with the current voice data; and, after a response message corresponding to the user identity association request is received, binding user identity information in the response message to the user voice model.