The present invention provides for improving training dataset by identifying errors in training dataset and generating improvement recommendations. In operation, the present invention provides for identifying and correcting duplicate utterances in training dataset comprising utterances-intent pairs. Further, a plurality of Natural Language ML models are trained with the corrected training dataset to obtain diverse set of trained ML models. Each utterance of training dataset are fed as input to trained ML models, and a probability of error associated with each utterances-intent pairs of training dataset are evaluated based on analysis of respective intent predictions received from each of the trained ML models. Furthermore, spelling errors in the dataset are identified and data-imbalances in the training dataset are evaluated. Finally, a set of improvement recommendations for each utterances-intent pair is generated based on evaluated probability of errors, spelling errors, duplicate utterances and data imbalances.