An approach is provided for a location-aware evaluation of a machine learning model. The approach, for example, involves designating a geographic area for creating an evaluation dataset for the machine learning model. The approach also involves separating a plurality of observation data records into the evaluation dataset and a training dataset based on a comparison of a respective data collection location of each of the plurality of observation data records to the geographic area. The training dataset is then used to train the machine learning model, and the evaluation dataset is used to evaluate the trained machine learning model.