Systems and methods are described for displaying classifier output and confidence measure in an image. The confidence measure advantageously provides additional information to the user indicating the accuracy of the classification result. Based on the classification accuracy, the user may accept or reject the classification result. In an exemplary embodiment, the classifier output is displayed on the image by color coding regions in the image based on their classifications. The confidence measure is displayed by adjusting the transparencies of the color coded regions according to their confidence measures. In one embodiment, only the classifications having confidence measures above a threshold are displayed. In other embodiments, the classifier output and confidence measure may be displayed separately, contour lines may be drawn through image regions having similar confidence measures, and the confidence measure may be displayed for a region under a pointer that the user can move within the image.