A method for ensemble based labeling is provided. The method includes obtaining a plurality of samples of an object. The method further includes estimating, for each of the plurality of samples, a probability that a label applies to the sample, for each of a plurality of labels. The method also includes determining a candidate label among the plurality of labels, based on the estimated probabilities of the plurality of samples for each of the plurality of labels. The method further includes calculating a dispersion of the estimated probabilities of the plurality of samples for the candidate label; and identifying a target label among the plurality of labels, based on the estimated probabilities of the plurality of samples for the candidate label, the dispersion for the candidate label, and a number of the plurality of samples.