A learning system that can predict a desired result, and can have stable and improved prediction precision is presented. The learning system includes a learning section which learns the learning data using a learning algorithm to generate hypotheses, a storage section containing at least a plurality of un-labeled candidate data, a calculating section which uses the hypotheses to calculate a score for each of the plurality of candidate data, a selecting section that selects desired candidate data based on the calculated scores and a predetermined stochastic selection function, a data updating section which affixes a user-determined label to the desired candidate data and outputs the desired candidate data to the learning data, and a control unit which outputs the hypotheses to an output unit when an end condition is met, so that a desired result is predicted.