An information processing apparatus includes a characteristic amount calculating unit calculating a characteristic amount for each of a plurality of n different image patterns, a specifying unit specifying a best-matching image pattern among the plurality of n image patterns for each of frames forming a learning moving picture and having temporal continuity, a computing unit computing a collocation probability Pij indicating a probability that, for a frame located at a position where a temporal distance to a frame for which a first image pattern Xi is specified among the plurality of n image patterns is within a predetermined threshold τ, a second image pattern Xj is specified among the plurality of n image patterns, and a grouping unit grouping the plurality of n image patterns by using the computed collocation probability Pij.