According to one embodiment, an information processing apparatus is provided with a display section, and can be instructed to be operated by a pointer displayed on the display section, and includes a detection section for detecting, from an input image of a hand, a position of the hand in the image, an operation section for obtaining a probability that the hand exists in the image by using the latest detection result detected by the detection section, and a value of a probability distribution function having a peak at a position which has been evaluated last time as a position at which a probability that the hand exists is high, and a pointer display section for moving the pointer, on the basis of an evaluation value obtained from the probability, to a position at which the probability that the hand exists is the highest and displaying the pointer at the position.