A pointer information processing device includes a memory and a processor coupled to the memory. The processor executes a process including acquiring a position of a conference participant in a first image captured toward the conference participant, detecting a light-emitting point of a laser pointer, detecting a radiated point of the laser pointer, identifying the conference participant that is using the laser pointer having the light-emitting point by comparing a position of the detected light-emitting point within the first image to the acquired position of the conference participant, associating the detected light-emitting point with the detected radiated point, and recording respective position information of the detected light-emitting point and the detected radiated point associated with each other at the associating and information about the conference participant identified at the identifying in the memory in an associated manner.