An active attentional sampling technology for accelerating background subtraction from input videos, more specifically, an active attentional sampling technology for accelerating background subtraction by removing background region from the input video and then applying foreground probability map and sampling mask according to temporal property, spatial property and frequency property of the input video in favor of the pixel-wise background subtraction algorithm is provided. The background subtraction is accomplished by generating active attentional sampling mask for input video and then processing each frame of the input video only for regions corresponding to the sampling mask, which renders the background subtraction be much accelerated. That is, the present invention successfully speeds up pixel-wise background subtraction methods approximately 6.6 times without deteriorating detection performance. Therefore, according to the present invention, real-time detection with full-HD video is successfully achieved through various conventional background subtraction algorithms.