A touch device, a processor and a touch signal accessing method thereof are provided. The touch signal accessing method of the touch device includes the following steps. A current touch point is received. Whether a spatial continuity is smaller than a spatial threshold, and a time continuity is smaller than a time threshold are determined. If the spatial continuity is smaller than the space threshold and the time continuity is smaller than the time threshold, then the current touch point is added to a temporary touch point set and a count value is accumulated. Whether the current touch point is a significance point is determined. If the current touch point is the significance point, a touch point reporting procedure is performed.