A performing device of an impulse-like gesture recognition system executes an impulse-like gesture recognition method. A performing procedure of the impulse-like gesture recognition method includes steps of: receiving a sensing signal from a sensing unit; determining a prediction with at least one impulse-like label according to the sensing frames by a deep learning-based model; and classifying at least one gesture event according to the prediction. The gesture event is classified to determine the motion of the user. Since the at least one impulse-like label is used to label at least one detection score of the deep learning-based model, the detection score is non-decreasing, reaction time of the at least one gesture event for an incoming gesture is fast, rapid consecutive gestures are easily decomposed, and an expensive post-processing is not needed.