A cursor controlling method includes: A starting position on which a touch signal triggered by an object on the touch panel is detected, and a starting coordinate of the starting position is calculated; a cursor is display at a first coordinate on a display screen corresponding to the starting coordinate. A first vector of the object moving from the starting position to a first steering position on the touch panel is detected. The cursor is moved along a first moving vector corresponding to the first vector, with a first speed on the display screen, until the object is stopped on a first steering position of the touch panel, to make the cursor ended up at a first virtual position having a first virtual coordinate. The cursor is shifted from the first virtual coordinate to a second coordinate on the display screen and corresponding to the first steering position.