An information processing apparatus inputs instructed coordinates to a display screen, and selects an object displayed at a coordinate position that corresponds to the input coordinates. When a drag operation for the object that was selected by the selection unit has been detected, a determination is made of whether or not the distance between the coordinate position of the selected object and input coordinates after the drag operation was detected exceeds a predetermined distance. If that distance does not exceed the predetermined distance, a moving amount of the object is made less than a moving amount of the drag operation, or the selected object is not moved.