A method and system for tracking a guidewire in a fluoroscopic image sequence is disclosed. In order to track a guidewire in a fluoroscopic image sequence, guidewire segments are detected in each frame of the fluoroscopic image sequence. The guidewire in each frame of the fluoroscopic image sequence is then detected by rigidly tracking the guidewire from a previous frame of the fluoroscopic image sequence based on the detected guidewire segments in the current frame. The guidewire is then non-rigidly deformed in each frame based on the guidewire position in the previous frame.