An overlay of anatomy is created for a fluoroscopy image. Anatomy detected in angiographic images is used to locate anatomy in the fluoroscopy image. For each cardiac phase, the anatomy is detected multiple times from different cardiac cycles using angiographic images. The fluoroscopic overlay for each cardiac phase is formed from a combination of angiographic candidates fit from the different cardiac cycles to the fluoroscopic image. To further enhance the combination, prediction of the anatomy position from one phase to the next phase is used.