A method and system for extracting coronary vessels fluoroscopic image sequences using coronary digital subtraction angiography (DSA) are disclosed. A set of mask images of a coronary region is received, and a sequence of contrast images for the coronary region is received. For each contrast image, a motion estimate is calculated between each of the mask images and a background region of the contrast image and a covariance is calculated for each motion estimate. Multiple background layer predictions are generated by generating a background layer prediction for each mask image based on the calculated motion estimate and covariance. The multiple background layer estimates are combined using statistical fusion to generate a final estimated background layer. The final estimated background layer is subtracted from the contrast image to extract a coronary vessel layer for the contrast image.