Embodiments of the invention relate to a method, system, and computer program product to automate image classification with respect to coronary vessels in an angiography sequence. Two primary elements are employed, including training and recognition. Training pertains to the pre-processing images and extracting salient features that characterize the appearance of coronary arteries under different viewpoints. Recognition pertains to extraction of features from a new image sequence and determining a classification boundary for the new image from previously classified and labeled image sequences.