Certain embodiments of the present invention provide a system and method for temporally aligning a plurality of cardiac image sequences. The method includes performing a locally linear embedding algorithm on a first set of cardiac image sequences and on a second set of cardiac image sequences. A graphical representation is created for the first set of cardiac image sequences and the second set of cardiac image sequences. A determination is made whether the first set of cardiac image sequences and the second set of cardiac image sequences were generated from a similar point of view. If a similar point of view is found, the first graphical representation and the second graphical representation are aligned using a minimization function. If a similar point of view is not found, the graphs are aligned with a template and then aligned with each other using the minimization function.