According to one embodiment of the present invention, a method for echocardiogram view classification is provided. According to one embodiment of the present invention, a method comprises: obtaining a plurality of video images of a subject; aligning the plurality images; using the aligned images to generate a motion magnitude image; filtering the motion magnitude image using an edge map on image intensity; detecting features on the motion magnitude image, retaining only those features which lie in the neighborhood of intensity edges; encoding the remaining features by generating, x, y image coordinates, a motion magnitude histogram in a window around the feature point, and a histogram of intensity values near the feature point; and using the encoded features to classify the video images of the subject into a predetermined classification.