A method for automatically assessing medical ultrasound (US) image usability, includes extracting one or more features from at least one part of a medical ultrasound image, calculating for each feature a feature score for each pixel of the at least one part of the ultrasound image, and classifying one or more image pixels of the at least one part as either usable or unusable, based on a combination of feature scores for each pixel, where usable pixels have intensity values substantially representative of one or more anatomical structures.