A system and method for subject-matching in images comprises detecting a first orientation of a first subject in a target image; comparing the first orientation with a second orientation of a second subject in a source image to obtain at least one orientation parameter; extracting at least one features from the target image; computing a visual similarity score between the target image and the source image using the features, the visual similarity score being computed as a function of the at least one feature and the at least one orientation parameter; and determining a match between the first subject and the second subject in accordance with the visual similarity score.