A method, a computer program product, and a computer system for classifying bacteria. The method comprises extracting a morphology signature corresponding to one or more bacteria and extracting a motility signature corresponding to the one or more bacteria. The method further comprises merging the morphology signature and the motility signature into a merged vector signature and classifying the one or more bacteria based on the merged vector signature.