A system for classifying objects detected in shearographic images identifying via a derivative peaks method, process, or algorithm is accomplished with a CNN (CNN). The system utilized training techniques of the CNN to classify objects as threats or non-threats. The system utilizes extracted clips from the shearographic image that contain the presence of an object so that the extracted clip containing the object is/are evaluated by the CNN to classify the object on or below a surface that has been insonified or otherwise stimulated to generate the shearographic image.