A system and method for processing mammographic images of target breast tissue is provided. The mammographic images are processed to generate modified images. A deep learning algorithm, having a tailored Convolutional Neural Networks (CNN) model, is applied to the modified images to generate a first output and a second output. Global features associated with the entirety of the mammographic images are extracted by using the first output. Local features associated with Regions of Interest (ROIs) of the mammographic images are extracted by using the second output. The global features and the local features are combined and fuse to generate an indicator representative of likelihood of malignancy of the target breast tissue.