A system and method of computer aided analysis of medical images and detection of malignant lesions is described. Medical images obtained from multiple modalities are analyzed. Morphological features as well as temporal, i.e., kinetics features, are combined to compute a consolidated assessment of a possible lesion detected in the medical images. The system includes at least one kinetics module, which is capable of extracting kinetics features from a time sequence of MRI images or MRS data taken after administering a contrast enhancement agent to a patient. The consolidated assessment is presented to a user for confirmation or modification.