Disclosed are a method of classifying lesions of chest x-ray radiographs based on data normalization and local patches and an apparatus thereof. The method includes converting an input chest x-ray radiograph into a normalized image, segmenting the converted normalized image into an organ area by using a first neural network based on a pre-learned segmentation model, generating local patches for the segmented organ area, and classifying a lesion in the input chest x-ray radiograph by using a second neural network based on a pre-learned classification model for the generated local patches.