State of the art image processing techniques such as background subtraction, and Convolutional Neural Network based approaches, when used for change detection, fail to support certain datasets. The disclosure herein generally relates to semantic change detection, and, more particularly, to a method and system for semantic change detection using a deep neural network feature correlation approach. An adaptive correlation layer is used by the system, which determines extent of computation required at pixel level, based on amount of information at pixels, and uses this information in further computation done for the semantic change detection. Information on the determined extent of computation required is then used to extract semantic features, which is then used to compute one or more correlation maps between the at least one feature map of a test image and corresponding reference image. Further the semantic changes are determined from the one or more correlation maps.