This disclosure relates to method and system for detecting and tracking at least one object in a rotational environment. The method includes receiving a set of first features based on first data and a set of second features based on second data, detecting at least one object based on the set of first features using a Convolutional Neural Network (CNN) based predictive model, determining a set of first parameters for the at least one object, detecting the at least one object based on the set of second features using the CNN based predictive model, determining a set of second parameters for the at least one object, and tracking the at least one object based on the set of first parameters and the set of second parameters. It should be noted that the first data and the second data sequentially belong to an input dataset that includes images or video frames.