The primary purpose of the present invention is to enable devices/machines/systems to perform an optimized video analytics on images and videos. The present invention focuses on detecting, tracking, and classifying objects in a scene. Here, the tracking is performed by comparing objects across at least two frames and then associating the objects based on a cost matrix. Some examples of the objects include, but are not limited to, persons, animals, vehicles, or any other articles or items.