A method and device for detecting objects from scene images by using dynamic knowledge base is disclosed. The method includes segmenting a scene image captured by at least one camera into a plurality of image segments. Each of the plurality of image segments include a plurality of pixels. The method further includes detecting at least one object in each of the plurality of image segments. The method includes finding a plurality of similar images from an online database based on the at least one object. The method further includes identifying using a knowledge base engine, at least one similar object in the plurality of similar images. The method includes updating the knowledge base engine based on the at least one similar object identified from the plurality of similar images. The method further includes training a neural network to detect objects from scene images, based on the updated knowledge base engine.