Exemplary embodiments are directed to a system for selective replacement of an object in an image. The system includes an interface configured to receive as input an original image and a background image, and a processing device in communication with the interface. The processing device is configured to process the original image using a neural network to detect one or more objects in the original image, generate a neural network mask of the original image for the one or more objects in the original image, generate a filtered original image including the original image without the one or more objects, generate a modulated background image including a replacement background based on the neural network mask, and generate a combined image including the filtered original image combined with the modulated background image.