According to some embodiments, systems, methods, apparatus and computer program code for converting 2D video data to 3D video data includes receiving a two dimensional (2D) video feed from a video camera, the feed including a set of image frames, the frames together forming a panorama image, generating a background depth map, extracting for each of the image frames a set of image frame depth maps from the background depth map, generating an updated depth map using the set of image frame depth maps and the background depth map, and rendering an output image, the output image based on the panorama image and the updated depth map, the output image and the panorama image together forming a stereoscopic image pair.