A plurality of frames of a video recorded by a video camera and depth maps of the plurality of frames are stored in a data storage. One or more target video camera positions are determined. Each frame of the plurality of frames is associated with one or more of the target video camera positions. For each frame, one or more synthesized frames from the viewpoint of the one or more target camera positions associated with that frame are generated by applying a view interpolation algorithm to that frame using the color pixels of that frame and the depth map of that frame. Users can provide their input about the new camera positions and other camera parameters through multiple input modalities. The synthesized frames are concatenated to create a modified video. Other embodiments are also described and claimed.