A system and method are disclosed living room movie creation. Movies can be directed, captured, and edited using a system that includes a depth camera. A virtual movie set can be created by using ordinary objects in the living room as virtual props. The system is able to capture motions of actors using the depth camera and to generate a movie based thereon. Therefore, there is no need for the actors to wear any special markers to detect their motion. A director may view scenes from the perspective of a “virtual camera” and record those scenes for later editing.