A system and method for group-based media composition is disclosed. This system has three modules. The first one is a grouping module, which associates content files into groups. This allows content files to be grouped logically or temporally. The second module is an operation selection module, which allows operations to be applied to each content file. The third module is a composition module, which uses the grouping and content operation information to create a desired composition.