A method of summarizing events in a video recording includes evaluating at least one video recording to identify event that violate at least one rule. The method further includes excerpting a fragment of the at least one video recording. The fragment contains a depiction of the event. The method also includes causing the fragment to be included in a summary video recording. The rules may relate to a threshold amount of motion in a physical space being recorded in the at least one received video recording, or a threshold duration of motion in a physical space being recorded in the at least one received video recording.