Provided is a panoramic video composition apparatus that suppresses a double image or a defect of an object even when the object moves to traverse an overlap region between cameras. In a panoramic video composition apparatus that composes a panoramic video by coupling a plurality of videos, the panoramic video composition apparatus includes an afterimage generation unit 10 configured to acquire a background image as a background and a reference image as a reference of the panoramic video from frame images constituting a video for each of videos from different angles of view, extract moving regions in which an object moves from differences between the background image and the frame images, and generate an afterimage by overlapping the extracted moving regions in order of the frame images, a feature point calculation unit 20 configured to obtain a plurality of feature points from each of the reference image and the afterimage, generate a set of feature points by adding the feature points, and calculate a feature value of each feature point, and a transformation parameter generation unit 30 configured to search for feature points of which feature values match each other by comparing the feature points of the set of feature points before and after the frame image, and generate a first transformation parameter indicating a degree of distorting the frame image from differences between coordinates of the feature points.