Provided are an upscaling device, an upscaling method, and an upscaling program capable of keying processing at low cost and with high accuracy. An upscaling device includes an image obtaining section configured to obtain a high-resolution input image illustrating a background and a foreground, a low-resolution input image obtained by converting the high-resolution input image into a low-resolution image, and a low-resolution alpha image illustrating a region of the foreground in the low-resolution input image; a correlation obtaining section configured to obtain correlation between grayscale information of the low-resolution input image and an alpha value of the low-resolution alpha image for each corresponding pixel pair of the low-resolution input image and the low-resolution alpha image, and upscale the correlation into a resolution of the high-resolution input image; and an output section configured to output a high-resolution alpha image having a resolution same as that of the high-resolution input image on a basis of the high-resolution input image and the upscaled correlation.