The present disclosure relates to systems, methods, and non-transitory computer readable media that utilize a continuous kernel neural network that learns continuous reconstruction kernels to merge digital image samples in local neighborhoods and generate enhanced digital images from a plurality of burst digital images. For example, the disclosed systems can utilize an alignment model to align image samples from burst digital images to a common coordinate system (e.g., without resampling). In some embodiments, the disclosed systems generate localized latent vector representations of kernel neighborhoods and determines continuous displacement vectors between the image samples and output pixels of the enhanced digital image. The disclosed systems can utilize the continuous kernel network together with the latent vector representations and continuous displacement vectors to generated learned kernel weights for combining the image samples and generating an enhanced digital image.