Certain aspects of the present disclosure provide techniques for performing finite rank deep kernel learning. In one example, a method for performing finite rank deep kernel learning includes receiving a training dataset; forming a set of embeddings by subjecting the training dataset to a deep neural network; forming, from the set of embeddings, a plurality of dot kernels; linearly combining the plurality of dot kernels to form a composite kernel for a Gaussian process; receiving live data from an application; and predicting a plurality of values and a plurality of uncertainties associated with the plurality of values simultaneously using the composite kernel.