Technologies for provisioning jobs to servers at a datacenter include a compute device to identify a class of each of a plurality of available servers in the datacenter, wherein the class is indicative of a set of hardware included on the corresponding server. The compute device selects a workload that includes a plurality of jobs to provision to a subset of the available servers and determines a provisioning configuration for the workload from a set of prospective configurations as a function of a rack utilization of each prospective configuration, the classes utilized by each prospective configuration, and a number of racks utilized by each prospective configuration. The provisioning configuration identifies a subset of the available servers to which to provision the jobs of the workload.