Certain aspects of the present disclosure provide techniques for performing inferences in a distributed computing environment. An example method generally includes receiving a request to perform an inference with respect to a set of input data. One or more client devices are selected for use in performing the inference with respect to the set of input data. A request to perform the inference is transmitted to the selected one or more client devices. The request generally includes an anonymized, vectorized version of the set of input data such that the selected one or more client devices are to perform the inference based on anonymized data. An inference response is received from each of the selected one or more client devices. An aggregated inference response is generated based on the inference response received from each respective client device of the selected one or more client devices and a reputation score associated with the respective client device, and the aggregated inference response is output to a requesting service.