Methods and systems for enhancing a distributed medical network. For example, a computer-implemented method includes inputting training data corresponding to each local computer into their corresponding machine learning model; generating a plurality of local losses including generating a local loss for each machine learning model based at least in part on the corresponding training data; generating a plurality of local parameter gradients including generating a local parameter gradient for each machine learning model based at least in part on the corresponding local loss; generating a global parameter update based at least in part on the plurality of local parameter gradients; and updating each machine learning model hosted at each local computer of the plurality of local computers by at least updating their corresponding active parameter set based at least in part on the global parameter update.