Methods and systems for optimizing distributed workloads on information handling systems involve determining workload attributes for a computing task for distributed execution among distributed information handling systems. The workload attributes are used to dynamically determine optimal allocation and configuration of distributed hardware resources at the distributed information handling systems. After dynamic confirmation of the allocation and configuration of the distributed hardware resources, the computing task is segmented for distributed execution.