A ray tracing image processing system may use a plurality of processing elements to render a two dimensional image from a three dimensional scene. A first portion of the processing elements may function as workload managers responsible for performing operations relating to traversing a ray through a spatial index, and a second portion of the processing elements may function as vector throughput engines responsible for performing operations relating to determining if a ray intersects primitives contained within bounding volumes. By monitoring workloads experienced by the processing elements for a particular frame, processing element function may be reallocated such that for a subsequent frame the workload experienced by processing elements in the image processing system may be balanced. Balanced workload may improve the performance of the image processing system.