An autonomous control system of a self-driving semi-truck can monitor a dynamic orientation of a cargo trailer in relation to a tractor of the semi-trailer truck. Based on the dynamic orientation of the cargo trailer, the control system can dynamically generate a coordinate transform between a first reference frame of a first set of sensors mounted to the tractor, and a second reference frame of a second set of sensors mounted to the cargo trailer, and execute the dynamically generated coordinate transform on sensor data from the second set of sensors to generate a fused sensor view of a surrounding environment of the self-driving semi-truck.