Aspects of this disclosure relate to directing the movement of instrument such as medical devices. For example, data regarding an ongoing physical of an instrument that is configured to gather spatial data via physical manipulation of the instrument for a procedure is received. A current orientation of the instrument is determined. Additional spatial data to gather for the procedure is determined. A subsequent physical manipulation on how to physically maneuver the instrument relative to the current orientation to gather the additional spatial data is determined. Real-time feedback on how to execute the subsequent physical manipulation is provided.