System and method of performing various transformations between an omnidirectional image model and a rectilinear image model for use in vehicle imaging systems. In particular, a panel transform system and method for transforming an omnidirectional image from an omnidirectional camera positioned on a vehicle to a rectilinear image. The rectilinear image is then displayed to the driver for use while performing vehicle maneuvers. The panel transform system and method also provide a rectilinear image model based on the omnidirectional camera for use with existing rectilinear imaging processing systems. The rectilinear image model is determined based on a variable set of input parameters that are defined by both automatic and manual system inputs such as a steering wheel angle sensor and a user interface.