A surround view system for a vehicle includes: a three-dimensional geometry unit configured to receive vehicle surrounding environment data and generate a three-dimensional model of a vehicle surrounding environment based on the received vehicle surrounding environment data; and a view generation unit configured to receive visual data and map the visual data to portions of the three-dimensional model based on the spatial and/or temporal information of the visual data and the vehicle surrounding environment data to form a virtual surround view.