A vision system of a vehicle includes a display configured to be disposed in the vehicle so as to be operable to display images for viewing by an occupant of the vehicle. The display includes a light field display. The system may include at least one camera configured to be disposed at a vehicle so as to have a respective field of view exterior of the vehicle, whereby the display may display images derived from image data captured by the at least one camera. The vision system may include a head-up display system having the light field display disposed at or in the instrumental panel and projecting images onto a combiner on top of the dashboard facing the driver of the vehicle.