A virtual image display device includes a light source unit, a polarization switching unit, an image generation unit, an optical path unit and a projection unit. The polarization switching unit switches a polarization direction of a light beam emitted from the light source unit. The optical path unit includes a first optical path through which the light beam having the first polarization direction travels and a second optical path through which the light beam having the second polarization direction travels. A first virtual image is displayed at a first distance with the light beam that has traveled through the first optical path. A second virtual image is displayed at a second distance farther than the first distance with the light beam that has traveled through the second optical path.