There is provided a light source unit including an excitation light source which emits excitation light, a luminescent material which receives excitation light from the excitation light source to emit luminous light, a diffuse plate on which the luminous light is incident, and a driving device which moves the diffuse plate so as to change an entering position of the luminous light on the diffuse plate.