A polarization conversion element having plural polarization separation sections and plural phase modulation sections is disclosed. A light flux is separated into transmission light (P polarization) and reflection light (S polarization) by being input to a polarization separation section. The reflection light reflected at the polarization separation section is output in the same direction as that of the transmission light by being reflected again at an adjacent polarization separation section at a different position from a position where a light flux is input to the adjacent polarization separation section. The phase modulation section is disposed on an optical path of the transmission light or the reflection light and output light becomes the same polarization.