Provided is an image capturing system comprising an irradiating section that sequentially irradiates an observed position with a plurality of types of irradiation light having different polarizations; a polarization filter section that includes a plurality of polarization filter units, which each include a plurality of returned polarized light filters that each pass light having a different polarization, the polarization filter section passing returned light from the observed position having each of the plurality of polarizations; and a light receiving section that receives the returned light passed by the polarization filter section having each of the plurality of polarizations.