A device includes a waveguide, an in-coupling element, and an out-coupling element coupled with the waveguide. The waveguide, the in-coupling element, and the out-coupling element are configured to deliver a plurality of portions of an image light to an eye-box of the device. At least one of the in-coupling element or the out-coupling element includes a polarization selective diffractive element. The polarization selective diffractive element includes a grating including a plurality of microstructures defining a plurality of grooves filled with a passive optically anisotropic material having a first effective refractive index along a groove direction of the grooves and a second effective refractive index along an in-plane direction perpendicular to the groove direction. One of the first effective refractive index or the second effective refractive index substantially matches with a refractive index of the microstructures.