In an optical display system that includes a waveguide with multiple diffractive optical elements (DOEs), one or more of the DOEs is configured with gratings that have varying depth and varying directions for depth modulation, in which the modulation direction is aligned with the steepest change (i.e., slope) of grating depth. Depth modulation direction may change at a point of transition between different regions in the DOE. For example, with a zero axis being defined along a line parallel to a long side of a DOE, the depth modulation direction can change from a negative angle, with respect to the axis in the plane of the waveguide in one region, to a positive angle in another region, or vice versa. By varying depth modulation direction in a DOE, display uniformity in the optical display system may be increased.