An image sensor may have a pixel array, and the pixel array may include a plurality of image pixels that gather image data and a plurality of phase detection pixels that gather phase information. The phase detection pixels may be arranged in phase detection pixel blocks, and each phase detection pixel group may include edge pixels. The edge pixels of each phase detection pixel group may be covered by microlenses that also cover a portion of a center pixel. The pixel array may also include high dynamic range pixel blocks. Each high dynamic range pixel block may include pixels within the phase detection pixel block and other pixels (e.g., corner pixels). A subset of the plurality of image pixels in the pixel array may be arranged in pixel blocks. Each pixel block may include a phase detection pixel block and a high dynamic range pixel block.