A light receiving device includes a substrate, a first contact layer disposed on a surface of the substrate, a light receiving layer disposed on the first contact layer, an intermediate layer disposed on the light receiving layer, a wide-gap layer having a pn junction disposed on the intermediate layer, a second contact layer disposed on the wide-gap layer, and a groove formed for pixel isolation by removing the second contact layer and part of the wide-gap layer, wherein the intermediate layer has a wider band gap than the light receiving layer, and wherein the wide-gap layer has a wider band gap than the intermediate layer.