A lensless holographic imaging system having a holographic optical element includes: a coherent light source for outputting a first light beam and a second light beam, wherein the first light beam irradiates a first inspection plane to form first object-diffracted light; a light modulator for modulating the second light beam into reading light having a specific wavefront; a multiplexed holographic optical element, wherein the first object-diffracted light passes through the multiplexed holographic optical element, and the reading light is input into the multiplexed holographic optical element to generate a diffracted light beam as system reference light; and an image capture device for reading at least one interference signal generated by interference between the first object-diffracted light and the system reference light. The lensless holographic imaging system has a relatively small volume and relatively high diffraction efficiency.