An optical element includes a semiconductor layer having an energy band gap larger than a photon energy of light, and a plurality of electrodes in electrical contact with the semiconductor layer. At least one of the electrodes forms a Schottky junction between the electrode and the semiconductor layer; the Schottky junction has a barrier height smaller than the photon energy of the light. At least part of a junction surface between the electrode that forms the Schottky junction and the semiconductor layer includes a light irradiation surface arranged to be irradiated with the light from a surface of the semiconductor layer without the electrodes, and a portion of a coupling structure arranged to be coupled to a terahertz wave that is generated or detected through the irradiation with the light.