An imaging element, an imaging device, and an information processing method are disclosed. In one example, an imaging element includes pixel output units configured for independently setting incident angle directivity for incident light incident through both of an imaging lens and a pinhole. The pixel output units include image restoration pixel output units arranged in a matrix, at least some of the pixel output units having the incident angle directivity both in a row direction and in a column direction of the matrix, and a unidirectional pixel output unit having the incident angle directivity only in the row direction of the matrix or only in the column direction of the matrix.