公开(公告)号：US11514667B1

公开(公告)日：2022-11-29

申请号：US17704202

申请日：2022-03-25

Applicant: Tsinghua University

Inventor： Lu Fang ,  Tiankuang Zhou ,  Siyuan Gu ,  Xiaoyun Yuan ,  Qionghai Dai

IPC: G06V10/82 ,  G06V10/774 ,  G06V10/145 ,  G06N3/067

Abstract: A method and an apparatus for camera-free light field video processing with all-optical neural network are disclosed. The method includes: mapping the light field video by a digital micro-mirror device (DMD) and an optical fiber coupler, a two-dimensional 2D spatial optical signal into a one-dimensional 1D input optical signal; realizing a multiply-accumulate computing model in a structure of all-optical recurrent neural network structure, and processing the 1D input signal to obtain the processed signal; and receiving the processed signal and outputting an electronic signal by a photodetector, or receiving the processed signal by a relay optical fiber for relay transmission of the processed signal. The method and system here realize light field video processing without the use of a camera and the whole system is all-optical, thus possessing the advantage in computing speed and energy-efficiency.