-
公开(公告)号:US11363218B2
公开(公告)日:2022-06-14
申请号:US17125587
申请日:2020-12-17
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner
IPC: H04N5/351 , H04N5/3745 , H04N5/345 , H04N5/378
Abstract: According to the present invention there is provided a vision sensor comprising, an array of pixels (101) comprising rows and columns of pixels, wherein each pixel has an address assigned thereto which represents the position of the pixel in the array, wherein each pixel in the array of pixels comprises a photodiode (103) which can receive light, and which can output current having an amplitude proportional to the intensity of the received light; a photoreceptor circuit (104) which is electronically connected to the photodiode, and which is configured to convert current which it receives from the photodiode into a voltage; a first storage capacitor (105), and at least a first switch which (106) is positioned between the first storage capacitor and an output of the photoreceptor circuit, wherein the first switch can be selectively closed to electronically connect the output of the photoreceptor circuit to the first storage capacitor, or selectively opened to electronically disconnect the output of the photoreceptor circuit from the first storage capacitor; and a circuit (102, 201) which is configured so that it can he selectively electronically connected to a pixel in the array, and to determine if the difference between the voltage output from the photoreceptor circuit and the voltage across the first storage capacitor is greater than a predefined threshold voltage, and to output the address of the pixel to a receiver only if the difference between the voltage output from the photoreceptor circuit and the voltage across the first storage capacitor is greater than a predefined threshold voltage. There is further provided a corresponding method of vision sensing using the vision sensor.
-
公开(公告)号:US11212468B2
公开(公告)日:2021-12-28
申请号:US16297273
申请日:2019-03-08
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner , Christian Brändli , Massimo Zannoni
Abstract: An event-based vision sensor system comprises an event-based pixel array including pixels that detect light, a readout circuit for reading out events associated with light received by each pixel and with the position it occupies in the array, and a memory controller that enables writing of each event, or event-related data, associated with a certain pixel to a certain address in a memory.
-
公开(公告)号:US20210144317A1
公开(公告)日:2021-05-13
申请号:US17125587
申请日:2020-12-17
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner
IPC: H04N5/351 , H04N5/3745 , H04N5/345 , H04N5/378
Abstract: According to the present invention there is provided a vision sensor comprising, an array of pixels (101) comprising rows and columns of pixels, wherein each pixel has an address assigned thereto which represents the position of the pixel in the array, wherein each pixel in the array of pixels comprises a photodiode (103) which can receive light, and which can output current having an amplitude proportional to the intensity of the received light; a photoreceptor circuit (104) which is electronically connected to the photodiode, and which is configured to convert current which it receives from the photodiode into a voltage; a first storage capacitor (105), and at least a first switch which (106) is positioned between the first storage capacitor and an output of the photoreceptor circuit, wherein the first switch can he selectively closed to electronically connect the output of the photoreceptor circuit to the first storage capacitor, or selectively opened to electronically disconnect the output of the photoreceptor circuit from the first storage capacitor; and a circuit (102, 201) which is configured so that it can he selectively electronically connected to a pixel in the array, and to determine if the difference between the voltage output from the photoreceptor circuit and the voltage across the first storage capacitor is greater than a predefined threshold voltage, and to output the address of the pixel to a receiver only if the difference between the voltage output from the photoreceptor circuit and the voltage across the first storage capacitor is greater than a predefined threshold voltage. There is further provided a corresponding method of vision sensing using the vision sensor.
-
公开(公告)号:US20240292127A1
公开(公告)日:2024-08-29
申请号:US18652982
申请日:2024-05-02
Applicant: SONY ADVANCED VISUAL SENSING AG
Inventor: Raphael Berner , Christian Brändli
IPC: H04N25/75 , G01J1/46 , G06F11/00 , G06T7/20 , H04N25/40 , H04N25/47 , H04N25/571 , H04N25/766 , H04N25/77 , H04N25/772
CPC classification number: H04N25/75 , G01J1/46 , G06F11/004 , G06T7/20 , H04N25/40 , H04N25/47 , H04N25/573 , H04N25/766 , H04N25/77 , H04N25/772 , G06F2201/86 , G06F2201/88
Abstract: A dynamic vision sensor (DVS) or change detection sensor reacts to changes in light intensity and in this way monitors how a scene changes. This disclosure covers both single pixel and array architectures. The DVS may contain one pixel or 2-dimensional or 1-dimensional array of pixels. The change of intensities registered by pixels are compared, and pixel addresses where the change is positive or negative are recorded and processed. Analyzing frames based on just three values for pixels, increase, decrease or unchanged, the proposed DVS can process visual information much faster than traditional computer vision systems, which correlate multi-bit color or gray level pixel values between successive frames.
-
公开(公告)号:US11936995B2
公开(公告)日:2024-03-19
申请号:US17541559
申请日:2021-12-03
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner , Christian Brandli , Massimo Zannoni
CPC classification number: H04N25/50 , H04N25/44 , H04N25/745 , H04N25/75 , H04N25/77 , H04N25/771 , H04N25/79
Abstract: An event-based vision sensor system comprises an event-based pixel array including pixels that detect light, a readout circuit for reading out events associated with light received by each pixel and with the position it occupies in the array, and a memory controller that enables writing of each event, or event-related data, associated with a certain pixel to a certain address in a memory.
-
公开(公告)号:US11856310B2
公开(公告)日:2023-12-26
申请号:US17629488
申请日:2020-09-01
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner
Abstract: An event based pixel sensor system employing delay equalization between differently illuminated pixels.
-
公开(公告)号:US11825218B2
公开(公告)日:2023-11-21
申请号:US17617416
申请日:2020-06-30
Applicant: Sony Advanced Visual Sensing AG
Inventor: Raphael Berner , Marc Osswald , Massimo Zannoni
IPC: H04N25/443 , H04N25/50
CPC classification number: H04N25/443 , H04N25/50
Abstract: An event based pixel sensor system employs regions of interest or regions of non-interest, which are preferably dynamic, to isolate change events and reduce data from non-interesting events.
-
公开(公告)号:US20230328406A1
公开(公告)日:2023-10-12
申请号:US18206634
申请日:2023-06-07
Applicant: SONY ADVANCED VISUAL SENSING AG
Inventor: Raphael Berner , Christian Brändli
IPC: H04N25/75 , H04N25/40 , H04N25/77 , H04N25/571 , H04N25/766 , H04N25/772 , H04N25/47 , G01J1/46 , G06F11/00 , G06T7/20
CPC classification number: H04N25/75 , H04N25/40 , H04N25/77 , H04N25/573 , H04N25/766 , H04N25/772 , H04N25/47 , G01J1/46 , G06F11/004 , G06T7/20 , G06F2201/86 , G06F2201/88
Abstract: A dynamic vision sensor (DVS) or change detection sensor reacts to changes in light intensity and in this way monitors how a scene changes. This disclosure covers both single pixel and array architectures. The DVS may contain one pixel or 2-dimensional or 1-dimensional array of pixels. The change of intensities registered by pixels are compared, and pixel addresses where the change is positive or negative are recorded and processed. Analyzing frames based on just three values for pixels, increase, decrease or unchanged, the proposed DVS can process visual information much faster than traditional computer vision systems, which correlate multi-bit color or gray level pixel values between successive frames.
-
公开(公告)号:US11711631B2
公开(公告)日:2023-07-25
申请号:US17366392
申请日:2021-07-02
Applicant: SONY ADVANCED VISUAL SENSING AG
Inventor: Raphael Berner , Christian Brändli
IPC: H04N25/77 , H04N25/571 , H04N25/772 , H04N25/47 , H04N25/75 , H04N25/40 , H04N25/766 , G01J1/46 , G06F11/00 , G06T7/20
CPC classification number: H04N25/75 , G01J1/46 , G06F11/004 , G06T7/20 , H04N25/40 , H04N25/47 , H04N25/573 , H04N25/766 , H04N25/77 , H04N25/772 , G06F2201/86 , G06F2201/88
Abstract: A dynamic vision sensor (DVS) or change detection sensor reacts to changes in light intensity and in this way monitors how a scene changes. This disclosure covers both single pixel and array architectures. The DVS may contain one pixel or 2-dimensional or 1-dimensional array of pixels. The change of intensities registered by pixels are compared, and pixel addresses where the change is positive or negative are recorded and processed. Analyzing frames based on just three values for pixels, increase, decrease or unchanged, the proposed DVS can process visual information much faster than traditional computer vision systems, which correlate multi-bit color or gray level pixel values between successive frames.
-
公开(公告)号:US20230185372A1
公开(公告)日:2023-06-15
申请号:US18080148
申请日:2022-12-13
Applicant: Sony Advanced Visual Sensing AG
Inventor: Christian Brandli , Raphael Berner , Michael Gassner
CPC classification number: G06F3/013 , G06V20/20 , G06T15/205 , G06T19/006 , G06T2215/16
Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.
-
-
-
-
-
-
-
-
-