-
51.
公开(公告)号:US11593626B2
公开(公告)日:2023-02-28
申请号:US16180536
申请日:2018-11-05
Applicant: Imagination Technologies Limited
Inventor: James Imber , Cagatay Dikici
Abstract: A histogram-based method of selecting a fixed point number format for representing a set of values input to, or output from, a layer of a Deep Neural Network (DNN). The method comprises obtaining a histogram that represents an expected distribution of the set of values of the layer, each bin of the histogram is associated with a frequency value and a representative value in a floating point number format; quantising the representative values according to each of a plurality of potential fixed point number formats; estimating, for each of the plurality of potential fixed point number formats, the total quantisation error based on the frequency values of the histogram and a distance value for each bin that is based on the quantisation of the representative value for that bin; and selecting the fixed point number format associated with the smallest estimated total quantisation error as the optimum fixed point number format for representing the set of values of the layer.
-
公开(公告)号:US20220101102A1
公开(公告)日:2022-03-31
申请号:US17481588
申请日:2021-09-22
Applicant: Imagination Technologies Limited
Inventor: Ivaxi Sheth , Aria Ahmadi , James Imber , Cagatay Dikici
Abstract: A data processing system and method are disclosed, for implementing a windowed operation in at least three traversed dimensions. The data processing system maps the windowed operation in at least three traversed dimensions to a plurality of constituent windowed operations in two traversed dimensions. This plurality of 2-D windowed operations is implemented as such in at least one hardware accelerator. The data processing system assembles the results of the constituent 2-D windowed operations to produce the result of the windowed operation in at least three traversed dimensions.
-
公开(公告)号:US20210125047A1
公开(公告)日:2021-04-29
申请号:US17141349
申请日:2021-01-05
Applicant: Imagination Technologies Limited
Inventor: James Imber
Abstract: Methods for determining a fixed point format for one or more layers of a DNN based on the portion of the output error of the DNN attributed to the fixed point formats of the different layers. Specifically, in the methods described herein the output error of a DNN attributable to the quantisation of the weights or input data values of each layer is determined using a Taylor approximation and the fixed point number format of one or more layers is adjusted based on the attribution. For example, where the fixed point number formats used by a DNN comprises an exponent and a mantissa bit length, the mantissa bit length of the layer allocated the lowest portion of the output error may be reduced, or the mantissa bit length of the layer allocated the highest portion of the output error may be increased. Such a method may be iteratively repeated to determine an optimum set of fixed point number formats for the layers of a DNN.
-
公开(公告)号:US20190227893A1
公开(公告)日:2019-07-25
申请号:US16181104
申请日:2018-11-05
Applicant: Imagination Technologies Limited
Inventor: James Imber
Abstract: Methods for determining a fixed point format for one or more layers of a DNN based on the portion of the output error of the DNN attributed to the fixed point formats of the different layers. Specifically, in the methods described herein the output error of a DNN attributable to the quantisation of the weights or input data values of each layer is determined using a Taylor approximation and the fixed point number format of one or more layers is adjusted based on the attribution. For example, where the fixed point number formats used by a DNN comprises an exponent and a mantissa bit length, the mantissa bit length of the layer allocated the lowest portion of the output error may be reduced, or the mantissa bit length of the layer allocated the highest portion of the output error may be increased. Such a method may be iteratively repeated to determine an optimum set of fixed point number formats for the layers of a DNN.
-
公开(公告)号:US10185888B2
公开(公告)日:2019-01-22
申请号:US15335607
申请日:2016-10-27
Applicant: Imagination Technologies Limited
Inventor: James Imber , Adrian Hilton , Jean-Yves Guillemaut
Abstract: An image processing system and method for determining an intrinsic color component of one or more objects present in a sequence of frames, for use in rendering the object(s), is described. At least some of the frames of the sequence are to be used as lighting keyframes. A lighting estimate for a lighting keyframe A of the sequence of frames is obtained. An initial lighting estimate for a lighting keyframe B of the sequence of frames is determined. A refined lighting estimate for the lighting keyframe B is determined based on: (i) the initial lighting estimate for the lighting keyframe B, and (ii) the lighting estimate for the lighting keyframe A. The refined lighting estimate for the lighting keyframe B is used to separate image values representing the object(s) in the lighting keyframe B into an intrinsic color component and a shading component, for use in rendering the object(s).
-
56.
公开(公告)号:US10055826B2
公开(公告)日:2018-08-21
申请号:US15335567
申请日:2016-10-27
Applicant: Imagination Technologies Limited
Inventor: James Imber , Adrian Hilton , Jean-Yves Guillemaut
CPC classification number: G06T5/20 , G06T7/60 , G06T7/90 , G06T15/04 , G06T15/80 , G06T2200/04 , G06T2200/28 , G06T2207/10016 , G06T2207/10024 , G06T2207/10028 , G06T2207/20028 , H04N9/045 , H04N9/07 , H04N13/204
Abstract: An image processing system and method for determining a set of surface normals of one or more objects for use in rendering the object(s) is described. One or more input images are received, each representing a view of the object(s). A depth image is received representing depth values of the object(s). Coarse surface normal estimates are determined based on depth values of the received depth image. The set of surface normals are determined by applying bilateral filtering to the coarse surface normal estimates. The bilateral filtering uses bilateral filtering guidance terms based on luminance values derived from the input image, wherein the determined set of surface normals are for use in rendering the object(s).
-
公开(公告)号:US09911200B2
公开(公告)日:2018-03-06
申请号:US14544122
申请日:2014-11-26
Applicant: Imagination Technologies Limited
Inventor: James Imber , Adrian Hilton , Jean-Yves Guillemaut
IPC: G06T11/00 , G06T7/40 , G06T7/90 , G06T7/507 , G06T15/04 , G06T15/06 , G06T15/10 , G06T15/50 , G06T11/60 , G06T15/80 , G06T17/00
CPC classification number: G06T7/90 , G06T7/507 , G06T11/001 , G06T11/60 , G06T15/04 , G06T15/06 , G06T15/10 , G06T15/50 , G06T15/80 , G06T17/00 , G06T2207/20224 , G06T2215/16
Abstract: Relightable free-viewpoint rendering allows a novel view of a scene to be rendered and relit based on multiple views of the scene from multiple camera viewpoints. Image values from the multiple camera viewpoints can be separated into diffuse image components and specular image components, such that an intrinsic color component of a relightable texture can be determined for a specular scene, by using the separated diffuse image components. Furthermore, surface normals of geometry in the scene can be refined by constructing a height map based on a conservative component of an initial surface normal field and then determining the refined surface normals based on the constructed height map.
-
公开(公告)号:US09875554B2
公开(公告)日:2018-01-23
申请号:US14544121
申请日:2014-11-26
Applicant: Imagination Technologies Limited
Inventor: James Imber , Adrian Hilton , Jean-Yves Guillemaut
IPC: G06T15/04 , G06T7/40 , G06T7/90 , G06T7/507 , G06T15/06 , G06T15/10 , G06T15/50 , G06T11/00 , G06T11/60 , G06T15/80 , G06T17/00
CPC classification number: G06T7/90 , G06T7/507 , G06T11/001 , G06T11/60 , G06T15/04 , G06T15/06 , G06T15/10 , G06T15/50 , G06T15/80 , G06T17/00 , G06T2207/20224 , G06T2215/16
Abstract: Relightable free-viewpoint rendering allows a novel view of a scene to be rendered and relit based on multiple views of the scene from multiple camera viewpoints. Image values from the multiple camera viewpoints can be separated into diffuse image components and specular image components, such that an intrinsic color component of a relightable texture can be determined for a specular scene, by using the separated diffuse image components. Furthermore, surface normals of geometry in the scene can be refined by constructing a height map based on a conservative component of an initial surface normal field and then determining the refined surface normals based on the constructed height map.
-
公开(公告)号:US20170323197A1
公开(公告)日:2017-11-09
申请号:US15585645
申请日:2017-05-03
Applicant: Imagination Technologies Limited
Inventor: Clifford Gibson , James Imber
Abstract: A method of configuring a hardware implementation of a Convolutional Neural Network (CNN), the method comprising: determining, for each of a plurality of layers of the CNN, a first number format for representing weight values in the layer based upon a distribution of weight values for the layer, the first number format comprising a first integer of a first predetermined bit-length and a first exponent value that is fixed for the layer; determining, for each of a plurality of layers of the CNN, a second number format for representing data values in the layer based upon a distribution of expected data values for the layer, the second number format comprising a second integer of a second predetermined bit-length and a second exponent value that is fixed for the layer; and storing the determined number formats for use in configuring the hardware implementation of a CNN.
-
公开(公告)号:US20170161938A1
公开(公告)日:2017-06-08
申请号:US15433211
申请日:2017-02-15
Applicant: Imagination Technologies Limited
Inventor: James Imber , Adrian Hilton
CPC classification number: G06T15/506 , G06T7/11 , G06T7/44 , G06T7/49 , G06T7/90 , G06T15/04 , G06T15/10 , G06T15/50 , G06T15/503 , G06T15/80 , G06T19/20 , G06T2207/10004 , G06T2207/10016 , G06T2207/10024 , G06T2207/10028 , G06T2207/20016 , G06T2207/20021 , G06T2207/20028
Abstract: Relightable free-viewpoint rendering allows a novel view of a scene to be rendered and relit based on multiple views of the scene from multiple camera viewpoints. An initial texture can be segmented into materials and an initial coarse colour estimate is determined for each material. Scene geometry is estimated from the captured views of the scene and is used to scale the initial coarse colour estimates relative to each other such that the different materials appear to be lit with a similar irradiance. In this way, a global irradiance function is estimated describing the scene illumination. This provides a starting point for a colour estimate and shading estimate extraction. The shading estimate can be used to fit surface normals to the global irradiance function. The set of surface normals and the colour estimate are stored for subsequent use to allow relighting of the scene.
-
-
-
-
-
-
-
-
-