APPARATUS AND METHOD FOR CONFIGURING A COMMUNICATION LINK

    公开(公告)号:US20210100067A1

    公开(公告)日:2021-04-01

    申请号:US17121335

    申请日:2020-12-14

    Abstract: An apparatus and method are provided for configuring a communication link. The apparatus has a plurality of antenna elements to support RF communication over a communication link using a plurality of frequency channels, a plurality of RF processing circuits, and configuration circuitry to apply a selected configuration from a plurality of different configurations, where each configuration identifies which RF processing circuit each antenna element is coupled to, and which frequency channel is allocated to each RF processing circuit. The configuration circuitry is arranged to employ a reinforcement learning process in order to dynamically alter which of the plurality of different configurations to apply as a currently selected configuration. The reinforcement learning process comprises maintaining a future rewards record having a plurality of entries, where each entry maintains, for an associated combination of link state and configuration, an estimated future rewards indication determined using a discounted rewards mechanism. A selection policy is employed to select a configuration for a current link state, and then a new reward is observed that is dependent on how the selected configuration alters a chosen performance metric for the communication link. The estimated future rewards indication in the associated entry is then updated in dependence on the new reward. The updating comprises, when the associated entry is first encountered following a reset event, the storing in the associated entry of a predicted estimated future rewards indication generated by assuming, when using the discounted rewards mechanism, that all rewards that will be used in future to update the estimated future rewards indication in the associated entry will have the same value as the new reward.

Patent Agency Ranking