- Patent Title: Method and system for adaptive cycle-level traffic signal control
-
Application No.: US17327523Application Date: 2021-05-21
-
Publication No.: US11783702B2Publication Date: 2023-10-10
- Inventor: Soheil Mohamad Alizadeh Shabestary , Baher Abdulhai , Hao Hai Ma , Yi Huo
- Applicant: HUAWEI CLOUD COMPUTING TECHNOLOGIES CO., LTD.
- Applicant Address: CN Gui'an New District
- Assignee: HUAWEI CLOUD COMPUTING TECHNOLOGIES CO., LTD
- Current Assignee: HUAWEI CLOUD COMPUTING TECHNOLOGIES CO., LTD
- Current Assignee Address: CN Gui'an New District
- Main IPC: G08G1/07
- IPC: G08G1/07 ; G08G1/01 ; G08G1/052 ; G06N20/00

Abstract:
Methods, systems, and processor-readable media for adaptive cycle-level traffic signal control are described. An adaptive cycle-level traffic signal controller and control method that operate within a continuous action space. A reinforcement learning algorithm called Proximal Policy Optimization (PPO), which is a type of actor-critic model for reinforcement learning, may be used to generate signal cycle phase durations selected from a continuous range of values. The controller thus does not treat the action space as discrete, but instead produces continuous values as output. The generated phase durations may define a full traffic signal cycle. The inputs to the controller may indicate current and past states of the traffic environment. The average duration of delay of vehicles in the traffic environment may be used to calculate the reward for the reinforcement learning model that drives the behavior of the controller.
Public/Granted literature
- US20220092973A1 METHOD AND SYSTEM FOR ADAPTIVE CYCLE-LEVEL TRAFFIC SIGNAL CONTROL Public/Granted day:2022-03-24
Information query