Abstract

Increasing traffic congestion is a major problem in urban areas, which incurs heavy economic and environmental costs in both developing and developed countries. Efficient urban traffic control (UTC) can help reduce traffic congestion. However, the increasing volume and the dynamic nature of urban traffic pose particular challenges to UTC. Reinforcement Learning (RL) has been shown to be a promising approach to efficient UTC. However, most existing work on RL-based UTC does not adequately address the fluctuating nature of urban traffic. This paper presents Soilse1, a decentralized RL-based UTC optimization scheme that includes a nonparametric pattern change detection mechanism to identify local traffic pattern changes that adversely affect an RL agent's performance. Hence, Soilse is adaptive as agents learn to optimize for different traffic patterns and responsive as agents can detect genuine traffic pattern changes and trigger relearning. We compare the performance of Soilse to two baselines, a fixed-time approach and a saturation balancing algorithm that emulates SCATS, a well-known UTC system. The comparison was performed based on a simulation of traffic in Dublin's inner city centre. Results from using our scheme show an approximate 35%–43% and 40%–54% better performance in terms of average vehicle waiting time and average number of vehicle stops respectively against the best baseline performance in our simulation.


Original document

The different versions of the original document can be found in:

http://dx.doi.org/10.1109/itsc.2010.5625145 under the license cc-by-nc-sa
http://www.tara.tcd.ie/handle/2262/56455,
http://yadda.icm.edu.pl/yadda/element/bwmeta1.element.ieee-000005625145,
https://dblp.uni-trier.de/db/conf/itsc/itsc2010.html#SalkhamC10,
https://ieeexplore.ieee.org/document/5625145,
https://trid.trb.org/view.aspx?id=1096462,
https://academic.microsoft.com/#/detail/1993167666
Back to Top

Document information

Published on 01/01/2010

Volume 2010, 2010
DOI: 10.1109/itsc.2010.5625145
Licence: Other

Document Score

0

Views 0
Recommendations 0

Share this document

Keywords

claim authorship

Are you one of the authors of this document?