An application of Q-value-based dynamic programming with Boltzmann distribution to real-world road networks

Authors

  • Shanqing Yu,

    Non-Member, Corresponding author
    1. Graduate School of Information, Production and Systems, Waseda University, Hibikino 2-7, Wakamatsu-ku, Kitakyushu, Fukuoka 808-0135, Japan
    • Graduate School of Information, Production and Systems, Waseda University, Hibikino 2-7, Wakamatsu-ku, Kitakyushu, Fukuoka 808-0135, Japan
    Search for more papers by this author
  • Shingo Mabu,

    Member
    1. Graduate School of Information, Production and Systems, Waseda University, Hibikino 2-7, Wakamatsu-ku, Kitakyushu, Fukuoka 808-0135, Japan
    Search for more papers by this author
  • Manoj Kanta Mainali,

    Non-Member
    1. Graduate School of Information, Production and Systems, Waseda University, Hibikino 2-7, Wakamatsu-ku, Kitakyushu, Fukuoka 808-0135, Japan
    Search for more papers by this author
  • Kaoru Shimada,

    Member
    1. Graduate School of Information, Production and Systems, Waseda University, Hibikino 2-7, Wakamatsu-ku, Kitakyushu, Fukuoka 808-0135, Japan
    Search for more papers by this author
  • Kotaro Hirasawa

    Member
    1. Graduate School of Information, Production and Systems, Waseda University, Hibikino 2-7, Wakamatsu-ku, Kitakyushu, Fukuoka 808-0135, Japan
    Search for more papers by this author

Abstract

In order to alleviate traffic congestion and improve the efficiency of traffic systems from a global perspective, a dynamic traffic management model is proposed in this paper. The proposed model is applied to the large-scale microscopic simulator SOUND/4U based on the real-world road network of Kurosaki, Kitakyushu, Japan. All the vehicles in the simulator follow the direction from the route guidance of the dynamic traffic management model, in which the extended Q-value-based dynamic Programming with Boltzmann distribution (QDP-BD) and the time-varying traffic information are used to generate the routes from the origins to the destinations. The simulation results show that the proposed QDP-BD can reduce traffic congestion and improve the efficiency of the whole traffic system effectively compared with the greedy method in the real-world road network. © 2013 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.

Ancillary