IDEAS home Printed from https://ideas.repec.org/a/eee/transb/v104y2017icp710-732.html
   My bibliography  Save this article

A stochastic optimal control approach for real-time traffic routing considering demand uncertainties and travelers’ choice heterogeneity

Author

Listed:
  • Pi, Xidong
  • Qian, Zhen (Sean)

Abstract

This paper develops a theoretical approach to identify optimal traffic routing strategy for managing transportation systems. It obtains the optimal traffic diversion ratio to each route that can be achieved in real time through cutting-edge sensing and vehicle-infrastructure communication technologies. We minimize the expected total travel time of all travelers in the network by providing and updating routing advice (or incentives) to travelers in real time. The system-optimum traffic routing problem is modeled using the stochastic control approach where demand uncertainty and travelers’ heterogeneity are explicitly considered over time. The approach is generic in the sense that the optimal routing strategies can be achieved through various technologies, such as connected vehicle technologies, navigation systems, variable message signs, dynamic pricing, etc. For a two-route representative network, we use dynamic programming to derive and approximate the analytical solution of the optimal routing policy for each time interval. The optimal diversion ratio can be updated solely upon the traffic counts measured along the preferred route in real time. The general rule is, with a high probability, to minimize the congestion and keep the maximum flow performance on the preferred route from the beginning of the peak hours. Towards the end of the peak hours, the optimal policy would allow more intensive use of the preferred route resulting over-saturation, whereas keeping the minimal use of the alternative route. The analytical solution is validated and examined in a synthesized network and a real-world network in California. It is found that it consistently outperforms the deterministic solution, and its resultant system performance is also reasonably close to the benchmark system optimum where true demand could be precisely known one day ahead.

Suggested Citation

  • Pi, Xidong & Qian, Zhen (Sean), 2017. "A stochastic optimal control approach for real-time traffic routing considering demand uncertainties and travelers’ choice heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 104(C), pages 710-732.
  • Handle: RePEc:eee:transb:v:104:y:2017:i:c:p:710-732
    DOI: 10.1016/j.trb.2017.06.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0191261516309924
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.trb.2017.06.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Du, Lili & Han, Lanshan & Li, Xiang-Yang, 2014. "Distributed coordinated in-vehicle online routing using mixed-strategy congestion game," Transportation Research Part B: Methodological, Elsevier, vol. 67(C), pages 1-17.
    2. Qian, Zhen (Sean) & Rajagopal, Ram, 2014. "Optimal occupancy-driven parking pricing under demand uncertainties and traveler heterogeneity: A stochastic control approach," Transportation Research Part B: Methodological, Elsevier, vol. 67(C), pages 144-165.
    3. Chung, Byung Do & Yao, Tao & Friesz, Terry L. & Liu, Hongcheng, 2012. "Dynamic congestion pricing with demand uncertainty: A robust optimization approach," Transportation Research Part B: Methodological, Elsevier, vol. 46(10), pages 1504-1518.
    4. Kachroo, Pushkin & Özbay, Kaan, 1998. "Solution to the user equilibrium dynamic traffic routing problem using feedback linearization," Transportation Research Part B: Methodological, Elsevier, vol. 32(5), pages 343-360, June.
    5. Shen, Wei & Zhang, H. Michael, 2009. "On the Morning Commute Problem in a Corridor Network with Multiple Bottlenecks: Its System-optimal Traffic Flow Patterns and the Realizing Tolling Scheme," Institute of Transportation Studies, Working Paper Series qt9bs815sq, Institute of Transportation Studies, UC Davis.
    6. Kenneth A. Small & Clifford Winston & Jia Yan, 2005. "Uncovering the Distribution of Motorists' Preferences for Travel Time and Reliability," Econometrica, Econometric Society, vol. 73(4), pages 1367-1382, July.
    7. David Levinson, 2003. "The Value of Advanced Traveler Information Systems for Route Choice," Working Papers 200307, University of Minnesota: Nexus Research Group.
    8. Du, Lili & Han, Lanshan & Chen, Shuwei, 2015. "Coordinated online in-vehicle routing balancing user optimality and system optimality through information perturbation," Transportation Research Part B: Methodological, Elsevier, vol. 79(C), pages 121-133.
    9. Leurent, F., 1998. "Sensitivity and error analysis of the dual criteria traffic assignment model," Transportation Research Part B: Methodological, Elsevier, vol. 32(3), pages 189-204, April.
    10. Yannis Pavlis & Markos Papageorgiou, 1999. "Simple Decentralized Feedback Strategies for Route Guidance in Traffic Networks," Transportation Science, INFORMS, vol. 33(3), pages 264-278, August.
    11. Gao, Song & Chabini, Ismail, 2006. "Optimal routing policy problems in stochastic time-dependent networks," Transportation Research Part B: Methodological, Elsevier, vol. 40(2), pages 93-122, February.
    12. Adler, Jeffrey L. & Satapathy, Goutam & Manikonda, Vikram & Bowles, Betty & Blue, Victor J., 2005. "A multi-agent approach to cooperative traffic management and route guidance," Transportation Research Part B: Methodological, Elsevier, vol. 39(4), pages 297-318, May.
    13. Muñoz, Juan Carlos & Laval, Jorge A., 2006. "System optimum dynamic traffic assignment graphical solution method for a congested freeway and one destination," Transportation Research Part B: Methodological, Elsevier, vol. 40(1), pages 1-15, January.
    14. Leurent, Fabien, 1993. "Cost versus time equilibrium over a network," European Journal of Operational Research, Elsevier, vol. 71(2), pages 205-221, December.
    15. Shen, Wei & Zhang, H.M., 2009. "On the morning commute problem in a corridor network with multiple bottlenecks: Its system-optimal traffic flow patterns and the realizing tolling scheme," Transportation Research Part B: Methodological, Elsevier, vol. 43(3), pages 267-284, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xie, Jiaohong & Yang, Zhenyu & Lai, Xiongfei & Liu, Yang & Yang, Xiao Bo & Teng, Teck-Hou & Tham, Chen-Khong, 2022. "Deep reinforcement learning for dynamic incident-responsive traffic information dissemination," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 166(C).
    2. Chen, Yi-Ting & Sun, Edward W. & Chang, Ming-Feng & Lin, Yi-Bing, 2021. "Pragmatic real-time logistics management with traffic IoT infrastructure: Big data predictive analytics of freight travel time for Logistics 4.0," International Journal of Production Economics, Elsevier, vol. 238(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lu, Chung-Cheng & Liu, Jiangtao & Qu, Yunchao & Peeta, Srinivas & Rouphail, Nagui M. & Zhou, Xuesong, 2016. "Eco-system optimal time-dependent flow assignment in a congested network," Transportation Research Part B: Methodological, Elsevier, vol. 94(C), pages 217-239.
    2. Nie, Yu (Marco), 2011. "A cell-based Merchant-Nemhauser model for the system optimum dynamic traffic assignment problem," Transportation Research Part B: Methodological, Elsevier, vol. 45(2), pages 329-342, February.
    3. Satsukawa, Koki & Wada, Kentaro & Watling, David, 2022. "Dynamic system optimal traffic assignment with atomic users: Convergence and stability," Transportation Research Part B: Methodological, Elsevier, vol. 155(C), pages 188-209.
    4. Ma, Rui & Ban, Xuegang (Jeff) & Szeto, W.Y., 2017. "Emission modeling and pricing on single-destination dynamic traffic networks," Transportation Research Part B: Methodological, Elsevier, vol. 100(C), pages 255-283.
    5. Liu, Siyuan & Qu, Qiang, 2016. "Dynamic collective routing using crowdsourcing data," Transportation Research Part B: Methodological, Elsevier, vol. 93(PA), pages 450-469.
    6. Zhao, Chuan-Lin & Leclercq, Ludovic, 2018. "Graphical solution for system optimum dynamic traffic assignment with day-based incentive routing strategies," Transportation Research Part B: Methodological, Elsevier, vol. 117(PA), pages 87-100.
    7. Wu, Wen-Xiang & Huang, Hai-Jun, 2014. "Finding anonymous tolls to realize target flow pattern in networks with continuously distributed value of time," Transportation Research Part B: Methodological, Elsevier, vol. 65(C), pages 31-46.
    8. Bao, Yue & Verhoef, Erik T. & Koster, Paul, 2021. "Leaving the tub: The nature and dynamics of hypercongestion in a bathtub model with a restricted downstream exit," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 152(C).
    9. Meng, Qiang & Liu, Zhiyuan & Wang, Shuaian, 2012. "Optimal distance tolls under congestion pricing and continuously distributed value of time," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 48(5), pages 937-957.
    10. Osawa, Minoru & Fu, Haoran & Akamatsu, Takashi, 2018. "First-best dynamic assignment of commuters with endogenous heterogeneities in a corridor network," Transportation Research Part B: Methodological, Elsevier, vol. 117(PB), pages 811-831.
    11. Yang, Hai & Tang, Wilson H. & Man Cheung, Wing & Meng, Qiang, 2002. "Profitability and welfare gain of private toll roads in a network with heterogeneous users," Transportation Research Part A: Policy and Practice, Elsevier, vol. 36(6), pages 537-554, July.
    12. Huang, Hai-Jun & Li, Zhi-Chun, 2007. "A multiclass, multicriteria logit-based traffic equilibrium assignment model under ATIS," European Journal of Operational Research, Elsevier, vol. 176(3), pages 1464-1477, February.
    13. Cortina, Mélanie & Chiabaut, Nicolas & Leclercq, Ludovic, 2023. "Fostering synergy between transit and Autonomous Mobility-on-Demand systems: A dynamic modeling approach for the morning commute problem," Transportation Research Part A: Policy and Practice, Elsevier, vol. 170(C).
    14. Fu, Haoran & Akamatsu, Takashi & Satsukawa, Koki & Wada, Kentaro, 2022. "Dynamic traffic assignment in a corridor network: Optimum versus equilibrium," Transportation Research Part B: Methodological, Elsevier, vol. 161(C), pages 218-246.
    15. Ning, Yuqiang & Du, Lili, 2023. "Robust and resilient equilibrium routing mechanism for traffic congestion mitigation built upon correlated equilibrium and distributed optimization," Transportation Research Part B: Methodological, Elsevier, vol. 168(C), pages 170-205.
    16. Le Zhang & Lijing Lyu & Shanshui Zheng & Li Ding & Lang Xu, 2022. "A Q-Learning-Based Approximate Solving Algorithm for Vehicular Route Game," Sustainability, MDPI, vol. 14(19), pages 1-14, September.
    17. Yang, Hai & Huang, Hai-Jun, 2004. "The multi-class, multi-criteria traffic network equilibrium and systems optimum problem," Transportation Research Part B: Methodological, Elsevier, vol. 38(1), pages 1-15, January.
    18. Baiocchi, Andrea, 2016. "Analysis of timer-based message dissemination protocols for inter-vehicle communications," Transportation Research Part B: Methodological, Elsevier, vol. 90(C), pages 105-134.
    19. Beheshtian, Arash & Richard Geddes, R. & Rouhani, Omid M. & Kockelman, Kara M. & Ockenfels, Axel & Cramton, Peter & Do, Wooseok, 2020. "Bringing the efficiency of electricity market mechanisms to multimodal mobility across congested transportation systems," Transportation Research Part A: Policy and Practice, Elsevier, vol. 131(C), pages 58-69.
    20. Gonzales, Eric J., 2016. "Demand responsive transit systems with time-dependent demand: User equilibrium, system optimum, and management strategyAuthor-Name: Amirgholy, Mahyar," Transportation Research Part B: Methodological, Elsevier, vol. 92(PB), pages 234-252.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transb:v:104:y:2017:i:c:p:710-732. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/548/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.