Offline and offline-to-online reinforcement learning for bus holding control

Clicks: 17
ID: 328698
2026
Free PDF
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This article has not been analysed, so there is no overall score — reader engagement is measured and shown alongside.
AI Quality Assessment
Not analyzed
Readership in this journal
Steady

Ranked #17 of 44 articles by views in Transportation Safety and Environment

Most read Least read

Bar heights use a square-root scale.

Mint this article as an NFT
Not yet minted

Create a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.

5 SUSD one-off · no wallet required
Sign in to mint
Abstract
Abstract Bus bunching is a self-reinforcing phenomenon in which a delayed bus boards more passengers, incurs further delay, and is caught by its follower. Holding a bus at a stop to regulate headways is a widely studied corrective measure, yet most evaluations rely on a single shaped objective rather than independent passenger and service outcomes. This study asks whether a fixed operational log can support network-wide holding policies without simulator interaction, and whether offline-to-online fine-tuning yields sufficient improvement to justify its computational cost. We constructed a microscopic Simulation of Urban Mobility (SUMO) benchmark with 12 Changsha bus lines and 3.37 million logged holding-only transitions. We compared five transportation rules and three offline learners: behavior cloning (BC), conservative Q-learning (CQL), and robust ensemble Soft Actor-Critic (RE-SAC). We also compared online Soft Actor-Critic (SAC) with warm-start reinforcement learning (WSRL) and reinforcement learning with prior data (RLPD), two offline-to-online methods, under separate interaction budgets. Every reported checkpoint was evaluated across ten common 18 000-s SUMO episodes that ran to natural completion. WSRL achieved the highest selected-checkpoint return (−710 544 ± 17 162). The mean passenger waiting time was 301 ± 4 s and the mean total travel time was 1 266 ± 18 s. However, no single controller was best on every passenger and service outcome, underscoring the need for evaluation beyond shaped return. The study contributes a reproducible benchmark and a comparison design with explicitly separated interaction budgets. The findings are limited to the simulated setting, as observed operating trajectories were unavailable for external calibration.
Reference Key
openalex_W7213472544 Use this key to autocite in the manuscript while using SciMatic Manuscript Manager or Thesis Manager
Authors Yifan Zhang, Haoming Li, Liang Zheng, Qifan Zhang
Are you one of these authors? Claim your profile
Journal Transportation Safety and Environment
Year 2026
DOI
10.1093/tse/tdag059
URL
https://doi.org/10.1093/tse/tdag059
Keywords Keywords not found

Citations

No citations found. To add a citation, contact the admin at info@scimatic.org

Comments

No comments yet. Be the first to comment on this article.