定向运动
强化学习
钢筋
计算机科学
运筹学
数学优化
人工智能
工程类
数学
结构工程
作者
Yuanyuan Li,Claudia Archetti,Ivana Ljubić
出处
期刊:Transportation Science
[Institute for Operations Research and the Management Sciences]
日期:2024-07-18
卷期号:58 (5): 1143-1165
标识
DOI:10.1287/trsc.2022.0366
摘要
In this paper, we study a sequential decision-making problem faced by e-commerce carriers related to when to send out a vehicle from the central depot to serve customer requests and in which order to provide the service, under the assumption that the time at which parcels arrive at the depot is stochastic and dynamic. The objective is to maximize the expected number of parcels that can be delivered during service hours. We propose two reinforcement learning (RL) approaches for solving this problem. These approaches rely on a look-ahead strategy in which future release dates are sampled in a Monte Carlo fashion, and a batch approach is used to approximate future routes. Both RL approaches are based on value function approximation: One combines it with a consensus function (VFA-CF) and the other one with a two-stage stochastic integer linear programming model (VFA-2S). VFA-CF and VFA-2S do not need extensive training as they are based on very few hyperparameters and make good use of integer linear programming (ILP) and branch-and-cut–based exact methods to improve the quality of decisions. We also establish sufficient conditions for partial characterization of optimal policy and integrate them into VFA-CF/VFA-2S. In an empirical study, we conduct a competitive analysis using upper bounds with perfect information. We also show that VFA-CF and VFA-2S greatly outperform alternative approaches that (1) do not rely on future information (2) are based on point estimation of future information, (3) use heuristics rather than exact methods, or (4) use exact evaluations of future rewards. Funding: This work was supported by the CY Initiative of Excellence [ANR-16- IDEX-0008]. Supplemental Material: The online appendices are available at https://doi.org/10.1287/trsc.2022.0366 .
科研通智能强力驱动
Strongly Powered by AbleSci AI