Interpretable Deep Reinforcement Learning for Dynamic Truck Dispatching in Open-Pit Mining

Authors

  • Luis Francisco Rosales Marticorena ESAN Graduate School of Business, Peru
  • Angelo DIAZ IMCA , Lima, Peru

DOI:

https://doi.org/10.56177/12icmie2025.202

Keywords:

Deep Q-Learning, Explainable AI, Truck Dispatching, Markov Decision Process, Policy Learning, Interpretable Reinforcement Learning

Abstract

Dynamic resource allocation under uncertainty is a core challenge in operations research, particularly in capital-intensive sectors such as open-pit mining, where suboptimal dispatching decisions can lead to substantial productivity losses and increased operational costs. This paper proposes a Deep Reinforcement Learning framework to address the dynamic truck assignment problem in open-pit mining, with a dual focus on performance optimization and policy interpretability. The problem is formulated as a Markov Decision Process (MDP) and implemented within a discrete-event simulation environment that replicates the stochastic dynamics of truck-shovel operations. A Deep Q-Learning approach with neural network function approximation is employed to learn adaptive dispatching policies directly from simulated experience. To enhance transparency, we integrate Explainable Artificial Intelligence (XAI) methods to interpret and validate the learned decision strategies. Experimental results show that the proposed framework significantly outperforms heuristic and random dispatching baselines in terms of resource utilization and operational efficiency. Moreover, the incorporation of explainability provides actionable insights into policy behavior, bridging the gap between autonomous optimization and human-centered decision support in complex industrial systems

References

R. Bellman, «"A Markovian Decision Process",» Indiana University Mathematics Journal, vol. 6, nº 4, pp. 679-684, 1957.

C. J. C. H. Watkins y P. Dayan, «“Q-learning”,» Machine Learning, vol. 8, nº 3, p. 279–292, 1992.

A. Zai y B. Brown, Deep Reinforcement Learning in Action, Manning Publications, 2020.

R. Noriega, Y. Pourrahimian y H. Askari-Nasab, «“Deep Reinforcement Learning based real-time open-pit mining truck dispatching system”,» Computers & Operations Research, vol. 173, p. 106815, 2025.

D. Huo, Y. A. Sari y Q. Zhang, «“Smart dispatching for low-carbon mining fleet: A deep reinforcement learning approach”,» Journal of Cleaner Production, vol. 435, p. 140459, 2024.

J. P. de Carvalho y R. Dimitrakopoulos, «“Integrating production planning with truck-dispatching decisions through reinforcement learning while managing uncertainty”,» Minerals, vol. 11, nº 6, p. 587, 2021.

T. V. Chiarot Villegas, S. F. Segura Altamirano, D. M. Castro Cárdenas, A. M. Sifuentes Montes, L. I. Chaman Cabrera, A. S. Aliaga Zegarra, C. L. Oblitas Vera y J. C. Albán Palacios, «“Improving productivity in mining operations: a deep reinforcement learning model for effective material supply and equipment management”,» Neural Computing and Applications, vol. 36, nº 9, p. 4523–4535, 2024.

V. Mukundan y A. Narayan, «“Deep Reinforcement Learning based Truck Dispatcher for Open-pit Mines”,» de 6th International Workshop on Multi-Agent Path Finding (WoMAPF 2025), 2025.

B. Christian, The Alignment Problem: Machine Learning and Human Values, W. W. Norton & Company, 2020.

A. Bain, La ciencia de la educación, 1st ed., F. Beltrán, Ed., 1915.

D. Klein, «"Mighty mouse",» MIT Technology Review, 19 Diciembre 2018.

M. Minsky, «“Steps toward Artificial Intelligence”,» Proceedings of the IRE, vol. 49, nº 1, pp. 8-30, 1961.

M. Á. Páliza Borja, Atlas catastral, geológico, minero y metalúrgico, 1st ed., Instituto Geológico, Minero y Metalúrgico (Ingemmet), 2022.

M. A. Minaya Cajjak, «“Implementación de la metodología Six Sigma para mejorar la vida útil de neumáticos de camiones mineros en el proyecto Mina Justa”,» 2021.

R. S. Sutton y A. G. Barto, Reinforcement Learning: An Introduction, 2da ed., Cambridge, MA.: MIT Press, 2018.

N. Bäuerle y U. Rieder, Markov Decision Processes with Applications to Finance, Springer, 2011.

H. van Hasselt, A. Guez y D. Silver, «“Deep Reinforcement Learning with Double Q-Learning”,» de Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16), 2016.

C. Molnar, Interpretable Machine Learning: A Guide for Making Black Box Models Explainable, Leanpub, 2020.

A. M. Salih, Z. Raisi-Estabragh, I. B. Galazzo, P. Radeva, S. E. Petersen, K. Lekadir y G. Menegaz, «“A perspective on explainable artificial intelligence methods: SHAP and LIME”,» Advanced Intelligent Systems, vol. 7, nº 1, p. 2400304, 2025.

A. Gramegna y P. Giudici, «“SHAP and LIME: An evaluation of discriminative power in credit risk”,» Frontiers in Artificial Intelligence, vol. 4, p. 752558, 2021.

Downloads

Published

2026-01-08

How to Cite

Rosales Marticorena, L. F., & DIAZ, A. . (2026). Interpretable Deep Reinforcement Learning for Dynamic Truck Dispatching in Open-Pit Mining . International Conference of Management and Industrial Engineering, 12, 207–217. https://doi.org/10.56177/12icmie2025.202

Issue

Section

Digital Transformation and Technological Leadership