Explaining the Behavior of Reinforcement Learning Agents Using Association Rules
(2023) Learning and Intelligent Optimization 17th International Conference — Location: Nice, France (4.June.2023)
Files
978-3-031-44505-7.pdf
Open Access - Adobe PDF
- 45.48 MB
Details
- Authors
- Abstract
- Deep reinforcement learning algorithms are increasingly used to drive decision-making systems. However, there exists a known tension between the efficiency of a machine learning algorithm and its level of explainability. Generally speaking, increased efficiency comes with the cost of decisions that are harder to explain. This concern is related to explainable artificial intelligence, which is a hot topic in the research community. In this paper, we propose to explain the behaviour of a black-box sequential decision process, built with a deep reinforcement learning algorithm, thanks to standard data mining tools, i.e. association rules. We apply this idea to the design of playing bots, which is ubiquitous in the video game industry. To do so, we designed three agents trained with a deep Q-learning algorithm for the game Street FighterTurbo II. Each agent has a specific playing style and the data mining algorithm aims to find rules maximizing the lift, while ensuring a minimum threshold for the confidence and the support. Experiments show that association rules can provide insights on the behavior of each agent, and reflect their specific playing style. We believe that this work is a next step towards the explanation of complex models in deep reinforcement learning.
- Affiliations
Citations
Parham, Z., de Lille, V. T., & Cappart, Q. (2023). Explaining the Behavior of Reinforcement Learning Agents Using Association Rules. Lecture Notes in Computer Science : Learning and Intelligent Optimization, p. 107-120. https://doi.org/10.1007/978-3-031-44505-7_8