Demo video: Towers of Saliency

Deep reinforcement learning (DRL) has had many successes on complex tasks, but is typically considered a black box. Opening this black box would enable better understanding and trust of the model which can be helpful for researchers and end users to better interact with the learner. In this paper, we propose a new visualization to better analyze DRL agents and present a case study using the Pommerman benchmark domain. This visualization combines two previously proven methods for improving human un-derstanding of systems: saliency mapping and immersive visualization.


author = {Douglas, Nathan and Yim, Dianna and Kartal, Bilal and Hernandez-Leal, Pablo and Taylor, Matthew E. and Maurer, Frank},
title = {Towers of Saliency: A Reinforcement Learning Visualization Using Immersive Environments},
booktitle = {Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces},
series = {ISS '19},
year = {2019},
isbn = {978-1-4503-6891-9/19/11},
location = {Daejon, Republic of Korea},
numpages = {4},
publisher = {ACM},
address = {New York, NY, USA},