Authors

* External authors

Venue

Date

Share

An Overview of Environmental Features that Impact Deep Reinforcement Learning in Sparse-Reward Domains

Jim Martin Catacora Ocaña*

Roberto Capobianco

Daniele Nardi*

* External authors

JAIR

2023

Abstract

Deep reinforcement learning has achieved impressive results in recent years; yet, it is still severely troubled by environments showcasing sparse rewards. On top of that, not all sparse-reward environments are created equal, ie, they can differ in the presence or absence of various features, with many of them having a great impact on learning. In light of this, the present work puts together a literature compilation of such environmental features, covering particularly those that have been taken advantage of and those that continue to pose a challenge. We expect this effort to provide guidance to researchers for assessing the generality of their new proposals and to call their attention to issues that remain unresolved when dealing with sparse rewards.

Related Publications

XAI-Guided Continual Learning: Rationale, Methods, and Future Directions

WIREs, 2025
Michela Proietti*, Alessio Ragno*, Roberto Capobianco

Providing neural networks with the ability to learn new tasks sequentially represents one of the main challenges in artificial intelligence. Unlike humans, neural networks are prone to losing previously acquired knowledge upon learning new information, a phenomenon known as …

Interpretable Memory-based Prototypical Pooling

WSDM, 2025
Alessio Ragno*, Roberto Capobianco

Graph Neural Networks (GNNs) have proven their effectiveness in various graph-structured data applications. However, one of the significant challenges in the realm of GNNs is representation learning, a critical concept that bridges graph pooling, aimed at creating compressed…

Intermediate Layers of LLMs Align Best With the Brain by Balancing Short- and Long-Range Information

CCN, 2025
Michela Proietti*, Roberto Capobianco, Mariya Toneva

Contextual integration is fundamental to human language comprehension. Language models are a powerful tool for studying how contextual information influences brain activity. In this work, we analyze the brain alignment of three types of language models, which vary in how the…

  • HOME
  • Publications
  • An Overview of Environmental Features that Impact Deep Reinforcement Learning in Sparse-Reward Domains

JOIN US

Shape the Future of AI with Sony AI

We want to hear from those of you who have a strong desire
to shape the future of AI.