Authors

* External authors

Venue

Date

Share

Agent-Based Markov Modeling for Improved COVID-19 Mitigation Policies

Roberto Capobianco

Varun Kompella

James Ault*

Guni Sharon*

Stacy Jong*

Spencer Fox*

Lauren Meyers*

Pete Wurman

Peter Stone

* External authors

The Journal of Artificial Intelligence Research

2021

Abstract

The year 2020 saw the covid-19 virus lead to one of the worst global pandemics in history. As a result, governments around the world have been faced with the challenge of protecting public health while keeping the economy running to the greatest extent possible. Epidemiological models provide insight into the spread of these types of diseases and predict the effects of possible intervention policies. However, to date, even the most data-driven intervention policies rely on heuristics. In this paper, we study how reinforcement learning (RL) and Bayesian inference can be used to optimize mitigation policies that minimize economic impact without overwhelming hospital capacity. Our main contributions are (1) a novel agent-based pandemic simulator which, unlike traditional models, is able to model fine-grained interactions among people at specific locations in a community; (2) an RLbased methodology for optimizing fine-grained mitigation policies within this simulator; and (3) a Hidden Markov Model for predicting infected individuals based on partial observations regarding test results, presence of symptoms, and past physical contacts.

Related Publications

XAI-Guided Continual Learning: Rationale, Methods, and Future Directions

WIREs, 2025
Michela Proietti*, Alessio Ragno*, Roberto Capobianco

Providing neural networks with the ability to learn new tasks sequentially represents one of the main challenges in artificial intelligence. Unlike humans, neural networks are prone to losing previously acquired knowledge upon learning new information, a phenomenon known as …

Interpretable Memory-based Prototypical Pooling

WSDM, 2025
Alessio Ragno*, Roberto Capobianco

Graph Neural Networks (GNNs) have proven their effectiveness in various graph-structured data applications. However, one of the significant challenges in the realm of GNNs is representation learning, a critical concept that bridges graph pooling, aimed at creating compressed…

Intermediate Layers of LLMs Align Best With the Brain by Balancing Short- and Long-Range Information

CCN, 2025
Michela Proietti*, Roberto Capobianco, Mariya Toneva

Contextual integration is fundamental to human language comprehension. Language models are a powerful tool for studying how contextual information influences brain activity. In this work, we analyze the brain alignment of three types of language models, which vary in how the…

  • HOME
  • Publications
  • Agent-Based Markov Modeling for Improved COVID-19 Mitigation Policies

JOIN US

Shape the Future of AI with Sony AI

We want to hear from those of you who have a strong desire
to shape the future of AI.