Learning-based multi-agent pathfinding

Teaching agents to act socially.

SYLPH helps teams of agents escape pathfinding dilemmas by learning when to be selfish, when to yield, and how to coordinate.

Chengyang He · Tanishq Duhan · Parth Tulsyan · Patrick Kim · Guillaume Sartoretti
MARMot Laboratory · National University of Singapore

Four-panel illustration showing two robots resolving a path conflict by yielding to each other
Conflict → cooperation

The idea

Breaking symmetry with social behavior.

Multi-Agent Path Finding (MAPF) asks a team of agents to find collision-free paths through a shared environment. Learning-based systems scale by deploying the same decentralized network to every agent—but identical policies can produce identical behavior, leaving agents locked in symmetric conflicts. SYLPH introduces dynamic social roles through Social Value Orientation (SVO). Each agent predicts its most influential interaction, selects an appropriate level of selfishness or altruism, and follows an SVO-conditioned motion policy. By sharing these social preferences with nearby agents, the team can produce nuanced, varied responses that break ties while retaining the scalability of parameter sharing. Across random, room-like, and maze-like maps, SYLPH outperforms prior learning-based MAPF planners and transfers to physical robots.

01

See the interaction

Agents predict future conflicts and identify the neighbor who matters most.

02

Choose a social role

Each agent dynamically selects how selfishly or altruistically to behave.

03

Move as a team

A shared, SVO-conditioned policy turns social intent into coordinated motion.

Simulation

One policy. Different worlds.

Watch SYLPH coordinate teams across open random maps, structured rooms, and constrained mazes. Colored paths show agents negotiating shared space in real time.

Hardware validation

From simulation to the floor.

Eight physical agents perform pathfinding in three map families, demonstrating coordinated behavior under real-world sensing and motion conditions.

Random map

Hardware experiment · 8 agents

01

Room-like map

Hardware experiment · 8 agents

02

Maze map

Hardware experiment · 8 agents

03

Citation

Build on our work.

If SYLPH supports your research, please cite the paper using the BibTeX entry provided.

Visit MARMot Lab
BibTeX
@article{he2025social,
  title={Social behavior as a key to learning-based multi-agent pathfinding dilemmas},
  author={He, Chengyang and Duhan, Tanishq and Tulsyan, Parth and Kim, Patrick and Sartoretti, Guillaume},
  journal={Artificial Intelligence},
  pages={104397},
  year={2025},
  publisher={Elsevier}
}