MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems

MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems

Marco Coscoy, Zewei Zhou, Seth Z. Zhao, Henry Wei, Jiaqi Ma · · 2026

Framework

N/A

License

N/A

Stars

17

Summary

Vehicle-to-Everything (V2X) communication has emerged as a promising paradigm for autonomous driving, enabling connected agents to share complementary perception information and negotiate with each other to benefit the final planning.

Abstract Summary

Multi-agent autonomous driving systems require coordination among vehicles to navigate complex traffic scenarios safely and efficiently. MDrive introduces a comprehensive benchmark for end-to-end multi-agent driving with diverse scenarios including highway merging, intersection negotiation, and emer... The method demonstrates significant improvements over existing approaches, providing both theoretical insights and practical benefits for real-world deployment. Comprehensive experiments validate the effectiveness of the proposed approach across diverse scenarios and task settings.

Key Points

  • Proposes MDrive, a novel approach for navigation in robotics.
  • Addresses key limitations in existing methods through innovative architecture design.
  • Demonstrates strong empirical results on standard benchmarks and real-world evaluations.
  • Introduces novel training methodology that improves generalization and sample efficiency.
  • Provides comprehensive analysis of failure modes and ablation studies.

MDrive Benchmark

MDrive is a closed-loop cooperative driving benchmark built on CARLA [ 55 ] simulator, which aims to provide broad, structured coverage of multi-agent scenarios to bridge the existing evaluation gap.

MDrive includes 225 scenarios and combines three complementary scenario buckets: 1) MDrive-Interdrive : in-domain performance of existing models without background actors; 2) MDrive-Interaction : interaction scenarios that enrich background actors interactivity and diversity; 3) MDrive-V2XPnP Real2Sim scenarios for testing models under real-world s...

MDrive Benchmark — MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems
Figure 3: Overview of the MDrive Toolbox. An open-source toolbox designed to support benchmark construction and extension through three core modules: 1) Human-in-the-Loop Simulation Interface that enables expert takeover via physical controllers to collect the realistic demonstrations; 2) Agentic Scenario Generation Pipeline that leverages agentic system as structured proposers to scalably generate, validate, and curate synthetic multi-agent interactions; and 3) Real2Sim Pipeline that reconstructs real-world V2X data into closed-loop CARLA scenarios with the digital twin.

Benchmarking State-of-the-Art Models

In this section, we present benchmark results to answer two research questions (RQ): RQ1: To what extent does multi-agent cooperation improve closed-loop driving over single-agent systems, and how do the gains decompose between perception sharing and negotiation? RQ2: What performance gaps and new challenges for multi-agent system do MDrive expose?

We benchmark on a set of representative single-agent and multi-agent end-to-end driving models.

Benchmarking State-of-the-Art Models — MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems
Figure 4: Category-wise MDrive Benchmark. Harmonic mean between Driving Score and Success Rate on three high-level categories.

Sources and Demonstrations

Figures are reproduced from Coscoy et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms
arXiv preprint

A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms

Yufei Jia, Zhanxiang Cao, Mingrui Yu et al.

Simulation-based RL for contemporary robot control is increasingly organized around GPU-resident simulation: physics, rollout collection, and learning are placed on a single GPU-centric execution path

reinforcement-learning simulation system-design locomotion
PDF Intermediate
EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera
SIGGRAPH 2026

EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera

Christen Millerdurai, Shaoxiang Wang, Yaxu Xie et al.

Reconstructing the absolute 3D pose and shape of the hands from the user's viewpoint using a single head-mounted camera is crucial for practical egocentric interaction in AR/VR, telepresence, and hand-centric manipulation tasks, where sensing must remain compact and unobtrusive.

manipulation manipulation simulation
Code PDF Intermediate
Code ★ 0