AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation

AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation

Featured

Wenxuan Guo, Xiuwei Xu, Yichen Liu, Xiangyu Li, Hang Yin, Huangxing Chen, Wenzhao Zheng, Jianjiang Feng, Jie Zhou, Jiwen Lu · Tsinghua University · 2026

Framework

N/A

License

N/A

Stars

29

Summary

AwareVLN introduces selective self-aware reasoning for VLN agents, triggering explicit spatial and progress analysis only at uncertain waypoints to improve robustness and explainability.

Abstract Summary

Vision-and-Language Navigation (VLN) agents typically predict actions end-to-end, lacking explicit awareness of their spatial state, task progress, or alignment with natural language instructions. AwareVLN introduces structured, self-aware reasoning that is selectively triggered at key navigation waypoints rather than consuming computation at every timestep. The model maintains an internal belief over task progress and spatial consistency, monitoring its own state for signs of uncertainty or misalignment with the instruction. When divergence is detected—such as entering the wrong room or missing a referenced landmark—AwareVLN invokes an explicit reasoning module that analyzes possible corrections and selects the most promising recovery action. This selective approach reduces unnecessary computation while improving navigation success rates. Evaluated on standard VLN benchmarks including R2R and REVERIE, AwareVLN achieves higher success and lower trajectory lengths than baseline end-to-end models. Importantly, the reasoning traces produced by AwareVLN are human-interpretable, making it easier to diagnose failure modes and build trust in embodied agents. The framework is compatible with existing VLN architectures and can be inserted as a lightweight reasoning head with minimal architectural changes.

Key Points

  • Selective self-aware reasoning for Vision-and-Language Navigation.
  • Only triggers explicit reasoning at uncertain waypoints, saving computation.
  • Maintains internal belief over task progress and spatial alignment.
  • Improves success rates on R2R and REVERIE benchmarks.
  • Produces human-interpretable reasoning traces for debugging.

Additional Notes

Overview

  • What Limits Vision-and-Language Navigation?
  • Guide, Think and Act: Interactive Embodied Reasoning in VLA
  • Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Share

Related Papers

DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation

DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation

Jusuk Lee, Seungjae Lee, Jonghun Shin et al. · arXiv preprint · May 2026

Robot manipulation critically depends on perception that preserves the action-relevant aspects of a scene. Yet most robot learning pipelines are built upon visual encoders pre-trained for static recog

foundation-models perception manipulation representation-learning vla
PDF Intermediate
No code repo Code updated: May 2026