Computer Vision

76 papers

Vision-based perception for robotics.

sim-to-real reinforcement-learning vision vla manipulation planning control learning-from-demonstration human-robot-interaction benchmark locomotion tactile navigation world-models humanoid

Papers

Sorted by year (newest first)

3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training

Jiaxin Shi, Xidong Zhang, Fucai Zhu et al. · arXiv preprint · Jun 2026

We propose a 3D-thinking-guided co-training framework that enables vision-language-action (VLA) models to perform 3D spatial reasoning implicitly during action prediction. Our core insight is that 3D geometry perception and 3D spatial reasoning are distinct capabilities that can be disentangled and ...

sim-to-real reinforcement-learning vision vla manipulation

PDF Advanced

No code repo Jun 2026

A Low-Cost, Open Platform for End-to-End Autonomous Driving on a Miniature Ackermann Vehicle

Gustavo Claudio Karl Couto, Eric Aislan Antonelo, Gabriel George Zipperer · arXiv preprint · Sep 2026

This paper presents a low-cost, open experimental platform for research in end-to-end autonomous driving with miniature Ackermann vehicles. The platform combines a physical vehicle, a printed urban track, data collection tools, trajectory registration, and a Webots digital twin, enabling controll...

vision reinforcement-learning sim-to-real planning control learning-from-demonstration

PDF Advanced

No code repo Sep 2026

A New Human-Likeness and Comfort Index for Robot Movements Along Prescribed Paths

Rosanna Coccaro, Enrico Ferrentino, Antonio Parziale et al. · arXiv preprint · Jul 2026

As human-robot interaction rapidly spreads in numerous fields, the subject of robot acceptance gains increasing importance. Visual similarity to the human body, as occurs for humanoids, is generally not enough to ensure acceptance in physical interaction, as acceptance directly links to comfort a...

vision control human-robot-interaction

PDF Intermediate

No code repo Jul 2026

Adaptation Needs in Robotic Systems: Assessing Behavior Trees and Their Enhancement

Mehran Rostamnia, Gianluca Filippone, Ricardo Caldas et al. · arXiv preprint · Sep 2026

Robotic systems increasingly operate in dynamic, uncertain, and open-ended environments, where design-time assumptions may no longer hold, and adaptation becomes necessary to maintain effective and safe operation. Behavior Trees (BTs) are widely used in robotic control architectures due to their ...

vision planning control

PDF Intermediate

No code repo Sep 2026

Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis

Sixu Yan, Shikang Wang, Binhua Huang et al. · arXiv preprint · Sep 2026

This paper proposes AdaRoboVLG, a task-adaptive Vision-Language-Grasp (VLG) framework that supports generalizable grasp synthesis across different robotic hands. Unlike existing VLG methods that tightly couple foundation models with end-to-end grasp policies, AdaRoboVLG learns an efficient genera...

manipulation vision reinforcement-learning

Code PDF Advanced

GitHub ★ — Sep 2026

Assessing Physical Frailty and Fall-Risk Indicators with Social Robots: An in situ Evaluation with Older Adults

Aniol Civit, Antonio Andriella, Alba Martínez et al. · arXiv preprint · Jul 2026

Frailty assessments are crucial to evaluate the risk of adverse events and the health and social care needs of older adults, yet their administration remains resource-intensive and typically relies on coarse clinical outcomes, such as task completion times, which may overlook biomechanical indica...

vision reinforcement-learning human-robot-interaction benchmark

PDF Intermediate

No code repo Jul 2026

Attention from Action, for Action: Emergent Visual Bottlenecks for Policy Learning

Zheyu Zhuang, Ruiyu Wang, Nick Heppert et al. · arXiv preprint · Aug 2026

Visual bottlenecks that focus policy inputs on regions of interest (ROIs) can improve data-efficient visuomotor learning by separating where to look from how to act. Many ROI interfaces rely on external spatial labels, such as gaze, object classes, or affordance annotations. Label-free alternativ...

vision reinforcement-learning control

PDF Intermediate

No code repo Aug 2026

AXIS: A Growable Community-Driven Data Engine for Scalable Robot Manipulation

Mengfei Zhao, Dihong Huang, Yikai Tang et al. · arXiv preprint · Jul 2026

Learning effective robot manipulation policies requires diverse, high-quality demonstrations, yet existing data pipelines are often difficult to scale because they rely on specialized hardware, centralized operators, or fixed task suites. We present AXIS, a growable community-driven data engine a...

manipulation vision vla learning-from-demonstration benchmark

PDF Advanced

No code repo Jul 2026

BadWAM: When World-Action Models Dream Right but Act Wrong

Qi Li, Xingyi Yang, Xinchao Wang · arXiv preprint · Jul 2026

World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representations that couple action generation with future world prediction. This coupling is often viewed as a source of robustness, interpretability, and safet...

vision reinforcement-learning control

PDF Intermediate

No code repo Jul 2026

Beyond Episodic Evaluation: Memory Architectural Bottlenecks in Sequential Embodied Question Answering

Zikui Cai, Kaushal Janga, Tan Dat Dao et al. · arXiv preprint · Jul 2026

Embodied question answering (EQA) is traditionally evaluated under an episodic formulation, where agents solve each task independently and reset internal state between episodes. However, real-world robots operate continuously and must accumulate, retain, and selectively reuse information acquired...

vision reinforcement-learning planning benchmark

PDF Intermediate

No code repo Jul 2026

Can People Distinguish Human and AI Agency in Humanoid Teleoperation? A Preliminary Study of Agency Perception

Xiang Li, Koya Dendo, Keigo Minamida et al. · arXiv preprint · Sep 2026

Can people distinguish between human and AI agency in humanoid teleoperation? To explore this question, we developed \textit{Ghost-in-the-Loop}, a teleoperation framework that supports both human-operated and AI-generated control of a robot's voice, facial expressions, and gestures while maintain...

vision reinforcement-learning control learning-from-demonstration

PDF Intermediate

No code repo Sep 2026

CAP: Continuously Adaptive Perception-Blind Humanoid Locomotion via Learned Denoising

Hongjin Chen, Zijun Xu, Shihao Ma et al. · arXiv preprint · Sep 2026

Humanoid locomotion across complex terrain demands forward-looking exteroception to anticipate obstacles, yet this signal is unreliable in real-world deployment, failing partially and intermittently. Existing perceptive policies often assume that depth observations remain clean and in-distributio...

locomotion vision reinforcement-learning control

PDF Intermediate

No code repo Sep 2026

Catalogue Photography as a Cold Start: Toward Deployable Carbide Burr Recognition

Abilash Philip Madavath, Chandra Yuvesh Aubeeluck, Augustin Raju et al. · arXiv preprint · Sep 2026

Verifying that manufactured batches of milling tools or carbide rotary burrs conform to production order sheets remains a largely manual and error-prone quality assurance task. Automating this process with computer vision faces a critical cold-start constraint since no labelled imagery is availab...

vision reinforcement-learning benchmark

PDF Intermediate

No code repo Sep 2026

Catch, Throw, Repeat: Planning for Human-Robot Partner Juggling

Jonathan Rainer Lippert, Kai Ploeger, Abir Chowdhury et al. · arXiv preprint · Jul 2026

Dynamic object exchange between humans and robots remains a challenging problem due to uncertainty in perception, timing, and contact-rich interaction. Human-robot juggling represents a particularly demanding instance of this problem, requiring precise real-time coordination, predictive motion pl...

vision reinforcement-learning planning control human-robot-interaction

PDF Intermediate

No code repo Jul 2026

ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models

Gehan Zheng, Matthew Johnson-Roberson, Weiming Zhi · arXiv preprint · Aug 2026

Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional de...

manipulation vision reinforcement-learning

PDF Intermediate

No code repo Aug 2026

Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving

Ruoyu Yao, Yusen Xie, Qingzhao Liu et al. · arXiv preprint · Sep 2026

Bridging the gap between the discrete reasoning of Vision-Language Models and the continuous, physics-constrained nature of autonomous driving remains a significant challenge. In this work, we introduce LaPla, a unified Vision-Language-Action (VLA) framework featuring latent-aligned planning to s...

vision vla planning benchmark

PDF Advanced

No code repo Sep 2026

CrossDepth: Geometry-Constrained Attention for Generalizable Multi-View Surround Depth Estimation

Samer Abualhanud, Max Mehltretter · arXiv preprint · Sep 2026

Reliable 3D understanding of the surrounding environment is a core requirement for autonomous driving. Multi-view surround camera rigs provide broad scene coverage, but the spatially adjacent images typically overlap only minimally. Consequently, the depth of most pixels must be inferred from mon...

vision reinforcement-learning benchmark

Code PDF Intermediate

GitHub ★ — Sep 2026

Decoding Task Progress from VLA Representations

Atiksh Bhardwaj, Edward Weiyi Duan, Prithwish Dan et al. · arXiv preprint · Aug 2026

Vision-language-action models (VLAs) are moving rapidly towards deployment as general-purpose manipulation policies, but we currently lack basic tools for understanding what these models represent internally or for monitoring them at runtime. Leveraging ideas from mechanistic interpretability, we...

manipulation vision vla reinforcement-learning control

PDF Intermediate

No code repo Aug 2026

DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation

Siyuan Ma, Boshi Zhang, Yutian Zhang et al. · arXiv preprint · Aug 2026

Mobile manipulation requires a robot to predict how locomotion and arm motion jointly alter future observations and control. Existing world-action models, developed largely for fixed-base platforms, do not explicitly distinguish camera ego-motion from base and arm actions. Here we introduce DECOW...

manipulation locomotion vision reinforcement-learning control benchmark

PDF Intermediate

No code repo Aug 2026

Design and Evaluation of a Touchscreen-Based Teleoperation Interface for Robotic Manipulators

Juan José García Cárdenas, Alperen Kenan, Hamidreza Raei et al. · arXiv preprint · Aug 2026

Intuitive teleoperation interfaces are crucial for the safe and effective operation of robotic manipulators in challenging environments. In the nuclear industry, surface contact tasks such as swab sampling require precise path and force tracking, obstacle avoidance, and sustained operator attenti...

manipulation vision reinforcement-learning control learning-from-demonstration tactile benchmark

PDF Intermediate

No code repo Aug 2026

Development of a Humanoid Robot Prototype for Multimodal Human-Robot Interaction

Thang Tran Viet, Thanh Nguyen Canh, Huy Uong Gia et al. · arXiv preprint · Sep 2026

Human-robot interaction (HRI) enables intuitive and intelligent collaboration between humans and robots in real-world environments. This paper introduces a humanoid robot prototype designed as a flexible testbed for developing and integrating artificial intelligence (AI) modules in HRI tasks. The...

manipulation vision vla reinforcement-learning control human-robot-interaction

Code PDF Intermediate

GitHub ★ — Sep 2026

DexVerse: A Modular Benchmark for Multi-Task, Multi-Embodiment Dexterous Manipulation

Yunchao Yao, Zhuxiu Xu, Tianqi Zhang et al. · arXiv preprint · Jul 2026

Building general-purpose dexterous manipulation policies requires benchmarks that go beyond isolated tasks to systematically evaluate policies across diverse interaction modes, sensory conditions, and robot embodiments. However, existing benchmarks remain limited in task and data diversity, embod...

manipulation vision vla reinforcement-learning control learning-from-demonstration benchmark

PDF Advanced

No code repo Jul 2026

DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation

Junfeng Li, Junjie He, Zhide Zhong et al. · arXiv preprint · Aug 2026

Vision-Language-Action (VLA) models have become a powerful paradigm for robot manipulation, but training a single generalist policy for heterogeneous robot embodiments remains an open problem. Existing methods have two main limitations. First, they underuse dynamics priors shared across diverse v...

manipulation vision vla reinforcement-learning control benchmark

PDF Intermediate

No code repo Aug 2026

Effect of Twisted-Yarn Architecture on Pressure and Proximity Sensing Characteristics of Textile Capacitive Sensors for Robotic Skin

Ishtia Zahir, Eslam Saleh, Maryam Rezayati et al. · arXiv preprint · Aug 2026

Textile-integrated capacitive sensors offer flexible and conformable tactile sensing for wearable electronics and human-robot interaction; however, the influence of yarn-level architecture on capacitive transduction characteristics remains insufficiently quantified. This work presents a textile c...

vision reinforcement-learning human-robot-interaction tactile

PDF Advanced

No code repo Aug 2026

Embodied Scene Rearrangement Planning

Canzhi Chen, Zan Wang, Siqi Zhu et al. · arXiv preprint · Aug 2026

This paper introduces Embodied Scene Rearrangement Planning (ESRP), a novel task requiring embodied agents to rearrange furniture in 3D scenes to match a target configuration using only egocentric observations and a top-down target layout. Unlike prior rearrangement tasks, ESRP precludes global s...

vision reinforcement-learning planning benchmark

Code PDF Intermediate

GitHub ★ — Aug 2026

ErgoSurf: Ergodic Control for the Coverage of Unknown Surfaces

Stefan Schneyer, Timo Bachmann, Maged Iskandar et al. · arXiv preprint · Aug 2026

Contact-centric tasks on surfaces, ranging from inspection and cleaning to sanding and polishing, require robots to systematically cover the surface while maintaining stable contact. Ergodic control generates trajectories that spend time at a location proportional to a desired, task-specific spat...

vision reinforcement-learning planning control tactile

PDF Advanced

No code repo Aug 2026

Evidence-Gated Task and Motion Planning with Vision-Language Models

Tsunehiko Tanaka, Matthew Stephenson, Alistair Macvicar et al. · arXiv preprint · Aug 2026

Robots executing long-horizon manipulation tasks from natural-language instructions must reason about both semantic task structure and geometric feasibility. However, under partial observability, the availability of goal-relevant objects may be uncertain. In such cases, approaches that combine Vi...

manipulation vision vla reinforcement-learning planning

PDF Intermediate

No code repo Aug 2026

EVPeriscope: Extended Perception across Aerial and Ground Vehicles with Event-based Propeller Tracking

Dexter Ong, Vijay Kumar, Pratik Chaudhari · arXiv preprint · Sep 2026

Reliable relative localization between aerial and ground robots is a key requirement for tightly coordinated heterogeneous teams. This can be difficult to do using conventional frame-based cameras and fiducial markers because they are sensitive to motion blur, lighting variations, and payload con...

vision reinforcement-learning planning control

Code PDF Intermediate

GitHub ★ — Sep 2026

FA-RDP: A Frequency-Adaptive Reactive Diffusion Policy for Contact-Rich Manipulation

Lifeng Zhuo, Wendi Chen, Han Xue et al. · arXiv preprint · Jul 2026

In contact-rich manipulation, action multimodality and reactivity dominate different stages of a single episode. Before contact, multiple trajectories might be equally valid, making it important to preserve diverse action modes. After contact, geometric constraints and force limits narrow the sol...

manipulation vision reinforcement-learning control

Code PDF Advanced

GitHub ★ — Jul 2026

FabriVLA: A Lightweight Vision-Language-Action Model for Precise Multi-Task Manipulation

Shiyuan Yang, Borong Zhang, Jizheng Zhang et al. · arXiv preprint · Jul 2026

We present FabriVLA, a lightweight Vision-Language-Action model for Precise Multi-Task Manipulation. FabriVLA combines an InternVL3.5 vision-language backbone with a flow-matching action head featuring gated self-attention across action tokens and shallow VLM layer fusion for enriched spatial con...

manipulation vision vla reinforcement-learning benchmark

PDF Intermediate

No code repo Jul 2026

FasTac: A Curved Multispectral Vision-Based Tactile Sensor for High-Speed High-Precision 3D Shape and Force Perception

Xiaofan Lu, Kaiji Huang, Jiahui Chen et al. · arXiv preprint · Jul 2026

Curved tactile fingertips for dexterous manipulation must resolve fine contact geometry, distinguish normal and tangential loads, and capture transient signals. Existing curved vision-based tactile sensors struggle to combine accurate 3D reconstruction, three-axis force estimation, and high-speed...

manipulation vision tactile

PDF Intermediate

No code repo Jul 2026

FIRE-LIVWO: Robust LiDAR-Inertial-Visual-Wheel Odometry via Failure-Immune mmWave Radar Enhancement

Kun Hu, Menggang Li, Kaidi Wu et al. · arXiv preprint · Sep 2026

Achieving robust SLAM in large-scale underground coal mines with complex structures and severe degeneracies remains highly challenging. Dense smoke and dust cause substantial loss of visual information and degrade LiDAR point-cloud features, while long, self-similar corridors induce geometric deg...

vision reinforcement-learning planning

Code PDF Advanced

GitHub ★ — Sep 2026

FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference

Zekai Li, Jiaming Tang, Zhijian Liu · arXiv preprint · Aug 2026

Vision-Language-Action (VLA) models are increasingly promising for robotic manipulation, yet their real-world deployment remains bottlenecked by high inference latency and unstable asynchronous execution. This challenge is particularly pronounced in flow-matching-based VLA models, where action de...

manipulation vision vla reinforcement-learning control

Code PDF Intermediate

GitHub ★ — Aug 2026

FolDeX: A Physical-World Benchmark for Long-Horizon Robotic Manipulation of Deformable Objects

Chenhuan Liu, Yi Xu, Feng Wu et al. · arXiv preprint · Sep 2026

Embodied AI, including vision-language-action and world-action models, must operate reliably in the physical world. Yet methods that perform well in simulation can degrade substantially on real robots, especially in long-horizon deformable-object manipulation, where policies must track changing s...

manipulation vision vla reinforcement-learning control benchmark

PDF Intermediate

No code repo Sep 2026

Generalization of World Models under Environmental Variability for Vision-based Quadrotor Navigation

Luca Zanatta, Grzegorz Malczyk, Kostas Alexis · arXiv preprint · Jun 2026

World models, learned generative models that predict how an environment evolves, have become a promising tool for sample-efficient robot learning. Yet how robust they are to environmental variability remains poorly understood. To address this, we conduct a systematic study using vision-based quadrot...

sim-to-real reinforcement-learning navigation vision world-models

PDF Advanced

No code repo Jun 2026

GenHOI: Contact-Aware Humanoid-Object Interaction by Imitating Generated Videos without Task-Specific Training

Zhihai Bi, Qiang Zhang, Guoyang Zhao et al. · arXiv preprint · Jun 2026

Humanoid-Object Interaction (HOI) is a fundamental capability for humanoid robots, yet it remains challenging due to the tight coupling between dynamic balance and stable interaction with diverse objects. Existing methods often require time-consuming task-specific policy training or rely on rigid tr...

humanoid manipulation vision

PDF Intermediate

No code repo Jun 2026

GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions

Chenghao Gu, Hanyang Yu, Jingbo Zhang et al. · arXiv preprint · Aug 2026

Generalist robot policies exhibit strong capabilities, but their robustness in complex and unseen environments remains limited. Scaling robot learning and evaluation in diverse real-world environments remains costly and challenging. Action-conditioned world models offer a promising alternative, b...

manipulation vision reinforcement-learning control learning-from-demonstration benchmark

PDF Intermediate

No code repo Aug 2026

GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulation

Yupeng Zheng, Xiang Li, Songen Gu et al. · arXiv preprint · Sep 2026

Vision-language pre-training and predictive world modeling provide robot policies with rich semantic and dynamic visual features, but their native action and visual-prediction objectives may omit critical physical and task structure while retaining control-irrelevant visual redundancy. We call th...

manipulation vision vla reinforcement-learning control

PDF Intermediate

No code repo Sep 2026

Goal-Oriented Semantic Communication for Distributed ISAC-Enabled Vehicle Coordination

Wenjie Liu, Yansha Deng · arXiv preprint · Jul 2026

Vehicle coordination at unsignalized intersections relies on accurate real-time vehicle state acquisition and reliable command-and-control (C&C) signal delivery. However, existing studies typically treat sensing, communication, and control separately, which may lead to redundant transmissions, ou...

vision reinforcement-learning control

PDF Advanced

No code repo Jul 2026

GRAIL: Generating Humanoid Loco-Manipulation from 3D Assets and Video Priors

Tianyi Xie, Haotian Zhang, Jinhyung Park et al. · arXiv preprint · Jun 2026

Scaling humanoid loco-manipulation requires robot-compatible demonstrations across diverse objects, whole-body motions, and scene geometries, but teleoperation and motion capture are difficult to scale because each collection depends on physical setups, instrumented actors, and robot operation. We p...

sim-to-real reinforcement-learning vision manipulation humanoid

Code PDF Advanced

GitHub ★ 275 Code updated: Jun 2026

GS-Agent: Creating 4D Physical Worlds With Generative Simulation

Hongxin Zhang, Chunru Lin, Junyan Li et al. · arXiv preprint · Jul 2026

Creating dynamic and physically realistic 4D worlds from natural language descriptions is both fascinating and challenging. Traditional computer graphics methods rely on manual creation, requiring extensive human effort to fine-tune materials, motions, and visual fidelity. Recent advances in gene...

manipulation vision reinforcement-learning control

Code PDF Advanced

GitHub ★ — Jul 2026

HaWMPO: Hallucination-Aware World Model-based Policy Optimization for Generalist Robot Policy

Zengjue Chen, Peidong Liu, Jiawei Li et al. · arXiv preprint · Sep 2026

Generalist robot policies have demonstrated strong generalization across robotic manipulation tasks, yet their success rates remain limited in com- plex long-horizon scenarios. Recent methods improve Visual-Language-Action (VLA) policies through online reinforcement learning on real robots, but s...

manipulation vision vla reinforcement-learning benchmark

PDF Intermediate

No code repo Sep 2026

JEPA Policy: Diffusion-Free Imitation Learning via Paired Action and Future Representation Prediction

Jie Xu, Kangjin Yu, Ziyi Jin et al. · arXiv preprint · Sep 2026

Standard behavior cloning supervises actions without explicitly constraining the future representation paired with each demonstrated action chunk. We introduce JEPA Policy, a diffusion-free framework that uses the action chunk and its observed future representation as paired training targets. Act...

vision reinforcement-learning control learning-from-demonstration

Code PDF Advanced

GitHub ★ — Sep 2026

LadderMan: Learning Humanoid Perceptive Ladder Climbing

Siheng Zhao, Yuanhang Zhang, Ziqi Lu et al. · arXiv preprint · Jun 2026

Humanoid robots hold great promise for operating in human-centered environments, yet ladder climbing remains one of the most challenging tasks due to sparse footholds and handholds, complex whole-body coordination, and sensitivity to perception and control errors. We present extbf{LadderMan}, a un...

sim-to-real reinforcement-learning vision manipulation humanoid

PDF Advanced

No code repo Jun 2026

LANTERN: A Closed-Loop Benchmark for VLM-Based Cooperative Driving with Temporally Grounded Warnings

Yongshuo Liu, Xu Gao, Morui Zhu et al. · arXiv preprint · Sep 2026

We present LANTERN, a closed-loop benchmark for temporally grounded cooperative warnings. LANTERN separates warning onset, hazard onset, warning termination, and post-hazard recovery, and evaluates each physical event under matched warning and no-warning executions so that the warning's contribut...

vision vla control benchmark

PDF Intermediate

No code repo Sep 2026

Learning Adaptive Solvers for Distributed Factor Graph Optimization on Matrix Lie Groups

Jaeho Shin, Maani Ghaffari, Yulun Tian · arXiv preprint · Jul 2026

Modern robotic perception increasingly involves large-scale geometric optimization problems distributed across multiple robots or sessions. However, existing distributed solvers often depend on brittle hand tuning and primarily target rigid body pose graphs. To address this, we present DeepCORD, ...

vision reinforcement-learning benchmark

PDF Advanced

No code repo Jul 2026

Marine Autonomous Vehicle Fleet Scheduling to Maximise Scientific Impact

Mehdi El Krari, Jonathan Smith, Maria Fox · arXiv preprint · Aug 2026

The marine science community increasingly relies on Marine Autonomous Vehicles (MAVs) to collect the critical environmental data required to understand global ocean systems. However, as these operations scale, manually routing and planning large autonomous fleets becomes exponentially complex and...

vision reinforcement-learning planning

PDF Intermediate

No code repo Aug 2026

Memory as Plans: World-Action Modeling with Memory-Grounded Planning

Sizhe Zhao, Haozhe Xie, Weiyu Zhao et al. · arXiv preprint · Sep 2026

Mainstream robotic policies often adopt a Markovian formulation, but many complex real-world manipulation tasks are inherently non-Markovian, requiring long-horizon memory beyond the current observation. Existing memory mechanisms often rely on language summaries, growing visual windows, or their...

manipulation vision reinforcement-learning planning

PDF Intermediate

No code repo Sep 2026

Native Video-Action Pretraining for Generalizable Robot Control

Qihang Zhang, Lin Li, Luyao Zhang et al. · arXiv preprint · Jul 2026

The advent of video-action models offers a promising path for robot control. Nevertheless, we argue that repurposing video generative models designed for digital content creation is inherently inadequate for physical environments. To bridge this gap, we present LingBot-VA 2.0, a video-action foun...

manipulation vision reinforcement-learning control

PDF Advanced

No code repo Jul 2026

Odometer-Agnostic Drift Correction Using OpenStreetMap Lane Geometry

Joaquin Caballero, Emilio Garcia-Fidalgo, Alberto Ortiz et al. · arXiv preprint · Sep 2026

Despite significant progress in odometry estimation, long-term drift remains a fundamental limitation of incremental pose integration, especially in large-scale or loop-free environments. Existing map-assisted methods can reduce drift, but often depend on dense maps, sensor-specific processing, o...

vision reinforcement-learning

PDF Advanced

No code repo Sep 2026

PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball

Lizhi Yang, Junheng Li, Aaron D. Ames · arXiv preprint · Jul 2026

We present PAC-MAN, a perception-aware CBF-RL framework that couples control-barrier safety with deployment-realistic onboard sensing for whole-body humanoid dodgeball. The deployed policy sees the ball only as segmentation-masked depth from a head-mounted camera, while training-time CBF guidance...

vision reinforcement-learning control benchmark

Code PDF Intermediate

GitHub ★ — Jul 2026

Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms

Yanchen Guan, Xingcheng Liu, Bin Rao et al. · arXiv preprint · Aug 2026

End-to-end autonomous driving has evolved from camera-to-control regression toward planning-oriented systems that use structured representations, trajectory-level outputs, and increasingly realistic evaluation protocols. This survey reviews this transition across behavior cloning, conditional imi...

vision vla reinforcement-learning planning control learning-from-demonstration benchmark

PDF Advanced

No code repo Aug 2026

Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation

Yuxuan Chen, Wanruo Zhang, Xiao Li · arXiv preprint · Aug 2026

Vision-Language-Action (VLA) models have recently achieved promising performance in robotic manipulation. However, existing benchmarks mainly evaluate generalization on static manipulation tasks and largely overlook dynamic interaction scenarios. To address this gap, we present ReflexBench, a ben...

manipulation vision vla reinforcement-learning control benchmark

Code PDF Advanced

GitHub ★ — Aug 2026

RoboSPA: Can VLA Models Go Beyond Simple Scenes and Short-Horizon Tasks?

Zhenxuan Fan, Bo Zhang, Yutong Lin et al. · arXiv preprint · Sep 2026

Vision-Language-Action (VLA) models have shown promising progress in language-conditioned robotic manipulation. However, existing datasets and benchmarks mainly evaluate task completion under predefined settings, offering limited insight into model reasoning under increasing spatial and procedura...

manipulation vision vla planning benchmark

Code PDF Advanced

GitHub ★ — Sep 2026

RoboTTT: Context Scaling for Robot Policies

Yunfan Jiang, Yevgen Chebotar, Ruijie Zheng et al. · arXiv preprint · Jul 2026

Recent robot foundation models operate with single-step or short-history visuomotor context. We introduce Test-Time-Training Robot Policies (RoboTTT), a robot model and training recipe that scale visuomotor context to 8K timesteps, three orders of magnitude beyond state-of-the-art policies, witho...

manipulation vision vla reinforcement-learning learning-from-demonstration

Code PDF Advanced

GitHub ★ — Jul 2026

Same Trajectory, Contradictory Rewards (ROBORMBENCH): Paraphrase Fragility in Vision Language Reward Models

Wonje Jeung, Sangyeon Yoon, Hyesoo Hong et al. · arXiv preprint · Sep 2026

Vision-language models are increasingly used as reward functions for robotic learning, but this role requires paraphrase invariance: the same trajectory should receive the same reward under semantically equivalent goal descriptions. We show that current VLM reward models often violate this proper...

vision vla benchmark

PDF Intermediate

No code repo Sep 2026

SEED-UMI: Sharing the Exoskeleton between human and robot for onE-to-one Dexterous demonstration

Tengbo Yu, Jiahao Wu, Daohan Li et al. · arXiv preprint · Sep 2026

Imitation learning for dexterous hands is bottlenecked by the difficulty of collecting contact-rich demonstrations that transfer faithfully to the robot. Prior wearable-exoskeleton systems record only on the human side and retarget via open-loop mappings calibrated in free space, which degrade un...

manipulation vision reinforcement-learning learning-from-demonstration

Code PDF Intermediate

GitHub ★ — Sep 2026

Synthetic Data Generation and Vision-based Wrinkle and Keypoint Detection for Bimanual Cloth Manipulation

Ariel Herrera, Xueyang Kang, Atal Anil Kumar · arXiv preprint · Jun 2026

Robotic manipulation of textiles remains challenging because continuous deformation and self-occlusions hinder the robust visual perception required to estimate the cloth's state. To address the lack of annotated real-world data, we developed a Blender-based synthetic pipeline exporting auto-annotat...

vision manipulation reinforcement-learning

PDF Intermediate

No code repo Jun 2026

TADP: Task-Aware Deformable Prediction for Single-Stage 3D Object Detection

Su Wang, Yaochen Li, Min Yang et al. · arXiv preprint · Aug 2026

Most single-stage 3D object detectors complete different tasks with the same extracted features. Nevertheless, it is impossible to project features into a common space that is adaptive for all the tasks. We present a novel task-aware deformable prediction (TADP) method for single-stage 3D object ...

vision benchmark

PDF Intermediate

No code repo Aug 2026

TEA-AgriVLN: Traversability Estimation Alarm for Agricultural Vision-and-Language Navigation

Xiaobei Zhao, Xingqi Lyu, Xin Chen et al. · arXiv preprint · Jul 2026

Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires an agent to follow a natural language instruction, predicting a sequence of low-level actions to navigate a robot from a starting point to a target location. The A2A benchmark and the AgriVLN method pioneeringly extended ...

vision planning benchmark

Code PDF Intermediate

GitHub ★ — Jul 2026

$\textbf{PLATO}: \emph{Preintegration Learning from Accurate Trajectory Observations} for Neural Inertial Odometry$

\textbf{PLATO}: \emph{Preintegration Learning from Accurate Trajectory Observations} for Neural Inertial Odometry

Haoying Li, Qihang Liu, Yifan Peng et al. · arXiv preprint · Sep 2026

Neural inertial odometry has demonstrated strong potential for motion estimation in challenging environments, yet inertial-only preintegration remains sensitive to IMU bias and uncertainty. To this end, this paper introduces \textbf{PLATO}:~\emph{Preintegration Learning from Accurate Trajectory O...

vision

PDF Intermediate

No code repo Sep 2026

THRIVE: Therapeutic Humanoid Robot In Virtual Environment

Jin Xu, Yu-Ping Chen, Ayanna Howard · arXiv preprint · Aug 2026

This paper presents THRIVE (Therapeutic Humanoid Robot In Virtual Environment), an at-home rehabilitation platform that integrates a suite of virtual-reality upper-body rehabilitation games, a real-time camera-based motion-tracking system, and a socially interactive robot therapist. The system is...

manipulation vision reinforcement-learning human-robot-interaction

PDF Intermediate

No code repo Aug 2026

Towards Neuro-Symbolic Procedural Reasoning for Long-Horizon Vision-Language-Action Manipulation

Vivek Chavan, Yahuan Shi, Oliver Heimann et al. · arXiv preprint · Sep 2026

Vision-language-action (VLA) models can execute short manipulation skills, but remain brittle in long-horizon procedures requiring persistent task state, dependency-aware reasoning, conditional decisions, and reliable grounding. We investigate a neuro-symbolic framework that combines learned VLA ...

manipulation vision vla reinforcement-learning control learning-from-demonstration

PDF Intermediate

No code repo Sep 2026

Towards Professional Tennis Styles for Humanoid Robots with Adaptive Motion Planning and Tracking

Tao Huang, Ruofei Liu, Xuchen Tang et al. · arXiv preprint · Aug 2026

Humanoid robots have recently demonstrated promising capabilities in real-world ball sports. However, achieving professional motion styles while maintaining strong task performance remains challenging. In this work, we propose AdaPT, an Adaptive Motion Planning and Tracking framework that learns ...

vision reinforcement-learning sim-to-real planning

Code PDF Intermediate

GitHub ★ — Aug 2026

Towards Surgical World-Action Modeling: A Preliminary Joint Visual-Trajectory Forecasting for Surgical Motion Planning

Weiliang Huang, Huanrong Liu, Bob Zhang et al. · arXiv preprint · Aug 2026

Reliable surgical planning requires models to anticipate not only how instruments will move, but also how the operative visual state will evolve together with such motion. Existing approaches typically treat future scene generation and instrument trajectory prediction as two separate tasks. Scene...

vision reinforcement-learning planning benchmark

Code PDF Intermediate

GitHub ★ — Aug 2026

UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling

Wei Li, Rui Shao, Jie He et al. · arXiv preprint · Sep 2026

Recent advances in Vision-Language-Action (VLA) models have improved robotic manipulation, yet observation-to-action learning remains limited by a fundamental transition realizability gap, manifested in three tightly coupled problems: (i) Transition ambiguity. Visually similar current observation...

manipulation vision vla reinforcement-learning

Code PDF Intermediate

GitHub ★ — Sep 2026

Using Automated Vehicles Operational Data to Confirm Safety and Anticipate Threats

Riccardo Donà, Espedito Rusciano, Germana Trentadue et al. · arXiv preprint · Sep 2026

European Union (EU) policymakers adopted revolutionary data collection provisions for Automated Driving Systems (ADS) in the recently approved regulation that allows driverless vehicles to be operated on public roads. The framework is inspired by best practices developed at the United Nations Eco...

vision reinforcement-learning

PDF Intermediate

No code repo Sep 2026

Video2DoorTraversal: Push Door Traversal via Simulated Door Twins

Xincheng Tang, Yiji Chen, Youhan Xie et al. · arXiv preprint · Aug 2026

Door opening and traversal is a long-horizon loco-manipulation task that requires precise handle interaction and coordinated base-arm control. We present Video2DoorTraversal, a single-video real-to-sim-to-real framework for wheel-legged mobile manipulators. Given one RGB video of a real door, Doo...

manipulation locomotion vision reinforcement-learning sim-to-real control learning-from-demonstration

PDF Intermediate

No code repo Aug 2026

Visual-SLAM for the detection of hidden tomatoes in greenhouses by Hierarchical Localization and GLOMAPfor robotized harvesting

Fernando Cañadas-Aránega, José C. Moreno, José L. Blanco-Claraco et al. · arXiv preprint · Sep 2026

Advanced crop monitoring inside greenhouses is becoming one of the primary objectives of research centers. High-performance sensors, such as LiDAR or stereo cameras, have traditionally been employed for this purpose, though these often have a high cost. This work proposes a Visual-SLAM system usi...

vision planning

Code PDF Intermediate

GitHub ★ — Sep 2026

VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies

Chang Song, Bin Qian, Yan Feng et al. · arXiv preprint · Sep 2026

Long-horizon robot manipulation with Vision-Language-Action (VLA) policies remains vulnerable to execution-time deviations, as final task success provides little information for diagnosing and correcting failures caused by action noise, object displacement, or goal misalignment. We introduce a st...

manipulation vision vla reinforcement-learning benchmark

PDF Intermediate

No code repo Sep 2026

VoLN: Vision-Only Long-Horizon Navigation---Paradigm, Benchmark, and Method

Jiabin Lou, Haopeng Wang, Yuanshuai Wang et al. · arXiv preprint · Jul 2026

Vision-and-Language Navigation (VLN) enables embodied agents to follow natural-language instructions. However, route-level instructions commonly encode spatial priors, such as orientation, distance, and layout, that are not explicitly available from onboard sensing at deployment in open, GPS-deni...

vision vla planning benchmark

Code PDF Intermediate

GitHub ★ — Jul 2026

What Matters, When? Diagnosing and Improving Conditional Visual Grounding in Visuomotor Imitation Policies

Vivek Chavan, Pengtao Xie, Yahuan Shi et al. · arXiv preprint · Sep 2026

Visuomotor imitation policies can achieve high performance under in-distribution visual conditions yet fail when visually similar objects or receptacles are introduced. We study this behavior as a problem of conditional visual grounding: the visual target required for successful control changes w...

manipulation vision vla reinforcement-learning control

PDF Intermediate

No code repo Sep 2026

X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matching

Tianyu Yang, Yiming Zeng, Wenzhe Cai et al. · arXiv preprint · Jul 2026

Pretraining navigation diffusion policies rely on large-scale expert demonstrations. These data are typically generated by a fully-informed oracle planner suited to a single nominal robot. This limits the policy's generalization to diverse embodiments and challenging scenarios (e.g., escaping dea...

vision reinforcement-learning planning learning-from-demonstration

Code PDF Advanced

GitHub ★ — Jul 2026

$ω$-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation

Zhe Li, Zhenzhe Zhang, Yangyang Wei et al. · arXiv preprint · Aug 2026

Humanoid household tasks often require concurrent loco-manipulation, where the robot must move, adjust posture, maintain balance, and manipulate objects as a single coordinated behavior. Yet existing humanoid policies typically decompose locomotion and manipulation, while recent world-action mode...

manipulation locomotion vision vla reinforcement-learning control learning-from-demonstration benchmark

PDF Advanced

No code repo Aug 2026

GR00T N1: An Open Foundation Model for Generalist Humanoid Robots

NVIDIA, :, Johan Bjorck et al. · arXiv preprint · Mar 2025

General-purpose robots need a versatile body and an intelligent mind. Recent advancements in humanoid robots have shown great promise as a hardware platform for building generalist autonomy in the human world. A robot foundation model, trained on massive and diverse data sources, is essential for...

manipulation vision vla reinforcement-learning control learning-from-demonstration benchmark

Code PDF Advanced

GitHub ★ — Mar 2025

WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Control

Haoran Jiang, Jin Chen, Qingwen Bu et al. · arXiv preprint · Dec 2025

Humanoid robots require precise locomotion and dexterous manipulation to perform challenging loco-manipulation tasks. Yet existing approaches, modular or end-to-end, are deficient in manipulation-aware locomotion. This confines the robot to a limited workspace, preventing it from performing large...

manipulation locomotion vision vla reinforcement-learning control learning-from-demonstration benchmark

Code PDF Advanced

GitHub ★ — Dec 2025

Suggested Learning Path

Read these papers in order to build expertise in Computer Vision.

1
3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training
Jiaxin Shi, Xidong Zhang et al. · 2026
2
A Low-Cost, Open Platform for End-to-End Autonomous Driving on a Miniature Ackermann Vehicle
Gustavo Claudio Karl Couto, Eric Aislan Antonelo et al. · 2026
3
A New Human-Likeness and Comfort Index for Robot Movements Along Prescribed Paths
Rosanna Coccaro, Enrico Ferrentino et al. · 2026
4
Adaptation Needs in Robotic Systems: Assessing Behavior Trees and Their Enhancement
Mehran Rostamnia, Gianluca Filippone et al. · 2026
5
Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis
Sixu Yan, Shikang Wang et al. · 2026
6
Assessing Physical Frailty and Fall-Risk Indicators with Social Robots: An in situ Evaluation with Older Adults
Aniol Civit, Antonio Andriella et al. · 2026

…and 70 more papers.