CIRRA: Dual-Level Continual Instruction Reconciliation with Ongoing Execution for Embodied Robot Agents in Interactive Household Tasks

CIRRA: Dual-Level Continual Instruction Reconciliation with Ongoing Execution for Embodied Robot Agents in Interactive Household Tasks

Ci Zhang, Enfu Nan, Arman Akbari, Lin Zhao, Li Wang, Chen Wang, Weiwei Chen, Yanzhi Wang, Geng Yuan · N/A · 2026

vla planning benchmark

Framework

N/A

License

N/A

Stars

N/A

Summary

Household robots must accommodate new user instructions while executing ongoing tasks. Existing agents often regenerate or extensively revise the remaining task sequence, introducing plan ambiguity, logical inconsistency, and redundant execution.

Abstract Summary

Household robots must accommodate new user instructions while executing ongoing tasks. Existing agents often regenerate or extensively revise the remaining task sequence, introducing plan ambiguity, logical inconsistency, and redundant execution. We formulate continual instruction reconciliation and propose CIRRA (Continual Instruction Reconciliation for Robot Agents), a dual-level framework combining LLM-based semantic reasoning with rule-constrained structural integration. CIRRA first grounds incoming instructions to unique executable skills and resolves underspecified actions and execution locations. It then preserves the ongoing subtask sequence as an execution backbone and generates integration candidates by inserting incoming subtasks into location-matched segments. The semantic reasoner evaluates only modified segments to identify dependencies and conflicts and select the most logically coherent local integration. This structure-preserving process maintains alignment with ongoing execution, mitigates ambiguity and inconsistency, and reuses shared subtasks to reduce redundant execution. We also introduce CHIRP (Continual Household Instruction Reconciliation and Planning), a text-based benchmark of 120 episodes across eight household environments and six categories of everyday activities. On CHIRP, CIRRA achieves 74.2% decision agreement, exceeding the strongest replanning baseline by 30 percentage points; every correct fusion decision yields a correctly placed, conflict-free schedule. On a Unitree G1 humanoid, CIRRA interrupts ongoing skills at the correct moment in every trial and significantly outperforms all baselines on every metric.

Key Points

  • Household robots must accommodate new user instructions while executing ongoing tasks
  • Existing agents often regenerate or extensively revise the remaining task sequence, introducing plan ambiguity, logical inconsistency, and redundant execution.
  • We formulate continual instruction reconciliation and propose CIRRA (Continual Instruction Reconciliation for Robot Agents), a dual-level framework combining LLM-based semantic reasoning with rule-constrained structural integration.
  • CIRRA first grounds incoming instructions to unique executable skills and resolves underspecified actions and execution locations.
  • It then preserves the ongoing subtask sequence as an execution backbone and generates integration candidates by inserting incoming subtasks into location-matched segments.

Methodology

We consider an embodied robot agent that receives a new user instruction while executing an existing household task. At time step $t$, the agent maintains an ongoing task sequence where each subtask is represented using a unified tuple Here, $a_{i}$ denotes an executable robot skill.

We divide the robot skill set $\mathcal{A}$ into navigation skills $\mathcal{A}_{\mathrm{nav}}$ and non-navigation behavioral skills $\mathcal{A}_{\mathrm{beh}}$. The meanings of $o_{i}$ and $l_{i}$ depend on the corresponding skill type.

Methodology — CIRRA: Dual-Level Continual Instruction Reconciliation with Ongoing Execution for Embodied Robot Agents in Interactive Household Tasks
Figure 2: Overview of CIRRA: (1) instruction assessment and ambiguity resolution, (2) rule-constrained candidate generation within location-matched segments, and (3) conflict-gated LLM arbitration that yields the revised sequence $\mathcal{P}^{\prime}_{t}$.

Experiments

CHIRP contains 120 episodes set in a simulated home with eight rooms, covering six action categories of 20 episodes each (appliance control, cleaning, tidying, cooking, fetch and delivery, and waste handling). Each episode freezes the moment a new utterance arrives during an ongoing task and asks for the agent’s reaction.

Episodes are built as minimal pairs with nearly identical wording but different execution states, so a method that ignores execution state must miss one episode of each pair.

Experiments — CIRRA: Dual-Level Continual Instruction Reconciliation with Ongoing Execution for Embodied Robot Agents in Interactive Household Tasks
Figure 3: Real-world setup. (a) A Unitree G1 humanoid operates at table $A$ (left) and table $B$ (right);(b) The eight tasks forming the robot’s behavioral skills.

Sources and Demonstrations

Figures are reproduced from Zhang et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

Coding Agents for Generalized Task and Motion Planning Problems
arXiv preprint

Coding Agents for Generalized Task and Motion Planning Problems

Matteo Merler, Bowen Li, Josh Roy et al.

Task and motion planning (TAMP) problems remain difficult even with full observability and object-centric states because discrete decisions are tightly coupled to geometric, kinematic, and dynamic constraints.

vla planning benchmark
PDF Intermediate