Frequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation

Frequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation

Featured

Jianing Guo, Fangzheng Chen, Zihao Mao, Wong Lik Hang Kenny, Zhenhong Wu, Yu Li, Yishuai Cai, Yuanpei Chen, Yikun Ban, Kai Chen, Qi Dou, Yaodong Yang, Xianglong Liu, Huijie Zhao, Simin Li · · 2026

Framework

N/A

License

N/A

Stars

N/A

Summary

Flow matching has emerged as a standard paradigm for robotic manipulation owing to its strong expressive power for modelling complex, multimodal action distributions, alongside similar approaches like diffusion policy.

Abstract Summary

Flow matching has emerged as a standard paradigm for robotic manipulation owing to its strong expressive power for modelling complex, multimodal action distributions, alongside similar approaches like diffusion policy. However, existing methods rely on discretized action chunks, making them brittle to demonstrations collected at heterogeneous control frequencies and prone to temporally inconsistent actions that degrade control stability. In this paper, we propose Frequency-Aware Flow Matching (FAFM), which outputs continuous, temporally consistent actions. To handle heterogeneous frequency input, we transform discrete action sequences into the frequency domain with the discrete cosine transform (DCT), perform flow matching over the resulting coefficients, and reconstruct continuous actions via cosine basis expansion. To generate temporally consistent actions, we regularize the first-order temporal derivative to promote smooth actions. This corresponds to a Sobolev-type constraint that suppresses high-frequency errors and discourages abrupt action changes. Our FAFM is simple, introduces no additional network parameters and applies to standalone flow-matching policies and vision-language action models. Across synthetic toy benchmark, obstacle avoidance, LapGym, and LIBERO, FAFM improves success rates, multimodal expressivity, motion smoothness, convergence speed, robustness to mechanical bias and mixed-frequency input. These gains are consistent when deployed on a real-world Franka robot. Code available at https://anonymous.4open.science/r/FAFM.

Key Points

  • Proposes Frequency-Aware Flow Matching for Continuous and Consistent for robotics.
  • Evaluated on real or simulated robotic tasks.
  • Primary contribution in ar-vr.

Method

In this section, we propose frequency-aware flow matching to generate continuous and temporally consistent actions. Our overall approach are illustrated in Figure 2 . Problem Formulation. We consider robot action generation as learning $p(\mathbf{A}/\mathbf{o})$ over action chunks $\mathbf{A}=[a_{0},\ldots,a_{K-1}]\in\mathbb{R}^{K\times d}$ given observation $\mathbf{o}$.

Method — Frequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation
Figure 2: Overview of FAFM. Demonstration trajectories are mapped to DCT coefficients anchored to physical time, flow matching is performed in coefficient space, and analytic temporal-derivative supervision regularizes the continuous action for smooth execution.

Experiments

We evaluate FAFM in two stages. First, as a standalone policy, it is assessed on synthetic toy benchmark, obstacle avoidance, LapGym [ 18 ] , and deployed on a real Franka robot. Second, FAFM is integrated into VLA backbones, evaluated on LIBERO [ 19 ] , and again deployed on a real Franka robot. The specific purpose of each environment is described below.

Evaluation metrics : We adopt success rate (SR) as the primary measure of task reliability.

Experiments — Frequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation
Figure 3: Synthetic toy bi-modal trajectory experiment. FAFM uniquely capture the multimodal modes and yields smooth trajectory.

Sources and Demonstrations

Figures are reproduced from Guo et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
arXiv preprint

Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think

Gia-Binh Nguyen, Trong-Bao Ho, Thien-Loc Ha et al.

Vision-Language-Action (VLA) models pre-trained on massive video-robot datasets have revolutionized robotic manipulation, yet their multi-billion parameter architectures impose prohibitive computational burdens during downstream fine-tuning and real-time inference.

ar-vr evaluation manipulation
PDF Intermediate