arxiv.org·2026/10/21
针对VLA异步推理延迟使新动作块基于陈旧观察、现有多候选方法或用生成观察排序或执行中反复切换导致轨迹不连续,PACT-VLA把推理延迟转化为决策窗口:从推理起点观察生成固定候选池,在提交前用预提交观察ot+d−1以FlowRes评分选出完整动作块;FlowRes共享同一验证噪声,计算候选隐含流方向与冻结策略在该观察下预测速度的加权残差,无需单独验证器,流水线并行处理观察与候选生成并批量评分,不增加控制步延迟。在Kinetix相同检查点下,最长延迟时较RTC成功率提高15.0个百分点,并进一步改善VLASH、DEFLECT、REMAC;在LIBERO上对π0.5与GR00T N1.7单候选异步执行,最长延迟下两个骨干均有提升,GR00T N1.7提高5.2个百分点,但最短延迟时因预提交观察未更新平均成功率略降。三个真实机器人任务使用同一冻结π0.5,平均成功率从60%升至82%;延迟测试显示候选加验证与单候选生成落在同一控制步延迟桶。FlowRes是策略一致性分数而非直接成功率估计。
为什么重要 异步 VLA 推理延迟会显著拉低成功率,该方法无需训练或额外验证器,直接复用冻结策略,在真机上将平均成功率从 60% 提升到 82%,对延迟鲁棒部署有直接工程价值。适合 做 VLA 异步部署、真机机器人控制与延迟鲁棒推理的工程师。
视觉-语言-动作(VLA)策略在现实世界环境中通常以异步推理方式部署,即在机器人仍在执行上一个动作块的同时生成下一个动作块。当新动作块被提交时,机器人和场景已经发生了变化,因此该动作块是以过时的观测为条件的,且随着推理延迟的增长,任务成功率急剧下降。
生成多个候选动作块可以让较新的观测为最终选择提供信息,但现有的多候选方法要么使用过时的推理起始观测对候选进行排序,要么在执行过程中反复在候选之间切换,这可能导致所执行的动作序列不连续。我们的关键洞察是,推理延迟可以被用作决策时间。在候选生成仍在进行的同时,候选选择可以复用 VLA 本身来选择最符合较晚观测的完整动作块。
我们提出了 PACT-VLA,这是一个免训练框架,它从推理起始观测生成候选,并使用这一提交前观测选择其中一个候选。其评分函数 FlowRes 测量每个候选所隐含的流方向与冻结策略在提交前观测下预测的速度之间的残差,无需单独的验证器。流水线式实现将观测处理与候选生成重叠进行,并对评分进行批处理,因此在所评估的硬件上,选择不会增加任何控制步延迟。
在四步延迟下,PACT-VLA 在 Kinetix 上比 RTC 将平均成功率提高了 15.0 个百分点,在 LIBERO 上比使用 GR00T N1.7 的单候选异步执行提高了 5.2 个百分点,并且它还进一步改进了现有的延迟鲁棒方法。在三个真实机器人任务上,使用相同的冻结 π0.5 检查点,它将平均成功率相比朴素异步执行从 60% 提升到 82%。
Vision-language-action (VLA) policies are commonly deployed with asynchronous inference in real-world settings, where the next action chunk is generated while the robot is still executing the previous one.
By the time the new chunk is committed, the robot and scene have changed, so the chunk is conditioned on a stale observation and task success drops sharply as this inference delay grows.
Generating multiple candidate chunks could let newer observations inform the final choice, but existing multi-candidate methods either rank candidates with the stale inference-start observation or repeatedly switch between candidates during execution, which can make the executed action sequence discontinuous.
Our key insight is that inference delay can be used as decision time.
While candidate generation is still underway, candidate selection can reuse the VLA itself to choose the complete action chunk that best fits a later observation.
We propose PACT-VLA, a training-free framework that generates candidates from the inference-start observation and selects one using this pre-commit observation.
Its scoring function, FlowRes, measures the residual between each candidate's implied flow direction and the velocity predicted by the frozen policy under the pre-commit observation, requiring no separate verifier.
A pipelined implementation overlaps observation processing with candidate generation and batches scoring, so selection adds no control-step delay on the evaluated hardware.
At a four-step delay, PACT-VLA improves average success by 15.0 percentage points over RTC on Kinetix and by 5.2 points over single-candidate asynchronous execution with GR00T N1.7 on LIBERO, and it further improves existing delay-robust methods.
On three real-robot tasks, it raises average success from 60% to 82% over naive asynchronous execution with the same frozen π0.5 checkpoint.


| 对比项 | 之前 / 基线 | 现在 / 本方案 | |
|---|---|---|---|
| Kinetix 平均成功率 | RTC | PACT-VLA4 步延迟下 +15.0 个百分点 | |
| LIBERO 平均成功率 | GR00T N1.7 单候选异步 | PACT-VLA4 步延迟下 +5.2 个百分点 | |
| 真机三任务平均成功率 | naive asynchronous 60% | PACT-VLA 82%同 π0.5 checkpoint |
EVIDENCE / METHODS
要点
VLA 异步推理下,新 chunk 基于的观测已过期,任务成功率随延迟下降。
原版排版与图表 · 手机无法内嵌时可在浏览器打开。PDF 插件内选文不能传给网页助手。