数据源与状态仍在导航菜单中
arxiv.org·2026/10/21
针对推理VLA能感知危险却未必刹停,作者提出感知-动作绑定缺口,以Alpamayo-1.5为对象,在CARLA反事实、NuRec闭环保真和日志回放中分离危险可用性与动作权威。诊断显示障碍物可从视觉表示解码,纵向规划却主要追踪ego速度、对障碍距离和推理轨迹几乎无响应。作者不重训、不改权重,将危险条件能量注入冻结flow-matching采样器:精确几何引导使足迹侵入率从58.1%降至14.5%,新站点由65.0%降至6.0%,闭环保真中碰撞消失,证明冻结生成器本可刹车,规划依赖从ego速度反转为障碍距离。模型自身注意力读出在新站点降至11.7%,接近几何引导。Senna和VaVAM也有类似危险响应失败;局限是危险均为合成,跨CARLA到NuRec的自动触发仍不稳健。
为什么重要 对自驾 VLA 落地与评测:感知/推理证据不必然控制动作;反事实仿真 + 推理时能量引导可修复,且代价仅 3.8ms适合 推理 VLA 自驾、评估与训练基础设施的工程师
推理增强的视觉-语言-动作(VLA)驾驶模型能够感知并推理安全关键危险,却未能将这些证据转化为安全动作。我们将这种失败刻画为感知-动作绑定缺口:危险信息在模型内部是可用的,但对轨迹生成的控制不足。使用匹配的模拟反事实和记录的驾驶回放,我们表明路径内危险实际上被编码在视觉表示中,但纵向规划由自车速度历史主导,并且只对危险接近程度或模型自身的推理轨迹作出弱响应。
进一步分析表明,轨迹生成器具备制动能力,但由于感知-动作绑定缺口,有时未能这样做。在不重新训练或修改任何权重的情况下,我们将危险条件能量注入 Alpamayo-1.5 的冻结 flow-matching 采样器,在生成时恢复缺失的耦合。
在精确障碍物几何下,引导将足迹侵入从 58.1% 降低到 14.5%,并在仍有足够停车距离时恢复安全制动,在我们的制动相关闭环测试组中完全消除碰撞。它还逆转了所诊断出的规划依赖,从跟踪自车速度转变为响应障碍物距离。这些结果在驾驶 VLA 中将危险感知与危险控制区分开来,表明即使模型同时拥有证据以及据此行动的能力,不安全行为仍可能出现,并提出了一种弥合该绑定缺口的简单修复方法。
Reasoning-augmented vision-language-action (VLA) driving models can perceive and reason about safety-critical hazards yet fail to translate that evidence into safe actions.
We characterize this failure as a perception-action binding gap: hazard information is available inside the model but exerts insufficient control over trajectory generation.
Using matched simulated counterfactuals and logged driving replay, we show that in-path hazards are actually encoded in the visual representation, but longitudinal plans are dominated by ego-speed history and respond only weakly to hazard proximity or the model's own reasoning trace.
Further analysis shows that the trajectory generator is capable of braking but sometimes fails to do so due to the perception-action binding gap.
Without retraining or modifying any weights, we inject a hazard-conditioned energy into the frozen flow-matching sampler of Alpamayo-1.5, restoring the missing coupling at generation time.
With exact obstacle geometry, guidance cuts footprint intrusion from 58.1% to 14.5% and recovers safe braking whenever sufficient stopping distance remains, eliminating collisions entirely in our braking-relevant closed-loop battery.
It also reverses the diagnosed dependence of the plan, from tracking ego speed to responding to obstacle range.
These results separate hazard perception from hazard control in driving VLAs, show that unsafe behavior can arise even when the model has both the evidence and the ability to act on it, and propose a simple fix for bridging this binding gap.
开放环入侵
seen 基线
引导后入侵
精确几何
闭环碰撞
must-brake
闭环最小间隙
原 -0.02m
新点入侵
精确几何
注释 · 开放环指标来自成对匹配场景,排除场地混杂。出自 §IV-A / §V-B
注释 · 空间结构保留是接近 oracle 的关键。出自 Table II / §V-C

EVIDENCE / METHODS
判断
AUC 0.998 的感知证据下,8–12m 场景全部入侵
论文把失败拆成三种可能:危害未被表示、生成器无法表达正确响应、证据拥有但行动权威不足。匹配反事实与闭环回放显示第三种:纵向计划被自车速度历史主导,危害与推理痕迹对轨迹几乎无因果权威。因此,不重训、不改权重直接给安全约束授权,就是在测试并修复连接层。
注释 · 感知可用不等于动作响应;诊断为绑定而非感知缺失或表达不足。出自 §IV-B / Fig.2
原版排版与图表 · 手机无法内嵌时可在浏览器打开。PDF 插件内选文不能传给网页助手。