arxiv.org·2026/10/19
针对机器人学习依赖遥操作示范、策略受模仿分布限制的问题,提出开源框架 RAX:冻结LLM编码智能体通过接口直接生成控制代码,无需动作示范或手工原语,把成功探索编译为封装感知-规划-控制环的程序,并以笔记和技能库跨会话复用,新机器人仅凭API接入。在RoboDojo、BEHAVIOR-1K、HumanoidArena、DexJoCo、LIBERO/LIBERO-Pro及Franka、Rainbow RB-Y1上按未见场景评估,作者报告平均超最强基线 +37.4%,RoboDojo达78.3%(VPP2为24.9%),HumanoidArena达 89.8% 且仅少量演示,DexJoCo最佳均值 99.5%;真实机器人无演示掌握高精度、可变形、关节和长程移动操作。规模扩展涌现主动感知、错误恢复、安全护栏与人机协作,深度感知优于RGB-only,推理延迟下降。知识以可检查、可组合的程序与技能存在,作者展望让智能体改进架构并跨机器人共享技能。
为什么重要 绕开遥操作采集,把能力沉淀为可检查的程序与技能库;新本体接 API 即可,影响数据闭环和部署成本。适合 具身智能、机器人学习与数据闭环工程师
机器人学习通过扩展演示数据集和模型容量取得了进展;然而,部署新的机器人本体或任务通常需要专门的遥操作语料库。由此得到的策略仍受其模仿分布的限制,限制了泛化能力和持续自我改进。我们介绍了 RAX(Robot Agent eXploration),一个以扩展探索为核心的机器人智能体开源框架:使智能体能够通过获取在线经验和合成可执行程序来改进。
在 RAX 中,一个通用编码智能体生成机器人控制代码,在没有动作演示数据、手工设计的动作原语或价值函数引导的情况下运行。通过在线探索,智能体识别出实现任务目标的决策序列,并将其编译为封装完整感知-规划-控制回路的模块化程序。利用 RAX,我们提出了一项系统性的多本体研究,在仿真和真实机器人上使用单臂、双臂、灵巧手、移动和类人系统,研究在精密和长时程操作任务上扩展在线探索。
随着探索规模的扩大,在未见环境上的泛化性能持续提升。在仿真中,RAX 平均比顶级基线模型高出 +37.4%。在真实机器人上,RAX 无需人类演示即可自主学习依赖记忆的、铰接式的、高精度的、可变形的以及长时程的移动操作任务,并通过组合先前探索会话中经过验证的技能来持续提升性能。随着探索规模的扩大,我们观察到包括主动感知、错误恢复、安全护栏和人机协作在内的涌现能力。
我们将 RAX 作为一个通用型机器人智能体平台开源,在该平台中,新的机器人本体仅通过其 API 即可集成,无需遥操作数据收集或策略训练。
Robot learning has advanced by scaling demonstration datasets and model capacity; however, deploying a new robot embodiment or task typically necessitates a dedicated teleoperation corpus.
The resulting policies remain bounded by their imitation distributions, limiting generalization and continual self-improvement.
We introduce RAX (Robot Agent eXploration), an open-source framework for robot agents centered on scaling exploration: enabling agents to improve by acquiring online experience and synthesizing executable programs.
In RAX, a general-purpose coding agent generates robot control code, operating without action demonstration data, hand-engineered action primitives, or value-function guidance.
Through online exploration, the agent identifies decision sequences that achieve task goals and compiles them into modular programs encapsulating the full perception-planning-control loop.
Using RAX, we present a systematic multi-embodiment study on scaling online exploration across precision and long-horizon manipulation tasks using single-arm, bimanual, dexterous, mobile, and humanoid systems in simulation and on real robots.
Generalization performance on unseen environments improves consistently as exploration scales. In simulation, RAX outperforms top baseline models by +37.4% on average.
On real robots, RAX autonomously learns memory-dependent, articulated, high-precision, deformable, and long-horizon mobile manipulation tasks without human demonstrations, continually improving performance by composing verified skills from prior exploration sessions.
As exploration scales, we observe emergent capabilities including active perception, error recovery, safety guardrails, and human-robot collaboration.
We open-source RAX as a generalist robot-agent platform in which new robot embodiments are integrated through their APIs alone, without teleoperated data collection or policy training.



| 对比项 | 之前 / 基线 | 现在 / 本方案 | |
|---|---|---|---|
| 五基准平均 | 最强基线 | RAX +37.4仿真平均提升 | |
| RoboDojo | 最强基线 | RAX +53.4 | |
| BEHAVIOR-1K | 最强基线 | RAX +38.3 | |
| DexJoCo | 最强基线 | RAX +31.4 | |
| LIBERO-Pro | 最强基线 | RAX +21.2 | |
| HumanoidArena | 最强基线,100 条演示 | RAX +7.9,3 条演示RAX 每任务仅用 3 条遥操作演示 |
EVIDENCE / METHODS
要点
VLA 与 WAM 用大规模遥操作语料微调预训练 VLM 或视频生成模型,新本体或新任务通常要另采一套数据。
原版排版与图表 · 手机无法内嵌时可在浏览器打开。PDF 插件内选文不能传给网页助手。