arxiv.org·2026/10/21
为检验NVIDIA X-Mobility与COMPASS学习导航能否在真实工业机器人上接近生产栈,研究把COMPASS仿真基准扩展到Idealworks的iw.hub差速机器人和全向HMP以及R&D中心数字孪生,并在实体iw.hub上对比仅NVIDIA环境训练、数字孪生微调、数字孪生加Cosmos sim-to-real增强三种策略与Idealworks导航栈。仿真中两种机型在未见过的数字孪生环境仍能迁移。真实基准部署于Jetson AGX Xavier,用多组布局生成训练数据,按成功率、效率、安全、平滑和计算开销评估;Cosmos增强的IW.CE-COMPASS在四个场景把真实成功率从65.3%提高到91.7%,加权旅行时间近减半,距生产栈8.3个百分点,全程板载运行;集成全局规划器后,在远距遮挡目标场景每试成功。数字孪生复现显示该增益来自缩小sim-to-real差距而非改变仿真行为。结论认为该生态可缩小与专用传统栈的差距,但成熟生产栈仍强,下一步需在HMP上量化跨机型迁移ROI、满足工业安全标准,并增强障碍感知与agentic流程。
为什么重要 这是 NVIDIA sim-to-real 流水线在真实 AMR 上接近生产导航栈的量化证据,直接服务机器人训练数据闭环与投资决策。适合 关注具身智能训练数据闭环、sim-to-real、AMR 导航落地的工程师与决策者。
经典机器人导航栈可靠,但往往需要针对每种新机器人和新场地重新工程化。基于学习的导航将这部分工作从手工调参转移到数据生成与训练,策略通过在仿真中微调来适配新的本体或设施。以这种方式适配的策略能否在真实工业机器人上保持可靠,此前几乎没有系统性检验。
我们针对 NVIDIA 的 X-Mobility 与 COMPASS 工作流在 Idealworks 机器人上训练学习导航策略进行了研究。在仿真中,我们用两种本体扩展了 COMPASS 基准——差速驱动的 iw.hub 与全向 Humanoid Mobile Platform (HMP)——并加入了 Idealworks 研发中心的数字孪生。
在真实世界,我们在该数字孪生的数据上微调 X-Mobility(分别带与不带 NVIDIA Cosmos 生成的 sim-to-real 变体),在数字孪生中从零训练其上的 COMPASS,将所得策略部署到 iw.hub 板载的 Jetson AGX Xavier 上,并在 Idealworks 研发中心就任务成功率、效率、安全性、平滑性与板载算力进行基准测试,对比对象为仅在 NVIDIA 环境中训练的 COMPASS 以及现有的 Idealworks 导航栈。
将每个静态场景同时在数字孪生副本与真实设施中运行,可度量 sim-to-real 差距以及 Cosmos 增强数据能在多大程度上缩小该差距。
在数字孪生中训练并配合 Cosmos sim-to-real 增强,使学习导航在四个场景中的真实世界成功率从 65.3% 提升到 91.7%,加权行驶时间相比纯仿真训练几乎减半,与生产导航栈的差距缩小到 8.3 个百分点,且完全在板载运行;配合集成的全局规划器,它在每次试验中都能到达远处被遮挡的目标。
Classical robot navigation stacks are reliable but often require re-engineering for each new robot type and site.
Learning-based navigation shifts this effort from hand-tuned parameters to data generation and training, where a policy adapts to each new embodiment or facility by fine-tuning in simulation.
Whether policies adapted this way stay reliable on real industrial robots has seen little systematic testing.
We study this for NVIDIA's X-Mobility and COMPASS workflow for training learned navigation policies on Idealworks robots.
In simulation, we extend the COMPASS benchmark with two embodiments, the differential-drive iw.hub and an omnidirectional Humanoid Mobile Platform (HMP), and with a digital twin of the Idealworks R&D center.
For the real world, we fine-tune X-Mobility on data from this digital twin, with and without sim-to-real variants generated by NVIDIA Cosmos, train COMPASS on top of it from scratch in the digital twin, deploy the resulting policies on the iw.hub's onboard Jetson AGX Xavier, and benchmark them in the Idealworks R&D center against COMPASS trained only on NVIDIA's environments and the existing Idealworks navigation stack on task success, efficiency, safety, smoothness and onboard compute.
Running every static scenario both in a digital-twin replica and in the real facility measures the sim-to-real gap and how far Cosmos-augmented data closes it.
Training in the digital twin with Cosmos sim-to-real augmentation raises the real-world success rate of learned navigation from 65.3% to 91.7% across four scenarios and nearly halves its weighted travel time compared with simulation-only training, bringing it within 8.3 points of the production navigation stack, fully onboard; with an integrated global planner, it also reaches far, occluded goals in every trial.
SR增益
相对 NVIDIA
Cosmos贡献
超出 IW.
从63.8s到33.9s
振荡降幅
角速度符号变化
与栈差距
距100%生产栈
注释 · 这些增益分解自四个静态/动态场景 S1–S4 与生产栈的对比。出自 §3 Overall
注释 · 每个环境 640 次试验,Office 对每个策略都最难。出自 Table 1



EVIDENCE / METHODS
表格
S3 静态障碍是最难场景,NVIDIA
| 场景 | IW Nav | NVIDIA | IW. | IW.CE- |
|---|---|---|---|---|
| S1 | 100.0 | 100.0 | 100.0 | 100.0 |
| S2 | 100.0 | 83.3 | 96.8 | 100.0 |
| S3 | 100.0 | 6.7 | 54.8 | 83.3 |
| S4 | 100.0 | 71.4 | 80.0 | 83.3 |
注释 · 数据取自 Table 4,IW Nav 为生产参照,
原版排版与图表 · 手机无法内嵌时可在浏览器打开。PDF 插件内选文不能传给网页助手。