arxiv.org·2026/10/19
MIT团队研究机器人仅凭关节本体感知能否完成毫米级精密装配:策略不用视觉、力/力矩与触觉,只观测0.6秒的关节位置速度史和既往动作,经仿真强化学习学会插销入孔、齿轮啮合与螺母旋合,而夹具位姿、抓取与零件几何均随机且未知。为此开源mjfit,以精确凸几何在MuJoCo中程序化批量生成保留真实间隙的装配体,比CoACD、V-HACD与SDF碰撞更快更准。训练用PPO、稀疏奖励加接触监督辅助。仿真内各任务近满分;线性探针显示隐状态编码接触模式,行为是反应式搜索,行程中位数37mm,优于95mm螺旋基线;对未见形状与尺寸,盲策略泛化远胜匹配的视觉策略。插销策略零样本迁移至Flexiv实机,作者报告237次试验成功率73%,含分布外零件。局限:需初始接触、行为局部。
为什么重要 为亚毫米级精密装配提供去掉视觉与力觉传感器的路线,并开源解决仿真间隙失真的几何生成器,直接影响做精密操作 sim-to-real 的团队。适合 做机器人操作 sim-to-real、精密装配与仿真资产生成的工程师
每台机器人其实已经自带高分辨率的接触传感器:它自己的关节。足式机器人和人形机器人利用这些传感器在无视觉的情况下行走、奔跑并跟踪全身运动,但在这些场景中,接触是大面积且强有力的。关节感知对于精确的、富接触的装配是否也足够?在这类装配中,机器人必须找到毫米级的开口、啮合齿轮齿,或通过轻微接触挂住螺纹。
我们通过训练盲装配策略来研究这一问题,这些策略仅观测关节位置、速度以及自身动作的短历史,而不使用视觉、力、力矩或触觉感知。策略对夹具和零件两者的位姿均未知,且抓取被大幅随机化。因此,策略必须通过接触来装配零件,而这些接触仅通过其自身的本体感知来感知。这类策略完全在仿真中通过强化学习进行训练,训练涵盖随机化的零件、抓取和接触,从而学会插销插入、齿轮啮合和螺母拧入。
插销插入策略零样本迁移到现实世界,在**73%**的试验中成功插入不同形状和尺寸的插销。在仿真中与相匹配的视觉策略进行的受控比较表明,盲策略对未见过的零件形状和尺寸的泛化能力远优于视觉策略,尽管它们可能更慢。
训练此类策略需要数千种不同的装配体,每种装配体在仿真中都保留其间隙不变,因此我们还发布了一个开源生成器,它从精确的凸件出发,以程序化方式为MuJoCo构建这些装配体;该生成器比凸分解或MuJoCo的有符号距离碰撞更准确、更快速。视频和交互式仿真见 https://younghyopark.me/blind-proprioceptive-assembly/。
Every robot already carries high-resolution contact sensors: its own joints.
Legged robots and humanoids exploit them to walk, run, and track whole-body motions without vision, but there the contacts are large and forceful.
Is joint sensing also enough for precise, contact-rich assembly, where the robot must find a millimeter-scale opening, mesh gear teeth, or catch a thread through light contact?
We study this question by training blind assembly policies that observe only a short history of joint positions, velocities, and their own actions, without visual, force, torque, or tactile sensing.
The poses of both the fixture and the part are unknown to the policy, and the grasp is randomized substantially.
The policy must therefore assemble the parts through contact, sensed exclusively through its own proprioception.
Trained with reinforcement learning entirely in simulation over randomized parts, grasps, and contacts, such policies learn peg insertion, gear meshing, and nut threading.
The peg insertion policy transfers zero-shot to the real world and inserts pegs of different shapes and sizes in 73% of trials.
Controlled comparisons with matched visual policies in simulation show that blind policies generalize far better to unseen part shapes and sizes, though they can be slower.
Training such policies needs thousands of different assemblies, each simulated with its clearance intact, so we also release an open-source generator that builds them procedurally from exact convex pieces for MuJoCo; it is more accurate and faster than convex decomposition or MuJoCo's signed-distance collision.
Videos and interactive simulations are at https://younghyopark.me/blind-proprioceptive-assembly/.



| 对比项 | 之前 / 基线 | 现在 / 本方案 | |
|---|---|---|---|
| CPU 每步速度 | MuJoCo mesh SDF | mjfit 快一个数量级16 mm 孔、间隙低至 20 µm,精度相同或更好 | |
| 孔内几何误差 | CoACD 与 V-HACD 孔内多料 | mjfit 仅多出间隙基线会填满 M10 螺母的 0.1 mm 螺纹间隙 | |
| 未见零件泛化 | 匹配视觉策略(仿真) | 盲策略(仿真)盲策略退化明显更小但更慢,原文未给具体数字 |
EVIDENCE / METHODS
要点
关节编码器本身就是高分辨率接触传感器,但以往只在腿足与人形的大接触力场景被验证。
原版排版与图表 · 手机无法内嵌时可在浏览器打开。PDF 插件内选文不能传给网页助手。