arxiv.org·2026/10/20
针对自由站立铰接物体的足式操作需同时稳定姿态与内部构型,作者在 ANYmal-D 四足机器人上仅用双脚自主求解魔方。机载RGB-D感知以SAM 3分割、RANSAC/ICP拟合并以IoU与中心色门控过滤错误,绕行翻转后融合多视角恢复魔方度量位姿和完整颜色面片状态;Kociemba求解序列经规划编译为翻转、旋转和重定位技能。PPO在Isaac Lab训练教师策略,蒸馏为仅输入前置深度与本体感觉的LSTM学生策略,旋转时一脚压底层、另一脚推上两层。作者报告随机化模拟中技能成功率最低 97.4%,硬件翻转全部成功、旋转多数成功。系统完成 3次硬件求解,每次约30步、历时8–9分钟;消融显示无深度、无时间记忆或分层足端控制会明显降低旋转精度与低摩擦地形可靠性。
为什么重要 它给出了无臂四足操控自由站立铰接物体的完整闭环:板载感知、规划与学习技能都能在真机上跑通,对具身操作与部署的参考价值很直接。适合 做具身操作、腿足机器人真机部署与感知闭环的工程师
用足部操纵一个独立支撑的铰接物体需要在保持平衡的同时控制其位姿和内部构型。我们通过让一台四足机器人仅用脚自主求解一个巨型 Rubik's Cube 来展示这一能力。该任务要求反复进行精确交互,因为非预期的层转动可能使后续操作失效。我们开发了一条机载 RGB-D 感知流水线,从通过移动和翻转获得的局部视图中估计魔方的度量位姿及其完整颜色状态。
一个规划器将计算出的求解步骤转换为机器人可执行的技能序列。学习到的全身技能在保持其层构型的同时重新定向魔方,并用一只脚固定魔方、另一只脚推动来转动其层。我们使用带特权观测的强化学习训练这些技能,并将其蒸馏为将机载深度和本体感觉映射到关节目标的策略。部署后的策略能容忍相对机器人-魔方放置位置的变化,并从外部扰动中恢复。该系统完成了三次自主硬件求解,每次约30步,历时8-9分钟。
这些结果表明,将机载感知与协调的足式操作相结合,使四足机器人能够完成长时间多步物理任务。更多材料可在 https://leggedrobotics.github.io/rubik-skills/ 找到。
Pedipulating a freestanding articulated object requires controlling its pose and internal configuration while maintaining balance.
We demonstrate this capability by autonomously solving a giant Rubik's Cube with a quadruped using only its feet.
The task demands repeated precise interactions, since unintended layer motion can invalidate subsequent operations.
We develop an onboard RGB-D perception pipeline that estimates the cube's metric pose and its full color state from partial views acquired through locomotion and flipping.
A planner converts the computed solve into robot-executable skill sequences.
Learned whole-body skills reorient the cube while preserving its layer configuration and turn its layers with one foot pinning the cube as the other pushes.
We train these skills using reinforcement learning with privileged observations and distill them into policies that map onboard depth and proprioception to joint targets.
The deployed policies tolerate variations in relative robot-cube placement and recover from external disturbances.
The system completes three autonomous hardware solves, each about 30 steps over 8-9 minutes.
These results show that combining onboard perception with coordinated pedipulation enables a quadruped to complete extended multi-step physical tasks.
Additional material can be found at: https://leggedrobotics.github.io/rubik-skills/



EVIDENCE / METHODS
要点
自由站立的铰接物体要求机器人在维持自身平衡的同时,控制物体的位姿与内部构型。
原版排版与图表 · 手机无法内嵌时可在浏览器打开。PDF 插件内选文不能传给网页助手。