GELLO 通过构建目标机械臂的缩小版运动等效结构,以不到 $300 的成本提供直觉式遥操作体验。相比 VR 控制器和 SpaceMouse,GELLO 在五项双臂操作任务中平均成功率达到 0.92,显著超越其他低成本方案,并已为 Franka、UR5、xArm 三款机器人平台开源了全部硬件设计与代码。By building a scaled kinematically equivalent structure of the target manipulator, GELLO delivers an intuitive teleoperation experience for under $300. Compared with VR controllers and the SpaceMouse, GELLO reaches an average success rate of 0.92 across five bimanual manipulation tasks, clearly outperforming other low-cost options, and it open-sources all hardware designs and code for three robot platforms: Franka, UR5 and xArm.
机器人模仿学习的性能随数据集规模提升而提升,但高质量演示数据的采集仍是主要瓶颈。传统双边遥操作设备(如力反馈外骨骼)成本高昂;而 VR 控制器、SpaceMouse 等低成本替代方案将机器人运动学抽象化,使操作者难以感知奇异点和碰撞风险,操作效率低下。The performance of robot imitation learning improves as dataset scale grows, yet collecting high-quality demonstration data remains the main bottleneck. Conventional bilateral teleoperation devices (such as force-feedback exoskeletons) are expensive, while low-cost alternatives such as VR controllers and the SpaceMouse abstract away the robot's kinematics, making it hard for the operator to perceive singularities and collision risks and leaving teleoperation inefficient.
"Systems that abstract away kinematic constraints prevent operators from managing singularities and collisions effectively."
GELLO 的核心思路是构建目标机器人臂的缩小版运动等效结构(scaled kinematically equivalent structure):操作者直接操纵各关节,无需计算逆运动学,同时通过关节阻力天然感知奇异点。配合弹簧/橡皮筋关节正则化和 DYNAMIXEL 高精度编码器,GELLO 以极低成本实现直觉式操作。The core idea of GELLO is to build a scaled kinematically equivalent structure of the target robot arm: the operator moves each joint directly, without computing inverse kinematics, and senses singularities naturally through joint resistance. Together with spring/rubber-band joint regularization and the high-precision DYNAMIXEL encoders, GELLO achieves intuitive teleoperation at extremely low cost.
GELLO 采用 DYNAMIXEL XL330 系列舵机。该舵机配备 12-bit 高精度编码器,关节测量精度达 0.088 mechanical degree 以内。选用 XL-330-288T 型号(最大传动比),提供较大关节阻力,作为天然阻尼,帮助操作者感知力矩和奇异点。舵机自带编码器和通信协议,构成"off-the-shelf, self-contained solution"。GELLO uses the DYNAMIXEL XL330 servo series. These servos carry a 12-bit high-precision encoder, giving joint measurement accuracy within 0.088 mechanical degree. The XL-330-288T model (the largest gear ratio) is chosen for its higher joint resistance, which acts as natural damping and helps the operator feel torques and singularities. The servos come with their own encoders and communication protocol, forming an "off-the-shelf, self-contained solution".
GELLO 将目标机械臂按比例因子 α = 0.5 缩小,保留完全相同的运动学结构。操作者直接控制各关节角度,无需求解逆运动学(IK),并可通过关节阻力感受奇异点临近。小尺寸设计提升便携性,同时降低操作者对环境碰撞的视觉遮挡。GELLO scales the target manipulator down by a factor of α = 0.5 while keeping an identical kinematic structure. The operator commands each joint angle directly, without solving inverse kinematics (IK), and feels an approaching singularity through joint resistance. The small size improves portability and reduces the visual occlusion of environment collisions for the operator.
重力会使手臂自然下垂至不理想构型。GELLO 使用弹簧或橡皮筋等简单机械元件进行"关节正则化",产生被动力反馈:
• 无正则化:维持关节姿态需约 1.9 N 的外力。
• 有正则化:所需力随高度/关节角度变化,自然引导操作者远离奇异构型。Gravity makes the arm sag into undesirable configurations. GELLO uses simple mechanical elements such as springs or rubber bands for "joint regularization", producing passive force feedback:
• Without regularization: holding a joint pose needs about 1.9 N of external force.
• With regularization: the required force varies with height/joint angle, naturally guiding the operator away from singular configurations.
软件栈基于 Python,利用 DYNAMIXEL SDK 读取各关节编码器值,通过 ZMQ 消息传递将关节角度流式发送给机器人控制器,实现直接关节空间控制,无需 IK 求解。设计高度模块化,支持快速扩展至新机器人平台。The software stack is built on Python: the DYNAMIXEL SDK reads the encoder value of each joint, and joint angles are streamed to the robot controller over ZMQ messaging, giving direct joint-space control without IK solving. The design is highly modular and extends quickly to new robot platforms.
用户研究共招募 12 名无专业遥操作训练经历的大学志愿者,使用双臂 UR5 系统对 GELLO、VR(Meta Quest 2)、3D Mice(SpaceMouse)三种设备进行对比。每位参与者先进行 6 分钟通用介绍,再对每种设备进行 5 分钟练习,然后执行 5 项任务,设备顺序随机化(6 种排列各重复 2 次)。The user study recruited 12 university volunteers without professional teleoperation training and compared three devices — GELLO, VR (Meta Quest 2) and 3D Mice (SpaceMouse) — on a bimanual UR5 system. Each participant first received a 6-minute general introduction, then practiced 5 minutes with each device and performed 5 tasks, with the device order randomized (each of the 6 permutations repeated 2 times).
| 设备Device | Hat | Mask | Banana | Towel | USB | 平均Average |
|---|---|---|---|---|---|---|
| GELLO | 0.92 | 0.92 | 1.0 | 0.92 | 0.83 | 0.92 |
| VR (Meta Quest 2) | 0.92 | 0.83 | 0.75 | 0.58 | 0.50 | 0.72 |
| 3D Mice (SpaceMouse) | 0.75 | 0.58 | 0.67 | 0.58 | 0.58 | 0.63 |
| 失败原因Failure cause | GELLO | 3D Mice | VR |
|---|---|---|---|
| 超时 (Timeout)Timeout | 1 | 9 | 5 |
| 自碰撞 (Self Collision)Self Collision | 1 | 5 | 5 |
| 环境碰撞 (Env Collision)Env Collision | 3 | 6 | 6 |
| 其他 (Other)Other | 2 | 1 | — |
GELLO 超时次数仅为 1 次(SpaceMouse 为 9 次),说明运动等效设计显著降低了操作难度。论文指出:"self collisions were a common problem for spacemouse and VR controllers due to teleoperator paying attention only to end effector",而 GELLO 操作者能感知整臂构型,有效规避自碰撞。GELLO timed out only 1 time (against 9 times for the SpaceMouse), showing that the kinematically equivalent design substantially lowers the difficulty of teleoperation. The paper notes: "self collisions were a common problem for spacemouse and VR controllers due to teleoperator paying attention only to end effector", whereas GELLO operators perceive the whole-arm configuration and avoid self-collisions effectively.
GELLO 成功完成了多类复杂任务:接触丰富型任务(插 USB、折叠毛巾)、长时程任务(倒水至水瓶,需承担较大负载)、双臂协作任务,以及 7-DOF 臂(Franka Panda、xArm)的零空间管理操作,验证了框架的通用性。GELLO successfully completed many kinds of complex tasks: contact-rich tasks (plugging in USB, folding a towel), long-horizon tasks (pouring water into a bottle, which carries a heavier load), bimanual coordination tasks, and null-space management on 7-DOF arms (Franka Panda, xArm), validating the generality of the framework.
| 设备Device | 成本Cost |
|---|---|
| 3D Mouse (SpaceMouse) | $150 |
| GELLO(本文)GELLO (ours) | $300 |
| VR (Meta Quest 2) | $300 |
| Robot-to-robot(UR5)Robot-to-robot (UR5) | $30,000 |
| Haptic Device (Omega7) | $40,000 |
由于 DYNAMIXEL XL330 舵机输出力矩有限,GELLO 不具备力反馈功能。论文原文指出:"GELLO lacks force feedback due to limited output torque of motors, compromising contact-rich task performance. This sacrifice prioritized affordability and accessibility."
作者表示希望"将来作为可选功能加入力反馈,以支持更高级的使用场景"。Because the output torque of the DYNAMIXEL XL330 servos is limited, GELLO has no force feedback. The paper states: "GELLO lacks force feedback due to limited output torque of motors, compromising contact-rich task performance. This sacrifice prioritized affordability and accessibility."
The authors say they hope to "add force feedback as an optional feature in the future, to support more advanced use cases".
参与用户均为缺乏专业遥操作训练经验的志愿者,且每种设备的练习时间仅为 5 分钟。论文坦承:"User study involved inexperienced users with limited practice time. Extended training could significantly improve proficiency with alternative devices."
换言之,VR 控制器和 SpaceMouse 在更长时间训练后的性能差距可能缩小。The participants were all volunteers lacking professional teleoperation training, and the practice time per device was only 5 minutes. The paper concedes: "User study involved inexperienced users with limited practice time. Extended training could significantly improve proficiency with alternative devices."
In other words, the performance gap of VR controllers and the SpaceMouse may narrow after longer training.
(作者隐含,inferred from design)每套 GELLO 均针对特定机器人臂运动学定制 3D 打印件,扩展至新平台需重新设计并打印结构件。尽管开源了三款平台(Franka、UR5、xArm)的设计,但快速适配任意新型机器人仍需一定工程工作量。(Implied by the authors, inferred from design) Every GELLO uses 3D-printed parts customized to the kinematics of one specific robot arm, so extending to a new platform requires redesigning and reprinting the structural parts. Although the designs for three platforms (Franka, UR5, xArm) are open-sourced, quickly adapting to an arbitrary new robot still takes some engineering effort.