现有 VLA 模型在推理泛化与高精度动作执行之间存在根本性矛盾。本文提出两个互补贡献: ERIQ(6,052 条具身推理问答,覆盖四个推理维度)用于系统量化该瓶颈, FACT(基于 flow matching 的动作分词器)将连续动作离散化同时保留高保真轨迹重建能力。 整合后的 GenieReasoner 在真实机器人任务中超越连续与离散动作基线。Existing VLA models face a fundamental tension between reasoning generalization and high-precision action execution. This paper makes two complementary contributions: ERIQ (6,052 embodied reasoning question-answer pairs spanning four reasoning dimensions), which systematically quantifies this bottleneck, and FACT (a flow-matching-based action tokenizer), which discretizes continuous actions while preserving high-fidelity trajectory reconstruction. The integrated GenieReasoner outperforms both continuous and discrete action baselines on real-robot tasks.
通用机器人需要在开放世界环境中同时做到广泛泛化与高精度动作执行——这一组合对现有 Vision-Language-Action(VLA)模型而言仍是重大挑战。General-purpose robots must deliver broad generalization and high-precision action execution at the same time in open-world environments — a combination that remains a major challenge for existing Vision-Language-Action (VLA) models.
"models optimized for strong reasoning capabilities tend to exhibit reduced action precision, while those achieving high-fidelity execution often demonstrate limited generalization."
具体而言,现有方案存在三层缺陷:Concretely, existing approaches suffer from three levels of deficiency:
为定量解耦这一瓶颈,作者构建了 ERIQ(Embodied Reasoning Intelligence Quotient)—— 一个包含 6,052 条具身问答对的大规模基准,跨四个推理维度评测 VLM, 并证明具身推理能力与端到端 VLA 泛化性能之间存在显著正相关。To disentangle this bottleneck quantitatively, the authors build ERIQ (Embodied Reasoning Intelligence Quotient) — a large-scale benchmark of 6,052 embodied question-answer pairs that evaluates VLMs across four reasoning dimensions, and show a significant positive correlation between embodied reasoning ability and end-to-end VLA generalization performance.
本文提出三个互补模块:ERIQ(评估框架)、FACT(动作分词器) 与 GenieReasoner(统一模型),共同构成从诊断到执行的完整框架。The paper proposes three complementary modules — ERIQ (evaluation framework), FACT (action tokenizer) and GenieReasoner (unified model) — which together form a complete framework from diagnosis to execution.
ERIQ 包含 6,052 条标准化多选问答对,覆盖四个具身推理维度, 共 15 个细粒度子任务:ERIQ contains 6,052 standardized multiple-choice question-answer pairs covering four embodied reasoning dimensions and 15 fine-grained subtasks in total:
通过将推理与运动执行解耦,ERIQ 能够系统性评测 VLM 的具身推理短板, 并揭示推理能力与端到端 VLA 泛化之间的强正相关关系。By decoupling reasoning from motion execution, ERIQ can systematically evaluate the embodied reasoning weaknesses of VLMs and reveal the strong positive correlation between reasoning ability and end-to-end VLA generalization.
FACT(Flow-matching-based Action tokenizer for Control Tasks)结合 VQ-VAE 离散化与 flow matching 解码, 实现连续动作的无损压缩与高保真还原:FACT (Flow-matching-based Action tokenizer for Control Tasks) combines VQ-VAE discretization with flow-matching decoding, achieving lossless compression and high-fidelity restoration of continuous actions:
e = ℰ_θ(a_{0:H}, e_{ini}),在时间维度(L≤H)和空间维度(D≤S)进行压缩。
比特量化器通过 c = sign(e) 将连续嵌入转换为二值离散码。Encoder: zero-initialized queries map an action chunk to a latent representation e = ℰ_θ(a_{0:H}, e_{ini}), compressing along both the temporal dimension (L≤H) and the spatial dimension (D≤S). A bit quantizer turns the continuous embedding into binary discrete codes via c = sign(e).
a^(t) = (1−t)z + ta, t ∈ [0,1],通过 ODE 积分重建平滑轨迹。Decoder (Rectified Flow): learns the velocity field from Gaussian noise to the action distribution. The linear interpolation is defined as a^(t) = (1−t)z + ta, t ∈ [0,1], and smooth trajectories are reconstructed through ODE integration.
MSE of (a−z) − 𝒟_θ(a^(t), c, t)。Training objective: a triple loss is optimized jointly — an entropy loss (maximizing codebook utilization), a commitment loss (keeping continuous embeddings close to their quantized values) and the flow-matching objective MSE of (a−z) − 𝒟_θ(a^(t), c, t).
GenieReasoner 将 VLM 主干(3B 参数规模)与 FACT 分词器统一训练。 训练阶段,VLM 在多模态数据上同时优化推理目标与离散动作预测目标; 推理阶段,模型自回归地预测离散码序列,FACT 解码器实时还原为连续控制信号, 避免了连续头与推理目标之间的优化冲突。GenieReasoner trains the VLM backbone (3B parameter scale) and the FACT tokenizer in a unified manner. During training, the VLM optimizes the reasoning objective and the discrete action-prediction objective simultaneously on multimodal data; at inference, the model autoregressively predicts a sequence of discrete codes that the FACT decoder restores to continuous control signals in real time, avoiding the optimization conflict between a continuous head and the reasoning objective.
训练数据来源涵盖:Training data sources include:
实验分三部分:ERIQ 基准评测、FACT 轨迹重建对比、以及真实机器人任务验证。 基线包括连续动作模型 π₀、π₀.₅、GR00T 以及离散动作模型 π₀-FAST。The experiments have three parts: ERIQ benchmark evaluation, FACT trajectory reconstruction comparison, and real-robot task validation. Baselines include the continuous-action models π₀, π₀.₅ and GR00T as well as the discrete-action model π₀-FAST.
GenieReasoner-3B 在 ERIQ 上取得 82.72% 平均准确率, 远超 Qwen2.5-VL-3B 基线的 58.64%,提升约 41%。 各维度详细结果如下:GenieReasoner-3B attains 82.72% average accuracy on ERIQ, far ahead of the 58.64% of the Qwen2.5-VL-3B baseline — an improvement of about 41%. Detailed per-dimension results are listed below:
| ERIQ 子任务ERIQ subtask | 维度Dimension | Qwen2.5-VL-3B(基线)Qwen2.5-VL-3B (baseline) | GenieReasoner-3B |
|---|---|---|---|
| Scene Understanding | 空间感知Spatial perception | — | 84.18% |
| Dualview | 空间感知Spatial perception | — | 68.54% |
| Task Grounding | 空间感知Spatial perception | — | 93.21% |
| Relative Position | 空间感知Spatial perception | — | 77.51% |
| Action Understanding | 规划与监控Planning & monitoring | — | 96.67% |
| Success Detection | 规划与监控Planning & monitoring | — | 85.25% |
| Subtask Planning | 规划与监控Planning & monitoring | — | 90.50% |
| Fine-grained Planning | 规划与监控Planning & monitoring | — | 55.36% |
| Trajectory | 规划与监控Planning & monitoring | — | 73.86% |
| Progress | 规划与监控Planning & monitoring | — | 51.60% |
| Mistake Existence | 错误检测Error detection | — | 75.45% |
| Error Classification | 错误检测Error detection | — | 93.10% |
| Recovery Strategy | 错误检测Error detection | — | 85.71% |
| Intention Comprehension | 意图理解Intent understanding | — | 96.44% |
| Human Interaction | 意图理解Intent understanding | — | 83.26% |
| ERIQ 总体平均ERIQ overall average | — | 58.64% | 82.72% |
在真实机器人评测中,GenieReasoner 在以下五个复杂度设置下的语言跟随(language following)指标 与完整任务成功率(full task success rate,含抓取与物体操作)两项指标上均优于所有基线(π₀、π₀.₅、GR00T、π₀-FAST), 并在综合加权性能上取得最高分。In real-robot evaluation, GenieReasoner outperforms all baselines (π₀, π₀.₅, GR00T, π₀-FAST) on both the language-following metric and the full task success rate (including grasping and object manipulation) under the following five complexity settings, and attains the highest overall weighted performance.
作者通过消融实验验证了两个核心设计选择:Ablation studies verify two core design choices:
作者明确指出,未来工作将探索 "deeper synergies between Chain-of-Thought reasoning and action generation"。 当前 GenieReasoner 将推理与动作在同一序列空间中预测,但二者的交互机制(例如推理步骤如何动态调整动作码) 尚未深入研究。The authors state explicitly that future work will explore "deeper synergies between Chain-of-Thought reasoning and action generation". GenieReasoner currently predicts reasoning and actions in the same sequence space, but the interaction mechanism between the two (for example, how reasoning steps dynamically adjust action codes) has not been studied in depth.
作者计划 "further enhance the system's generalization and instruction-following robustness across diverse real-world environments",隐含当前模型在分布外场景(极端光照、新型物体、 非结构化指令)下仍存在鲁棒性不足的问题。The authors plan to "further enhance the system's generalization and instruction-following robustness across diverse real-world environments", implying that the current model is still insufficiently robust in out-of-distribution scenes (extreme lighting, novel objects, unstructured instructions).
GenieReasoner 的训练数据包含 AgiBot World 平台的专有轨迹数据、定位标注等, 这些数据未公开,限制了社区复现与公平对比。ERIQ 基准的构建过程同样依赖内部数据源, 外部研究者难以直接扩展。GenieReasoner's training data includes proprietary trajectory data, grounding annotations and more from the AgiBot World platform; these data are not public, which limits community reproduction and fair comparison. The construction of the ERIQ benchmark likewise relies on internal data sources, making it hard for external researchers to extend it directly.
图7 展示了不同码长下的重建 MSE 对比,但论文未提供端到端任务成功率随码长变化的系统分析, 实践中最优码长选择仍依赖经验调参,缺乏理论指导。Figure 7 compares reconstruction MSE across code lengths, but the paper offers no systematic analysis of how end-to-end task success rate varies with code length; in practice the optimal code length still relies on empirical tuning and lacks theoretical guidance.