arXiv Weekly Digest — Week 17, 2026

Fetched: 2026-04-20 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 141 (from 454 candidates; 1165 total fetched)

Note: cs.CV failed all retries (429 rate limit). Papers scored ≥ 6 retained; score 9–10 = core, 7–8 = related, 6 = peripheral.


Core Papers (Score 9–10)

I2RLC: Refinement of Accelerated Demonstrations via Incremental Iterative Reference Learning Control for Fast Contact-Rich Imitation Learning

Authors: Koki Yamane, Cristian C. Beltran-Hernandez, Steven Oh, et al. | Submitted: 2026-04-18 | arXiv: 2604.16850 Categories: cs.RO, cs.AI, eess.SY

Research Background: Providing high-speed demonstrations for imitation learning is challenging — humans cannot demonstrate at high speed, and naively accelerating recordings distorts contact dynamics and creates large tracking errors. 研究背景: 為模仿學習提供高速示範具有挑戰性——人類無法以高速演示,而直接加速錄製會扭曲接觸動態並造成大幅追蹤誤差。

Technical Approach: I2RLC repurposes Iterative Reference Learning Control to autonomously refine time-accelerated demonstrations. Unlike plain IRLC, it gradually increases speed while updating the reference trajectory (incremental scheduling), yielding high-fidelity trajectories up to 10× faster than the original. 技術方法: I2RLC 重新利用迭代參考學習控制來自主精煉時間加速的示範。與純 IRLC 不同,它在更新參考軌跡的同時逐漸提升速度(增量排程),可產生比原始快達 10 倍的高保真軌跡。

Key Takeaway: Policies trained on I2RLC-refined trajectories achieve 100% peg-in-hole success at seen and unseen positions, with lower contact forces than IRLC-trained policies. 核心發現: 以 I2RLC 精煉軌跡訓練的策略在已見和未見位置達到 100% 插銷成功率,且接觸力低於 IRLC 訓練的策略。


ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Control

Authors: Lingling Chen, Zongyao Lyu, William J. Beksi | Submitted: 2026-04-17 | arXiv: 2604.16677 Categories: cs.RO, cs.AI

Research Background: VLA models produce no calibrated confidence for their action predictions, limiting their reliability in real-world settings where uncertainty and failure must be anticipated. 研究背景: VLA 模型對動作預測不提供校正的信心度,限制了其在需要預測不確定性和失敗的真實場景中的可靠性。

Technical Approach: ReconVLA applies conformal prediction to VLA action token outputs, yielding calibrated uncertainty estimates correlated with execution quality. A state-space conformal layer additionally detects robot state outliers before failures occur. 技術方法: ReconVLA 對 VLA 動作 token 輸出應用符合性預測,產生與執行品質相關的校正不確定性估計。額外的狀態空間符合層可在失敗發生前偵測機器人狀態異常值。

Key Takeaway: Conformalized VLA predictions consistently improve failure anticipation and reduce catastrophic errors without retraining the underlying VLA model. 核心發現: 符合化 VLA 預測在不重新訓練底層 VLA 模型的情況下持續改善失敗預期並減少災難性錯誤。


π₀.₇: A Steerable Generalist Robotic Foundation Model with Emergent Capabilities

Authors: Physical Intelligence | Submitted: 2026-04-21 | arXiv: 2604.15483 Categories: cs.LG, cs.RO

Research Background: Generalist robot policies must follow diverse language instructions in unseen scenarios without per-task fine-tuning. Prior foundation models degrade significantly on out-of-distribution scenarios. 研究背景: 通才型機器人策略必須在未見場景中遵循多樣化的語言指令,而無需針對每項任務進行微調。先前的基礎模型在分佈外場景中性能明顯下降。

Technical Approach: π₀.₇ is a steerable generalist model that enables strong out-of-the-box performance across a wide range of scenarios. It supports following diverse language instructions in unseen environments and shows emergent capabilities not present in previous versions. 技術方法: π₀.₇ 是一個可引導的通才模型,在廣泛場景中提供強大的開箱即用性能。它支援在未見環境中遵循多樣化語言指令,並展現先前版本中不存在的湧現能力。

Key Takeaway: π₀.₇ advances the state of steerable generalist robot foundation models, with emergent cross-task generalization and strong instruction following. 核心發現: π₀.₇ 推進了可引導通才機器人基礎模型的前沿,具備湧現的跨任務泛化能力和強大的指令遵循能力。


World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems

Authors: Junpeng Yue, Xu Zhan, Yunxiang Zhang, et al. | Submitted: 2026-04-20 | arXiv: 2604.14732 Categories: cs.RO, cs.LG

Research Background: Most VLA systems rely on direct action prediction without explicit planning, limiting performance on long-horizon tasks that require reasoning about future states. 研究背景: 大多數 VLA 系統依賴直接動作預測而無明確規劃,限制了在需要推理未來狀態的長時程任務中的表現。

Technical Approach: The World-Value-Action (WVA) Model integrates world model prediction with value estimation into VLA decision-making, enabling implicit planning without explicit search. A joint world-value head predicts future states and their values, guiding action selection toward higher-reward trajectories. 技術方法: World-Value-Action (WVA) 模型將世界模型預測與價值估計整合到 VLA 決策制定中,實現無需顯式搜尋的隱式規劃。聯合世界-價值頭預測未來狀態及其價值,引導動作選擇朝向高回報軌跡。

Key Takeaway: WVA achieves superior performance on long-horizon manipulation tasks by implicitly planning through value-guided world model rollouts. 核心發現: WVA 通過基於價值引導的世界模型展開進行隱式規劃,在長時程操作任務中達到優越性能。


HiVLA: A Visual-Grounded-Centric Hierarchical Embodied Manipulation System

Authors: Jianye Yang, Gaotian Wang, Yen-Jen Wang, et al. | Submitted: 2026-04-19 | arXiv: 2604.14125 Categories: cs.CV, cs.AI, cs.RO

Research Background: Fine-tuning VLA models on narrow control data often compromises their broad reasoning capabilities, creating a tension between task-specific performance and general understanding. 研究背景: 在狹窄控制資料上微調 VLA 模型往往會損害其廣泛推理能力,在任務特定性能和一般理解之間造成張力。

Technical Approach: HiVLA decomposes manipulation into visual grounding and low-level control through a hierarchical architecture. A high-level VLM performs visual grounding to identify precise interaction regions, while a low-level policy executes the action conditioned on grounded spatial information. 技術方法: HiVLA 通過層次化架構將操作分解為視覺定位和低階控制。高階 VLM 執行視覺定位以識別精確的互動區域,低階策略在定位空間信息的條件下執行動作。

Key Takeaway: The hierarchical visual-grounding approach significantly improves manipulation precision and maintains generalization capabilities compared to direct fine-tuning. 核心發現: 與直接微調相比,層次化視覺定位方法顯著提升操作精度並保持泛化能力。


Learning Whole-Body Humanoid Locomotion via Motion Generation and Motion Tracking

Authors: Zewei Zhang, Kehan Wen, Michael Xu, et al. | Submitted: 2026-04-19 | arXiv: 2604.17335 Categories: cs.RO

Research Background: Humanoid whole-body locomotion via RL often produces lower-body-dominated behaviors; imitation-based RL learns coordinated skills but cannot adapt motions online from perception for terrain-aware locomotion. 研究背景: 透過強化學習實現的人形機器人全身運動通常產生以下半身為主的行為;基於模仿的強化學習學習協調技能,但無法從感知在線適應動作以實現地形感知的運動。

Technical Approach: A diffusion model trained on retargeted human motions generates real-time terrain-aware reference motions. A whole-body reference tracker with RL closes the loop via fine-tuning with a frozen motion generator in a closed-loop setting, deployed on Unitree G1 with onboard perception. 技術方法: 在重定向人體動作上訓練的擴散模型生成實時地形感知參考動作。配備強化學習的全身參考追蹤器在閉環設置中通過凍結動作生成器的微調閉合循環,部署在具有板載感知的 Unitree G1 上。

Key Takeaway: Successfully traverses boxes, hurdles, stairs, and mixed terrain combinations on a Unitree G1 humanoid with online motion generation and adaptation. 核心發現: 在 Unitree G1 人形機器人上成功穿越箱子、跨欄、樓梯和混合地形組合,實現在線動作生成和自適應。


MM-Hand: A 21-DOF Multi-modal Modular Dexterous Robotic Hand with Remote Actuation

Authors: Zhuoheng Li, Qingquan Lin, Checheng Yu, et al. | Submitted: 2026-04-19 | arXiv: 2604.17245 Categories: cs.RO

Research Background: Conventional dexterous hands occupy valuable in-hand space, increase end-effector mass, and suffer from heat accumulation. Remote tendon-driven actuation relocates motors externally but challenges long-distance transmission. 研究背景: 傳統靈巧手占用寶貴的手內空間、增加末端執行器質量並受熱積聚問題困擾。遠端腱驅動驅動將電機外置,但面臨長距離傳輸的挑戰。

Technical Approach: MM-Hand achieves 21-DOF with remote tendon-driven actuation, integrating modular 3D-printed structures, quick tendon connectors, multi-modal sensing (joint angle, tactile, motor feedback, in-palm stereo vision), and closed-loop joint control. 技術方法: MM-Hand 通過遠端腱驅動實現 21 個自由度,整合模塊化 3D 打印結構、快速腱連接器、多模態感測(關節角度、觸覺、電機反饋、掌內立體視覺)和閉環關節控制。

Key Takeaway: Achieves 25N fingertip force under 1m remote sheath transmission, providing a lightweight, sensor-rich, open-source platform for dexterous manipulation research. 核心發現: 在 1 公尺遠端護套傳輸下達到 25N 指尖力,提供輕量化、感測豐富的開源平台用於靈巧操作研究。


COIN: Chain Of Interaction Benchmark — When Reasoning meets Embodied Interaction

Authors: Xianhao Wang, Xiaojian Ma, Haozhe Hu, et al. | Submitted: 2026-04-18 | arXiv: 2604.16886 Categories: cs.RO

Research Background: Generalist embodied agents need to perform interactive, causally-dependent reasoning in partial observability — existing benchmarks don’t systematically evaluate this essential capability. 研究背景: 通才型具身智能體需要在部分可觀察性下執行互動式、因果依賴的推理——現有基準未系統評估這一基本能力。

Technical Approach: COIN introduces 50 interactive daily-scenario tasks, COIN-Primitive (causally-dependent primitive tasks) and COIN-Composition (mid-term complexity). A low-cost AR teleoperation system collects 1000 demonstrations, with evaluation metrics for execution stability and generalization robustness. 技術方法: COIN 引入 50 個互動日常場景任務、COIN-Primitive(因果依賴原始任務)和 COIN-Composition(中等複雜度)。低成本 AR 遙控系統收集 1000 個示範,配有執行穩定性和泛化健壯性評估指標。

Key Takeaway: Reveals critical gaps in current models: significant mismatch between visual understanding and motor execution in interactive reasoning tasks. 核心發現: 揭示當前模型的關鍵差距:互動推理任務中視覺理解和動作執行之間存在顯著不匹配。


LongBench: Evaluating Robotic Manipulation Policies on Real-World Long-Horizon Tasks

Authors: Xueyao Chen, Jingkai Jia, Tong Yang, et al. | Submitted: 2026-04-18 | arXiv: 2604.16788 Categories: cs.RO

Research Background: Manipulation policies degrade over extended horizons, but existing benchmarks are simulation-based or report aggregate success, obscuring the sources of temporal difficulty. 研究背景: 操作策略在長時程中性能下降,但現有基準基於模擬或報告聚合成功率,掩蓋了時間困難的來源。

Technical Approach: LongBench provides 1000+ real-world episodes in two regimes: Context-Independent (fully observable) and Context-Dependent (ambiguity-driven). Tasks are organized into capability- and ambiguity-specific subsets enabling mechanism-aware evaluation. 技術方法: LongBench 提供超過 1000 個真實場景劇集,分為兩種模式:上下文獨立(完全可觀察)和上下文依賴(歧義驅動)。任務按能力和歧義特定子集組織,實現機制感知評估。

Key Takeaway: Fully observable performance correlates with execution robustness; contextual difficulty varies across tasks and is not consistently improved by memory-based methods. 核心發現: 完全可觀察性能與執行健壯性相關;上下文困難因任務而異,記憶型方法不能持續改善。


Rewind-IL: Online Failure Detection and State Respawning for Imitation Learning

Authors: Gehan Zheng, Sanjay Seenivasan, Matthew Johnson-Roberson, Weiming Zhi | Submitted: 2026-04-17 | arXiv: 2604.16683 Categories: cs.RO, cs.AI, cs.CV

Research Background: Once IL policies drift off the demonstration manifold, they continue producing locally plausible actions without recovery. Runtime monitors either require failure data or stop at detection without providing recovery. 研究背景: 一旦模仿學習策略偏離示範流形,它們繼續產生局部合理的動作而無法恢復。運行時監控器要麼需要失敗數據,要麼在偵測時停止而不提供恢復機制。

Technical Approach: Rewind-IL combines a zero-shot failure detector (TIDE — Temporal Inter-chunk Discrepancy Estimate) calibrated with conformal prediction, with a state-respawning mechanism that returns the robot to a semantically verified safe intermediate state identified offline by a VLM. 技術方法: Rewind-IL 結合零樣本失敗偵測器(TIDE——時間塊間差異估計,以符合性預測校正)和狀態重生機制,將機器人返回到由 VLM 離線識別的語義驗證安全中間狀態。

Key Takeaway: Policy-internal consistency coupled with semantically grounded respawning provides a practical route to improved reliability in imitation learning without retraining. 核心發現: 策略內部一致性與語義基礎重生相結合,提供了在不重新訓練的情況下提升模仿學習可靠性的實用途徑。


Long-Term Memory for VLA-based Agents in Open-World Task Execution

Authors: Chen Li, Chenglong Li, Hao Li, et al. | Submitted: 2026-04-21 | arXiv: 2604.15671 Categories: cs.RO

Research Background: VLA models are limited in complex tasks like chemical laboratory automation where long-term memory of prior steps and object states is essential for multi-step workflows. 研究背景: VLA 模型在化學實驗室自動化等複雜任務中受限,這些任務需要對先前步驟和物體狀態進行長期記憶以完成多步驟工作流程。

Technical Approach: A long-term episodic memory module is integrated with a VLA agent, storing and retrieving task-relevant memories (object states, completed steps) to enable coherent decision-making across extended open-world task horizons. 技術方法: 將長期情節記憶模塊整合到 VLA 智能體中,存儲和檢索任務相關記憶(物體狀態、已完成步驟),以在延伸的開放世界任務時程中實現連貫的決策制定。

Key Takeaway: Long-term memory substantially improves VLA task completion in laboratory automation scenarios requiring multi-step sequential reasoning. 核心發現: 長期記憶在需要多步驟順序推理的實驗室自動化場景中顯著提升 VLA 任務完成率。


One-Shot Cross-Geometry Skill Transfer through Part Decomposition

Authors: Danling Wu, Zewei Zhang, Kehan Wen, et al. | Submitted: 2026-04-21 | arXiv: 2604.15455 Categories: cs.RO

Research Background: Robots should generalize skills to objects with unfamiliar shapes from a single demonstration, but existing skill transfer approaches fail to adapt to novel geometries. 研究背景: 機器人應能從單一示範中將技能泛化到形狀陌生的物體,但現有技能遷移方法無法適應新穎幾何形狀。

Technical Approach: Given a demonstration on one geometry, part decomposition identifies functional parts, maps them to analogous parts on new geometries, and transfers the skill one-shot to objects with significantly different shapes. 技術方法: 給定一個幾何形狀上的示範,部件分解識別功能部件,將它們映射到新幾何形狀上的類似部件,並將技能一次性遷移到形狀顯著不同的物體上。

Key Takeaway: Part decomposition enables robust one-shot cross-geometry skill transfer, significantly outperforming baselines on objects with diverse shapes. 核心發現: 部件分解實現了穩健的一次性跨幾何形狀技能遷移,在形狀多樣的物體上顯著優於基線。


Vision-Based Safe Human-Robot Collaboration with Uncertainty Guarantees

Authors: Yuhao Wang, Xinchen Cao, Wuhao Wang, et al. | Submitted: 2026-04-21 | arXiv: 2604.15221 Categories: cs.RO, cs.CV

Research Background: Safe HRC requires reliable human motion prediction with formal safety guarantees, but existing methods lack calibrated uncertainty bounds for certifiable safety. 研究背景: 安全的人機協作需要具有正式安全保證的可靠人體動作預測,但現有方法缺乏可認證安全性的校正不確定性邊界。

Technical Approach: Combines vision-based human pose estimation with conformal prediction for motion forecasting, providing formal coverage guarantees. A safe planning module uses these uncertainty sets to guarantee collision-free robot motion. 技術方法: 結合基於視覺的人體姿態估計和運動預測的符合性預測,提供正式覆蓋保證。安全規劃模塊使用這些不確定性集合確保無碰撞機器人動作。

Key Takeaway: Provides certifiably safe HRC with conformal prediction uncertainty guarantees, enabling robots to work safely near humans without conservative over-approximations. 核心發現: 通過符合性預測不確定性保證提供可認證的安全人機協作,使機器人能在人類附近安全工作,而無需保守的過度近似。


A Hierarchical Spatiotemporal Action Tokenizer for In-Context Imitation Learning

Authors: Zetong Yang, Zekai Wang, Jiannan Chen, et al. | Submitted: 2026-04-21 | arXiv: 2604.15215 Categories: cs.RO

Research Background: In-context imitation learning requires compact yet expressive action representations that capture both spatial structure and temporal dynamics for few-shot skill adaptation. 研究背景: 上下文模仿學習需要緊湊但富有表現力的動作表示,同時捕捉空間結構和時間動態以實現少樣本技能自適應。

Technical Approach: A hierarchical spatiotemporal tokenizer applies two successive levels of vector quantization: spatial tokenization groups joint-level actions into body-part clusters, while temporal tokenization compresses sequences into discrete motion primitives, enabling efficient in-context learning. 技術方法: 層次化時空分詞器應用兩個連續層次的向量量化:空間分詞將關節級動作分組為身體部位群集,時間分詞將序列壓縮為離散運動原語,實現高效的上下文學習。

Key Takeaway: The hierarchical tokenizer significantly improves in-context imitation learning efficiency and adaptability across diverse manipulation tasks. 核心發現: 層次化分詞器顯著提升了在各種操作任務中的上下文模仿學習效率和適應性。


DEX-Mouse: A Low-cost Portable and Universal Interface with Force Feedback for Dexterous Hand Data Collection

Authors: Hao Guo, Zeyun Lu, Tengyue Li, et al. | Submitted: 2026-04-21 | arXiv: 2604.15013 Categories: cs.RO

Research Background: Scaling foundation models for dexterous manipulation requires large-scale, physically consistent demonstration data. Simulation and video methods suffer from sim-to-real gaps, while robot teleoperation interfaces are expensive and non-portable. 研究背景: 擴展靈巧操作基礎模型需要大規模、物理一致的示範資料。模擬和視頻方法存在仿真到現實的差距,而機器人遙控介面昂貴且不便攜。

Technical Approach: DEX-Mouse is a low-cost, portable teleoperation interface that provides force feedback to the human operator, enabling collection of physically realistic demonstration data. Universal design supports multiple dexterous hand embodiments. 技術方法: DEX-Mouse 是一種低成本、便攜式遙控介面,為人類操作員提供力回饋,實現物理上真實的示範資料收集。通用設計支援多種靈巧手具身形式。

Key Takeaway: Achieves force-feedback-enabled dexterous demonstration collection at low cost, enabling broader access to high-quality manipulation training data. 核心發現: 以低成本實現具有力回饋的靈巧示範收集,為高品質操作訓練資料提供更廣泛的獲取途徑。


UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Awareness

Authors: Hanxiao Huang, Hao Li, Zhenyu Yi, et al. | Submitted: 2026-04-19 | arXiv: 2604.14089 Categories: cs.RO, cs.AI

Research Background: The original UMI relies on wrist-mounted cameras limited to 2D visual data. 3D spatial awareness is essential for robust manipulation in cluttered environments with depth-dependent tasks. 研究背景: 原始 UMI 依賴腕載相機,僅限於 2D 視覺資料。3D 空間感知對於在雜亂環境中進行依賴深度任務的穩健操作至關重要。

Technical Approach: UMI-3D extends the Universal Manipulation Interface with multi-modal 3D sensing (RGB-D, stereo, or structured light) integrated into the wrist-mounted collection device. Policies trained on UMI-3D data show improved spatial generalization. 技術方法: UMI-3D 通過集成到腕載收集設備的多模態 3D 感測(RGB-D、立體或結構光)擴展了通用操作介面。在 UMI-3D 資料上訓練的策略顯示出更好的空間泛化。

Key Takeaway: Adding 3D spatial awareness to the UMI data collection pipeline substantially improves manipulation policy robustness on depth-sensitive tasks. 核心發現: 在 UMI 資料收集管道中添加 3D 空間感知顯著提升了深度敏感任務的操作策略健壯性。


Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection

Authors: Yuming Huang, Peiqi Duan, Lixian Li, et al. | Submitted: 2026-04-18 | arXiv: 2604.13942 Categories: cs.RO

Research Background: Most existing VLA policies rely on limited observation windows and end-to-end action generation, struggling with multi-step tasks requiring adaptive planning and reflection on failures. 研究背景: 大多數現有 VLA 策略依賴有限的觀察窗口和端到端動作生成,在需要自適應規劃和對失敗進行反思的多步驟任務中表現欠佳。

Technical Approach: Goal2Skill decomposes long-horizon tasks into skills using a goal-conditioned planner, with an explicit reflection mechanism that detects execution failures and re-plans. Skills are parameterized by goal-conditioned VLM reasoning. 技術方法: Goal2Skill 使用目標條件規劃器將長時程任務分解為技能,配備顯式反思機制偵測執行失敗並重新規劃。技能由目標條件 VLM 推理參數化。

Key Takeaway: Adaptive planning with reflection substantially outperforms end-to-end baselines on multi-step VLA manipulation benchmarks. 核心發現: 帶有反思的自適應規劃在多步驟 VLA 操作基準上顯著優於端到端基線。


Jump-Start Reinforcement Learning with Vision-Language-Action Regularization

Authors: Yan Zhang, Baoling Guo, Chen Qian, et al. | Submitted: 2026-04-18 | arXiv: 2604.13733 Categories: cs.LG, cs.AI, cs.RO

Research Background: RL enables closed-loop control for manipulation but struggles to scale to long-horizon tasks with sparse or imperfect rewards due to inefficient exploration. 研究背景: 強化學習實現閉環控制操作,但由於探索效率低下,難以擴展到具有稀疏或不完美回報的長時程任務。

Technical Approach: VLA pre-trained policies are used as jump-start initializations for RL, with a VLA regularization term that prevents the RL policy from diverging too far from the pretrained behavioral prior, enabling efficient fine-tuning with sparse rewards. 技術方法: VLA 預訓練策略用作強化學習的跳躍起點初始化,配合 VLA 正則化項防止強化學習策略偏離預訓練行為先驗過遠,實現稀疏回報下的高效微調。

Key Takeaway: VLA regularization in jump-start RL achieves 3-5× more sample-efficient learning on long-horizon manipulation tasks compared to vanilla RL or VLA fine-tuning. 核心發現: 跳躍起點強化學習中的 VLA 正則化在長時程操作任務中比普通強化學習或 VLA 微調達到 3-5 倍的樣本效率提升。


A Mechanistic Analysis of Sim-and-Real Co-Training in Generative Robot Policies

Authors: Zhao-Heng Yin, Pieter Abbeel | Submitted: 2026-04-18 | arXiv: 2604.13645 Categories: cs.RO, cs.AI, cs.LG

Research Background: Co-training with simulation or cross-embodiment data is widely used but poorly understood mechanistically — which types of surrogate data help, and why? 研究背景: 使用模擬或跨具身資料進行聯合訓練被廣泛使用,但機制上理解不足——哪些類型的代理資料有幫助,以及為什麼?

Technical Approach: Systematic mechanistic analysis of sim-and-real co-training in generative robot policies, examining how different surrogate data types affect the learned representations, policy behavior, and generalization, providing actionable insights for data mixing strategies. 技術方法: 對生成機器人策略中模擬與真實聯合訓練進行系統性機制分析,研究不同代理資料類型如何影響學習表示、策略行為和泛化,為資料混合策略提供可行洞見。

Key Takeaway: Co-training helps primarily through improving representation quality, not just data augmentation — simulation data must be semantically aligned to be beneficial. 核心發現: 聯合訓練主要通過提升表示品質而非僅僅通過資料增強提供幫助——模擬資料必須在語義上對齊才有益處。


Learning Versatile Humanoid Manipulation with Touch Dreaming

Authors: Ye Yuan, Jianan Li, Zhengyi Luo, et al. | Submitted: 2026-04-17 | arXiv: 2604.13015 Categories: cs.RO

Research Background: Real-world humanoid loco-manipulation requires whole-body stability, end-effector dexterity, and contact-aware interaction — simultaneously challenging for any single learning approach. 研究背景: 真實世界人形機器人的運動操作需要全身穩定性、末端執行器靈活性和接觸感知互動——對任何單一學習方法都極具挑戰性。

Technical Approach: Touch Dreaming integrates tactile imagination with model-based RL, allowing the humanoid to “dream” about contact forces during planning and improve dexterous manipulation through simulated tactile experiences before physical execution. 技術方法: Touch Dreaming 將觸覺想像與基於模型的強化學習整合,允許人形機器人在規劃過程中「夢想」接觸力,並通過物理執行前的模擬觸覺體驗改善靈巧操作。

Key Takeaway: Tactile imagination substantially improves contact-rich manipulation success rates on the Unitree H1 humanoid across diverse everyday tasks. 核心發現: 觸覺想像在 Unitree H1 人形機器人的多樣日常任務中顯著提升接觸豐富的操作成功率。


XRZero-G0: Pushing the Frontier of Dexterous Robotic Manipulation with Interfaces Beyond Morphological Constraints

Authors: Shu Chen, Xuchao Xu, Nuo Chen, et al. | Submitted: 2026-04-17 | arXiv: 2604.13001 Categories: cs.RO

Research Background: High-quality action-aligned demonstration data is a fundamental bottleneck for scaling dexterous manipulation foundation models. Robot-free human demonstrations avoid this but suffer from morphological mismatch. 研究背景: 高品質動作對齊示範資料是擴展靈巧操作基礎模型的基本瓶頸。免機器人的人類示範避免了這一問題,但存在形態不匹配的問題。

Technical Approach: XRZero-G0 introduces a teleoperation interface that transcends morphological constraints, enabling human operators to provide dexterous demonstrations that are directly applicable across different robot hand embodiments without costly retargeting. 技術方法: XRZero-G0 引入超越形態約束的遠端操作介面,使人類操作員能夠提供直接適用於不同機器人手具身形式的靈巧示範,無需昂貴的重定向。

Key Takeaway: Cross-morphology demonstration collection substantially reduces the cost and effort required to scale dexterous manipulation datasets. 核心發現: 跨形態示範收集大幅降低擴展靈巧操作資料集所需的成本和工作量。


HazardArena: Evaluating Semantic Safety in Vision-Language-Action Models

Authors: Zhuoxi Li, Junliang Chen, Runze Li, et al. | Submitted: 2026-04-16 | arXiv: 2604.12447 Categories: cs.RO

Research Background: VLA models inherit world knowledge from VLM backbones but existing evaluations focus only on task success, not semantic safety — models may execute dangerous actions that succeed at the task while causing harm. 研究背景: VLA 模型從 VLM 骨幹繼承世界知識,但現有評估僅關注任務成功而非語義安全——模型可能執行危險動作,在完成任務的同時造成傷害。

Technical Approach: HazardArena provides a benchmark with diverse manipulation tasks containing embedded safety hazards (sharp objects, fragile items, electrical risks). Evaluation covers both task success and semantic safety compliance across VLA models. 技術方法: HazardArena 提供包含嵌入安全危害(尖銳物品、易碎物品、電氣風險)的多樣操作任務基準。評估涵蓋各 VLA 模型的任務成功和語義安全合規性。

Key Takeaway: Current VLA models show significant semantic safety failures on hazardous tasks, even when achieving task success — safety-aware training is critical. 核心發現: 當前 VLA 模型在危險任務上顯示出顯著的語義安全失敗,即使在實現任務成功時——安全感知訓練至關重要。


M2HRI: An LLM-Driven Multimodal Multi-Agent Framework for Personalized Human-Robot Interaction

Authors: Yanzhen Wang, Xinyi Li, Liang Zhao, et al. | Submitted: 2026-04-16 | arXiv: 2604.11975 Categories: cs.RO

Research Background: Multi-robot systems in social environments treat robots as functionally identical, overlooking how individual robot personalities, modalities, and roles should complement each other for optimal HRI. 研究背景: 社會環境中的多機器人系統將機器人視為功能相同,忽視了個別機器人的個性、模態和角色應如何互補以實現最佳人機互動。

Technical Approach: M2HRI uses LLM-driven coordination where each robot has distinct multimodal capabilities and personality traits. An LLM orchestrator allocates user requests to the best-suited robot, maintaining personalized interaction history across the team. 技術方法: M2HRI 使用 LLM 驅動的協調,每個機器人具有獨特的多模態能力和個性特徵。LLM 協調器將使用者請求分配給最適合的機器人,在整個團隊中保持個性化互動歷史。

Key Takeaway: Personalized multi-agent HRI substantially improves user satisfaction and task completion compared to homogeneous multi-robot systems. 核心發現: 個性化多智能體人機互動相比同質化多機器人系統顯著提升使用者滿意度和任務完成率。


StarVLA-α: Reducing Complexity in Vision-Language-Action Systems

Authors: Yuanyi Liu, Ziyang Chen, Chuanrui Zhang, et al. | Submitted: 2026-04-16 | arXiv: 2604.11757 Categories: cs.RO, cs.AI, cs.CV

Research Background: The VLA landscape is highly fragmented and complex — existing systems differ in architecture, training data, evaluation protocols, making comparison and reuse difficult. 研究背景: VLA 領域高度碎片化且複雜——現有系統在架構、訓練資料、評估協議上各異,使得比較和重用困難。

Technical Approach: StarVLA-α proposes a simplified unified architecture that reduces the complexity inherent in current VLA systems while maintaining competitive performance. A modular design enables easier integration of new components and transfer across tasks. 技術方法: StarVLA-α 提出簡化統一架構,在保持競爭性能的同時降低當前 VLA 系統固有的複雜性。模塊化設計使新組件的集成和跨任務遷移更加容易。

Key Takeaway: Architectural simplification of VLA systems reduces implementation overhead while retaining performance, accelerating research reproducibility. 核心發現: VLA 系統的架構簡化在保留性能的同時降低了實現開銷,加速了研究可重現性。


LARY: A Latent Action Representation Yielding Benchmark for Generalizable VLA Models

Authors: Yuxuan Wang, Zijie Ye, Yifei Sun, et al. | Submitted: 2026-04-15 | arXiv: 2604.11689 Categories: cs.RO, cs.CV

Research Background: VLA models are limited by scarce labeled robot data, but massive unlabeled human action videos offer a scalable alternative — the challenge is learning meaningful latent action representations from these videos. 研究背景: VLA 模型受限於稀缺的標記機器人資料,但大量未標記的人類動作視頻提供了可擴展的替代方案——挑戰在於從這些視頻中學習有意義的潛在動作表示。

Technical Approach: LARY proposes a benchmark and method for learning latent action representations from large-scale human action videos without explicit action labels. The representation is then used to pre-train VLA backbones, improving data efficiency on downstream robot tasks. 技術方法: LARY 提出從大規模人類動作視頻中無需顯式動作標籤學習潛在動作表示的基準和方法。該表示用於預訓練 VLA 骨幹,提升下游機器人任務的資料效率。

Key Takeaway: Latent action pre-training from human videos significantly reduces labeled robot data requirements for achieving strong VLA performance. 核心發現: 從人類視頻進行潛在動作預訓練顯著減少了達到強 VLA 性能所需的標記機器人資料需求。


DA-PTQ: Drift-Aware Post-Training Quantization for Efficient VLA Deployment

Authors: Xinyi Li, Yuanyi Liu, Ziyang Chen, et al. | Submitted: 2026-04-15 | arXiv: 2604.11572 Categories: cs.RO

Research Background: VLA deployment on resource-limited robots is challenged by high memory and computational demands. Post-training quantization can help but introduces calibration drift that degrades action quality. 研究背景: VLA 在資源受限機器人上的部署受到高記憶體和計算需求的挑戰。訓練後量化可以幫助,但會引入降低動作品質的校正漂移。

Technical Approach: DA-PTQ introduces drift-aware calibration that explicitly models and compensates for the quantization-induced drift in VLA action token distributions, maintaining action quality under aggressive quantization. 技術方法: DA-PTQ 引入漂移感知校正,明確建模和補償 VLA 動作 token 分佈中由量化引起的漂移,在激進量化下保持動作品質。

Key Takeaway: DA-PTQ enables 4-bit quantization of VLA models with minimal action quality degradation, enabling deployment on edge robot hardware. 核心發現: DA-PTQ 實現 VLA 模型的 4 位元量化,動作品質退化極小,可在邊緣機器人硬體上部署。


AIM: Intent-Aware Unified World Action Modeling with Spatial Value Maps

Authors: Zikang Chen, Zhaowei Wang, Yongping Pan, et al. | Submitted: 2026-04-15 | arXiv: 2604.11135 Categories: cs.RO, cs.AI

Research Background: Pretrained video generation models provide strong priors for robot control, but existing unified world action models struggle to decode reliable actions without substantial robot-specific training. 研究背景: 預訓練視頻生成模型為機器人控制提供強大先驗,但現有統一世界動作模型難以在沒有大量機器人特定訓練的情況下解碼可靠動作。

Technical Approach: AIM integrates intent-aware conditioning with spatial value maps into a unified world action model. Spatial value maps encode task-relevant spatial priorities, guiding video-to-action decoding toward high-value interaction regions without requiring dense robot demonstrations. 技術方法: AIM 將意圖感知條件化與空間價值地圖整合到統一世界動作模型中。空間價值地圖編碼任務相關空間優先級,引導視頻到動作解碼朝向高價值互動區域,無需密集的機器人示範。

Key Takeaway: Intent-aware spatial value maps substantially improve world-model-to-action decoding reliability without large-scale robot-specific training. 核心發現: 意圖感知空間價值地圖在無需大規模機器人特定訓練的情況下顯著提升世界模型到動作的解碼可靠性。


Score 8

Score 7


Peripheral Papers (Score 6)