arXiv Weekly Digest — Week 19, 2026
Fetched: 2026-06-03 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 15
Anticipation-VLA: Solving Long-Horizon Embodied Tasks via Anticipation-based Subgoal Generation
Authors: Zhilong Zhang, Wenyu Luo, Haonan Wang, et al. | Submitted: 2026-05-03 | arXiv: 2605.01772
Categories: cs.RO, cs.LG
Research Background: Existing VLA models break down on long-horizon manipulation because errors compound and fixed-granularity subtask decomposition cannot adapt to varying execution complexity.
研究背景： 現有 VLA 模型在長時序任務上會因誤差累積而失效，且固定粒度的子任務拆解無法適應不同階段的執行複雜度。
Technical Approach: The paper introduces an Anticipation Model that adaptively and recursively generates future subgoals, continuously adjusting as task dynamics evolve. This is wrapped in Anticipation-VLA, a hierarchical architecture where anticipated subgoals guide the low-level VLA policy toward more reliable planning paths.
技術方法： 論文提出可自適應且遞迴地生成未來子目標的 Anticipation Model，隨任務動態演進持續調整；並將其包裝成階層式 Anticipation-VLA 架構，由預期子目標引導底層 VLA 策略產生更可靠的規劃路徑。
Key Takeaway: Adaptive anticipatory subgoaling makes VLA policies substantially more robust on compounding-error long-horizon tasks.
核心發現： 自適應的預期式子目標生成能讓 VLA 策略在易累積誤差的長時序任務上明顯更穩健。
Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery
Authors: Wenhao Li, Xiu Su, Dan Niu, et al. | Submitted: 2026-05-02 | arXiv: 2605.01191
Categories: cs.RO
Research Background: Current VLA models lack execution-time self-monitoring and struggle to reason about and recover from their own errors during manipulation.
研究背景： 現有 VLA 模型缺乏執行時的自我監控能力，難以在操作過程中推理並從自身錯誤中恢復。
Technical Approach: Sentinel-VLA adds an active “sentinel” module that monitors real-time execution status and triggers dynamic reasoning or error-recovery only when needed (e.g., initial planning or detected failures). This on-demand mechanism preserves robustness while minimizing compute, trained on 2.6M auto-annotated transitions across 44 tasks.
技術方法： Sentinel-VLA 加入主動的「哨兵」模組監控即時執行狀態，僅在必要時（如初始規劃或偵測到錯誤）觸發動態推理或錯誤恢復；此按需機制在維持穩健性的同時降低運算開銷，並以涵蓋 44 個任務、260 萬筆自動標註轉移的資料訓練。
Key Takeaway: Metacognitive on-demand reasoning lets a VLA recover from errors without paying the cost of constant deliberation.
核心發現： 元認知式的按需推理讓 VLA 能在不付出持續審議成本的情況下從錯誤中恢復。
VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model
Authors: Wenhao Li, Xiu Su, Yichao Cao, et al. | Submitted: 2026-05-02 | arXiv: 2605.01194
Categories: cs.RO
Research Background: VLA models act through a fast instinctive process that lacks deliberation, causing suboptimal or catastrophic actions in complex or ambiguous scenarios.
研究背景： VLA 模型以快速本能的方式決策、缺乏審議，在複雜或模糊情境下容易產生次優甚至災難性動作。
Technical Approach: VLA-ATTC introduces an uncertainty-based “cognitive clutch” that switches from reflexive execution to a test-time-compute deliberation phase when needed. In that phase a Relative Action Critic selects the best action from candidates via pairwise comparison, replacing unstable absolute value estimation.
技術方法： VLA-ATTC 引入以不確定性為基礎的「認知離合器」，在需要時從反射式執行切換到測試期運算的審議階段；該階段由 Relative Action Critic 以成對比較從候選動作中挑選最佳者，取代不穩定的絕對價值估計。
Key Takeaway: Allocating extra test-time compute only under uncertainty, judged by relative action comparison, improves VLA decisions in hard cases.
核心發現： 僅在不確定時投入額外測試期運算、並以相對動作比較判斷，可改善 VLA 在困難情境下的決策。
Libra-VLA: Achieving Learning Equilibrium via Asynchronous Coarse-to-Fine Dual-System
Authors: Yifei Wei, Linqing Zhong, Yi Liu, et al. | Submitted: 2026-04-27 | arXiv: 2604.24921
Categories: cs.RO, cs.AI, cs.CL, cs.CV
Research Background: Monolithic VLA models map visual-language features directly to high-frequency motor commands, ignoring the natural hierarchy of manipulation and widening the semantic-to-actuation gap.
研究背景： 單體式 VLA 模型直接將視覺語言特徵映射到高頻馬達指令，忽略了操作本身的階層結構，加大語意到致動之間的落差。
Technical Approach: Libra-VLA proposes a coarse-to-fine dual-system architecture that decouples manipulation into discrete macro-directional reaching and continuous micro-pose alignment within a hybrid action space, with the two systems running asynchronously to balance learning complexity.
技術方法： Libra-VLA 提出粗到細的雙系統架構，在混合動作空間中把操作拆解為離散的宏觀方向性接近與連續的微觀位姿對齊，兩個系統非同步運行以平衡學習複雜度。
Key Takeaway: Explicitly hierarchizing the action space into coarse and fine asynchronous systems eases the semantic-actuation burden on VLA grounding.
核心發現： 將動作空間明確拆成粗、細兩個非同步系統，可減輕 VLA 在語意對致動接地上的負擔。
M²-VLA: Boosting Vision-Language Models for Generalizable Manipulation via Layer Mixture and Meta-Skills
Authors: Siyao Xiao, Yuhong Zhang, Zhifang Liu, et al. | Submitted: 2026-04-27 | arXiv: 2604.24182
Categories: cs.RO
Research Background: End-to-end fine-tuning of VLA models erodes the base VLM’s generalization and causes catastrophic forgetting, limiting transfer to new manipulation tasks.
研究背景： VLA 模型的端到端精調會侵蝕底層 VLM 的泛化能力並導致災難性遺忘，限制其對新操作任務的遷移。
Technical Approach: M²-VLA uses a generalized VLM as a backbone with a Mixture of Layers strategy that selectively extracts task-critical information from dense semantic features, plus a Meta Skill Module that injects strong inductive biases for efficient trajectory learning under limited capacity.
技術方法： M²-VLA 以泛化的 VLM 作為骨幹，透過 Mixture of Layers 策略從密集語意特徵中選擇性抽取任務關鍵資訊，並以 Meta Skill Module 注入強歸納偏置，在有限容量下高效學習軌跡。
Key Takeaway: Selectively mixing VLM layers and injecting meta-skills preserves generalization while adapting a VLM into a strong manipulation backbone.
核心發現： 選擇性混合 VLM 層並注入元技能，能在把 VLM 改造為強操作骨幹的同時保留其泛化能力。
DexSim2Real: Foundation Model-Guided Sim-to-Real Transfer for Generalizable Dexterous Manipulation
Authors: Zijian Zeng, Fei Ding, Huiming Yang, et al. | Submitted: 2026-05-03 | arXiv: 2605.05241
Categories: cs.RO, cs.LG
Research Background: Sim-to-real transfer is a key bottleneck for dexterous manipulation, as manual domain randomization and task-specific adaptation generalize poorly across diverse scenarios.
研究背景： Sim-to-real 遷移是靈巧操作的關鍵瓶頸，手動領域隨機化與任務專屬調適難以泛化到多樣情境。
Technical Approach: DexSim2Real uses vision-language foundation models to bridge the gap via three parts: Foundation Model-Guided Domain Randomization that treats a VLM as a visual-realism critic optimized by closed-loop CMA-ES, a Tactile-Visual Cross-Attention Policy for zero-shot visuo-tactile fusion, and a progressive transfer pipeline.
技術方法： DexSim2Real 利用視覺語言基礎模型彌合落差，包含三部分：以 VLM 作為視覺真實度評審、由閉迴路 CMA-ES 優化的基礎模型引導領域隨機化；用於零樣本視覺-觸覺融合的 Tactile-Visual Cross-Attention 策略；以及漸進式遷移流程。
Key Takeaway: Using a VLM as a visual-realism critic to tune simulation closes the dexterous sim-to-real gap without task-specific hand tuning.
核心發現： 以 VLM 作為視覺真實度評審來調校模擬，可在無需任務專屬手動調參下彌合靈巧操作的 sim-to-real 落差。
HANDFUL: Sequential Grasp-Conditioned Dexterous Manipulation with Resource Awareness
Authors: Ethan Foong, Yunshuang Li, Hao Jiang, et al. | Submitted: 2026-04-28 | arXiv: 2604.25126
Categories: cs.RO
Research Background: Most dexterous manipulation work targets single-object, single-skill tasks, ignoring sequential settings where a hand must keep prior grasps while executing new subtasks.
研究背景： 多數靈巧操作研究聚焦單物件、單技能任務，忽略了手部需在執行新子任務時保持先前抓握的序列情境。
Technical Approach: HANDFUL models finger usage as a limited resource and uses finger-level contact rewards to encourage resource-aware grasps that conserve fingers for future actions, then selects these grasps for downstream subtasks via curriculum-based policy learning.
技術方法： HANDFUL 將手指使用建模為有限資源，透過手指層級的接觸獎勵鼓勵保留手指供後續動作的「資源感知」抓握，再以課程式策略學習為下游子任務挑選這些抓握。
Key Takeaway: Treating fingers as a budgeted resource enables dexterous hands to chain multiple manipulation skills while preserving earlier grasps.
核心發現： 將手指視為有預算的資源，能讓靈巧手在保留先前抓握的同時串接多個操作技能。
World Model for Robot Learning: A Comprehensive Survey
Authors: Bohan Hou, Gen Li, Jindou Jia, et al. | Submitted: 2026-04-30 | arXiv: 2605.00080
Categories: cs.RO, cs.CV
Research Background: World models now underpin policy learning, planning, simulation, and data generation in robotics, but the literature is fragmented across architectures, roles, and embodied domains.
研究背景： 世界模型已成為機器人策略學習、規劃、模擬與資料生成的核心，但相關文獻在架構、角色與具身領域上零散分割。
Technical Approach: The survey reviews world models from a robot-learning perspective, examining how they couple with policies, serve as learned simulators for RL and evaluation, and how robotic video world models progressed from imagination-based generation to controllable, foundation-scale formulations, connecting them to navigation and autonomous driving.
技術方法： 本綜述從機器人學習視角回顧世界模型，檢視其如何與策略耦合、如何作為 RL 與評估的學習式模擬器，以及機器人影片世界模型如何從想像式生成演進到可控、基礎規模的形式，並連結到導航與自駕。
Key Takeaway: Provides a unified map of how world models plug into the full robot-learning stack, from policy coupling to foundation-scale video generation.
核心發現： 提供一張統一地圖，說明世界模型如何接入從策略耦合到基礎規模影片生成的完整機器人學習堆疊。
Robot Learning from Human Videos: A Survey
Authors: Junyi Ma, Erhang Zhang, Haoran Yang, et al. | Submitted: 2026-04-30 | arXiv: 2604.27621
Categories: cs.RO, cs.CV
Research Background: Scaling robot data is a critical bottleneck for embodied AI; learning manipulation skills from abundant human videos is a promising path to scalable, generalist robot learning.
研究背景： 擴展機器人資料是具身 AI 的關鍵瓶頸，從大量人類影片學習操作技能是邁向可擴展、通用機器人學習的有前景路徑。
Technical Approach: This survey comprehensively reviews human-video-based learning, covering policy-learning foundations, the interfaces for incorporating human video into robot training, human-to-robot skill transfer, and the data foundations that make passive skill acquisition from human demonstrations feasible.
技術方法： 本綜述全面回顧基於人類影片的學習，涵蓋策略學習基礎、將人類影片納入機器人訓練的介面、人到機器人的技能遷移，以及讓被動從人類示範習得技能成為可能的資料基礎。
Key Takeaway: Consolidates the human-video-to-robot skill transfer landscape and identifies the interfaces and data foundations needed for scalable LfD.
核心發現： 整合人類影片到機器人技能遷移的全貌，釐清可擴展 LfD 所需的介面與資料基礎。
Learning Human-Intention Priors from Large-Scale Human Demonstrations for Robotic Manipulation
Authors: Yifan Xie, YuAn Wang, Guangyu Chen, et al. | Submitted: 2026-04-27 | arXiv: 2604.24681
Categories: cs.RO
Research Background: Human videos hold rich manipulation priors, but raw observations entangle scene understanding, human motion, and embodiment-specific action, making them hard to use for robot learning.
研究背景： 人類影片蘊含豐富的操作先驗，但原始觀測糾纏了場景理解、人體動作與體態專屬動作，難以直接用於機器人學習。
Technical Approach: MoT-HRA is a hierarchical VLA that factorizes manipulation into three experts — a vision-language expert predicting embodiment-agnostic 3D trajectories, an intention expert modeling MANO-style hand motion as a latent human-motion prior, and a fine expert mapping to robot action chunks — trained on a curated 2.2M-episode action-language dataset (HA-2.2M).
技術方法： MoT-HRA 是一個階層式 VLA，將操作分解為三個專家：預測體態無關 3D 軌跡的視覺語言專家、以 MANO 式手部動作建模潛在人體動作先驗的意圖專家，以及映射到機器人動作區塊的精細專家，並以精心整理的 220 萬集動作-語言資料集（HA-2.2M）訓練。
Key Takeaway: Disentangling human-intention priors into trajectory, hand-motion, and action experts lets large-scale human videos drive robotic manipulation.
核心發現： 將人類意圖先驗解耦為軌跡、手部動作與動作三個專家，使大規模人類影片得以驅動機器人操作。
To Do or Not to Do: Ensuring the Safety of Visuomotor Policies Learned from Demonstrations
Authors: Riad Ahmed, Moniruzzaman Akash, Momotaz Begum | Submitted: 2026-05-02 | arXiv: 2605.01201
Categories: cs.RO
Research Background: Imitation learning research measures success by task completion, but field robotics also demands safety assurance — sometimes it is better not to act than to roll out an unsafe policy.
研究背景： 模仿學習研究以任務完成度衡量成效，但實地機器人還需安全保證——有時不執行不安全的策略，反而比硬要展開更好。
Technical Approach: The paper analyzes the underexplored safety-vs-performance trade-off in imitation learning, proposing insights and a framework that lets an IL-powered robot abstain from rolling out a policy when safety cannot be guaranteed, rather than risking a poor or unsafe outcome.
技術方法： 論文剖析模仿學習中少被探討的安全與性能權衡，提出見解與框架，讓由 IL 驅動的機器人在無法保證安全時選擇不展開策略，而非冒著差或不安全結果的風險。
Key Takeaway: Framing IL deployment around the option to abstain elevates safety to a first-class objective alongside task success.
核心發現： 將 IL 部署圍繞「可選擇不執行」來設計，把安全提升為與任務成功並列的一級目標。
An Efficient Metric for Data Quality Measurement in Imitation Learning
Authors: Noushad Sojib, Momotaz Begum | Submitted: 2026-05-02 | arXiv: 2605.01544
Categories: cs.RO
Research Background: Fine-tuning IL policies with end-user demonstrations is hampered because such data is often poor quality — full of corrective motions, oscillations, and abrupt adjustments that degrade performance.
研究背景： 用終端使用者示範精調 IL 策略常受阻，因為這類資料品質往往不佳，充斥校正動作、震盪與突兀調整，拖累性能。
Technical Approach: The authors propose a fast, fully automated demonstration-ranking metric based on the power spectral density (PSD) of demonstration trajectories, which avoids the expensive policy rollouts that existing curation methods require, making it practical for real-world deployment.
技術方法： 作者提出一個快速、全自動的示範排序指標，基於示範軌跡的功率譜密度（PSD），避免現有篩選方法所需的昂貴策略展開，因而適用於實際部署。
Key Takeaway: A rollout-free PSD-based metric can rank demonstration quality cheaply enough for on-device fine-tuning curation.
核心發現： 無需策略展開、基於 PSD 的指標能以足夠低的成本為示範品質排序，適合裝置端的精調篩選。
Learning while Deploying: Fleet-Scale Reinforcement Learning for Generalist Robot Policies
Authors: Yi Wang, Xinchen Li, Pengwei Xie, et al. | Submitted: 2026-05-01 | arXiv: 2605.00416
Categories: cs.RO
Research Background: Pretraining alone leaves generalist robot policies fragile in deployment, where distribution shifts, long-tail failures, and human corrections exceed what fixed demonstration datasets capture.
研究背景： 僅靠預訓練會讓通用機器人策略在部署時脆弱，因為分布偏移、長尾失敗與人類校正超出固定示範資料集所能涵蓋的範圍。
Technical Approach: Learning While Deploying (LWD) is a fleet-scale offline-to-online RL framework that closes the loop between deployment, shared physical experience, policy improvement, and redeployment, using autonomous rollouts and human interventions across a fleet, stabilized by Distributional Implicit Value Learning for robust value estimation.
技術方法： Learning While Deploying（LWD）是一個機隊規模的離線到線上 RL 框架，串接部署、共享物理經驗、策略改進與再部署的迴路，利用機隊範圍的自主展開與人類介入，並以 Distributional Implicit Value Learning 穩定價值估計。
Key Takeaway: Continually post-training a VLA from pooled fleet experience and human interventions closes the gap between pretraining and robust real-world deployment.
核心發現： 從機隊匯集的經驗與人類介入持續對 VLA 進行後訓練，可彌合預訓練與穩健實地部署之間的落差。
Persona-Based Process Design for Assistive Human-Robot Workplaces for Persons with Disabilities
Authors: Nils Mandischer, Daria Eckert, Lars Mikelsons | Submitted: 2026-04-29 | arXiv: 2604.26527
Categories: cs.HC, cs.RO, eess.SY
Research Background: Assistive human-robot workplaces can integrate persons with disabilities into work, but their highly personalized design hinders reuse and universal applicability.
研究背景： 輔助型人機協作工作站能讓身障者進入職場，但其高度個人化的設計阻礙了重用與普及適用性。
Technical Approach: The paper proposes a persona-based process design approach: typical workforce impairments are abstracted into personas with disabilities, the work process is subdivided into sequential actions, and for each action-persona pair strategies are developed to reach the action goal, embedding universal-design principles without requiring scarce expert knowledge.
技術方法： 論文提出以人物誌為基礎的流程設計法：將職場常見的障礙抽象為帶有身障特徵的人物誌，把工作流程拆解為序列動作，並為每個動作-人物誌組合設計達成目標的策略，在不依賴稀缺專家知識下嵌入通用設計原則。
Key Takeaway: Persona-driven process design brings universal-design principles into assistive HRI workplaces without needing scarce expert input.
核心發現： 以人物誌驅動的流程設計，能在不需稀缺專家投入下將通用設計原則帶入輔助型 HRI 工作站。
OmniRobotHome: A Multi-Camera Platform for Real-Time Multiadic Human-Robot Interaction
Authors: Junyoung Lee, Sookwan Han, Jeonghwan Kim, et al. | Submitted: 2026-04-30 | arXiv: 2604.28197
Categories: cs.RO, cs.CV
Research Background: Real homes require multiadic collaboration where multiple humans and robots act concurrently on coupled subtasks, but close-proximity occlusion and rapid state changes make reliable real-time 3D tracking the central bottleneck.
研究背景： 真實家庭需要多方協作，多名人類與多台機器人同時處理相互耦合的子任務，但近距離遮擋與快速狀態變化使可靠的即時 3D 追蹤成為核心瓶頸。
Technical Approach: OmniRobotHome instruments a natural home with 48 hardware cameras to deliver room-scale, occlusion-robust, real-time 3D perception of humans and objects, unified with coordinated multi-robot actuation in a shared world frame — the first platform to make the multiadic HRI regime experimentally tractable.
技術方法： OmniRobotHome 在自然家居環境中部署 48 台硬體相機，提供房間尺度、抗遮擋的即時人物與物件 3D 感知，並在共享世界座標系中統一協調多機器人致動，是首個讓多方 HRI 情境可實驗化的平台。
Key Takeaway: A 48-camera room-scale platform makes concurrent multi-human, multi-robot collaboration experimentally tractable by solving occlusion-robust real-time 3D tracking.
核心發現： 48 相機的房間尺度平台透過解決抗遮擋即時 3D 追蹤，讓多人多機器人並行協作得以實驗化研究。