arXiv Weekly Digest — Week 20, 2026
Fetched: 2026-06-03 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 22
SABER: A Scalable Action-Based Embodied Dataset for Real-World VLA Adaptation
Authors: Narsimha Menga, Parikshit Sakurikar, Amirreza Rouhi et al. | Submitted: 2026-05-10 | arXiv: 2605.09613
Categories: cs.RO, cs.CV
Research Background: General-purpose robot foundation models struggle in specialized domains like retail because they were not trained on relevant data, and collecting it via teleoperation is prohibitively expensive. 研究背景： 通用機器人基礎模型在零售等特殊領域表現不佳，因為預訓練資料缺乏相關場景，而透過遠端操作收集資料成本極高。
Technical Approach: SABER is a retail robotics dataset built from over 100 hours of natural in-store capture using egocentric head-mounted cameras and 360-degree exocentric cameras — no staging, no teleoperation required. The 44.8K training samples span three action streams: latent action sequences (LAPA-style), dexterous hand-pose trajectories retargeted to robot joint space, and whole-body motion sequences. Applied to GR00T N1.6 via multi-task post-training, the approach bypasses the robot-in-the-loop bottleneck. 技術方法： SABER 以頭戴式自我中心相機和 360 度全景相機在真實零售環境中自然採集超過 100 小時影片，完全不需要遠端操作。44,800 個訓練樣本涵蓋三種動作流：LAPA 式潛在動作序列、重定向到機器人關節空間的靈巧手部姿態軌跡，以及全身同步動作序列。資料集應用於 GR00T N1.6 的多任務後訓練。
Key Takeaway: Fine-tuning GR00T N1.6 on SABER achieves a 29.3% mean success rate across ten retail manipulation tasks — more than 2.19× over the baseline — showing that better domain-specific data matters more than model architecture alone. 核心發現： SABER 微調後在十項零售操作任務中達到 29.3% 的平均成功率，是基線的 2.19 倍以上，印證「更好的資料比更好的架構更重要」。
MolmoAct2: Action Reasoning Models for Real-world Deployment
Authors: Haoquan Fang, Jiafei Duan, Donovan Clay et al. | Submitted: 2026-05-04 | arXiv: 2605.02881
Categories: cs.RO
Research Background: Current VLA systems face a trilemma: frontier models are closed, open-weight alternatives require expensive hardware, and reasoning-augmented policies impose prohibitive latency — leaving a gap for practical, open, deployable robot intelligence. 研究背景： 目前的 VLA 系統面臨兩難：前沿模型不開源、開放權重模型需要昂貴硬體、推理增強策略延遲過高，缺乏實用且可部署的開放機器人智能。
Technical Approach: MolmoAct2 advances its predecessor along five axes: MolmoER (a VLM backbone specialized for spatial/embodied reasoning trained on 3.3M samples), three new datasets including MolmoAct2-BimanualYAM (720 hours — the largest open bimanual dataset), OpenFAST (an open-weight action tokenizer across five embodiments), a flow-matching continuous-action expert grafted via per-layer KV-cache conditioning, and MolmoThink (adaptive-depth reasoning that only re-predicts changed scene regions). 技術方法： MolmoAct2 從五個維度提升：MolmoER（330 萬樣本訓練的空間具身推理 VLM backbone）、三個新資料集（含 720 小時雙臂遙操作資料集）、OpenFAST（跨五種具身形態的開放動作分詞器）、透過逐層 KV-cache 條件化嫁接的流匹配連續動作專家，以及只對變化場景區域重新預測的自適應推理 MolmoThink。
Key Takeaway: MolmoAct2 outperforms Pi-0.5 on manipulation benchmarks while remaining fully open (weights, code, and data), and MolmoER surpasses GPT-5 and Gemini Robotics ER-1.5 on 13 embodied-reasoning benchmarks. 核心發現： MolmoAct2 在操作基準上超越 Pi-0.5，且完全開放（權重、程式碼與資料），MolmoER 在 13 個具身推理基準上超過 GPT-5 和 Gemini Robotics ER-1.5。
CoRAL: Contact-Rich Adaptive LLM-based Control for Robotic Manipulation
Authors: Berk Çiçek, Mert K. Er, Ozgur S. Oguz | Submitted: 2026-05-04 | arXiv: 2605.02600
Categories: cs.RO, cs.AI
Research Background: Applying LLMs and VLMs directly to contact-rich manipulation fails because these models lack explicit physical grounding and cannot perform real-time adaptive control when contact dynamics shift unexpectedly. 研究背景： 直接將 LLM/VLM 應用於接觸豐富的操作任務失敗，因為這些模型缺乏明確的物理接地能力，無法在接觸動力學突變時執行自適應即時控制。
Technical Approach: CoRAL decouples high-level reasoning from low-level control: LLMs act as cost designers that synthesize objective functions for an MPPI (Model Predictive Path Integral) planner. A neuro-symbolic adaptation loop uses VLM semantic priors (mass, friction estimates) which are then refined online via system identification, while the LLM iteratively modulates cost structure based on interaction feedback. A retrieval-based memory unit reuses successful strategies across recurring tasks. 技術方法： CoRAL 將高層推理與低層控制解耦：LLM 充當成本設計師，為 MPPI 規劃器合成目標函數。神經符號自適應迴路使用 VLM 的語義先驗（質量、摩擦估計），並透過線上系統辨識即時精化；LLM 根據互動反饋迭代調整成本函數結構，檢索式記憶單元在重複任務中重用成功策略。
Key Takeaway: CoRAL boosts average success rates by over 50% on unseen contact-rich scenarios compared to VLA and foundation-model-based planner baselines, validated on both simulation and real hardware including wall-leveraged object flipping. 核心發現： 在未見過的接觸豐富場景中，CoRAL 的平均成功率比 VLA 和基礎模型規劃器高出 50% 以上，並在實體機器人上完成了利用牆壁翻轉物體等挑戰任務。
OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation
Authors: Yushan Liu, Peibo Sun, Shoujie Li et al. | Submitted: 2026-05-07 | arXiv: 2605.06481
Categories: cs.RO
Research Background: World Action Models (WAMs) jointly predict scene evolution and robot actions, but representing the world as holistic images or global latents makes it hard for the action decoder to address individual objects — especially under scene perturbations where object identity gets entangled with context. 研究背景： 世界動作模型（WAM）聯合預測場景演化和機器人動作，但以整體圖像或全局潛在表示世界時，動作解碼器難以尋址個別物體，在場景擾動下尤為脆弱。
Technical Approach: OA-WAM decomposes each frame into N+1 slot states (one robot slot + N object slots), each with a persistent address vector and time-varying content vector. Cross-slot attention is routed through address-only keys, separating which object to act on from what it currently looks like. A world head predicts next-frame slot states while a flow-matching action head decodes a 16-step action chunk in the same forward pass. 技術方法： OA-WAM 將每一幀分解為 N+1 個槽狀態（一個機器人槽 + N 個物體槽），每個槽含持久地址向量和時變內容向量。跨槽注意力透過僅使用地址鍵進行路由，分離「要操作哪個物體」和「該物體當前外觀」。世界頭預測下一幀槽狀態，流匹配動作頭在同一前向傳播中解碼 16 步動作塊。
Key Takeaway: OA-WAM matches strong VLA and WAM baselines on LIBERO (97.8%) and SimplerEnv (79.3%) while achieving state-of-the-art on LIBERO-Plus geometric axes, with causal slot-intervention tests confirming genuine object addressability (swap-binding cosine 0.87 vs. ≤0.09 for holistic baselines). 核心發現： OA-WAM 在 LIBERO（97.8%）和 SimplerEnv（79.3%）上媲美強基線，在 LIBERO-Plus 幾何軸上達到最佳性能，因果槽干預測試確認了真正的物體可尋址性（交換綁定餘弦 0.87，基線最多 0.09）。
Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models
Authors: Meng Zheng, Samhita Marri, Anwesa Choudhuri et al. | Submitted: 2026-05-08 | arXiv: 2605.08434
Categories: cs.RO
Research Background: VLA models trained via success-only behavioral cloning become brittle — minor execution errors compound into unrecoverable failures because the model has never learned from negative trajectories. 研究背景： 僅用成功示範訓練的 VLA 模型很脆弱：微小執行誤差會疊加成無法恢復的失敗，因為模型從未從負面軌跡中學習。
Technical Approach: AFIL (Adaptive Failure-Informed Learning) uses a pretrained VLA to generate failure rollouts online, then jointly trains Dual Action Generators (DAGs) for successful and failed behaviors while sharing a common vision-language backbone. During diffusion sampling, the failure generator adaptively steers action generation away from failure-prone regions, with guidance strength proportional to the per-step distance between success and failure distributions. 技術方法： AFIL 使用預訓練 VLA 線上生成失敗展開，再聯合訓練雙重動作生成器（DAG），在共享視覺語言 backbone 下分別建模成功和失敗行為。擴散採樣時，失敗生成器自適應地引導動作遠離易失敗區域，引導強度與每步成功/失敗分佈距離成正比。
Key Takeaway: AFIL consistently improves task success rates and robustness across short- and long-horizon manipulation tasks, requiring no handcrafted failure-mode design or human-in-the-loop recovery. 核心發現： AFIL 在短/長時程操作任務中一致提升成功率和魯棒性，無需手動設計失敗模式或人工干預恢復。
RLDX-1 Technical Report
Authors: Dongyoung Kim, Huiwon Jang, Myungkyu Koo et al. | Submitted: 2026-05-05 | arXiv: 2605.03269
Categories: cs.RO, cs.AI, cs.LG
Research Background: While VLAs inherit versatile scene understanding from pretrained VLMs, they still struggle with complex real-world tasks requiring motion awareness, long-term memory, and physical sensing beyond the standard RGB observation. 研究背景： VLA 模型雖繼承了預訓練 VLM 的通用場景理解能力，但在需要動作感知、長期記憶和物理感測的複雜真實世界任務中仍有明顯不足。
Technical Approach: RLDX-1 is built on the Multi-Stream Action Transformer (MSAT), which integrates heterogeneous modalities (proprioception, tactile, depth, etc.) through modality-specific streams with cross-modal joint self-attention. The system further incorporates data synthesis for rare manipulation scenarios, human-like manipulation learning procedures, and inference optimizations for real-time deployment. 技術方法： RLDX-1 以多流動作轉換器（MSAT）為核心，透過模態專用流和跨模態聯合自注意力整合異質感測（本體感覺、觸覺、深度等）。系統還結合稀有操作場景的資料合成、擬人化操作學習程序以及即時部署的推理優化。
Key Takeaway: RLDX-1 achieves 86.8% success on ALLEX humanoid tasks — more than doubling π₀.₅ and GR00T N1.6 (~40%) — establishing a new bar for dexterous manipulation in high-DoF humanoid robots. 核心發現： RLDX-1 在 ALLEX 人形機器人任務中達到 86.8% 成功率，是 π₀.₅ 和 GR00T N1.6（約 40%）的兩倍以上，為高自由度人形機器人靈巧操作設立新標竿。
TAVIS: A Benchmark for Egocentric Active Vision and Anticipatory Gaze in Imitation Learning
Authors: Giacomo Spigler | Submitted: 2026-05-08 | arXiv: 2605.07943
Categories: cs.RO, cs.AI, cs.CV, cs.LG
Research Background: Active vision — policies that control their own gaze during manipulation — has shown benefits in multiple systems, but no shared benchmark exists to compare approaches or quantify what active vision actually contributes across task types. 研究背景： 主動視覺（策略在操作過程中自主控制凝視方向）已在多個系統中顯示優勢，但目前缺乏共享基準來比較方法或量化主動視覺在不同任務中的實際貢獻。
Technical Approach: TAVIS provides two complementary task suites on two humanoid torso embodiments (GR1T2, Reachy2) built on IsaacLab: TAVIS-Head (5 tasks, global search via pan/tilt necks) and TAVIS-Hands (3 tasks, local occlusion via wrist cameras). Key evaluation primitives include a paired headcam-vs-fixedcam protocol and GALT (Gaze-Action Lead Time), a novel HRI-grounded metric quantifying anticipatory gaze in learned policies. 技術方法： TAVIS 在 IsaacLab 上為兩款人形機器人（GR1T2、Reachy2）提供兩套互補任務：TAVIS-Head（5 個任務，透過俯仰頭部進行全局搜索）和 TAVIS-Hands（3 個任務，透過腕部相機應對局部遮擋）。核心評估原語包括配對頭部相機 vs 固定相機協議，以及量化學習策略預期凝視的新指標 GALT（凝視-動作領先時間）。
Key Takeaway: Active vision generally helps but benefits are task-conditional; imitation learning alone produces anticipatory gaze with median lead times comparable to the human teleoperator reference, suggesting gaze prediction is an emergent behavior of imitation. 核心發現： 主動視覺通常有益但收益因任務而異；模仿學習本身即能產生預期凝視，中位領先時間與人類遠端操作者相當，表明預期凝視是模仿的湧現行為。
BifrostUMI: Bridging Robot-Free Demonstrations and Humanoid Whole-Body Manipulation
Authors: Chenhao Yu, Hongwu Wang, Youhao Hu et al. | Submitted: 2026-05-05 | arXiv: 2605.03452
Categories: cs.RO
Research Background: Training humanoid whole-body visuomotor policies requires high-quality demonstration data, but current teleoperation paradigms are bottlenecked by limited hardware accessibility, low efficiency, and the cost of operating actual robots. 研究背景： 訓練人形機器人全身視覺運動策略需要高品質示範資料，但遠端操作範式受限於硬體可及性、效率低落和實際機器人操作成本。
Technical Approach: BifrostUMI uses lightweight VR devices to capture human demonstrations as sparse keypoint trajectories while simultaneously recording wrist-mounted visual data — no robot required during data collection. A high-level policy network predicts future keypoint trajectories conditioned on visual features, and a robust retargeting pipeline maps these trajectories onto the humanoid’s morphology for execution via a whole-body controller. 技術方法： BifrostUMI 使用輕量 VR 設備捕捉人類示範的稀疏關鍵點軌跡，同時記錄腕部相機視覺資料，無需機器人參與資料收集。高層策略網路根據視覺特徵預測未來關鍵點軌跡，穩健的重定向管線將軌跡映射到人形機器人形態並透過全身控制器執行。
Key Takeaway: BifrostUMI enables diverse and agile human-scale behaviors to transfer to humanoid robots without a robot in the loop during data collection, significantly lowering the barrier to humanoid policy training. 核心發現： BifrostUMI 在無需機器人參與資料收集的情況下，實現了多樣化敏捷的人類行為向人形機器人的遷移，大幅降低人形機器人策略訓練門檻。
TriRelVLA: Triadic Relational Structure for Generalizable Embodied Manipulation
Authors: Hanyu Zhou, Chuanhao Ma, Gim Hee Lee et al. | Submitted: 2026-05-07 | arXiv: 2605.05714
Categories: cs.CV, cs.RO
Research Background: VLA models perform well on seen tasks but fail to generalize because their implicit visual representations entangle object appearance, background, and scene layout, making policies sensitive to visual variations in unseen environments. 研究背景： VLA 模型在訓練任務上表現良好，但因隱式視覺表示將物體外觀、背景和場景佈局混雜在一起，使策略對未見環境的視覺變化過度敏感而難以泛化。
Technical Approach: TriRelVLA introduces a triadic relational VLA framework centred on object-hand-task relationships. It constructs explicit triadic representations from multimodal inputs, builds a task-grounded relational graph using task-guided cross-attention for nodes and a relation-aware graph transformer for modelling interactions, then compresses this relational structure into a bottleneck space projected into an LLM for action prediction. 技術方法： TriRelVLA 引入以物體-手-任務關係為核心的三元關係 VLA 框架。從多模態輸入構建顯式三元表示，以任務引導交叉注意力構建節點、關係感知圖轉換器建模互動，再將關係結構壓縮到瓶頸空間並投影到 LLM 進行動作預測。
Key Takeaway: The triadic relational bottleneck reduces reliance on appearance statistics and enables clear gains in cross-scene, cross-object, and cross-task generalization on both simulated benchmarks and a new real-world robotic dataset. 核心發現： 三元關係瓶頸減少了對外觀統計的依賴，在模擬基準和新真實世界機器人資料集上均取得跨場景、跨物體、跨任務泛化的明顯提升。
Understanding Asynchronous Inference Methods for Vision-Language-Action Models
Authors: Ayoub Agouzoul | Submitted: 2026-05-04 | arXiv: 2605.08168
Categories: cs.RO, cs.AI, cs.LG
Research Background: VLA inference latency causes observation staleness when actions are executed asynchronously, and several concurrent methods have been proposed to address this — but they have been evaluated independently with incompatible protocols, making comparison impossible. 研究背景： VLA 推理延遲導致非同步執行時觀測失去新鮮度，雖有多種並行方法提出應對，但各自用不同代碼庫和協議評估，無法橫向比較。
Technical Approach: The paper develops two unified codebases integrating four asynchronous-inference methods — IT-RTC (inference-time inpainting), TT-RTC (training-time delay simulation), VLASH (future-state-aware conditioning), and A2C2 (residual correction) — and benchmarks all four under controlled conditions on Kinetix (MLPMixer) and LIBERO (SmolVLA), sweeping inference delays up to 20 control steps. 技術方法： 建立兩個統一代碼庫，整合四種非同步推理方法（IT-RTC、TT-RTC、VLASH、A2C2），在 Kinetix 和 LIBERO 基準上以控制條件系統性比較，推理延遲最高掃描至 20 個控制步。
Key Takeaway: A2C2’s per-step residual correction is most effective at medium-to-high delays; TT-RTC is the most robust training-based method (zero inference overhead, generalizes beyond its training delay distribution) — offering a practical default for production VLA deployment. 核心發現： A2C2 的逐步殘差修正在中高延遲下最有效；TT-RTC 是最穩健的訓練期方法（零推理開銷，可泛化到訓練延遲分佈之外），是 VLA 生產部署的實用預設選擇。
VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts
Authors: Yuhua Jiang, Junjie Lu, Xinyao Qin et al. | Submitted: 2026-05-07 | arXiv: 2605.06175
Categories: cs.RO
Research Background: Full fine-tuning of VLA models risks catastrophic forgetting of pretrained vision-language knowledge, but existing parameter-efficient fine-tuning (PEFT) methods still struggle to adapt effectively to robot control tasks. 研究背景： VLA 模型全量微調容易破壞預訓練視覺語言知識，但現有參數高效微調（PEFT）方法在機器人控制任務的自適應上仍有明顯不足。
Technical Approach: VLA-GSE spectral-decomposes the frozen backbone, assigning leading singular components to shared generalized experts (capturing broad visual-semantic knowledge) and disjoint residual components to routed specialized experts (capturing task-specific control). This decomposition improves adaptation capacity within a fixed parameter budget, updating only 2.51% of model parameters. 技術方法： VLA-GSE 對凍結 backbone 進行譜分解，將主要奇異分量分配給共享廣泛視覺語意知識的通用專家，將正交殘差分量分配給路由特定任務控制的專業專家，在固定參數預算下提升自適應容量，僅更新 2.51% 的模型參數。
Key Takeaway: VLA-GSE achieves 81.2% average zero-shot success on LIBERO-Plus while preserving pretrained VLM capability on par with LoRA, and improves real-world manipulation under multiple distribution shifts. 核心發現： VLA-GSE 在 LIBERO-Plus 上達到 81.2% 的平均零樣本成功率，同時像 LoRA 一樣保留預訓練 VLM 能力，並在多個分布偏移下提升真實世界操作性能。
OGPO: Sample Efficient Full-Finetuning of Generative Control Policies
Authors: Sarvesh Patil, Mitsuhiko Nakamoto, Manan Agarwal et al. | Submitted: 2026-05-04 | arXiv: 2605.03065
Categories: cs.LG, cs.RO
Research Background: Diffusion- and flow-based generative control policies (GCPs) are effective for robot learning, but fine-tuning them with reinforcement learning is difficult due to distribution mismatch and the challenge of propagating gradients through the full generative process. 研究背景： 基於擴散和流的生成控制策略（GCP）在機器人學習中表現優異，但由於分佈不匹配和難以通過完整生成過程反向傳播梯度，強化學習微調仍具挑戰。
Technical Approach: OGPO (Off-policy Generative Policy Optimization) maintains off-policy critic networks to maximize data reuse and propagates policy gradients through the full generative process via a modified PPO objective using critics as terminal reward. Practical stabilizers include success-buffer regularization, conservative advantages, χ² regularization, and Q-variance reduction. 技術方法： OGPO 維護離策略評論家網路以最大化資料重用，透過修改版 PPO 目標（以評論家作為終端獎勵）將策略梯度傳播通過完整生成過程。實用穩定器包括成功緩衝正則化、保守優勢、χ² 正則化和 Q 方差降低。
Key Takeaway: OGPO is the only method shown to fine-tune poorly-initialized BC policies to near full task-success with no expert data in the online replay buffer, achieving state-of-the-art on multi-task, high-precision insertion, and dexterous manipulation benchmarks. 核心發現： OGPO 是目前唯一能在線上回放緩衝區中無專家資料的情況下，將初始化不良的 BC 策略微調至接近完全成功的方法，在多任務、高精度插入和靈巧操作基準上達到最先進性能。
Seeing Realism from Simulation: Efficient Video Transfer for Vision-Language-Action Data Augmentation
Authors: Chenyu Hui, Xiaodi Huang, Siyu Xu et al. | Submitted: 2026-05-04 | arXiv: 2605.02757
Categories: cs.CV, cs.RO
Research Background: Simulated data is cheap and parallelizable to collect, but suffers from a substantial visual domain gap that limits real-world generalization of VLA models — a key bottleneck for scalable robot learning. 研究背景： 模擬資料收集便宜且可並行化，但視覺域差距顯著，限制了 VLA 模型的真實世界泛化——這是可擴展機器人學習的關鍵瓶頸。
Technical Approach: The framework extracts structured conditions from simulation (semantic segmentation + captioning), rewrites captions to diversify environments, and uses a conditional video transfer model to synthesize realistic videos while preserving task semantics and action trajectories. Two efficiency mechanisms are introduced: a diffusion feature-reuse mechanism that reuses video tokens across adjacent timesteps, and a coreset sampling strategy to identify a compact non-redundant augmentation subset. 技術方法： 框架從模擬中提取結構化條件（語意分割 + 字幕），改寫字幕以多樣化環境，並使用條件視頻遷移模型合成保留任務語義和動作軌跡的真實感視頻。引入兩種效率機制：跨相鄰時間步重用視頻令牌的擴散特徵重用機制，以及識別緊湊非冗餘增強子集的核心集採樣策略。
Key Takeaway: The method improves RDT-1B by 8% on RoboTwin 2.0 and boosts π₀ by 5.1% on LIBERO-Plus, demonstrating that efficient sim-to-real video transfer is a practical path to richer VLA training data. 核心發現： 該方法在 RoboTwin 2.0 上將 RDT-1B 提升 8%，在 LIBERO-Plus 上將 π₀ 提升 5.1%，證明高效的模擬到真實視頻遷移是擴充 VLA 訓練資料的實用路徑。
When Life Gives You BC, Make Q-functions: Extracting Q-values from Behavior Cloning for On-Robot Reinforcement Learning
Authors: Lakshita Dodeja, Ondrej Biza, Shivam Vats et al. | Submitted: 2026-05-06 | arXiv: 2605.05172
Categories: cs.RO, cs.AI
Research Background: Behavior cloning effectively bootstraps robot policies from demonstrations but lacks a self-guided mechanism for online improvement — existing offline-to-online RL methods often cause policies to replace learned good actions due to distribution mismatch. 研究背景： 行為克隆能有效從示範啟動機器人策略，但缺乏線上自我改進機制——現有離線到線上強化學習方法常因分佈不匹配導致策略覆蓋已學到的好動作。
Technical Approach: Q2RL extracts a Q-function from a BC policy using a few environment interactions, then applies online RL with Q-Gating: a mechanism that switches between BC and RL policy actions based on their respective Q-values to collect high-quality samples for RL policy training, combining the stability of BC with the improvement capability of RL. 技術方法： Q2RL 透過少量環境互動從 BC 策略提取 Q 函數，再透過 Q-Gating 進行線上強化學習：該機制根據各自 Q 值在 BC 和 RL 策略動作間切換以收集高品質樣本，結合了 BC 的穩定性和 RL 的改進能力。
Key Takeaway: Q2RL learns robust policies for contact-rich manipulation (pipe assembly, kitting) on a real robot in 1–2 hours of online interaction, achieving up to 100% success rates and 3.75× improvement over the original BC policy. 核心發現： Q2RL 在 1-2 小時的真實機器人線上互動中，在接觸豐富的操作任務（管道組裝、套件裝配）上學習到穩健策略，成功率達 100%，比原始 BC 策略提升 3.75 倍。
SigLoMa: Learning Open-World Quadrupedal Loco-Manipulation from Ego-Centric Vision
Authors: Shiyi Chen, Haiyi Liu, Mingye Yang et al. | Submitted: 2026-05-05 | arXiv: 2605.03846
Categories: cs.RO
Research Background: Building open-world quadrupedal loco-manipulation systems is difficult because RL with exteroception suffers from sample inefficiency and large sim-to-real gaps, while high-frequency control conflicts with visual tracking latency. 研究背景： 建構開放世界四足行走-操作系統極具挑戰：使用外感知的強化學習樣本效率低且模擬到真實差距大，而高頻控制需求與視覺追蹤延遲相衝突。
Technical Approach: SigLoMa introduces Sigma Points — a lightweight geometric representation for exteroception ensuring native sim-to-real alignment — and pairs them with an ego-centric Kalman Filter for robust high-rate state estimation bridging the perception-control frequency gap. An Active Sampling Curriculum guided by Hint Poses addresses sample inefficiency, while temporal encoding with simulated random-walk drift handles structural visual blind spots. 技術方法： SigLoMa 引入 Sigma Points——一種確保原生模擬到真實對齊的輕量幾何外感知表示——並結合自我中心卡爾曼濾波器提供跨越感知-控制頻率差距的高頻魯棒狀態估計。由提示姿態引導的主動採樣課程解決樣本低效問題，帶模擬隨機漂移的時序編碼處理結構性視覺盲區。
Key Takeaway: Relying solely on a 5Hz open-vocabulary detector (200ms latency), SigLoMa performs dynamic loco-manipulation across multiple tasks on real hardware at performance comparable to expert human teleoperation. 核心發現： 僅依賴 5Hz 開放詞彙偵測器（200ms 延遲），SigLoMa 在真實硬體上執行多種動態行走操作任務，性能媲美人類專家遠端操作。
AT-VLA: Adaptive Tactile Injection for Enhanced Feedback Reaction in Vision-Language-Action Models
Authors: Xiaoqi Li, Muhe Cai, Jiadong Xu et al. | Submitted: 2026-05-08 | arXiv: 2605.07308
Categories: cs.RO
Research Background: VLA models excel at visual manipulation but struggle in contact-rich scenarios requiring precise physical interaction — integrating tactile signals during fine-tuning risks disrupting pretrained capabilities, while slow VLA inference limits real-time tactile responsiveness. 研究背景： VLA 模型在視覺操作中表現出色，但在需要精確物理互動的接觸豐富場景中掙扎——微調時引入觸覺信號會破壞預訓練能力，而緩慢的 VLA 推理限制了即時觸覺響應性。
Technical Approach: AT-VLA introduces an Adaptive Tactile Injection mechanism that dynamically determines when and where tactile signals should be injected, incorporating them only when they significantly contribute to action generation. A Tactile Reaction Dual-Stream mechanism decouples sensory processing into a slow visual-language stream (low-frequency perceptual reasoning) and a fast tactile control stream (high-frequency physical interaction), enabling closed-loop response within 0.04s. 技術方法： AT-VLA 引入自適應觸覺注入機制，動態決定何時及何處注入觸覺信號，僅在對動作生成有顯著貢獻時才注入。觸覺反應雙流機制將感測處理解耦為慢速視覺語言流（低頻感知推理）和快速觸覺控制流（高頻物理互動），實現 0.04 秒內的閉環響應。
Key Takeaway: AT-VLA enables real-time tactile-reactive manipulation in contact-rich tasks while minimizing interference with pretrained VLA representations, achieving high-frequency physical response without sacrificing semantic grounding. 核心發現： AT-VLA 在接觸豐富任務中實現即時觸覺反應操作，同時最小化對預訓練 VLA 表示的干擾，無需犧牲語義接地即可實現高頻物理響應。
AssistDLO: Assistive Teleoperation for Deformable Linear Object Manipulation
Authors: Berk Guler, Simon Manschitz, Kay Pompetzki et al. | Submitted: 2026-05-07 | arXiv: 2605.06323
Categories: cs.RO
Research Background: Deformable Linear Objects (DLOs) like ropes and cables are notoriously difficult to manipulate robotically due to their infinite-dimensional configuration space; in teleoperation, depth uncertainty further hinders state perception and timely reaction. 研究背景： 繩索、電纜等可變形線性物體（DLO）因無限維配置空間而難以機器人操作；在遠端操作中，深度不確定性進一步妨礙狀態感知和即時反應。
Technical Approach: AssistDLO combines real-time multi-view state estimation with visual assistance (VA) and a geometry-aware shared autonomy controller using Control Barrier Functions (SA-CBF). Unlike simple geometric attractors, SA-CBF acts as a geometry-aware funnel enabling precise grasping while preserving operator high-level authority. Evaluated in a bimanual knot-untangling user study with N=22 participants and ropes of varying length and rigidity. 技術方法： AssistDLO 結合即時多視角狀態估計、視覺輔助（VA）和基於控制障礙函數的幾何感知共享自主控制器（SA-CBF）。SA-CBF 作為幾何感知漏斗，在保留操作員高層控制權的同時實現精確抓取。在 N=22 參與者的雙臂解繩用戶研究中評估。
Key Takeaway: SA-CBF acts as a skill equalizer for novice users — raising knot-untangling success from 71% to 88% — while expert users prefer visual assistance, revealing that effective DLO teleoperation requires adaptive, user-aware shared autonomy rather than a fixed strategy. 核心發現： SA-CBF 是初學者的技能均衡器（解繩成功率從 71% 提升至 88%），而專家偏好視覺輔助，揭示有效的 DLO 遠端操作需要自適應、用戶感知的共享自主性，而非固定策略。
ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation
Authors: Wei Li, Jizhihui Liu, Li Yixing et al. | Submitted: 2026-05-06 | arXiv: 2605.05126
Categories: cs.RO
Research Background: Current VLA models map 2D observations to actions, but exhibit spatiotemporal limitations: 3D spatial representations require additional sensors with computational overhead, and visual reasoning is limited to future-frame prediction without instruction-grounded scene alignment. 研究背景： 現有 VLA 模型將 2D 觀測映射到動作，但存在時空限制：3D 空間表示需要額外感測器帶來計算開銷，而視覺推理僅限於未來幀預測，缺乏與指令接地的場景對齊。
Technical Approach: ConsisVLA-4D introduces three components: CV-Aligner (ensures cross-view object semantic consistency by filtering instruction-relevant regions), CO-Fuser (eliminates spatial relation ambiguities between objects across views using compact latent representations), and CS-Thinker (achieves cross-scene spatiotemporal consistency by learning local dynamics from object-semantic tokens and global depth from geometric tokens). 技術方法： ConsisVLA-4D 引入三個組件：CV-Aligner（過濾指令相關區域確保跨視角物體語意一致性）、CO-Fuser（用緊湊潛在表示消除跨視角物體空間關係模糊）和 CS-Thinker（從物體語意令牌學習局部動力學、從幾何令牌學習全局深度，實現跨場景時空一致性）。
Key Takeaway: ConsisVLA-4D achieves 21.6% and 41.5% performance improvements with 2.3× and 2.4× inference speedups over OpenVLA on LIBERO and real-world platforms respectively, showing that explicit spatiotemporal consistency unlocks both accuracy and efficiency. 核心發現： ConsisVLA-4D 在 LIBERO 和真實世界平台上分別比 OpenVLA 提升 21.6% 和 41.5% 的性能，同時實現 2.3 倍和 2.4 倍推理加速，顯示顯式時空一致性同時提升精度和效率。
Latent Bridge: Feature Delta Prediction for Efficient Dual-System Vision-Language-Action Model Inference
Authors: Yudong Liu, Yuan Li, Zijia Tang et al. | Submitted: 2026-05-04 | arXiv: 2605.02739
Categories: cs.RO
Research Background: Dual-system VLA models achieve top manipulation performance but are bottlenecked by a heavy VLM backbone that must run at every control step despite producing temporally redundant features between steps. 研究背景： 雙系統 VLA 模型達到頂尖操作性能，但受制於每個控制步都需運行的重型 VLM backbone，儘管相鄰時間步的特徵在時間上高度冗餘。
Technical Approach: Latent Bridge is a lightweight model that predicts VLM output deltas between timesteps, allowing the action head to operate on predicted outputs while the expensive VLM is called only periodically. Instantiated on both GR00T-N1.6 (feature-space bridge) and π0.5 (KV-cache bridge), the approach uses a task-agnostic DAgger training pipeline that transfers across benchmarks without modification. 技術方法： Latent Bridge 是一個預測時間步間 VLM 輸出差量的輕量模型，使動作頭可在預測輸出上運行，而昂貴的 VLM 僅需周期性調用。分別在 GR00T-N1.6（特徵空間橋接）和 π0.5（KV-cache 橋接）上實例化，使用無需修改即可跨基準遷移的任務無關 DAgger 訓練管線。
Key Takeaway: Latent Bridge achieves 95–100% performance retention while reducing VLM calls by 50–75%, yielding 1.65–1.73× net per-episode speedup across LIBERO, RoboCasa, and ALOHA benchmarks. 核心發現： Latent Bridge 在保持 95-100% 性能的同時，將 VLM 調用次數減少 50-75%，在 LIBERO、RoboCasa 和 ALOHA 基準上實現 1.65-1.73 倍的每 episode 淨加速。
ECHO: Continuous Hierarchical Memory for Vision-Language-Action Models
Authors: Yanbin Hu, Jin Cui, Jiayi Lu et al. | Submitted: 2026-05-09 | arXiv: 2605.10993
Categories: cs.RO
Research Background: Long-horizon manipulation tasks expose a critical memory limitation in VLA models — existing memory-augmented architectures rely on linear or flat storage that lacks structural priors for manipulation categories, hindering efficient experience retrieval and generalization to unseen task compositions. 研究背景： 長時程操作任務暴露了 VLA 模型的關鍵記憶限制——現有記憶增強架構依賴缺乏操作類別結構先驗的線性或平面存儲，阻礙高效經驗檢索和對未見任務組合的泛化。
Technical Approach: ECHO (Experience Consolidation and Hierarchical Organization) maps VLA hidden states into a Continuous Hierarchical Space using a hyperbolic autoencoder. Hyperbolic metrics and entailment constraints organize experience vectors into a semantic memory tree supporting efficient top-down retrieval. A background consolidation mechanism continuously refines the memory tree through geometric interpolation and structural splitting. 技術方法： ECHO 使用雙曲自編碼器將 VLA 隱藏狀態映射到連續階層空間，雙曲度量和蘊含約束將經驗向量組織成支持高效自上而下檢索的語意記憶樹。後台整合機制透過幾何插值和結構分裂持續精化記憶樹。
Key Takeaway: Integrated into π₀, ECHO achieves a 12.8% absolute improvement in execution success on LIBERO-Long over the baseline, while improving compositional generalization on cross-suite unseen long-horizon tasks. 核心發現： 整合到 π₀ 後，ECHO 在 LIBERO-Long 上比基線提升 12.8% 的絕對執行成功率，同時在跨套件未見長時程任務上改善組合泛化能力。
Hierarchical Prompting with Dual LLM Modules for Robotic Task and Motion Planning
Authors: Karolina Źróbek, Tessa Pulli, Paweł Gajewski et al. | Submitted: 2026-05-08 | arXiv: 2605.08330
Categories: cs.RO
Research Background: Enabling robots to execute natural language instructions in service and assistance scenarios requires bridging high-level task planning with low-level 3D spatial reasoning — a gap that single LLM architectures handle poorly. 研究背景： 使機器人在服務和輔助場景中執行自然語言指令，需要橋接高層任務規劃與低層 3D 空間推理——單一 LLM 架構難以同時處理這兩者。
Technical Approach: The framework employs two LLM modules: a primary ReAct-style planning agent that processes natural language commands and generates action sequences by interacting with perception and manipulation tools, plus a separate spatial reasoning sub-module that handles precise 3D placement instructions (e.g., “place the mug next to the plate”) based on object geometry and scene layout. Object detection uses YOLOX-GDRNet for pose estimation. 技術方法： 框架採用兩個 LLM 模組：以 ReAct 風格處理自然語言指令並透過感知和操作工具生成動作序列的主規劃代理，以及基於物體幾何和場景佈局處理精確 3D 放置指令的獨立空間推理子模組。物體偵測使用 YOLOX-GDRNet 進行姿態估計。
Key Takeaway: The hierarchical dual-LLM system achieves 86% overall task success across 24 test scenarios — from simple spatial commands to high-level instructions and infeasible request detection — with clear gains from the spatial reasoning sub-module on precise placement tasks. 核心發現： 階層式雙 LLM 系統在 24 個測試場景中達到 86% 的整體任務成功率，涵蓋從簡單空間指令到高層指令和不可行請求偵測，空間推理子模組在精確放置任務上有顯著貢獻。
How to Utilize Failure Demo Data?: Effective Data Selection for Imitation Learning Using Distribution Differences in Attention Mechanism
Authors: Kana Miyamoto, Kanata Suzuki, Tetsuya Ogata | Submitted: 2026-05-08 | arXiv: 2605.07560
Categories: cs.RO
Research Background: Imitation learning has relied almost exclusively on successful demonstrations, even though failures are unavoidable during human data collection — and existing methods for exploiting failure data require additional processing or iterative policy rollouts that are difficult to integrate into standard pipelines. 研究背景： 模仿學習幾乎完全依賴成功示範，儘管人類資料收集中失敗不可避免——而現有利用失敗資料的方法需要額外處理或迭代策略展開，難以整合到標準管線。
Technical Approach: The paper proposes learning latent representations of success-failure discrepancies that are incorporated directly into the attention mechanism, enabling the policy to select an appropriate latent mode from the initial observation at inference. A post-training metric quantifying attention discrepancy between each failure sample and successful demonstrations is introduced to selectively identify which failure samples benefit learning when combined with successes. 技術方法： 論文提出學習成功-失敗差異的潛在表示，並直接整合到注意力機制中，使策略在推理時能從初始觀測選擇適當的潛在模式。引入量化每個失敗樣本與成功示範間注意力差異的後訓練指標，以識別哪些失敗樣本在與成功示範結合時有助於學習。
Key Takeaway: The attention-discrepancy metric enables selective failure data utilization that improves task success rates without requiring autonomous rollouts, offering a practical drop-in enhancement for standard imitation learning data collection pipelines. 核心發現： 注意力差異指標實現了選擇性失敗資料利用，無需自主展開即可提升任務成功率，為標準模仿學習資料收集管線提供了實用的即插即用增強。