arXiv Weekly Digest — Week 21, 2026

Fetched: 2026-05-23 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 133

”I’m Not Mad, Just Focused”: Understanding Human Emotions in Human-Robot Collaboration

Authors: Seung Chan Hong, Dana Kulić, Leimin Tian | Submitted: 2026-05-16 | arXiv: 2605.16816 Categories: cs.RO

Research Background: Human-robot collaboration (HRC) can benefit from robots’ abilities to interpret human emotional states. However, current emotion recognition (ER) models in HRC often fall short, particularly due to their reliance on acted datasets and single-modality inputs like facial expressions. 研究背景： 人機協作中，機器人若能理解人類情緒狀態，將大幅提升協作品質。然而現有情緒辨識模型常因依賴演出型資料集與單一模態輸入而表現不足。

Technical Approach: We propose a novel vision language model (VLM)-based ER system that leverages contextual understanding to improve emotion interpretation in HRC. We first evaluate the VLM-ER system by assessing its semantic and sentiment similarity with human annotations on an existing HRC dataset. Then, in a user study with a service robot in a collaborative delivery task, we evaluate the effects of modulating the robot’s behaviour based on the user’s emotional state inferred by the VLM-ER system. 技術方法： 本文提出基於視覺語言模型（VLM）的情緒辨識系統，利用情境理解提升人機協作中的情緒詮釋能力。研究首先在現有 HRC 資料集上評估語義與情感相似度，再透過與服務機器人的使用者研究進行驗證。

Key Takeaway: Further, participants in the user study preferred emotion-adaptive robot behaviour facilitated by the VLM-ER system. 核心發現： VLM 情緒辨識系統在人機協作情境中展現優於傳統方法的情緒理解能力。

SADP: Subgoal-Aware Diffusion Policy for Explainable Robots Learned from Foundation Model Generated Demonstrations

Authors: Site Hu, Takato Horii | Submitted: 2026-05-16 | arXiv: 2605.16871 Categories: cs.RO

Research Background: Explainable robots require not only successful task execution but also the ability to expose internal decision-making process in a user-friendly manner. However, most imitation learning methods are trained solely on task-level demonstrations, without explicitly modeling subgoal structure or execution progress. 研究背景： 可解釋機器人不僅需完成任務，還須以使用者友善的方式展現內部決策過程。然而多數模仿學習方法僅在任務層級示範上訓練，未明確建模子目標結構。

Technical Approach: This limitation is further exacerbated by the scarcity of subgoal-level supervision in standard robot learning datasets, which restricts the development of robots that can convey the subtasks they are executing during long-horizon manipulation. To address this issue, this paper proposes Subgoal-Aware Diffusion Policy (SADP), a framework that leverages foundation models to autonomously generate subgoal-annotated demonstrations and trains diffusion policies on these datasets. SADP structures policy execution around human-interpretable subgoals by 技術方法： 本文提出 SADP（子目標感知擴散策略），利用基礎模型生成子目標層級示範，讓機器人在長時域操作中能清楚傳達正在執行的子任務。該方法透過擴散策略建模子目標序列與執行進度。

Key Takeaway: These results highlight that built-in, rather than post-hoc, interpretability can coexist with high task performance. 核心發現： SADP 在長時域操作任務中同時提升成功率與可解釋性。

When Dynamics Shift, Robust Task Inference Wins: Offline Imitation Learning with Behavior Foundation Models Revisited

Authors: Rishabh Agrawal, Rahul Jain, Ashutosh Nayyar | Submitted: 2026-05-16 | arXiv: 2605.17017 Categories: cs.LG, cs.AI

Research Background: Behavior Foundation Models (BFMs) enable scalable imitation learning (IL) by pretraining task-agnostic representations that can be rapidly adapted to new tasks. However, existing BFMs assume fixed environment dynamics, limiting their robustness under real-world shifts such as changes in friction, actuation, or sensor noise. 研究背景： 行為基礎模型（BFM）透過預訓練任務無關表示來實現可擴展的模仿學習，但現有 BFM 假設環境動態固定，在真實世界摩擦、驅動或感測器雜訊變化下魯棒性不足。

Technical Approach: We address this by formulating BFM task-inference as a robust minimax optimization problem, enabling adaptation to worst-case dynamics perturbations without modifying pretraining. To the best of our knowledge, this is the first BFM-based framework that achieves robustness to dynamics shifts while relying solely on offline data from a single nominal environment. Our approach significantly outperforms standard BFM and robust offline IL baselines under dynamics shifts. 技術方法： 本文將 BFM 任務推斷重新表述為魯棒極小極大最佳化問題，無需修改預訓練即可適應最壞情況的動態擾動。這是首個在動態偏移下仍具魯棒性的 BFM 框架。

Key Takeaway: These results demonstrate that robust policy can be achieved entirely at task-inference time, improving the practicality of BFMs in dynamic settings. 核心發現： 魯棒任務推斷讓 BFM 在動態偏移環境下仍能維持強勁的模仿學習表現。

How to Instruct Your Robot: Dense Language Annotations Power Robot Policy Learning

Authors: Bosung Kim, Ruiyi Wang, David Acuna et al. | Submitted: 2026-05-16 | arXiv: 2605.17077 Categories: cs.RO, cs.AI

Research Background: Scaling robot policy learning is bottlenecked by the cost of collecting demonstrations, while language annotations for existing demonstrations are comparatively cheap. We study language density as a lever for extracting more signal from a fixed robot or egocentric-video corpus. 研究背景： 擴展機器人策略學習的瓶頸在於收集示範的成本，而對現有示範補充語言標註則相對低廉。本文研究語言標註密度作為從固定示範語料庫中提取更多訊號的手段。

Technical Approach: We introduce DeMiAn (Dense Multi-aspect Annotation), a two-stage approach that first re-labels demonstration segments with VLM-generated annotations along four complementary aspects: physical motion, scene composition, arm pose, and reasoning. A learned instructor then maps a task description and initial scene snapshot to a task-appropriate annotation at deployment, running asynchronously so generation latency is hidden behind policy execution. Across over 1M robot manipulation clips and 50K EgoVerse human-egocentric videos, DeMiAn improves bot 技術方法： 本文提出 DeMiAn（密集多面向標註），兩階段方法先以 VLM 生成的標註重新標記示範片段（涵蓋動作、場景、手臂姿態、推理四個面向），再訓練一個指導模型將任務描述映射至密集指令序列。

Key Takeaway: These results position dense re-annotation as a practical scaling lever for robot policy learning. 核心發現： 密集語言標註顯著提升機器人策略從固定示範資料集中的學習效率。

Contrastive Conceptor Activation Steering (COAST): Unlocking Vision-Language-Action Models through Hidden States

Authors: Miranda Muqing Miao, Subin Kim, Brandon Yang et al. | Submitted: 2026-05-16 | arXiv: 2605.17144 Categories: cs.RO, cs.AI, cs.LG

Research Background: Vision-Language-Action (VLA) models leverage powerful perceptual priors from web-scale Vision-Language Model (VLM) pre-training, yet they remain surprisingly brittle in practice, frequently failing at simple robotic tasks. To mitigate this, we propose Contrastive Conceptor Activation Steering (COAST). 研究背景： VLA 模型利用大規模預訓練的感知先驗，卻在實際機器人任務中仍常失敗。理解並修正 VLA 的內部表示是提升魯棒性的關鍵。

Technical Approach: COAST builds on the notion of a “conceptor”, a linear operator that soft-projects data into the principal components of a target distribution. COAST uses conceptors to identify success-critical subspaces for a target robotic task from a few examples of success and failure rollouts. At inference time, it steers VLA latents into these identified success subspaces to improve task outcomes. 技術方法： 本文提出 COAST（對比概念器激活引導），建構「概念器」線性算子將資料投影至目標分佈的主成分。COAST 從少量成功與失敗示範中識別關鍵子空間，並在推理時引導 VLA 的隱藏狀態遠離失敗模式。

Key Takeaway: COAST provides a lightweight, training-free path to unlocking these latent capabilities by steering the model towards its own “success” distributions. 核心發現： COAST 無需重新訓練即可在推理時提升 VLA 的操作成功率。

Designing for Being-With: Presence Without Personhood in Conversational Human-AI Interaction

Authors: Hector Michael Fried, Robin Hill | Submitted: 2026-05-16 | arXiv: 2605.17194 Categories: cs.HC, cs.CY

Research Background: Conversational AI systems increasingly generate social presence through linguistic fluency, emotional mirroring, and continuity across interactions. While these qualities can support engagement, they also risk relational overreach-particularly in care-adjacent contexts where users may interpret fluent systems as empathic, competent, or authoritative. 研究背景： 對話式 AI 系統透過語言流暢性與情感鏡射製造社交臨場感，在照護情境中可能導致使用者過度依賴或誤解 AI 能力。

Technical Approach: This position paper argues for a designerly alternative: being-with without becoming. Drawing on a program of research-through-design and design ethnography involving the design, deployment, and reflective analysis of conversational agents across public, educational, cultural, and care-adjacent settings, the paper introduces the concept of bounded relational presence. Bounded presence supports attentiveness, continuity, and responsiveness while explicitly avoiding claims of personhood, therapeutic authority, or human equivalence. 技術方法： 本文主張以「同在而不成為人」的設計原則取代擬人化設計，透過研究型設計與設計民族誌分析對話代理人的部署，提倡建立明確的能力邊界。

Key Takeaway: The contribution is not a deployed clinical system, but a set of designerly principles for shaping relational interaction in conversational HRI that emphasize relational coherence, honesty of limits, and accountable withdrawal. 核心發現： 在照護情境中，設計「同在但不成為人」的對話 AI 可降低關係過度依賴的風險。

Event-Grounded Sparse Autoencoders for Vision-Language-Action Policies

Authors: Xinchen Jin, Aditya Chatterjee, Pranav Kumar et al. | Submitted: 2026-05-17 | arXiv: 2605.17204 Categories: cs.RO, cs.AI

Research Background: Vision-Language-Action (VLA) policies translate language and visual inputs into robot actions, where their hidden representations directly shape closed-loop behavior. However, mechanistic interpretability tools from language and vision-language models do not transfer cleanly to VLAs: outputs are robot actions rather than human-readable tokens, and interventions can only be tested via expensive closed-loop rollouts. 研究背景： VLA 策略將語言與視覺輸入轉換為機器人動作，其隱藏表示直接影響閉環行為。然而語言模型的機制可解釋性工具難以直接應用於 VLA。

Technical Approach: We propose an event-grounded interpretability pipeline that anchors SAE feature analysis to behavioral events rather than text contexts. End-effector keyframes are clustered within each task using visual, state, and temporal cues, linking SAE features to behaviorally salient events and, via optional VLM annotations, to semantic context. To our knowledge, our pipeline is among the first to ground SAE-based VLA analysis in closed-loop behavioral events. 技術方法： 本文提出事件錨定的稀疏自編碼器（SAE）可解釋性流程，以行為事件（末端執行器關鍵幀）而非文字情境作為特徵分析錨點，並在 VLA 隱藏層中提取任務相關的語義特徵。

Key Takeaway: Code is available at \url{https://github.com/xc-j/Event-SAE}. 核心發現： 事件錨定 SAE 方法揭示了 VLA 策略中與操作行為直接對應的可解釋特徵。

Authors: Jingzhi Huang, Junkai Huang, Wenxuan Song et al. | Submitted: 2026-05-17 | arXiv: 2605.17249 Categories: cs.RO

Research Background: Vision-Language Navigation (VLN) approaches have currently followed two primary paradigms: the end-to-end Vision-Language Model (VLM) policy fine-tuned on navigation trajectories to directly predict actions, and the zero-shot modular pipeline integrating pre-trained Multimodal Large Language Model (MLLM) for training-free generalization to unseen environments. However, end-to-end methods struggle with long-horizon navigation and lack dynamic reas 研究背景： 視覺語言導航（VLN）有端對端 VLM 策略與零樣本模組化管線兩種主要範式，前者長時域推理不足，後者空間定位能力有限。

Technical Approach: To bridge this gap, we introduce SEDualVLN, a spatially-enhanced dual-system VLN framework. System 1 is a VLM model enhanced with both global and local spatial awareness, used for action generation. System 2 integrates a general MLLM with a mapping module, wherein the MLLM plans waypoints by leveraging top-down views of the real-time 3D map alongside streams of rendered path images. 技術方法： 本文提出 SEDualVLN，融合兩種範式的空間增強雙系統架構：端對端 VLM 策略提供語義理解，模組化管線提供空間定位，透過動態協調機制整合兩者優勢。

Key Takeaway: SEDualVLN achieves state-of-the-art performance on VLN-CE benchmarks, and further ablation studies demonstrate the effectiveness of each system and module. 核心發現： SEDualVLN 在長時域導航任務中同時保有語義推理能力與可靠的空間定位。

Is VLA Reasoning Faithful? Probing Safety of Chain-of-Causation

Authors: Nicanor Mayumu, Xiaoheng Deng, Patrick Mukala | Submitted: 2026-05-17 | arXiv: 2605.17268 Categories: cs.AI, cs.CV, cs.RO

Research Background: We present the first systematic study of faithfulness in Vision-Language-Action (VLA) driving models, analyzing 300 Alpamayo-R1-10B inferences across 100 diverse PhysicalAI-AV scenarios. Our main finding is that output natural-language rationales with trajectories may be significantly unfaithful: (i) overall reasoning fidelity is only 42.5%, with Chain-of-Causation matching scene reality less than half the time; (ii) 94 missed pedestrians in one- 研究背景： VLA 駕駛模型的推理忠實性（輸出語言解釋是否真實反映決策過程）尚未有系統性研究。

Technical Approach: Our main finding is that output natural-language rationales with trajectories may be significantly unfaithful: (i) overall reasoning fidelity is only 42.5%, with Chain-of-Causation matching scene reality less than half the time; (ii) 94 missed pedestrians in one-third of pedestrian-relevant scenes; (iii) 97.7% trajectory fragility under mild visual perturbations; and (iv) only 48.3% mean reasoning-action consistency, with 53.3% of inferences exhibiting low consistency, including 37.9% of stop-claimed cases where the model continues instead. We 技術方法： 本文對 300 次 Alpamayo-R1-10B 推理進行首次系統性忠實性研究，發現整體推理保真度僅 42.5%，行人遺漏率高，且在輕微視覺擾動下軌跡脆弱性達 97.7%。

Key Takeaway: We formalize faithfulness information-theoretically, define entity and action fidelity with verification criteria, and outline a four-component safety architecture aligned with these results. 核心發現： VLA 駕駛模型的語言推理與實際決策存在嚴重不一致，影響安全部署。

CLAP: Contrastive Latent-space Prompt Optimization for End-to-end Autonomous Driving

Authors: Ruiyang Zhu, Yuehan He, Boyuan Zheng et al. | Submitted: 2026-05-17 | arXiv: 2605.17284 Categories: cs.CV, cs.AI, cs.LG, cs.RO

Research Background: End-to-end autonomous driving systems powered by Vision-Language-Action (VLA) models achieve strong performance on common driving scenarios, yet remain brittle in rare but safety-critical long-tail situations such as active construction zones and complex yielding geometries. In this paper, we present a method that addresses the long-tail challenging scenes beyond data scaling and model training. 研究背景： 端對端自動駕駛 VLA 系統在常見場景表現優異，但在施工區與複雜讓行幾何等長尾安全關鍵情境中仍脆弱。

Technical Approach: We introduce CLAP (Contrastive Latent-space Prompt optimization), a location-aware adaptation framework that augments a frozen VLA driving model with per-roadblock soft prompts, optimized from crowdsourced data and retrieved on demand via Vehicle-to-Everything (V2X) communication. Our approach rests on two observations from VLAs’ latent space: (i) at the VLA’s hidden-state layer, scenarios from the same roadblock cluster tightly and occupy compact regions of the latent space; and (ii) within a single roadblock, long-tail and normal frames are h 技術方法： 本文提出 CLAP（對比潛空間提示最佳化），為凍結 VLA 駕駛模型加入位置感知的路段級軟提示，從眾包反饋最佳化，無需修改模型權重即可適應長尾場景。

Key Takeaway: On the NAVSIM benchmark with various state-of-the-art VLA backbones, CLAP reduces challenging scenario planning error by 24% with no regression on normal frames, significantly improving planning performance. 核心發現： CLAP 在不重新訓練 VLA 的情況下顯著提升長尾安全關鍵場景的駕駛表現。

ClaHF: A Human Feedback-inspired Reinforcement Learning Framework for Improving Classification Tasks

Authors: Tianxiang Xu, Xiaoyan Zhu, Xin Lai et al. | Submitted: 2026-05-17 | arXiv: 2605.17458 Categories: cs.LG

Research Background: Text classification models are typically trained via supervised fine-tuning (SFT). However, SFT essentially performs behavior cloning from instance-wise labels and thus fails to adequately capture relative preference relations among samples, which limits the model’s ability to shape decision boundaries and calibrate predictive confidence. 研究背景： 文字分類模型通常透過監督微調訓練，本質上是對逐樣本標籤進行行為複製，無法充分捕捉樣本間的相對偏好關係。

Technical Approach: In this paper, we propose ClaHF, a human feedback-inspired reinforcement learning (RL) framework for text classification that integrates preference modeling and RL optimization into the classification pipeline without requiring additional human annotations. Unlike prior work that relies solely on instance-wise supervision, ClaHF constructs multiple candidate predictions together with their relative ranking relations, and jointly models the Top-1 preference and the ordering among non-optimal candidates within a reward model (RM). This design con 技術方法： 本文提出 ClaHF，將偏好建模與強化學習最佳化整合至分類流程，無需額外人工標註即可利用偏好關係改善決策邊界與預測信心校準。

Key Takeaway: The data and code are available at https://anonymous.4open.science/r/ClaHF. 核心發現： ClaHF 透過 RL 與偏好建模提升文字分類器的邊界塑造能力與信心校準品質。

DyGRO-VLA: Cross-Task Scaling of Vision-Language-Action Models via Dynamic Grouped Residual Optimization

Authors: Sixu Lin, Yunpeng Qing, Litao Liu et al. | Submitted: 2026-05-17 | arXiv: 2605.17486 Categories: cs.RO, cs.LG

Research Background: Recent progress in Reinforcement Learning (RL) provides a principled approach to optimizing Vision-Language-Action (VLA) models, facilitating a shift from trajectory imitation to active learning in the task environment. Despite improvements in control precision, most RL optimizers remain task-specific, which reduces VLA models from generalist controllers to policies that overfit to a narrow set of tasks. 研究背景： 強化學習為 VLA 模型最佳化提供了從軌跡模仿轉向主動學習的途徑，但現有 RL 最佳化器多為任務特定，導致 VLA 過度擬合狹窄任務集。

Technical Approach: In this study, we conduct an in-depth analysis of this phenomenon and highlight the importance of cross-task feature representations for improving the generalizability of VLA models. Motivated by this finding, we introduce DyGRO-VLA, a two-stage optimization framework that 1) effectively captures cross-task latent representations based on information-theoretic principles, and 2) dynamically refines policy optimization via a mixture-of-RL-residuals. DyGRO-VLA enables the RL optimizer to exploit task-relevant latent information while strategicall 技術方法： 本文深入分析跨任務泛化失敗現象，提出 DyGRO-VLA，透過動態分組殘差最佳化跨任務共享特徵表示，在保持跨任務泛化能力的同時提升控制精度。

Key Takeaway: We evaluate our approach on LIBERO, RoboTwin2 benchmarks, and further validate it on real world, demonstrating consistent improvements over strong baselines under multi-task training and distribution shift. 核心發現： DyGRO-VLA 在多任務設定下兼顧 VLA 的控制精度與跨任務泛化能力。

AffordVLA: Injecting Affordance Representations into Vision-Language-Action Models via Implicit Feature Alignment

Authors: Weijie Kong, Zhian Su, Wei Yu et al. | Submitted: 2026-05-17 | arXiv: 2605.17517 Categories: cs.RO

Research Background: Recent advances in Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation. However, the visual representations of most VLA models are often dominated by global object appearance and struggle to focus on task-relevant functional interaction regions, which limits their robustness in unstructured environments. 研究背景： VLA 模型的視覺表示常由全局物件外觀主導，難以聚焦於任務相關的功能互動區域，限制了在非結構化環境中的魯棒性。

Technical Approach: Existing affordance-based methods typically rely on explicit mask injection or external perception modules, requiring additional annotations while introducing cascading perception errors and inference overhead. To address these limitations, we propose AffordVLA, an affordance-enhanced VLA framework that internalizes manipulation-centric affordance perception into VLA visual representations through implicit representation alignment. Specifically, we construct a zero-shot affordance teacher to extract task-conditioned affordance visual representa 技術方法： 本文提出 AffordVLA，透過隱式特徵對齊將可操作性表示注入 VLA 模型，無需額外標註或外部感知模組，讓視覺特徵在訓練中自然關注功能互動區域。

Key Takeaway: Ablation analyses show that AffordVLA effectively reshapes VLA visual representations while preserving inference efficiency, leading to improved manipulation success rates and training efficiency. 核心發現： AffordVLA 在雜亂場景中的操作魯棒性顯著提升，且不增加推理開銷。

Visual Sculpting: Visually-Aligned Planning Representations for Long-Horizon Robot Clay Sculpting

Authors: Peter Schaldenbrand, Jean Oh | Submitted: 2026-05-17 | arXiv: 2605.17556 Categories: cs.RO, cs.AI

Research Background: Clay sculpting is a nuanced, artistic task involving dexterous manipulation with long-horizon planning to achieve high-level goals. As a robotics problem, we formulate clay sculpting as a shape-to-shape matching challenge. 研究背景： 黏土塑形是涉及靈巧操作與長時域規劃的精細藝術任務，以機器人執行時需同時處理形狀匹配與可變形物體動態。

Technical Approach: Prior deformable object manipulation work either requires retraining a policy per goal or relies on dynamics models which represent state as sparse point clouds which do not capture important clay features, such as textures, well. We present a method for modeling the dynamics of deformable materials and planning for robotic sculpting in a representation that is visually-aligned, capturing lighting and texture features. With three different deformable materials and various end-effectors, we demonstrate that our dynamics model is comparable in pe 技術方法： 本文將黏土塑形表述為形狀對形狀匹配問題，提出視覺對齊規劃表示，在視覺上直觀的潛在空間中建模可變形材料動態，使規劃器能推理高層次目標並無需逐目標重新訓練。

Key Takeaway: Lastly, we show the benefits of planning in a visually-aligned representation, but also provide analysis providing evidence as to why this representation is challenging to plan in compared to 3D representations. 核心發現： 視覺對齊規劃表示讓機器人能在無需重新訓練的情況下泛化至新塑形目標。

From a Single Demonstration to a General Policy for Contact-Rich Manipulation

Authors: Xing Li, Oliver Brock | Submitted: 2026-05-17 | arXiv: 2605.17601 Categories: cs.RO

Research Background: We present a Learning from Demonstration (LfD) framework that achieves one-shot generalization in multi-stage, contact-rich manipulation tasks. Central to our approach is the utilization of environmental constraints as the inductive bias. 研究背景： 學習示範框架（LfD）在多階段、接觸豐富的操作任務中實現單次示範泛化是重大挑戰。

Technical Approach: By representing a demonstration as a sequence of behaviors that exploit environmental constraints, the robot separates task-general structure — the constraint types and their transitions — from instance-specific details such as exact demonstration trajectories, poses, and local geometries. Our four-stage pipeline builds a complete policy on this representation: the robot first abstracts a single demonstration into environmental-constraint primitives, then disambiguates them through self-guided exploration, next assimilates targeted human corr 技術方法： 本文利用環境約束作為歸納偏置，將示範表示為利用環境約束的行為序列，分離任務通用結構（約束類型與轉換）與實例特定細節，透過四階段流程從單次示範建構完整策略。

Key Takeaway: These extensive experimental results establish environmental constraints as fundamental building blocks for efficient generalization in learning from demonstration. 核心發現： 以環境約束為核心的 LfD 框架實現了接觸豐富操作任務的單次示範泛化。

Mono-Hydra++: Real-Time Monocular Scene Graph Construction with Multi-Task Learning for 3D Indoor Mapping

Authors: U. V. B. L. Udugama, George Vosselman, Francesco Nex | Submitted: 2026-05-17 | arXiv: 2605.17661 Categories: cs.RO, cs.CV

Research Background: Autonomous agile robots need more than metric geometry: they must understand objects, rooms, places, and spatial relations for search, inspection, exploration, and human robot interaction. Conventional metric maps support localization and collision avoidance, but do not provide this semantic and relational structure. 研究背景： 自主敏捷機器人不僅需要度量幾何，還需理解物件、房間與空間關係，以支援搜索、檢查與人機互動。傳統度量地圖不提供此語義結構。

Technical Approach: 3D scene graphs address this gap by connecting geometry with object level and room level understanding. Building such representations on agile platforms remains difficult because aerial and lightweight robots operate under strict payload, power, and compute limits, making RGB-D cameras and LiDAR sensors impractical for many onboard settings. We present Mono-Hydra++, a real time monocular RGB plus IMU pipeline for indoor metric semantic mapping and hierarchical 3D scene graph construction. 技術方法： 本文提出 Mono-Hydra++，利用多任務學習從單目 RGB 影像即時建構 3D 場景圖，同時學習深度估計、物件偵測與語義分割，專為計算受限的敏捷機器人平台設計。

Key Takeaway: These results show that Mono-Hydra++ can provide real time metric semantic mapping and scene graph construction for resource constrained robotic platforms without relying on active depth sensors. 核心發現： Mono-Hydra++ 在單目相機限制下實現室內環境的即時語義場景圖建構。

PRIME: Physically-consistent Robotic Inertial and Motion Estimation for Legged and Humanoid Robots

Authors: Jiarong Kang, Kunzhao Ren, Tao Pang et al. | Submitted: 2026-05-17 | arXiv: 2605.17681 Categories: cs.RO

Research Background: Humanoid and legged robots interact with the environment through intermittent contacts, making accurate motion estimation fundamentally dependent on reasoning about contact dynamics. However, standard sensing pipelines-whether based on onboard proprioception with Extended Kalman Filters (EKFs) or external motion capture systems-recover only kinematics, while contact forces, contact timing, and inertial parameters remain unobserved. 研究背景： 足式與人形機器人透過間歇性接觸與環境互動，使精確運動估計高度依賴接觸動態推理。標準感測管線僅恢復運動學，接觸力與慣性參數仍無法觀測。

Technical Approach: As a result, purely kinematic reconstructions often violate rigid-body dynamics, particularly during contact-rich motions. To enable accurate motion estimation from onboard kinematics in real-world deployment, we propose PRIME (Physically-consistent Robotic Inertial and Motion Estimation), a Maximum A Posteriori (MAP) formulation that refines measured kinematics and actuator commands into a dynamically consistent trajectory while jointly estimating frictional contact forces and physically consistent inertial parameters. Our approach incorporate 技術方法： 本文提出 PRIME，在因子圖框架中聯合估計運動、接觸力、接觸時序與慣性參數，確保重建結果符合剛體動力學，避免純運動學重建的物理不一致性。

Key Takeaway: Beyond improving state estimation and feedback control with calibrated inertial parameters, PRIME produces force- and contact-annotated motion reconstructions from real robots in deployment, which can be used to provide high-quality data for downstream learning applications, including large-scale be 核心發現： PRIME 實現了足式機器人在接觸豐富運動中物理一致的運動與慣性估計。

Authors: Xiangyue Wang, Hanxuan Chen, Songsheng Cheng et al. | Submitted: 2026-05-18 | arXiv: 2605.17776 Categories: cs.RO

Research Background: Recent aerial vision-language navigation (VLN) datasets have grown rapidly, but they primarily address goal-oriented navigation to static destinations, leaving UAV visual tracking — continuously following a moving target while maintaining visibility — largely without dedicated training data. We introduce CosFlyTrack, a large-scale multi-modal dataset and scalable generation pipeline for UAV visual tracking in urban environments. 研究背景： 近期無人機視覺語言導航資料集快速增長，但主要針對靜態目標導航，缺乏針對持續追蹤移動目標的無人機視覺追蹤專用訓練資料。

Technical Approach: The dataset provides approximately 12,000 expert and perturbed UAV trajectories generated from 6,000 pedestrian paths, comprising 2.4 million timesteps (approximately 334 hours) with seven aligned data channels: RGB, metric depth, semantic segmentation, six-degree-of-freedom drone pose, target state with visibility flag, bilingual (Chinese-English) instructions, and trajectory-pair metadata. To generate high-quality expert trajectories, we develop MuCO, a multi-constraint optimizer that plans directly in continuous three-dimensional space with 技術方法： 本文提出 CosFlyTrack，透過多約束軌跡最佳化從行人路徑生成約 12,000 條專家與擾動無人機軌跡，共 240 萬時間步，提供城市環境大規模多模態無人機視覺追蹤資料集。

Key Takeaway: The dataset is publicly available at https://huggingface.co/datasets/AutelRobotics/CosFly; evaluation scripts and pre-trained checkpoints are hosted at https://huggingface.co/AutelRobotics/CosFly-Track. 核心發現： CosFlyTrack 填補了無人機視覺追蹤訓練資料的空白，提供大規模可擴展的生成管線。

A Dexterous and Compliant Gripper With Soft Hydraulic Actuation for Microgravity Manipulation

Authors: William Su, Jordan Kam, Yixiao Wang et al. | Submitted: 2026-05-18 | arXiv: 2605.17851 Categories: cs.RO

Research Background: Astrobee’s existing one-degree-of-freedom (DOF) underactuated compliant claw gripper enables perching on the International Space Station (ISS), but provides limited capability for continuous dexterous manipulation. More complex microgravity tasks require an end-effector that can maintain stable contact while limiting disturbance to the free-flying base, since contact forces directly couple into base motion. 研究背景： Astrobee 自由飛行機器人現有的單自由度夾爪僅支援棲息，無法執行連續靈巧操作。微重力環境中更複雜的任務需要能在限制接觸力的同時維持穩定接觸的末端執行器。

Technical Approach: This article presents the integration of DexCoHand, a dexterous and compliant two-finger, 6-DOF gripper, with the Astrobee free-flying robot for microgravity manipulation. The system is evaluated in MuJoCo using Astrobee’s standard handrail perching sequence, including approach, perching, and subsequent pan and tilt motions. Compared with Astrobee’s existing gripper, DexCoHand preserves the commanded pan and tilt motions while reducing unintended cross-axis base motion. 技術方法： 本文將 DexCoHand 靈巧順從兩指六自由度夾爪整合至 Astrobee 機器人，採用軟液壓驅動設計，在微重力操作中限制對自由飛行底座的擾動，並在國際太空站環境中進行評估。

Key Takeaway: Hardware experiments on Earth further demonstrate DexCoHand’s dexterous manipulation capabilities and its potential for more adaptable intelligent manipulation tasks. 核心發現： DexCoHand 在微重力環境中實現靈巧操作，同時有效限制對自由飛行底座的接觸力擾動。

TacSE3: Equivariant SE(3) Motion Estimation from Low-Texture Visuotactile Images for In-Gripper Tracking and Compensation

Authors: Zhongyuan Liao, Junzhe Wang, Qingyang Liu et al. | Submitted: 2026-05-18 | arXiv: 2605.17929 Categories: cs.RO

Research Background: Robotic in-hand manipulation requires reliable object-motion tracking under frequent visual occlusion, yet low-texture visuotactile images provide few stable correspondences for conventional image- or geometry-matching methods. This paper presents TacSE3, a tactile motion-estimation pipeline that converts low-texture visuotactile observations into a decoupled three-dimensional force field and estimates incremental rigid-body motion on SE(3). 研究背景： 機器人手中操作需要在頻繁視覺遮擋下可靠追蹤物件運動，但低紋理視觸覺影像為傳統方法提供的穩定對應點極少。

Technical Approach: This paper presents TacSE3, a tactile motion-estimation pipeline that converts low-texture visuotactile observations into a decoupled three-dimensional force field and estimates incremental rigid-body motion on SE(3). The method derives planar translation from contact-centroid motion and estimates rotation primarily from shear-related tactile responses, yielding a physically interpretable signal for in-gripper tracking and compensation. Experiments with paired DM-Tac fingertip sensors show that dual-sensor sensing reduces translation-rotation a 技術方法： 本文提出 TacSE3，將低紋理視觸覺觀測轉換為解耦三維力場，並在 SE(3) 上估計增量剛體運動，從接觸質心運動推導平面位移，從剪切觸覺響應估計旋轉，實現物理一致的運動估計。

Key Takeaway: Experiments with paired DM-Tac fingertip sensors show that dual-sensor sensing reduces translation-rotation ambiguity, supports rotation tracking across axes and object geometries, and provides a lightweight compensation signal that improves disturbance tolerance in downstream manipulation tasks wit 核心發現： TacSE3 在無穩定視覺對應點的情況下，從觸覺感測實現精確的六自由度物件運動追蹤。

StableVLA: Towards Robust Vision-Language-Action Models without Extra Data

Authors: Yiyang Fu, Chubin Zhang, Shukai Gong et al. | Submitted: 2026-05-18 | arXiv: 2605.18287 Categories: cs.CV, cs.RO

Research Background: It is infeasible to encompass all possible disturbances within the training dataset. This raises a critical question regarding the robustness of Vision-Language-Action (VLA) models when encountering unseen real-world visual disturbances, particularly under imperfect visual conditions. 研究背景： VLA 模型在遇到訓練資料中未出現的視覺擾動時，性能大幅下降，這對真實世界部署構成嚴重挑戰。

Technical Approach: In this work, we conduct a systematic study based on recent state-of-the-art VLA models and reveal a significant performance drop when visual disturbances absent from the training data are introduced. To mitigate this issue, we propose a lightweight adapter module grounded in information theory, termed the Information Bottleneck Adapter (IB-Adapter), which selectively filters potential noise from visual inputs. Without requiring any extra data or augmentation strategies, IB-Adapter consistently improves over the baseline by an average of 30%, w 技術方法： 本文系統性研究最新 VLA 模型的視覺魯棒性，並提出基於資訊理論的輕量適配器模組（InfoAdapter），在不需要額外擾動訓練資料的情況下，透過最小化冗餘視覺資訊來提升魯棒性。

Key Takeaway: With negligible parameter overhead (<10M), our approach maintains accuracy on long-horizon tasks and surpasses OpenPi under both synthetic and physical visual corruptions. 核心發現： InfoAdapter 在無需額外資料的情況下顯著提升 VLA 模型對未見視覺擾動的魯棒性。

Towards Ubiquitous Mapping and Localization for Dynamic Indoor Environments

Authors: Halim Djerroud, Nico Steyn, Olivier Rabreau et al. | Submitted: 2026-05-18 | arXiv: 2605.18385 Categories: cs.RO, cs.AI

Research Background: We present UbiSLAM, an innovative solution for real-time mapping and localization in dynamic indoor environments. By deploying a network of fixed RGB-D cameras strategically throughout the workspace, UbiSLAM addresses limitations commonly encountered in traditional SLAM systems, such as sensitivity to environmental changes and reliance on mobile unit sensors. 研究背景： 傳統 SLAM 系統在動態室內環境中常受環境變化與感測器依賴性限制。分佈式固定相機網路是解決移動機器人局限性的潛在方案。

Technical Approach: This fixed-sensor approach enables real-time, comprehensive mapping, enhancing the localization accuracy and responsiveness of robots operating within the environment. The centralized map generated by UbiSLAM is continuously updated, providing robots with an accurate global view, which improves navigation, minimizes collisions, and facilitates smoother human-robot interactions in shared spaces. Beyond its advantages, UbiSLAM faces challenges, particularly in ensuring complete spatial coverage and managing blind spots, which necessitate da 技術方法： 本文提出 UbiSLAM，透過在工作空間中策略性部署固定 RGB-D 相機網路，實現動態室內環境的即時定位與建圖，集中式地圖持續更新以反映環境變化，提升機器人定位精度。

Key Takeaway: The proposed model reduces the computational load on individual robotic units, allowing less complex robotic platforms to operate effectively while enhancing the robustness of the overall system. 核心發現： UbiSLAM 透過固定相機網路克服傳統移動 SLAM 在動態環境中的局限性。

Qumus: Realization of An Embodied AI Quantum Material Experimentalist

Authors: Lihan Shi, Zhaoyi Joy Zheng, Xinzhe Juan et al. | Submitted: 2026-05-18 | arXiv: 2605.18407 Categories: cond-mat.mes-hall, cond-mat.mtrl-sci, cs.AI, cs.RO

Research Background: While modern Large Language Models (LLMs) and agentic artificial intelligence (AI) have demonstrated transformative capabilities in digital domains, the realization of embodied AI capable of real-world scientific discovery remains a difficult frontier. The advancements are hindered by the inherent complexity of integrating high-level reasoning, multimodal information processing and real-time physical execution. 研究背景： LLM 與智能體 AI 在數位領域展現變革性能力，但能進行真實世界科學發現的具身 AI 仍是困難的前沿問題。

Technical Approach: Here we introduce Qumus, the first AI quantum materials experimentalist. Physically embodied within a robotic mini-laboratory, Qumus is an intelligent, multimodal, and multi-agent system designed for the creation and nano-processing of atomically thin two-dimensional (2D) materials and stacked van der Waals (vdW) structures. Qumus autonomously navigates the full scientific cycle, from hypothesis generation and protocol planning to multi-step experimental execution, result analysis and reporting, acting as an experimentalist. 技術方法： 本文提出 Qumus，首個 AI 量子材料實驗員，具身於機器人迷你實驗室中，整合高層次推理、多模態資訊處理與即時物理執行，實現多智能體協作的量子材料科學實驗自動化。

Key Takeaway: Our results establish a generalizable framework for self-improving embodied AI systems that learn directly from the quantum world, opening a pathway toward accelerated discovery in quantum materials, electronics and beyond. 核心發現： Qumus 展示了具身 AI 在真實世界科學實驗中自主規劃與執行的可行性。

Key-Gram: Extensible World Knowledge for Embodied Manipulation

Authors: Jingjing Fan, Siyuan Li, Botao Ren et al. | Submitted: 2026-05-18 | arXiv: 2605.18556 Categories: cs.RO, cs.AI

Research Background: Embodied control increasingly requires models to follow compositional language instructions while reasoning over dynamic visual states. However, current vision-language-action policies and world-action models often couple linguistic knowledge with visual computation in a shared backbone or conditioning pathway, leading to modality competition and making knowledge extension dependent on backbone updates. 研究背景： 具身控制日益需要模型依照組合式語言指令行動，同時對動態視覺狀態進行推理。現有 VLA 策略常將語言知識與視覺計算耦合，導致模態競爭與知識擴展困難。

Technical Approach: In this paper, we introduce Key-Gram, a conditional-memory framework that separates language-derived world knowledge from visual-state reasoning for embodied control. At its core is a memory module that decomposes an instruction into task-specific key-grams, retrieves static linguistic priors through deterministic hashed lookup, and injects the retrieved entries into selected hidden layers through context-aware gating and lightweight convolutional fusion. This design allows the backbone to devote its main capacity to visual reasoning and action 技術方法： 本文提出 Key-Gram，條件記憶框架，將語言衍生的世界知識與視覺狀態推理分離。核心記憶模組儲存從語言指令提取的可組合知識，獨立於視覺骨幹，實現知識的彈性擴展。

Key Takeaway: These results demonstrate that externalized linguistic memory provides an effective and extensible mechanism for improving compositional grounding, transfer, and real-world manipulation. 核心發現： Key-Gram 透過解耦語言知識與視覺推理，實現具身操作中的可擴展世界知識整合。

When Outcome Looks Right But Discipline Fails: Trace-Based Evaluation Under Hidden Competitor State

Authors: Peiying Zhu, Sidi Chang | Submitted: 2026-05-18 | arXiv: 2605.18580 Categories: cs.AI, cs.LG

Research Background: Outcome-only evaluation can certify economically unsafe agents: a policy can hit a business KPI while violating deployable behavioral discipline. In hotel pricing with hidden competitor state, a learner can achieve plausible revenue per available room while failing to preserve the rate discipline of a rule-based revenue-management competitor. 研究背景： 純結果評估可能認證行為不安全的智能體：策略可在達到業務 KPI 的同時違反可部署的行為規範。

Technical Approach: We introduce discipline stability, a trace-based evaluation paradigm: define the benchmark behavior, restrict observations to the deployment regime, induce trace diagnostics from failure, separate mechanisms with ablations, and test transfer and deployment. Across a two-hotel benchmark and a compact hidden-budget bidding task, reward-only PPO variants miss trace alignment; revealing hidden state reduces label uncertainty; deterministic copy collapses uncertainty; and trace-prior or corrected history policies better preserve price or bid distrib 技術方法： 本文提出紀律穩定性（discipline stability）軌跡評估範式，在隱藏競爭者狀態的酒店定價情境中，透過定義基準行為、軌跡診斷、消融機制與遷移測試，識別通過結果評估但行為不安全的策略。

Key Takeaway: The contribution is an evaluation and benchmark paradigm, not a new optimizer or a universal claim about MARL 核心發現： 僅依賴結果指標會遮蔽策略的行為安全問題，軌跡評估是必要的補充。

Not What You Asked For: Typographic Attacks in Household Robot Manipulation

Authors: Ali Iranmanesh, Peng Liu | Submitted: 2026-05-18 | arXiv: 2605.18593 Categories: cs.CR, cs.AI, cs.RO

Research Background: Open-vocabulary embodied AI agents increasingly rely on vision-language models such as CLIP for object perception and task grounding. However, the shared embedding space that enables this flexibility introduces a structural vulnerability to typographic attacks, where printed text in a physical scene semantically overrides visual judgment. 研究背景： 開放詞彙具身 AI 智能體日益依賴 CLIP 等視覺語言模型進行物件感知，但共享嵌入空間引入了印刷攻擊（typographic attack）漏洞：場景中的文字可語義覆蓋視覺判斷。

Technical Approach: While prior work has quantified this threat in static 2D benchmarks and 3D navigation tasks, its impact on the full Sense-Plan-Act pipeline of household robot manipulation remains unexplored. This work evaluates typographic attacks in a Habitat-based simulation using the HomeRobot benchmark. We introduce a decoupled perception architecture that exposes a frozen CLIP encoder to adversarial stickers while maintaining geometric grounding via DETIC. 技術方法： 本文在 Habitat 模擬器中評估印刷攻擊對家庭機器人操作完整感知-規劃-動作管線的影響，系統性研究攻擊在不同環境配置與任務類型下的效果與遷移性。

Key Takeaway: These results establish typographic misclassification as a real, measurable, and physically consequential threat to the safety of modular manipulation pipelines that prior typographic attack research has left unexamined. 核心發現： 印刷攻擊對依賴 CLIP 的家庭機器人操作系統構成實質性安全威脅。

Dexora: Open-source VLA for High-DoF Bimanual Dexterity

Authors: Zongzheng Zhang, Jingrui Pang, Zhuo Yang et al. | Submitted: 2026-05-18 | arXiv: 2605.18722 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models have recently become a central direction in embodied AI, but current systems are restricted to either dual-gripper control or single-arm dexterous hand manipulation. While low-dimensional gripper control can often be handled with simpler methods, high-dimensional dexterous hand control benefits greatly from full end-to-end VLA learning. 研究背景： VLA 模型已成為具身 AI 的核心方向，但現有系統僅支援雙夾爪控制或單臂靈巧手操作，高自由度雙臂靈巧手系統仍缺乏開放原始碼方案。

Technical Approach: In this work, we introduce Dexora, the first open-source VLA system that natively targets dual-arm, dual-hand high-DoF manipulation. We design a hybrid teleoperation pipeline that decouples gross arm kinematics (captured with a custom exoskeleton backpack) from fine finger motion (markerless hand tracking via Apple Vision Pro), and that drives both a physical dual-arm dual-hand platform and an identical MuJoCo digital twin. Using that interface, we assemble a large training corpus: an embodiment-matched synthetic corpus (100K simulated trajecto 技術方法： 本文提出 Dexora，首個原生針對雙臂雙手高自由度操作的開源 VLA 系統，設計混合遠程操作管線解耦粗略手臂運動學與精細手部控制，並進行完整的端到端 VLA 訓練。

Key Takeaway: Ablations confirm the importance of real data and the discriminator for dexterity. 核心發現： Dexora 為雙臂靈巧手高自由度操作提供首個開源 VLA 解決方案。

DexHoldem: Playing Texas Hold’em with Dexterous Embodied System

Authors: Feng Chen, Tianzhe Chu, Li Sun et al. | Submitted: 2026-05-18 | arXiv: 2605.18727 Categories: cs.RO, cs.AI

Research Background: Evaluating embodied systems on real dexterous hardware requires more than isolated primitive skills: an agent must perceive a changing tabletop scene, choose a context-appropriate action, execute it with a dexterous hand, and leave the scene usable for later decisions. We introduce DexHoldem, a real-world system-level benchmark built around Texas Hold’em dexterous manipulation with a ShadowHand. 研究背景： 評估具身系統在真實靈巧硬體上的能力需要超越孤立基元技能，要求智能體感知變化場景、選擇動作並以靈巧手執行，同時保持場景可供後續決策使用。

Technical Approach: DexHoldem provides 1,470 teleoperated demonstrations across 14 Texas Hold’em manipulation primitives, a standardized physical policy benchmark, and an agentic perception benchmark that tests whether agents can recover the structured game state needed for embodied decision making. On primitive execution, $π_{0.5}$ obtains the highest task completion rate ( $61.2%$ ), while $π_{0.5}$ and $π_{0}$ tie on scene-preserving success rate ( $47.5%$ ). On agentic perception, Opus 4.7 obtains the best strict problem-level accuracy ( $34.3%$ ), while GPT 5.5 ob 技術方法： 本文提出 DexHoldem，以德州撲克靈巧操作為基礎的真實世界系統級基準，提供 1,470 個遠程操作示範（14 種操作基元），以及標準化的物理策略基準與智能體感知基準。

Key Takeaway: Project page: https://dexholdem.github.io/Dexholdem/. 核心發現： DexHoldem 提供了評估靈巧具身系統感知、決策與執行整合能力的系統級基準。

Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Induction

Authors: Nga Teng Chan, Yi Zhang, Yechi Liu et al. | Submitted: 2026-05-18 | arXiv: 2605.18729 Categories: cs.RO, cs.CV

Research Background: The ability to navigate and interact with complex environments is central to real-world embodied agents, yet navigation in unseen environments remains challenging due to “experiential amnesia,” where existing trajectory-driven or reactive policies fail to synthesize generalizable strategies from past interactions. We propose Robo-Cortex, a self-evolving framework that enables robots to autonomously induce navigation heuristics and refine cognitiv 研究背景： 在未見環境中導航的具身智能體面臨「經驗遺忘」問題：現有軌跡驅動或反應式策略無法從過去互動中綜合可泛化的策略。

Technical Approach: By abstracting success patterns and failure pitfalls into natural-language heuristics, Robo-Cortex enables a transition from passive execution to active strategy evolution. Our core innovation is an Autonomous Knowledge Induction (AKI) mechanism that distills multimodal trajectories into a structured Navigation Heuristic Library for knowledge generalization. The architecture further incorporates a Dual-Grain Cognitive Memory system, comprising a Short-term Reflective Memory (SRM) for real-time local progress analysis, and a Long-term Principle 技術方法： 本文提出 Robo-Cortex，透過雙粒度認知記憶（細粒度情節記憶與粗粒度啟發式記憶）與自主知識歸納，讓機器人從成功模式與失敗陷阱中提取自然語言啟發式，並透過持續反思-適應循環自我演化。

Key Takeaway: Preliminary real-world robotic experiments further support the effectiveness of Robo-Cortex in physical settings. 核心發現： Robo-Cortex 的自我演化框架讓機器人在未見環境中持續從經驗中歸納導航啟發式。

Neural Operators for Design-Space Surrogate Modeling of Tendon-Actuated Continuum Robots

Authors: Branden Frieden, James M. Ferguson, Alan Kuntz et al. | Submitted: 2026-05-18 | arXiv: 2605.19104 Categories: cs.RO, cs.AI

Research Background: Continuum robots enable dexterous manipulation in constrained environments, but require accurate and efficient models for real-time manipulation and control. Traditional physics-based models can be computationally expensive and may suffer from inaccuracies due to unmodeled effects, while current learning-based methods often generalize poorly beyond the specific robot on which they are trained. 研究背景： 腱驅動連續型機器人能在受限環境中實現靈巧操作，但需要精確高效的模型以供即時控制。傳統物理模型計算成本高且可能不精確，現有學習方法泛化能力差。

Technical Approach: We present a formulation of surrogate modeling for tendon-driven continuum robots as an operator learning problem that maps robot design parameters and tendon actuation inputs to resulting configurations. This formulation enables a single trained model to generalize across a large class of robot designs. We develop four novel neural operator architectures—two based on Deep Operator Networks (DeepONets) and two based on Fourier Neural Operators (FNOs)—and train them on simulation data to predict robot configurations. 技術方法： 本文將腱驅動連續機器人的代理建模表述為算子學習問題，將機器人設計參數與腱驅動輸入映射至結果構型，學習跨設計參數的泛化能力而非僅針對特定機器人。

Key Takeaway: Our results demonstrate that operator learning provides an effective and generalizable surrogate for continuum robot mechanics in the design space, enabling fast modeling for control, planning, and design optimization in surgical and industrial applications. 核心發現： 神經算子代理模型實現了腱驅動連續機器人跨設計空間的精確即時建模。

COBALT: Crowdsourcing Robot Learning via Cloud-Based Teleoperation with Smartphones

Authors: Ayush Agarwal, Ansh Gandhi, Jeremy A. Collins et al. | Submitted: 2026-05-18 | arXiv: 2605.19138 Categories: cs.RO, cs.AI, cs.LG

Research Background: The scarcity of large-scale, high-quality demonstration data remains a bottleneck in scaling imitation learning for robotic manipulation. We present COBALT, a teleoperation platform designed to democratize robot learning at scale both in simulation and in the real world. 研究背景： 大規模高品質示範資料稀缺仍是擴展機器人操作模仿學習的瓶頸。眾包遠程操作平台可大幅降低資料收集成本。

Technical Approach: By leveraging vectorized environments, our scalable, load-balanced infrastructure supports concurrent teleoperation by multiple users on a single GPU, yielding a significant reduction in teleoperation cost. Operators can connect from nearly anywhere on Earth using commonly available devices, including single or dual smartphones, VR headsets, 3D mice, and keyboards. An inmemory data cache and efficient video streaming keep control and rendering synchronous, sustaining dozens of concurrent users at 20 Hz with sub-100 ms end-to-end latency for up 技術方法： 本文提出 COBALT，利用向量化環境支援多用戶並發遠程操作的雲端平台，操作員可從世界各地使用智慧型手機連接，在單一 GPU 上顯著降低遠程操作成本並同時在模擬與真實環境中收集資料。

Key Takeaway: Please visit https://cobalt-teleop.github.io/ for more details. 核心發現： COBALT 讓機器人學習的示範資料收集民主化，大幅降低規模化遠程操作的成本。

Bilateral Teleoperation with Compliant 6-DOF Pose-and-Force Sensing

Authors: Yue Feng, Weicheng Huang, I-Ming Chen | Submitted: 2026-05-19 | arXiv: 2605.19255 Categories: cs.RO

Research Background: Existing bilateral teleoperation platforms still rely on costly rigid six-axis force/torque sensors, tightly coupled leader-follower hardware, and kilohertz control loops. We present a Cartesian bilateral framework built on the hardware-agnostic WinGs Operating Studio (WOS) middleware, in which a low-cost compliant 6-DOF pose-and-force sensing end-effector, Delta6, is mounted on both sides so that each manipulator behaves as an end-effector 6-DOF 研究背景： 現有雙向遠程操作平台仍依賴昂貴的剛性六軸力/扭矩感測器與緊耦合的主從硬體。低成本六自由度姿態力感測方案是實現廣泛部署的關鍵。

Technical Approach: The leader runs a damping-only admittance loop with a 6-D biquad notch filter; the follower realizes a stiffness-damping impedance through a position-based outer loop with a PID wrench-to-pose mapping. Three time scales (hardware I/O, mid-rate impedance/admittance, low-rate teleoperation messages) are explicitly decoupled, enabling the same application to drive heterogeneous arms. On a Lite6/FR3 testbed at 150 Hz, the system tracks stably under delays up to $120 \pm 40$ ms and 1% packet loss, matches the prescribed virtual stiffness in contact, a 技術方法： 本文提出基於 WOS 中介軟體的笛卡爾雙向框架，在主從兩側安裝低成本順從六自由度姿態力感測末端執行器 Delta6，實現六自由度串聯彈性驅動器行為，並採用雙二階陷波濾波器消除震盪。

Key Takeaway: On a Lite6/FR3 testbed at 150 Hz, the system tracks stably under delays up to $120 \pm 40$ ms and 1% packet loss, matches the prescribed virtual stiffness in contact, and shows a favorable cumulative energy signature in passivity-style tests. 核心發現： 低成本順從六自由度感測框架使雙向遠程操作更易於普及部署。

PRISM-SLAM: Probabilistic Ray-Grounded Inference for Scale-aware Metric SLAM

Authors: Eunsoo Im | Submitted: 2026-05-19 | arXiv: 2605.19257 Categories: cs.RO

Research Background: Monocular SLAM historically suffers from scale ambiguity and tracking failure in dynamic environments. While recent vision foundation models (VFMs) provide remarkable zero-shot depth priors, naively integrating these deterministic predictions ignores predictive uncertainty and frame-to-frame scale inconsistencies. 研究背景： 單目 SLAM 長期面臨尺度模糊與動態環境追蹤失敗問題。視覺基礎模型提供了強大的零樣本深度先驗，但直接整合忽略了預測不確定性與帧間尺度不一致性。

Technical Approach: We propose PRISM-SLAM, a real-time framework that rigorously integrates VFM priors into a structured Bayesian factor graph to achieve scale-aware, metric-consistent localization and mapping. Specifically, we introduce a Plücker Ray-Distance Factor to anchor monocular observations in absolute space within a globally consistent metric coordinate system, mathematically resolving scale drift by making the metric scale Fisher-identifiable. To handle environmental dynamics, we derive an epistemic uncertainty proxy from temporal depth consistency and 技術方法： 本文提出 PRISM-SLAM，透過結構化貝葉斯因子圖嚴格整合視覺基礎模型深度先驗，引入普呂克射線距離因子錨定單目觀測，實現尺度感知的度量一致定位與建圖。

Key Takeaway: Project page: https://prismslam-cmd.github.io/prismslam_pr/ 核心發現： PRISM-SLAM 在動態環境中實現尺度一致的即時單目度量 SLAM。

Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVR

Authors: Chongyu Fan, Gaowen Liu, Mingyi Hong et al. | Submitted: 2026-05-19 | arXiv: 2605.19282 Categories: cs.LG

Research Background: Muon is a matrix-aware optimizer that leverages Newton-Schulz (NS) iterations to enforce spectral gradient orthogonalization by driving all singular values of the momentum matrix toward 1. While this uniform spectral whitening enhances exploration and outperforms AdamW in LLM pretraining, we show it could lead to fundamental limitations beyond pretraining in two regimes: (i) cross-modality vision-language-action (VLA) training, where inherently l 研究背景： Muon 最佳化器在 LLM 預訓練中優於 AdamW，但均勻頻譜白化在預訓練之後存在根本限制：在 VLA 跨模態訓練中放大低秩動作模組梯度的雜訊方向。

Technical Approach: To address these challenges, we propose Pion, a drop-in replacement for Muon that preserves its computational efficiency while replacing uniform spectral whitening with a two-stage Promotion+Suppression mechanism, which we call the high-pass NS iteration. This design induces a sharp spectral high-pass effect, anchoring dominant singular values at 1 while suppressing noisy tail components toward 0, with controllable filter strength. To preserve pretrained per-head heterogeneity, Pion also supports a per-head mode that applies updates independent 技術方法： 本文分析 Muon 在 VLA 訓練與帶可驗證獎勵的強化學習（RLVR）中的頻譜失敗模式，並提出高通修正方法，保留低頻動作訊號同時抑制高頻雜訊，改善收斂與穩定性。

Key Takeaway: In RLVR post-training on Qwen3-1.7B/4B with GRPO and GMPO, Pion also outperforms AdamW on MATH and GSM8K while Muon collapses to zero. 核心發現： 高通頻譜修正讓 Muon 最佳化器適用於 VLA 訓練與 RLVR 場景。

Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperation

Authors: Caolu Xu, Zhiyong Chen, Meixia Tao et al. | Submitted: 2026-05-19 | arXiv: 2605.19293 Categories: cs.IT, cs.LG, cs.RO

Research Background: Wireless extended reality (XR) teleoperation provides embodied interaction capability for collecting humanoid robot demonstrations, but the large-scale adoption is restricted by the overhead of high-frequency motion transmission. This paper develops a system framework that integrates sampling, transmission, interpolation, and reconstruction and formulates a communication-rate optimization that aims to minimize the communication energy while maint 研究背景： 無線 XR 遠程操作為收集人形機器人示範提供了具身互動能力，但高頻動作傳輸的巨大開銷限制了大規模採用。

Technical Approach: Since acquiring real-time feedback from physical robots is limited by hardware costs, it is necessary to solve the problem through simulator interaction with offline real-domain data correction. To guide sim-to-real adaptation, we provide a PAC-Bayes generalization characterization that reveals the effects of latent density-ratio estimation, finite-sample deviation, and encoder bias. Building on this analysis, we propose a proximal policy optimization (PPO) method with density-ratio weighting and trust-region regularization. 技術方法： 本文開發整合取樣、傳輸、插值與重建的系統框架，以通訊速率最佳化最小化通訊能耗，同時維持機器人運動軌跡重建精度，透過維度級取樣率控制實現自適應壓縮。

Key Takeaway: We further analyze the effectiveness of the proposed algorithm across various wireless channels and dynamic motion trajectories. 核心發現： 維度級自適應取樣率控制在保持重建精度的前提下大幅降低人形機器人 XR 遠程操作的通訊能耗。

DEFLECT: Delay-Robust Execution via Flow-matching Likelihood-Estimated Counterfactual Tuning for VLA Policies

Authors: Yixiang Zhu, Yonghao Chen, Rui Meng et al. | Submitted: 2026-05-19 | arXiv: 2605.19294 Categories: cs.RO, cs.AI

Research Background: Vision-Language-Action (VLA) policies are typically deployed with asynchronous inference: the robot executes a previously predicted action chunk while the model computes the next one. This creates a prediction-execution misalignment: the chunk is conditioned on the observation taken before inference began, but executes in a physical state that has already drifted forward by several control steps; naive asynchronous rollover collapses from 89% to 研究背景： VLA 策略通常以非同步推理部署：機器人執行先前預測的動作塊時，模型計算下一個。這造成預測執行不對齊，在推理週期覆蓋多個控制步驟時性能急劇下降。

Technical Approach: This creates a prediction-execution misalignment: the chunk is conditioned on the observation taken before inference began, but executes in a physical state that has already drifted forward by several control steps; naive asynchronous rollover collapses from 89% to under 1% on Kinetix as the inference cycle covers up to seven control steps. We introduce DEFLECT, a fully offline post-training refinement that applies as a near drop-in upgrade to existing async-VLA stacks by converting latency itself into a label-free preference signal: counterfac 技術方法： 本文提出 DEFLECT，透過流匹配似然估計反事實微調，在完全離線後訓練中學習以前向漂移物理狀態為條件的動作，無需修改 VLA 架構或增加推理成本即可適應非同步執行。

Key Takeaway: DEFLECT substantially extends the usable delay envelope of async VLA control, with +6.4 success-rate gain in the high-latency regime (5-7 control steps), +4.6 when transferred to a real-scale VLA at the longest delay, and consistent improvements on two real-robot tasks (a bimanual conveyor pick-and- 核心發現： DEFLECT 消除 VLA 非同步推理的預測執行不對齊，在高延遲部署中恢復接近同步的性能。

Authors: Kaijie Yun, Yue Chen | Submitted: 2026-05-19 | arXiv: 2605.19420 Categories: cs.RO

Research Background: Grounding open-ended semantic instructions into physically executable local goals is a fundamental challenge in human-robot interaction. While existing navigation frameworks often regress deterministic waypoints, this rigid formulation collapses spatial uncertainty and frequently targets non-traversable object centers, leading to severe execution failures. 研究背景： 將開放式語義指令對應至物理可執行局部目標是人機互動中的核心挑戰。現有方法回歸確定性路徑點，忽略空間不確定性並常指向不可穿越的物件中心。

Technical Approach: In this work, we focus on the practical setting of in-FOV semantic navigation, where a robot receives concise, interleaved multimodal (text and image) prompts. To bridge the gap between abstract semantic intent and physical reachability, we propose a unified Vision-Language framework that abandons single-point regression in favor of a Dual-Heatmap representation. Our framework predicts a navigation affordance heatmap that captures continuous reachable regions, coupled with a facing heatmap for orientation constraints. 技術方法： 本文聚焦視場內語義導航，提出雙熱圖接地框架，將多模態（文字+圖像）提示映射至可穿越區域的分佈熱圖而非單一路徑點，跨具身泛化至不同機器人形態。

Key Takeaway: By placing targets reliably in executable free space, our framework effectively mitigates the brittleness of point regression, offering a transferable path toward safe cross-embodiment semantic navigation. 核心發現： 雙熱圖接地框架顯著降低因目標不可達而導致的導航執行失敗率。

Neuromorphic Control of a Flapping-Wing Robot on Resource-Constrained Hardware

Authors: Rim El Filali, Chenrui Feng, Chao Gao et al. | Submitted: 2026-05-19 | arXiv: 2605.19430 Categories: cs.RO

Research Background: Flapping-Wing Micro Aerial Vehicles (FWMAVs) provide exceptional maneuverability and aerodynamic efficiency but pose significant challenges for onboard control due to nonlinear dynamics and stringent Size, Weight, and Power (SWaP) constraints, as exemplified by a butterfly-inspired robot less than 30 gram. To this end, we present a hierarchical neuromorphic control framework that enables fully onboard, closed-loop flight on a widely available, re 研究背景： 撲翼微型飛行器提供卓越機動性，但嚴格的尺寸重量功耗限制使機載控制極具挑戰性。

Technical Approach: Specifically, our method deploys two lightweight Spiking Neural Networks (SNNs) onboard: one for state estimation from raw sensory feedback and another for control via modulation of a Central Pattern Generator (CPG) for wing actuation. Trained by imitation learning, the system achieves stable pitch and heading angle tracking during untethered real-world flight. Experimental results further reveal that the SNN-based controller reduces latency by 36% (1059us to 680us) and power by 18% (0.033W to 0.027W) for inference compared to the conventional 技術方法： 本文提出層次化神經形態控制框架，在廣泛可得的 ESP32 微控制器上部署兩個輕量脈衝神經網路（SNN），實現完全機載閉環飛行控制，單位成本約 5 美元，展示蝴蝶型撲翼機器人的穩定飛行。

Key Takeaway: Visual abstract: http://bit.ly/4nI8ECY 核心發現： 層次化 SNN 在極低成本嵌入式硬體上實現撲翼機器人的完整機載閉環控制。

Authors: Cunjun Yu, Zishuo Wang, Anxing Xiao et al. | Submitted: 2026-05-19 | arXiv: 2605.19501 Categories: cs.RO, cs.AI

Research Background: Robot guide dogs offer navigation assistance that greatly expands the independent mobility of the visually impaired, but their effective use requires subtle human-robot coordination that is difficult for users to learn from generic verbal instructions. To tackle this challenge, we present CANINE, an automated coaching system that trains users for interactive navigation with a robot guide dog, through personalized, adaptive verbal feedback. 研究背景： 機器人導盲犬為視障者提供導航協助，但有效使用需要細膩的人機協調，難以從一般口語指導中習得。

Technical Approach: CANINE decomposes a complex coordination task into sub-skills and operates at two levels. At the high level, it decides what to train by tracking the learner’s proficiency across sub-skills using knowledge tracing and prioritizing training on the weakest areas. At the low level, CANINE decides how to train each sub-skill by observing each human practice episode, using foundation models to infer the underlying causes of errors, and generating targeted verbal corrections adaptively. 技術方法： 本文提出 CANINE 自動化訓練系統，將複雜協調任務分解為子技能，在高層追蹤學習進度決定訓練重點，在低層透過即時電腦視覺生成個人化自適應口語反饋，指導使用者學習與機器人導盲犬的互動。

Key Takeaway: Project page: https://cunjunyu.github.io/project/canine/ 核心發現： CANINE 透過個人化自適應訓練顯著加速使用者習得與機器人導盲犬的有效協作。

SafeAlign-VLA: A Negative-Enhanced Safe Alignment Framework for Risk-Aware Autonomous Driving

Authors: Kefei Tian, Yuansheng Lian, Kai Yang et al. | Submitted: 2026-05-19 | arXiv: 2605.19524 Categories: cs.RO, cs.CV

Research Background: End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. 研究背景： 端到端自動駕駛系統在常見場景表現優異，但在安全關鍵長尾案例中缺乏對危險行為的理解。VLA 模型以其強推理能力展現潛力，但現有方法很少利用負樣本。

Technical Approach: However, most VLA-based approaches rely on positive expert demonstrations, rarely exploiting negative samples, leading to insufficient understanding of risky behaviors and safety boundaries. To address this limitation, we propose SafeAlign-VLA, a unified negative-enhanced safe alignment framework that incorporates negative data into supervised learning and reinforcement learning. First, we develop a counterfactual safety pairing paradigm to generate structured safety labels and counterfactual positive trajectories from risky scenarios via count 技術方法： 本文提出 SafeAlign-VLA，將負樣本整合至監督學習與強化學習的統一負樣本增強安全對齊框架，明確學習危險行為邊界，提升 VLA 在安全關鍵場景中的理解與避免能力。

Key Takeaway: These results demonstrate the effectiveness of the proposed negative-enhanced safe alignment framework for safe and robust autonomous driving. 核心發現： 負樣本增強安全對齊顯著提升 VLA 自動駕駛系統對安全關鍵長尾場景的處理能力。

PAPO-VLA: Planning-Aware Policy Optimization for Vision-Language-Action Models

Authors: Peizheng Guo, Jingyao Wang, Changwen Zheng et al. | Submitted: 2026-05-19 | arXiv: 2605.19580 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models show promising ability in language-guided robotic tasks. However, making VLA policies reliable remains challenging, because a manipulation task is completed through closed-loop interaction, where each action affects subsequent execution. 研究背景： VLA 策略在語言引導機器人任務中展現潛力，但閉環操作的可靠性仍是挑戰：每個動作影響後續執行，策略需同時扮演規劃者與執行者角色。

Technical Approach: To analyze this problem, we revisit VLA policy during execution and argue that a VLA policy acts both as a planner, which makes task-oriented decisions that change the direction of execution, and as an executor, which realizes these decisions through dense continuous actions. This view suggests that improving VLA reliability requires particular attention to planning actions. Existing optimization methods can imitate actions or improve complete trajectories, but they usually do not explicitly identify planning actions or measure their importance 技術方法： 本文重新審視 VLA 策略的規劃者-執行者雙重角色，提出 PAPO-VLA（規劃感知策略最佳化），針對影響執行方向的規劃動作與實現決策的執行動作設計不同的最佳化目標，提升 VLA 可靠性。

Key Takeaway: Experiments on multiple benchmarks demonstrate the effectiveness of PAPO-VLA. 核心發現： 明確區分規劃與執行動作的最佳化顯著提升 VLA 策略的閉環操作可靠性。

FlyMirage: A Fully Automated Generation Pipeline for Diverse and Scalable UAV Flight Data via Generative World Model

Authors: Jinhan Li, Xijie Huang, Zhaoqi Wang et al. | Submitted: 2026-05-19 | arXiv: 2605.19600 Categories: cs.RO

Research Background: In the field of Vision-Language Navigation (VLN), aerial datasets remain limited in their ability to combine scale, diversity, and realism, often relying on either costly real-world scenes or visually limited simulations. To address these challenges, we introduce FlyMirage, a highly scalable and fully automated data generation pipeline for aerial VLN. 研究背景： 空中 VLN 資料集在規模、多樣性與真實感的結合上仍受限，通常依賴昂貴真實場景或視覺受限的模擬環境。

Technical Approach: Our approach leverages large language models (LLM) as an environment designer to promote scene diversity, paired with a generative world model that instantiates these designs into high-fidelity 3D Gaussian Splatting (3DGS) scenes. To substantially reduce human labor and ensure the feasibility of flight data, FlyMirage automates scene exploration and semantic information acquisition, and further integrates a dynamically feasible planner for uncrewed aerial vehicle (UAV) trajectory generation. Utilizing this toolchain, we generate a large-scale, 技術方法： 本文提出 FlyMirage，利用 LLM 作為環境設計師促進場景多樣性，配合生成式世界模型將設計實例化為高保真 3D 高斯散射（3DGS）場景，建立可擴展的全自動空中 VLN 資料生成管線。

Key Takeaway: Utilizing this toolchain, we generate a large-scale, diverse, and photorealistic aerial VLN dataset, with dynamically feasible flying trajectories, designed to support the development of next-generation embodied navigation models. 核心發現： FlyMirage 為空中視覺語言導航提供高品質、高多樣性的大規模合成訓練資料。

RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models

Authors: Jingzhou Luo, Yifan Wen, Yongjie Bai et al. | Submitted: 2026-05-19 | arXiv: 2605.19678 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models have shown strong performance on embodied manipulation, yet they remain brittle under visual observation changes, paraphrased language instructions, and compounded perturbations. This limitation suggests that existing methods still rely heavily on shallow correlations in the training distribution, rather than learning stable couplings among task semantics, environment states, and action generation. 研究背景： VLA 模型在具身操作中表現強勁，但在視覺觀測變化、改述語言指令與複合擾動下仍脆弱，顯示模型仍依賴訓練分佈的淺層相關性。

Technical Approach: Although recent efforts improve robustness through larger-scale training, post-training adaptation, or enhanced predictive modeling, they rarely enforce invariance-oriented consistency within the end-to-end policy itself. To address this issue, we propose RoVLA, a robust vision-language-action framework with multi-consistency constraints. RoVLA enforces consistency under three complementary transformations: instruction semantics, trajectory evolution, and observation perturbation. 技術方法： 本文提出 RoVLA，透過多一致性約束（視覺觀測一致性、語言指令一致性與跨模態語義一致性）強制學習任務語義、環境狀態與動作生成之間的穩定耦合，提升魯棒性而不依賴大規模訓練。

Key Takeaway: Codes will be available at https://github.com/HCPLab-SYSU/RoVLA. 核心發現： 多一致性約束讓 VLA 模型學習更穩定的任務語義與動作耦合，在複合擾動下維持性能。

Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negatives

Authors: Junli Wang, Zhihua Hua, Xueyi Liu et al. | Submitted: 2026-05-19 | arXiv: 2605.19771 Categories: cs.RO, cs.CV

Research Background: Existing imitation learning methods for end-to-end autonomous driving predominantly learn from successful demonstrations by minimizing geometric deviations from expert trajectories. This paradigm implicitly assumes that spatial proximity implies behavioral safety, leading to a critical objective mismatch: trajectories with nearly identical imitation losses may exhibit drastically different safety outcomes, where one remains recoverable while the 研究背景： 現有自動駕駛模仿學習方法主要從成功示範學習，最小化與專家軌跡的幾何偏差，隱含假設空間鄰近性等同行為安全性，導致目標錯配。

Technical Approach: To address this limitation, we propose BeyondDrive, a failure-aware imitation learning framework that jointly learns from successful and failed driving behaviors. First, we introduce a flow matching-based negative trajectory generator that synthesizes safety-critical yet expert-proximate trajectories, enabling explicit modeling of safety asymmetry. Second, we develop a diversity-aware sampling strategy that mitigates mode collapse and improves coverage of diverse failure modes during negative trajectory generation. 技術方法： 本文提出 BeyondDrive，失敗感知模仿學習框架，同時從成功示範與精心設計的失敗案例中學習，讓模型明確理解哪些偏差導致碰撞，而非僅學習複製成功軌跡。

Key Takeaway: Moreover, BeyondDrive generalizes effectively across different autonomous driving architectures, including multi-modal planners, and further demonstrates strong zero-shot transferability on the HUGSIM benchmark. 核心發現： 從失敗案例中學習顯著改善端到端自動駕駛系統在安全邊界附近的行為。

Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains

Authors: Rebecca Ramnauth, Drazen Brscic, Brian Scassellati | Submitted: 2026-05-19 | arXiv: 2605.19940 Categories: cs.AI, cs.RO

Research Background: Foundation models are increasingly deployed in socially sensitive domains such as education, mental health, and caregiving, where failures are often cumulative and context-dependent. Existing guardrail approaches — ranging from training-time alignment to prompting, decoding constraints, and post-hoc moderation — primarily provide empirical risk reduction rather than enforceable behavioral guarantees, and largely treat safety as a property of in 研究背景： 基礎模型日益部署於教育、心理健康與照護等社會敏感領域，現有護欄方法主要提供個別輸出的經驗性風險降低，而非跨互動軌跡的可執行行為保證。

Technical Approach: We reframe guardrails as a problem of runtime behavioral control over interaction trajectories, drawing on robotics to introduce formal constructs for constraint enforcement in uncertain, closed-loop systems. We instantiate these ideas in the Grounded Observer framework and apply it across three real-world deployments: small talk, in-home autism therapy, and behavioral de-escalation in schools. Across settings, the framework enables runtime interventions that mitigate drift into undesirable interaction regimes while adapting to diverse social c 技術方法： 本文從機器人學重新框架護欄為互動軌跡上的執行時行為控制，借鑒安全關鍵機器人系統的形式化方法（如 CBF 與安全過濾器），提供跨多輪互動的行為約束。

Key Takeaway: We discuss extensions to the framework and propose research directions toward stronger guarantees. 核心發現： 借鑒機器人安全控制的形式化護欄方法為基礎模型提供可執行的跨軌跡行為保證。

TravExplorer: Cross-Floor Embodied Exploration via Traversability-Aware 3-D Planning

Authors: Han Zheng, Zhe Chen, Yudong Huang et al. | Submitted: 2026-05-19 | arXiv: 2605.19958 Categories: cs.RO

Research Background: Zero-shot Object Navigation (ZSON) has shown promise for open-vocabulary target search in unseen environments, yet most existing systems remain tied to planar representations and single-floor assumptions. These assumptions become inadequate in real buildings, where navigation involves floors, stairs, landings, and vertically overlapping spaces. 研究背景： 零樣本物件導航在未見環境中已展現潛力，但現有系統受限於平面表示與單層假設，在真實建築的多層環境中失效。

Technical Approach: This article presents TravExplorer, a cross-floor embodied exploration framework that couples zero-shot semantic guidance with traversability-aware 3-D planning. TravExplorer maintains a unified volumetric map that distinguishes occupied structures from robot-reachable support surfaces and extracts traversable frontiers from connected support surfaces, including floors, stairs, and landings. A FOV-aware active perception strategy further resolves incomplete observations during cross-floor traversal. 技術方法： 本文提出 TravExplorer，結合零樣本語義引導與可穿越性感知三維規劃的跨層具身探索框架，維護統一體積地圖區分佔用結構與可穿越空間，支援含樓梯與垂直重疊空間的複雜室內環境。

Key Takeaway: The code will be released at https://github.com/wuyi2121/TravExplorer. 核心發現： TravExplorer 在多層真實建築環境中實現可靠的跨層物件目標導航。

CEER: Compliant End-Effector and Root Control as a Unified Interface for Hierarchical Humanoid Loco-Manipulation

Authors: Xinyuan Luo, Xingrui Chen, Xunjian Yin et al. | Submitted: 2026-05-19 | arXiv: 2605.19981 Categories: cs.RO

Research Background: Humanoid robots have achieved impressive locomotion performance, yet contact-rich and long-horizon manipulation remains a major bottleneck. Manipulation is inherently contact-rich and demands compliant whole-body control for stable interaction, while its diversity and long-horizon nature favor modular, planner-compatible interfaces over joint-space tracking. 研究背景： 人形機器人已在運動方面取得顯著進展，但接觸豐富的長時域操作仍是主要瓶頸，需要順從全身控制與模組化規劃介面的結合。

Technical Approach: We propose CEER, a compliant end-effector-root (EE-root) control abstraction for modular humanoid loco-manipulation within a hierarchical planning framework. CEER enables compliance-aware whole-body control in an interpretable task space defined by root motion commands and end-effector pose targets, and supports plug-and-play integration with heterogeneous high-level planners. A teacher-student framework is adopted to distill a general motion-tracking controller into a low-level policy that consumes only EE-root commands. 技術方法： 本文提出 CEER，順從末端執行器-根部（EE-root）控制抽象，在層次規劃框架內為模組化人形機器人操作運動提供統一介面，在可解釋任務空間中實現順從全身控制，兼容多種任務規劃器。

Key Takeaway: These results indicate that compliant EE-root control provides a practical abstraction for humanoid loco-manipulation, enabling modular and scalable integration of diverse skills. 核心發現： CEER 的順從 EE-root 抽象讓人形機器人實現接觸豐富長時域操作運動。

Beyond Binary Success: A Diagnostic Meta-Evaluation Framework for Fine-Grained Manipulation

Authors: He-Yang Xu, Pengyuan Zhang, Zongyuan Ge et al. | Submitted: 2026-05-19 | arXiv: 2605.19986 Categories: cs.RO, cs.CV, cs.LG

Research Background: Fine-grained manipulation marks a regime where global scene context no longer suffices, and success hinges on the tight coupling of local attribute grounding, high-fidelity spatial perception, and constraint-respecting motor execution. However, current embodied AI benchmarks collapse these capacities into binary success rates, systematically inflating reported capabilities by up to 70% and masking the architectural bottlenecks that impede real-wo 研究背景： 精細操作標誌著全局場景情境不再足夠，成功取決於局部屬性定位、高保真空間感知與約束遵循動作執行的緊密耦合。現有基準以二元成功率折疊所有能力。

Technical Approach: We introduce MetaFine, a diagnostic meta-evaluation framework that disentangles manipulation competency along three axes: understanding, perception, and controlled behavior. Built on a compositional task graph, MetaFine absorbs heterogeneous external benchmarks and reconstructs them into diagnostic scenarios of varying complexity under a unified protocol. Evaluating state-of-the-art vision-language-action (VLA) models through this lens exposes severe dimension-specific failures invisible to conventional metrics. 技術方法： 本文提出 MetaFine 診斷元評估框架，沿理解、感知與執行三個軸解耦操作能力，揭示現有基準因二元成功率虛報能力最高達 70%，並識別阻礙真實部署的架構瓶頸。

Key Takeaway: The MetaFine framework, benchmarks, and supporting resources will be publicly released at our project page: https://metafine.github.io/. 核心發現： MetaFine 揭示現有操作基準嚴重高估模型能力，三軸診斷評估是更準確的能力評量工具。

Towards LLM-Assisted Architecture Recovery for Real-World ROS~2 Systems: An Agent-Based Multi-Level Approach to Hierarchical Structural Architecture Reconstruction

Authors: Dominique Briechle, Raj Chanchad, Tobias Geger et al. | Submitted: 2026-05-19 | arXiv: 2605.20055 Categories: cs.SE, cs.AI, cs.RO

Research Background: Explicit software architecture models are essential artifacts for communicating, analyzing, and evolving complex software-intensive systems. In ROS~2-based robotic systems, however, structural (de-)composition and integration semantics are often only implicitly encoded across distributed artifacts such as source code and launch files, making recovery of hierarchical architecture particularly difficult. 研究背景： LLM 日益被提議作為機器人系統的認知元件，但其在閉環具身任務中的不透明決策過程難以解釋成功或失敗。

Technical Approach: Existing approaches mainly focus on node-level entities and communication wiring, while providing limited support for recovering hierarchical structural (de-)composition across multiple abstraction levels. In this paper, we extend our previously proposed blueprint-guided LLM-assisted architecture recovery pipeline for ROS~2 systems through two major enhancements: (1) refined prompting to improve the consistency and controllability of architecture synthesis, and (2) a staged recovery strategy based on multi-level intermediate architectural repre 技術方法： 本文採用實證 AI 方法研究具身 LLM 智能體的行為特性，使用 Lockbox 序列機械謎題作為測試床，在物理機器人設置中評估 LLM 在 RGB、RGB-D 與地面真值符號觀測下的行為差異。

Key Takeaway: The results demonstrate improved structural consistency, scalability, and robustness of architecture recovery, while also revealing remaining challenges related to dynamic integration semantics in large-scale ROS~2 systems. 核心發現： 更高保真的觀測並不總是改善具身 LLM 的問題解決能力，資訊豐富度與任務複雜度的匹配至關重要。

Probing Embodied LLMs: When Higher Observation Fidelity Hurts Problem Solving

Authors: Oussama Zenkri, Oliver Brock | Submitted: 2026-05-19 | arXiv: 2605.20072 Categories: cs.AI, cs.RO

Research Background: Large Language Models are increasingly proposed as cognitive components for robotic systems, yet their opaque decision processes make it difficult to explain success or failure in closed-loop embodied tasks. Following an empirical AI methodology, we study embodied LLM agents behaviorally by varying the information available to the agent and measuring the resulting changes in behavior. 研究背景： Large Language Models are increasingly proposed as cognitive components for robotic systems, yet their opaque decision processes make it difficult to explain success or failure in closed-loop embodied tasks. Following an empirical AI methodology, we study embodied LLM agents behaviorally by varying the information available to the agent and measuring the resulting changes in behavior.

Technical Approach: Using the Lockbox, a sequential mechanical puzzle with hidden interdependencies, we evaluate LLMs across RGB, RGB-D, and ground-truth symbolic observations in a physical robotic setup and use controlled simulation to probe the resulting behavior. Counterintuitively, agents perform best under raw RGB input and worst under perfect ground-truth observations. In simulation, we probe this effect by randomly flipping perceived action outcomes and find that moderate noise improves performance, peaking at a 40% flip probability with a 2.85-fold success 技術方法： Using the Lockbox, a sequential mechanical puzzle with hidden interdependencies, we evaluate LLMs across RGB, RGB-D, and ground-truth symbolic observations in a physical robotic setup and use controlled simulation to probe the resulting behavior. Counterintuitively, agents perform best under raw RGB input and worst under perfect ground-truth observations. In simulation, we probe this effect by randomly flipping perceived action outcomes and find that moderate noise improves performance, peaking at a 40% flip probability with a 2.85-fold success

Key Takeaway: These findings suggest that success rates alone are insufficient for evaluating LLMs, as measured performance may reflect the interaction between perceptual errors and reasoning failures rather than robust problem solving. 核心發現： These findings suggest that success rates alone are insufficient for evaluating LLMs, as measured performance may reflect the interaction between perceptual errors and reasoning failures rather than robust problem solving.

SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework

Authors: Tianshu Wu, Xiangqi Kong, Yue Chen et al. | Submitted: 2026-05-19 | arXiv: 2605.20373 Categories: cs.RO, cs.AI, cs.CV

Research Background: Building humanoid robots capable of generalizable whole-body loco-manipulation in the real world remains a fundamental challenge. Existing methods either rely on laborious task-specific reward engineering, rigidly replay reference motions that fail to generalize, or depend on costly teleoperation that limits scalability. 研究背景： 建構能在真實世界泛化全身操作運動的人形機器人是根本性挑戰。現有方法依賴繁瑣的任務特定獎勵工程、剛性動作重播或昂貴的遠程操作。

Technical Approach: While human videos capture diverse human behaviors, motion priors inferred from them are inherently imperfect, suffering from occlusion, contact artifacts, and retargeting errors that render them unsuitable for direct policy learning. To address this, we present SUGAR, a scalable data-driven framework that converts diverse human videos into deployable humanoid loco-manipulation skills, without any task-specific reward engineering or reference-motion conditioning at inference. SUGAR proceeds in three stages. 技術方法： 本文提出 SUGAR，利用人類影片作為多樣行為先驗，透過不完美動作先驗過濾、多層次人類影片引導強化學習框架克服遮擋與重定向誤差，實現可泛化全身操作運動學習。

Key Takeaway: Project Page: https://tianshuwu.github.io/sugar-humanoid/ 核心發現： SUGAR 從不完美人類影片先驗中學習可泛化的人形機器人全身操作運動。

Spacetime Optimal-Transport Attention for Visuo-Haptic Imitation Learning of Contact-Rich Manipulation

Authors: Yue Feng, Weicheng Huang, I-Ming Chen | Submitted: 2026-05-19 | arXiv: 2605.20433 Categories: cs.RO

Research Background: Contact-rich manipulation tasks such as tight-clearance insertion, connector mating, polishing, and surface-conforming wiping remain difficult for data-driven controllers because they couple discontinuous contact dynamics, partial observability, and strict safety constraints. No single sensing modality suffices: vision supplies global context before contact, force/torque (F/T) feedback governs interaction after contact, and proprioceptive pose pr 研究背景： 接觸豐富操作（精密插入、連接器配對、拋光）對資料驅動控制器具有挑戰性，因為需要結合接觸前的視覺全局情境、接觸後的力/扭矩反饋與一致的本體感知位姿。

Technical Approach: Most prior imitation-learning policies for contact-rich tasks operate on uni- or bi-modal signals, and the few that fuse three modalities typically adopt off-the-shelf attention modules with no explicit prior on how attention mass should be distributed across task-relevant regions. We present Spacetime Optimal-Transport Attention (SO-TA), a tri-modal fusion backbone that replaces softmax-normalized patch attention by an entropy-regularized Optimal Transport (OT) alignment between force-pose-derived sub-queries and visual patches. Explicit margi 技術方法： 本文提出時空最優傳輸注意力機制用於視觸覺模仿學習，透過最優傳輸對齊跨模態（視覺、力/扭矩、本體感知）的時空特徵，統一處理接觸前後的感知融合。

Key Takeaway: OT-derived patch heatmaps and leave-one-out modality-influence ratios provide interpretable, phase-dependent diagnostics. 核心發現： 時空最優傳輸注意力在接觸豐富操作的多模態模仿學習中實現更好的感知融合與策略性能。

Jointly Learning Predicates and Actions Enables Zero-Shot Skill Composition

Authors: Benedict Quartey, Sebastian Castro, Eric Rosen et al. | Submitted: 2026-05-20 | arXiv: 2605.20648 Categories: cs.RO, cs.AI

Research Background: Learning from Demonstration (LfD) enables robots to learn complex behaviors from expert examples, yet existing approaches often fail to generalize to new compositions of known skills without retraining. Modern generative policies model distributions over action trajectories alone, thus are unable to reason about the symbolic outcomes required for robust composition. 研究背景： LfD 讓機器人從專家示範中學習複雜行為，但現有方法對已知技能的新組合往往在不重新訓練的情況下失敗。現代生成策略僅建模動作軌跡分佈，無法推理組合所需的符號結果。

Technical Approach: We propose that skills should jointly model action trajectories and the symbolic outcomes they induce. To address this gap, we introduce Predicate Action Skills (PACTS), a class of closed-loop visuomotor policies that model skills as a joint generative process over action and predicate belief trajectories, producing coherent action-outcome rollouts within a single model. Jointly generating actions and predicates enables PACTS to learn internal representations that improve both action generation and predicate classification. 技術方法： 本文提出 PACTS（謂詞動作技能），聯合建模動作軌跡與技能誘導的符號結果，讓策略能推理執行結果，從而在零樣本情況下將已知技能組合為新的任務序列。

Key Takeaway: Project website: https://planpacts.github.io/ 核心發現： 聯合建模動作軌跡與符號謂詞讓機器人在無需重新訓練的情況下零樣本組合已知技能。

GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulation

Authors: Zijian Zhang, Yuqing Jiang, Qian Cheng et al. | Submitted: 2026-05-20 | arXiv: 2605.20752 Categories: cs.RO

Research Background: Vision-language-action (VLA) policies have advanced language-conditioned robotic manipulation by transferring semantic priors from pretrained vision-language models to action generation. Yet, standard action-imitation training often provides limited explicit supervision for 3D geometry, dense visual structure, and short-horizon environment evolution, which are critical for physically precise manipulation. 研究背景： VLA 策略透過動作模仿訓練推進語言條件操作，但標準動作模仿訓練對三維幾何、密集視覺結構與短時域環境演化的明確監督有限。

Technical Approach: We introduce \textbf{GaussianDream}, a feed-forward 3D Gaussian world-model plug-in that turns robot trajectories into structured spatial-temporal supervision. The key idea is to couple current Gaussian reconstruction with horizon-conditioned future Gaussian prediction during training, forcing a compact spatio-temporal prefix to be decodable into renderable 3D Gaussian states. This enables dense RGB rendering, depth, and pseudo 3D scene-flow supervision without requiring test-time Gaussian decoding. 技術方法： 本文提出 GaussianDream，前饋三維高斯世界模型插件，將機器人軌跡轉換為結構化時空監督，耦合當前動作預測與下一幀三維高斯場景重建，為 VLA 策略提供豐富的幾何監督訊號。

Key Takeaway: Experiments on LIBERO, RoboCasa Human-50, and real-robot tasks demonstrate strong and highly competitive performance, achieving \textbf{98.4%} average success on LIBERO, \textbf{52.6%} on RoboCasa Human-50, and \textbf{50.0%} in real-world evaluation. 核心發現： GaussianDream 世界模型插件為 VLA 訓練提供三維幾何監督，提升精密操作的物理準確性。

VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models

Authors: Alex S. Huang, Jiahui Zhang, Shiqing Tang et al. | Submitted: 2026-05-20 | arXiv: 2605.20774 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models have shown strong promise for general-purpose robotic manipulation, but their real-world evaluation remains limited by a lack of accessible, reproducible, and consistent benchmarks. Simulation benchmarks fail to capture real-world complexity, while existing real-world benchmarks often require expensive hardware, centralized evaluation, or are limited in task diversity. 研究背景： VLA 模型在通用機器人操作方面展現強勁潛力，但真實世界評估受限於缺乏可獲取、可複現且一致的基準，模擬基準無法捕捉真實複雜性。

Technical Approach: We introduce VLA-REPLICA, a low-cost, easily reproducible real-world benchmark for evaluating VLA models. Built from off-the-shelf components, our system can be quickly assembled and replicated across laboratories, providing a consistent environment for policy evaluation anywhere in the world. VLA-REPLICA includes a diverse suite of manipulation tasks and a small-scale demonstration dataset for target-domain adaptation, with real-world evaluation protocols for both in-distribution and out-of-distribution settings. 技術方法： 本文提出 VLA-REPLICA，基於現成零件組裝的低成本可複現真實世界 VLA 評估基準，任何人均可快速組裝複製，涵蓋多樣化任務，支援去中心化分散式評估。

Key Takeaway: Experiments with imitation learning and state-of-the-art VLA models reveal model strengths and limitations, while consistent results across independently constructed setups demonstrate the reproducibility of our benchmark. 核心發現： VLA-REPLICA 提供低成本可複現的真實世界 VLA 評估標準，推動跨實驗室一致性比較。

Demo-JEPA: Joint-Embedding Predictive Architecture for One-shot Cross-Embodiment Imitation

Authors: Jingyang He, Guangrun Li, Jieyu Zhang et al. | Submitted: 2026-05-20 | arXiv: 2605.20811 Categories: cs.RO

Research Background: Robotic imitation learning is often treated as reproducing demonstrated actions, but actions are inherently embodiment-specific. When demonstrations come from humans or robots with different morphology, kinematics, or action spaces, this action-centric view requires shared action spaces, heuristic retargeting, or large-scale multi-embodiment co-training. 研究背景： 機器人模仿學習通常被視為複製示範動作，但動作本質上依賴於具身形態。跨具身示範（來自人類或形態不同的機器人）時，以動作為中心的觀點需要共享動作空間或大規模共訓練。

Technical Approach: We instead view demonstrations as implicit specifications of future goals: the target agent should infer what state the demonstrator is trying to realize, rather than how the demonstrator executes it. We propose Demo-JEPA, a cross-embodiment imitation framework that decouples demonstration intent from embodiment-specific execution. Built on a JEPA-based world model, Demo-JEPA translates source visual demonstrations into target-compatible future latent trajectories in a shared predictive representation space. 技術方法： 本文提出 Demo-JEPA，將示範視為未來目標的隱式規格，目標智能體推斷示範者試圖達成的狀態而非執行方式，透過聯合嵌入預測架構實現跨具身單次模仿。

Key Takeaway: Experiments on RLBench and real-world manipulation tasks show that Demo-JEPA matches specialized in-domain planners and generalizes to unseen tasks and embodiment configurations where prior methods fail. 核心發現： Demo-JEPA 透過目標推斷而非動作複製，實現跨形態具身的單次模仿學習。

Mobile UMI: Cross-View Diffusion Policy with Decoupled Kinematics for Mobile Manipulation

Authors: Haoran Huang, Haonan Dong, Huixu Dong | Submitted: 2026-05-20 | arXiv: 2605.20894 Categories: cs.RO

Research Background: Mobile imitation learning on portable demonstration interfaces faces two coupled bottlenecks: locomotion-contaminated action labels and inference-induced execution latency on a continuously moving base. Recent wrist-mounted interfaces lower the cost of tabletop data collection, yet a single wrist view does not capture the global context required for base navigation. 研究背景： 便攜示範介面的移動模仿學習面臨兩個耦合瓶頸：運動污染的動作標籤與移動底座上的推理延遲導致執行滯後。

Technical Approach: Adding a body-mounted camera entangles human walking with hand motion. Meanwhile, generative policies introduce hundreds of milliseconds of inference latency, during which the base advances past predicted waypoints, forcing backward corrections at action splices. This paper presents Mobile UMI, a hardware-free demonstration framework that addresses both gaps through three components. 技術方法： 本文提出 Mobile UMI，跨視角擴散策略加解耦運動學框架，添加軀幹相機提供全局導航情境，同時以解耦運動學分離底座導航動作與手腕操作動作，並透過延遲補償解決推理延遲問題。

Key Takeaway: These results indicate that, for mobile imitation learning under the tested conditions, explicit kinematic factorization combined with state-level latency alignment provides an effective solution without requiring architectural changes to the underlying policy class. 核心發現： Mobile UMI 解決移動操作模仿學習的動作污染與推理延遲雙重瓶頸。

Authors: Hana Yamamoto, Carlotta Julia Mayer, Charlotte Raithel et al. | Submitted: 2026-05-20 | arXiv: 2605.21053 Categories: cs.RO

Research Background: Addressing the global caregiver shortage through socially assistive robots necessitates a deep understanding of their psychological and physiological impacts on older adults during human-robot interaction (HRI). This study addresses whether social robots can serve as effective interaction partners compared to humans, and if “positive prompts” can similarly enhance these interactions. 研究背景： 透過社交輔助機器人解決全球照護人員短缺問題，需深入理解機器人對老年人的心理與生理影響。本研究探討社交機器人能否成為有效的互動夥伴。

Technical Approach: We conducted a comparative study with 35 participants (aged 70+). Our multi-modal analysis, integrating facial expression data, heart rate variability, and subjective questionnaires, revealed no significant differences in overall stress levels between human and robot interactions. Facial expression analysis confirmed that the robot was accepted as a valid interaction partner, while physiological data showed slightly lower heart rates during robot interactions, suggesting a more relaxed state compared to human-led sessions. 技術方法： 本研究針對 35 名 70 歲以上參與者進行比較研究，整合面部表情、心率變異性與主觀問卷的多模態分析，比較機器人與人類作為互動夥伴的效果及正向提示的影響。

Key Takeaway: Future work should address the identified “appearance-content mismatch” in robot design to facilitate even more natural and effective interactions. 核心發現： 社交機器人在老年人照護 HRI 中與人類互動夥伴效果相當，正向語言提示可進一步增強互動品質。

Grounding Driving VLA via Inverse Kinematics

Authors: Junsung Park, Hyunjung Shim | Submitted: 2026-05-20 | arXiv: 2605.21061 Categories: cs.CV, cs.AI, cs.RO

Research Background: Existing Driving VLAs predict trajectories while largely ignoring their visual tokens — a phenomenon we trace not to insufficient training but to a structurally ill-posed task formulation. We show that trajectory recovery, when viewed through the lens of inverse kinematics, requires both a current and a future visual state as boundary conditions; existing VLAs supply only the former, which encourages the model to shortcut through ego status and 研究背景： 現有駕駛 VLA 在預測軌跡時大量忽略視覺 token，我們追蹤此問題的根源在於任務表述的結構性缺陷，而非訓練不足。

Technical Approach: To address this, we re-design Driving VLA in the style of an inverse kinematics solver. First, a next visual state prediction objective that requires the LLM to predict the future visual scene provides dense visual supervision and suppresses shortcut paths. Second, a separate Inverse Kinematics Network (a cross-attention-based conditional diffusion model) that takes only the current and future visual states as input is designed to suppress reliance on ego status and textual shortcuts during trajectory decoding. 技術方法： 本文從逆運動學視角重新設計駕駛 VLA：首先預測下一視覺狀態作為目標，再從當前與未來視覺狀態邊界條件解決逆運動學問題生成軌跡，強制模型真正使用視覺資訊進行決策。

Key Takeaway: Extensive analysis further shows that this improvement stems from a recovered ability to exploit visual features, with the effect being most pronounced in dynamic driving situations such as turning. 核心發現： 逆運動學啟發的駕駛 VLA 設計消除視覺 token 忽略問題，顯著提升感知資訊的利用效率。

Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Driving

Authors: Yang Wu, Qiang Meng, Zhaojiang Liu et al. | Submitted: 2026-05-20 | arXiv: 2605.21139 Categories: cs.CV, cs.LG

Research Background: Current end-to-end autonomous driving models are fundamentally constrained by the behavioral cloning ceiling of imitation learning. While reinforcement learning offers a path to smarter autonomy, it demands two missing pieces of infrastructure: (1) a cognitive foundation that understands traffic semantics and driving intent, and (2) a foresighted physical environment that can anticipate the consequences of candidate actions. 研究背景： 當前端到端自動駕駛模型受到模仿學習的行為複製上限限制，強化學習提供了更智能自主的路徑，但需要語義理解基礎與前瞻性物理環境。

Technical Approach: To this end, we propose CoPhy, a CognitivePhysical reinforcement learning framework for autonomous driving. To distill to think, we distill VLM knowledge into the BEV encoder and then discard the VLM entirely, retaining cognitive ability at zero inference cost while releasing the cognitive channel as a pluggable interface for optional human language commands. To foresee to act, we build an auto-regressive BEV world model that explicitly predicts future semantic maps conditioned on candidate actions, serving as an interpretable physical sandbox 技術方法： 本文提出 CoPhy，認知物理強化學習框架，將 VLM 知識蒸餾至 BEV 編碼器以建立語義認知基礎，並建構前瞻性物理環境預測候選動作的後果，結合兩者驅動 RL 訓練。

Key Takeaway: Extensive experiments demonstrate that CoPhy not only achieves state-of-the-art results on NAVSIM v1 and v2 benchmarks, but also enables safer driving via cognitively informed scene compliance and flexible intent control through user-defined language instructions. 核心發現： 認知物理 RL 框架突破模仿學習上限，在語義理解與物理前瞻雙重基礎上實現更智能的自動駕駛。

PREFINE: Preference-Based Implicit Reward and Cost Fine-Tuning for Safety Alignment

Authors: Richa Verma, Bavish Kulur, Sanjay Chawla et al. | Submitted: 2026-05-20 | arXiv: 2605.21225 Categories: cs.LG, cs.AI

Research Background: We address the problem of making a pre-trained reinforcement learning (RL) policy safety-aware by incorporating cost constraints without retraining it from scratch. While costs could be numerically encoded, we assume a more general setting is when costs are provided as preferences. 研究背景： 在不從頭重新訓練的情況下，讓預訓練 RL 策略具備成本約束的安全意識是重要的實際部署問題。

Technical Approach: Given a reward-optimized policy and a small dataset of preferred (low-cost) and dispreferred (high-cost) trajectories, our goal is to fine-tune the policy to generate low-cost behaviors while retaining high rewards. Unlike standard RLHF in language models, where preferences are defined over responses to the same prompt, our setting involves trajectory-level preferences in continuous control environments. We introduce PREFINE: Preference-based Implicit Reward and Cost Fine-Tuning for Safety Alignment which is a preference-based fine-tuning metho 技術方法： 本文提出 PREFINE，給定獎勵最佳化策略與少量偏好（低成本/高成本）軌跡，透過隱式成本建模與 RL 微調讓策略在保持高獎勵的同時生成低成本行為，無需數值成本編碼。

Key Takeaway: PREFINE produces policies that achieve low-cost, high-reward performance with significantly improved data and computational efficiency compared to full offline RL or imitation learning, bridging preference alignment and safe policy adaptation in continuous domains. 核心發現： PREFINE 透過偏好引導的隱式成本微調，讓預訓練策略在不重新訓練的情況下具備安全約束意識。

To Select or not to Select, that is the Question: Distilling Robot Skill Prediction into a Small Ensemble

Authors: Haechan Mark Bong, Simon Roy, Euhid Aman et al. | Submitted: 2026-05-20 | arXiv: 2605.21242 Categories: cs.RO

Research Background: As robot fleets become more heterogeneous, including humanoids, rovers, quadrupeds, and drones, selecting the right robot for a task becomes a core systems problem. We study robot skill prediction: mapping a natural-language task description to the physical capabilities required to execute it, such as fly, wheels, legs, surface water, under water and hands. 研究背景： 隨著機器人艦隊日益多樣化（人形、漫遊車、四足、無人機），將自然語言任務描述映射至所需物理能力（機器人技能預測）成為核心系統問題。

Technical Approach: Since labelled data that maps natural-language task descriptions to robot’s physical capabilities does not exist, we construct a synthetic task-to-skill dataset using LLM-assisted generation and targeted label auditing. Trained on this data, a ~133M-parameter ensemble of two fine-tuned sentence encoders (mpnet + MiniLM) reaches 83.5% task-to-skill matching on a stratified 200 task dataset, outperforming Kimi K2 (1T MoE) at 72.0%, GPT-OSS-120B at 71.5%, and Llama-4-Scout-17B at 69.0% under the same zero-shot prompt. These results suggest that, f 技術方法： 本文利用 LLM 輔助生成合成任務到技能資料集，並針對多樣機器人形態訓練小型集成模型，透過知識蒸餾將大型 LLM 的技能推理能力壓縮至輕量可部署模型。

Key Takeaway: These results suggest that, for fixed robot skill taxonomies, small specialized models trained on synthetic data can outperform much larger general-purpose LLMs for fleet-level task routing. 核心發現： 蒸餾至小型集成模型的機器人技能預測器能有效將自然語言任務映射至所需機器人物理能力。

Learning Robust Dexterous In-Hand Manipulation from Joint Sensors with Proprioceptive Transformer

Authors: Senlan Yao, Chenyu Yang, Jaehoon Kim et al. | Submitted: 2026-05-20 | arXiv: 2605.21330 Categories: cs.RO

Research Background: In-hand object manipulation is a fundamental yet challenging capability for dexterous robots. Despite significant progress in dexterous manipulation, existing approaches rely heavily on vision or tactile sensing to track object states, while joint sensing — the most readily available modality on any robotic hand — remains largely overlooked, particularly for tendon-driven hands. 研究背景： 手中操作是靈巧機器人的基礎但具挑戰性的能力。現有方法嚴重依賴視覺或觸覺感測追蹤物件狀態，而最易獲取的關節感測模態反而被忽視。

Technical Approach: In this paper, we study how far joint sensing alone can go by asking: (i) whether motor encoders or direct joint sensing provides better proprioceptive feedback, (ii) how to extract environment information from joint measurements, and (iii) whether joint-only control can achieve competitive real-world performance without external perception. We present the Proprioceptive Transformer (PT), an exteroceptive-free approach for continuous cube rotation on a tendon-driven dexterous hand that uses only joint sensing feedback. A teacher policy is first 技術方法： 本文研究關節感測能走多遠：比較電機編碼器與直接關節感測的本體感知反饋效果，提出本體感知 Transformer 從關節感測提取環境資訊，並建立完整的靈巧手中操作策略。

Key Takeaway: We also demonstrate that our PT achieves a 23.4% lower RMSE for cube position estimation than the MLP baseline, indicating superior extraction of exteroceptive information from proprioceptive sources. 核心發現： 本體感知 Transformer 展示關節感測單獨驅動靈巧手中操作的可行性，無需視覺或觸覺感測。

PointACT: Vision-Language-Action Models with Multi-Scale Point-Action Interaction

Authors: Shizhe Chen, Paul Pacaud, Cordelia Schmid | Submitted: 2026-05-20 | arXiv: 2605.21414 Categories: cs.RO, cs.CV

Research Background: Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation by leveraging large pretrained vision-language backbones. However, most existing VLAs rely primarily on 2D visual representations, which limit their ability to reason about fine-grained geometry and spatial grounding - capabilities that are essential for precise and robust manipulation in 3D environments. 研究背景： VLA 模型主要依賴二維視覺表示，限制了在三維環境中進行精密操作所需的幾何推理與空間定位能力。

Technical Approach: In this paper, we propose PointACT, a dual-system 3D-aware VLA policy that integrates hierarchical 3D point cloud representations directly into the action decoding process. PointACT employs a multi-scale point-action interaction mechanism with efficient bottleneck window self-attention, enabling evolving action tokens to densely attend to both local geometric detail and global scene structure. We evaluate PointACT on the LIBERO and RLBench benchmarks and systematically compare it against monolithic and dual-system VLA baselines, including varia 技術方法： 本文提出 PointACT，雙系統三維感知 VLA 策略，將層次化三維點雲表示直接整合至動作解碼過程，兩個系統分別處理全局語義理解與局部三維精確操作，互補協作。

Key Takeaway: Our results also highlight the promise of pretrained 3D representations for 3D-aware VLA policies. 核心發現： 融合點雲的三維感知 VLA 策略在精密三維操作任務中顯著優於純二維 VLA 基準。

Lost in Fog: Sensor Perturbations Expose Reasoning Fragility in Driving VLAs

Authors: Abhinaw Priyadershi, Jelena Frtunikj | Submitted: 2026-05-20 | arXiv: 2605.21446 Categories: cs.RO, cs.AI

Research Background: Interpretable autonomous driving planners depend not only on generating explanations, but also on those explanations remaining reliable under real-world sensor degradation. In this paper we present a controlled perturbation study of Vision-Language-Action (VLA) robustness in autonomous driving, evaluating Alpamayo R1 (10B parameters) across 1,996 scenarios under eight sensor perturbations (Gaussian noise at four intensities, two lighting extremes 研究背景： 可解釋自動駕駛規劃器不僅需生成解釋，還需確保這些解釋在真實世界感測器退化下保持可靠。

Technical Approach: We find that reasoning consistency is a high-fidelity indicator of trajectory reliability: when Chain-of-Causation (CoC) explanations change after perturbation, trajectory deviation spikes $5.3 \times$ (21.8m vs 4.1m), with $r = 0.99$ across attack types and $r_{p b} = 0.53$ per-sample (Cohen’s $d = 1.12$ ). A controlled ablation provides evidence that enabling CoC generation is associated with improved trajectory accuracy (11.8% on average across conditions; $p < 0.0001$ ) under matched inference settings. Over the tested noise range ($σ\i 技術方法： 本文對 VLA 自動駕駛在八種感測器擾動下的魯棒性進行受控研究，評估 Alpamayo R1 跨 1,996 個場景的表現，發現推理一致性是軌跡可靠性的高保真指標。

Key Takeaway: Together, these results establish CoC consistency as a quantitative proxy for planning safety and motivate reasoning-based runtime monitoring for safer VLA deployment. 核心發現： 推理一致性是預測 VLA 駕駛軌跡可靠性的有效指標，可作為感測器退化情境下的早期預警信號。

HITL-D: Human In The Loop Diffusion Assisted Shared Control

Authors: Riley Zilka, Sergey Khlynovskiy, Allie Wang et al. | Submitted: 2026-05-20 | arXiv: 2605.21460 Categories: cs.RO, cs.AI, cs.HC

Research Background: Autonomous manipulation systems have achieved remarkable capabilities, yet the integration of human expertise with diffusion-based policies in shared control remains relatively unexplored. In this paper, we propose Human-In-The-Loop Diffusion (HITL-D), a shared control framework that enhances user performance in multi-step, insertion, and fine manipulation tasks. 研究背景： 自主操作系統能力顯著，但擴散策略與共享控制的整合探索不足，人類專業知識與擴散策略在共享控制中的協同潛力尚未開發。

Technical Approach: HITL-D leverages a novel combination of diffusion-based policies and human control to provide autonomous end effector orientation updates conditioned on a scene point cloud and the Cartesian position of the end effector. This approach reduces the number of joystick control axes required, thereby lowering mental workload. In a multi-task user study with 12 participants, HITL-D reduced average task completion times by 40%, decreased perceived workload by 37%, and improved Likert-scale ratings for independence, intuitiveness, and confidence compar 技術方法： 本文提出 HITL-D（人在迴路擴散），結合擴散策略與人類控制的共享控制框架，以場景點雲與末端執行器笛卡爾位置為條件提供自主方向更新，在多步驟、插入與精細操作任務中增強使用者性能。

Key Takeaway: These results demonstrate that HITL-D effectively integrates human expertise with autonomous assistance, improving both objective and subjective aspects of teleoperation. 核心發現： 人在迴路擴散共享控制顯著提升接觸豐富精細操作任務中的人機協作性能。

PGDG: Physically Grounded Data Generation for Robust Bimanual Policy Learning from a Single Demonstration

Authors: Cunxi Dai, Haoran Chang, Aditya Nisal et al. | Submitted: 2026-05-20 | arXiv: 2605.21710 Categories: cs.RO

Research Background: Behavior cloning for contact-rich bimanual manipulation remains challenging because diverse demonstrations are expensive to collect, and even small disturbances can push the system into off-manifold states where no recovery supervision is available. We propose PGDG, a data generation framework with zero-shot curation that expands a single demonstration into a compact dataset of physically plausible, successful, and diverse recovery behaviors with 研究背景： 接觸豐富雙臂操作的行為複製因多樣示範收集成本高昂而困難，且即使微小擾動也可能使系統進入無恢復監督的離流形狀態。

Technical Approach: PGDG iterates between a physics-grounded sampler and a dataset curator, where the curator selects informative, non-redundant, and recoverable behaviors to update the sampling distribution toward under-covered recovery modes, and the sampler draws physically plausible rollout candidates from this updated distribution and retains successful trajectories. To further improve data quality, PGDG applies short-horizon sampling-based control to relabel selected risky states with corrective actions. Across four bimanual manipulation tasks, PGDG consiste 技術方法： 本文提出 PGDG，零樣本策展的資料生成框架，從單次示範擴展為物理合理、成功且多樣的恢復行為緊湊資料集，透過物理基礎取樣器與資料集策展器迭代選擇信息豐富的非冗餘示範。

Key Takeaway: Additional results are available in our website: https://cunxid.github.io/PGDG/. 核心發現： 從單次示範零樣本生成物理合理恢復行為資料集，有效解決接觸豐富雙臂操作的資料稀缺問題。

Safe and Steerable Geometric Motion Policies for Robotic Dexterous Manipulation

Authors: Albert Wu, Riccardo Bonalli, Thomas Lew et al. | Submitted: 2026-05-20 | arXiv: 2605.21811 Categories: cs.RO

Research Background: Robotic dexterous manipulation requires continuously reconciling objectives and constraints defined on heterogeneous geometric spaces: a robot controlled on a $R^{7}$ configuration manifold may need to track end effector poses on $SE (3)$ while satisfying obstacle avoidance margins in $R$ . We present Safe Pullback Bundle Dynamical Systems (SafePBDS), a geometrically consistent framework that computes optimal, certifiably s 研究背景： 靈巧機器人操作需要在異質幾何空間上持續協調目標與約束，現有方法難以在任意任務流形上同時滿足幾何一致性與安全性。

Technical Approach: SafePBDS builds on prior work that combines predefined task manifold dynamical systems to produce autonomous motion. Its first innovation is a pullback control barrier function construction, which converts task manifold safety conditions into linear constraints on configuration manifold accelerations. The second innovation is a task manifold action interface that allows a high-level policy to inject low dimensional residual motions; zero input recovers the autonomous behavior, while safety is preserved under arbitrary inputs. 技術方法： 本文提出 SafePBDS（安全拉回束動力系統），幾何一致框架從任意任務流形上的目標與安全要求計算最優且可認證安全的構型流形加速度，建立從任務空間到關節空間的嚴格幾何映射。

Key Takeaway: Demo video and details: https://tml.stanford.edu/safe-pbds 核心發現： SafePBDS 在任意幾何任務空間上提供可認證安全的靈巧機器人操作控制。

EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Control

Authors: Chushan Zhang, Ruihan Lu, Jinguang Tong et al. | Submitted: 2026-05-21 | arXiv: 2605.21862 Categories: cs.RO, cs.AI

Research Background: Chunked vision-language-action (VLA) policies predict multi-step robot controls, conditioning each update on the current visual observation alone. Yet robot actions cause contact, occlusion, and object motion, and the geometry that later decisions depend on can change before the next visual update arrives. 研究背景： 分塊 VLA 策略僅以當前視覺觀測為條件預測多步控制，但機器人動作引起接觸、遮擋與物件運動，後續決策依賴的幾何可能在下次視覺更新前改變。

Technical Approach: Spatial VLAs improve current-frame geometry. Temporal VLAs aggregate past frames. Neither maintains an action-updated scene prior across chunks. 技術方法： 本文提出 EvoScene-VLA，引入跨控制呼叫的持久動作更新場景狀態，其循環場景前綴攜帶動作更新的幾何先驗，讓動作解碼器在動作塊執行期間維護演化中的場景模型。

Key Takeaway: On the Galaxea R1-Lite real robot, EvoScene-VLA outperforms all baselines. 核心發現： 動作更新持久場景狀態讓 VLA 在分塊執行期間維護幾何一致性，提升長時域操作性能。

TacO: Benchmarking Tactile Sensors for Object Manipulation

Authors: Anya Zorin, Zilin Si, Myungsun Park et al. | Submitted: 2026-05-21 | arXiv: 2605.21976 Categories: cs.RO

Research Background: Vision-based learning from demonstrations has achieved remarkable success in enabling robots to perform manipulation tasks and high-level semantic reasoning, yet it remains insufficient for complex, contact-rich manipulation. While there is broad agreement that tactile sensing improves manipulation, there is no empirical guidance on which tactile sensors are best suited for which manipulation tasks. 研究背景： 視覺學習示範在語義推理方面取得顯著成功，但對接觸豐富操作仍不足夠，觸覺感測改善操作已有廣泛共識，但缺乏哪種觸覺感測器最適合哪類操作任務的實證指引。

Technical Approach: In this paper, we provide a systematic, task-driven evaluation of tactile sensors for robot manipulation and propose a framework for selecting and evaluating sensors based on manipulation policy performance. Separate manipulation policies are trained for tactile sensors of four distinct modalities: visual, acoustic, magnetic, and resistive, across three tasks: pick-and-place with unknown mass, object reorientation, and plug insertion. For each task, an analysis of how sensor properties such as spatial resolution, shear sensing, and tactile repr 技術方法： 本文提出 TacO，系統性任務驅動觸覺感測器操作評估框架，跨多種任務類型比較不同觸覺感測器的操作策略性能，提供感測器選擇的量化實證依據。

Key Takeaway: All of the tactile sensors, code, data, and hardware setup will be publicly available on the project website. 核心發現： TacO 首次提供觸覺感測器針對具體操作任務的系統性量化評估，填補感測器選擇的實證指引空白。

Action with Visual Primitives

Authors: Weilong Guo, Yuchen Wang, Renping Zhou et al. | Submitted: 2026-05-21 | arXiv: 2605.22183 Categories: cs.RO, cs.AI

Research Background: Vision-Language-Action (VLA) models have emerged as a promising paradigm for generalist robotic manipulation. A common design in current architectures maps language instructions and visual observations to actions in a single forward pass. 研究背景： VLA 模型的常見設計在單次前向傳遞中從語言指令與視覺觀測映射至動作，這種設計將指令理解、空間場景理解與動作控制耦合在單一學習目標中。

Technical Approach: While conceptually simple, this formulation entangles instruction comprehension, spatial scene understanding, and motor control within a single learning objective. As a result, the action expert must implicitly relearn cognitive and perceptual capabilities already present in the pretrained VLM, which can limit both learning efficiency and generalization. We introduce AVP (Action with Visual Primitives), an end-to-end architecture that implements this visual-primitive-centric interface: the VLM infers the next-stage target and emits visual-primi 技術方法： 本文提出視覺基元動作（AVP）框架，透過分離的視覺基元中間表示解耦感知與控制：VLM 首先從場景中提取任務相關視覺基元（關鍵點、邊界框、接觸點），動作專家再從基元生成精確動作。

Key Takeaway: Real-robot experiments on general pick-and-place tasks show that AVP improves the success rate by 27.61% over pi_0.5 and outperforms other recent methods, with consistent gains in data efficiency, spatial-compositional generalization, and object-level transfer. 核心發現： 解耦視覺基元中間表示讓 VLA 的感知推理與動作控制各司其職，提升學習效率與泛化能力。

Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priors

Authors: Jiahe Chen, ZiRui Wang, Feiyu Jia et al. | Submitted: 2026-05-21 | arXiv: 2605.22272 Categories: cs.RO, cs.CV

Research Background: Whole-body Humanoid-Object Interaction (HOI) is bottlenecked by the scarcity of high-fidelity 3D data. While video generative priors offer a promising alternative, existing methods suffer from \textit{Representation Misalignment} due to their reliance on geometric priors (e.g., explicit CAD models), and \textit{Retargeting Complexity} arising from intensive morphing and morphological mismatch. 研究背景： 全身人形機器人-物件互動（HOI）受限於高保真三維資料稀缺。視覺生成先驗提供替代方案，但現有方法受幾何先驗依賴（表示不對齊）與形態重定向複雜性制約。

Technical Approach: We propose Imagine2Real, a zero-shot HOI framework for flexible, geometry-free interaction. To resolve misalignment, we formulate robot and object motions as unified 4D point trajectories. To overcome retargeting complexity, our Keypoints Tracker tracks only sparse critical points (base, hands, and object), entirely bypassing the error-amplifying retargeting process. 技術方法： 本文提出 Imagine2Real，幾何無關的零樣本 HOI 框架：將機器人與物件運動統一表示為四維點軌跡消除表示不對齊，透過運動流傳播克服形態不匹配，無需顯式 CAD 模型。

Key Takeaway: Using a progressive training strategy, Imagine2Real learns robust behaviors with simple tracking rewards, enabling zero-shot physical deployment within a motion capture(mocap) system. 核心發現： Imagine2Real 實現無幾何先驗的人形機器人物件互動零樣本泛化。

Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Action

Authors: Pengteng Li, Weiyu Guo, He Zhang et al. | Submitted: 2026-05-21 | arXiv: 2605.22283 Categories: cs.RO

Research Background: We introduce SOMA, the Spatial Memory framework for Out-of-Vision Manipulation in Vision-Language-Action (VLA) models. Most existing VLAs implicitly assume that task-relevant objects are always visible, leading to brittle and reactive behaviors when targets fall outside the camera’s field of view. 研究背景： 現有 VLA 模型隱式假設任務相關物件始終可見，導致目標落出相機視野時出現脆弱的反應式行為。

Technical Approach: SOMA addresses this limitation by equipping VLAs with a persistent spatial memory constructed from multi-view observations acquired via a movable head camera, enabling reasoning beyond the current visual frustum. The framework consists of three components: Spatial Memory Construction, which aggregates angular-wise observations into a unified spatial-semantic representation through scanning; Dynamic Memory Refinement, which maintains global consistency over time; and Contextual Memory Retrieval, which activates instruction-relevant spatial cues 技術方法： 本文提出 SOMA（視野外操作空間記憶），透過可移動頭部相機的多視角觀測建構持久空間記憶，讓 VLA 推理超出當前視覺截錐的目標，包含空間記憶建構、更新與記憶引導操作三個模組。

Key Takeaway: Code will be released soon. 核心發現： 持久空間記憶框架讓 VLA 機器人在目標物件離開視野後仍能可靠執行操作任務。

How can reasoning capability empower the AI copilot robot in endoscopic surgery

Authors: Guankun Wang, Long Bai, Hongliang Ren | Submitted: 2026-05-21 | arXiv: 2605.22322 Categories: cs.RO

Research Background: Reasoning capability has significantly advanced complex logical inference and robotic decision-making in general domains. However, its potential in the Artificial Intelligence (AI) copilot robot-particularly implemented based on the Vision-Language-Action (VLA) model-remains unexplored in endoscopic surgery. 研究背景： 推理能力在通用領域已顯著推進複雜邏輯推斷與機器人決策，但其在內視鏡手術 AI 副駕駛機器人（基於 VLA 模型）中的潛力仍未被探索。

Technical Approach: However, its potential in the Artificial Intelligence (AI) copilot robot-particularly implemented based on the Vision-Language-Action (VLA) model-remains unexplored in endoscopic surgery. Effective reasoning should enable AI copilot robots to integrate multimodal cues, interpret surgical intent, and infer hidden tissue dynamics, thereby alleviating intraoperative uncertainty and cognitive burden on surgeons. Properly implemented, reasoning-driven autonomy can transform AI copilot robots from reactive executors into cognitive collaborators, enha 技術方法： 本文研究推理能力如何賦能內視鏡手術 AI 副駕駛機器人，使其整合多模態線索、詮釋手術意圖並推斷隱藏組織動態，分析推理驅動自主如何減輕術中不確定性與認知負擔。

Key Takeaway: Properly implemented, reasoning-driven autonomy can transform AI copilot robots from reactive executors into cognitive collaborators, enhancing precision, safety, and sustainability in clinical practice. 核心發現： 推理驅動的 VLA 手術機器人能更有效整合多模態術中資訊，潛在改善手術決策品質。

Pre-VLA: Preemptive Runtime Verification for Reliable Vision-Language-Action and World-Model Rollouts

Authors: Zhen Sun, Yongjian Guo, Haoran Sun et al. | Submitted: 2026-05-21 | arXiv: 2605.22446 Categories: cs.CV, cs.AI, cs.RO

Research Background: While large vision-language-action (VLA) models and generative world models (WM) have advanced long-horizon embodied intelligence, their practical deployment remains challenged by uncertainty in learning-based action generation. Low-quality actions may cause physical failures during execution or lead to misleading world-model rollouts with redundant rendering costs. 研究背景： 大型 VLA 模型與生成式世界模型推進了長時域具身智能，但不確定性學習動作生成在實際部署中仍面臨挑戰，低品質動作可能導致物理失敗或誤導世界模型展開。

Technical Approach: To address this issue, we propose Pre-VLA, a unified runtime verification architecture that performs preemptive action validity assessment before physical execution or world-model imagination. Pre-VLA leverages an efficient multimodal backbone with modality-aware pooling and a lightweight dual-branch head to predict both safety confidence and critic-derived advantage scores for candidate action chunks. To handle severe class imbalance and unstable boundary decisions, we train Pre-VLA with a multi-task objective combining Focal classification, a 技術方法： 本文提出 Pre-VLA，在物理執行或世界模型想象前進行搶先式動作有效性評估的統一執行時驗證架構，利用高效多模態評估模型在推理時預篩無效動作。

Key Takeaway: Experiments on the LIBERO benchmark show that Pre-VLA improves the average closed-loop success rate across four suites from 30.79% to 37.62% over RynnVLA-002, reduces task execution steps, achieves 183.9 ms average forward verification time per action chunk, and mitigates error accumulation in wor 核心發現： Pre-VLA 搶先式執行時驗證架構顯著降低 VLA 部署中的物理失敗率與世界模型展開誤差。

GesVLA: Gesture-Aware Vision-Language-Action Model Embedded Representations

Authors: Wenxuan Guo, Ziyuan Li, Meng Zhang et al. | Submitted: 2026-05-21 | arXiv: 2605.22812 Categories: cs.RO, cs.CV

Research Background: Vision-Language-Action (VLA) models have shown strong potential for general-purpose robot manipulation by unifying perception and action. However, existing VLA systems primarily rely on textual instructions and struggle to resolve spatial ambiguity in complex scenes with multiple similar objects. 研究背景： VLA 模型主要依賴文字指令，在有多個相似物件的複雜場景中難以解決空間歧義，限制了通用機器人操作的精確性。

Technical Approach: To address this limitation, we introduce gesture as a parallel instruction modality and propose a Gesture-aware Vision-Language-Action model (GesVLA). Our approach encodes gesture features directly into the latent space, enabling them to participate in both high-level reasoning and low-level action generation, and adopts a dual-VLM architecture to achieve tight coupling between gesture representations and action policies. At the data level, we construct a scalable gesture data generation pipeline by rendering hand models onto real-world scene i 技術方法： 本文引入手勢作為平行指令模態，提出 GesVLA，將手勢特徵直接編碼至潛在空間參與高層推理與低層動作生成，讓機器人能透過手勢消除多物件場景中的空間歧義。

Key Takeaway: Project page: https://gwxuan.github.io/GesVLA/. 核心發現： 手勢模態與 VLA 的整合顯著提升複雜多物件場景中機器人操作的空間定位精度。

Authors: Wenxuan Guo, Xiuwei Xu, Yichen Liu et al. | Submitted: 2026-05-21 | arXiv: 2605.22816 Categories: cs.RO, cs.CV

Research Background: Vision-and-Language Navigation (VLN) requires an agent to ground language instructions to its own movement within a visual environment. While state-of-the-art methods leverage the reasoning capabilities of Vision-Language Models (VLMs) for end-to-end action prediction, they often lack an explicit and explainable understanding of the relationships between the agent, the instruction, and the scene. 研究背景： 視覺語言導航（VLN）需要智能體在視覺環境中將語言指令對應至自身移動。現有方法利用 VLM 推理能力進行端到端動作預測，但缺乏對智能體、指令與場景關係的明確可解釋理解。

Technical Approach: Conversely, explicitly building a scene map for heuristic planning is intuitively appealing but relies on additional 3D sensors and hinders large-scale vision-language pre-training. To bridge this gap, we propose AwareVLN, a novel framework that equips the navigation model with a self-aware reasoning mechanism, enabling it to understand the agent’s state and task progress in a fully end-to-end and data-driven manner. Our approach features two key innovations: (1) a structural reasoning module that fosters spatial and task-oriented self-awarenes 技術方法： 本文提出 AwareVLN，透過自我感知推理橋接 VLM 端到端預測與明確場景地圖規劃的優勢，讓智能體建立對自身位置與指令進度的明確認識，無需額外三維感測器。

Key Takeaway: Project page: https://gwxuan.github.io/AwareVLN/. 核心發現： 自我感知推理顯著提升 VLN 智能體在複雜長時域導航任務中的指令遵循準確性。

DriveSafer: End-to-End Autonomous Driving with Safety Guidance

Authors: Shounak Sural, Raj Rajkumar | Submitted: 2026-05-16 | arXiv: 2605.16737 Categories: cs.RO, cs.CV

Research Background: End-to-End (E2E) autonomous driving models have shown growing capability in recent years, with performance improving on increasingly challenging benchmarks. However, modern generative E2E planners still suffer from a substantial number of catastrophic failures in safety-critical scenarios. 研究背景： 端到端自動駕駛模型性能持續提升，但現代生成式端到端規劃器在安全關鍵場景中仍有大量災難性失敗，根源在於物理約束與安全要求的違反。

Technical Approach: We find that many such failures arise from violations of physical constraints and safety requirements, leading to unsafe behavior. Motivated by this finding, in this paper, we focus on improving safety outcomes in generative end-to-end driving with a targeted reduction of catastrophic planning failures, instead of enhancing average planning quality. Towards this end, we propose DriveSafer, a failure-aware safety framework for end-to-end planners. 技術方法： 本文提出 DriveSafer，以安全引導改善生成式端到端駕駛的安全結果，識別違反物理約束與安全要求的失敗模式，並設計針對性的安全改善策略減少災難性規劃失敗。

Key Takeaway: Compared to the state-of-the-art DiffusionDrive model, on the NAVSIM benchmark, DriveSafer reduces the number of catastrophic failures (PDMS=0) by 48%, with over 65% reduction in drivable-area compliance failures. 核心發現： 安全引導的端到端駕駛框架顯著減少安全關鍵場景中的災難性規劃失敗。

Plan First, Diffuse Later: Extrinsic Graph Guidance for Long-Horizon Diffusion Planning

Authors: Yaniv Hassidof, Adir Morgan, Yilun Du et al. | Submitted: 2026-05-16 | arXiv: 2605.16863 Categories: cs.RO, cs.AI, cs.LG

Research Background: Compositional diffusion models offer a promising route to long-horizon planning by denoising multiple overlapping sub-trajectories while ensuring that together they constitute a global solution. However, enforcing local behavior over long chains is often insufficient for a coherent global structure to emerge. 研究背景： 組合擴散模型透過對多個重疊子軌跡去噪為長時域規劃提供了有潛力的途徑，但局部行為約束不足以讓連貫的全局結構自然出現。

Technical Approach: Recent works tackle this limitation through intrinsic search, which explores multiple paths during the denoising process. While intrinsic search improves global coherence, it comes at the cost of repeated evaluations of an already compute-heavy model. In this work, we argue that extrinsic search, performed outside the denoising process, offers a more effective mode of exploration for long-horizon planning while naturally enabling the use of classical algorithms to solve unseen combinatorial tasks at test time. 技術方法： 本文主張透過外在圖引導（而非計算成本高昂的內在搜索）提升全局連貫性，利用稀疏圖結構引導擴散過程在長時域規劃中保持全局一致性，同時降低重複評估成本。

Key Takeaway: Project website: https://yanivhass.github.io/XDiffuser-site/ 核心發現： 外在圖引導擴散規劃在保持全局連貫性的同時大幅降低計算成本。

Generalizable and Actionable Parts Pose Estimation with Symmetry Annotation-Free Learning Strategy

Authors: Wenxiao Chen, Xueyu Yuan, Liu Liu et al. | Submitted: 2026-05-16 | arXiv: 2605.17033 Categories: cs.RO

Research Background: Urgently needed generalizable robot object interaction and manipulation requires high-quality Cross-Category object perception. As a pioneer of this area, Generalizable and Actionable Parts (GAParts) understanding has attracted increasing attention from relevant researchers. 研究背景： 可泛化機器人物件互動與操作需要高品質跨類別物件感知。廣義可動作部件（GAPart）理解正吸引研究關注，但現有方法在對稱性處理上設計不足或需要大量對稱性標註。

Technical Approach: However, most recent works either have insufficient design regarding the symmetry issue or require rich symmetry annotation, which severely impedes precise GAPart pose estimation in data-lacking scenarios. In this paper, we propose SAFAG, a novel Symmetry Annotation-Free framework for Generalizable and Actionable Parts Pose Estimation. Specifically, we suggest a stepwise refinement two-stage framework for candidate-to-final quaternion regression, and tackle the symmetry prediction as a probability distribution problem with self-supervised learn 技術方法： 本文提出 SAFAG，無對稱性標註的廣義可動作部件位姿估計框架，透過對稱性感知學習策略在資料稀缺場景中實現精確的跨類別位姿估計，無需繁重的對稱性標註成本。

Key Takeaway: We believe that our work has the enormous potential to be applied in many areas of embodied AI system. 核心發現： SAFAG 無需對稱性標註即實現精確的廣義可動作部件跨類別位姿估計。

HCLM: A Hierarchical Framework for Cooperative Loco-Manipulation with Dual Quadrupeds

Authors: Qixuan Li, Chen Le, Jincheng Yu et al. | Submitted: 2026-05-17 | arXiv: 2605.17300 Categories: cs.RO

Research Background: We introduce HCLM, a hierarchical framework for general-purpose cooperative loco-manipulation with dual quadrupedal systems. Coordinating multi-robot collaborative manipulation across floating bases is highly challenging due to the conflicting demands of spatial coordination, robust locomotion, and closed-chain physical interactions. 研究背景： 雙四足系統的協作操作運動面臨空間協調、穩健運動與閉鏈物理互動的衝突需求，是高度挑戰性的多機器人問題。

Technical Approach: To resolve this, our architecture systematically decouples high-level collaborative reasoning from low-level robust motion execution. At the high level, a centralized Joint Diffusion Policy leverages an SE(3)-invariant task-space representation to learn coordinate-agnostic spatial coordination patterns. To translate these frame-agnostic references into physical motion, a task-centric hybrid Whole-Body Controller synergizes a proactive kinematic Model Predictive Control for collision-free velocity distribution with a reactive execution layer. 技術方法： 本文提出 HCLM，雙四足協作操作層次框架，高層採用 SE(3) 不變任務空間表示的集中式聯合擴散策略學習協調，低層實現穩健運動執行，系統性解耦高層協作推理與低層穩健運動。

Key Takeaway: The results demonstrate reliable task execution, strict configuration agnosticism, and exceptional resilience against severe physical perturbations, offering a highly robust pathway for multi-robot embodied coordination. 核心發現： HCLM 層次框架讓雙四足系統實現通用目的協作操作運動。

RoboFlow4D: A Lightweight Flow World Model Toward Real-Time Flow-Guided Robotic Manipulation

Authors: Sixu Lin, Junliang Chen, Huaiyuan Xu et al. | Submitted: 2026-05-17 | arXiv: 2605.17522 Categories: cs.RO

Research Background: Planning and acting in 3D environments is a fundamental capability for robotic manipulation in the real world. Although prior work has explored predictive flow planners to guide 3D manipulation, existing approaches often rely on modular pipelines stacking multiple submodels, resulting in high computational overhead and limited real-time performance. 研究背景： 在三維環境中規劃與行動是真實世界機器人操作的基礎能力，但現有三維預測流規劃器依賴模組化多模型堆疊，計算開銷大且實時性能受限。

Technical Approach: To address these challenges, we introduce RoboFlow4D, a lightweight flow world model that unifies perception and planning by estimating temporal motion in physical 3D space. As an end-to-end framework, RoboFlow4D directly predicts multi-frame 3D flows from visual observations and textual instructions, providing explicit flow-based planning to guide action generation. This design allows seamless integration with general action policies, forming an efficient observation-planning-execution closed loop. 技術方法： 本文提出 RoboFlow4D，輕量流世界模型，透過統一感知與規劃直接在物理三維空間估計時間運動，端到端框架直接預測多幀三維流動作指令，避免模組化管線的累積誤差。

Key Takeaway: Extensive experiments in both simulation and real-world settings demonstrate that RoboFlow4D consistently improves manipulation success rates and computational efficiency, advancing flow-guided planning for embodied intelligence. 核心發現： RoboFlow4D 輕量流世界模型在保持高精度的同時實現三維操作的實時規劃。

Learning-Based Adaptive Control for Surgical Robotic Exposure Task on Deformable Tissues

Authors: Jiayi Liu, Kaiqi Wei, Yiwei Wang et al. | Submitted: 2026-05-18 | arXiv: 2605.17927 Categories: cs.RO

Research Background: In various surgical procedures, regions of interest (ROIs) such as organs or lesions are often occluded by overlying tissues, requiring surgeons to achieve adequate exposure for precise intervention. However, the irregular geometry, nonlinear biomechanical properties of overlying tissues, and limited intraoperative visibility of the ROI pose significant challenges to the autonomous execution of tissue retraction. 研究背景： 外科手術中感興趣區域常被覆蓋組織遮擋，需要外科醫生進行適當暴露。覆蓋組織的不規則幾何、非線性生物力學特性與有限術中可見性對自主組織牽引構成重大挑戰。

Technical Approach: To address this, we formulate a realistic model of the tissue retraction task and propose a learning-based adaptive control framework for achieving ROI exposure. The method optimizes control inputs online by monitoring changes in the visual boundary of the tissue, while leveraging a deep deformation estimation model trained on simulation data to identify the optimal grasping point and ensure the convergence and safety of the adaptive controller. Through simulations and real-world experiments on different deformable materials, it has been demons 技術方法： 本文提出學習型自適應控制框架實現感興趣區域暴露，建立真實組織牽引任務模型，最佳化整個操作過程中的 ROI 暴露，處理術中組織變形的不確定性。

Key Takeaway: Therefore, it has the potential to be applied in actual surgical assistance scenarios. 核心發現： 學習型自適應控制框架在真實手術場景中可靠地實現軟組織牽引的自主 ROI 暴露。

Dynamic robotic cloth folding with efficient Koopman operator-based model predictive control

Authors: Edoardo Caldarelli, Franco Coltraro, Adrià Colomé et al. | Submitted: 2026-05-18 | arXiv: 2605.18373 Categories: cs.RO, cs.LG, math.DS, math.OC

Research Background: Robotic cloth folding is a challenging task, particularly when considering dynamic folding tasks, which aim at folding cloth by fast motions that leverage its dynamics. When subject to such fast motions, the complexity of cloth dynamics hinders both system identification and planning of folding trajectories, resulting in a difficult simulation-to-reality transfer when using physical models of cloth. 研究背景： 機器人布料折疊是一項具挑戰性的任務，尤其是動態折疊任務，旨在利用快速運動利用布料動態。快速運動下布料動態複雜性阻礙系統識別與折疊軌跡規劃。

Technical Approach: Compared to the dexterity that humans exhibit when performing folding tasks, robotic approaches usually employ small garments with quite rigid dynamics, and are either too slow, or fast but imprecise, requiring several attempts to achieve a reasonably good fold. In this paper, we tackle these challenges by generating fast folding trajectories with a novel model predictive controller, integrating physics-based simulation of cloth dynamics and efficient, kernel-based Koopman operator regression. Koopman operator regression, an increasingly popula 技術方法： 本文利用 Koopman 算子建立布料動態的高效線性近似，基於 Koopman 算子的模型預測控制（MPC）規劃動態折疊軌跡，克服傳統模型的模擬到現實傳遞困難。

Key Takeaway: Both in simulated and real-robot experiments, we show how the linearization supplied by the Koopman operator-based model can be employed to efficiently generate fast folding trajectories to unseen poses, without sacrificing folding accuracy. 核心發現： Koopman 算子 MPC 在計算效率與軌跡品質之間取得良好平衡，實現可靠的動態布料折疊。

Unified Walking, Running, and Recovery for Humanoids via State-Dependent Adversarial Motion Priors

Authors: Yidan Lu, Yichao Zhong, Liu Zhao et al. | Submitted: 2026-05-18 | arXiv: 2605.18611 Categories: cs.RO

Research Background: We propose a unified reinforcement learning framework that enables a single policy to perform walking, running, and fall recovery on the Unitree G1 humanoid robot, validated on physical hardware without any explicit mode-switching command at deployment. The framework extends Adversarial Motion Priors (AMP) by replacing the conventional global reference distribution with a state-dependent gate that routes each training transition to one of two dis 研究背景： 大多數視覺語言操作研究針對固定形態的剛性機械臂，這限制了在雜亂或受限空間中的適應性。軟體機械臂提供替代方案，但面臨本體感知不可靠與分散式底層驅動的挑戰。

Technical Approach: The gate is defined by a single fixed threshold on projected gravity: the recovery discriminator is activated when body tilt exceeds approximately $3 7^{\circ}$ from vertical ( $∣ g_{z} + 1∣ > 0.6$ ); otherwise the locomotion discriminator is used, with the normalized commanded velocity serving as a condition that selects the appropriate reference trajectory between walk and run clips. Only three LAFAN1 reference clips are required to regularize the complete behavior set. At deployment, a single frozen ONNX policy executes at 50,Hz with no runtime mode lo 技術方法： 本文提出 ManiSoft，第一個針對軟體機械臂的視覺語言操作基準，配備結合真實軟體動態與接觸豐富互動的定制模擬器，評估現有 VLM 操作方法在軟臂上的表現。

Key Takeaway: At deployment, a single frozen ONNX policy executes at 50,Hz with no runtime mode logic; hardware experiments demonstrate successful recovery from both prone and supine falls and smooth walk-to-run transitions under the same controller. 核心發現： ManiSoft 揭示現有 VLM 操作方法在軟體機器人上的關鍵挑戰，推動軟臂操作研究。

ManiSoft: Towards Vision-Language Manipulation for Soft Continuum Robotics

Authors: Ziyu Wei, Luting Wang, Chen Gao et al. | Submitted: 2026-05-18 | arXiv: 2605.18617 Categories: cs.RO, cs.AI, cs.CV

Research Background: Most existing vision-language manipulation research targets rigid robotic arms, whose fixed morphology limits adaptability in cluttered or confined spaces. Soft robotic arms offer an appealing alternative due to their deformability, but confront challenges such as unreliable proprioception and distributed low-level actuation. 研究背景： Most existing vision-language manipulation research targets rigid robotic arms, whose fixed morphology limits adaptability in cluttered or confined spaces. Soft robotic arms offer an appealing alternative due to their deformability, but confront challenges such as unreliable proprioception and distributed low-level actuation.

Technical Approach: To investigate these challenges, we introduce \ManiSoft, a benchmark for vision-language manipulation with soft arms. ManiSoft features a tailored simulator that couples realistic soft-body dynamics with contact-rich interactions via an elastic force constraint. On this basis, ManiSoft defines four tasks, each highlighting distinct aspects of deformable control, from basic end-effector coordination to obstacle avoidance. 技術方法： To investigate these challenges, we introduce \ManiSoft, a benchmark for vision-language manipulation with soft arms. ManiSoft features a tailored simulator that couples realistic soft-body dynamics with contact-rich interactions via an elastic force constraint. On this basis, ManiSoft defines four tasks, each highlighting distinct aspects of deformable control, from basic end-effector coordination to obstacle avoidance.

Key Takeaway: Out codes and datasets are released at https://buaa-colalab.github.io/ManiSoft. 核心發現： Out codes and datasets are released at https://buaa-colalab.github.io/ManiSoft.

KG-ASG: Collision-Knowledge-Guided Closed-Loop Adversarial Scenario Generation With Primary-Support Attribution

Authors: Cheng Wang, Chen Xiong, Ziwen Wang et al. | Submitted: 2026-05-17 | arXiv: 2605.18895 Categories: cs.RO, cs.AI

Research Background: Safety validation of autonomous driving systems requires high-risk scenario coverage, clear collision semantics, executable trajectories, and attributable multi-vehicle interactions. Existing safety-critical scenario generation methods often rely on low-level trajectory perturbations, collision-proxy optimization, or single-adversary search, which may produce adversarial samples with ambiguous collision causes or uncontrolled multi-vehicle collis 研究背景： 自動駕駛系統安全驗證需要高風險場景覆蓋與清晰碰撞語義，現有方法常依賴低層軌跡擾動或單一對抗者搜索，產生碰撞原因模糊的對抗樣本。

Technical Approach: This paper proposes KG-ASG, a collision-knowledge-guided closed-loop adversarial scenario generation framework with primary-support attribution. KG-ASG constructs a structured collision knowledge base and trains a lightweight Collision Expert to infer the target collision mode, the unique primary adversary, support vehicles, and their interaction roles. Guided by this semantic prior, multi-vehicle adversarial generation is formulated as a primary-support process, where the primary adversary induces the main conflict and support vehicles shape t 技術方法： 本文提出 KG-ASG，碰撞知識引導的閉環對抗場景生成框架，結合主支車輛歸因，明確建模多車輛碰撞語義，生成碰撞原因清晰且可歸因的安全關鍵場景。

Key Takeaway: These results demonstrate that collision-knowledge guidance and primary-support single-collider reasoning improve adversarial effectiveness, interpretability, and executability for autonomous driving safety validation. 核心發現： 碰撞知識引導的場景生成提供語義清晰、碰撞可歸因的自動駕駛安全驗證場景。

EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Prediction

Authors: Ahmad Yehia, Abduallah Mohamed, Tianyi Wang et al. | Submitted: 2026-05-18 | arXiv: 2605.19004 Categories: cs.CV, cs.LG, cs.RO

Research Background: Accurately forecasting human trajectories from an egocentric perspective plays a central role in applications such as humanoid robotics, wearable sensing systems, and assistive navigation. However, progress in this direction remains limited due to the scarcity of egocentric trajectory datasets collected in real-world environments. 研究背景： 從自我中心視角精確預測人類軌跡在人形機器人、可穿戴感測系統與輔助導航應用中至關重要，但自我中心軌跡資料集稀缺制約了進展。

Technical Approach: Addressing this need, we introduce EgoTraj, an egocentric multimodal open dataset recorded using Meta Quest Pro (MQPro). EgoTraj contains 75 sequences of human navigation collected from multiple MQPro wearers in real-world urban environments. Each recording provides synchronized RGB video along with ground-truth data, including continuous time-synchronized 6-degree-of-freedom head poses, per-frame 3D eye gaze vectors, scene annotations. 技術方法： 本文提出 EgoTraj，使用 Meta Quest Pro 在真實城市環境中收集的自我中心多模態開放資料集，包含 75 個人類導航序列，提供影像、深度、IMU 與位置資料，支援多模態軌跡預測研究。

Key Takeaway: The EgoTraj dataset, code, and EgoViz Dashboard are publicly available at https://github.com/yehiahmad/EgoTraj. 核心發現： EgoTraj 填補了人形機器人與輔助導航研究所需的自我中心軌跡資料集空白。

Adversarial Stress Testing of SPARK Humanoid Safety Filters

Authors: Saurav Ghosh, Abdou Sow, Luke Zhang | Submitted: 2026-05-18 | arXiv: 2605.19009 Categories: cs.RO, eess.SY

Research Background: Humanoid robots are difficult to deploy safely because they have high-dimensional bodies, many collision constraints, and must operate near people and obstacles. Safety filters help by modifying a nominal control action when it may violate collision-avoidance constraints. 研究背景： 人形機器人因高維身體與眾多碰撞約束難以安全部署。安全過濾器透過在標稱控制動作可能違反約束時修改之來提供保障，但標稱基準得分無法充分展示在更困難環境中的行為。

Technical Approach: Still, nominal benchmark scores do not fully show how these filters behave in harder environments. In this work, we study the robustness of SPARK humanoid safety filters through replication and stress testing. We replicate the SPARK benchmark case G1SportMode_D1_WG_SO_v1 in MuJoCo and evaluate RSSA, RSSS, SSA, CBF, PFM, and SMA under controlled random seeds. 技術方法： 本文在 MuJoCo 中複現 SPARK 人形安全過濾器基準，並透過壓力測試評估 RSSA、RSSS、SSA、CBF、PFM 與 SPARK 等多種安全過濾器在不同難度環境下的魯棒性。

Key Takeaway: These findings suggest that humanoid autonomy should be evaluated beyond nominal performance, using metrics that expose failure modes before deployment. 核心發現： 壓力測試揭示各類人形機器人安全過濾器在具挑戰性環境下的差異化魯棒性。

Distributionally Robust Control via Stein Variational Inference for Contact-Rich Manipulation

Authors: Hrishikesh Sathyanarayan, Victor Vantilborgh, Harish Ravichandar et al. | Submitted: 2026-05-18 | arXiv: 2605.19029 Categories: cs.RO

Research Background: Reliable robotic manipulation requires control policies that can accurately represent and adapt to uncertainty arising from contact-rich interactions. Modern data-driven methods mitigate uncertainty through large-scale training and computation, and degrade significantly in performance with limited number of training samples. 研究背景： 可靠的機器人操作需要能準確表示並適應接觸豐富互動不確定性的控制策略，現代資料驅動方法在訓練樣本有限時性能大幅下降，傳統模型基礎控制器表示不確定性能力有限。

Technical Approach: By contrast, classical model-based controllers are computationally efficient and reliable, but their limited ability to represent task-relevant uncertainty can hinder performance in contact-rich interactions. In this work, we propose to expand the capabilities of model-based manipulation control through more flexible uncertainty modeling that retains performance while exactly adapting to uncertainty. Our approach casts the manipulation problem as a distributionally robust control optimization and proposes a novel deterministic formulation based 技術方法： 本文提出基於 Stein 變分推斷的分佈魯棒控制，擴展模型基礎控制器的任務相關不確定性表示能力，兼顧計算效率與在接觸豐富互動中的可靠性。

Key Takeaway: Experimental results demonstrate up to 3 $\times$ improved robustness across a range of contact-rich manipulation tasks under broad parametric uncertainty, outperforming existing model-based control methods. 核心發現： Stein 變分推斷分佈魯棒控制在小樣本接觸豐富操作中優於純資料驅動與純模型基礎方法。

Guiding Neuro-Symbolic Scenario Generation with Spatio-Temporal Logic

Authors: Lorenzo Bonin, Francesco Giacomarra, Luca Bortolussi et al. | Submitted: 2026-05-18 | arXiv: 2605.19038 Categories: cs.RO, cs.LG

Research Background: The rapid advancement of autonomous driving (AD) technologies has outpaced the development of robust safety evaluation methods. Conventional testing relies on exposing AD systems to vast numbers of real-world traffic scenes — a brute-force approach that is prohibitively expensive and statistically ineffective at capturing the rare, safety-critical edge cases essential for validating real-world robustness. 研究背景： 自動駕駛技術的快速發展超越了穩健安全評估方法的開發。傳統測試依賴大量真實場景，對捕捉安全關鍵邊緣案例效率極低。

Technical Approach: To address this fundamental limitation, we introduce STRELGen, a scalable framework for the targeted generation of safety-critical driving scenarios. STRELGen synergistically combines a multi-agent trajectory-generation diffusion model (DM) with Spatio-Temporal Logic (STREL) specifications that encode complex safety and realism properties through a highly interpretable formalism. Crucially, monitoring satisfaction levels of these specifications is differentiable, enabling gradient-based search. 技術方法： 本文提出 STRELGen，結合時空邏輯約束規範與神經符號生成的可擴展安全關鍵駕駛場景生成框架，針對性生成滿足形式化安全規格的對抗場景。

Key Takeaway: STRELGen thus provides a flexible, interpretable, and powerful tool for stress-testing autonomous driving systems, moving beyond the limitations of brute-force data collection. 核心發現： 時空邏輯引導的神經符號生成提供形式化可控的安全關鍵自動駕駛場景生成能力。

Automatically Improving Simulation Physics for Articulated Objects

Authors: Anh-Quan Pham | Submitted: 2026-05-18 | arXiv: 2605.19136 Categories: cs.RO

Research Background: Simulation is a central tool for scalable robot learning, but its effectiveness depends on the quality of object assets. While modern 3D datasets provide rich geometric and kinematic representations, they typically lack the physical properties required for stable and realistic interaction, requiring significant manual effort to construct simulation-ready articulated objects. 研究背景： 模擬是可擴展機器人學習的核心工具，但其有效性取決於物件資產品質。現代三維資料集提供幾何與運動學表示，但通常缺乏穩定真實互動所需的物理屬性。

Technical Approach: In this thesis, we introduce interaction-readiness, which characterizes whether an object can be reliably simulated under manipulation. We propose a quantitative evaluation framework that decomposes interaction-readiness into measurable components, enabling systematic analysis of object quality and revealing failure modes not captured by conventional evaluation. We further present a multi-modal, simulator-in-the-loop approach for generating interaction-ready articulated objects from incomplete 3D assets. 技術方法： 本文引入互動就緒性概念，描述物件能否在操作下被可靠模擬，提出量化評估框架分解互動就緒性，並開發自動改善關節物件物理屬性使其適合模擬的方法。

Key Takeaway: Overall, this thesis demonstrates the importance of physical realism for articulated objects in simulation and introduces a practical multi-modal refinement approach, guided by simulator feedback, for constructing such objects at scale. 核心發現： 自動改善關節物件模擬物理屬性的方法顯著降低建構高品質模擬訓練資產的人工成本。

Graph Neural Planning and Predictive Control for Multi-Robot Communication-Constrained Unlabeled Motion Planning

Authors: Manohari Goarin, Yang Zhou, Giuseppe Loianno | Submitted: 2026-05-19 | arXiv: 2605.19209 Categories: cs.RO, cs.MA

Research Background: The multi-robot unlabeled motion planning problem of concurrently assigning robots to goals and generating safe trajectories is central in many collaborative tasks. Recent Graph Neural Network methods offer scalable decentralized solutions but rely on simplified dynamics and simulation environments, overlooking key challenges of real-world deployment such as dynamic feasibility and communication constraints. 研究背景： 多機器人無標籤運動規劃需同時分配機器人至目標並生成安全軌跡，近期圖神經網路方法提供可擴展去中心化方案，但依賴簡化動態並忽略通訊約束等真實部署挑戰。

Technical Approach: To address these gaps, we propose a hierarchical framework that combines a Graph ATtention Planner (GATP) with a decentralized Nonlinear Model Predictive Controller (NMPC). GATP provides intermediate subgoals through multi-robot cooperation, and the NMPC enforces safety under nonlinear dynamics and actuation constraints. We evaluate our framework in both simulation and real-world quadrotor experiments. 技術方法： 本文提出結合圖注意力規劃器（GATP）與去中心化非線性模型預測控制器（NMPC）的層次框架，GATP 提供協調指導，NMPC 確保動態可行性，共同處理通訊約束下的真實部署。

Key Takeaway: Thanks to attention mechanisms and minimal communication requirements, we demonstrate improved generalization to larger teams, robustness to communication delays up to 200 ms and practical feasibility with decentralized on-board inference. 核心發現： GATP 與 NMPC 層次組合解決通訊受限多機器人運動規劃的動態可行性與協調挑戰。

ContextFlow: Hierarchical Task-State Alignment for Long-Horizon Embodied Agents

Authors: Shuhan Guo, Kun Zhang, Haifei Liu et al. | Submitted: 2026-05-19 | arXiv: 2605.19314 Categories: cs.RO, cs.AI

Research Background: Long-horizon embodied agents increasingly delegate navigation, search, approach, and manipulation to specialist executors. As these executors become stronger, the main bottleneck shifts from local skill execution to maintaining a coherent task frontier across planning, monitoring, memory, and execution. 研究背景： 長時域具身智能體的主要瓶頸已從局部技能執行轉移到跨規劃、監控、記憶與執行維持連貫任務前沿。任務狀態不對齊是一種任務層級一致性失敗。

Technical Approach: We study task-state misalignment, a task-level consistency failure in which the planner’s active stage, runtime evidence, remembered context, and delegated executor no longer justify the same next-step decision. This failure can lead to unsupported handoffs, stage lock, executor-context mismatch, and unnecessary replanning. We propose ContextFlow, an inspectable alignment framework that represents stages as explicit contracts, converts runtime observations into evidence packets, and applies scoped updates including continue, refine, transfer, p 技術方法： 本文提出 ContextFlow，針對長時域具身智能體的層次任務狀態對齊框架，研究規劃者當前階段、執行時證據、記憶情境與委托執行器之間的一致性，透過顯式任務前沿追蹤防止狀態不對齊。

Key Takeaway: Experiments and demonstration traces on long-horizon embodied tasks illustrate how evidence-grounded scoped updates diagnose and mitigate recurring task-state failures. 核心發現： ContextFlow 層次任務狀態對齊框架顯著減少長時域具身智能體中的任務層級一致性失敗。

RoboJailBench: Benchmarking Adversarial Attacks and Defenses in Embodied Robotic Agents

Authors: Doguhuan Yeke, Yanming Zhou, Leo Y. Lin et al. | Submitted: 2026-05-19 | arXiv: 2605.19328 Categories: cs.CR, cs.RO

Research Background: Recent advances in Vision-Language Models (VLMs) facilitate a new class of embodied AI systems, where these models are integrated into physical platforms, e.g. robots and autonomous vehicles, to interpret visual scenes and execute natural language commands in diverse environments. 研究背景： VLM 驅動的具身 AI 系統在解讀視覺場景並執行自然語言命令時，面臨越獄攻擊的安全威脅。現有評估依賴特設資料集、指標有限且忽略安全與良性命令遵循之間的權衡。

Technical Approach: Previous research has introduced jailbreak attacks and defenses for embodied AI. Their evaluations, however, rely on ad-hoc datasets, limited metrics, and emphasize attack success while neglecting the trade-off between security and the ability to follow benign commands. Existing benchmarks and evaluation frameworks either target traditional chat-based models or focus on non-adversarial safety evaluation for embodied AI; neither captures the adversarial risks, inputs, consequences, and evaluation criteria necessary for jailbreak attacks in embod 技術方法： 本文提出 RoboJailBench，具身機器人智能體對抗攻擊與防禦的系統性基準，提供標準化評估資料集、全面指標，並明確評估攻擊成功率與良性功能性之間的權衡。

Key Takeaway: We release our code, datasets, and artifacts, and maintain a leaderboard at https://purseclab.github.io/benchmark-for-robotics-security. 核心發現： RoboJailBench 提供具身 AI 安全評估的標準化框架，填補現有基準的系統性空白。

Self-assembling Modular Aerial Robot for Versatile Aerial Tasks

Authors: Junichiro Sugihara, Masaki Kitagawa, Jinjie Li et al. | Submitted: 2026-05-19 | arXiv: 2605.19431 Categories: cs.RO

Research Background: Multirotor aerial robots excel at maneuvering in three-dimensional space, and recent advances enable nimble navigation in cluttered and confined environments, especially for small airframes. By contrast, platforms built for high-altitude work tend to be larger to deliver high thrust for stable physical interaction with the environment. 研究背景： 多旋翼無人機擅長三維空間機動，但靈活小型機與高推力大型機之間存在長期設計矛盾，難以同時實現敏捷導航與穩健空中操作。

Technical Approach: However, these conflicting design requirements create a long-standing trade-off between nimble navigation and robust aerial manipulation. Here, we present LEGION units, which are reconfigurable modular aerial robots capable of in-flight self-assembly for cooperative manipulation, drawing inspiration from the self-organized collectives formed by ants. Each unit retains nimble maneuverability while joint-equipped docking interfaces at both ends enable end-to-end self-assembly into a flying manipulator. 技術方法： 本文提出 LEGION 模組化可重構無人機單元，支援飛行中自組裝，小型時靈活穿越受限環境，組合後提供高推力執行空中操作，動態適應任務需求的形態變化。

Key Takeaway: LEGION’s self-organization enables aerial robots, especially in swarms, to shift from passive observers to active participants in their environment, broadening the scope of aerial physical interaction. 核心發現： 可重構模組化無人機透過飛行中自組裝突破靈活性與操作能力的固有設計矛盾。

Sampling-Based Safe Reinforcement Learning

Authors: Luca Vignola, Bruce D. Lee, Manish Prajapat et al. | Submitted: 2026-05-19 | arXiv: 2605.19469 Categories: cs.LG, cs.AI, cs.RO

Research Background: Safe exploration remains a fundamental challenge in reinforcement learning (RL), limiting the deployment of RL agents in the real world. We propose Sampling-Based Safe Reinforcement Learning (SBSRL), a model-based RL algorithm that maintains safety throughout the learning process by enforcing constraints jointly across a finite set of dynamics samples. 研究背景： 安全探索仍是強化學習的根本挑戰，限制了 RL 智能體在真實世界的部署。在不確定動態下強制執行安全約束的實用方法尤為關鍵。

Technical Approach: This formulation approximates an intractable worst-case optimization over uncertain dynamics and enables practical safety guarantees in continuous domains. We further introduce an exploration strategy based on constraining epistemic uncertainty, eliminating the need for explicit exploration bonuses. Under regularity conditions, we derive high-probability guarantees of safety throughout learning and a finite-time sample complexity bound for recovering a near-optimal policy. 技術方法： 本文提出 SBSRL，透過在有限動態樣本集上聯合強制執行約束，以可處理最壞情況最佳化的近似實現連續域的實用安全保證，並引入基於認知不確定性約束的探索策略。

Key Takeaway: Empirically, SBSRL achieves safe and efficient exploration both in simulation and in real robotic hardware, and readily extends to practical deep-ensemble implementations that scale to high-dimensional continuous control problems. 核心發現： 基於取樣的安全 RL 在不確定動態下提供連續域的實用安全探索保證。

ARC-RL: A Reinforcement Learning Playground Inspired by ARC Raiders

Authors: Carlo Romeo, Andrew D. Bagdanov | Submitted: 2026-05-19 | arXiv: 2605.19503 Categories: cs.RO, cs.AI, cs.LG

Research Background: Reinforcement learning for legged locomotion has matured into a stack of multi-component reward functions and physics-engine benchmarks whose morphologies are uniformly derived from real commercial hardware. Game NPCs, however, are bound by stylistic constraints absent from sim-to-real robotics and routinely take the form of creatures with no real-robot counterpart. 研究背景： 足式運動學習已成熟為多元件獎勵函數與物理引擎基準的組合，現有形態均源自真實商業硬體。遊戲 NPC 受風格約束，常採用無真實機器人對應的形態。

Technical Approach: We introduce ARC-RL, a suite of four MuJoCo continuous-control environments featuring robotic morphologies inspired by the bestiary of ARC Raiders: the 18-DoF tall hexapod Queen, the 12-DoF armoured hexapod Bastion, the 18-DoF compact hexapod Tick, and the 12-DoF quadruped Leaper. All four robots share a unified observation template, action convention, simulation cadence, and a single closed-form multi-component reward function whose only per-morphology variation lives in a small set of weights and parameters. The reward fuses a velocity-tracki 技術方法： 本文提出 ARC-RL，四個受 ARC Raiders 啟發的機器人形態 MuJoCo 連續控制環境（18 自由度高腿六足 Queen、12 自由度裝甲六足 Bastion 等），測試 RL 算法在非標準形態上的泛化能力。

Key Takeaway: Source code is available at https://github.com/CarloRomeo427/ARC_RL.git. 核心發現： ARC-RL 提供多樣非標準機器人形態的 RL 基準，推動超越真實硬體形態的算法泛化研究。

Learning-Accelerated Optimization-based Trajectory Planning for Cooperative Aerial-Ground Handover Missions

Authors: Jingshan Chen, Bochen Yu, Henrik Ebel et al. | Submitted: 2026-05-19 | arXiv: 2605.19562 Categories: cs.RO, cs.LG, math.OC

Research Background: This paper presents a learning-augmented trajectory planning framework for cooperative unmanned aerial vehicle (UAV) and unmanned ground vehicle (UGV) handover missions. While centralized trajectory optimization ensures dynamic feasibility and task optimality, its high computational cost limits real-time applicability. 研究背景： 無人機與地面車協作遞交任務的集中式軌跡最佳化確保動態可行性與任務最優性，但高計算成本限制了實時適用性。

Technical Approach: We propose a neural surrogate planner utilizing decoupled encoder-decoder long short-term memory (LSTM) networks to generate coordinated handover trajectory predictions from the task specifications. These predictions serve as informed warm starts for the downstream centralized optimizer, thereby accelerating convergence to dynamically feasible solutions. Benchmark evaluations demonstrate that the learning-augmented planning framework achieves more than a threefold speedup and 100% optimization success rate compared to cold start optimization. 技術方法： 本文提出學習增強軌跡規劃框架，利用解耦編解碼器 LSTM 神經代理規劃器從任務規格生成協調遞交軌跡預測，作為後端集中最佳化的熱啟動，顯著降低計算成本。

Key Takeaway: The results indicate that combining data-driven inference with model-based refinement enables fast and reliable trajectory generation for heterogeneous multi-robot systems. 核心發現： 神經代理規劃器熱啟動使無人機-地面車協作遞交任務軌跡最佳化達到實時可行性。

Implicit Action Chunking for Smooth Continuous Control

Authors: Bosun Liang, Shuo Pei, Zirui Chen et al. | Submitted: 2026-05-19 | arXiv: 2605.19592 Categories: cs.RO, cs.AI

Research Background: Reinforcement learning often produces high-frequency oscillatory control signals that undermine the safety and stability required for physical deployment. Explicit action chunking addresses this by predicting fixed-horizon trajectories but scales the policy output dimension proportionally with the horizon length, leading to optimization difficulties and incompatibility with standard step-wise interaction. 研究背景： 強化學習常產生高頻震盪控制訊號，損害物理部署所需的安全與穩定性。顯式動作分塊解決此問題但輸出維度隨時域線性擴展，導致最佳化困難。

Technical Approach: To overcome these challenges, this paper proposes Dual-Window Smoothing (DWS), an implicit action chunking framework for smooth continuous control. Unlike explicit methods, DWS enforces temporal coherence without expanding the action space. It uses a dual-window design: an execution window that ensures physical smoothness through deterministic modulation, and a value window that aligns temporal-difference targets over the horizon to correct critic bias caused by open-loop execution. 技術方法： 本文提出 DWS（雙窗口平滑），隱式動作分塊框架，不增加策略輸出維度，透過雙時域窗口約束在標準步進互動中強制執行時域平滑，與標準 RL 訓練兼容。

Key Takeaway: In complex vision-based autonomous driving tasks, DWS achieves smoother control, safer behavior with reduced jitter, and attains a 100% success rate. 核心發現： DWS 隱式動作分塊在不增加輸出維度的情況下有效消除 RL 控制訊號的高頻震盪。

HEAT: Heterogeneous End-to-End Autonomous Driving via Trajectory-Guided World Models

Authors: Hoonhee Cho, Giwon Lee, Jae-Young Kang et al. | Submitted: 2026-05-19 | arXiv: 2605.19631 Categories: cs.RO, cs.CV

Research Background: End-to-end autonomous driving has emerged as a compelling alternative to traditional modular pipelines by directly mapping raw sensor data to driving actions. While recent approaches achieve strong performance on single-domain datasets, their performance degrades significantly when trained jointly across multiple heterogeneous domains. 研究背景： 端到端自動駕駛已成為傳統模組管線的有力替代，但在異質多域資料集聯合訓練時性能大幅下降，真實部署需跨不同城市、感測器配置與交通模式的泛化能力。

Technical Approach: In practice, however, autonomous systems must operate across diverse environments with heterogeneous distributions, including different cities, sensor configurations, and traffic patterns, without domain-specific retraining. This gap highlights a key challenge in multi-domain learning: domain-specific variations across heterogeneous domains introduce conflicting learning signals, driving models toward compromised solutions that are suboptimal across domains. To address this, we propose a trajectory-driven learning paradigm that organizes traini 技術方法： 本文提出 HEAT，基於軌跡引導世界模型的異質端到端自動駕駛框架，利用世界模型捕捉跨域環境演化規律，透過軌跡引導對齊多域表示，實現跨異質域的性能維持。

Key Takeaway: We will make our code publicly available. 核心發現： 軌跡引導世界模型讓端到端自動駕駛在多異質域聯合訓練後仍維持強勁性能。

Authors: Shintaro Nakaoka, Takayuki Kanai, Kazuhito Tanaka | Submitted: 2026-05-19 | arXiv: 2605.19690 Categories: cs.RO

Research Background: Navigation Foundation Models (NFMs) trained on large cross-embodied datasets have demonstrated powerful generalizability in various scenarios. Adopting in-domain fine-tuning for an NFM efficiently calibrates the visuomotor policy, promising further improvement even in a novel scenario. 研究背景： 在大規模跨具身資料集上訓練的導航基礎模型（NFM）展現出強大的泛化能力，域內微調可進一步改善新場景性能，但現有微調方法存在障礙規避差或目標到達失敗問題，且小資料集微調會侵蝕預訓練先驗。

Technical Approach: However, the fine-tuned models still suffer from poor obstacle avoidance or fail to properly reach the provided goals. Furthermore, model updates using a small subset of data typically erode the pre-trained prior, compromising the pre-training generalization. Consequently, fine-tuning deteriorates the capability of the model for robust and accurate navigation. 技術方法： 本文提出 D-CLING，深度條件先驗保留微調方法，引入深度感知微調正則化防止過擬合，同時保留預訓練泛化先驗，在障礙規避與目標到達之間取得平衡。

Key Takeaway: The project page: https://toyotafrc.github.io/DCLING-Proj/ 核心發現： D-CLING 深度條件微調在提升域內性能的同時有效保留導航基礎模型的預訓練泛化能力。

Beyond Action Residuals: Real-World Robot Policy Steering via Bottleneck Latent Reinforcement Learning

Authors: Dongjie Yu, Kun Lei, Zhennan Jiang et al. | Submitted: 2026-05-19 | arXiv: 2605.19919 Categories: cs.RO

Research Background: Pretrained imitation policies have become a strong foundation for robot manipulation, but they often require online improvement to overcome execution errors, limited dataset coverage, and deployment mismatch. A central question is therefore how reinforcement learning (RL) should adapt policies after offline pretraining. 研究背景： 預訓練模仿策略為機器人操作提供了強大基礎，但常需要線上改善以克服執行錯誤與部署不匹配。如何透過 RL 適應預訓練後策略是核心問題。

Technical Approach: Existing lightweight methods commonly apply residual corrections directly in action space, but this often leads to noisy and poorly structured exploration. In this work, we propose Z-Perturbation Reinforcement Learning (ZPRL), an approach that steers pretrained policies through a compact bottleneck latent rather than through policy weights or output actions. During offline training, we augment the policy with a plug-and-play variational information bottleneck (VIB) module to extract a task-relevant latent interface from observation embeddings. 技術方法： 本文提出 ZPRL（Z 擾動強化學習），在瓶頸潛在空間而非動作空間施加擾動引導預訓練策略，避免動作空間直接殘差修正的雜訊與結構不良探索，實現更有效的線上 RL 精化。

Key Takeaway: More videos can be found at https://manutdmoon.github.io/ZPRL/. 核心發現： 潛空間擾動 RL 比動作空間殘差修正更有效地在真實機器人上精化預訓練模仿策略。

RoHIL: Robust Human-in-the-Loop Robotic Reinforcement Learning Against Illumination Variations

Authors: Shuoqin Zhang, Yixin Xiong, Xiru Gao et al. | Submitted: 2026-05-19 | arXiv: 2605.19924 Categories: cs.RO

Research Background: Human-in-the-loop reinforcement learning systems achieve near-perfect success on the workstation where they are trained, but collapse when the same robot is moved to a workstation a few meters away due to shifts in the visual input distribution caused by new lamp positions and window light. Re-collecting demonstrations and re-running HIL on every workstation is incompatible with deployment, and naively fine-tuning on shifted-light data triggers c 研究背景： 人在迴路強化學習系統在訓練工作站上幾乎完美，但移動至不同工作站後因視覺輸入分佈偏移而崩潰，跨工作站重新收集示範的成本與災難性遺忘問題制約部署。

Technical Approach: To close this cross-domain gap, we present RoHIL, an offline fine-tuning framework that uses no extra real-robot interaction. RoHIL combines (i) a world-model-based image relighter that re-synthesises the visual stream of source-workstation trajectories under multiple virtual HDRI environments, leaving actions and rewards real; (ii) Illumination-Retention Replay (IRR), a data-level anti-forgetting mechanism that interleaves relit adaptation transitions with original-light retention transitions to preserve source-workstation Bellman coverage; an 技術方法： 本文提出 RoHIL，利用無外部干預的域適應技術在偏移光照資料上進行離線微調，在適應新視覺條件的同時防止對原始工作站的災難性遺忘。

Key Takeaway: Project page: https://anonymous4365.github.io/RoHIL/ 核心發現： RoHIL 使 HIL-RL 機器人系統在無需重新收集示範的情況下適應跨工作站視覺分佈偏移。

World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Tasks

Authors: Zuyao Lin, Jianhui Zhang, Peidong Jia et al. | Submitted: 2026-05-19 | arXiv: 2605.19957 Categories: cs.CV, cs.AI, cs.RO

Research Background: World models are widely explored in embodied intelligence, yet they typically predict distinct evolutions of the world and the ego within a single stream, where the world captures persistent instruction-agnostic scene regularities and the ego captures robot-centric instruction-conditioned dynamics. This world-ego entanglement leads to a degradation in long-horizon embodied scenarios, particularly in hybrid tasks with interleaved navigation and ma 研究背景： 具身智能的世界模型通常在單一流中預測世界與自我的不同演化，但世界與自我的耦合在長時域具身場景（尤其是交替導航與操作的混合任務）中導致性能退化。

Technical Approach: In this paper, we introduce \emph{World-Ego Modeling}, a new conceptual paradigm that decomposes future evolution into world and ego components. We define the world-ego boundary from three perspectives, i.e., motion-, semantic-, and intention-based views, and analyze three disentanglement strategies with post-, pre-, and full disentanglement. Further, we instantiate this paradigm as the World-Ego Model (WEM), a unified embodied world model that couples an implicit separate world-ego planner with a cascade-parallel mixture-of-experts (CP-MoE) di 技術方法： 本文提出世界-自我建模，將未來演化分解為環境世界流（持久場景規律）與機器人自我流（指令條件動態），透過雙流解耦架構分別建模並在推理時協調，提升長時域混合任務性能。

Key Takeaway: Extensive experiments show that WEM achieves state-of-the-art performance on HTEWorld while remaining competitive on existing manipulation-only benchmarks. 核心發現： 世界-自我分解建模顯著提升長時域交替導航-操作混合任務中的具身智能性能。

Adaptive Human-Robot Collaboration for Masonry Construction Under Material and Assembly Uncertainty

Authors: Jutang Gao, Arash Adel | Submitted: 2026-05-18 | arXiv: 2605.20264 Categories: cs.RO, cs.HC

Research Background: Human-robot collaboration in construction is often challenged by limited robot-to-human communication and the need to adapt to tolerance accumulation arising from material and assembly uncertainties. We present an adaptive human-robot collaborative workflow for masonry construction that addresses communication limitations and tolerance accumulation, demonstrated through a brickwork case study in which a robot places bricks while a human applies a 研究背景： 建築業人機協作面臨機器人對人類通訊有限與因材料及組裝不確定性積累的公差容忍問題。

Technical Approach: This workflow is enabled by two complementary mechanisms: 1) an end-effector-mounted projector that provides spatially registered, just-in-time projection guidance for manual adhesive application, and 2) laser scanning for feedback-driven grasping and placement pose correction. Together, these mechanisms enable adjustment of human and robotic actions in response to material variability and accumulated assembly tolerances. Full-scale experiments across conventional running-bond and nonstandard configurations demonstrate that projection guidance 技術方法： 本文提出自適應人機協作砌磚施工流程，末端執行器安裝投影儀提供空間註冊的即時視覺引導，補充機器人對人類的通訊不足，同時開發動態公差補償機制處理材料不確定性，並通過磚砌案例研究驗證。

Key Takeaway: These results indicate that integrating spatial projection with feedback-driven adaptation, enabled by material and as-built sensing, can mitigate tolerance accumulation and improve precision and robustness in human-robot collaborative construction. 核心發現： 投影儀輔助視覺引導與公差補償使人機協作砌磚在材料與組裝不確定性下可靠執行。

Authors: Isaac Ngui, Courtney McBeth, James D. Motes et al. | Submitted: 2026-05-19 | arXiv: 2605.20395 Categories: cs.RO

Research Background: A fundamental challenge in multi-robot motion planning is achieving sufficient coordination to avoid inter-robot conflicts without incurring the large computational expense of searching the joint configuration space of the robot group. In this work, we present a method for multiple mobile robot motion planning that achieves an improvement in planning time up to an order of magnitude by leveraging the insight that we can use discrete search over a 研究背景： 多機器人運動規劃的根本挑戰在於在避免衝突的充分協調與搜索聯合構型空間的巨大計算成本之間取得平衡。

Technical Approach: In this work, we present a method for multiple mobile robot motion planning that achieves an improvement in planning time up to an order of magnitude by leveraging the insight that we can use discrete search over a workspace decomposition to provide coordination between robots during planning. While prior work uses workspace topology to inform when coordination between robots is needed and then composes robots into their joint configuration space, we take a step further by iteratively refining our workspace representation to allow our planner t 技術方法： 本文提出層次子問題擴展與工作空間分解精化方法，利用工作空間分解的離散搜索為規劃提供機器人間協調，達到比現有方法快一個數量級的規劃速度提升。

Key Takeaway: While prior work uses workspace topology to inform when coordination between robots is needed and then composes robots into their joint configuration space, we take a step further by iteratively refining our workspace representation to allow our planner to search smaller, decoupled configuration spa 核心發現： 工作空間分解引導的層次規劃框架將多移動機器人運動規劃速度提升一個數量級。

Enhancing Graph-Based SLAM in GNSS-Denied environments by leveraging leg odometry

Authors: Léon Perruchot-Triboulet, Luc Jaulin, Kai Xiao | Submitted: 2026-05-19 | arXiv: 2605.20484 Categories: cs.RO

Research Background: Autonomous navigation in GNSS-denied environments remains a core challenge for legged robots, where exteroceptive sensors such as LiDAR are prone to elevation drift in geometrically sparse or repetitive scenes. We present a factor graph architecture that augments the LIO-SAM framework with a parallel kinematic lane driven by proprioceptive leg odometry, coupled to the main LiDAR-inertial lane via an identity relative pose constraint with a select 研究背景： GNSS 被拒環境中的自主導航對足式機器人仍是核心挑戰，LiDAR 等外感知感測器在幾何稀疏或重複場景中易出現高程漂移。

Technical Approach: We present a factor graph architecture that augments the LIO-SAM framework with a parallel kinematic lane driven by proprioceptive leg odometry, coupled to the main LiDAR-inertial lane via an identity relative pose constraint with a selective noise model. Applied to a Linxai D50 quadruped platform across two outdoor loops totaling over one kilometer, our approach reduces elevation drift from over 30m to under 30cm and enables convergence in a scene where the baseline pipeline fails entirely. These results suggest that proprioceptive data, alrea 技術方法： 本文提出因子圖架構，以平行運動學通道（由本體感知腿部里程計驅動）增強 LIO-SAM 框架，透過選擇性雜訊模型的身份相對位姿約束與主 LiDAR-慣性通道耦合，在複雜室外環境中降低高程漂移。

Key Takeaway: These results suggest that proprioceptive data, already computed onboard for gait control, constitutes a lightweight and effective vertical anchor for SLAM in GNSS-denied settings. 核心發現： 本體感知腿部里程計輔助因子圖 SLAM 顯著降低四足機器人在 GNSS 被拒環境中的高程漂移。

Conflict-Aware Active Perception and Control in 3D Gaussian Splatting Fields via Control Barrier Functions

Authors: Amirhossein Mollaei Khass, Athanasios Cosse, Vivek Pandey et al. | Submitted: 2026-05-19 | arXiv: 2605.20566 Categories: cs.RO

Research Background: Active perception in uncertain environments requires robots to navigate safely while acquiring informative observations to reduce map uncertainty. These objectives inherently conflict, as informative viewpoints often lie near uncertain regions with higher collision risk. 研究背景： 主動感知在不確定環境中需要機器人在安全導航同時獲取信息豐富的觀測以降低地圖不確定性，但兩個目標固有衝突：信息豐富的視角常位於不確定性高的區域。

Technical Approach: To address this challenge, we develop a conflict-aware active perception and control framework for robotic systems operating in environments represented by 3D Gaussian Splatting (3DGS). Safety is enforced using a Control Barrier Function (CBF) derived from an Average Value-at-Risk AV@R collision-risk metric that accounts for geometric uncertainty and guarantees forward invariance of a safe set. To improve perception, we propose a risk-aware Expected Information Gain (EIG) formulation for selecting the next-best-view and introduce perception bar 技術方法： 本文在三維高斯散射（3DGS）環境表示下開發衝突感知主動感知控制框架，以基於 AV@R 碰撞風險度量的控制障礙函數（CBF）強制執行安全，同時最大化地圖不確定性降低。

Key Takeaway: Simulation results demonstrate that the proposed method improves both safety and information acquisition compared to existing 3DGS-based approaches. 核心發現： 衝突感知 CBF 框架在 3DGS 環境中優雅平衡主動感知的安全性與信息豐富性。

Time-To-Reach Separation and Safety Filtering for Safe, Fair, and Efficient Multi-Agent Coordination

Authors: Matthew Low, Jasmine Jerry Aloor, Victoria Marie Tuck et al. | Submitted: 2026-05-20 | arXiv: 2605.20625 Categories: eess.SY, cs.MA, cs.RO

Research Background: Advanced Air Mobility (AAM) operations are expected to significantly increase aerial traffic in urban airspace, requiring autonomous traffic management systems to ensure collision-free operations in highly congested environments. In this paper, we propose a multi-agent coordination framework that uses minimum time-to-reach (TTR) as a unifying metric for priority assignment, temporal separation, and safety filtering. 研究背景： 先進空中交通（AAM）預計大幅增加城市空域航班密度，需要自主交通管理系統確保高度擁擠環境中的無衝突運行。

Technical Approach: We focus on the problem of coordinating multiple aerial vehicles merging into an air corridor while maintaining safe separation between vehicles. Vehicles are assigned arrival-consistent priority based on TTR, and target TTR values are used to enforce temporal spacing that induces spatial separation. A priority-consistent safety filtering layer based on Hamilton-Jacobi reachability value functions ensures collision avoidance while minimally modifying the reference guidance. 技術方法： 本文提出以最小到達時間（TTR）作為優先級分配、時間分離與安全過濾統一度量的多智能體協調框架，聚焦多架飛行器合併進入空中走廊的協調問題，同時維持飛行器間安全間隔。

Key Takeaway: Simulation results in a highly congested corridor merging scenario show that the proposed method improves safety, fairness, and efficiency compared to time-optimal guidance and priority-agnostic safety filtering. 核心發現： TTR 統一度量多智能體框架在高密度城市空中交通中提供公平、安全且高效的協調。

Authors: Mohamed Khair Altrabulsi, Nouhaila Innan, Alberto Marchisio et al. | Submitted: 2026-05-20 | arXiv: 2605.20801 Categories: cs.RO, quant-ph

Research Background: Adaptive robot navigation in dynamic environments requires policies that can reach the target reliably while producing efficient and stable trajectories. This paper presents Q-SpiRL, a quantum spiking reinforcement learning framework for obstacle-aware robot navigation. 研究背景： 動態環境中的自適應機器人導航需要策略能可靠到達目標同時產生高效穩定的軌跡。量子強化學習與脈衝神經網路的結合為資源高效導航控制提供新途徑。

Technical Approach: The framework develops and evaluates five agent families: tabular Q-learning, classical MLP, classical SNN, quantum-enhanced MLP (QMLP), and quantum-enhanced spiking neural network (QSNN). While all models are implemented under a unified training and evaluation pipeline, the QSNN is the central architecture of interest, as it combines spike-based temporal processing with variational quantum feature transformation. Experiments are conducted across three grid-world environments of increasing size, namely 20x20, 30x30, and 40x40, with both static 技術方法： 本文提出 Q-SpiRL，量子脈衝強化學習導航框架，比較五種智能體家族（表格 Q 學習、MLP、SNN、量子 MLP、量子 SNN），量子脈衝神經網路（QSNN）在計算效率與軌跡品質之間取得優異平衡。

Key Takeaway: Execution on IBM quantum hardware further demonstrates the feasibility of deploying the proposed hybrid policy under real-device conditions. 核心發現： 量子脈衝神經網路在障礙規避機器人導航中兼顧計算效率與軌跡品質。

DISC: Decoupling Instruction from State-Conditioned Control via Policy Generation

Authors: Hanxiang Ren, Pei Zhou, Xunzhe Zhou et al. | Submitted: 2026-05-20 | arXiv: 2605.20856 Categories: cs.RO, cs.AI, cs.LG

Research Background: Language-conditioned manipulation policies typically process instructions and observations through shared network parameters. This task-state entanglement provides a pathway for observation leakage — networks learn scene-to-action shortcuts that bypass language grounding entirely. 研究背景： 語言條件操作策略通常透過共享參數處理指令與觀測，這種任務狀態耦合為觀測洩漏提供了通道：網路學習繞過語言定位的場景到動作捷徑。

Technical Approach: DISC eliminates this failure structurally. Rather than conditioning a universal policy on language, DISC uses a hypernetwork to generate the entire parameter set of a task-specific visuomotor policy from the instruction alone. The generated policy never directly accesses language; therefore, its task-awareness must come from the language. 技術方法： 本文提出 DISC，透過超網路從指令單獨生成整個任務特定視覺運動策略的參數集，生成的策略從不直接存取語言，從結構上消除語言定位的觀測洩漏路徑。

Key Takeaway: Our code is available at: {https://github.com/ReNginx/DISC}. 核心發現： DISC 超網路架構從結構上消除語言條件操作中的觀測洩漏，強制學習真正的語言定位。

Humanoid Whole-Body Manipulation via Active Spatial Brain and Generalizable Action Cerebellum

Authors: Zhizhao Liang, Yi-Lin Wei, Xuhang Chen et al. | Submitted: 2026-05-20 | arXiv: 2605.21133 Categories: cs.RO

Research Background: In this paper, we explore spatial-aware humanoid whole-body manipulation task. Compared with tabletop settings, this task poses two key challenges: 1) Spatial understanding is challenging in complex 3D environments with diverse spatial relations. 研究背景： 與桌面設置相比，空間感知人形機器人全身操作任務面臨兩大挑戰：複雜三維環境中的空間理解困難與動作泛化能力不足。

Technical Approach: 2) Action generation is difficult to generalize, as limited and costly real-robot data restricts data-driven models generalization. To address these challenges, we propose a generalizable humanoid loco-manipulation framework that leverages the spatial perception and action generation capabilities of multi-agent large models. Specifically, our framework includes two components: Active Spatial Brain for active spatial perception and decision-making, and Generalizable Action Cerebellum for executable robot action generation. 技術方法： 本文提出可泛化人形機器人操作運動框架，利用多智能體大模型的空間感知與動作生成能力，設計「空間腦（Spatial Brain）」與「可泛化行動小腦（Generalizable Action Cerebellum）」雙組件架構協同工作。

Key Takeaway: The results demonstrate strong performance on both aspects across diverse tasks and environments. 核心發現： 雙組件框架讓人形機器人在複雜三維環境中實現可泛化的全身操作運動。

Reinforcement Learning for Risk Adaptation via Differentiable CVaR Barrier Functions

Authors: Xinyi Wang, Taekyung Kim, Bardh Hoxha et al. | Submitted: 2026-05-20 | arXiv: 2605.21257 Categories: cs.RO

Research Background: Planning through crowded environments under uncertain obstacle motions remains difficult, as stochastic interactions often induce overly conservative behavior or reduced efficiency. To address this challenge, we propose an end-to-end risk adaptation framework for crowd navigation under obstacle-motion uncertainty modeled by a Gaussian mixture model. 研究背景： 在不確定障礙運動下的擁擠環境規劃具有挑戰性，隨機互動常導致過於保守的行為或效率降低。

Technical Approach: The framework combines reinforcement learning~(RL) with a differentiable quadratic-program safety layer based on Conditional Value-at-Risk~(CVaR) barrier functions, jointly learning nominal control input, risk level, and safety margin and enforcing explicit probabilistic safety constraints. This design enables context-aware adaptation, promoting efficient behavior while invoking caution only when necessary. We conduct extensive evaluations in dynamic, uncertain, and crowded environments across varying obstacle densities and robot models, and fu 技術方法： 本文提出基於可微 CVaR 障礙函數的風險自適應強化學習框架，為高斯混合模型建模的障礙運動不確定性下的人群導航提供端到端風險自適應，聯合學習標稱控制輸入、風險水準與安全裕度。

Key Takeaway: Comparisons across optimization-based, RL-based, and integrated RL and optimization methods are provided, and the proposed method is shown to deliver the strongest overall performance in safety, efficiency, and generalization under uncertainty. 核心發現： 可微 CVaR 障礙 RL 框架在不確定障礙運動下實現高效非保守的機器人人群導航。

Learning Structural Latent Points for Efficient Visual Representations in Robotic Manipulation

Authors: Yicheng Jiang, Jiaxu Wang, Junhao He et al. | Submitted: 2026-05-20 | arXiv: 2605.21258 Categories: cs.RO, cs.AI

Research Background: Current 3D-aware pretraining methods for embodied perception and manipulation are largely built on differentiable rendering frameworks, producing either fully implicit neural fields or fully explicit geometric primitives. Implicit representations, while expressive, lack explicit structural cues, whereas explicit ones preserve geometry but suffer from resolution limits and weak generalization. 研究背景： 當前三維感知預訓練方法主要建立在隱式神經場或顯式幾何基元上，前者缺乏明確結構線索，後者受分辨率限制且泛化能力弱。

Technical Approach: To address these limitations, we propose a novel pretraining framework that learns a hybrid representation-structural latent points. Specifically, we insert a point-wise latent variational autoencoder into the latent space of a point-cloud autoencoder, jointly regularizing point-wise features and coordinates toward a Gaussian prior. The resulting compact latent preserves coarse structural tendencies, which do not encode precise geometry but capture richer rough shape and semantic information, effectively combining the expressiveness of implicit 技術方法： 本文提出學習混合表示-結構潛在點的預訓練框架，插入逐點潛在變分自編碼器在隱式神經場骨幹中生成具有明確幾何意義的結構潛在點，結合隱式表達力與顯式幾何性。

Key Takeaway: Ablation studies further confirm that each component of our framework is critical to overall performance. 核心發現： 結構潛在點混合表示在視覺機器人操作中提供比純隱式或純顯式表示更優的幾何感知能力。

roto 2.0: The Robot Tactile Olympiad

Authors: Elle Miller, Jayaram Reddy, Ayush Deshmukh et al. | Submitted: 2026-05-20 | arXiv: 2605.21429 Categories: cs.RO, cs.LG

Research Background: Tactile-based reinforcement learning (RL) is currently hindered by fragmented research and a focus on over-saturated orientation tasks. We introduce v2 of the Robot Tactile Olympiad (\texttt{roto 2.0}), a GPU-parallelised benchmark designed to standardise tactile-based RL across four distinct robotic morphologies (16-DOF to 24-DOF). 研究背景： 觸覺強化學習目前受分散研究與過度聚焦飽和方向任務所阻礙，缺乏跨多種機器人形態的標準化評估框架。

Technical Approach: Unlike prior benchmarks, roto focuses on end-to-end “blind” manipulation, utilising only proprioception and tactile sensing without state information or distillation. We demonstrate a significant performance leap, with our blind agents achieving 13 Baoding ball rotations in 10 seconds, an order of magnitude faster than current state-of-the-art speeds. By open-sourcing our environments and robustly tuned baselines, we reduce the barrier to entry and enable researchers to prioritise fundamental algorithmic challenges over tedious RL tuning. 技術方法： 本文提出 roto 2.0，GPU 並行化觸覺 RL 基準，跨四種不同機器人形態（16-24 自由度）標準化評估，聚焦純「盲」端到端操作，僅使用本體感知與觸覺感測，不依賴狀態資訊或知識蒸餾。

Key Takeaway: Website: https://elle-miller.github.io/roto/ 核心發現： roto 2.0 在多形態盲操作基準上展示觸覺 RL 智能體的顯著性能飛躍。

Flying Together: Human-Guided Immersive Shared Control for Aerial Robot Teams in Unknown Environments

Authors: Lou De Bel-Air, Luca Morando, Ruitao Chen et al. | Submitted: 2026-05-20 | arXiv: 2605.21680 Categories: cs.RO

Research Background: While autonomous multi-robots can achieve safe and coordinated navigation, they often struggle to adapt to unforeseen conditions and to capture operator-driven objectives in unstructured environments. We present a Virtual Reality (VR)-based shared control framework for teams of drones operating in constrained and unknown environments, enabling real-time, user-guided exploration. 研究背景： 自主多機器人可實現安全協調導航，但在非結構化環境中難以適應突發情況或捕捉操作員目標。

Technical Approach: At the core of our approach is a novel, user-guided motion-primitive-based planner that computes continuous, collision-free trajectories while continuously integrating operator input. This planner is coupled with an admittance controller, allowing the operator to flexibly influence team behavior and guide drones toward regions of interest that autonomous planners may overlook. The system supports mixed-reality operations with both physical and simulated drones, and implements a bilateral VR-based interface, allowing the operator to guide the ro 技術方法： 本文提出基於 VR 的無人機群共享控制框架，核心為用戶引導的運動基元規劃器，在持續整合操作員輸入的同時計算連續無碰撞軌跡，支援受限與未知環境中的即時人類引導探索。

Key Takeaway: Experimental results show that shared control improves obstacle avoidance, maintains inter-agent spacing, and reduces operator effort, demonstrating the feasibility and advantages of immersive, human-in-the-loop multi-robot navigation. 核心發現： VR 共享控制框架讓人類操作員有效引導無人機群在未知受限環境中進行目標導向探索。

Distributed Multi-Coverage for Robot Swarms

Authors: Mariem Guitouni, Aaron T. Becker | Submitted: 2026-05-20 | arXiv: 2605.21686 Categories: cs.RO

Research Background: Autonomous drone swarms deployed for surveillance, environmental monitoring, and infrastructure inspection must maintain reliable coverage of critical assets despite robot failures. This requires multicoverage: each asset must be observed by multiple robots for redundancy, with coverage requirements varying by asset importance. 研究背景： 自主無人機群部署於監視、環境監測與基礎設施檢查時，必須在機器人失效情況下維持對關鍵資產的可靠覆蓋，這需要多覆蓋（每個資產由多台機器人觀測）能力。

Technical Approach: This requires multicoverage: each asset must be observed by multiple robots for redundancy, with coverage requirements varying by asset importance. While recent work has solved the centralized problem optimally using integer programming, practical deployments face constraints that demand distributed solutions: robots operate with limited communication ranges, onboard computation restricts global planning, and partial system failures must not cause mission abort. We present a distributed multicoverage algorithm for robot swarms operating with lo 技術方法： 本文解決分散式多覆蓋問題，機器人在有限通訊範圍與機載計算限制下工作，提出分散式多覆蓋算法，根據資產重要性差異化多覆蓋要求，在機器人失效下維持冗餘覆蓋。

Key Takeaway: We present a distributed multicoverage algorithm for robot swarms operating with local sensing, local communication, and no global coordination. 核心發現： 分散式多覆蓋算法在通訊受限與機器人失效情況下維持無人機群對關鍵資產的冗餘覆蓋。

Closed-Loop Sim-to-Real Reinforcement Learning for Deformable Microfiber Shape Control

Authors: Alessandro Amici, Houari Bettahar, Veeti Jaakkola et al. | Submitted: 2026-05-20 | arXiv: 2605.21688 Categories: cs.RO, eess.SY

Research Background: Autonomous contact-based micromanipulation is challenging because surface and interfacial interactions at the microscale are difficult to model accurately, limiting the use of conventional model-based control and sim-to-real learning. We present a closed-loop sim-to-real reinforcement learning (RL) approach for microfiber shape control on a surface. 研究背景： 自主接觸式微操作困難在於微尺度表面與界面相互作用難以精確建模，限制了傳統模型基礎控制與模擬到現實遷移學習的使用。

Technical Approach: The central idea is to train geometric shape regulation in a simplified frictionless simulator and rely on real-time visual feedback during deployment to iteratively correct the observed effects of unmodeled surface interactions. An RL policy trained entirely in simulation is transferred directly to a physical dual-gripper micromanipulation system operating at 40 Hz, without retraining or domain adaptation. Using silk microfibers as a testbed, the policy achieves a mean point-wise shape error of 270 $\pm$ 80 $μ$ m across twenty-four diverse init 技術方法： 本文提出閉環模擬到現實 RL 方法用於微纖維形狀控制：在無摩擦簡化模擬器中訓練幾何形狀調節策略，部署時依賴實時視覺反饋迭代修正未建模表面互動效應，無需精確微尺度模型。

Key Takeaway: These results show that a policy learned in a simplified simulator can achieve repeatable real-world microfiber shape regulation under surface contact, provided that the task-relevant effects of the sim-to-real mismatch remain observable and correctable within the closed feedback loop. 核心發現： 閉環模擬到現實 RL 配合視覺反饋在無精確微尺度模型的情況下實現可靠的微纖維形狀控制。

Motion Design for Grasp-Based Dynamic Locomotion in Microgravity

Authors: Chaerim Moon, Joohyung Kim, Justin K. Yim | Submitted: 2026-05-20 | arXiv: 2605.21704 Categories: cs.RO, eess.SY

Research Background: Locomotion in microgravity often relies on sparsely and irregularly arranged anchors, motivating grasp-based mobility with multiple limbs. In this setting, dynamic locomotion is feasible only through deliberate regulation of both anchored interactions and whole-body coordination under coupled dynamic and kinematic constraints. 研究背景： 微重力運動通常依賴稀疏且不規則分佈的錨點，驅動基於抓握的多肢體移動需求，動態運動僅在刻意調控錨固互動與全身協調的情況下可行。

Technical Approach: This paper presents design insights for grasp-based dynamic locomotion with multi-limbed robotic systems in microgravity, targeting scenarios that require 6D limb manipulation to establish contacts with candidate anchors. The investigated design parameters include gait pattern, stride length, locomotion speed, and nominal posture. A parameterizable locomotion planning framework is proposed to support variations of these parameters and to evaluate the resulting locomotion performance in terms of stability and actuation demand. 技術方法： 本文針對微重力多肢體機器人系統基於抓握的動態運動提出設計洞見，目標場景需要六自由度肢體操作建立候選錨點接觸，研究參數包含步態模式與接觸策略對系統動態的影響。

Key Takeaway: These findings inform strategies for contact configuration selection and whole-body coordination in microgravity locomotion with multi-limbed systems. 核心發現： 系統性微重力基於抓握動態運動設計分析為多肢體太空機器人提供實用運動設計指引。

Higher Order Reasoning for Collaborative Communicationless Mobile Robot Operations

Authors: Jonathan Reasoner, Nicola Bezzo | Submitted: 2026-05-21 | arXiv: 2605.21901 Categories: cs.RO

Research Background: In communicationless environments, multi-robot systems must operate without the constant information exchange that many coordination strategies typically assume. This paper presents a novel dynamic epistemic planning framework that enables implicit coordination and long horizon planning through higher-order reasoning among robots. 研究背景： 在無通訊環境中，多機器人系統必須在無持續資訊交換的假設下操作。現有協調策略多依賴通訊，無通訊場景需要不同方法。

Technical Approach: With our approach, robots form and propagate higher-order belief particles, update world beliefs using Bayesian inference, and select actions via a behavior tree that anticipates teammates’ likely decisions. A temporally aware Model Predictive Path Integral (MPPI) controller integrates this reasoning into low-level execution, allowing robots to plan intercepts and adapt trajectories under partial observability. The proposed framework is evaluated in both simulations and physical experiments, where it consistently reduces task completion time co 技術方法： 本文提出動態認識論規劃框架，透過高階信念推理（機器人形成並傳播關於隊友信念的高階信念粒子）實現無通訊的隱式協調，利用貝葉斯推斷更新世界信念，透過 MPPI 選擇動作。

Key Takeaway: The proposed framework is evaluated in both simulations and physical experiments, where it consistently reduces task completion time compared to a first-order baseline, demonstrating that epistemic logic can serve as a robust foundation for resilient coordination in communication-restricted domains. 核心發現： 高階信念推理讓多機器人系統在完全無通訊條件下實現有效的隱式協調與長時域規劃。

Auction-Consensus Algorithm with Learned Bidding Scheme for Multi-Robot Systems

Authors: Jose Rodriguez, Constantine Tarawneh, Sven Koenig et al. | Submitted: 2026-05-21 | arXiv: 2605.21932 Categories: cs.RO

Research Background: Multi-Robot Task Allocation (MRTA) is a central challenge in decentralized multi-agent systems, where teams of robots must cooperatively assign and execute tasks under limited communication while optimizing global performance objectives. Auction-consensus algorithms, such as the Consensus-Based Bundle Algorithm (CBBA), provide scalable decentralized coordination with provable convergence, but rely on hand-crafted greedy scoring functions that oft 研究背景： 多機器人任務分配（MRTA）是去中心化多智能體系統的核心挑戰，共識拍賣算法提供可擴展去中心化協調但依賴手工評分函數，常導致次優分配。

Technical Approach: This paper proposes a learning-enhanced auction-consensus framework in which CBBA’s deterministic bidding mechanism is replaced by a neural bidding policy trained using reinforcement learning. Under a centralized training and decentralized execution paradigm, agents learn to compute task bids from partial local observations while retaining the standard auction and consensus phases for decentralized coordination. The learned bidding policy is trained using Proximal Policy Optimization with rewards shaped by proximity to globally optimal solution 技術方法： 本文提出學習增強共識拍賣框架，以神經網路取代 CBBA 的確定性競標機制，在有限通訊下聯合學習競標策略與共識協議，在保持可擴展性的同時提升任務分配品質。

Key Takeaway: The proposed approach highlights the effectiveness of integrating reinforcement learning with classical distributed coordination algorithms, offering a scalable pathway toward higher-quality decentralized multi-robot task allocation. 核心發現： 學習增強競標策略顯著提升共識拍賣框架在通訊受限多機器人任務分配中的分配品質。

Authors: Peifeng Jiang, Hong Liu, Jin Jin et al. | Submitted: 2026-05-21 | arXiv: 2605.21935 Categories: cs.RO

Research Background: Safe manipulation-oriented navigation for humanoid robots requires scene memory that remains reliable under locomotion-induced perceptual distortion, environmental changes, and interaction-level geometric safety constraints. Existing semantic mapping and scene-graph systems are difficult to deploy directly in this setting because they often assume stable camera trajectories, static environments, or coarse object geometry. 研究背景： 人形機器人的安全操作導向導航需要在運動引起的感知失真、環境變化與互動層次幾何安全約束下保持可靠的場景記憶。

Technical Approach: We introduce the Multi-modal Interactive Field (MIF), a humanoid-oriented system that integrates confidence-aware semantic 3D Gaussian Splatting, discrepancy-triggered spatial memory updates, and task-driven geometric reconstruction within a closed-loop perception-adaptation pipeline. MIF couples three fields: an uncertainty-aware 3DGS Appearance Field that suppresses gait-induced blur, a Spatial Field that maintains topological memory, and a Geometry Field that supports Interaction Pose Safety (IPS) before manipulation. A discrepancy detection 技術方法： 本文提出多模態互動場（MIF），整合信心感知語義三維高斯散射、差異觸發空間記憶更新與互動感知幾何安全表示，專為人形機器人在動態環境中的操作運動設計。

Key Takeaway: Project page and code: https://ziya-jiang.github.io/MIF-homepage/ 核心發現： 多模態互動場為人形機器人在動態環境中的操作運動提供可靠的語義幾何場景記憶。

A Visitation Grid for Complete Coverage Foraging in Robot Swarms

Authors: Qi Arturo Gonzalez, Yifeng Gao, Li Zhang et al. | Submitted: 2026-05-21 | arXiv: 2605.21947 Categories: cs.RO

Research Background: The complete collection of sparse resources in large, unknown environments remains a challenging problem for autonomous robot swarms. Previous studies have shown that a substantial portion of total mission time is consumed during the final stage of collection, where only a small fraction of randomly scattered resources remain. 研究背景： 在大型未知環境中完整收集稀疏資源對自主機器人群仍是挑戰，大量任務時間消耗在只剩少量資源的最終收集階段，現有算法多聚焦在有限時間內收集大部分資源。

Technical Approach: Consequently, many existing swarm foraging algorithms (search and collection) focus on collecting most resources within a limited time window, rather than improving end-stage efficiency for collecting all resources. We propose a grid-based stochastic foraging strategy that explicitly reduces redundant visits and accelerates late-stage collection. The unknown search area is partitioned into a grid map, which is maintained by a lightweight central server. 技術方法： 本文提出基於網格的隨機覓食策略，維護機器人訪問紀錄以消除重複訪問，同時保持機器人間的空間分佈，顯著提升任務最後階段的收集效率以達到完整覆蓋。

Key Takeaway: These results indicate that the proposed strategy is robust, flexible, and scalable for near-complete and complete resource collection in robot swarms and can serve as a general enhancement for stochastic swarm foraging methods under limited onboard resources. 核心發現： 訪問網格策略讓機器人群在大型未知環境中實現高效的完整資源收集覆蓋。

CoRMA: Contrastive RMA for Contact-Rich Meta-Adaptation

Authors: Wentian Wang, Chutong Wen, Hongxu Ma et al. | Submitted: 2026-05-21 | arXiv: 2605.22082 Categories: cs.RO, cs.LG

Research Background: We present CoRMA(Contrastive Robotic Motor Adaptation), a context-based meta-adaptation framework that modifies RMA for force-dominant assembly. CoRMA replaces raw simulator-parameter adaptation with a compact 6D simulator-only semantic contact context describing contact onset, lateral engagement, guided transition, contact direction, and jamming. 研究背景： 力主導裝配任務中的情境化元適應（RMA）需要表示接觸起始、橫向接合、引導轉換等接觸語義，以實現在新接觸條件下的快速適應。

Technical Approach: A deployable causal Transformer adapter infers this context online from force, proprioceptive, and action histories using semantic regression and a force-regime contrastive objective. At deployment, oracle context is removed and replaced by the inferred context, enabling within-episode adaptation without demonstrations, privileged inputs, or gradient updates. We evaluate CoRMA on PegInsert, GearMesh, and NutThread in Isaac Lab / Isaac Sim~5.0 and on a real Marvin arm. 技術方法： 本文提出 CoRMA，以緊湊六維模擬器語義接觸情境取代原始模擬器參數的對比 RMA 框架，因果 Transformer 適配器透過對比目標從力、本體感知與動作歷史在線推斷接觸情境，部署時移除神諭情境。

Key Takeaway: These results support semantic contact inference as a reusable adaptation interface within a related assembly task family, while broader unseen-task generalization and Real2Sim calibration remain future work. 核心發現： 語義接觸情境的對比學習使 CoRMA 在無神諭信息的部署中實現可靠的接觸豐富裝配適應。

Beyond Pixels: Learning Invariant Rewards for Real-World Robotics From a Few Demonstrations

Authors: Tengye Xu, Yangting Sun, Ziju Shen et al. | Submitted: 2026-05-21 | arXiv: 2605.22123 Categories: cs.RO

Research Background: Designing reward functions that generalize beyond controlled laboratory settings remains a fundamental challenge in reinforcement learning for robotics. In open-world manipulation problems, a single task can appear in numerous variants through different object instances, positions, and camera viewpoints. 研究背景： 設計能在實驗室控制環境之外泛化的獎勵函數仍是機器人強化學習的根本挑戰，現有視覺獎勵模型傾向記憶特定像素分佈，在不同物件實例、位置與相機視角下失敗。

Technical Approach: Recent vision-based reward models tend to memorize specific pixel distributions and fail to generalize beyond their training conditions. To address this, we propose a framework that learns invariant symbolic reward functions from as few as five demonstrations. The insight is to shift from visual feature-fitting to the discovery of behavioral invariants: task-level properties that remain constant across diverse visual instantiations. 技術方法： 本文提出從少至五個示範學習不變符號獎勵函數的框架，以符號關係（物件屬性、空間關係）取代像素表示，讓獎勵函數對物件外觀與場景佈局變化保持不變性。

Key Takeaway: Three real-world out-of-distribution experiments further show that the same learned reward generalizes zero-shot to position, viewpoint, and object variations, enabling a single reward representation to be reused across diverse task variants in practice. 核心發現： 基於符號關係的不變獎勵函數從極少示範實現跨物件實例與視角的開放世界操作泛化。

Beyond Euclidean Proximity: Repairing Latent World Models with Horizon-Matched Trajectory Reachability Metrics

Authors: Liangyu Li, Shengzhi Wang, Qingwen Liu | Submitted: 2026-05-21 | arXiv: 2605.22164 Categories: cs.LG, cs.RO

Research Background: Latent world models can contain the state needed for control, yet their terminal-cost interface can expose the planner to the wrong decision-relevant information. In common latent MPC, candidate sequences are ranked by Euclidean distance between predicted terminal and goal latent states; this assumes that raw latent distance weights reachability-relevant variables correctly. 研究背景： 潛在世界模型可包含控制所需的狀態，但終端成本介面可能向規劃器暴露錯誤的決策相關資訊。現有潛在 MPC 以歐氏距離排名候選序列，但假設原始潛在距離正確加權可達性相關變數。

Technical Approach: We propose trajectory reachability metrics (TRM), a post-hoc terminal-ranking method for fixed latent world models. TRM trains a small pairwise head from logged trajectory structure and uses it as a replacement or hybrid cost; the encoder, dynamics, sampler, optimizer, and evaluation manifests remain fixed. The key design choice is horizon-aware supervision: the metric is trained on broad, balanced temporal separations to match the long-horizon terminal candidate ranking problem. 技術方法： 本文提出軌跡可達性度量（TRM），固定潛在世界模型的後置終端排名方法，從記錄的軌跡結構訓練小型成對比較頭，替換或混合原始歐氏距離作為終端成本，無需修改世界模型。

Key Takeaway: TRM is the planner-facing repair, and audits explain when terminal reachability metrics should replace or augment raw latent proximity. 核心發現： 軌跡可達性度量改善潛在 MPC 的終端狀態排名，提升基於世界模型的機器人規劃性能。

Steins;Gate Drive: Semantic Safety Arbitration over Structured Futures for Latency-Decoupled LLM Planning

Authors: Anjie Qiu, Hans D. Schotten | Submitted: 2026-05-21 | arXiv: 2605.22456 Categories: cs.RO, cs.AI

Research Background: Cloud-hosted LLM driver agents provide useful semantic judgments, but their inference latency exceeds stepwise vehicle-control windows. Learned world models predict futures, but they usually keep future generation and action selection inside large coupled loops. 研究背景： 雲端託管 LLM 駕駛智能體提供有價值的語義判斷，但推理延遲超過步進式車輛控制窗口。學習型世界模型預測未來，但通常將未來生成與動作選擇耦合在大型循環中。

Technical Approach: We present SteinsGateDrive, a latency-decoupled planner-runtime architecture in which the worldline metaphor from the eponymous story names one plausible consequence of an intervention: the LLM selects counterfactual driving futures before the final control instant, and a runtime reuses the selected forecast only while safety contracts remain valid. The generator builds three world-line roles: alpha nominal ego-conditioned futures, beta interaction counterfactuals around nearby vehicles, and gamma hazard-stress futures such as braking, cut-ins, 技術方法： 本文提出 SteinsGateDrive，延遲解耦規劃器-執行時架構，LLM 在最終控制時刻前選擇反事實駕駛未來（世界線），執行時僅在安全契約成立期間重用選定的預測，實現延遲容忍的語義 LLM 規劃。

Key Takeaway: The architecture’s safety contribution comes from the atom-predicate runtime check, not from the drift score, which functions as a refresh-frequency knob. 核心發現： 延遲解耦語義世界線選擇框架讓高延遲 LLM 規劃能力在步進式自動駕駛控制中實際可用。

MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropy

Authors: Jiaxu Wang, Junhao He, Jingkai Sun et al. | Submitted: 2026-05-21 | arXiv: 2605.22597 Categories: cs.LG, cs.AI, cs.GR, cs.RO

Research Background: Learning real-world dynamics from visual observations is crucial for various domains. A common strategy is to calibrate simulators by estimating physical parameters, yet accuracy is ultimately bounded by the underlying physical models, which often assume materials are homogeneous and isotropic. 研究背景： 從視覺觀測學習真實世界動態對機器人及多個領域至關重要，常見策略是通過估計物理參數校準模擬器，但精度最終受限於假設材料均勻各向同性的底層物理模型。

Technical Approach: Even if reasonable, real-world objects typically exhibit mild anisotropy and heterogeneity. After the near-isotropic backbone is well calibrated, these residual effects become the key bottleneck for further closing the real-to-sim gap. Although neural networks can fit dynamics end-to-end, such black-box modeling discards strong physical priors, leading to poor data efficiency and overfitting. 技術方法： 本文提出 MoSA，動態約束壓力適應框架，在近等向性骨架精確校準後，學習殘差各向異性以進一步縮小模擬到現實差距，透過運動約束殘差各向異性學習避免黑盒神經網路端到端的過擬合。

Key Takeaway: Project Page is available at https://mercerai.github.io/MoSA/. 核心發現： 殘差各向異性建模顯著縮小連續體動態的模擬到現實差距，超越均勻各向同性假設的精度上限。

Superhuman Safe and Agile Racing through Multi-Agent Reinforcement Learning

Authors: Ismail Geles, Leonard Bauersfeld, Markus Wulfmeier et al. | Submitted: 2026-05-21 | arXiv: 2605.22748 Categories: cs.RO, cs.AI, cs.LG, cs.MA

Research Background: Autonomous systems have achieved superhuman performance in isolation or simulation, yet they remain brittle in shared, dynamic real-world spaces. This failure stems from the dominant single-agent paradigm for physical applications, where other actors are ignored or treated as environmental noise, preventing effective coordination. 研究背景： 自主系統在隔離或模擬環境中已達超人性能，但在真實動態共享空間中仍脆弱，根源在於將其他行動者視為環境噪聲的單智能體範式。

Technical Approach: Here we show that multi-agent reinforcement learning provides the essential safety scaffolding required for real-world interaction. Using high-speed quadrotor racing as a high-stakes testbed, we train agents to navigate complex aerodynamic interactions and strategic maneuvering with a variable number of racers. Through league-based self-play, agents evolve sophisticated anticipatory behaviors, including proactive collision avoidance, overtaking, and handling multi-agent physical interactions, including aerodynamic downwash. 技術方法： 本文以高速無人機競速為高風險測試床，展示多智能體強化學習如何提供真實世界互動所需的安全腳手架，訓練智能體在複雜空氣動力互動與策略超越中協調，在真實競速中達到超人安全性。

Key Takeaway: Multimedia materials are available at: https://rpg.ifi.uzh.ch/marl 核心發現： 多智能體 RL 在真實高速無人機競速中首次實現同時超越人類安全性與敏捷性。

Hierarchical Variational Policies for Reward-Guided Diffusion

Authors: Kushagra Pandey, Farrin Marouf Sofian, Jan Niklas Groeneveld et al. | Submitted: 2026-05-20 | arXiv: 2605.21661 Categories: cs.LG, cs.AI, cs.CV

Research Background: Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framework for generating high-quality reward-aligned samples at substantially reduced inference cost. 研究背景： 將預訓練擴散模型適應至下游目標（如逆問題）通常需要昂貴的測試時引導或最佳化，難以在計算效率與樣本品質之間取得平衡。

Technical Approach: Our approach formulates test-time adaptation as a hierarchical variational model, where control is amortized into a lightweight yet expressive stochastic policy. This formulation naturally supports few-step diffusion sampling: large step sizes enable fast inference, while the learned policy maintains sample quality by providing structured per-step control. The resulting fully amortized sampler achieves a strong quality—speed tradeoff, matching or exceeding recent test-time scaling baselines while requiring significantly less compute. 技術方法： 本文提出層次化變分策略框架，將測試時自適應表述為層次化變分模型，將控制攤銷至輕量隨機策略，自然支援少步擴散取樣：大步長實現快速推理，學習策略維持樣本品質。

Key Takeaway: We further extend our approach to a semi-amortized regime that combines cheap amortized proposals with limited test-time optimization, achieving state-of-the-art perceptual quality across several challenging inverse problems. 核心發現： 層次化變分策略框架在大幅降低推理成本的同時維持獎勵對齊樣本品質，適用於機器人策略擴散模型後訓練。

Generative Modeling by Value-Driven Transport

Authors: Pablo Moreno-Muñoz, Adrian Müller, Gergely Neu | Submitted: 2026-05-21 | arXiv: 2605.22507 Categories: cs.LG, stat.ML

Research Background: We propose a new framework for generative modeling based on a discrete-time stochastic control formulation of measure transport. Adapting classic results from control theory, we formulate our problem as a linear program whose dual variables correspond to the \emph{optimal value function} of the control problem, which directly encodes the optimal control policy. 研究背景： 基於離散時間隨機控制的度量傳輸為生成建模提供了新框架，傳統方法難以高效計算最優控制策略。

Technical Approach: Exploiting this LP formulation, we develop an efficient simulation-free primal-dual algorithm for computing approximately optimal value functions and the associated \emph{value-driven transport} (VDT) policies which approximate the true optimal policy. We show that well-trained VDT policies enjoy numerous favorable properties in comparison with other state-of-the-art methods based on flows, diffusions, or Schrödinger bridges: they lead to straight transport paths which can be simulated quickly and robustly, and can be enhanced in all the same w 技術方法： 本文提出價值驅動傳輸（VDT），將度量傳輸表述為線性規劃，其對偶變數對應最優控制問題的最優值函數，並開發高效無模擬的原始對偶算法計算近似最優值函數與關聯策略。

Key Takeaway: We evaluate our methodology in a range of experiments, with results that indicate strong performance and good potential for scalability. 核心發現： 價值驅動傳輸提供計算高效的度量傳輸生成建模框架，可應用於機器人擴散策略學習。

Factored Diffusion Policies:Compositionally Generalized Robot Control with a Single Score Network

Authors: Sayan Mitra, Ege Yuceel, Noah Giles et al. | Submitted: 2026-05-21 | arXiv: 2605.22596 Categories: cs.LG

Research Background: Robotic tasks are typically specified by a tuple of factors, such as the object to be grasped, the obstacles to be avoided, the color of the target, and so on. Collecting expert demonstrations for every combination of factor values grows combinatorially. 研究背景： 機器人任務通常由因素元組指定（抓取物件、避障顏色等），為所有因素值組合收集示範呈組合式增長，現有生成策略無法跨因素泛化。

Technical Approach: We present factored diffusion policies: a single shared diffusion network trained with per-factor null-token dropout, whose score decomposes additively across factors at inference. Under approximate conditional independence between factors given the action-observation pair, this composition approximates the true joint score with a bounded uniform error, reducing the training-task budget from a product of factor cardinalities to a sum. A trajectory-tube certificate chains this score-level bound through the reverse-time sampling ODE and a contrac 技術方法： 本文提出因子化擴散策略，以每個因素的空 token 丟棄訓練單一共享擴散網路，推理時分數在因素間加法組合，在近似條件獨立假設下以有界誤差近似真實聯合分數。

Key Takeaway: On state-based multi-gate racing, the factored policy passes 90% of held-out gates — matching an oracle — while a K-network composition baseline collapses to 3%; on vision-based single-gate traversal, it transfers zero-shot to an unseen venue with +11.7pp success-rate gain and 2.4X crash-rate redu 核心發現： 因子化擴散策略讓單一網路實現跨已知因素組合的零樣本機器人控制泛化。

Explorer

arXiv Digest — 2026-W21

arXiv Weekly Digest — Week 21, 2026

Graph View

Table of Contents