arXiv Weekly Digest — Week 26, 2026

Fetched: 2026-06-22 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 191

ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretraining

Authors: Hao Li, Ganlong Zhao, Yufei Liu et al. | Submitted: 2026-06-15 | arXiv: 2606.17200 Categories: cs.RO

Research Background: VLA models require diverse robotic demonstrations to generalize, but collecting robot trajectory data at scale is expensive. Leveraging abundant egocentric human videos as a complementary training source could dramatically reduce this cost. 研究背景： VLA 模型需要多樣化機器人示範才能泛化，但大規模收集機器人軌跡資料成本高昂。利用豐富的第一人稱人類影片作為補充訓練來源，可大幅降低此成本。

Technical Approach: ACE-EGO-0 builds a pipeline converting human egocentric videos into pseudo-action robot trajectories, aligning them with robot data via an embodiment-agnostic representation. It bridges action space, embodiment, and temporal dynamics gaps through a unified pretraining objective. 技術方法： ACE-EGO-0 建立將人類第一人稱影片轉換為偽動作機器人軌跡的管道，透過具身無關表示法與機器人資料對齊，並以統一的預訓練目標橋接動作空間、具身形態與時序動態差異。

Key Takeaway: Joint pretraining on human egocentric and robot data yields stronger VLA policies than robot-only training, validating human video as a scalable data source. 核心發現： 聯合在人類第一人稱與機器人資料上預訓練所產生的 VLA 策略，優於僅使用機器人資料訓練，驗證了人類影片作為可擴展資料來源的價值。

T-Rex: Tactile-Reactive Dexterous Manipulation

Authors: Dantong Niu, Zhuoyang Liu, Zekai Wang et al. | Submitted: 2026-06-15 | arXiv: 2606.17055 Categories: cs.RO

Research Background: Current VLA models largely ignore dynamic tactile signals despite their importance for agile manipulation, due to scarce data and architectural limitations. 研究背景： 儘管動態觸覺訊號對靈活操作至關重要，現有 VLA 模型因資料稀缺與架構限制，大多未能充分利用。

Technical Approach: T-Rex collects a 100-hour tactile dataset via an efficient primitive-focused approach, introduces a high-frequency temporal tactile encoder capturing dynamic contact signals, and integrates these into a VLA architecture for reactive multi-modal control. 技術方法： T-Rex 透過高效原語導向方式收集百小時觸覺資料集，引入高頻時序觸覺編碼器捕捉動態接觸訊號，並整合至 VLA 架構以實現反應性多模態控制。

Key Takeaway: T-Rex achieves reactive dexterous manipulation adapting dynamically to touch signals, outperforming static-tactile VLAs on contact-adjustment tasks. 核心發現： T-Rex 實現能動態適應觸覺訊號的反應性靈巧操作，在接觸調整任務上優於靜態觸覺 VLA。

Human Universal Grasping

Authors: Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu et al. | Submitted: 2026-06-15 | arXiv: 2606.17054 Categories: cs.RO, cs.AI, cs.CV, cs.LG

Research Background: Multi-fingered robot grasping lacks the generality of human hands. Human daily grasping provides a vast natural data source that remains underutilized in robotics. 研究背景： 多指機器人抓握缺乏人手的泛化能力。人類日常抓握提供了龐大的自然資料來源，但在機器人領域仍未被充分利用。

Technical Approach: HUG trains a flow-matching model on 1M-HUGs, an egocentric dataset of 1 million human grasping frames across 6,707 objects collected with smart glasses, generating diverse grasps for any object from a single RGB-D image and retargeting to robot hands. 技術方法： HUG 在 1M-HUGs（使用智慧眼鏡收集的百萬幀人類抓握資料集，涵蓋 6,707 種物體）上訓練流匹配模型，從單張 RGB-D 影像為任意物體生成多樣化抓握姿態並重定向至機器人手。

Key Takeaway: Learning from large-scale human grasping data enables zero-shot generalization across thousands of novel object instances. 核心發現： 從大規模人類抓握資料學習能讓機器人對數千種新物體實現零樣本泛化。

Geometric Action Model for Robot Policy Learning

Authors: Jisang Han, Seonghu Jeon, Jaewoo Jung et al. | Submitted: 2026-06-15 | arXiv: 2606.17046 Categories: cs.RO, cs.CV, cs.LG

Research Background: VLA models operate primarily in 2D image space, lacking the 3D geometric understanding essential for contact-rich manipulation tasks. 研究背景： VLA 模型主要在 2D 影像空間中運作，缺乏接觸密集操作所需的 3D 幾何理解。

Technical Approach: GAM repurposes a pretrained 3D geometric reconstruction model to provide explicit scene geometry, conditioning a language-guided manipulation policy on 3D representations rather than 2D image features. 技術方法： GAM 重新利用預訓練的 3D 幾何重建模型提供明確場景幾何，以 3D 表示（而非 2D 影像特徵）為語言引導操作策略提供條件。

Key Takeaway: GAM achieves superior manipulation performance by grounding robot actions in 3D geometric representations, reducing spatial ambiguity inherent to 2D-based VLAs. 核心發現： GAM 透過將機器人動作植根於 3D 幾何表示，有效降低 2D VLA 固有的空間模糊性，實現更優越的操作性能。

ROVE: Unlocking Human Interventions for Humanoid Manipulation via Reinforcement Learning

Authors: Wei Xiao, Weiliang Tang, Yuying Ge et al. | Submitted: 2026-06-15 | arXiv: 2606.17011 Categories: cs.RO, cs.LG

Research Background: Human interventions provide crucial corrective signals for post-training VLA models, but humanoid kinematics make interventions complex, and collected demonstrations are often suboptimal. 研究背景： 人類介入為訓練後 VLA 模型提供了關鍵的糾正訊號，但人形機器人運動學使介入複雜，且收集的示範往往次優。

Technical Approach: ROVE uses a reinforcement learning framework that treats human intervention trajectories as learning signal rather than expert demonstrations, employing task-completion rewards to filter out suboptimal human behaviors during humanoid VLA post-training. 技術方法： ROVE 使用強化學習框架，將人類介入軌跡視為學習訊號而非專家示範，採用任務完成獎勵過濾次優人類行為，用於人形機器人 VLA 後訓練。

Key Takeaway: ROVE enables humanoid robots to improve from imperfect human interventions via RL, outperforming behavior-cloning baselines on dexterous tasks. 核心發現： ROVE 使人形機器人能透過強化學習從不完美的人類介入中改進，在靈巧任務上優於行為克隆基準。

Unified Motion-Action Modeling for Heterogeneous Robot Learning

Authors: Yunhao Cao, Shitong Liu, Chao Feng et al. | Submitted: 2026-06-15 | arXiv: 2606.16917 Categories: cs.RO

Research Background: We present Unified Motion-Action (UMA) Model, an approach that uses 3D object motion trajectories as a shared interface to bridge visuomotor control and dynamics modeling. UMA treats object motion and robot actions as co-evolving variables under a masked generative objective, in which the mask pattern determines both the supervision regime during… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Using hindsight-relabeled motion contexts and a contrastive objective that disentangles task intent from scene geometry, UMA enables multi-task pretraining across heterogeneous data sources without requiring manually annotated task instructions. At deployment, the same pretrained parameters support motion-conditioned visuomotor control, motion-based dynamics modeling, and task adaptation from few-shot demonstrations. Pretrained on a mixture of… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Pretrained on a mixture of robot demonstrations, human videos, and simulated data, UMA consistently outperforms state-of-the-art baselines specialized for each inference mode. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

LOPAL: Local Performance-Aware Active Learning from Imperfect Demonstrations

Authors: Johannes Heidersberger, Shail Jadav, Dongheui Lee | Submitted: 2026-06-15 | arXiv: 2606.16888 Categories: cs.RO

Research Background: Learning from Demonstration (LfD) enables intuitive robot skill acquisition by allowing robots to learn directly from human task demonstrations. However, current methods often fail to address the fact that due to suboptimal and inconsistent human behavior, the quality of the demonstration can vary within each demonstration. 研究背景： 本研究聚焦於從示範學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Therefore, we introduce LOPAL (LOcal Performance-aware Active Learning), an active learning approach that leverages this local demonstration quality information. Our approach consists of two synergistic components. First, a local performance-driven LfD method uses a Gaussian Mixture Model (GMM) to encode both the demonstrated trajectories and their associated local quality assessments. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決從示範學習中的核心問題。

Key Takeaway: The results from a real-world pipe inspection task showed that the proposed approach can achieve up to 27.31 % improvement in task performance while also reducing the effort required to collect the demonstrations. 核心發現： 實驗結果顯示所提方法在從示範學習相關任務上顯著優於現有基準方法。

ATOM-Bench: A Real-World Benchmark for Atomic Skills and Compositional Generalization in Manipulation Policies

Authors: Zenan Wu, Bingqing Wei, Lu Liu et al. | Submitted: 2026-06-15 | arXiv: 2606.16826 Categories: cs.RO, cs.AI

Research Background: Generalist manipulation policies are increasingly presented as foundation models for robotic control, but their real-world generalization remains difficult to diagnose. A policy may succeed on demonstrated tasks while still failing to execute fine-grained atomic skills or recombine learned skills in new task structures. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce \textbf{ATOM-Bench}, a real-world benchmark for evaluating both atomic skills and compositional generalization in manipulation policies. ATOM-Bench factorizes tabletop manipulation into motor atoms and instruction atoms, and contains 30 atomic tasks and 24 held-out compositional tasks across paired single-arm and dual-arm robot tracks. We collect 3,000 human demonstrations for atomic fine-tuning and release both the demonstration… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: ATOM-Bench provides a diagnostic testbed for studying whether failures arise from weak motor execution, poor instruction grounding, or limited compositional reuse. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

DataLadder: A Simulation-Enabled Interconversion Toolchain for the Embodied Data Pyramid

Authors: Peidong Liu, Yongce Liu, Songyan Guo et al. | Submitted: 2026-06-15 | arXiv: 2606.16776 Categories: cs.RO

Research Background: Generalist robot policies require trustworthy evaluation and robot-usable training data, but both are difficult to scale with physical robots alone. Real-robot trials and demonstrations remain the most faithful source of deployment signals, yet they are slow, costly, and hard to reproduce. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present DataLadder, a simulation-enabled interconversion toolchain for human-robot aligned model evaluation and data generation, denoted as Robot $⇌$ Simulation $⇌$ Human. On the one hand, the Robot $\to$ Simulation $\to$ Human pathway supports human-robot aligned model evaluation by reconstructing real-robot tabletop organization tasks as calibrated digital twins for scalable evaluation,… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: We further package the core reconstruction, simulation, rendering, and realism-augmentation modules as cloud services on JD Cloud, turning the system into reusable infrastructure for robot data generation and model evaluation. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

HATS: A Human-Agent Teleoperation System for Multi-Arm Data Collection

Authors: Zesen Lin, Jian-Jian Jiang, Haoming Cen et al. | Submitted: 2026-06-15 | arXiv: 2606.16491 Categories: cs.RO

Research Background: Many real-world manipulation scenarios, such as handling complex collaborative tasks and dealing with large workspaces, require coordination of more than two robotic arms. Consequently, an effective multi-arm teleoperation system is required to collect demonstrations for training coordinated multi-arm manipulation policies. 研究背景： 本研究聚焦於從示範學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, existing teleoperation frameworks mainly focus on single-operator or multi-operator setups, facing a practical trade-off between the cognitive load placed on a single operator and the coordination cost incurred by multiple operators. To address this problem, we introduce HATS, a human-agent teleoperation system that enables a single human operator, assisted by an MLLM-based agent, to collect data for multi-arm manipulation tasks. Our… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決從示範學習中的核心問題。

Key Takeaway: Moreover, downstream policy evaluations demonstrate the efficacy and quality of the data collected through HATS. 核心發現： 實驗結果顯示所提方法在從示範學習相關任務上顯著優於現有基準方法。

Robots that Collaborate: Sequential Asymmetric Imitation for Learning Coupled Robot Policies

Authors: Yincong Chen, Ranpeng Qiu, Zihao Li et al. | Submitted: 2026-06-15 | arXiv: 2606.16490 Categories: cs.RO

Research Background: Collaborative mobile manipulation requires robots to coordinate with a partially observed partner while physically interacting through shared objects. This is difficult because failures often arise not from poor local skills, but from mistimed waiting, yielding, pulling, releasing, or repositioning. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We study this problem with two bimanual mobile manipulators coupled through rigid and deformable objects. We propose Sequential Asymmetric Imitation (SAI), a single-teleoperator curriculum for learning coupled multi-robot behaviors without synchronized dual-operator demonstrations or explicit inter-robot communication. SAI trains Robot A from unilateral demonstrations with a compliant human partner, trains Robot B against the deployed Robot A… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results suggest that physically coupled collaboration can be learned through the structure of the imitation curriculum, rather than through synchronized multi-operator demonstrations or explicit coordination mechanisms.Project… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

V2P-Manip: Learning Dexterous Manipulation from Monocular Human Videos

Authors: Kaihan Chen, Yanming Shao, Haifeng Ji et al. | Submitted: 2026-06-15 | arXiv: 2606.16436 Categories: cs.RO, cs.CV

Research Background: Achieving autonomous robotic dexterous manipulation requires precise, human-like action sequences at scale. As a scalable supplement to costly teleoperation data, extracting trajectories with both visual fidelity and physical plausibility from monocular videos represents a promising frontier in embodied AI. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To this end, we introduce V2P-Manip, an efficient framework designed to learn dexterous manipulation policies directly from human demonstration videos. We establish an efficient, integrated pipeline encompassing 3D asset acquisition, trajectory estimation, and dexterous policy learning. To bridge the gap between visual perception and physical constraints, we introduce a two-stage refinement process to enforce spatial alignment and physical… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Ultimately, experimental results confirm an average success rate of over 75% across multiple synthetic manipulation tasks and validate the adaptability of the extracted manipulation priors across diverse dexterous hand embodiments. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

TopoRetarget: Interaction-Preserving Retargeting for Dexterous Manipulation

Authors: Jielin Wu, Shenzhe Yao, Guanqi He et al. | Submitted: 2026-06-15 | arXiv: 2606.16272 Categories: cs.RO

Research Background: Human hand-object demonstrations provide dense reference motions for training dexterous manipulation reinforcement learning (RL) policies through reference tracking. However, to use such demonstrations for RL policy learning, retargeting must preserve hand pose and task-relevant hand-object contact structure. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Otherwise, contact and feasibility artifacts can degrade downstream RL policy performance. We introduce TopoRetarget, an interaction-preserving retargeting framework that uses a single set of parameters across diverse retargeting conditions while maintaining task-relevant hand-object interaction and adapting human demonstrations to dexterous robot hands. The method constructs a sparse interaction graph over hand and object keypoints and… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Evaluations show that the generated references improve both interaction fidelity and policy learning: TopoRetarget achieves the best contact precision and alignment over all baselines on the ContactPose Dataset, improves Pen-Spin training success by… 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curation

Authors: Tao Xu, Jiaxin Wang, Runhao Zhang et al. | Submitted: 2026-06-15 | arXiv: 2606.16208 Categories: cs.RO

Research Background: In robot imitation learning, influence functions provide a principled approach to quantify each demonstration’s effect on robot task outcomes, yet scaling them to billion-parameter Vision-Language-Action (VLA) models is limited by computational and multitask bottlenecks. To this end, we propose ATHENA, an influence function framework tailored for… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Concretely, it leverages the Kronecker structure of linear-layer gradients to reduce projection cost, and approximates dense Hessian inversion with a rank-r Random Truncated Approximation, achieving about a 313.4x speedup in influence computation. Furthermore, ATHENA formulates global and local interactive influence to balance data curation across 50 jointly trained tasks. Extensive evaluations on RoboTwin 2.0 and real-robot deployment, covering… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Overall, ATHENA demonstrates its effectiveness for data curation in billion-parameter multitask VLA fine-tuning. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Kairos: A Native World Model Stack for Physical AI

Authors: Kairos Team, Fei Wang, Shan You et al. | Submitted: 2026-06-15 | arXiv: 2606.16533 Categories: cs.AI, cs.CV

Research Background: World models are transitioning from passive visual generators to foundational, operational infrastructure for Physical AI: they must natively acquire world knowledge from heterogeneous experience, maintain persistent states over long horizons, and execute efficiently within real deployment constraints. We introduce Kairos, a native world model… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: (1) Kairos learns the world by pioneering a Native Pre-training Paradigm governed by a Cross-Embodiment Data Curriculum, which organizes open-world videos, human behavioral data, and robot interactions into a progressive developmental pathway. (2) Kairos maintains the world by unified world understanding, generation, and prediction within a Native Unified Architecture equipped with Hybrid Linear Temporal Attention, where sliding-window attention… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Together, these results position Kairos as a cohesive operational foundation for future self-evolving physical intelligence. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Gershom Seneviratne, Yohan Abeysinghe, Jianyu An et al. | Submitted: 2026-06-16 | arXiv: 2606.18426 Categories: cs.RO

Research Background: We introduce VEGA, an approach for training navigation VisionLanguage-Action (VLA) models from unlabeled egocentric navigation videos. Internet-scale egocentric videos provide a scalable source of navigation-relevant visual observations, capturing cluttered scenes, close-range obstacles, and natural human motion through real-world spaces. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, these videos are not directly usable for policy learning because they do not provide obstacle-aware trajectories conditioned on explicit navigation goals in the robot’s coordinate frame. VEGA addresses this gap by reconstructing local scene geometry from monocular video, sampling navigation goals (represented as text, image, or spatial waypoints) and generating obstacle-aware trajectories using the constructed geometry. The resulting… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: The code and benchmark will be released at the time of publication. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

PAIWorld: A 3D-Consistent World Foundation Model for Robotic Manipulation

Authors: Yuhang Huang, Xuan Lv, Junyan Xu et al. | Submitted: 2026-06-16 | arXiv: 2606.18375 Categories: cs.RO

Research Background: World foundation models (WFMs) are powerful simulators, yet they predominantly operate in a single-view setting and lack the multi-view 3D consistency required for robotic manipulation. While robotic systems rely on multiple cameras (egocentric, eye-to-hand, and wrist-mounted) for policy learning, current multi-view world models simply concatenate… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This causes cross-view object drift, depth inconsistency, and texture misalignment. We trace these failures to two deficiencies: the absence of an explicit inter-view communication mechanism and the lack of a 3D geometric prior. We argue that resolving both simultaneously is necessary and sufficient. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Built upon a DiT-based world foundation model, PAIWorld achieves state-of-the-art multi-view 3D consistency on robotic manipulation benchmarks, ranking 1st on the WorldArena leaderboard and 2nd on the AgiBot-Challenge2026 leaderboard, while enabling… 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Guava: An Effective and Universal Harness for Embodied Manipulation

Authors: Haowen Liu, Xirui Li, Shaoxiong Yao et al. | Submitted: 2026-06-16 | arXiv: 2606.18363 Categories: cs.RO, cs.AI

Research Background: Language models trained on large-scale vision-language data have demonstrated strong potential for embodied agents. Harnessing models through embodied tools use offers a promising alternative to end-to-end vision-language-action systems by combining high-level reasoning with external modules for perception, planning, and control. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, it remains unclear what makes an effective harness for embodied manipulation, and to what extent such a harness can unlock embodied capabilities in a wide range of reasoning models. In this work, we present Guava, a harness framework for embodied tool use developed through systematic exploration of the design space of agent workflows, action spaces, and observation spaces. Our study identifies three key ingredients for effective… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Results suggest that a well-designed harness can serve as a scalable, model-agnostic interface for embodied manipulation, enabling strong emergent embodied capabilities in compact open-source models with minimal training data. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Recover, Discover, Plan: Learning Skills and Concepts from Robot Failures

Authors: Bowen Li, Mayank Mishra, Y. Isabel Liu et al. | Submitted: 2026-06-16 | arXiv: 2606.18328 Categories: cs.RO

Research Background: Intelligent robots should not only recover from failures, but also acquire the abstract knowledge needed to avoid them in the future. While reinforcement learning (RL) can learn reactive recovery behaviors, training a separate policy for every distinct failure mode is highly inefficient. 研究背景： 本研究聚焦於強化學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce Recovery-Driven Synthesis of Relational Concepts (ReSYNC), the first approach that progressively discovers and refines state abstractions (relational predicates) from failure-recovery experience to support abstract planning. Unlike purely reactive methods, ReSYNC jointly learns skills and concepts through an incremental dual-learning process. In the skill-learning phase, the robot uses RL to learn to recover from failures seen in… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決強化學習中的核心問題。

Key Takeaway: Overall, ReSYNC represents a significant step toward robots that autonomously acquire abstractions for scalable, failure-aware planning in the physical world. 核心發現： 實驗結果顯示所提方法在強化學習相關任務上顯著優於現有基準方法。

Visual Verification Enables Inference-time Steering and Autonomous Policy Improvement

Authors: Mingtong Zhang, Dhruv Shah | Submitted: 2026-06-16 | arXiv: 2606.18247 Categories: cs.RO, cs.AI

Research Background: Robots deployed in the real world should learn from their experience and improve over time. This requires a mechanism of practicing and learning from feedback. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In this paper, we propose VERITAS, a generator-verifier framework for generalist robot policies for inference-time policy steering and self-improvement. We use a pre-trained generalist robot policy as a generator'' and pair it with a gradient-free visual verifier” that evaluates actions at inference time. This framework enables inference-time steering that improves policy performance without additional training. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Our results highlight inference-time verification as a practical and scalable mechanism for improving robotic policies during deployment. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

EBench: Elemental Diagnosis of Generalist Mobile Manipulation Policies

Authors: Ning Gao, Jinliang Zheng, Xing Gao et al. | Submitted: 2026-06-16 | arXiv: 2606.18239 Categories: cs.RO

Research Background: We present EBench, a simulation benchmark that diagnoses generalist mobile manipulation policies beyond a single success-rate scalar. EBench comprises 26 diverse and challenging manipulation tasks annotated along 5 capability dimensions and 4 generalization dimensions. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We evaluate state-of-the-art generalist manipulation models including $π_{0}$ , $π_{0.5}$ , XVLA, and InternVLA-A1, and reveal that models with near success rates exhibit strikingly different capability profiles: $π_{0.5}$ achieves the highest test success rate and the best train—test retention, whereas InternVLA-A1 dominates mobile manipulation but collapses on dexterous tasks, and XVLA exhibits strengths on a disjoint set of atomic skills… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: We hope this benchmark offers a broad set of diagnostic signals to guide iteration on generalist manipulation models. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

EAGG: Embodiment-Aligned Grasp Generation via Geometry-Aware Graph Conditioning

Authors: Wanhao Niu, Qiyan Ke, Yuan Sun et al. | Submitted: 2026-06-16 | arXiv: 2606.18092 Categories: cs.RO, cs.AI

Research Background: Cross-end-effector grasp generation seeks a unified model that generalizes across objects and across embodiments ranging from parallel grippers to dexterous end effectors. Existing grasp generators are typically designed for a fixed embodiment or encode embodiment identity with a static descriptor, which weakens transfer when topology, actuation… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present EAGG, an embodiment-aligned grasp generator that represents each embodiment with a topology-aware end-effector graph and an embodiment-specific low-dimensional end-effector control space. A frozen end-effector-cognition backbone converts the current articulated state into geometry-aware tokens that act as a reusable morphology prior, and iterative geometry injection refreshes these tokens throughout sampling so that conditioning… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Code is available at https://github.com/wanhaoniu/EAGG. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Uncertainty Quantification for Flow-Based Vision-Language-Action Models

Authors: Ralf Römer, Maximilian Seeliger, Saida Liu et al. | Submitted: 2026-06-16 | arXiv: 2606.18043 Categories: cs.RO, cs.LG

Research Background: Vision-language-action models (VLAs) combine vision-language backbones with expressive generative action heads trained via flow matching on large-scale robotic datasets. Despite their strong empirical performance in robotic manipulation, VLAs lack mechanisms to quantify confidence in their predictions and to detect when their actions may be… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This presents a critical limitation for real-world deployment in non-stationary environments, where models inevitably encounter scenarios outside their pretraining distribution and may fail without warning. To address this, we derive an efficient method for quantifying epistemic uncertainty in flow-matching models by leveraging velocity-field disagreement (VFD) across a small ensemble. We successfully use this uncertainty estimate for failure… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Project website: tum-lsy.github.io/uq_vla/. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulation

Authors: Tianyi Lu, Hui Zhang, Zijie Diao et al. | Submitted: 2026-06-16 | arXiv: 2606.17937 Categories: cs.RO

Research Background: Most Vision-Language-Action (VLA) models map observations directly to actions without explicit reasoning, limiting their capacity for reasoning-intensive long-horizon tasks. To address this, existing approaches adopt Chain-of-Thought (CoT) reasoning to enable subgoal decomposition and spatial anticipation. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, those methods lack a unified architecture for effective cross-modal reasoning and fail to explicitly include inverse reasoning ability based on the target state. We argue that manipulation planning naturally decomposes into prediction, anticipating the next visual state, and inverse dynamics, inferring the actions to reach it. Bridging both requires a unified autoregressive architecture that interleaves textual and visual reasoning in a… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Extensive experiments on simulation and real-world benchmarks demonstrate that ThinkingVLA consistently outperforms state-of-the-art baselines, with particularly large gains on long-horizon manipulation tasks. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

Authors: Bochen Yang, Lianlei Shan | Submitted: 2026-06-16 | arXiv: 2606.17924 Categories: cs.RO, cs.AI

Research Background: Current Vision-Language-Action (VLA) models face a trade-off between efficient action generation and explicit deliberation. Directly decoding actions from vision-language backbone representations enables low-latency control, whereas explicit reasoning through textual chains, pixel-level subgoals, or action search can improve planning but incurs… 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We propose PearlVLA, a VLA framework that moves deliberation into the latent space of a vision-language model (VLM). PearlVLA separates VLM meta-query representations into a fixed visual grounding branch and an iterative latent plan branch. At each refinement round, a plan-conditioned world query probes a lightweight frozen latent world model for an action-free future observation latent, which is fed back to guide plan refinement. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Empirical evaluations on the LIBERO benchmark demonstrate that PearlVLA achieves state-of-the-art performance among existing methods. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

WAM-RL: World-Action Model Reinforcement Learning with Reconstruction Rewards and Online Video SFT

Authors: Zezhong Qian, Xiaowei Chi, Yu Qi et al. | Submitted: 2026-06-16 | arXiv: 2606.17906 Categories: cs.RO

Research Background: Recent World-Action (WA) models demonstrate strong generalization ability and data efficiency, but they typically rely on expert trajectories for training. This reliance limits their ability to acquire fine-grained manipulation skills beyond the demonstration distribution and prevents them from continuously improving through real-world interaction. 研究背景： 本研究聚焦於強化學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address these limitations, we propose WAM-RL, a reinforcement learning framework that enables joint optimization of the world model and the action model through online interaction with the environment. By allowing the two components to co-evolve, our approach enhances fine-grained control and adaptability. Specifically, a WA model consists of a world model and an actor. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決強化學習中的核心問題。

Key Takeaway: Our work is the first to introduce reinforcement learning into the World-Action paradigm, and provides insights into how online optimization of both the action head and the world model impacts overall performance. 核心發現： 實驗結果顯示所提方法在強化學習相關任務上顯著優於現有基準方法。

Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models

Authors: Haoqi Yuan, Zhixuan Liang, Anzhe Chen et al. | Submitted: 2026-06-16 | arXiv: 2606.17846 Categories: cs.RO, cs.CV, cs.LG

Research Background: Foundation models in language and multimodality achieve strong generalization by aligning heterogeneous data under a unified formulation and training at scale. In this report, we investigate whether this scaling recipe can be applied to robotic manipulation to achieve genuine generalization. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This is challenging because, unlike text, manipulation data is heterogeneous by nature, expensive to collect, and narrow in diversity, making alignment and scale simultaneously difficult. We present Qwen-RobotManip, a generalizable Vision-Language-Action foundation model built on Qwen-VL. Qwen-RobotManip introduces a unified alignment framework across the representation, motion, and behavioral dimensions of manipulation, making large-scale… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Qwen-RobotManip substantially outperforms prior state-of-the-art models, including $π$ 0.5, across all OOD settings, ranks 1st in RoboChallenge with a 20% relative improvement, and is validated on real-robot platforms including AgileX ALOHA, Franka,… 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

HumanoidArena: Benchmarking Egocentric Hierarchical Whole-body Learning

Authors: Taowen Wang, Zikang Xie, Bin Yang et al. | Submitted: 2026-06-16 | arXiv: 2606.17833 Categories: cs.RO

Research Background: Humanoid robots promise whole-body interaction in human-centered environments, but scalable policy learning remains difficult because task-level decision-making and whole-body dynamic execution are tightly coupled. A practical solution is hierarchical control, where a high-level policy predicts intermediate whole-body actions and low-level general… 研究背景： 本研究聚焦於人形機器人領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, existing benchmarks rarely evaluate the policy-tracker interface itself, leaving open whether intermediate whole-body actions are executable, robust under task distribution shifts, and transferable across different GMT backends. We introduce HumanoidArena, a simulation-first benchmark for egocentric hierarchical whole-body learning. The benchmark formulates policy learning as a hierarchical decision making problem: a high-level policy… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決人形機器人中的核心問題。

Key Takeaway: These results position HumanoidArena as a benchmark for studying transferable intermediate action representations and scalable egocentric whole-body policy learning. 核心發現： 實驗結果顯示所提方法在人形機器人相關任務上顯著優於現有基準方法。

ERQA-Plus: A Diagnostic Benchmark for Reasoning in Embodied AI

Authors: Hong Yang, Basura Fernando | Submitted: 2026-06-16 | arXiv: 2606.17639 Categories: cs.RO, cs.CV

Research Background: Generalist embodied agents require more than object recognition: they must reason about spatial relations, actions, procedures, human intentions, environmental constraints, and commonsense consequences from situated visual observations. Yet existing visual and embodied question answering benchmarks often provide limited control over the reasoning… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present ERQA-Plus, a diagnostic benchmark for reasoning in embodied AI. ERQA-Plus contains 1,766 question-answer instances grounded in 711 robot-centric images and organized according to a structured taxonomy spanning perceptual, action-centric, social-interaction, navigation-environmental, and contextual commonsense reasoning. The dataset is constructed using a multi-stage generation and validation pipeline that combines taxonomy-guided… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The dataset is available https://huggingface.co/datasets/huggingdas/erqa-plus and the project page at https://github.com/LUNAProject22/erqa-plus. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

MuseVLA: An Adaptive Multimodal Sensing Vision-Language-Action Model for Robotic Manipulation

Authors: Xingyuming Liu, Ruichun Ma, Heyu Guo et al. | Submitted: 2026-06-16 | arXiv: 2606.17598 Categories: cs.RO, cs.CV

Research Background: Humans naturally leverage diverse sensing modalities to interact with the physical world, while most Vision-Language-Action (VLA) models for robotics rely solely on RGB observations. This limits their ability to perceive physical properties that are difficult or impossible to infer from RGB cameras, such as temperature, sound, or radar response. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present MuseVLA, an adaptive multimodal sensing VLA model that integrates novel sensors as on-demand tools for robotic manipulation. Given a task instruction and visual context, MuseVLA first generates a sensor token and target description that select the sensing modality to invoke and what to attend to, analogous to a tool call with arguments. It then converts the selected sensor measurement into a grounded sensor image, a unified… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: MuseVLA achieves 80.6% success rate on average, outperforming RGB-only and multisensory VLA baselines significantly, and exhibits strong zero-shot capabilities on unseen tasks. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

MagicSim: A Unified Infrastructure for Executable Embodied Interaction

Authors: Haoran Lu, Songling Liu, Yue Chen et al. | Submitted: 2026-06-16 | arXiv: 2606.17511 Categories: cs.RO, cs.AI, cs.CV

Research Background: Robot learning and embodied agents now require simulation to serve as a shared execution substrate linking control, skills, and planning, not only as a renderer, controller testbed, or fixed task environment. Existing pipelines split these layers with “magic” actions, disconnected training environments, or forward-only renders that cannot… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present MagicSim, an embodied interaction infrastructure built around one deterministic batched runtime and a shared Markov decision process (MDP). From YAML-first specifications that decouple contents, placement, behavior, and agent exposure, MagicSim constructs diverse executable worlds spanning task families, interaction regimes, physics, layouts, sensors, avatars, and robot embodiments in one reset-and-step loop. A common execution… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: MagicSim thus unifies diverse world construction, embodied execution, task evaluation, automatic rollout generation, and interactive agent interfaces in one planner-in-the-loop runtime. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

GeneralVLA-2: Geometry-Aware Reconstruction and Governed Memory for Robot Planning

Authors: Haoyu Wang, Guoqing Ma, Zeyu Zhang et al. | Submitted: 2026-06-16 | arXiv: 2606.17480 Categories: cs.CV, cs.RO

Research Background: Generalist vision-language-action systems need object-centric 3D evidence and reusable manipulation experience to plan reliable robot trajectories. GeneralVLA provides a hierarchical interface for converting language and RGB-D observations into 3D end-effector paths, but two bottlenecks remain. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: First, monocular SAM3D-style object reconstruction can hallucinate pose and unseen geometry, while manipulation benefits from stable object shape when calibrated multi-view observations are available. Second, the original KnowledgeBank mainly retrieves semantically similar snippets and appends new knowledge, which makes it difficult to control memory quality, conflicts, confidence, and geometric relevance. To address the first challenge, we… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Website: https://aigeeksgroup.github.io/GeneralVLA-2. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulation

Authors: Shoujing Zhu, Zhenyang Liu, Fungmiu Wang et al. | Submitted: 2026-06-16 | arXiv: 2606.17463 Categories: cs.CV, cs.RO

Research Background: Vision-Language-Action (VLA) policies have achieved remarkable single-step manipulation, yet they remain brittle precisely where each stage depends on what was just completed. The core issue is structural: short-window VLAs lack an explicit channel for rouxting information across sub-task boundaries, and existing memory-augmented variants either… 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We identify the sub-goal completion event as the natural temporal unit for cross-subtask memory hand-off, and present WeaveLA (Weave Latent memory for Vision-Language-Action policies), a cross-subtask memory interface that, on top of a frozen VLA backbone, compresses each completed segment into latent tokens via query-driven attention pooling and routes them directly into the action-generation path of the next sub-task. This event-triggered,… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Per-episode paired analysis confirms the gains are confined to tasks whose causal structure requires cross-subtask information. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation

Authors: Haoran Lu, Mutian Shen, Shuyang Yu et al. | Submitted: 2026-06-16 | arXiv: 2606.17446 Categories: cs.RO, cs.CV

Research Background: Simulation enables scalable robot data collection, but raw 3D assets provide only geometry, lacking the semantic, interactive, and physical knowledge needed to specify where and how robots should act. In this work, we present AnnotateAnything, a general automatic annotation framework that converts passive 3D assets into manipulation-ready assets… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: AnnotateAnything is built around two complementary pipelines. First, a unified visual-language annotation pipeline using vision-language reasoning to infer object semantics, interaction constraints, and 3D-grounded cues, providing human-prior guidance for identifying meaningful interaction regions. Second, a fully automatic and massively parallel physics annotation pipeline grounds these priors in each asset’s geometry and physical constraints… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Videos, code, demo assets, and annotations are provided in supplementary materials Project page: https://tourmaline-caramel-169490.netlify.app. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

DF-ExpEnse: Diffusion Filtered Exploration for Sample Efficient Finetuning

Authors: Calvin Luo, Chen Sun, Shuran Song | Submitted: 2026-06-17 | arXiv: 2606.19656 Categories: cs.RO, cs.LG

Research Background: A natural recipe for intelligent robotic decision-making is initializing from pretrained generative control policies, which have summarized offline experience, and adapting them to self-collected online experience. We present DF-ExpEnse, an exploration technique that improves the quality of online experience collection, thus increasing finetuning… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: DF-ExpEnse leverages the multimodal modeling capabilities of the generative control policy to create an expressive and tractably evaluatable candidate set. It then utilizes an ensemble of critics to identify the action that best balances quality with high exploration interest. In fleet settings, DF-ExpEnse further enables cross-agent communication to facilitate collaborative exploration as a group. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Project can be found at https://df-expense.github.io. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

CTS-MoE: Implicit Terrain Adaptation via Mixture-of-Experts for Perceptive Locomotion

Authors: Francisco Affonso, Matheus P. Angarola, Ana Luiza Mineiro et al. | Submitted: 2026-06-17 | arXiv: 2606.19633 Categories: cs.RO, cs.AI

Research Background: Perceptive legged locomotion over discontinuous terrain (e.g., stairs, gaps, and obstacles) requires adaptive behavior, as a single conservative gait cannot produce the anticipatory maneuvers needed for abrupt topology changes. Cast as multi-task reinforcement learning, this problem introduces a tension between sharing and separation. 研究背景： 本研究聚焦於機器人運動領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Tasks use a common locomotion base but have conflicting rewards, so a policy must share behavior while avoiding value interference. Prior work addresses only one side, with monolithic policies sacrificing specialization and hierarchical sub-policies sacrificing generalization across transitions and unseen terrain. We propose CTS-MoE, which combines a dense mixture-of-experts actor with perception-based gating to compose shared behaviors and a… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人運動中的核心問題。

Key Takeaway: Project Website: https://cts-moe.github.io/ . 核心發現： 實驗結果顯示所提方法在機器人運動相關任務上顯著優於現有基準方法。

Formal Verification of Learned Multi-Agent Communication Policies via Decision Tree Distillation

Authors: Ahmad Farooq, Kamran Iqbal | Submitted: 2026-06-17 | arXiv: 2606.19632 Categories: cs.RO, cs.AI, cs.LG, cs.LO, cs.MA

Research Background: Multi-agent reinforcement learning (MARL) enables agents to develop coordination strategies through emergent communication, but neural policies lack the formal safety guarantees required for safety-critical robotic deployment in drone swarms and autonomous vehicle fleets. We present the first end-to-end framework for safety verification of learned… 研究背景： 本研究聚焦於強化學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Our four-stage pipeline consists of domain-specific feature extraction from agent observations, decision tree distillation achieving 97.9% +/- 1.2% fidelity to neural policies, automated translation to PRISM probabilistic model checker specifications with complete feature-to-state-variable correspondence, and compositional verification of Probabilistic Computation Tree Logic (PCTL) properties via pairwise decomposition with union-bound… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決強化學習中的核心問題。

Key Takeaway: Our framework provides empirically validated safety verification for distilled policy abstractions, serving as a practical bridge between deep MARL and formal safety workflows for multi-robot deployment. 核心發現： 實驗結果顯示所提方法在強化學習相關任務上顯著優於現有基準方法。

One Demo is Worth a Thousand Trajectories: Action-View Augmentation for Visuomotor Policies

Authors: Chuer Pan, Litian Liang, Dominik Bauer et al. | Submitted: 2026-06-17 | arXiv: 2606.19586 Categories: cs.RO

Research Background: Visuomotor policies for manipulation have demonstrated remarkable potential in modeling complex robotic behaviors, yet minor alterations in the robot’s initial configuration and unseen obstacles easily lead to out-of-distribution observations. Without extensive data collection effort, these result in catastrophic execution failures. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In this work, we introduce an effective data augmentation framework that generates visually realistic fisheye image sequences and corresponding physically feasible action trajectories from real-world eye-in-hand demonstrations, captured with a portable parallel gripper with a single fisheye camera. We introduce a novel Gaussian Splatting formulation, adapted to wide FoV fisheye cameras, to reconstruct and edit the 3D scene with unseen objects… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Comprehensive experiments in simulation and the real world show that our augmentation framework improves the success rate for various manipulation tasks in both the same scene and the augmented scene with obstacles requiring collision avoidance. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?

Authors: Yuyang Zhang, Wenyao Zhang, Zekun Qi et al. | Submitted: 2026-06-17 | arXiv: 2606.19531 Categories: cs.CV, cs.RO

Research Background: World Action Models (WAMs) commonly rely on video generation to bridge visual world modeling and robot control. However, video-based WAMs face three coupled limitations: dense multi-frame future tokens make inference costly, full video prediction spends capacity on action-irrelevant temporal and appearance details, and long-horizon future… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: These issues raise a simple question: Does world action model really need video generation? We propose ImageWAM, a simple WAM framework that repurposes pretrained image editing models for robot action prediction. In contrast to video generation, image editing provides a better-matched prior: it only needs to model a target-frame transformation, focuses on action-relevant current-to-target visual differences, and grounds task instructions to… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Attention analysis further shows that editing caches focus on task-relevant change regions, supporting image editing as an effective alternative to video-based world-action modeling. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Zero-Shot Long-Horizon Dexterous Manipulation via Multi-View 3D-Grounded VLM Reasoning

Authors: Jisoo Kim, Sangwon Baik, Taeksoo Kim et al. | Submitted: 2026-06-17 | arXiv: 2606.19340 Categories: cs.RO

Research Background: We present a zero-shot framework for long-horizon dexterous manipulation that grounds language instructions into executable 3D task plans from calibrated multi-view RGB images. Rather than training an end-to-end policy, our system uses a vision-language model (VLM) to produce reference-frame task grounding and primitive-level 2D keypoints, then… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This lifting combines triangulation of view-wise VLM groundings with reference-view ray voting, which searches along a semantic camera ray for geometrically consistent candidates across neighboring views. The resulting 3D keypoints support both pick-and-place and tool-use: for tool-use, we retrieve an object-centric atomic action corresponding to the inferred skill category and align its stored 6D tool trajectory to the scene; for dexterous… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: We further demonstrate long-horizon manipulation through closed-loop status verification and replan, enabling zero-shot execution on unseen objects and tool-use tasks in novel scenes. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Do as I Do: Dexterous Manipulation Data from Everyday Human Videos

Authors: Bhawna Paliwal, Haritheja Etukuru, William Liang et al. | Submitted: 2026-06-17 | arXiv: 2606.19333 Categories: cs.RO, cs.CV

Research Background: How can we scalably generate data for robotic manipulation, especially on human-like platforms such as dexterous multi-fingered hands? Learning from human videos has recently emerged as a likely answer to this question. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, difficulties in estimating hand-object interaction and crossing the human-to-robot embodiment gap have hindered the adoption of abundant monocular RGB-only human videos as the primary source of robot manipulation data. In this work, we present DO AS I DO, an algorithm to reconstruct and retarget monocular RGB human videos to multi-fingered dexterous robotic hands. DO AS I DO reconstructs hand-object interactions from various egocentric… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Our experiments enable us to propose an efficacy playbook for practitioners collecting human data for manipulation. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Playful Agentic Robot Learning

Authors: Junyi Zhang, Jiaxin Ge, Hanjun Yoo et al. | Submitted: 2026-06-17 | arXiv: 2606.19419 Categories: cs.RO, cs.AI

Research Background: Current agentic robot systems can write executable Code-as-Policy programs, observe feedback, and revise behavior across multiple attempts, but they remain largely task-driven: reusable skills are acquired only after explicit instructions. We study Playful Agentic Robot Learning, where an embodied coding agent uses self-directed play as a… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce RATs, Robotics Agent Teams designed for play-time skill acquisition. During play, RATs proposes novel yet learnable exploratory tasks, plans and executes robot-code policies, verifies intermediate progress, diagnoses failures, retries with dense, step-level feedback, and distills successful executions into a persistent code skill library. At test time, the agent reuses relevant skills from this frozen library to help solve new tasks. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Moreover, the learned skills can be plugged into other inference-time Code-as-Policy agents by simply retrieving them into the context, improving RoboSuite and real-world transfer by 8.9 and 8.8 points, respectively, without finetuning the… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Seeing Through Occlusion: Deterministic Arm Kinematic Correction for Robot Teleoperation

Authors: Thomas M. Kwok, Nicholas Koenig, Yue Hu | Submitted: 2026-06-17 | arXiv: 2606.19240 Categories: cs.RO, cs.CV, cs.HC, eess.SY

Research Background: Markerless, single-RGB-D-camera motion capture provides a low-cost and non-invasive alternative to conventional marker-based systems for robot teleoperation; however, depth estimation often degrades in the presence of self-occlusion, particularly during upper-limb motion. This paper presents an Arm Kinematic Correction (AKC) method that improves… 研究背景： 本研究聚焦於從示範學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: The proposed approach reconstructs occluded joint depths by leveraging wrist positions and predefined arm lengths via a deterministic formulation based on the Pythagorean theorem, thereby avoiding the need for complex probabilistic modeling or parameter tuning. Experimental validation against a Vicon reference system demonstrates reliable performance for both static and dynamic joint motions, evaluated using root-mean-square error (RMSE) and… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決從示範學習中的核心問題。

Key Takeaway: The results show that AKC enhances robustness and preserves anatomical consistency under long-duration, severe self-occlusion, even when paired with less reliable temporal filters, highlighting its practicality for real-time applications such as… 核心發現： 實驗結果顯示所提方法在從示範學習相關任務上顯著優於現有基準方法。

Invertible Neural Network Adapter for One-Step Flow Matching in Robot Manipulation

Authors: Yu Zhang, Kangyi Ji, Yongxiang Zou et al. | Submitted: 2026-06-17 | arXiv: 2606.19194 Categories: cs.RO

Research Background: This paper presents an invertible neural network adapter for general robotic manipulation, designed to generate precise high-dimensional actions conditioned on multimodal observations, including visual, linguistic, and proprioceptive inputs, through a one-step denoising process. Built upon a flow-matching formulation, the proposed adapter… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Compared with conventional iterative flow-matching policies, the proposed framework substantially reduces inference complexity while maintaining strong action prediction accuracy and stability. Extensive experiments are conducted across a diverse set of simulation benchmarks and real-world robotic platforms to evaluate the effectiveness of the proposed method. Across simulation benchmarks, the proposed adapter consistently demonstrates superior… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Furthermore, real-world experiments reveal a significant improvement in inference efficiency for vision-language-action (VLA) models, reducing the average inference latency from 110 ms to 61 ms while maintaining strong task performance. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

HT-Bench: Benchmarking and Learning Dexterous Full-Hand Tactile Representations with Egocentric Vision

Authors: Yuzhe Huang, Jiaping Wu, Jiaming Jiang et al. | Submitted: 2026-06-17 | arXiv: 2606.19161 Categories: cs.RO

Research Background: Establishing a universal benchmark for tactile representation learning in robotic manipulation remains challenging due to the diversity of tactile sensor designs, data formats, and robot embodiments. Rather than seeking to establish such, we explore a scalable and promising direction for future development: egocentric vision paired with full-hand… 研究背景： 本研究聚焦於觸覺感知領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To this end, we introduce \textbf{HT-Bench}, a large-scale multi-task benchmark for dexterous full-hand tactile sensing, comprising 10M RGB frames and 7.8M tactile frames collected across 226 tasks. HT-Bench evaluates tactile representations from three key perspectives: whether they encode meaningful contact geometry, whether they can align tactile observations with visual information, and whether they generalize to unseen tasks. To assess these… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決觸覺感知中的核心問題。

Key Takeaway: These results demonstrate the effectiveness of HandTouch and suggest that large-scale egocentric full-hand tactile data provides a scalable basis for evaluating and advancing tactile representation learning in dexterous manipulation. 核心發現： 實驗結果顯示所提方法在觸覺感知相關任務上顯著優於現有基準方法。

FlexLAM: Resolving the Bottleneck Trade-off in Latent Action Learning

Authors: Takanori Yoshimoto, Yang Hu, Naruya Kondo et al. | Submitted: 2026-06-17 | arXiv: 2606.19408 Categories: cs.LG, cs.RO

Research Background: Latent actions provide a compact interface between action-free video and downstream decision-making, yet existing Latent Action Models (LAMs) force every transition through a fixed-capacity bottleneck. We identify a bottleneck trade-off: overly tight codes can discard transition cues needed for action alignment, while overly loose codes preserve… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: FlexLAM replaces this fixed capacity with variable-length latent actions trained by nested dropout, yielding prefix-valid codes that capture compact transition structure first and add detail only when needed, without new architectures or losses. A single FlexLAM matches or surpasses separately trained fixed-capacity LAMs at every evaluated token budget under standard scarce-label supervision and under a low-return single-task alignment stress… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results suggest that variable-length latent actions are an architecture-free, drop-in upgrade to the fixed-capacity bottleneck in latent action models, latent-action world models, and video-pretrained action interfaces. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

GCNGrasp-VP: Affordance-Guided View Planning for Efficient Task-Oriented Grasping

Authors: Zanjia Tong, Wenlong Dong, Chengjie Zhang et al. | Submitted: 2026-06-17 | arXiv: 2606.19091 Categories: cs.RO

Research Background: Task-oriented grasping performance degrades significantly when object views suffer from occlusions. Existing task-oriented grasping methods typically assume task-relevant regions are visible in the initial frame, while view planning approaches enable active perception but often ignore task semantics and rely on time-consuming scene reconstruction. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address these limitations, we present GCNGrasp-VP, an efficient framework integrating affordance field prediction with active view planning. Central to this framework is GCNGrasp-v2, a task-oriented grasp model that simultaneously supports grasp evaluation and affordance field prediction, achieving constant-time inference complexity. Leveraging this capability, our Affordance-guided View Planner (Affordance-VP) utilizes the affordance field… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Code and models are available at https://github.com/Instinct323/GCNGrasp-VP. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulation

Authors: Zirui Zheng, Jiaqian Yu, Xiongfeng Peng et al. | Submitted: 2026-06-17 | arXiv: 2606.18960 Categories: cs.CV, cs.RO

Research Background: Action-conditioned world models have emerged as a promising paradigm for robot learning, offering a scalable alternative to costly real-world experimentation by generating action-consistent video rollouts. However, persistent world modeling remains challenging in manipulation: frequent end-effector occlusions and rapid wrist-camera motion make the… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Existing memory retrieval strategies often fail to identify informative history in dynamic manipulation scenarios. To address this limitation, we propose Mem-World, a memory-augmented multi-view action-conditioned world model. At its core, we present W-VMem, a 4D wrist-view-centered surfel-indexed memory that anchors historical observations to temporally evolving surface elements. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Extensive experiments show that Mem-World generates persistent rollouts in complex manipulation scenarios, enables more reliable policy evaluation than Ctrl-World, improving the Pearson correlation with real-world performance by 14.5%, and supports… 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

TactSpace: Learning a Physics-enriched Shared Latent Space for Tactile Sim-to-Real Transfer

Authors: Arunim Joarder, Arjun Bhardwaj, René Zurbrügg et al. | Submitted: 2026-06-17 | arXiv: 2606.18959 Categories: cs.RO

Research Background: Tactile sensing provides direct measurements of contact interactions that are essential for robotic manipulation. However, current simulators lack the fidelity to faithfully model the complex deformation and transduction mechanics of tactile sensors, severely hindering sim-to-real transfer in robot learning pipelines. 研究背景： 本研究聚焦於觸覺感知領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address this challenge, we propose a multi-modal representation learning framework that aligns heterogeneous tactile modalities within a shared latent space, eliminating the need for accurate raw-signal simulation while preserving relevant contact information. Our approach employs modality-specific encoders to project diverse tactile observations, such as simulated penetration depth and real-world capacitance, into a common embedding space… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決觸覺感知中的核心問題。

Key Takeaway: Finally, we release an efficient Warp-based implementation of a penalty-based tactile simulation model for Isaac Lab, enabling scalable tactile data generation. 核心發現： 實驗結果顯示所提方法在觸覺感知相關任務上顯著優於現有基準方法。

Motion-Focused Latent Action Enables Cross-Embodiment VLA Training from Human EgoVideos

Authors: Runze Xu, Yiluo Zhang, Jian Wang et al. | Submitted: 2026-06-17 | arXiv: 2606.18955 Categories: cs.CV, cs.RO

Research Background: Training generalist Vision-Language-Action(VLA) models typically requires massive, diverse robotic datasets with high-fidelity action annotations. While egocentric human manipulation videos are abundant and capture significant environmental diversity, the absence of action labels makes them difficult to use in conventional training paradigms. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address this, we propose a latent-action-based framework designed to extract general action priors from unlabeled human videos. The architecture features a Hybrid Disentangled VQ-VAE that decouples motion dynamics from environmental backgrounds through physical masks, enabling the construction of a cross-embodiment action codebook. By pre-training on human videos with the codebook, the VLM backbone learns deep representations of action intent. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Results in simulation and real-world environments show that our method, pre-trained exclusively on unlabeled human videos, performs competitively with state-of-the-art VLA models trained on massive annotated datasets, requiring only 50 trajectories… 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

Object-Centric Residual RL for Zero-Shot Sim-to-Real VLA Enhancement

Authors: Kinam Kim, Namiko Saito, Heecheol Kim et al. | Submitted: 2026-06-17 | arXiv: 2606.18953 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models can generalize across diverse manipulation tasks, but their imitation-learning-based policies remain brittle in precise physical interactions due to compounding execution errors; Can a reinforcement learning policy trained purely in simulation improve the robustness of real-world VLAs zero-shot? Residual RL,… 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We propose an object-centric residual RL framework that refines VLA actions using object poses, enabling a compact observation space that transfers consistently between simulation and reality. To align the two domains, we additionally replay the same teleoperation demonstrations in simulation to train a sim counterpart of the real-world VLA. The residual RL policy is trained only in simulation with pose noise injection and dropout, and transfers… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Project page: https://www.microsoft.com/en-us/research/articles/object-centric-residual-rl/ 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

DiffusionVS: A Generative Framework for Robust Visual Servoing Based on Diffusion Policy

Authors: Hongkang Cui, Rui He, Haoyao Chen | Submitted: 2026-06-17 | arXiv: 2606.19397 Categories: cs.RO

Research Background: Visual servoing is a fundamental technique in robotic manipulation and navigation. Regression-based visual servoing frequently experiences trajectory jitter as a result of noise-sensitive single-step mappings and the accumulation of errors during distribution shifts. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In contrast, Diffusion Policy maintains temporal consistency by predicting action sequences and improves robustness through implicit data augmentation. This paper presents a novel diffusion-based servoing method. Based on Diffusion Policy, the proposed approach uses normalized image coordinates of observed tag corners as input and generates camera velocity through conditional denoising. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results indicate that the proposed strategy possesses broad applicability and can enhance various visual servoing systems beyond the specific architecture presented here. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

HALOMI: Learning Humanoid Loco-Manipulation with Active Perception from Human Demonstrations

Authors: Zehui Zhao, Yuxuan Zhao, Gaojing Zhang et al. | Submitted: 2026-06-17 | arXiv: 2606.18772 Categories: cs.RO

Research Background: Human demonstrations, which can be collected at scale and naturally capture active hand-eye coordination, are a promising data source for learning humanoid loco-manipulation. However, directly transferring human demonstrations to humanoids requires a precise world-frame tracking controller, which is often brittle under Out-of-Distribution(OOD)… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address these challenges, we present HALOMI, a scalable framework for learning humanoid loco-manipulation with active perception from human demonstrations. HALOMI extends Universal Manipulation Interface (UMI) with egocentric sensing to collect ego-view and wrist-view observations along with head-hand trajectories at scale. We further propose a manifold-constrained controller that plans in a learned latent behavior manifold to enable precise… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Across the three quantitatively evaluated tasks, HALOMI achieves an average success rate of 85%, while additional qualitative demonstrations show its ability to support dynamic tossing and deep-squat grasping. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

A Scalable Embodied Intelligence Platform for Seamless Real-to-Sim-to-Real Transfer of Household Mobile Manipulation Tasks

Authors: Kui Yang, Xianlei Long, Haoxuan Li et al. | Submitted: 2026-06-17 | arXiv: 2606.18646 Categories: cs.RO

Research Background: Mobile manipulation is a fundamental capability in embodied intelligence robotics. The growing demand for robust and generalizable manipulation in unstructured household environments has driven rapid progress in embodied intelligence platforms. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, achieving a seamless transfer across the real-to-sim-to-real cycle faces three key challenges, including costly high-fidelity simulation scenes reconstruction, the complexity of systematic strategy evaluation in simulation, and incompatible real-world deployments. To address these challenges, we develop BestMan, a scalable and seamless real-to-sim-to-real platform that bridges the gap between the simulation and the real world, enabling… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Experimental results demonstrate the superior performance of our proposed platform in establishing standardized benchmarks and facilitating promising research in the field of mobile manipulation. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

ROBOSHACKLES: A Safety Dataset for Human-Injury Prevention in Embodied Foundation Models

Authors: Zhuowen Yin, Chongyang Liu, Wenzhang Yang et al. | Submitted: 2026-06-17 | arXiv: 2606.18632 Categories: cs.RO

Research Background: Embodied Foundation Models (EFMs) integrate multimodal understanding, future-state reasoning, and executable robot actions. Yet their safety alignment for human-injury prevention remains underexplored, primarily because real-world data of robots harming humans or creating hazardous household situations cannot be safely or ethically collected. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address this challenge, we propose a safety-critical data construction pipeline for human-injury prevention in EFMs.Starting from real DROID observations, our construction pipeline proceeds through scene understanding, hazard-aware image editing, temporal prompt generation, and single-pass rollout synthesis. The temporal prompts specify the expected scene evolution, while Wan2.7 synthesizes realistic robotic rollouts from the edited hazardous… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: ROBOSHACKLES serves as a scalable benchmark and training resource for refusal learning and hazard anticipation before robot action execution.The dataset is publicly available at https://huggingface.co/datasets/YZW00/RoboShackles. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Self-Supervised Mask-Aware Transformers for Fault-Tolerant FBG Force Sensing in Minimally Invasive Surgical Robotics

Authors: Peibo Sun, Shiyuan Dong, Shucheng Ye et al. | Submitted: 2026-06-17 | arXiv: 2606.18628 Categories: cs.RO

Research Background: In minimally invasive surgical robotics, catheter-scale Fiber Bragg Grating (FBG) sensors are promising due to their ability to estimate multi-dimensional forces by multiplexing several optical channels. However, deploying these compact multi-channel sensors introduces two critical engineering challenges: inherent nonlinear cross-axis coupling… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: These compounding issues severely degrade force estimation. Existing fault-tolerant approaches rely on combinatorial model banks, which scale exponentially with the channel count and demand prohibitively expensive per-pattern calibration. In this paper, we propose a unified, self-supervised mask-aware Transformer that explicitly models channel availability to enable graceful degradation under diverse and dynamic sensor failures. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: This significantly outperforms a comprehensive model bank of 255 per-pattern neural networks (0.0154~N at 4-channel loss) while eliminating pattern-specific calibration. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

SRL: Combining SLIP Model and Reinforcement Learning for Agile Robotic Jumping

Authors: Xiaowen Hu, Linqi Ye, Yudi Zhu et al. | Submitted: 2026-06-17 | arXiv: 2606.18625 Categories: cs.RO

Research Background: Robotic jumping is pivotal in applications such as search and rescue and logistics, where crossing obstacles and enhancing mobility efficiency are critical. The Spring-Loaded Inverted Pendulum (SLIP) model leverages simplified spring-mass dynamics that naturally encode biologically plausible hopping motions, yet its performance degrades on… 研究背景： 本研究聚焦於強化學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Meanwhile, Reinforcement Learning (RL) can adapt to diverse and complex environments but often requires extensive data from unguided exploration. The complementary strengths of SLIP’s physically grounded baseline and RL’s adaptive capabilities motivate a hybrid framework that overcomes these individual limitations. We therefore propose Spring-loaded Reinforcement Learning (SRL), which integrates SLIP-based feedforward control signals with… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決強化學習中的核心問題。

Key Takeaway: Through bipedal and quadrupedal simulations of ground and stair jumping, as well as sim-to-sim and sim-to-real validations, SRL exhibits robust adaptability to various task requirements and environmental complexities, underscoring its potential for… 核心發現： 實驗結果顯示所提方法在強化學習相關任務上顯著優於現有基準方法。

SC3-Eval: Evaluating Robot Foundation Models via Self-Consistent Video Generation

Authors: Wei-Cheng Tseng, Gashon Hussein, Yuzhu Dong et al. | Submitted: 2026-06-17 | arXiv: 2606.18610 Categories: cs.RO, cs.CV

Research Background: Evaluating generalist robot manipulation policies in the real world is expensive, slow, and difficult to scale. Action-conditioned video world models offer a scalable alternative by simulating policy rollouts. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Autoregressive rollouts accumulate compounding errors, observations across multiple camera views must remain mutually consistent, and the evaluator must generalize to policies whose behaviors lie outside the training distribution. We address these challenges with SC3-Eval, a self-consistent video generation recipe that adapts a pre-trained video foundation model into an accurate policy evaluator by enforcing three complementary forms of… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Across seven real-world vision-language-action policies, SC3-Eval attains a closed-loop Pearson correlation of $0.929$ and MMRV of $0.119$ , outperforming three strong prior video-model-based baselines, and generalizes to new tasks. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

DREAM-Chunk: Reactive Action Chunking with Latent World Model

Authors: Wenxi Chen, Kaidi Zhang, Chi Lin et al. | Submitted: 2026-06-17 | arXiv: 2606.18589 Categories: cs.RO

Research Background: Action chunking has become a common interface for vision-language-action (VLA) models, enabling low-frequency policy inference to drive high-frequency robot execution. However, once an action chunk is committed, its open-loop execution can be brittle under stochastic dynamics, hardware execution errors, and partial observability. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We propose DREAM-Chunk, a test-time scaling method that augments chunking-based policies with a lightweight latent world model, without requiring additional policy fine-tuning. At test time, DREAM-Chunk samples multiple candidate action chunks, rolls out their predicted latent futures, and selects actions from the chunk whose predicted state best matches the observed rollout. In this way, DREAM-Chunk uses additional test-time computation to… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Across simulation and hardware experiments, DREAM-Chunk improves the robustness of action-chunking policies in stochastic dynamics. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

MemoryWAM: Efficient World Action Modeling with Persistent Memory

Authors: Sizhe Yang, Juncheng Mu, Tianming Wei et al. | Submitted: 2026-06-18 | arXiv: 2606.20562 Categories: cs.RO

Research Background: Robust robotic manipulation in the real world requires not only an understanding of the current observation, but also memory and dynamics modeling. World action models (WAMs) possess these capabilities by jointly modeling visual foresight and actions conditioned on both current and historical observations, making them a promising paradigm for… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, existing WAMs face a fundamental trade-off: methods with efficient inference typically condition only on a bounded window of recent observations and therefore struggle in non-Markovian environments, whereas methods that preserve long histories incur time and space costs that grow substantially with sequence length. To address this challenge, we introduce MemoryWAM, a world action model with efficient persistent memory. MemoryWAM uses a… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Across long-horizon, memory-dependent manipulation tasks in both simulation and the real world, MemoryWAM outperforms strong vision-language-action (VLA) and WAM baselines while maintaining favorable computational efficiency. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Generating Robot Hands from Human Demonstrations

Authors: Sha Yi, Nicklas Hansen, Xueqian Bai et al. | Submitted: 2026-06-18 | arXiv: 2606.20549 Categories: cs.RO

Research Background: Robot learning has advanced rapidly in learning control, but learning the physical body of a robot remains much more difficult because jointly searching over design and control creates a very large combinatorial problem. Here, we present a data-driven framework for generating robot hands from human demonstrations. 研究背景： 本研究聚焦於從示範學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Instead of learning a complex controller together with each candidate design, we generate robot hand designs using the same simple control policy used after fabrication: matching fingertip positions through inverse kinematics. Using more than 4 million frames of human fingertip motion from everyday manipulation, our algorithm optimizes tree-structured robot hands to reproduce desired target motions. The framework produced both a… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決從示範學習中的核心問題。

Key Takeaway: These results showed that large-scale human motion data can be used not only to train robot controllers but also as a reference for optimizing and generating the physical embodiment of robots. 核心發現： 實驗結果顯示所提方法在從示範學習相關任務上顯著優於現有基準方法。

TaCauchy: An Extensible FEM Framework for Vision-Based Tactile Simulation

Authors: Hengfei Zhao, Yifan Xie, Junhao Gong et al. | Submitted: 2026-06-18 | arXiv: 2606.20426 Categories: cs.RO

Research Background: Vision-based tactile sensors require high-fidelity simulation for reinforcement learning, yet existing approaches struggle to provide accurate mechanical stress fields within GPU-accelerated robotics platforms. We present TaCauchy, an extensible Finite Element Method (FEM) framework that integrates rigorous physics-based force computation into… 研究背景： 本研究聚焦於觸覺感知領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Built on the Unified Incremental Potential Contact (UIPC) solver, TaCauchy directly computes Cauchy stress tensors from hyperelastic constitutive laws and projects them onto contact surfaces to obtain traction forces and pressure distributions, providing mechanical ground truth from first principles rather than empirical estimation. Our framework features automatic mesh generation with geometry-aware adaptive refinement and a modular sensor… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決觸覺感知中的核心問題。

Key Takeaway: Physical validation experiments show strong agreement between simulated and real tactile responses across force ranges from 1.2556 N to 4.7332 N, achieving SSIM above 0.93, confirming the framework’s capability to provide accurate,… 核心發現： 實驗結果顯示所提方法在觸覺感知相關任務上顯著優於現有基準方法。

CoLI: A Reproducible Platform for Continuum Robot Learning via Monolithic 3D Printing and Isomorphic Teleoperation

Authors: Ziyuan Tang, Chenxi Xiao* | Submitted: 2026-06-18 | arXiv: 2606.20389 Categories: cs.RO

Research Background: Continuum robots offer strong potential for manipulation tasks due to their high degrees of freedom, compliant structures, and operational safety. However, their adoption in both research and practical applications has been hindered by reproducibility issues arising from complex fabrication and assembly processes, challenging kinematic modeling,… 研究背景： 本研究聚焦於從示範學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address these challenges, we present a novel open-source continuum robot design. The platform features a simplified fabrication pipeline enabled by multi-material 3D printing, allowing the arm to be fabricated as a monolithic compliant structure with minimal assembly. Control is achieved through an isomorphic teleoperation interface that establishes a direct actuator-level mapping, eliminating the need for explicit kinematic modeling and… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決從示範學習中的核心問題。

Key Takeaway: Experimental results demonstrate that the platform provides a reproducible, learning-ready continuum robot system, accelerating algorithmic development and systematic benchmarking for the continuum robotics community. 核心發現： 實驗結果顯示所提方法在從示範學習相關任務上顯著優於現有基準方法。

Co-VLA: Coordination-Aware Structured Action Modeling for Dual-Arm Vision-Language-Action Systems

Authors: Yandong Wang, Jiaqian Yu, Xiongfeng Peng et al. | Submitted: 2026-06-18 | arXiv: 2606.20285 Categories: cs.RO

Research Background: Vision-language-action (VLA) models show strong capabilities in single and dual-arm robotic manipulation. Prior works show coordinated bimanual behaviors can emerge from end-to-end learning, leveraging large vision-language backbones with continuous action prediction. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, as bimanual tasks become tightly coupled and execution constraints become critical, implicit coordination alone is insufficient to ensure reliable, interpretable, and stable behavior. In this work, we propose Co-VLA, a coordination-aware bimanual manipulation framework introducing explicit structural priors into VLA models. We instantiate our method on a state-of-the-art vision-language backbone by replacing its monolithic action head… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Experiments across simulation and real-world benchmarks show Co-VLA significantly outperforms monolithic baselines, achieving a 27% success rate gain in tight-coordination tasks, more than doubling performance in OOD real-world scenarios (from 13%… 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think

Authors: Gia-Binh Nguyen, Trong-Bao Ho, Thien-Loc Ha et al. | Submitted: 2026-06-18 | arXiv: 2606.20246 Categories: cs.RO, cs.AI

Research Background: Vision-Language-Action (VLA) models pre-trained on massive video-robot datasets have revolutionized robotic manipulation, yet their multi-billion parameter architectures impose prohibitive computational burdens during downstream fine-tuning and real-time inference. In this work, we reveal a highly non-trivial architectural characteristic of these… 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To exploit this, we introduce a structural compression pipeline that is entirely training-free, bypassing the need of existing methods to load full-scale models to learn optimized token reductions or dynamic layer selectors. Instead, using only a single forward pass via Centered Kernel Alignment to identify redundant layer features, we remove twin layers to permanently compress the model depth by up to 50% across both the VLM backbone and the… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: These results prove that advanced VLAs require significantly fewer layers than previously assumed, offering a highly compute-efficient paradigm for scalable robot learning. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

Belt-Finger: An Affordable Soft Belt-Driven Gripper for Dexterous In-Hand Manipulation

Authors: Boya Zhang, Andreas Zell, Georg Martius | Submitted: 2026-06-18 | arXiv: 2606.20193 Categories: cs.RO

Research Background: Parallel-jaw grippers are the default manipulator choice in robotics because they are simple, robust, and inexpensive. Their limited in-hand mobility, however, often forces large arm motions and restricts dexterous manipulation in confined workspaces. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present a parallel-gripper upgrade: a double-soft-belt-based finger module that preserves standard opening/closing while adding three in-hand degrees of freedom (DoF): translation, pitch, and roll. The mechanism is deliberately kept simple and engineered for inexpensive manufacturing and straightforward integration, preserving the reliability and precise control of traditional parallel grippers while greatly broadening the range of… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Across a suite of challenging manipulation tasks executed via teleoperation, MPC, and trained policies, the proposed gripper consistently improves dexterity and task feasibility compared to a conventional parallel gripper 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Robust Assembly State Reasoning from Action Recognition for Human-Robot Collaboration

Authors: James Fant-Male, Roel Pieters | Submitted: 2026-06-18 | arXiv: 2606.20150 Categories: cs.RO

Research Background: Human Action Recognition (HAR) is frequently investigated in Human-Robot Collaboration (HRC) research to understand what actions have been performed and hence the state of a collaborative task. Accurately tracking an assembly state from HAR is however not fully investigated, and in realistic scenarios is not a trivial task. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This research systematically investigates and compares methods for tracking assembly state using action recognition inputs. Investigations using two diverse datasets and five state tracking approaches, including logic-based, Hidden Markov Model (HMM), and neural network (NN) methods, show that optimal approaches are not uniform across different tasks and that different methods fail under different circumstances. Testing is performed using both… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Methods which model expected action duration are also important for tasks with repeated actions where no additional sensing is provided. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Frequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation

Authors: Jianing Guo, Fangzheng Chen, Zihao Mao et al. | Submitted: 2026-06-18 | arXiv: 2606.20135 Categories: cs.RO, cs.AI

Research Background: Flow matching has emerged as a standard paradigm for robotic manipulation owing to its strong expressive power for modelling complex, multimodal action distributions, alongside similar approaches like diffusion policy. However, existing methods rely on discretized action chunks, making them brittle to demonstrations collected at heterogeneous… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In this paper, we propose Frequency-Aware Flow Matching (FAFM), which outputs continuous, temporally consistent actions. To handle heterogeneous frequency input, we transform discrete action sequences into the frequency domain with the discrete cosine transform (DCT), perform flow matching over the resulting coefficients, and reconstruct continuous actions via cosine basis expansion. To generate temporally consistent actions, we regularize the… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code available at https://anonymous.4open.science/r/FAFM. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentation

Authors: Jonghoon Lee, Seong Hyeon Park, Byungwoo Jeon et al. | Submitted: 2026-06-18 | arXiv: 2606.20118 Categories: cs.RO, cs.LG

Research Background: Vision-language-action (VLA) policies have shown strong potential for general-purpose manipulation, yet they often fail on novel, out-of-distribution objects whose appearance or geometry deviates from the training distribution. The standard remedy is to collect multi-view teleoperation data for every failure case, but this scales poorly in both… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce Pose6DAug, a failure-driven data augmentation framework that turns a policy’s own successful episodes into targeted demonstrations for its failure modes, without any new data collection. Our key insight is that each successful episode already encodes a physically valid action trajectory together with calibrated multi-view observations. By swapping only the manipulated object while preserving this trajectory, we obtain new and… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results show that multi-view and physically consistent augmentation is a practical path to scalable VLA generalization. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

VFILC: Accurate Frequency Extrapolations in Imitation Learning via Sampling Frequency ILC

Authors: Nozomu Masuya, Toshiaki Tsuji, Sho Sakaino | Submitted: 2026-06-18 | arXiv: 2606.20056 Categories: cs.RO

Research Background: Conventional neural network (NN)-based imitation learning methods for variable-speed motion either restricted their scope to interpolated speeds, or generated unpredictable motions when extrapolating beyond trained velocity ranges. Variable-frequency imitation learning (VFIL) enabled extrapolations of speeds by linking the NN model’s sampling… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This study proposes variable-frequency imitation learning with iterative learning control (VFILC) based on a combination of VFIL and iterative learning control (ILC) with both feedforward and feedback parts, the former taking advantage of VFIL and the latter adjusting the frequency errors. The experimental results showed that the proposed method successfully and accurately extrapolated motion speeds and reduced frequency errors in all three… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The proposed method also improved accuracy by 27% compared with VFIL even at an interpolated frequency for a contact-rich mixing task affected by complex friction traits. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

MirrorDuo: Reflection-Consistent Visuomotor Learning from Mirrored Demonstration Pairs

Authors: Zheyu Zhuang, Ruiyu Wang, Giovanni Luca Marchetti et al. | Submitted: 2026-06-18 | arXiv: 2606.20048 Categories: cs.RO

Research Background: Image-based behaviour cloning leverages demonstrations captured from ubiquitous RGB cameras. However, it remains constrained by the cost of collecting diverse demos, especially for generalizing across workspace variations. 研究背景： 本研究聚焦於從示範學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We propose MirrorDuo, a reflection-based formulation that operates on image, proprioception, and full 6-DoF end-effector action tuples, generating a mirrored counterpart for each original demonstration, effectively achieving “collect one, get one for free”. It can be applied as a data augmentation strategy for existing learning pipelines, such as standard behaviour cloning or diffusion policy, or as a structural prior for reflection-equivariant… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決從示範學習中的核心問題。

Key Takeaway: When demonstrations are confined to one side, MirrorDuo enables efficient skill transfer to the mirrored workspace with as few as zero or five demos in the target arrangement. 核心發現： 實驗結果顯示所提方法在從示範學習相關任務上顯著優於現有基準方法。

Tri-Info: Generalizable, Interpretable Failure Prediction for VLA Models via Information Theory

Authors: Jinghan Yang, Yunchao Zhang, Wang Yuan et al. | Submitted: 2026-06-18 | arXiv: 2606.19998 Categories: cs.RO, cs.AI, cs.CV, cs.LG

Research Background: Vision-Language-Action (VLA) models are increasingly deployed across diverse tasks, yet they remain black boxes whose physical interactions can cause irreversible harm, making generalizable and interpretable failure detection essential. We observe that successful and failed rollouts carry systematically different information-theoretic signatures. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Building on this, we formalize VLA control as a closed-loop information pipeline and derive the Triple Information-theoretic (Tri-Info) signals that capture whether actions remain diverse, temporally consistent, and coupled to state transitions. Across six VLA models and three benchmark environments, Tri-Info matches the strongest baselines in-domain. Moreover, Tri-Info transfers across architectures, environments, and the sim-to-real gap… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: This establishes Tri-Info as a simple yet powerful method that not only detects failures with strong cross-domain generalization, but also delivers interpretable diagnostics of the underlying failure modes. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

SWAP: Symmetric Equivariant World-Model for Agile Robot Parkour

Authors: Kaixin Lan, Ze Wang, Hongyi Li et al. | Submitted: 2026-06-18 | arXiv: 2606.19928 Categories: cs.RO

Research Background: While latent world models enable the proactive predictions required for extreme parkour, their purely data-driven nature forces them to redundantly encode left-right symmetric interactions as independent patterns. This inflates the learning burden and hinders the capture of geometric regularities, restricting the latent space’s efficiency for… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address this, we propose SWAP, an end-to-end equivariant symmetric world model. This framework embeds symmetry directly into both the world model and the actor-critic networks. In real-world tests, the robot leaps across a 2.13 m gap and climbs a 1.63 m platform, breaking records for quadruped parkour. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results demonstrate that symmetry equivariance is an effective structural prior for pushing the physical boundaries of learned legged locomotion. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

One-to-Two Acting: A Novel Framework for Single-arm Agent Action Expansion to Dual Arms

Authors: Youbin Yao, Nieqin Cao, Mingyan Li et al. | Submitted: 2026-06-18 | arXiv: 2606.19897 Categories: cs.RO

Research Background: Dual-arm manipulation can improve throughput via parallel execution, but collecting bimanual demonstrations for training is costly and difficult. We present ExS2D, a hierarchical action expansion framework that enables dual-arm manipulation from single-arm supervision. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: ExS2D first generates structured subtasks from textual instructions while explicitly capturing temporal precedence. It then grounds each subtask into executable actions through subtask-guided action mapping in observation. Finally, precedence-aware action allocation and synchronized planning are performed by a multimodal large language model driven coordinator to select collision-free dual-arm executions. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Real-robot experiments on four tasks further demonstrate the reliability of ExS2D for dual-arm execution under few-shot single-arm samples, while using zero bimanual demonstrations. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

EquiVLA: A General Framework for Rotationally Equivariant Vision-Language-Action Models

Authors: Thien-Loc Ha, Quang-Tan Nguyen, Trong-Bao Ho et al. | Submitted: 2026-06-18 | arXiv: 2606.19784 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models have emerged as a powerful paradigm for generalist robot manipulation, yet they lack geometric inductive biases: policies trained at specific orientations require substantially more data to generalize across rotational configurations. We present \textsc{EquiVLA}, the first general framework for end-to-end… 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: \textsc{EquiVLA} introduces \textsc{EquiPerceptor}, which produces approximately $SO (2)$ -equivariant visual representations from frozen ViT features; and \textsc{EquiActor}, an exactly $SO (2)$ -equivariant flow-matching Diffusion Transformer action head. Together, they establish an approximate $SO (2)$ equivariance chain from camera observations to predicted action sequences. Instantiated on GR00T~N1.5 and evaluated… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: $3.45$ ), and improves real-robot success from $54%$ to $72%$ . 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

Start Right, Arrive Right: Asynchronous Execution via Initial Noise Selection

Authors: Trong-Bao Ho, Quang-Tan Nguyen, Thien-Loc Ha et al. | Submitted: 2026-06-18 | arXiv: 2606.19774 Categories: cs.RO

Research Background: Action chunking enables robot policies to produce temporally coherent behavior, but generating multi-step action sequences with flow-based policies incurs latency that is incompatible with real-time control. Under asynchronous execution, the robot continues executing the current chunk while the next one is generated, causing even minor delays to… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Existing methods address this problem by steering generation toward the already executed action prefix. We instead show that prefix consistency can be achieved by selecting an appropriate initial noise before generation begins, allowing the unmodified flow ODE to produce a coherent next chunk. This reframes asynchronous inference as a noise selection problem rather than a trajectory steering problem. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Website: ~\href{https://paint-action-chunking.github.io}{\texttt{https://paint-action-chunking.github.io}}. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Data Standards for Humanoid Robotics: The Missing Infrastructure for Physical AI

Authors: Shaoshan Liu, Xiugong Qin, Xuan Wu et al. | Submitted: 2026-06-18 | arXiv: 2606.19769 Categories: cs.RO, cs.AI

Research Background: The scalability of humanoid robots will depend not only on models and hardware, but also on whether physical experience can accumulate across robots, tasks, organizations, and time. Drawing on the authors’ work in developing ISO/WD 26264-1, Humanoid robot datasets — Part 1: General requirements, within ISO/TC 299/WG 16, this article argues that… 研究背景： 本研究聚焦於人形機器人領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We develop three insights. First, humanoid robot data is embodied interaction data, not a collection of isolated digital samples; a useful dataset must preserve the relationship among robot body, action, task, scene, execution trace, and outcome. Second, its value depends on physical coherence: multimodal streams are reusable only when timing, coordinate frames, calibration, kinematics, units, and synchronization assumptions remain inspectable. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決人形機器人中的核心問題。

Key Takeaway: As AI moves from screens into bodies, data standards must evolve from organizing digital information to structuring physical interaction. 核心發現： 實驗結果顯示所提方法在人形機器人相關任務上顯著優於現有基準方法。

Temporal Self-Imitation Learning

Authors: Yinsen Jia, Boyuan Chen | Submitted: 2026-06-18 | arXiv: 2606.19752 Categories: cs.RO, cs.AI

Research Background: Long-horizon robot manipulation policies trained with reward shaping can still exploit dense rewards through inefficient interaction, while rare efficient behaviors may be forgotten during training. We argue that temporal efficiency itself provides a powerful and underutilized source of self-supervision for reinforcement learning. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce Temporal Self-Imitation Learning (TSIL), a reinforcement learning framework that mines temporally efficient successful trajectories generated during learning and converts them into reusable supervision for future policy improvement. TSIL progressively refines learning using configuration-conditioned adaptive temporal targets derived from fast successful trajectories, while preserving and replaying efficient behaviors through… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: More broadly, our results suggest that the temporal structure of successful behavior itself provides a scalable self-supervisory signal for reinforcement learning beyond manually engineered reward shaping alone. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Bidirectional Tutoring for Developmental Motor Learning in Robots: Co-Developed Interaction Dynamics Support Stable Learning

Authors: Rui Fukushima, Jun Tani | Submitted: 2026-06-18 | arXiv: 2606.19728 Categories: cs.RO, cs.AI

Research Background: Infants are well known to develop their motor skills through dense interaction with caregivers. Although such social interaction is crucial for human development, motor-skill learning in robots is often treated as a unidirectional process in which robots passively receive demonstrations from tutors. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This overlooks a key property of social interaction: it is inherently bidirectional, with tutor and learner dynamically adapting to each other. In such interactions, the robot’s past experiences may function as prior constraints that shape the dynamics of their co-developed trajectories. We hypothesize that bidirectional tutoring allows such constraints to guide the formation of consistent behavioral patterns that preserve behavioral coherence… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results suggest that bidirectional tutoring, as an embodied and socially grounded approach, provides an effective scaffold for developmental motor learning in robots. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies

Authors: Ganlin Yang, Zhangzheng Tu, Yuqiang Yang et al. | Submitted: 2026-06-18 | arXiv: 2606.20092 Categories: cs.CV

Research Background: Memory remains a critical bottleneck for long-horizon robotic manipulation, as standard Vision-Language-Action (VLA) policies often fail when task-relevant cues become occluded or unobservable over time. While existing memory-augmented methods utilize historical context, they either suffer from severe information bottlenecks, incur high latency… 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address these limitations, we introduce EventVLA, an end-to-end framework founded on the concept of sparse visual evidence memory that comprises two core components: foundational visual anchors to retain initial and short-term contexts, and a dynamic Keyframe Evidence Memory (KEM) module. Specifically, KEM directly predicts future keyframe probabilities from the VLA’s latent embeddings to autonomously capture and store sparse, task-critical… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Extensive evaluations show that across 17 memory-requiring simulation tasks and 4 real-world bimanual tasks, EventVLA achieves an average success rate improvement of +40% over state-of-the-art memory-augmented VLAs. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

Abstention-Aware Personalized Object Rearrangement via Uncertainty-Guided LLM Assistance

Authors: Sam Collin, Ali Ayub | Submitted: 2026-06-15 | arXiv: 2606.17309 Categories: cs.RO

Research Background: Robotic assistance in household environments requires not only predicting where objects should be placed, but also reasoning about when objects should not be placed at all. Existing approaches to personalized object rearrangement primarily focus on placement decisions under the assumption of clean observations and complete actionability, limiting… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In this paper, we introduce APOLLO, a hybrid framework for abstention-aware personalized object rearrangement that combines a lightweight, personalized embedding model (PEM) with selective large language model (LLM) assistance. PEM is trained for each user-environment pair using a small number of demonstrations, operates entirely on CPU, and produces uncertainty estimates, which are used to selectively invoke LLM-based reasoning only for… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code is available at https://github.com/PaInt-Lab/APOLLO. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Maeva Guerrier, Koki Kobayashi, Simon Roy et al. | Submitted: 2026-06-15 | arXiv: 2606.17294 Categories: cs.RO, cs.LG

Research Background: Vision Navigation Foundation Models (VNMs) promise end-to-end learned navigation policies capable of zero-shot deployment across diverse embodiments and environments. To maintain generality, many vision-based navigation models predict normalized actions. 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, this normalization introduces a critical deployment vulnerability: applying different scaling factors to the same normalized trajectory alters its physical geometry, which degrades navigation performance and increases collision risks. We address this vulnerability by conditioning the model on normalized action histories alongside image observations, providing explicit context on the relationship between the model’s predictions and the… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: VISTA generalizes robustly to out-of-distribution environments, achieving 100% goal prediction accuracy in zero-shot, real-world deployment in Outdoor, Forest and Office settings, and an average of 95% checkpoints crossed, demonstrating consistent… 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

Contrastive Action-Image Pre-training for Visuomotor Control

Authors: Yuvan Sharma, Dantong Niu, Anirudh Pai et al. | Submitted: 2026-06-15 | arXiv: 2606.17256 Categories: cs.RO, cs.CV

Research Background: Existing vision encoders for robotics face a fundamental bottleneck: robotic datasets lack the scale necessary for large-scale pre-training. Prior work circumvents this data scarcity by turning to internet-scale image and language data or egocentric human video. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: While these models show promise, neither paradigm learns from paired vision and action data, which downstream visuomotor control policies require. However, robot trajectories, the most direct source of this paired signal, are not available at pre-training scale, motivating us to extract action signals from abundant human video instead. To this end, we introduce CAIP (Contrastive Action-Image Pre-training), a vision encoder that treats human hand… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Our results show that our method of contrastive action-centric pre-training yields a scalable path to achieving robust visual representations better suited for physical interaction. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Svetlana Lukina, Mohamad Al Mdfaa, Gloria Haro et al. | Submitted: 2026-06-15 | arXiv: 2606.17183 Categories: cs.RO

Research Background: Answering navigation-relevant questions over long egocentric videos requires retrieving and organizing evidence distributed across distant temporal moments while maintaining spatial and contextual consistency. Although long-context vision—language models can achieve strong answer quality, they are computationally expensive for long trajectories… 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Recent graph-based approaches such as VL-KnG address this challenge through persistent spatio-temporal knowledge graphs, but graph-centric retrieval alone may underrepresent broader temporal continuity and contextual cues. We present VL-MemKnG, a hybrid memory framework that extends VL-KnG by combining a spatio-temporal knowledge graph with persistent segment-level contextual memory. The knowledge graph captures structured relational information… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: The gains are particularly pronounced on temporal-global and temporally scattered aggregation questions, demonstrating the benefits of combining structured relational memory with segment-level contextual memory while maintaining efficient query-time… 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

Hierarchical Advantage Weighting for Online RL Fine-Tuning of VLAs from Sparse Episode Outcomes

Authors: Tongyan Fang, Siyuan Huang, Naiyu Fang et al. | Submitted: 2026-06-15 | arXiv: 2606.17043 Categories: cs.RO, cs.LG

Research Background: When pretrained VLA policies are fine-tuned through online RL, each rollout episode produces only a single binary outcome (success or failure), yet the actor update requires per-transition supervision. Existing approaches commonly reduce this sparse outcome to a single scalar reward or advantage signal, which conflates distinct forms of… 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: First, a single scalar signal conflates the two objectives of viability and efficiency; once basic success is achieved, the binary label provides no gradient to distinguish efficient completions from slow ones. Second, real-world rollouts mix autonomous and intervention segments; naively assigning episode outcomes across these boundaries introduces incorrect credit assignment. To address these issues, we propose Hierarchical Advantage-Weighted… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: In real-robot experiments on three contact-rich bimanual tasks, HABC raises success from supervised fine-tuning (SFT) baselines of 36%, 44%, and 12% to 92%, 88%, and 38%. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

R2RDreamer: 3D-aware Data Augmentation for Spatially-generalized 2D Manipulation Policies

Authors: Xiuwei Xu, Haowen Sun, Angyuan Ma et al. | Submitted: 2026-06-15 | arXiv: 2606.17040 Categories: cs.RO, cs.CV

Research Background: Spatial generalization is critical for imitation-learned manipulation policies, but achieving it typically requires scaling demonstrations across diverse object poses, robot configurations, and camera viewpoints. Data augmentation from a few source demonstrations offers a practical alternative to costly real-world collection. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Simulation-based augmentation can create controllable variation, but requires complex environment and object setup and may introduce a sim-to-real gap. Recent real-to-real methods avoid these issues by jointly editing 3D observations and action trajectories from real demonstrations, yet they still rely on strong 3D scene parsing and geometry completion, and often produce observations tailored to 3D pointcloud policies rather than RGB-based 2D… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Experiments on spatially shifted manipulation tasks with both 2D diffusion-style policies and vision-language-action policies show that R2RDreamer improves spatial generalization from limited source demonstrations, with analyses validating the… 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Task-Error Residual Learning for Real-Robot Five-Ball Juggling

Authors: Kai Ploeger, Jan Peters | Submitted: 2026-06-15 | arXiv: 2606.16978 Categories: cs.RO, cs.LG, eess.SY

Research Background: For residual learning that refines existing behavior, sample efficiency depends on two things: how much information each rollout returns, and how efficiently the learner uses that information. Reinforcement learning’s standard scalar reward carries far less information than the directional task error that defines the task. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Random exploration further discards whatever information each rollout returns. Through residual learning with directional task-error supervision and a task error model that drives sample selection, we achieve stable three-, four-, and five-ball juggling on anthropomorphic Barrett WAM arms. Despite planning and controlling through a simple, idealized stack, the system converges from the second attempt. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Video documentation of all experiments is available at https://kai-ploeger.com/residual-juggling. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Zhizheng Liu, Honglin He, Vivek Alumootil et al. | Submitted: 2026-06-15 | arXiv: 2606.16953 Categories: cs.RO

Research Background: Urban sidewalk navigation presents significant challenges due to complex structural layouts, dynamic pedestrian behaviors, and long distances. While recent visual navigation models offer a promising solution, the lack of a unified benchmark hinders quantitative and reproducible evaluation. 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To bridge this gap, we propose SidewalkBench, a comprehensive benchmark designed for visual navigation on urban sidewalks. Built upon NVIDIA Isaac Sim, SidewalkBench brings GPU-accelerated simulation of diverse, high-fidelity sidewalk environments, including both procedurally generated and real-world scanned scenes. We further populate the scenes with rich, reactive event-based pedestrian behaviors and flexible, efficient animation, enabling… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: Our findings highlight that pedestrian interaction and long-horizon robustness remain critical bottlenecks for existing models, and scaling up sidewalk training with synthetic data emerges as a promising solution. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

Authors: Jan-Niklas Klein, Sona Ghahremani, Christian Medeiros Adriano et al. | Submitted: 2026-06-15 | arXiv: 2606.16935 Categories: cs.RO, cs.AI, cs.LG

Research Background: Rovers rely on perception to maintain spatial maps that encode both objects and sensor quality (e.g., range reliability, lighting artifacts, data density), guiding data fusion, embedding updates, and navigation under partial observability. To study these coupled perception-navigation processes, we present CrossMaps, a real-time confidence-aware… 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Building on VLMaps-style approaches, CrossMaps integrates multi-scale CLIP embeddings with confidence-aware fusion and a dual-memory architecture consisting of Short-Term Memory (STM) and Long-Term Memory (LTM). The STM aggregates noisy visual observations using geometric, semantic, and temporal confidence cues, while confident and coherent cells are promoted to the LTM as persistent semantic landmarks. Designed for deployment with a Jetson… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: Designed for deployment with a Jetson Orin-powered UGV alongside SLAM, CrossMaps runs in real time and produces semantic heatmaps that can be queried with natural language to guide rover navigation. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

SGM-SLAM: Scene Graph Matching for Data-Efficient Distributed SLAM

Authors: Yewei Huang, Tixiao Shan, Abhinav Rajvanshi et al. | Submitted: 2026-06-15 | arXiv: 2606.16881 Categories: cs.RO

Research Background: We introduce a data-efficient distributed Simultaneous Localization and Mapping (SLAM) framework designed for a team of robots equipped with LiDAR, cameras, and inertial sensors. Our framework uses scene graph matching to identify inter-robot measurement constraints. 研究背景： 本研究聚焦於機器人定位與地圖建構領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Unlike prior approaches that rely on feature-level matching, our framework is the first to perform scene graph matching using only object labels and centroids. Our approach constructs a scene graph by using fused RGB-LiDAR point clouds to generate both a semantically segmented point cloud layer, and a layer of discrete bounded objects, to accompany estimated robot trajectories. Scene graph matching is performed collaboratively through exchanging… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人定位與地圖建構中的核心問題。

Key Takeaway: We demonstrate the effectiveness and efficiency of our approach using both simulation and real-world datasets collected by legged robots in indoor and outdoor environments. 核心發現： 實驗結果顯示所提方法在機器人定位與地圖建構相關任務上顯著優於現有基準方法。

Video-Based Optimal Transport for Feedback-Efficient Offline Preference-Based Reinforcement Learning

Authors: Tung M. Luu, Hwanhee Kim, Younghwan Lee et al. | Submitted: 2026-06-15 | arXiv: 2606.16856 Categories: cs.RO

Research Background: Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL (PbRL) offers a promising alternative by learning reward functions from human feedback, but its scalability is hindered by high labeling costs. 研究背景： 本研究聚焦於強化學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Inspired by advances in Video Foundation Models (ViFMs), we present Video-based Optimal Transport Preference (VOTP), a semi-supervised framework that learns effective reward functions from only a handful of labels. By leveraging optimal transport to align visual trajectories within the rich representation space of ViFMs, VOTP effectively generates high-fidelity pseudo-labels for large amounts of unlabeled data, substantially reducing human… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決強化學習中的核心問題。

Key Takeaway: We also showcase the robustness of VOTP in the presence of visual distractors and validate its utility on real robotic tasks, where it learns meaningful rewards with minimal human input. 核心發現： 實驗結果顯示所提方法在強化學習相關任務上顯著優於現有基準方法。

DIFF-IPPO: Diffusion-Based Informative Path Planning with Open-Vocabulary Belief Maps

Authors: Sausar Karaf, Oleg Sautenkov, Mikhail Martynov et al. | Submitted: 2026-06-15 | arXiv: 2606.16780 Categories: cs.RO

Research Background: Exploration and object search require robots to perceive their environment, identify regions of interest, and plan trajectories that improve target-detection likelihood or maximize information gain. Many IPP methods, especially in continuous environmental monitoring, rely on Gaussian-process belief models, while object-search settings often… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Global trajectory generation directly conditioned on such non-Gaussian belief maps remains comparatively underexplored. Although diffusion-based planners offer strong capabilities for modeling such distributions, their use in informative path planning remains limited. In this work, we propose DIFF-IPPO, a pipeline that integrates an open-vocabulary belief map generator with a diffusion-based planner for global trajectory generation over belief… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: In this setting, a team of five drones using batched belief-map-conditioned trajectory generation achieves first detections in 3.5 minutes. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

VENOM: Versatile Embodied Network for Omni-bodied Motion tracking

Authors: Siddharth Padmanabhan, Kazuki Miyazawa, Takato Horii | Submitted: 2026-06-15 | arXiv: 2606.16696 Categories: cs.RO

Research Background: Achieving expert-level expressive full-body motion tracking across multiple humanoids solely from demonstration data remains a challenging and relatively an underexplored problem in humanoid robot learning. Cross-embodiment motion tracking policies are mostly trained by decoupling the control problem into upper and lower body control. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This work proposes VENOM, a cross-embodiment full-body motion tracking model for humanoids in simulation. VENOM is a GPT-based motion tracker trained on multiple humanoid data that can track the entire body without the requirement to split into upper and lower body control. We curate a multi-humanoid motion tracking dataset called the VENOM dataset that contains states, actions, and rewards and train VENOM and the baselines on this dataset. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: In this letter, we evaluate VENOM’s performance against baselines and show that we can achieve a stable motion tracker across different humanoids more capable than an MLP trained on multiple humanoid data with supervised learning alone, and also… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulation

Authors: Yanan Zhou, Ranpeng Qiu, Yincong Chen et al. | Submitted: 2026-06-15 | arXiv: 2606.16690 Categories: cs.RO, cs.AI, cs.CV

Research Background: Learning-based manipulation policies have made substantial progress in real-world robot manipulation, particularly for short-horizon action generation. However, deployment in open workspaces remains fragile under unexpected local scene dynamics, such as moving objects, transient occlusions, or disturbances near the intended motion. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Existing runtime monitors often rely on global observation anomalies, policy uncertainty, or frame-level visual changes, and struggle to distinguish task-relevant execution risk from benign visual variation. We introduce PATCH, an action-chunk-conditioned latent patch innovation monitor for deployment-time intervention. Given the active action chunk, PATCH defines a projected execution corridor, predicts latent patch evolution inside it, and… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Project Page: https://yananzhou5555.github.io/PATCH/. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Steering Generative Reinforcement Learning into Stable Robotic Controller

Authors: Yixuan Wang, Shutong Ding, Ke Hu et al. | Submitted: 2026-06-15 | arXiv: 2606.16572 Categories: cs.RO

Research Background: Diffusion and flow-based generative policies provide a powerful policy class for reinforcement learning by inducing rich stochastic exploration through iterative action generation. However, the stochasticity of diffusion policies is not suitable for stable and precise control in high-dimensional robotic systems, where small action variations can… 研究背景： 本研究聚焦於強化學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address this issue, we propose SteerGenPO, a latent-space reinforcement learning framework that steers a trained generative policy into a robust deterministic robotic controller. The key idea is to replace stochastic latent sampling of the trained generative policy with a learned latent actor that predicts a state-dependent latent input for the generative policies. This separates exploration and control: stochastic generative sampling… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決強化學習中的核心問題。

Key Takeaway: The results show SteerGenPO improves over both classical RL and generative RL baselines, while its deterministic latent steering produces more stable inference-time behaviors and more reliable command responses. 核心發現： 實驗結果顯示所提方法在強化學習相關任務上顯著優於現有基準方法。

PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models

Authors: Zhiang Chen, Nahyuk Lee, Boyang Sun et al. | Submitted: 2026-06-15 | arXiv: 2606.16569 Categories: cs.CV, cs.RO

Research Background: Registering two captures of the same indoor space taken at different times underpins persistent spatial memory for robots and AR systems, yet the realistic version of this task is egocentric and its most scalable form is RGB-only. Head-mounted cameras yield blurry, fast-moving, partially overlapping views from which dense geometry is hard to… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Classical registration leans on exactly the clean point clouds this setting lacks, while learned scene-graph methods require a pre-built or annotated graph and a trained matcher that we find brittle under egocentric data. We take a different route, using a pretrained vision-language model as the source of both scene understanding and cross-scan matching. Our method, PROSE (Prompted Scene rEgistration), lifts each RGB sequence into an… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: On the egocentric Aria Digital Twin and Aria Everyday Activities benchmarks, it outperforms both geometric and learned scene-graph baselines in registration accuracy, on ground-truth and RGB-reconstructed point clouds alike, and the scene graph it… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Elastic ODYN: Differentiable Optimization for Infeasible Control and Learning in Robotics

Authors: Aristotelis Papatheodorou, Jose Rojas, Ioannis Havoutis et al. | Submitted: 2026-06-15 | arXiv: 2606.16564 Categories: cs.RO, cs.LG

Research Background: Robotic systems routinely encounter conflicting objectives, modeling errors, and degenerate contact conditions that render quadratic programs (QPs) infeasible. Yet most optimization solvers and differentiable QP layers assume feasibility, leading to numerical failures, unstable gradients, or solver breakdown when constraints cannot be… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present Elastic ODYN, a primal—dual non-interior-point QP solver that handles infeasibility through smooth squared- $ℓ_{2}$ elastic relaxations. The resulting formulation remains well posed under ill-conditioning and degeneracy, supports warm starting, and converges to closest-to-feasible solutions when no feasible point exists. A lightweight refinement stage recovers physically meaningful dual variables from the elastic solution. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Across all settings, Elastic ODYN consistently outperforms state-of-the-art elastic QP solvers in robustness, warm-start performance, and convergence reliability, enabling optimization, simulation, control, and learning beyond the feasibility… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

ADAPT: Analytical Disturbance-Aware Policy Training for Humanoid Locomotion

Authors: Bofan Lyu, Jindou Jia, Kuangji Zuo et al. | Submitted: 2026-06-15 | arXiv: 2606.16542 Categories: cs.RO

Research Background: Humanoids deployed in human-centered environments must handle force-interactive tasks, where external contacts introduce unexpected disturbances that disrupt locomotion accuracy and stability. Existing learning-based approaches rely on broad domain randomization, task-specific force objectives, or learning-based force estimators from motion… 研究背景： 本研究聚焦於機器人運動領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present Analytical Disturbance-Aware Policy Training (ADAPT), a framework that equips humanoid policies with a physically grounded disturbance observer. The core of ADAPT is an analytical whole-body disturbance observer that estimates residual force/torque online with the accessible robot dynamics, without requiring force/torque sensors. Fed directly into the policy, the estimated disturbances give the humanoid an explicit, physics-derived… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人運動中的核心問題。

Key Takeaway: Moreover, ADAPT enables penalizing inferred disturbances at lower-body joints to encourage lighter locomotion. 核心發現： 實驗結果顯示所提方法在機器人運動相關任務上顯著優於現有基準方法。

APEX: Adaptive Policy Execution for Precise Manipulation

Authors: Mengfei Zhao, Chenxi Jiang, Tuo An et al. | Submitted: 2026-06-15 | arXiv: 2606.16504 Categories: cs.RO

Research Background: Modern imitation learning methods, including visuomotor and Vision-Language-Action (VLA) policies, typically output high-level action references that are executed by low-level controllers. However, the absence of higher-order reference signals, together with the policy’s lack of awareness of the underlying low-level control dynamics during… 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: As a result, realized actions deviate systematically from policy-commanded ones, with a critical impact on precision-sensitive manipulation. Prior work either modifies the policy architecture or the low-level controller, both requiring intrusive changes to the pretrained policy or packaged controller. This raises a natural question: when the policy and controller are both treated as inaccessible black boxes, can we bridge the execution gap? 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Extensive empirical studies show that APEX reduces controller-induced tracking error by 41.2% on demonstration replay and improves manipulation success by 4.8—25.8 percentage points across four visuomotor and VLA policy classes. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

HOLO-MPPI: Multi-Scenario Motion Planning via Hierarchical Policy Optimization

Authors: Youngjae Min, Jovin D’sa, Faizan M. Tariq et al. | Submitted: 2026-06-15 | arXiv: 2606.16480 Categories: cs.RO, cs.AI, eess.SY

Research Background: Robots deployed in the real world must plan motions across diverse scenarios without per-scenario retuning. End-to-end reinforcement learning (RL) can generalize across scenarios but often becomes brittle under distribution shift, reward misspecification, and stochastic interactions. 研究背景： 本研究聚焦於強化學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Model predictive path integral (MPPI) control enables strong real-time refinement without gradients, but its performance depends on a well-shaped sampling prior, while manually designing the priors does not scale to multi-scenario deployment. We present HOLO-MPPI (High-level Offline, Low-level Online MPPI), a multi-scenario motion planning framework that combines high-level policy learning with low-level stochastic optimal control. Offline, we… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決強化學習中的核心問題。

Key Takeaway: Our evaluation across diverse driving scenarios shows that HOLO-MPPI improves upon MPPI and end-to-end RL baselines while maintaining real-time control. 核心發現： 實驗結果顯示所提方法在強化學習相關任務上顯著優於現有基準方法。

Decoupled Object-Centric Video Understanding for Generating Robotic Manipulation Commands

Authors: Thanh Nguyen Canh, Thanh-Tuan Tran, Haolan Zhang et al. | Submitted: 2026-06-15 | arXiv: 2606.16470 Categories: cs.CV, cs.RO

Research Background: Translating video demonstrations into executable robot commands remains challenging because existing methods often fail to identify which objects are functionally involved in the demonstrated action. As a result, they may generate commands that are linguistically plausible but operationally ambiguous. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We propose an object-centric video understanding framework that decouples action recognition from object identification to generate precise, grammar-free manipulation commands. Our approach integrates Temporal Shift Modules (TSM) for efficient spatio-temporal action classification with a novel \textbf{Object Selection} algorithm that identifies task-relevant objects through trajectory-based role classification, blur detection, and overlap… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Across all semantic metrics, our approach consistently outperforms task-specific methods and remains competitive with, or surpasses, large general-purpose VLMs while retaining a modular, object-centric design. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

RHO: Your Coding Agent is Secretly a Roboticist

Authors: Karim Elmaaroufi, Justin Svegliato, Sarunas Kalade et al. | Submitted: 2026-06-15 | arXiv: 2606.16458 Categories: cs.RO

Research Background: Code-as-Policies (CaP) has shown that large language models (LLMs) can write code to solve robotics tasks by composing perception, planning, and control primitives. Recent CaP systems, however, rely on multi-turn code-generation loops at test time, which is often infeasible for real-time robot control. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce Robotics Harness Optimization (RHO), a novel paradigm in which tool-enabled coding agents, at training time, propose and search for interpretable, neurosymbolic multi-file policy repositories (Repositories-as-Policies) that compose these primitives rather than a single prompt, function, or file. RHO searches with reflective feedback from environment reward and execution rather than teleoperation demonstrations. It generalizes to… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: When an LLM is used in the control loop, as on RAI’s O3DE benchmark, RHO optimizes the deployed agent’s multi-file harness of prompts, tools, and control code, improving held-out success from 23.5% to 44.3% with 20% less wall-clock time and 27%… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Training and Evaluating Diffusion Policies with Long Context Lengths

Authors: Abhinav Agarwal, Adam Wei, Taylan Kargin et al. | Submitted: 2026-06-15 | arXiv: 2606.16447 Categories: cs.RO, cs.AI

Research Background: Imitation learning has enabled highly-dexterous robotic manipulation from RGB observations. Policies trained with these methods, however, typically condition robot actions on only a short history of observations. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: These policies cannot solve tasks that require memory and can get stuck repeatedly executing the same failing motions. In this work, we first benchmark policy performance as context length is incrementally increased from short to long, across a spectrum of tasks with varying local stability and memory requirements, and in multiple data regimes. To our knowledge, this is the first study to investigate context length in imitation learning at this… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Finally, we apply our findings to re-evaluate some previously proposed solutions to long-context imitation learning. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Yu Liu, Zongyang Chen, Yan Guo et al. | Submitted: 2026-06-15 | arXiv: 2606.16400 Categories: cs.RO

Research Background: Learning-based visual navigation has enhanced semantic goal-reaching capabilities. However, due to their black-box nature, purely end-to-end models often lack explicit geometric constraints, leading to unpredictable and unreliable obstacle avoidance in open environments. 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Conversely, traditional geometric planners ensure safety but struggle with high-dimensional visual targets. To address these limitations, we propose SemGeoNav, a novel hierarchical visual navigation framework.It tightly integrates the high-level semantic reasoning of end-to-end models with the reliable local planning ability of geometry-based methods, achieving robust image-based navigation while significantly improving obstacle avoidance… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: The results demonstrate that SemGeoNav outperforms existing representative methods, including ViNT and NoMaD, achieving higher success rates and shorter navigation times. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

3D Scene Graphs: Open Challenges and Future Directions

Authors: Dennis Rotondi, Francesco Argenziano, Sebastian Koch et al. | Submitted: 2026-06-15 | arXiv: 2606.19383 Categories: cs.RO, cs.CV

Research Background: 3D Scene Graphs (3DSGs) have emerged as a powerful representation for spatial AI by combining geometric grounding with semantic and relational abstractions of the environment. Their expressiveness has made them relevant to a broad range of problems in robotics and computer vision, including manipulation, navigation, task planning, scene… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, the field remains fragmented: different communities adopt distinct formulations, construction pipelines, and evaluation protocols, making it difficult to compare methods, identify common assumptions, and assess remaining challenges for robust real-world deployment. This survey provides a unified and critical review of 3DSGs, with particular emphasis on open challenges and future directions. We first formalize 3DSGs under a common… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: To support the community, we also provide a dedicated website that organizes and extends the surveyed content, accessible at https://3dscenegraphs.com/. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

ART-Glove: Articulated Tactile Glove for Contact-Grounded Dexterous Interaction Capture

Authors: Changyi Lin, Ding Zhao | Submitted: 2026-06-15 | arXiv: 2606.16370 Categories: cs.RO

Research Background: We present ART-Glove, an articulated tactile glove designed to capture contact-grounded dexterous demonstrations while preserving human dexterity. ART-Glove makes hand-side contact geometry explicit with 16 rigid functional surfaces covering the fingers, thumb, and palm. 研究背景： 本研究聚焦於觸覺感知領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Twenty-two anatomically aligned joints connect these surfaces and allow them to follow human hand motion during dexterous manipulation. Encoder-based sensing tracks surface motion, while dense piezoresistive tactile sensing records contact over the same surfaces. The complete system captures synchronized 22-DoF joint measurements and 2048-taxel tactile measurements at 120 Hz. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決觸覺感知中的核心問題。

Key Takeaway: We evaluate ART-Glove across experiments on motion freedom, joint sensing, tactile sensing, and contact-rich interaction capture, demonstrating its ability to preserve human dexterity while recording contact-grounded information that can support… 核心發現： 實驗結果顯示所提方法在觸覺感知相關任務上顯著優於現有基準方法。

FlowMPC: Improving Flow Matching policies with World Models

Authors: Chandon Hamel | Submitted: 2026-06-15 | arXiv: 2606.16286 Categories: cs.LG, cs.AI, cs.RO

Research Background: Flow Matching (FM) is a powerful approach for behavior cloning in multimodal action spaces [Jiang et al., 2025], but because it is not trained to directly maximize expected return, there is still room to improve how FM policies act at test time. This work investigates whether a learned world model can improve FM policies by enabling Model… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Building on TD-MPC2 [Hansen et al., 2024], I introduce FlowMPC, a framework that combines an imitation-learned FM policy with a learned world model for test-time planning in ManiSkill manipulation tasks [Tao et al., 2025]. Across PickCube and PickSingleYCB, adding the world model improved performance over the FM policy alone, with especially clear gains in end-of-episode success. These results suggest that world-model-based planning can… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results suggest that world-model-based planning can effectively complement flow-based imitation policies without modifying the FM training objective. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

EgoPhys: Learning Generalizable Physics Models of Deformable Objects from Egocentric Video

Authors: Hyunjin Kim, Ri-Zhao Qiu, Guangqi Jiang et al. | Submitted: 2026-06-15 | arXiv: 2606.16202 Categories: cs.CV, cs.AI, cs.RO

Research Background: Humans naturally understand object physics through everyday interactions, but faithfully predicting complex deformable dynamics, such as elastic materials and fabrics, remains a major challenge for computer vision and robotics. We present EgoPhys, a framework that constructs deformable physical digital twins from egocentric RGB-only video using… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: EgoPhys overcomes the limitations of existing methods to enable controllable deformable digital twin generation from egocentric videos by distilling per-object inverse-physics solutions into a compact codebook, enabling prediction of dense spring stiffness fields for unseen objects without per-spring test-time optimization. Trained with generalizable priors from diverse egocentric interactions, EgoPhys outperforms baselines in reconstruction,… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: We deploy EgoPhys on a real xArm6 robot, demonstrating that a digital twin initialized from a single egocentric human play video can serve as an internal world representation to aid in deformable-object planning, highlighting egocentric RGB… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Scaling Short-Term Memory of Visuomotor Policies for Long-Horizon Tasks

Authors: Rutav Shah, Rajat Kumar Jenamani, Xiaohan Zhang et al. | Submitted: 2026-06-15 | arXiv: 2606.16178 Categories: cs.RO

Research Background: Many robotic tasks require short-term memory, whether it’s retrieving an object that’s no longer visible or turning off an appliance after a set period. Yet, most visuomotor policies trained via imitation learning rely only on immediate sensory input without using past experiences to guide decisions. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present PRISM, a transformer-based architecture for visuomotor policies to effectively use short-term memory via two key components: (i) gated attention, which filters retrieved information to suppress irrelevant details, improving performance by reducing the spurious correlations between the history and current action prediction, (ii) a hierarchical architecture that first compresses local information into compact tokens and then integrates… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Additional materials are available at https://shahrutav.github.io/short-term-memory 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

A Deployment Case Study in Robotic Apparel Automation: Digital Twin Integration, Interoperability, and Workforce Enablement

Authors: Gokul Narayanan, Abhiroop Ajith, Jonathan Zornow et al. | Submitted: 2026-06-15 | arXiv: 2606.16078 Categories: cs.RO

Research Background: Despite steady advances in flexible automation in sectors such as electronics and automotive manufacturing, apparel automation remains challenging because fabrics are deformable and difficult to manipulate with robots. This paper presents a deployment-oriented case study of a robotic sewing system for denim manufacturing, emphasizing the… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: At the engineering level, a digital thread module parses DXF production drawings into process parameters and executable robot trajectories, reducing manual programming effort and enabling rapid re-targeting across sewing operations. In parallel, a digital twin of the workcell is used during pre-deployment to validate reach and clearance, refine layout and sequencing, evaluate operator access, and assess cycle-time compatibility with upstream and… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Two staged factory deployments on denim shorts, covering 2D pocket operations and 3D garment-shaping seams, show that digital-twin-based validation, digital-thread-driven task generation, interoperability, runtime verification, and operator training… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation

Authors: Jie Zhang, Xiaoyue Chen, Anzhe Chen et al. | Submitted: 2026-06-15 | arXiv: 2606.17030 Categories: cs.CV

Research Background: We introduce Qwen-RobotWorld, a language-conditioned video world model for embodied intelligence. With natural language as a unified action interface, it predicts physically grounded future visual trajectories from current observations across robotic manipulation, autonomous driving, indoor navigation, and human-to-robot transfer. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This unified formulation provides three promising application directions: synthetic data generation for policy training augmentation, scalable virtual environments for policy evaluation, and language-guided planning signals for downstream robot control. This is achieved through a three-part design: a) Double-Stream MMDiT with MLLM Action Encoding, where a 60-layer double-stream diffusion transformer couples frozen Qwen2.5-VL semantics with… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Additional zero-shot analyses on RoboTwin-IF benchmark further support robust generalization and multi-view consistency. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Learned Image Compression for Vision-Language-Action Models

Authors: Hyeonjun Kim, Jegwang Ryu, Sangbeom Ha et al. | Submitted: 2026-06-15 | arXiv: 2606.16253 Categories: cs.CV, cs.AI

Research Background: Vision-language-action (VLA) models increasingly rely on high-frequency multi-camera observations, making visual communication a major bottleneck for real-time robotic control in bandwidth-constrained or distributed deployment settings. Existing image and video codecs, however, are designed to preserve generic visual fidelity rather than the… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In this work, we introduce SPARC (SPatially Adaptive Rate Control), a learned image compression framework tailored for VLA-driven robots. Our key observation is that the importance of visual information varies substantially across both camera views and spatial regions within an image. Based on this observation, SPARC employs a lightweight temporal mask selector that adaptively allocates bitrate over latent representations according to task… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: We additionally demonstrate real-world deployment benefits in remote-control settings, where our method substantially improves the bitrate-success tradeoff. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

AI Sandboxes: A Threat Model, Taxonomy, and Measurement Framework

Authors: Inderjeet Singh, Haitham Mahmoud, Andrés Murillo | Submitted: 2026-06-16 | arXiv: 2606.18532 Categories: cs.CR, cs.AI, cs.RO, cs.SE

Research Background: AI systems are increasingly evaluated in bounded environments that combine isolation, simulation, instrumentation, supervision, and evidence capture. For physical AI, AIoT, and cyber-physical systems, this shift is not a matter of terminology: the system under test may sense, decide, actuate, communicate, and fail through physical processes,… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This article develops an assurance-oriented account of AI sandboxes as controlled environments for testing, evaluation, verification, and validation across digital AI, embodied autonomy, and cyber-physical deployments. We formalize the sandbox boundary and a weakest-link rule for composing per-dimension evidence into a bounded deployment claim; separate major sandbox archetypes; define a cyber-physical threat model that includes attacks on the… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The resulting threat model, taxonomy, and measurement framework clarify what a sandbox can validly test, which risks it can contain, and what forms of evidence it can support for safety, security, and regulatory assurance. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

As You Wish: Mission Planning with Formal Verification using LLMs in Precision Agriculture

Authors: Marcos Abel Zuzuárregui, Stefano Carpin | Submitted: 2026-06-16 | arXiv: 2606.18519 Categories: cs.RO, cs.AI

Research Background: Though robotic systems are now being commercialized and deployed in various industries, many of these systems are highly specialized and often require an advanced skill set to operate and ensure they perform as instructed. To mitigate this problem, we recently introduced a mission planner leveraging LLMs to synthesize mission plans in precision… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: While the system demonstrates impressive performance, it also suffers from the inherent ambiguities of natural language. In this paper, we extend our system to address this issue by introducing multiple feedback loops in the planning architecture that leverage linear temporal logic (LTL) to ensure the mission planning system meets the specifications formulated by the user while still using natural language. To mitigate potential bias, this is… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Through extensive experiments, we highlight the strengths and limitations of integrating mission verification into a fully autonomous pipeline, particularly regarding an LLM’s ability to generate valuable LTL formulas, and show how our proposed… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Task Allocation and Motion Planning in Dynamic, Cluttered Environments via CBBA and Graphs of Convex Sets

Authors: Matthew D. Osburn, Cameron K. Peterson, John L. Salmon | Submitted: 2026-06-16 | arXiv: 2606.18516 Categories: cs.RO

Research Background: Multi-agent task planning in cluttered, dynamic environments requires assigning tasks to agents while simultaneously determining safe, time-efficient trajectories through the environment. When tasks are dynamic, such as rendezvous objectives, allocation decisions depend not only on which agent is best suited for a task, but also on when and where… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This paper presents a solution to this problem, which combines Graphs of Convex Sets (GCS) for trajectory optimization with the Consensus-Based Bundle Algorithm (CBBA) for distributed task allocation. In our approach, GCS finds optimal trajectories through dynamic environments using a time-extended (3D+time) configuration space. At the same time, CBBA coordinates task assignments across agents, enabling informed decision-making in a moving… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: We demonstrate the effectiveness of our approach in simulated cluttered environments with static and dynamic tasks. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

N(CO) $^{2}$ : Neural Combinatorial Optimization with Chance Constraints to Solve Stochastic Orienteering

Authors: Anas Saeed, Marcos Abel Zuzuárregui, Stefano Carpin | Submitted: 2026-06-16 | arXiv: 2606.18514 Categories: cs.RO, cs.LG

Research Background: Neural combinatorial optimization (NCO) offers a promising alternative to traditional heuristic-based methods for solving complex graph optimization problems by proposing to learn heuristics through data. This class of problems frequently arises in automation, as it can be used to model a variety of applications. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: While NCO has been extensively studied for deterministic combinatorial optimization problems, there are only a few works that aim to solve stochastic combinatorial optimization problems. In this work, we present N(CO) $^{2}$ : Neural Combinatorial Optimization with Chance cOnstraints to solve the Stochastic Orienteering Problem (SOP) without the use of hand-crafted heuristics. By integrating a reinforcement learning (RL) framework, the model… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The proposed approach reduces human effort in heuristic design while enabling adaptive and efficient decision-making in uncertain environments. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

MOCHI: Motion Enhancement of Collaborative Human-object Interactions

Authors: Jiye Lee, Yonghun Choi, Jungdam Won | Submitted: 2026-06-16 | arXiv: 2606.18243 Categories: cs.CV, cs.GR, cs.RO

Research Background: Collaborative human-object interaction shows dynamic and complex movements that require mutual anticipation and continuous adjustment between participants and the shared object. Modeling such collaborative multi-human object interaction (MHOI) scenarios requires high-quality data acquisition as a foundational step; however, this is challenging due… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Such complexity leads to noisy MHOI captures characterized by several artifacts: contact misalignment between hands and objects, motion jitter and temporal inconsistencies in the captured sequences, and missing or incomplete finger-level articulation details. To address these challenges, we present MOCHI (MOtion Enhancement of Collaborative Human-object Interactions), a two-stage framework for enhancing noisy MHOI data. Our approach first… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: We further show robustness of our system across varying numbers of participants and types of interactions, and demonstrate various applications including keyframe-based MHOI creation and data augmentation through varying object geometries. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Beyond Failure Recovery: An Engagement-Aware Human-in-the-loop Framework for Robotic Systems

Authors: Jiaying Fang, Joyce Yang, Zhanxin Wu et al. | Submitted: 2026-06-16 | arXiv: 2606.18189 Categories: cs.RO

Research Background: Conventional human-in-the-loop approaches typically involve users only when a robot encounters failure or uncertainty, treating humans primarily as tools for improving robot performance. However, in many human-centered robotics settings, interaction should support engagement by keeping users involved in decision-making rather than limiting them to… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This is particularly compelling in physical caregiving, where mobility limitations can reduce users’ ability to intervene or modulate the robot’s behavior in the moment. As a result, failure-driven interaction policies may relegate users to passive observers for long stretches of the task. For example, a user with mobility limitations may feel less engaged when being continuously and passively fed by a robot. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: In addition, we conduct a real-world user study with participants with emulated mobility limitations on a robot-assisted bite acquisition system, showing that E-MPC improves user experience while maintaining task success. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Jiazhao Zhang, Gengze Zhou, Hale Yin et al. | Submitted: 2026-06-16 | arXiv: 2606.18112 Categories: cs.RO, cs.CV

Research Background: Agentic navigation systems require a base navigation model whose observation strategy can be externally reconfigured at inference time, because instruction following, object search, target tracking, and autonomous driving share the same perception-planning backbone yet demand fundamentally different strategies for consuming the visual stream. We… 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: With training-time randomization over all parameters, Qwen-RobotNav is robust to any inference-time configuration requiring zero architectural modification to the Qwen-RobotNav backbone. We train Qwen-RobotNav on 15.6M samples; co-training with vision-language data prevents the collapse into reactive action-sequence mappers observed in trajectory-only training. The parameterised interface also makes Qwen-RobotNav a natural building block for… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: The model exhibits favourable scaling from 2B to 8B parameters, with joint multi-task training developing a shared spatial-planning substrate that transfers across task families, and demonstrates strong zero-shot generalisation to real-world robots… 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

WireCraft: A Simulation Benchmark for Industrial DLO Manipulation

Authors: Chongyu Zhu, Ramy ElMallah, Hyegang Kim et al. | Submitted: 2026-06-16 | arXiv: 2606.18097 Categories: cs.RO

Research Background: Deformable Linear Objects (DLOs), such as wires and cables, are central to industrial assembly. Unlike rigid objects, whose state is captured by a 6-DoF pose, DLOs have an infinite-dimensional configuration space and deform continuously under contact with grippers, fixtures, and the workspace, making them a demanding benchmark for general… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Despite their importance, policy development and comparison remain difficult: existing benchmarks are often tied to specific hardware setups, lack modular and customizable task assets, or study generic deformable-object tasks without the fixtures relevant to real-world industrial wire manipulation. Few benchmarks align simulation, real-world data, and shared evaluation protocols. To bridge this gap, we introduce WireCraft, a simulation benchmark… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: The benchmark, data, and tools will be open-sourced upon acceptance. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

A Hybrid Optimization Framework for Grasp Synthesis under Partial Observations

Authors: Wenzheng Zhang, Fahira Afzal Maken, Tin Lai et al. | Submitted: 2026-06-16 | arXiv: 2606.18053 Categories: cs.RO

Research Background: We propose a hybrid grasp synthesis framework that combines a learning-based Energy-Based Model (EBM) with an analytical Iterative Closest Point (ICP) method to generate robust grasps from partially observed point clouds. The learned energy function acts as a prior within a Stein Variational Gradient Descent (SVGD) framework, guiding iterative… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Evaluated on 67 objects with 5,360 grasp attempts, our method achieves an average success rate of 60.9%, outperforming AnyGrasp (31.1%) and Grasp Pose Detection (48.4%) and AS-ICP (56.6%). These results highlight the strong generalization ability of our approach and demonstrate how combining data-driven learning with geometric optimization addresses the limitations of either strategy in isolation. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: These results highlight the strong generalization ability of our approach and demonstrate how combining data-driven learning with geometric optimization addresses the limitations of either strategy in isolation. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

LAGO Policy: Latency-Aware Asynchronous Diffusion Policies with Goal-Directed Collision-Free Planning for Smooth Manipulation

Authors: Guowei Shi, Xupeng Xie, Yiming Luo et al. | Submitted: 2026-06-16 | arXiv: 2606.17982 Categories: cs.RO

Research Background: Diffusion-based visuomotor policies deployed with asynchronous inference often exhibit inter-chunk discontinuities and lack explicit mechanisms for obstacle-aware execution, leading to jerky motions and collisions that hinder reliable manipulation in real-world scenes. To address these issues, we propose LAGO Policy, a unified asynchronous… 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: LAGO Policy improves inter-chunk consistency via latency-aware classifier-free guidance conditioning on future actions. It further enables goal-directed collision-free trajectory planning by predicting a task-relevant interaction goal from demonstrations. Finally, spatial-temporal trajectory optimization refines the actions to be executed for low-jerk and feasible motion. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Project Website: https://lago-policy.github.io/ 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Authors: Mengke Zhang, Sitong Li, Tiancheng Lai et al. | Submitted: 2026-06-16 | arXiv: 2606.17630 Categories: cs.RO

Research Background: Safe and efficient trajectory planning in unknown, cluttered 3D environments constitutes a critical bottleneck for deploying Unmanned Aerial Vehicles (UAVs) in real-world applications. This challenge is further exacerbated by the limited field-of-view (FOV) and sensing range of onboard sensors. 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Many existing methods either make simplistic assumptions about unexplored space or rely on conservative heuristics such as speed limits or fixed perception patterns, reducing efficiency and generalizing poorly across different sensor types. In this work, we propose a novel planning framework that directly integrates active perception into trajectory optimization, thereby improving safety while preserving efficiency. The perception constraints… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: Extensive simulations and real-world experiments demonstrate robust performance across diverse unknown environments with varying sensor configurations. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments

Authors: Jiawei Zhang, Yiming Yan, Chao Liang et al. | Submitted: 2026-06-16 | arXiv: 2606.17520 Categories: cs.RO, cs.CV

Research Background: Training embodied agents in the real world requires skilled operators and expensive hardware. Simulation environments offer a compelling alternative by enabling large-scale, cost-effective data augmentation. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Consequently, rapidly constructing high-fidelity simulation scenes with a minimal sim-to-real gap has become a critical objective in robot learning. While reconstruction-based methods provide superior visual quality, current workflows are hindered by inefficient data acquisition and subpar foreground object extraction. We thus propose GASE, a highly automated system for simulation scene construction. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code will be released. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

When Robots Sleep: Offline Skill Consolidation for Shared-Policy Robot Learning

Authors: Nethmi Jayasinghe, Diana Gontero, Amit Ranjan Trivedi | Submitted: 2026-06-16 | arXiv: 2606.17493 Categories: cs.RO

Research Background: Robots that learn over long deployments must add new skills without losing the shared policy structure that makes earlier skills reusable. We study sequential robot skill learning, where previous trajectories and task losses may be unavailable, and the deployed policy must remain a single shared controller without task-specific heads, routing, or… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We identify skill-coupling collapse, a failure mode in which individual skill success remains non-trivial while reliability among related skills deteriorates. We propose Sleeping Robots, a wake-sleep framework that learns each new skill during wake and consolidates the shared policy offline during sleep using compact frozen skill memories: frozen critics with unordered state buffers for reinforcement learning and frozen actor snapshots with… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: On Meta-World MT5, Sleeping Robots improves average success by 64 % and pairwise reliability by x 2.0 over the strongest non-oracle baseline, and on SurgicAI it improves average success and backward transfer relative to continual imitation baselines… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

DexLink Hand: A Compact, Affordable, 16-DOF Linkage-Driven Hand with Human-Like Dexterity

Authors: Hao Wu, Yanzhe Wang, Yu Feng et al. | Submitted: 2026-06-16 | arXiv: 2606.17418 Categories: cs.RO

Research Background: Dexterous robotic hands face a longstanding trade-off among dexterity, compactness, and affordability. Particularly, high-degree-of-freedom designs typically demand complex actuation and transmission, hindering integration into human-scale forms. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address these challenges, this work presents a compact, low-cost linkage-driven anthropomorphic hand that achieves high dexterity, structural integration, and human-hand-like functionality. The hand integrates 20 joints driven by 16 independent actuators, with all actuation, sensing, and transmission components compactly embedded within a human-hand-sized structure. The resulting prototype weighs only 320g at a total cost below USD 400. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results validate the proposed hand as an affordable, compact, and mechanically efficient platform for dexterous manipulation, teleoperation, and robot learning in human-centered environments. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Where Should Action Generation Begin? A Learnable Source Prior for Generative Robot Policies

Authors: Meipo Dai, Qiyuan Zhuang, He-Yang Xu et al. | Submitted: 2026-06-16 | arXiv: 2606.17408 Categories: cs.RO, cs.CV, cs.LG

Research Background: Generative robot policies typically begin action generation from an observation-independent standard Gaussian distribution, leaving the choice of source distribution underexplored. This work asks a simple question: where should action generation begin? 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We propose LeaP, a Learnable source Prior that replaces the standard Gaussian with a proprioception-conditioned diagonal Gaussian over action chunks. Parameterized by a lightweight MLP, LeaP jointly predicts the mean and state-adaptive variance of the source distribution, while keeping the downstream generator architecture and inference solver unchanged. This design provides an observation-informed yet stochastic initialization, allowing the… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results suggest that the source distribution is an independent and reusable design axis for generative robot policies, complementary to the choice of generative dynamics. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Damage Adaptation in Seconds for Architected Materials

Authors: James Avtges, Jake Ketchum, Helena Young et al. | Submitted: 2026-06-16 | arXiv: 2606.17394 Categories: cs.RO, cs.LG

Research Background: Adaptation to damages and in-situ physical repairs is essential for long-term robot autonomy, yet challenging outside of narrowly defined and well-anticipated bounds. In this work we proprioceptively adapt to catastrophic damage in soft-actuated systems in under one minute. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Architected materials are well equipped for adaptation: actuator failure occurs gradually rather than acutely, and damage can be described in a low-dimensional, discrete coordinate space. Surprisingly, latent damage representations plus a simple yet robust ensemble method is sufficient for adapting to unseen damage in real-time. Moreover, we identify conditions under which exponential sample complexity collapses to linear sample complexity for… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Videos and more information are available at https://murpheylab.github.io/leap. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

TerraTransfer: Learning End-to-End Driving Policies Without Expert Demonstrations

Authors: Zikang Xiong, Weixin Li, Zhouchonghao Wu et al. | Submitted: 2026-06-16 | arXiv: 2606.17386 Categories: cs.CV, cs.AI, cs.RO

Research Background: End-to-end autonomous driving has achieved state-of-the-art performance on benchmarks and real-world deployments. Its standard training recipe, however, is expensive across all stages: collecting and labeling millions of driving frames is costly, and closed-loop RL on images is bottlenecked by the per-step cost of photorealistic rendering plus a… 研究背景： 本研究聚焦於從示範學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Self-play in vectorized simulators changes the economics: millions of rollout steps per second, and a state distribution naturally rich in collisions, near-misses, and recoveries that no driving log contains. Our approach exploits this asymmetry by decoupling learning to drive from learning to see. We pretrain a single policy by self-play, then align its latent space with a pretrained vision backbone, through the action KL divergence and a… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決從示範學習中的核心問題。

Key Takeaway: On photorealistic 3D Gaussian splatting closed-loop scenarios, the resulting end-to-end policy matches or exceeds prior end-to-end methods. 核心發現： 實驗結果顯示所提方法在從示範學習相關任務上顯著優於現有基準方法。

EgoInfinity: A Web-Scale 4D Hand-Object Interaction Data Engine for Any-View Robot Retargeting and Video-to-Action Robot Learning

Authors: Gaotian Wang, Kejia Ren, Andrew Morgan et al. | Submitted: 2026-06-16 | arXiv: 2606.17385 Categories: cs.RO

Research Background: Internet videos constitute the largest reservoir of embodied human manipulation knowledge, yet converting arbitrary RGB footage into actionable robot training data remains a major bottleneck. Existing lab- or factory-collected datasets are narrow in scale and diversity, limiting open-world robot learning. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Instead of proposing a static dataset, we introduce EgoInfinity, a universal 4D hand-object interaction data engine that enables web-scale data generation for robot retargeting and learning. EgoInfinity is a modular engine integrating perception, segmentation, reconstruction, interaction-aware refinement, and retargeting to automate this traditionally unscalable video-to-action problem without human-in-the-loop annotation. Its modular design… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: We validate EgoInfinity across perception fidelity, kinematic feasibility, contact consistency, cross-embodiment generalization, and real-robot skill acquisition (e.g., grasping, cutting, wiping, and pouring), demonstrating a scalable bridge from… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Scaling Self-Play for End-to-End Driving

Authors: Luke Rowe, Roger Girgis, Rodrigue de Schaetzen et al. | Submitted: 2026-06-17 | arXiv: 2606.19641 Categories: cs.RO, cs.CV

Research Background: End-to-end autonomous driving models are typically trained on offline human-demonstration datasets that provide limited state coverage and often no closed-loop feedback, making them prone to compounding errors when deployed in closed-loop and brittle to long-tail agent interactions. To overcome these limitations, we propose an alternative strategy… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: While prior self-play approaches have shown promising transfer to real-world driving, they typically assume vectorized Bird’s-Eye-View (BEV) observations that are incompatible with end-to-end policies operating directly on sensor observations. To this end, we introduce Gigapixel, a high-throughput batched driving simulator with perspective rendering, enabling scalable self-play directly from pixel observations. Rather than targeting… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Moreover, scaling self-play training yields proportional gains in policy performance, establishing self-play as a practical and scalable strategy for training end-to-end models. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Fail-RAG : A Retrieval Augmented Generation Informed Framework for Robot Failure Identification

Authors: Ameya Salvi, Jie Hu | Submitted: 2026-06-17 | arXiv: 2606.19598 Categories: cs.RO

Research Background: Industry automation is witnessing an evolution in robotics driven by both technological breakthroughs and societal changes: progress towards generalist robots, embodied and physical artificial intelligence (AI), and increasing labor shortage in manufacturing.An intelligent autonomous robot needs to not only act according to planned motions but… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Specifically, we refer to any unexpected events as failures and develop methods to detect robot operations related failures. Rule-based detection methods may break since the form of failures could change due to the dynamic nature of both environments and tasks. We propose ‘Fail-RAG’, a Retrieval Augmented Generation (RAG)-based failure detection framework where failure images and context information are embedded and queried against a failure… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Fail-RAG achieved 25 percentage point higher failure detection accuracy on average across five types of robot operations compared to using off-the-shelf VLMs, indicating its effectiveness for real-world failure detection. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Safe, Real-Time Active Model Discrimination and Fault Diagnosis for Nonlinear Systems via Differentiable Reachability

Authors: Xinpei Ni, Melkior Ornik, Glen Chou et al. | Submitted: 2026-06-17 | arXiv: 2606.19590 Categories: cs.RO, eess.SY

Research Background: We present a safe, real-time algorithm for active fault diagnosis and model discrimination for uncertain continuous-time nonlinear systems with process and measurement disturbances. Given a finite set of candidate models representing nominal and faulty modes, including actuator and sensor faults, we formulate an output-feedback, time-varying… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To solve this problem in real time, we develop a tractable approximation using interval over-approximations of reachable state and output sets, and encode diagnosability via a differentiable objective that penalizes overlap between the reachable output sets of possible models. The resulting optimization is solved efficiently online with gradient-based methods using JAX and differentiable reachability primitives. We evaluate our method on sensor… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Across these case studies, our approach achieves reliable model discrimination in under 50 ms, outperforming baselines in discrimination success rate and speed while providing formal safety guarantees. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

pdSTL: Probabilistic Differentiable Signal Temporal Logic for Stochastic Systems

Authors: Bennett Dogbey, Hemanth Manjunatha | Submitted: 2026-06-17 | arXiv: 2606.19561 Categories: cs.RO, eess.SY

Research Background: Autonomous robots operating in uncertain environments must satisfy complex temporal and safety specifications despite stochastic dynamics and sensing noise. While Signal Temporal Logic (STL) offers robustness measures for gradient-based optimization, existing extensions either lack differentiability or ignore belief-space uncertainty. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce pdSTL (probabilistic differentiable Signal Temporal Logic), a framework that unifies probabilistic semantics with differentiable robustness over belief trajectories. pdSTL employs interval-valued probabilistic semantics to compute conservative satisfaction bounds, propagated compositionally through the STL syntax tree. We formulate the temporal robustness evaluation as a recurrent, LSTM-style unfolding of STL operators, enabling… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Results demonstrate that pdSTL achieves efficient optimization with formal probabilistic guarantees, significantly outperforming deterministic differentiable STL in maintaining safety margins under real-world uncertainty. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Han Zheng, Zhe Chen, Yiwen Fu et al. | Submitted: 2026-06-17 | arXiv: 2606.19555 Categories: cs.RO

Research Background: Quadruped robots are increasingly expected to navigate through narrow passages, cluttered indoor scenes, and large-scale 3D unstructured environments. Existing local planners commonly approximate the robot using isotropic geometric inflation or rely on planar and elevation-map representations, leading to conservative motion in tight spaces and… 研究背景： 本研究聚焦於機器人運動領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This letter presents SCAN-Planner, a spatial collision-aware local planning framework for long-range quadruped navigation. A yaw-aware twin-cylinder footprint is used to model the elongated robot body, enabling whole-body collision evaluation through sparse queries in an inflated 3D occupancy map. We further introduce a projected A* search that generates collision-free guidance on an interpolated ground-following surface, with z-gradient… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人運動中的核心問題。

Key Takeaway: Simulation and real-world experiments demonstrate that SCAN-Planner generates safe, smooth, and efficient trajectories in dense clutter, 3D unstructured scenes, stair traversal, and long-range navigation tasks. 核心發現： 實驗結果顯示所提方法在機器人運動相關任務上顯著優於現有基準方法。

Proprioceptive Invariant State Estimation for Humanoid Robots on Non-Inertial Ground

Authors: Falak Mandali, Zijian He, Yan Gu | Submitted: 2026-06-17 | arXiv: 2606.19512 Categories: cs.RO, eess.SY

Research Background: This paper presents an invariant extended Kalman filtering (InEKF) approach for real-time state estimation of humanoid robots operating on non-inertial ground using only onboard proprioceptive sensing. The proposed approach estimates the robot’s base position and velocity relative to the moving ground frame without requiring direct measurements of… 研究背景： 本研究聚焦於人形機器人領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: By exploiting kinematic constraints at the stance foot through foot-mounted IMUs, the filter accounts for ground-induced nonlinearities in the process and measurement models while remaining fully proprioceptive. The estimator is formulated to admit a right-invariant measurement model, enabling favorable error dynamics under large initial uncertainties. Observability analysis establishes conditions under which the robot’s relative base position… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決人形機器人中的核心問題。

Key Takeaway: Walking experiments on a uni-axially rotating ground achieve an average estimation error of less than 9 cm for an initial error of up to 1 m. 核心發現： 實驗結果顯示所提方法在人形機器人相關任務上顯著優於現有基準方法。

Simulating Robotic Locomotion in Sand: Resistive Force Theory in an Open-Source Physics Engine

Authors: Ryan Walker Brown, Laura K. Treers, Kathryn A. Daltorio | Submitted: 2026-06-17 | arXiv: 2606.19504 Categories: cs.RO, eess.SY

Research Background: Recent advancements in Resistive Force Theory (RFT) enable approximation of ground reaction forces for locomotion in sand without the computational expense of modeling interactions with individual grains. However, these tools have been absent in 3D physics engines commonly used for robot simulation. 研究背景： 本研究聚焦於機器人運動領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We explore if resistive force approximations are sufficient, when integrated with standard dynamics calculations, to provide a stable substrate for a freely walking robot. To determine this, we implement 3D Granular Resistive Force Theory (3D RFT) in a physics simulation engine, MuJoCo. We verify simulations in multiple scenarios to demonstrate that key trends due to end effector shape, speed, and loading are preserved. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人運動中的核心問題。

Key Takeaway: While RFT has inherent approximations, the open source tool described here has potential to help develop new and improved robot designs to traverse granular media substrates. 核心發現： 實驗結果顯示所提方法在機器人運動相關任務上顯著優於現有基準方法。

3D-DLP: Self-Supervised 3D Object-Centric Scene Representation Learning

Authors: Ellina Zhang, Madhaven Iyengar, Amir Zadeh et al. | Submitted: 2026-06-17 | arXiv: 2606.19451 Categories: cs.LG, cs.CV, cs.RO

Research Background: We introduce 3D-DLP, a self-supervised object-centric representation learning model that decomposes scene-level RGB-D or voxel observations into a set of 3D latent particles. Building on the Deep Latent Particles (DLP) framework, each particle encodes disentangled attributes, including 3D keypoint position, bounding box dimensions, and appearance… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: The model learns interpretable per-particle segmentation maps through an end-to-end self-supervised reconstruction objective. We demonstrate on both simulated and real-world datasets that the learned latent space is interpretable and controllable: by manipulating particle positions and decoding, we can generate novel scene configurations. Furthermore, we show that leveraging these compact 3D latent particles for downstream robotic manipulation… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code and videos are available at https://eubooks3003.github.io/3d-dlp. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

UBP2: Uncertainty-Balanced Preference Planning for Efficient Preference-based Reinforcement Learning

Authors: Mohamed Nabail, Leo Cheng, Jingmin Wang et al. | Submitted: 2026-06-17 | arXiv: 2606.19328 Categories: cs.LG, cs.AI, cs.RO

Research Background: Preference-based RL provides an approach to learning reward models from pairwise comparisons of behaviors, bypassing the need for explicit reward design. However, existing methods typically rely on passive data collection and suffer from poor sample efficiency, especially during the early stages of learning. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce a model-based approach that actively directs exploration by jointly reasoning over uncertainties in the reward, dynamics, and value functions. Our method, Uncertainty-Balanced Preference Planning (UBP2), uses ensembles of reward, dynamics, and value function models to evaluate candidate trajectories according to a unified score that combines expected reward, terminal value, and epistemic uncertainty. Planning under this objective… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Empirically, experiments on the Meta-World benchmark show UBP2 achieves substantially higher sample efficiency than model-free preference-based methods and non-optimistic model-based baselines. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Modeling Branches for Active Manipulation using Iterative Parameter Estimation

Authors: Madhav Rijal, Rashik Shrestha, Trevor Smith et al. | Submitted: 2026-06-17 | arXiv: 2606.19314 Categories: cs.RO

Research Background: This study presents a method for modeling diverse plant branches by iteratively estimating material parameters to support delicate branch manipulation. Branch manipulation is necessary in agricultural robotics for plant repositioning, stabilizing, and clearing visual obstructions in dense foliage. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: The proposed method builds a tetrahedral branch model from point-cloud data and simulates its behavior using the finite element method. Using real observed deformation data, it iteratively estimates branch parameters and then computes an optimal path with a deformation-aware motion planner to move and stabilize branches within another robot’s field of view. Across 30 trials on branches with varying geometries and material properties, the… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: Across 30 trials on branches with varying geometries and material properties, the proposed method reduced the deformation energy by 35.69% while increasing the path length by 8.10% on average. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Does VLA Even Know the Basics? Measuring Commonsense and World Knowledge Retention in Vision-Language-Action Models

Authors: Nikita Kachaev, Andrey Moskalenko, Matvey Skripkin et al. | Submitted: 2026-06-17 | arXiv: 2606.19297 Categories: cs.LG, cs.RO

Research Background: Embodied Vision-Language-Action (VLA) models are typically obtained by fine-tuning powerful pretrained VLMs on robotics data, yet it is unclear how much commonsense and factual knowledge they retain after adaptation. Failures on knowledge-sensitive tasks are ambiguous, conflating missing knowledge with poor generalization of low-level control. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce Act2Answer, a lightweight protocol that adapts VLM knowledge benchmarks to VLA evaluation by requiring agents to answer through action. Each question becomes a short tabletop episode where the agent performs a single object-placement action to select among candidate answers, yielding an action-grounded success rate with reduced control confounds. We curate a test suite of such environments across diverse commonsense and… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: Act2Answer is available at https://tttonyalpha.github.io/act2answer/. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

A Mixed-Reality Testbed for Autonomous Vehicles

Authors: H. M. Sabbir Ahmad, Ehsan Sabouni, Emrullah Celik et al. | Submitted: 2026-06-17 | arXiv: 2606.19267 Categories: cs.RO, eess.SY

Research Background: We propose a mixed-reality, hardware-in-the-loop (HIL) testbed for autonomous vehicles that seamlessly integrates a physical testbed of mobile robots with a high-fidelity simulation environment. The virtual simulation enables the creation of diverse, safety-critical driving scenarios to validate state-of-the-art perception, planning, and control… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Our testbed also features vehicular connectivity using wireless communication and can accommodate a large number of agents through the combination of physical robots and virtual simulated agents, supporting research on multi-agent systems including Connected and Autonomous Vehicles (CAVs). Finally, we present a safety-guaranteed framework combining perception, planning and a novel online learning-based controller using Control Barrier Functions… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Experiments using the proposed framework are used to validate and demonstrate the key functionalities and the overall utility of the testbed to bridge the gap between simulation and real-world hardware deployment. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

OneCanvas: 3D Scene Understanding via Panoramic Reprojection

Authors: Bartłomiej Baranowski, Dave Zhenyu Chen, Matthias Nießner | Submitted: 2026-06-17 | arXiv: 2606.19253 Categories: cs.CV, cs.AI, cs.LG, cs.RO

Research Background: Existing approaches to 3D scene understanding in Vision-Language Models (VLMs) either rely on complex, model-specific geometry encoders or large training budgets in pursuit of spatial reasoning. Instead, OneCanvas aggregates patch features from all views onto a single equirectangular panoramic canvas. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Namely, each patch is unprojected to a 3D world coordinate using its depth and camera pose, then placed on the canvas at the continuous longitude and latitude of that point as seen from the canvas origin, with no rasterization or aggregation across overlapping views. A 3D position embedding of the patch’s metric coordinates is added to its feature, restoring the depth lost when collapsing the world position to an angular canvas coordinate… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: OneCanvas achieves state-of-the-art accuracy on SQA3D and VSI-Bench, and generalizes to out-of-distribution data on SPBench, using an order of magnitude less training compute than the strongest competing methods. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Mobile Pedipulation for Object Sliding via Hierarchical Control on a Wheeled Bipedal Robot

Authors: Yue Qin, Yulun Zhuang, Zelin Shen et al. | Submitted: 2026-06-17 | arXiv: 2606.19233 Categories: cs.RO

Research Background: In this letter, we present a hierarchical control framework that enables wheeled bipedal robots to perform planar object sliding tasks with their wheeled legs. The proposed approach formulates a nonlinear model predictive controller (NMPC) based on a reduced-order three rigid bodies (TRB) dynamical model that explicitly accounts for the hip roll… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Within this framework, the NMPC simultaneously regulates robot locomotion and interaction forces, allowing the robot to stably execute both rolling and object manipulation behaviors. A trajectory-optimization-based robot-object motion planner is developed to generate reference motions that incorporate stick-slip transitions in ground-object contact. Two representative pedipulation motions, namely scooting and lateral sliding, are validated… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Two representative pedipulation motions, namely scooting and lateral sliding, are validated through real-world hardware experiments, in which the robot successfully retrieves a 1 kg object from under a desk and slides a 4 kg object over a distance… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Constant Time-Delay Leader Following with Neural Networks and Invariant Extended Kalman Filters for Arbitrary Trajectories

Authors: Luka Antonyshyn, Paulo Ricardo Marques de Araujo, Sidney Givigi | Submitted: 2026-06-17 | arXiv: 2606.19227 Categories: cs.RO

Research Background: This paper proposes a constant time-delay trajectory tracking method for vehicle convoys operating without inter-vehicle communication, a common coordinate system, or global positioning. The method integrates a probabilistic sequence-to-sequence (Seq2Seq) neural network with an invariant extended Kalman filter (IEKF) to warm-start the prediction… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: A geometric model predictive controller is further incorporated to fully exploit the manifold-based trajectory predictions for improved control performance. The system can handle arbitrary nonlinear trajectories with varying speeds and motion profiles while reducing the need for expert-based domain knowledge for the design of trajectory following systems, even under long trajectory delays. The effectiveness of the method is validated through… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The effectiveness of the method is validated through comparisons with a pure IEKF baseline, learning-based methods, and the ground-truth trajectory in kinematic simulations, as well as in experiments using real robotic vehicles. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

FAST-LIVGO: A Degeneracy-Robust LiDAR-Inertial-Visual-GNSS Fusion Odometry

Authors: Zhiyu Chen, Chunran Zheng, Jiayu Wen et al. | Submitted: 2026-06-17 | arXiv: 2606.19190 Categories: cs.RO

Research Background: Robust state estimation and mapping in long-term, large-scale, and highly dynamic environments remains a key challenge in robotics. Existing LiDAR-Inertial-Visual Odometry (LIVO) systems achieve strong local accuracy but suffer from accumulated drift over long distances and may fail in geometrically degraded or textureless scenes. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Meanwhile, GNSS-aided fusion frameworks often rely on LiDAR or visual odometry for state prediction and outlier rejection, making them vulnerable when odometry degenerates. To address these limitations, we propose a tightly coupled LiDAR-Inertial-Visual-GNSS fusion framework based on an Error-State Iterated Kalman Filter. An online spatiotemporal alignment module using Dynamic Time Warping is introduced for highly dynamic conditions. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Experiments on the public M3DGR dataset and a custom 20~m/s fixed-wing UAV dataset demonstrate that our system reduces accumulated drift and map ghosting, outperforming state-of-the-art methods in accuracy and robustness. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Hardware- and Vision-in-the-Loop Validation of Deep Monocular Pose Estimation for Autonomous Maritime UAV Flight

Authors: Maneesha Wickramasuriya, Beomyeol Yu, Jaden Shin et al. | Submitted: 2026-06-17 | arXiv: 2606.19176 Categories: cs.RO, cs.AI, eess.SY

Research Background: Autonomous UAV operations on ships require reliable vision-based relative pose estimation, yet at-sea validation is costly, weather-dependent, and risky. This paper presents a hardware-validated vision-in-the-loop framework that enables fully autonomous indoor flight while emulating photorealistic maritime environments. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Rendered maritime views are processed onboard by a deep transformer-based monocular pose estimator. Delayed vision measurements are fused with high-rate IMU data using a delayed Kalman filter to provide consistent state estimates for geometric control. The system captures critical embedded effects, including perception latency, asynchronous updates, and computational constraints, that are absent in pure simulation. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The results establish a safe and hardware-realistic intermediate stage for developing maritime UAV autonomy prior to shipboard deployment. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Viking Hill Dataset: A Lidar-Radar-Camera Dataset for Detection and Segmentation in Forest Scenes

Authors: Vladimír Kubelka, Oleksandr Kotlyar, Unal Artan et al. | Submitted: 2026-06-17 | arXiv: 2606.19154 Categories: cs.RO

Research Background: Autonomous robots operating under forest canopies need robust perception of trees and surrounding vegetation across varying seasonal conditions. Existing forestry datasets provide lidar or camera data with per-tree annotations, but none include co-registered 4D imaging radar — a modality of growing interest for its resilience to visual… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce a multi-sensor forest dataset collected by a mobile robot equipped with a high-resolution FMCW imaging radar, lidar, RGB camera, IMU, and RTK-GNSS. The site was recorded in two sessions under contrasting vegetation states, and 3D cuboid annotations — including per-tree diameter estimates — provide shared semantic labels across all three perception modalities. Furthermore, we provide baseline results for semantic segmentation of… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The dataset and annotation tools are publicly available. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Monocular 3D Occupancy Perception for Robots on Sidewalks via Hybrid 2D-3D Learning

Authors: Yukai Ma, Joe Lin, Liu Liu et al. | Submitted: 2026-06-17 | arXiv: 2606.19122 Categories: cs.RO

Research Background: Sidewalks in the real world are crowded, cluttered, and less structured than roads, making 3D occupancy prediction a key ingredient for the safe navigation of mobile robots such as delivery bots and electric wheelchairs. Existing occupancy learning pipelines are largely designed for on-road autonomous driving and often train on large-scale paired… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We propose WalkOCC, a hybrid Ray-marching monocular 3D occupancy perception framework for robots operating on sidewalks. WalkOCC explicitly couples geometric grounding from LiDAR-RGB paired data with scalable learning from large-scale unpaired monocular images. It bootstraps pseudo occupancy supervision from paired sequences and jointly learns image-level representations on additional 2D-only data. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code and data will be made available. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

ReSiReg: Towards Spatially Consistent Semantics in Language-Conditioned Robotic Tasks

Authors: Simon Schwaiger, David Seyser, Alessandro Scherl et al. | Submitted: 2026-06-17 | arXiv: 2606.19088 Categories: cs.RO

Research Background: Vision-Language Models (VLMs) enable robots to follow open-language instructions. However, dense VLM embeddings have shown to be noisy and lack spatial consistency. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This is problematic for robotic applications, which require simultaneous reasoning over semantics and 3D space. We examine spatial structure across recent VLMs and propose ReSiReg, a feature reconstruction method that uses spatially consistent VLM intermediates to improve dense language-grounded retrieval. ReSiReg clusters intermediates into visual prototypes, derives their language descriptors, and reconstructs each patch as a soft mixture of… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Available at https://resireg.github.io 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

ART-VS: Adaptive Resolution Tiling for Vision Transformer Visual Servoing

Authors: Alessandro Scherl, Bernhard Neuberger, Simon Schwaiger et al. | Submitted: 2026-06-17 | arXiv: 2606.19089 Categories: cs.RO

Research Background: Visual servoing with self-supervised Vision Transformer (ViT) features enables training-free robotic positioning with strong generalization, but faces a fundamental trade-off between robustness and precision. Coarse patch-level descriptors provide stable correspondences yet limit positioning accuracy. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Increasing image resolution improves precision but yields only marginal robustness gains - under perturbation, high-resolution processing improves convergence success rate from 76.6% to just 81.0% despite 12x more ViT patches. Therefore, we propose Adaptive Resolution Tiling Visual Servoing (ART-VS), a two-phase method that adapts feature granularity to servoing progress: a coarse phase at native ViT resolution for stable alignment, then a tiled… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code available under https://art-vs.github.io/. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Sensor Configuration Matters: A Systematic Evaluation of Multimodal SLAM on Quadruped Robots

Authors: Roberto Corlito, Fabian Schmidt, Nils Seibert et al. | Submitted: 2026-06-17 | arXiv: 2606.19067 Categories: cs.RO, cs.CV

Research Background: Autonomous navigation of quadrupedal robots in diverse environments fundamentally relies on resilient Simultaneous Localization and Mapping (SLAM). While visual-inertial SLAM has matured across wheeled, handheld, and aerial platforms, a critical evaluation gap remains regarding how hardware-level sensor configurations affect performance under the… 研究背景： 本研究聚焦於機器人運動領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Quadrupeds introduce distinct embodiment-induced sensory challenges, including foot-impact shocks, high-frequency mechanical vibrations, and rapid angular rotations, which degrade standard perception pipelines. To address this gap, we present a systematic evaluation of state-of-the-art visual, visual-inertial, and LiDAR-visual-inertial SLAM methods using the GrandTour dataset recorded on an ANYmal D quadruped. We isolate and quantify the impacts… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人運動中的核心問題。

Key Takeaway: These insights additionally offer concrete design guidelines for tailoring custom sensor payloads to achieve dependable perception on agile legged systems. 核心發現： 實驗結果顯示所提方法在機器人運動相關任務上顯著優於現有基準方法。

A High-accuracy Event-based Underwater SLAM System

Authors: Yifan Peng, Qihang Liu, Haoying Li et al. | Submitted: 2026-06-17 | arXiv: 2606.18951 Categories: cs.RO

Research Background: While event cameras offer immense potential for underwater SLAM, existing Time Surface (TS)-based methods prove highly unreliable when deployed underwater. Fluctuating camera velocities severely degrade TS imaging quality, while wide stereo baselines and repetitive underwater textures induce critical matching failures, frequently triggering system… 研究背景： 本研究聚焦於機器人定位與地圖建構領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To overcome these challenges, we develop the first high-accuracy event-based underwater stereo SLAM system. A structure-aware metric for TS is designed based on structure tensor coherence and gradients to quantitatively evaluate TS structural information density. By decoupling the optimal TS generation into two distinct stages based on system initialization, Bayesian Optimization(BO) first predicts an optimal prior TS sequentially before… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人定位與地圖建構中的核心問題。

Key Takeaway: The code and data will be open-sourced. 核心發現： 實驗結果顯示所提方法在機器人定位與地圖建構相關任務上顯著優於現有基準方法。

ZiMPedance: Impedance-Aware ZMP Modeling and Control for Payload Carrying with Quadruped Robots

Authors: Giovanni B. Dessy, Lorenzo Amatucci, Victor Barasuol et al. | Submitted: 2026-06-17 | arXiv: 2606.18883 Categories: cs.RO

Research Background: Load transportation with quadruped robots is strongly affected by the dynamics of the physical interface between the robot and the load. Passive spring-based arms reduce weight and complexity compared to active manipulators, but their spring-damper dynamics can introduce oscillatory forces that degrade locomotion stability. 研究背景： 本研究聚焦於機器人運動領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This paper derives an extended Zero Moment Point (ZMP) formulation that includes passive payload-interface dynamics, relating stiffness, damping, and payload mass to the stability margin. The analysis shows that underdamped configurations can resonate with locomotion harmonics. Based on this insight, we augment a Single Rigid Body Dynamics model with passive subsystem dynamics and integrate it into a Model Predictive Control framework. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人運動中的核心問題。

Key Takeaway: The same model also enables end-effector tracking through passive arm dynamics without direct arm actuation. 核心發現： 實驗結果顯示所提方法在機器人運動相關任務上顯著優於現有基準方法。

Generating Natural and Expressive Robot Gestures through Iterative Reinforcement Learning with Human Feedback using LLMs

Authors: Chris Lee, Flora Salim, Benjamin Tag et al. | Submitted: 2026-06-17 | arXiv: 2606.18747 Categories: cs.RO, cs.AI

Research Background: Expressive gestures are essential for natural and effective communication, complementing speech when verbal cues alone are insufficient (e.g., pointing). For social robots such as the humanoid Pepper, producing natural and expressive movements is critical for improving human-robot interaction (HRI) and long-term acceptance. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, generating gestures remains challenging due to reliance on expert-authored animations, resulting in rigid behaviors that are impractical for dynamic and diverse environments. Alternatively, machine learning approaches often struggle to capture perceived naturalness, becoming increasingly challenging with more degrees of freedom. Consequently, producing expressive robot gestures requires a system that can adapt to the environment while… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Our results show that RLHF improved the LLM’s co-speech generative capabilities, producing more expressive, relevant and fluid movements. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Selective Unit-Cell Actuation in Lattice Structures for Distributed Morphology in Soft Robots

Authors: Trevor Exley, Altair Coutinho, Lucia Beccai | Submitted: 2026-06-17 | arXiv: 2606.18704 Categories: cs.RO

Research Background: Soft lattice structures are increasingly used in robotics to tailor compliance and guide deformation; however, actuation is typically introduced at the device or module level, with actuators inserted into otherwise passive architectures. In this work, we move actuator-lattice co-design to the unit-cell scale. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present an embedded pneumatic unit cell that integrates curved-strut lattice geometry with a bidirectional bellow actuator within a single monolithic element. When tessellated, the lattice functions as a distributed actuation field in which global morphology is governed by spatial actuation patterns rather than uniform pressurization. Experimental characterization of 1x1, 2x2, and 3x3 tessellations demonstrates scalable displacement and force… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results establish unit-cell-level actuation as a strategy for distributed morphing in lattice-based soft robots and provide a foundation for scalable, monolithic robotic architectures. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

High-Degree-of-Freedom Lightweight Bioinspired Leg for Enhanced Mobility in Small Robots

Authors: Haoqi Han, Yifei Yu, Jiaming Zhang et al. | Submitted: 2026-06-17 | arXiv: 2606.18680 Categories: cs.RO

Research Background: In microrobotics, enhancing locomotion capabilities by increasing the degrees of freedom (DoF) of leg mechanisms under severe spatial constraints remains a significant challenge. Inspired by insect locomotion, this paper presents a novel micro-scale parallel leg mechanism with four degrees of freedom, and systematically analyzes its mechanical… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: The design incorporates two spherical five-bar linkages to achieve spatial motion within a parallel four-bar configuration. Furthermore, a concentric design strategy is employed to simplify the analytical solution of the leg kinematics. Due to the parallel system architecture, all actuators are located on the main body, substantially reducing the equivalent inertia of moving parts compared to traditional high-DOF leg structures. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Experimental results demonstrate that the proposed single-leg mechanism achieves excellent motion flexibility, highlighting its potential for micro bio-inspired robotics. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Zecheng Yin, Benedict Jun Ma | Submitted: 2026-06-17 | arXiv: 2606.18634 Categories: cs.RO, cs.AI

Research Background: To locate a target object while exploring the unknown environment is a fundamental capability for autonomous agents, with applications ranging from search-and-rescue to field robots. A simplified version of such task is Object Goal Navigation (ObjNav). 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In ObjNav, successful arrival at the target object provides a basic measure of performance; however, the efficiency of the navigation trajectory is equally important, as it indicates how intelligently the agent explores and how much time remains for subsequent tasks. In unknown environments, the key to efficient navigation lies in deciding where to explore next. While many prior works aim to address this core challenge and achieved promising… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: Recognizing the different emphases of the two datasets, the performances reveals this framework is more balanced and generalizable for efficient ObjNav. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

DNN Koopman-Based Deviation Compensation for UGV Path Tracking Control on Coupled Slope and Potholed Road

Authors: Jian Zhao, Wenbo Zhou, Zhicheng Chen et al. | Submitted: 2026-06-17 | arXiv: 2606.18630 Categories: cs.RO

Research Background: Unmanned ground vehicles (UGVs) operating in off-road scenarios are confronted with complex terrain disturbances that can substantially degrade path tracking performance. To address this challenge, this paper proposes a deep neural network (DNN) Koopman-based deviation compensation strategy for UGV path tracking control. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Firstly, based on the vehicle dynamic function on coupled slope, an adaptive forgetting recursive least squares method with decoupled error terms is designed to estimate tire cornering stiffness. On this basis, a Laguerre model predictive control (LMPC) path tracking control strategy is designed by incorporating Laguerre functions, which can reduce computational resource usage while maintaining reliable tracking performance across different… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Experimental results demonstrate that the proposed UGV path tracking strategy improves tracking performance by more than 11.5% across multiple operating conditions. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Admittance-Based Surface Alignment for Human-in-the-Loop Robotic Visual Inspection

Authors: Antara Banerjee, Colin Acton, Xu Chen | Submitted: 2026-06-17 | arXiv: 2606.18601 Categories: cs.RO

Research Background: Precision visual inspection underpins quality assurance across aerospace, semiconductor, and medical manufacturing, where undetected surface anomalies on high-value parts translate directly into scrap, rework, and field failures. Robotic visual inspection requires precise alignment between the end-effector and local surface geometry in the… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In industrial settings, a human operator is often kept in the loop via teleoperation or shared autonomy, introducing real-time adjustments that render purely offline motion planning inadequate. This motivates control architectures capable of reactive, compliant behavior under combined human and perceptual uncertainty. This paper presents a novel real-time, closed-loop robotic orientation control pipeline for precision visual inspection, with an… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: We validate the framework on a 6-DOF manipulator demonstrating stable normal-tracking and a final mean orientation error of 0.4°. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Benchmarking Action Spaces in Reinforcement Learning for Vision-based Robotic Manipulation

Authors: Seyed Alireza Azimi, Homayoon Farrahi, Abhishek Naik et al. | Submitted: 2026-06-17 | arXiv: 2606.18594 Categories: cs.RO, cs.AI

Research Background: In real-world reinforcement learning (RL), the choice of action space can play a key role in shaping motion smoothness, safety, and overall task performance. In this study, we evaluate pose increment, pose velocity, joint position increment, and joint velocity across two vision-based manipulation tasks: object picking and pushing. 研究背景： 本研究聚焦於機器人操作領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We train policies in simulation and deploy them to the real world using sim-to-real transfer. We find that action-space representation indeed significantly affects sim-to-real performance. In particular, we find that the joint velocity action space is best for the vision-based picking and pushing tasks in terms of smoothness and final task performance. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人操作中的核心問題。

Key Takeaway: We also provide practical guidance for RL practitioners in choosing action spaces for both simulation and real-world experiments. 核心發現： 實驗結果顯示所提方法在機器人操作相關任務上顯著優於現有基準方法。

Aerial-ground LiDAR place recognition with patch-level self-supervised learning and expanded reciprocal re-ranking

Authors: Yandi Yang, Xianghong Zou, Jianping Li et al. | Submitted: 2026-06-17 | arXiv: 2606.18583 Categories: cs.CV, cs.RO

Research Background: LiDAR place recognition determines one’s position on a prior point cloud map. The most studied ground-level LiDAR place recognition suffers from pre-visit requirements, incomplete coverage, and limited perspectives. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Using pre-acquired, full-coverage Airborne Laser Scanning (ALS) data as an aerial prior map overcomes these drawbacks, making cross-view place recognition necessary and advantageous. However, aerial-ground LiDAR place recognition faces significant challenges, including the domain gap between aerial and ground point clouds, and false positives during initial retrieval. To address these challenges, we present a novel retrieval and re-ranking… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Additionally, our ER re-ranking algorithm further boosts the average Recall@1 by 4.9% on CS-Campus3D and 10.2% on CS-Urban-Scenes without additional training. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Leveraging DINOv3 for Robust Outdoor Scene Understanding in Field Robotics

Authors: Jaeil Park, Hyobin Choi, Sangjin Lee et al. | Submitted: 2026-06-17 | arXiv: 2606.18582 Categories: cs.CV, cs.RO, eess.IV

Research Background: The GOOSE 2D Fine-Grained Semantic Segmentation Challenge at the ICRA 2026 Workshop on Field Robotics evaluates dense semantic segmentation of off-road imagery over a fine-grained taxonomy of 64 classes and 11 evaluated non-void coarse categories. We present the first-place solution to this challenge. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Our solution comprises two complementary improvements: (a) a network-level design that combines a self-supervised DINOv3 ViT-L/16 backbone, a ViT-Adapter, and a Mask2Former mask-classification decoder, together with a coarse-category auxiliary loss on the global [CLS] token; and (b) an inference-time aggregation strategy based on multi-scale and horizontal-flip test-time augmentation and an ensemble of the top three checkpoints selected using… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Our method achieves an official composite score of 76.57%, consisting of 69.32% fine-class mIoU and 83.81% category-level mIoU, and ranks first on the final phase leaderboard: www.codabench.org/competitions/14257/#/results-tab. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Improving Human-Robot Teamwork in Urban Search and Rescue Through Episodic Memory of Prior Collaboration

Authors: Taewoon Kim, Emma van Zoelen, Mark Neerincx | Submitted: 2026-06-17 | arXiv: 2606.18836 Categories: cs.HC, cs.AI

Research Background: Effective human-robot teamwork requires robots to adapt to partners, situations, and task dynamics from the start of an interaction. In the MATRX Urban Search and Rescue (USAR) environment, people can externalize collaboration patterns (CPs) they discover during teamwork through a chat and reflection interface. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We study whether a robot can use such prior team experience to become a better teammate in future interactions. To this end, we represent historical CPs as knowledge-graph episodic memories and use graph representation learning with a node-classification objective to identify a representative and effective memory for reuse. We then initialize the robot with this memory before a new collaboration episode begins. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The strongest gains appear at the beginning of interaction, suggesting that reusable episodic memory can help robots enter collaboration with more effective task knowledge and support smoother early teamwork. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Mix-QVLA: Task-Evidence-Aware Mixed-Precision Quantization of Vision-Language-Action Models

Authors: Navin Ranjan, Andreas Savakis | Submitted: 2026-06-17 | arXiv: 2606.19565 Categories: cs.CV

Research Background: We propose Mix-QVLA, a task-evidence-aware mixed-precision PTQ framework for VLA models. Mix-QVLA anchors each quantized variant to the full-precision action-token reference decision and evaluates whether quantization preserves task-relevant evidence across key VLA functional boundaries. 研究背景： 本研究聚焦於視覺語言動作（VLA）模型領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: It computes normalized gradient-weighted task-evidence maps from boundary activations and compares full-precision and quantized maps using evidence-mass and attribution-distribution distortion, capturing changes in both the strength and allocation of decision-supporting evidence. A soft-bottleneck objective aggregates boundary-level degradation into layer-wise sensitivity scores. Mix-QVLA further models sensitivity throughout task execution,… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決視覺語言動作（VLA）模型中的核心問題。

Key Takeaway: On LIBERO, Mix-QVLA reduces OpenVLA-OFT memory from 15.4 GB to 4.1 GB, retains 96.3 average success compared with 97.1 for the BF16 model, and achieves a 1.52x inference speedup. 核心發現： 實驗結果顯示所提方法在視覺語言動作（VLA）模型相關任務上顯著優於現有基準方法。

URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification

Authors: Xinze Zhang | Submitted: 2026-06-17 | arXiv: 2606.18861 Categories: cs.CV, cs.AI

Research Background: Reconstructing simulation-ready digital twins of articulated objects from sensor observations remains constrained by two persistent gaps: (i) part-level geometric reconstruction is decoupled from kinematic-parameter estimation, and (ii) the recovered models often violate basic dynamic invariants such as energy conservation, leading to drift when… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: The pipeline introduces three components: a kinematic constraint graph that encodes joint-part incidences as soft edges; a differentiable screw-axis solver that backpropagates from rendered observations through Featherstone’s articulated-body algorithm to joint parameters; and an energy residual loss that penalises non-physical free responses of the reconstructed model. Across five PartNet-Mobility categories and an internal RGB-D benchmark,… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code and reconstruction data will be released upon acceptance. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Fatma Youssef Mohammed, Grzegorz Malczyk, Kostas Alexis | Submitted: 2026-06-18 | arXiv: 2606.20491 Categories: cs.RO, cs.CV

Research Background: Human visual attention relies on structured scanpaths to efficiently process scenes, yet instilling this behavior into robot autonomy is in its infancy and hindered by the high,computational costs of existing predictive models. To address this, we introduce GazeLNN, a computationally lightweight,scanpath prediction model that leverages Liquid… 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Operating auto-regressively, the architecture predicts sequential fixation heatmaps conditioned on the current visual stimulus and fixation history. Despite requiring only 0.61 GFLOPs, GazeLNN achieves state-of-the-art performance on the MIT Low Resolution dataset achieving 0.47 ScanMatch score. It outperforms existing recurrent baselines across diverse evaluation metrics, while reducing computational costs by 99.40% and accelerating inference… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: This integration enables human-fixation-guided perception during autonomous navigation, validated through successful real-world deployments on an aerial robot. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

Authors: Nastaran Darabi, Divake Kumar, Sina Tayebati et al. | Submitted: 2026-06-18 | arXiv: 2606.20479 Categories: cs.RO

Research Background: Vision-language navigation agents achieve competitive average success on benchmark tasks, yet failures often arise through predictable trajectory-level breakdowns such as oscillation, stagnation, or inefficient detours. Reliable deployment, therefore, requires uncertainty signals that anticipate emerging failure dynamics during execution rather… 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We introduce \emph{GroundControl}, a trajectory-consistent uncertainty estimator defined as statistical deviation from nominal goal-directed distance-to-goal dynamics aggregated over an episode. GroundControl models distance evolution using a constant-velocity Kalman filter and combines normalized innovation statistics with complementary trajectory features capturing progress, monotonicity, path efficiency, and oscillatory behavior. The… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: These results show that modeling deviation from goal-directed dynamics provides an interpretable and robust signal for anticipating navigation failures in vision-language agents. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

Authors: Zhenghao “Mark” Peng, Honglin He, Quanyi Li et al. | Submitted: 2026-06-18 | arXiv: 2606.20458 Categories: cs.RO

Research Background: Learning-based planners for sidewalk navigation can generate diverse candidate trajectories in real time, yet their scoring functions often fail to select the best trajectory in challenging situations, outputting trajectories that make the mobile robot drive onto grass, toward pedestrians, or in the wrong direction, even when better candidates… 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Rather than replacing the planner with an end-to-end Vision-Language-Action model, we propose a VLM-Planner interface that uses a VLM to select a candidate index from the planner’s proposal set and then fuse it with the planner’s initial output. However, VLMs take 1—3s per query and so cannot directly drive a 5—20Hz control loop. We contribute a training-free, latency-resilient trajectory-level fusion layer that turns a stale VLM selection… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: We demonstrate the full system on a mobile robot navigating challenging campus sidewalks with varied network latency. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

LIT-GS: LiDAR-Inertial-Thermal Gaussian Splatting for Illumination-Robust Mapping

Authors: Shikuan Shi, Chunran Zheng, Jiaming Xu et al. | Submitted: 2026-06-18 | arXiv: 2606.20424 Categories: cs.RO

Research Background: Gaussian Splatting has enabled real-time neural rendering, yet existing LiDAR-inertial-visual (LIV) Gaussian mapping pipelines remain fragile under illumination changes and texture-deficient scenes due to their reliance on RGB photometric cues. We present LIT-GS, a LiDAR-inertial-thermal Gaussian Splatting framework that injects LiDAR-derived… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Specifically, we exploit LIV visual map points as confidence-aware cross-modal anchors to establish reliable thermal-LiDAR associations, and incorporate weighted LiDAR point-to-plane residuals into bundle adjustment to jointly refine camera poses and 3D points under weak thermal supervision. Building on the refined structure, we further introduce a LiDAR-plane-regularized differentiable splatting objective that constrains rendered 3D points to… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Experiments on proprietary sequences and public datasets demonstrate that LIT-GS consistently improves geometric accuracy and rendering quality over state-of-the-art LIV-based Gaussian Splatting baselines, particularly in challenging lighting… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Agentic AutoResearch forSpace Autonomy: An Auditable, LLM-Driven Research Agent for Aerospace Control Problems

Authors: Amit Jain, Richard Linares | Submitted: 2026-06-18 | arXiv: 2606.20394 Categories: cs.RO, math.OC

Research Background: Spacecraft guidance, navigation, and control functions are increasingly realized as learned policies distilled from expert solvers. Developing such a policy is itself a research process: an investigator selects an architecture and hyperparameters, runs experiments, and must determine whether an apparent improvement is genuine or merely seed noise. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This paper presents AutoResearch, a framework in which a large language model autonomously drives that loop for aerospace control problems, coupled with a credibility layer, built into the loop, that certifies each reported result against the problem’s own measured seed noise. The language model serves only as the offline research agent that develops the control policy; the trained policy it produces is then deployed onboard the spacecraft,… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: On the docking problem the gap becomes categorical: undirected search yields no feasible policy, while the learned policy stays outside the keep-out zone on every seed. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

An Infrastructure-less, Control-Independent Solution to Relative Localisation of a Team of Mobile Robots using Ranging Measurements

Authors: Paolo Golinelli, Tommaso Faraci, Daniele Fontanelli | Submitted: 2026-06-18 | arXiv: 2606.20365 Categories: cs.RO, cs.MA

Research Background: The ability to localise teams of robots is essential for applications ranging from robotic fleets in unstructured environments to cooperative control and navigation tasks. In such contexts, fixed infrastructure is often unavailable, deployments must be fast and flexible, and system requirements must be minimal. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present a decentralised cooperative localisation algorithm that addresses all these challenges at once. The method is anchor-less, fully decentralised, and, unlike most existing approaches, does not require controlling the robots motion to ensure team observability. It relies only on local odometry, sparse inter-agent ranging measurements, and short-range communication, all of which are widely available in practice. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Moreover, through information sharing, each agent benefits from the estimates of the entire group, even in partially connected conditions. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Autonomous Driving with Priority-Ordered STL Specifications Under Multimodal Uncertainty

Authors: Taha Bouzid, Shuhao Qi, Mircea Lazar et al. | Submitted: 2026-06-18 | arXiv: 2606.20336 Categories: cs.RO

Research Background: Autonomous vehicles must plan trajectories that satisfy a multitude of requirements on safety, passenger comfort, and compliance with traffic rules. However, in safety-critical scenarios, it is not always possible to satisfy all requirements simultaneously, necessitating their prioritization based on importance. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: At the same time, in these safety-critical scenarios, the uncertainty in trajectory predictions of the surrounding traffic, such as other vehicles and pedestrians, should be explicitly accounted for. In this work, we propose an uncertainty-aware trajectory planning framework that incorporates a predefined lexicographic ordering over Signal Temporal Logic (STL) specifications that stays valid under uncertainty. We implement this formulation with… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: We implement this formulation with Model Predictive Path Integral (MPPI) control and we demonstrate the effectiveness of our method on simulation scenarios, showing that our framework efficiently handles conflicting objectives under realistic… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications

Authors: Paul Koch, Vivek Chavan, André Sers et al. | Submitted: 2026-06-18 | arXiv: 2606.20272 Categories: cs.RO, cs.CV

Research Background: AI vision models are a driving factor for the potential use case scenarios of cognitive robotics within in the industry and household applications. A large array of methods from semantic environment analysis towards 6D and grasping pose estimation have been proposed based on the latest AI achievements. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: However, such advancements require further strong and efficient methods w.r.t. training data and AI-architectures, which are capable in synergy to tackle current challenges, precision limits, and scalability beyond domain gaps. In this paper, we discuss these current limits and trends in the related state-of-the-art which are challenging those. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Further we discuss our current work in progress on bridging the domain gap between simulations and real world applications by linking those in the training data generation. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

FlowMaps: Modeling Long-Term Multimodal Object Dynamics with Flow Matching

Authors: Francesco Argenziano, Miguel Saavedra-Ruiz, Sacha Morin et al. | Submitted: 2026-06-18 | arXiv: 2606.20209 Categories: cs.RO, cs.AI

Research Background: Joint spatial and temporal understanding of 3D scenes is a crucial requirement for robots deployed in everyday household environments. Such agents must not only comprehend and navigate spatial layouts, but also reason about how these spaces evolve over time. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In particular, humans interact with objects daily, causing them to change position throughout the environment and making it difficult for robots to reliably associate current observations with previously seen objects. However, these interactions are not random: human habits and routines induce spatio-temporally consistent patterns in object locations, which robotic agents can potentially learn and then exploit for downstream tasks such as… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code and additional material is available at https://fra-tsuna.github.io/flowmaps/. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Stable Transformer-Actor-Critic Model Predictive Control: A Contraction Analysis Approach

Authors: Antonio Marino, Valerio Modugno, Marco Cognetti | Submitted: 2026-06-18 | arXiv: 2606.20197 Categories: cs.RO

Research Background: Actor-Critic Model Predictive Control (MPC) effectively addresses complex, non-convex control problems, but guaranteeing the closed-loop stability of sequence-based learning models within these pipelines remains challenging. This paper introduces a novel Transformer-Actor-Critic MPC architecture with formal robustness guarantees. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: First, we prove that Transformer networks can satisfy global incremental Input-to-State Stability ( $δ$ ISS). We then leverage Riemannian contraction theory to analyze the interconnected dynamics between the physical plant and the predictive neural network. Finally, we integrate these theoretical bounds as a training regularizer to yield a certifiably robust policy. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The framework is validated on a nonlinear 3D drone model executing target-reaching and obstacle-avoidance maneuvers. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-trainin

Authors: Maciej Wozniak, Jesper Ericsson, Hariprasath Govindarajan et al. | Submitted: 2026-06-18 | arXiv: 2606.20189 Categories: cs.CV, cs.AI, cs.RO

Research Background: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD). However, current approaches typically treat VFMs as black-box teachers, relying exclusively on… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Consequently, they do not fully exploit the teacher’s layer-wise semantic structure and global context, as well as the rich spatiotemporal information inherent in LiDAR sequences. We propose HilDA, a self-supervised pretraining framework for LiDAR backbones that better captures the semantic what and geometric where needed for driving tasks. HilDA combines hierarchical distillation comprising multi-layer distillation for progressive semantic… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Code available at: https://maxiuw.github.io/hilda. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Dual-Agent Framework for Cross-Model Verified Translation of Natural-Language Protocols into Robotic Laboratory Platform

Authors: Hyeonna Choi, Jung Yup Kim, Hyuneui Lim et al. | Submitted: 2026-06-18 | arXiv: 2606.20120 Categories: cs.RO, cs.AI

Research Background: Biological experiment protocols are written in natural language, whereas automation systems rely on predefined control commands, creating a semantic gap that limits autonomous execution. Microplate-based automatic experiments are particularly challenging due to the need to simultaneously control well mapping, sample-reagent combinations, replicate… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: This study proposes an agent-based protocol translation framework that converts natural-language microplate-based protocols into executable control commands for a robotic laboratory platform. A Parser Agent formalizes the natural-language protocol into a structured representation, and a rule-based mapping engine deterministically incorporates the operational constraints of the robotic laboratory platform to generate device-level control… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The proposed framework provides a flexible approach to narrowing the semantic gap between natural-language protocols and microplate-based self-driving laboratories. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

A Neuromorphic Reinforcement Learning Framework for Efficient Pathfinding in Robotic Mobile Fulfillment Systems

Authors: Junzhe Xu, Zecui Zeng, Lusong Li et al. | Submitted: 2026-06-18 | arXiv: 2606.20031 Categories: cs.RO, cs.AI

Research Background: Dynamic environmental changes, confined workspaces, and stringent real-time constraints make pathfinding in Robotic Mobile Fulfillment Systems (RMFS) a challenging problem for conventional search- and rule-based methods, which typically suffer from high computational complexity and long decision latency. While reinforcement learning (RL) has… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We present SDQN-RMFS, an end-to-end framework that achieves high-fidelity deployment of an RL-trained policy from a full-precision artificial neural network (ANN) through to a neuromorphic chip. By computing only when triggered by sparse events, this framework unlocks ultra-low-power RMFS pathfinding. Our full-stack pipeline operates as follows: an ANN policy is first efficiently trained via a collision-allowing strategy to densify informative… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: These results establish physical neuromorphic inference as a practical and energy-sustainable pathway for large-scale RMFS operations. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Evaluation of Augmented Reality-based Intuitive Interface for Robot-Assisted Transesophageal Echocardiography: A User Study

Authors: Xiu Zhang*, Matteo Di Mauro*, Sofia Breschi et al. | Submitted: 2026-06-18 | arXiv: 2606.19971 Categories: cs.RO

Research Background: TransEsophageal Echocardiography (TEE) is essential for diagnosing and guiding Structural Heart Disease (SHD) interventions. However, manual TEE manipulation demands significant operator expertise, is physically demanding, and exposes clinicians to radiation when performed alongside fluoroscopy. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Robotic-assisted TEE systems have been introduced to improve probe handling and reduce operator fatigue, yet the design of intuitive and effective user interfaces remains an open challenge. This study presents and evaluates a model-enhanced, Augmented Reality (AR)-based intuitive interface for robot-assisted TEE, designed to improve spatial awareness and control intuitiveness. A robotic TEE platform integrated with electromagnetic tracking and a… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Overall, the 3D-TI configuration, combining immersive visualization with direct tip-level control, proved the most effective and ergonomic interface, supporting the integration of AR-based visualization and intuitive control paradigms into… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Deep-Unfolded Coordination

Authors: Hunter Kuperman, Minchan Jung, Rahul V. Ghosh et al. | Submitted: 2026-06-18 | arXiv: 2606.19920 Categories: cs.RO, cs.LG, cs.MA

Research Background: Distributed optimization is a highly scalable and structurally transparent technique to solve multi-agent robotics problems; however, such methods often suffer from the need for highly-specialized, problem-specific hyperparameter tunings. In this work, we propose Deep Coordinator, a deep-unfolding framework that learns to dynamically adjust the… 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Our architecture consists of unrolling a fixed number of ADMM-DDP iterations into a neural network with learnable functions between layers mapping the optimizer state to the next hyperparameters. To the best of our knowledge, Deep Coordinator is the first deep-unfolding framework to adapt the penalty parameters of a non-convex optimizer at solve-time; we show that the mainstream supervised approach can yield degenerate solutions when training… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Furthermore, Deep Coordinator retains its performance benefits when deployed to systems up to 8x larger than trained on. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Co-policy: Responsive Human-Robot Co-Creation for Musical Performances

Authors: Xuetao Li, Wenke Huang, Mang Ye et al. | Submitted: 2026-06-18 | arXiv: 2606.19914 Categories: cs.RO, cs.AI

Research Background: Art has long stood as a pivotal expression of human creativity. Embodied artificial intelligence offers a route for generative models to participate in that creativity through physical action rather than disembodied digital content. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: In robotic music co-creation, it is challenging to connect semantic musical understanding with real-time and physically executable performance. We present Co-policy, a framework for human-robot musical co-creation that separates semantic intent grounding, constrained musical variation, and visuomotor execution. To ground musical semantics, Co-policy uses pre-inference semantic anchors and a fine-tuned Qwen-vl planner (F-Qwen) to transform… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Real-robot chime experiments, ablations, and expert evaluation show improved intent alignment, execution accuracy, and response frequency over diffusion-policy and ablated baselines, supporting physically grounded action generation as a key… 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAM

Authors: Fan Zhu, Ziyu Chen, Peichen Liu et al. | Submitted: 2026-06-18 | arXiv: 2606.19874 Categories: cs.RO, cs.CV

Research Background: 3D Gaussian Splatting (3DGS) has significantly boosted novel view synthesis and high-fidelity scene reconstruction, expanding the potential of 3DGS-based Visual Simultaneous Localization and Mapping (SLAM) methods. However, most existing systems fail to fully exploit the underlying structural information, which limits rendering quality and often… 研究背景： 本研究聚焦於機器人定位與地圖建構領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address these limitations, we propose MMD-SLAM, a structure-enhanced Visual SLAM framework that leverages the Atlanta World (AW) assumption to guide a Multi-Meta Gaussian representation for photorealistic mapping. First, we introduce a point-line fusion strategy for pose optimization, where 3D line segments are incorporated to improve tracking robustness and provide additional constraints for mapping. Second, we design a Multi-Meta Gaussian… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人定位與地圖建構中的核心問題。

Key Takeaway: e.g., our method achieves a 48.56% reduction in ATE RMSE on ScanNet and a 5.71% improvement in PSNR on Replica, compared with MonoGS. 核心發現： 實驗結果顯示所提方法在機器人定位與地圖建構相關任務上顯著優於現有基準方法。

World Engine: Towards the Era of Post-Training for Autonomous Driving

Authors: Tianyu Li, Li Chen, Caojun Wang et al. | Submitted: 2026-06-18 | arXiv: 2606.19836 Categories: cs.RO, cs.CV

Research Background: Autonomous vehicles must operate safely in the real world, where errors can have severe consequences. Although modern end-to-end driving policies excel in routine scenarios, their reliability is limited by the scarcity of safety-critical “long-tail” events in real driving datasets. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: These rare interactions define the practical safety boundary of the learned policy, yet they are difficult to collect at scale in the real world. Here we show that this fundamental limitation can be addressed by post-training pre-trained driving models on synthesized high-stakes interactions. We introduce World Engine, a generative framework that reconstructs high-fidelity interactive environments from real-world logs and systematically… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: The full codebase suite, including training, is released to the public. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

VOiLA: Vectorized Online Planning with Learned Diffusion Model for POMDP Agents

Authors: Marcus Hoerger, Rishikesh Joshi, Rahul Shome et al. | Submitted: 2026-06-18 | arXiv: 2606.19729 Categories: cs.RO, cs.AI

Research Background: Planning under uncertainty is an essential capability for autonomous robots. The Partially Observable Markov Decision Process (POMDP) provides a powerful framework for such a capability. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Although POMDP-based planning has advanced significantly, its application to real-world problems is often limited by the difficulty of obtaining faithful POMDP models. We present Vectorized Online planning wIth Learned diffusion model for POMDP Agents (VOiLA), a framework that learns task-agnostic POMDP models for online planning under uncertainty. VOiLA learns transition and observation samplers using conditional diffusion models and learns… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Physical robot evaluation indicates VOiLA uses the models learned using only simulated data and generates a policy that successfully accomplish the task in 10 of 10 runs. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

A Differentiable Composite Approximation Framework for Autonomous Underwater Vehicle Maneuvering Modeling from Sea-Trial Data

Authors: Aobo Wang, Aifei Xia, Zihao Wang et al. | Submitted: 2026-06-18 | arXiv: 2606.19711 Categories: cs.RO, cs.LG, eess.SY

Research Background: Field-based modeling from onboard measurements can produce autonomous underwater vehicle (AUV) maneuvering models that reflect real operating characteristics. From an approximation perspective, conventional maneuvering models use predefined constraint polynomial bases, whereas data-driven models use data-adaptive bases. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Motivated by this basis-function view, this paper presents a differentiable composite-approximation formulation, in which the polynomial-basis component and the data-adaptive basis component are treated as differentiable parts of a single predictor and calibrated jointly. A gradient-based co-calibration method is developed for full-scale AUV maneuvering prediction, where a sensitivity-aware mechanism regulates bounded polynomial updates while… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: Results show that the proposed method improves recursive trajectory and velocity prediction compared with polynomial-only, neural-only, and frozen-prior hybrid baselines, demonstrating its applicability to field-data-based AUV maneuvering modeling. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Comparative Study on Agility, Efficiency, and Impact Absorption of Bipedal Robots with Active Toes

Authors: Joong-Gil Kim, Wontae Ye, Geunwoo Cho et al. | Submitted: 2026-06-18 | arXiv: 2606.19699 Categories: cs.RO, cs.LG, eess.SY

Research Background: Human legs exhibit high efficiency, agility, and impact absorption, with toes playing a crucial role in these capabilities. While many attempts have been made to implement human-like toes in robots, they have not fully replicated human characteristics nor rigorously validated their benefits. 研究背景： 本研究聚焦於機器人學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: We propose a 14-DOF biped robot emulating human toes’ lightweight, high-torque, robust nature. To quantitatively analyze the effectiveness of the active toes in terms of agility, efficiency, and impact absorption, we developed a high-fidelity simulation training environment that reflects actual actuators with coupled transmissions and accurate power consumption. To ensure a fair comparison between configurations with and without active toes, we… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人學習中的核心問題。

Key Takeaway: On the agility test, average and maximum path deviation decreased by 25.0% and 34.0%, respectively. 核心發現： 實驗結果顯示所提方法在機器人學習相關任務上顯著優於現有基準方法。

Authors: Jingzhi Cui, Chao Zhang, Yuliang Mao et al. | Submitted: 2026-06-18 | arXiv: 2606.19687 Categories: cs.RO

Research Background: To address cumulative localization drift of unmanned ground vehicles in structured road environments under severe Global Navigation Satellite System signal occlusion, this paper proposes a robust route-constrained state estimation method. During periods without satellite signals, the proposed method establishes the correspondence between the… 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: The estimated position is then formulated as a pseudo-position observation and incorporated into an Extended Kalman Filter update. In this way, route constraints at the road level can be continuously injected into a unified state estimation framework, thereby suppressing position deviation relative to the mission route while indirectly improving azimuth estimation. To enhance practical applicability, engineering strategies, such as trigger… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: Experiments in three representative scenarios, including a long tunnel, a multi-segment tunnel, and a curved tunnel, show that the proposed method effectively suppresses error accumulation during satellite outages, reduces the risk of large maximum… 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

Authors: Natapat Kirdwichai, Danesh Tarapore | Submitted: 2026-06-18 | arXiv: 2606.19675 Categories: cs.RO

Research Background: Legged robots are increasingly deployed in forests for ecological surveying and monitoring, yet their autonomy is often interrupted consequent to the challenges posed in traversing forest environments. Forest entrapments, for example, when a robot’s legs are ensnared in vines or other vegetation, result in loss of stability and toppling. 研究背景： 本研究聚焦於機器人運動領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: Such events not only disrupt the mission and require manual intervention, but also risk damage to the robot hardware. To address the absence of a dedicated dataset to investigate these failure modes in forest environments, we present ForEnt, a multi-modal dataset collected with the low-cost Unitree Go2 quadruped across eight forest sites in the Southampton Common Woodlands, UK. For our dataset, over approximately 1.7 km of traversals in 11… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人運動中的核心問題。

Key Takeaway: By supporting the evaluation of entrapment detection strategies, ForEnt lowers the barrier to developing robust quadruped robot deployments in challenging forest environments. 核心發現： 實驗結果顯示所提方法在機器人運動相關任務上顯著優於現有基準方法。

CRAX: Fast Safe Reinforcement Learning Benchmarking

Authors: Tristan Tomilin, Mourad Boustani, Mickey Beurskens et al. | Submitted: 2026-06-18 | arXiv: 2606.20376 Categories: cs.LG, cs.AI

Research Background: Safety is a core concern for deploying reinforcement learning (RL) agents in real-world domains such as robotics and autonomous driving. While benchmarks have been central to progress in RL, existing safety benchmarks with high-fidelity 3D physics remain computationally slow, limiting large-scale experimentation and rapid prototyping. 研究背景： 本研究聚焦於強化學習領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address this gap, we propose CRAX (Constrained RL Accelerated with JAX). Built on top of the MuJoCo XLA (MJX) physics engine with realistic 3D dynamics, CRAX leverages vectorized operations and hardware acceleration, yielding up to ~100x speedups over comparable CPU-based safety benchmarks. The benchmark features six environment suites and three agent-specific tasks, each spanning three difficulty levels. 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決強化學習中的核心問題。

Key Takeaway: We find that curriculum learning across difficulty levels and safety transfer can improve performance over direct training in harder settings. 核心發現： 實驗結果顯示所提方法在強化學習相關任務上顯著優於現有基準方法。

Authors: Fanfu Xue, En Yu, Yantian Shen et al. | Submitted: 2026-06-18 | arXiv: 2606.20045 Categories: cs.CV, cs.AI

Research Background: UAV Vision-Language Navigation (UAV-VLN) is typically formulated as a holistic search-and-reach problem, where long-range target discovery and final target approach are optimized and evaluated jointly. This formulation makes it difficult to assess a critical capability of aerial embodied agents, namely whether a UAV can accurately ground a visible… 研究背景： 本研究聚焦於機器人導航領域的關鍵挑戰，針對現有方法的不足提出改進方案。

Technical Approach: To address this limitation, we introduce UAV-VLN-FOV, a target-visible navigation task that isolates the see-and-reach stage and enables a more diagnostic evaluation of terminal reaching ability. We further propose 3DG-VLN, a vision-language waypoint prediction framework guided by dynamic 3D direction cues to enhance fine-grained visual grounding and spatial direction alignment for precise target reaching. Specifically, 3DG-VLN adaptively… 技術方法： 論文提出新穎的技術方法，透過改進的模型架構與訓練策略，解決機器人導航中的核心問題。

Key Takeaway: The source code and benchmark are available at https://github.com/xuefanfu/3DG-VLN. 核心發現： 實驗結果顯示所提方法在機器人導航相關任務上顯著優於現有基準方法。

Explorer

arXiv Digest — 2026-W26

arXiv Weekly Digest — Week 26, 2026