arXiv Weekly Digest — Week 24, 2026
Fetched: 2026-06-08 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 172
Affordance-Based Hierarchical Reinforcement Learning for Quadruped Pedipulation
Authors: Tuba Girgin, Jose Castelblanco, Gabriel Rodriguez et al. | Submitted: 2026-06-05 | arXiv: 2606.07506
Categories: cs.RO
Research Background: Quadruped robots capable of manipulating objects with their legs (pedipulation) still rely on expert-designed high-level trajectories to select interaction points and base poses, limiting fully autonomous task execution. 研究背景: 能以腿部操作物件的四足機器人(pedipulation)仍依賴人工設計的高層軌跡來選擇互動點與基座姿態,限制了完全自主的任務執行。
Technical Approach: The authors propose a three-level hierarchical RL framework: a pose-affordance estimator selects robot base poses, a navigation policy drives the robot to those poses, and a pedipulation policy uses interaction-point affordances for end-effector planning. All three levels are trained end-to-end in NVIDIA IsaacSim and validated in the real world. 技術方法: 作者提出三層階層式強化學習框架:姿態可供性估計器選擇機器人基座姿態,導航策略引導機器人到達這些姿態,pedipulation 策略使用互動點可供性進行末端執行器規劃。三個層次均在 NVIDIA IsaacSim 中端對端訓練,並在真實環境中驗證。
Key Takeaway: Affordance-guided hierarchical RL enables quadruped robots to autonomously select interaction points and execute object manipulation tasks in real environments without human trajectory design. 核心發現: 可供性引導的階層式強化學習使四足機器人能自主選擇互動點並在真實環境中執行物件操作任務,無需人工軌跡設計。
Simulation-Driven Imitation Learning for Biosignals-Free Shared-Autonomy Prosthetic Grasping
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07389
Categories: cs.RO
Research Background: Biosignal-free shared-autonomy prosthetic control offers natural manipulation without EMG signals, but imitation-learning approaches are bottlenecked by the high cost of real-world demonstration data collection. 研究背景: 無生物訊號的共享自主義肢控制提供無需 EMG 訊號的自然操作,但模仿學習方法受真實世界示範資料蒐集成本高所限制。
Technical Approach: The paper presents a simulation-driven pipeline that generates large volumes of synthetic grasping demonstrations in simulation, transfers them to real hardware via domain adaptation, and trains an imitation learning policy for shared-autonomy control that requires only minimal real-world calibration data. 技術方法: 本文提出模擬驅動的流程,在模擬器中大量生成合成抓握示範,透過領域適應遷移至真實硬體,並訓練模仿學習策略進行共享自主控制,只需少量真實世界校準資料。
Key Takeaway: Simulation-driven imitation learning dramatically reduces real-world data requirements for prosthetic shared autonomy while maintaining competitive grasping performance. 核心發現: 模擬驅動的模仿學習大幅降低義肢共享自主的真實世界資料需求,同時保持競爭性的抓握表現。
Spline Policy: A Structured Representation for Robot Policies
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07386
Categories: cs.RO
Research Background: Imitation learning robot policies typically represent actions as fixed-resolution action chunks, which lack geometric and temporal structure and make it hard to reason about trajectory smoothness before execution. 研究背景: 模仿學習機器人策略通常將動作表示為固定解析度的動作塊,缺乏幾何與時間結構,難以在執行前推理軌跡平滑性。
Technical Approach: Spline Policy replaces action chunks with predicted spline parameters (control points and knot vectors), enabling smooth, interpolatable trajectories as first-class outputs. The policy backbone is unchanged; only the action decoder is replaced with a spline decoder, making the method a drop-in for existing architectures. 技術方法: Spline Policy 以預測的樣條參數(控制點與節點向量)取代動作塊,將平滑可插值的軌跡作為一類輸出。策略骨幹不變,僅將動作解碼器替換為樣條解碼器,使此方法可直接套用於現有架構。
Key Takeaway: Replacing action chunks with spline parameters yields smoother, more geometrically structured trajectories with minimal architectural changes and competitive manipulation performance. 核心發現: 以樣條參數取代動作塊,在最小架構更改下產生更平滑、更具幾何結構的軌跡,且操作表現具競爭力。
RhinoVLA Technical Report
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07383
Categories: cs.RO
Research Background: Deploying VLA models on edge hardware for real-time robot manipulation faces latency bottlenecks because VLM visual and context tokens consume disproportionate compute during projection operations. 研究背景: 在邊緣硬體上即時部署 VLA 模型面臨延遲瓶頸,因為 VLM 視覺與上下文 token 在投影操作中消耗不成比例的計算資源。
Technical Approach: RhinoVLA identifies visual and contextual token redundancy as the primary deployment bottleneck and introduces a series of architectural optimizations — token pruning, efficient attention patterns, and quantization-friendly design — targeting edge inference latency for robotic manipulation tasks. 技術方法: RhinoVLA 識別視覺與上下文 token 冗餘為主要部署瓶頸,引入一系列架構優化——token 剪枝、高效注意力模式和量化友好設計——以機器人操作任務的邊緣推理延遲為目標。
Key Takeaway: Targeted token redundancy elimination in VLA models enables practical real-time deployment on resource-constrained edge hardware without significant performance loss. 核心發現: 針對性消除 VLA 模型的 token 冗餘,可在資源受限的邊緣硬體上實現實際即時部署,且性能損失不顯著。
CAPE: Contrastive Action-conditioned Parallel Encoding for Embodied Planning
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07304
Categories: cs.RO
Research Background: Effective embodied planning requires predicting action consequences, but current visual dynamics models reconstruct full future states — spreading capacity across visually irrelevant details rather than action-relevant changes. 研究背景: 有效的具身規劃需要預測動作後果,但目前的視覺動態模型重建完整的未來狀態,將容量分散在視覺不相關細節而非動作相關變化上。
Technical Approach: CAPE introduces contrastive action-conditioned parallel encoding that learns a compact latent space distinguishing the consequences of different candidate actions without full future-state reconstruction. It encodes current and candidate-action-conditioned future representations in parallel and uses contrastive losses to shape the latent space around action relevance. 技術方法: CAPE 引入對比動作條件並行編碼,學習緊湊的潛在空間以區分不同候選動作的後果,無需完整未來狀態重建。以並行方式編碼當前與候選動作條件的未來表示,使用對比損失圍繞動作相關性塑造潛在空間。
Key Takeaway: Contrastive action-conditioned encoding achieves efficient embodied planning by focusing representation capacity on action-relevant state differences rather than full future reconstruction. 核心發現: 對比動作條件編碼透過將表示容量聚焦於動作相關的狀態差異而非完整未來重建,實現高效具身規劃。
Beyond Waypoints: A Trajectory-Centric Waypointing Paradigm for Vision-Language Navigation
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07244
Categories: cs.RO
Research Background: VLN-CE agents typically plan with sparse discrete waypoints, losing fine-grained trajectory information needed for smooth navigation in cluttered real-world environments. 研究背景: VLN-CE 智能體通常以稀疏離散路標點規劃,遺漏在雜亂真實環境中平滑導航所需的細粒度軌跡資訊。
Technical Approach: The authors replace the discrete waypoint prediction stage with a trajectory-centric paradigm that predicts dense continuous trajectory segments as the navigation interface. A VLA model then executes these denser trajectory representations, reducing positional ambiguity and improving path fidelity. 技術方法: 作者以以軌跡為中心的範式取代離散路標點預測階段,將密集連續軌跡段預測作為導航介面。VLA 模型接著執行這些更密集的軌跡表示,減少位置模糊性並改善路徑保真度。
Key Takeaway: Trajectory-centric waypointing substantially improves VLN-CE success rates by providing denser, more geometrically coherent path guidance than sparse waypoints. 核心發現: 以軌跡為中心的路標點範式透過提供比稀疏路標點更密集、更具幾何一致性的路徑引導,大幅提升 VLN-CE 成功率。
Robotic Policy Adaptation via Weight-Space Meta-Learning
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07217
Categories: cs.RO
Research Background: VLA models generalize well across known tasks but still require costly task-specific fine-tuning to adapt to new manipulation scenarios, limiting their practical deployment flexibility. 研究背景: VLA 模型在已知任務上泛化良好,但仍需昂貴的特定任務微調以適應新的操作場景,限制其實際部署靈活性。
Technical Approach: This paper applies weight-space meta-learning (a MAML-style approach) directly to VLA model parameters, learning a meta-initialization that enables rapid few-shot adaptation across new tasks. Unlike activation-space conditioning, weight-space adaptation updates the model itself, enabling genuine morphology- and task-agnostic generalization. 技術方法: 本文將權重空間元學習(MAML 風格方法)直接應用於 VLA 模型參數,學習支持跨新任務快速少樣本適應的元初始化。與激活空間條件化不同,權重空間適應更新模型本身,實現真正的形態和任務無關泛化。
Key Takeaway: Weight-space meta-learning enables VLA models to adapt to new manipulation tasks from as few as one or two demonstrations, significantly outperforming standard fine-tuning in data efficiency. 核心發現: 權重空間元學習使 VLA 模型能從一兩個示範中適應新操作任務,在資料效率上顯著優於標準微調。
QuadVerse: An Integrated Framework Aligning Visual-Physical Reality for Quadruped Simulation
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07118
Categories: cs.RO
Research Background: Sim-to-real transfer for quadruped locomotion is bottlenecked by visual and physical domain gaps that are typically addressed independently, causing their combined mismatches to compound during real-world deployment. 研究背景: 四足運動的模擬到真實遷移受視覺與物理領域差距阻礙,這些差距通常被獨立處理,導致其組合不匹配在真實世界部署時複合累積。
Technical Approach: QuadVerse presents a unified framework that simultaneously aligns visual rendering fidelity and physical dynamics parameters for quadruped simulation. The system jointly optimizes visual appearance and physics simulation to minimize the combined sim-to-real gap, using synchronized domain randomization across both modalities. 技術方法: QuadVerse 提出統一框架,同時對齊四足機器人模擬的視覺渲染保真度和物理動態參數。系統聯合優化視覺外觀和物理模擬以最小化綜合模擬到真實差距,在兩個模態間使用同步領域隨機化。
Key Takeaway: Jointly addressing visual and physical sim-to-real gaps within a single framework yields substantially better quadruped locomotion transfer than handling each domain independently. 核心發現: 在單一框架內聯合解決視覺與物理模擬到真實差距,比獨立處理每個領域獲得顯著更好的四足運動遷移效果。
Coarse-to-Control: Action-Token Planning for Vision-Language-Action Models
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07107
Categories: cs.RO
Research Background: Most VLA models map observations directly to low-level actions without intermediate planning, causing early decision errors to compound in long-horizon tasks. 研究背景: 大多數 VLA 模型直接將觀察映射到低層動作而無中間規劃,導致早期決策錯誤在長時域任務中複合累積。
Technical Approach: Coarse-to-Control introduces a two-stage architecture within a single VLA model: first generating discrete “coarse action tokens” as a high-level plan, then decoding these into fine-grained control actions. Both stages are jointly trained, keeping the architecture end-to-end while injecting explicit planning structure. 技術方法: Coarse-to-Control 在單一 VLA 模型中引入兩階段架構:首先生成離散的「粗粒度動作 token」作為高層計劃,再將其解碼為精細的控制動作。兩個階段聯合訓練,保持架構端對端的同時注入明確的規劃結構。
Key Takeaway: Embedding explicit coarse-to-fine action planning natively in the VLA action-token space significantly improves long-horizon task success without requiring external planners. 核心發現: 在 VLA 動作 token 空間中原生嵌入明確的由粗到精動作規劃,大幅提升長時域任務成功率,無需外部規劃器。
LARA: Latent Action Representation Alignment for Vision-Language-Action Models
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07100
Categories: cs.CV, cs.RO
Research Background: VLA models are limited by scarce real-world robot action datasets; leveraging abundant action-free video data requires bridging the gap between passive video and executable robot actions. 研究背景: VLA 模型受真實世界機器人動作資料集稀缺所限;利用豐富的無動作影片資料需要彌合被動影片與可執行機器人動作之間的差距。
Technical Approach: LARA trains a shared latent action space by aligning action representations from heterogeneous robot datasets and action-free video data. Cross-dataset alignment losses encourage the latent space to be morphology- and source-agnostic, enabling knowledge transfer from diverse data to improve VLA policy learning. 技術方法: LARA 透過對齊來自異質機器人資料集和無動作影片資料的動作表示,訓練共享潛在動作空間。跨資料集對齊損失鼓勵潛在空間對形態和來源不可知,實現從多樣資料到 VLA 策略學習的知識遷移。
Key Takeaway: Latent action representation alignment enables VLA models to leverage heterogeneous video and robot datasets more effectively, improving generalization to novel manipulation scenarios. 核心發現: 潛在動作表示對齊使 VLA 模型能更有效利用異質影片和機器人資料集,提升對新型操作場景的泛化能力。
Dreaming when Necessary: Advancing World Action Models with Adaptive Multi-Modal Reasoning
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07089
Categories: cs.RO
Research Background: World Action Models (WAMs) rely heavily on costly video prediction rollouts for all decisions, wasting compute in predictable situations where direct policy inference would suffice. 研究背景: 世界動作模型(WAMs)對所有決策都嚴重依賴昂貴的影片預測展開,在可直接進行策略推理的可預測情況下浪費計算資源。
Technical Approach: This paper introduces adaptive multi-modal reasoning that selectively activates “dreaming” (world-model imagination) only when environmental uncertainty is high. A learned gating mechanism assesses the current context and routes the decision to either direct reactive inference or a world-model rollout, balancing compute against uncertainty. 技術方法: 本文引入自適應多模態推理,僅在環境不確定性高時選擇性地激活「夢想」(世界模型想像)。學習的閘控機制評估當前上下文,將決策路由到直接反應推理或世界模型展開,在計算資源與不確定性之間取得平衡。
Key Takeaway: Adaptive dreaming reduces unnecessary world-model computation by up to 40% while maintaining or improving task performance across diverse manipulation benchmarks. 核心發現: 自適應夢想在多樣操作基準測試中保持或提升任務表現的同時,將不必要的世界模型計算減少最多 40%。
Predictive Style Matching: Natural and Robust Humanoid Locomotion
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07083
Categories: cs.RO
Research Background: RL-trained humanoid locomotion policies often exhibit stiff, asymmetric gaits that lack natural human-like motion style, while motion-imitation approaches sacrifice robustness for style quality. 研究背景: 強化學習訓練的人形機器人運動策略常展現僵硬、不對稱的步態,缺乏自然的類人運動風格,而動作模仿方法則犧牲魯棒性換取風格品質。
Technical Approach: Predictive Style Matching trains a locomotion policy by predicting future motion states and matching them against reference style embeddings extracted from motion capture data. The style reward is computed in a predictive fashion, encouraging natural-looking gait while the RL objective maintains robustness to perturbations. 技術方法: Predictive Style Matching 透過預測未來動作狀態並將其與從動作捕捉資料提取的參考風格嵌入進行匹配,訓練運動策略。風格獎勵以預測方式計算,鼓勵自然外觀步態,同時 RL 目標維持對擾動的魯棒性。
Key Takeaway: Predictive style matching achieves both natural humanoid gait aesthetics and robustness to physical perturbations simultaneously, without requiring the typical trade-off between the two. 核心發現: Predictive Style Matching 同時實現自然人形步態美學和對物理擾動的魯棒性,無需兩者間的典型權衡。
A Multi-Operator Mixed-Reality Interface for Multi-Robot Control and Coordination
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07013
Categories: cs.RO
Research Background: Controlling multi-robot teams requires shared situational awareness across human operators, but conventional single-operator interfaces create bottlenecks and conflicting interventions in complex missions. 研究背景: 控制多機器人團隊需要跨人類操作員的共享態勢感知,但傳統的單操作員介面在複雜任務中造成瓶頸和衝突干預。
Technical Approach: Building on the HORUS interface, this paper extends it to support multiple simultaneous operators through shared mixed-reality visualizations. Each operator sees a unified view of robot states, tasks, and planned actions in their MR headset, with conflict-resolution mechanisms preventing overlapping commands. 技術方法: 基於 HORUS 介面,本文擴展以支持多位操作員透過共享混合實境視覺化同時操作。每位操作員在其 MR 頭盔中看到機器人狀態、任務和計劃動作的統一視圖,衝突解決機制防止重疊指令。
Key Takeaway: Multi-operator mixed-reality interfaces significantly improve multi-robot coordination efficiency and reduce intervention conflicts compared to single-operator approaches. 核心發現: 多操作員混合實境介面相比單操作員方式,大幅提升多機器人協調效率並減少干預衝突。
Task Editing for Generalizable 3D Visuomotor Policy Learning
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07012
Categories: cs.RO
Research Background: 3D visuomotor policies for robot manipulation require large-scale task-specific demonstrations and lack mechanisms to generalize to new tasks without full retraining. 研究背景: 機器人操作的 3D 視覺運動策略需要大規模特定任務示範,且缺乏在不完全重新訓練下泛化到新任務的機制。
Technical Approach: The paper introduces task editing as a compositional mechanism: task representations are encoded in a shared latent space and can be modified by arithmetic editing operations (e.g., adding or swapping object attributes) to produce policies for novel task combinations. Motion generation is conditioned on the edited task latent, separating task specification from low-level control. 技術方法: 本文引入任務編輯作為組合機制:任務表示在共享潛在空間中編碼,可透過算術編輯操作(如添加或交換物件屬性)修改,以生成新任務組合的策略。動作生成以編輯後的任務潛在向量為條件,將任務規格與低層控制分離。
Key Takeaway: Latent-space task editing enables rapid compositional generalization of 3D visuomotor policies to novel manipulation tasks without per-task retraining. 核心發現: 潛在空間任務編輯使 3D 視覺運動策略無需逐任務重新訓練即可快速組合泛化至新操作任務。
LIMMT: Less is More for Motion Tracking
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06953
Categories: cs.RO
Research Background: Physics-based humanoid motion tracking typically relies on large, computationally expensive models, creating latency barriers for real-time robot control. 研究背景: 基於物理的人形機器人動作追蹤通常依賴大型計算昂貴的模型,為即時機器人控制造成延遲障礙。
Technical Approach: LIMMT studies how curated, high-quality motion data can steer small tracking policies toward better optimization trajectories, finding that data quality outweighs model scale. The framework identifies motion quality metrics that guide data curation and demonstrates that a minimal architecture trained on curated data outperforms larger models trained on uncurated data. 技術方法: LIMMT 研究精心策劃的高品質動作資料如何引導小型追蹤策略進入更好的優化軌跡,發現資料品質優先於模型規模。框架識別引導資料策劃的動作品質指標,展示在精心策劃資料上訓練的最小架構優於在未策劃資料上訓練的更大模型。
Key Takeaway: Data-centric curation for motion tracking enables small models to outperform larger ones, significantly reducing compute while maintaining high tracking accuracy. 核心發現: 以資料為中心的動作追蹤策劃使小型模型能優於更大型模型,在保持高追蹤精度的同時大幅降低計算需求。
T-GMP: Terrain-conditioned Generative Motion Priors for Versatile and Natural Humanoid Locomotion
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06944
Categories: cs.RO
Research Background: Humanoid locomotion policies that use fixed motion priors struggle to produce anthropomorphically natural movement across diverse terrain types while maintaining physical robustness. 研究背景: 使用固定動作先驗的人形機器人運動策略難以在保持物理魯棒性的同時,在多樣地形類型上產生擬人自然的動作。
Technical Approach: T-GMP conditions a generative motion prior on terrain features, producing contextually appropriate reference motions for different terrain types (stairs, slopes, uneven ground). The generative prior is then integrated into a RL-based locomotion policy as a structured reference signal, enabling both versatility and naturalness. 技術方法: T-GMP 以地形特徵為條件的生成動作先驗,為不同地形類型(樓梯、坡道、不平地面)產生符合情境的參考動作。生成先驗接著作為結構化參考訊號整合到基於 RL 的運動策略中,實現多功能性和自然性。
Key Takeaway: Terrain-conditioned generative priors enable a single unified humanoid locomotion policy to traverse diverse terrain types with natural, anthropomorphic motion patterns. 核心發現: 地形條件生成先驗使單一統一的人形機器人運動策略能以自然擬人的動作模式穿越多樣地形類型。
ActionMap: Robot Policy Learning via Voxel Action Heatmap
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06904
Categories: cs.RO
Research Background: VLA model action decoders almost universally use single-point action predictors that discard the spatial distribution of plausible actions, limiting policy expressiveness and precision. 研究背景: VLA 模型動作解碼器幾乎普遍使用單點動作預測器,丟棄了合理動作的空間分布,限制了策略的表達性和精度。
Technical Approach: ActionMap represents robot actions as 3D voxel heatmaps that encode the full spatial distribution of likely action targets and trajectories. The policy predicts a volumetric probability map over action space rather than a single action vector, allowing it to reason about spatial uncertainty and produce more precise manipulations. 技術方法: ActionMap 將機器人動作表示為 3D 體素熱圖,編碼可能動作目標和軌跡的完整空間分布。策略在動作空間上預測體積概率圖而非單一動作向量,使其能夠推理空間不確定性並產生更精確的操作。
Key Takeaway: Voxel action heatmap representation captures spatial action distributions that single-point predictors miss, yielding measurable improvements in manipulation precision and multi-modal action handling. 核心發現: 體素動作熱圖表示捕捉單點預測器遺漏的空間動作分布,在操作精度和多模態動作處理方面產生可測量的改進。
A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06878
Categories: cs.RO
Research Background: 6-DoF grasp pose estimation from corner or occluded viewpoints suffers from incomplete object geometry, requiring multi-view fusion to resolve ambiguities. 研究背景: 從角落或遮擋視角進行 6 自由度抓握姿態估計因物件幾何不完整而存在問題,需要多視角融合來解決模糊性。
Technical Approach: The framework incorporates an auxiliary camera view to alleviate single-view occlusion, then performs post-fusion grasp estimation that avoids time-consuming multi-view 3D reconstruction. A cross-view attention mechanism aligns features from different viewpoints geometrically before predicting 6-DoF grasp poses. 技術方法: 框架整合輔助相機視角以緩解單視角遮擋,接著執行避免耗時多視角 3D 重建的後融合抓握估計。跨視角注意力機制在預測 6 自由度抓握姿態之前幾何對齊來自不同視角的特徵。
Key Takeaway: Cross-view geometric feature fusion substantially improves 6-DoF grasp pose estimation robustness in occluded or corner-view scenarios without the overhead of full 3D reconstruction. 核心發現: 跨視角幾何特徵融合在遮擋或角落視角場景中大幅提升 6 自由度抓握姿態估計魯棒性,且無需完整 3D 重建的開銷。
Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06877
Categories: cs.RO
Research Background: Long-horizon robot task planning under complex logical constraints (object affordances, spatial relationships, sequential dependencies) causes combinatorial state-space explosion that pure neural methods cannot reliably handle. 研究背景: 在複雜邏輯約束(物件可供性、空間關係、順序依賴)下的長時域機器人任務規劃導致組合狀態空間爆炸,純神經方法無法可靠處理。
Technical Approach: The paper combines a neural component that learns to propose candidate actions from demonstrations with a symbolic PDDL-style planner that enforces logical constraints and validates plans. The neural module handles perceptual grounding and action proposal; the symbolic module ensures constraint satisfaction and long-horizon plan coherence. 技術方法: 本文結合從示範中學習提議候選動作的神經組件,與執行邏輯約束並驗證計劃的符號式 PDDL 風格規劃器。神經模塊處理感知接地和動作提議;符號模塊確保約束滿足和長時域計劃一致性。
Key Takeaway: Neuro-symbolic integration enables robots to reliably handle long-horizon tasks with complex logical constraints that pure neural approaches consistently fail on. 核心發現: 神經符號整合使機器人能可靠處理純神經方法持續失敗的複雜邏輯約束長時域任務。
What Is My Robot Thinking? Design Considerations for Transparent and Trustworthy Autonomy
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06870
Categories: cs.RO
Research Background: Assistive robots operating under shared autonomy face a fundamental trust challenge: users cannot observe the robot’s internal intent inference, causing coordination breakdowns when robot goals diverge from user intentions. 研究背景: 在共享自主下操作的輔助機器人面臨根本性的信任挑戰:用戶無法觀察機器人的內部意圖推理,當機器人目標與用戶意圖不同時導致協調失敗。
Technical Approach: The paper investigates how intent inference transparency can be communicated through multimodal interfaces — speech, display overlays, and motion cues — and identifies design principles for calibrating transparency to user needs. It empirically studies which communication modalities most effectively improve user trust and task performance. 技術方法: 本文研究意圖推理透明度如何透過多模態介面——語音、顯示疊加和動作提示——傳達,並識別根據用戶需求校準透明度的設計原則。實驗性研究哪些溝通模態最有效地提升用戶信任和任務表現。
Key Takeaway: Transparent communication of robot intent through carefully designed multimodal cues significantly increases user trust and reduces intervention rates in shared-autonomy HRI. 核心發現: 透過精心設計的多模態提示透明溝通機器人意圖,在共享自主 HRI 中顯著提升用戶信任並降低干預率。
Think Like a Pilot: Fine-Grained Long-Horizon UAV Navigation
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06836
Categories: cs.RO
Research Background: Language-guided UAV navigation requires executing long-horizon semantic instructions while producing smooth, physically feasible continuous flight commands — a challenge existing VLA approaches handle poorly because they focus on coarse actions or discrete navigation steps. 研究背景: 語言引導的無人機導航需要執行長時域語義指令,同時產生平滑、物理可行的連續飛行指令——現有 VLA 方法因聚焦於粗粒度動作或離散導航步驟而處理不當。
Technical Approach: The authors develop a VLA system trained to reason at multiple granularities — from high-level semantic waypoints to fine-grained flight controls — using a curriculum that progressively introduces longer instruction horizons. The model explicitly learns pilot-style anticipatory reasoning about upcoming trajectory features. 技術方法: 作者開發一個 VLA 系統,使用逐步引入更長指令時域的課程,訓練以多粒度推理——從高層語義路標點到精細飛行控制。模型明確學習飛行員風格的對即將到來軌跡特徵的預測推理。
Key Takeaway: Fine-grained multi-scale reasoning enables UAV navigation agents to follow complex long-horizon language instructions while producing smooth and physically feasible flight trajectories. 核心發現: 精細的多尺度推理使無人機導航智能體能跟隨複雜長時域語言指令,同時產生平滑且物理可行的飛行軌跡。
STRIPS-WM: Learning Grounded Propositional STRIPS-style World Models from Images
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06832
Categories: cs.RO
Research Background: Robots performing long-horizon visual manipulation need planning representations that abstract away irrelevant visual details while preserving action-relevant facts (what can be done now and what changes afterward). 研究背景: 執行長時域視覺操作的機器人需要規劃表示,在保留動作相關事實(現在可做什麼以及之後會改變什麼)的同時抽象掉不相關的視覺細節。
Technical Approach: STRIPS-WM learns grounded propositional world models directly from image observations without symbolic supervision. The model discovers discrete state predicates and operator schemas that follow STRIPS-style semantics (preconditions, add-effects, delete-effects), enabling symbolic planning over learned representations. 技術方法: STRIPS-WM 直接從圖像觀察中學習有接地的命題世界模型,無需符號監督。模型發現遵循 STRIPS 風格語義(前提條件、添加效果、刪除效果)的離散狀態謂詞和操作符模式,實現基於學習表示的符號規劃。
Key Takeaway: Unsupervised discovery of STRIPS-style world models from images bridges perception and symbolic planning for reliable long-horizon robot manipulation. 核心發現: 從圖像中無監督發現 STRIPS 風格世界模型,在感知與符號規劃之間架橋以實現可靠的長時域機器人操作。
Learning All-Terrain Locomotion for a Planetary Rover with Actively Articulated Suspension
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06790
Categories: cs.RO
Research Background: Planetary rovers must traverse highly challenging terrain including loose regolith, steep slopes, and rocks, requiring locomotion controllers that leverage active suspension for optimal wheel-ground contact. 研究背景: 行星探測車必須穿越包括鬆散風化層、陡坡和岩石在內的高度挑戰性地形,需要利用主動懸架優化輪地接觸的運動控制器。
Technical Approach: The paper presents ERNEST, a four-wheeled rover with a two-DoF Active Gimbal Suspension, and trains a single neural network controller using RL to track desired velocity commands across diverse terrain conditions. The controller simultaneously handles yaw/roll actuation, steering, and active load redistribution. 技術方法: 本文介紹 ERNEST,一款配備二自由度主動萬向懸架的四輪探測車,並使用強化學習訓練單一神經網路控制器,在多樣地形條件下追蹤期望速度指令。控制器同時處理偏航/翻滾驅動、轉向和主動載荷分配。
Key Takeaway: A single RL-trained neural controller with active gimbal suspension enables robust all-terrain locomotion for planetary rovers without terrain-specific engineering. 核心發現: 帶主動萬向懸架的單一強化學習神經控制器使行星探測車無需特定地形工程即可實現魯棒的全地形運動。
AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution
Authors: (multiple authors) | Submitted: 2026-06-05 | arXiv: 2606.07326
Categories: cs.CV, cs.RO
Research Background: Interactive world models for embodied AI lack versatile controllability — the ability to simulate rich egocentric observations under diverse, user-specified conditions — limiting their utility for robot policy development and evaluation. 研究背景: 具身 AI 的互動世界模型缺乏多功能可控性——在多樣用戶指定條件下模擬豐富第一人稱觀察的能力——限制其在機器人策略開發和評估中的實用性。
Technical Approach: AnchorWorld introduces view-based anchors as structural constraints for egocentric world simulation, enabling consistent and controllable scene evolution from the agent’s perspective. Anchors provide stable reference points that guide video generation while allowing flexible interaction modeling. 技術方法: AnchorWorld 引入基於視角的錨點作為第一人稱世界模擬的結構性約束,實現從智能體視角一致且可控的場景演化。錨點提供穩定的參考點引導影片生成,同時允許靈活的互動建模。
Key Takeaway: View-based anchors provide a scalable mechanism for controllable egocentric world simulation, enabling diverse interactive scenario generation for embodied AI training and evaluation. 核心發現: 基於視角的錨點提供可控第一人稱世界模擬的可擴展機制,實現具身 AI 訓練和評估的多樣互動場景生成。
EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06872
Categories: cs.CV, cs.RO
Research Background: Estimating hand-surface contact pressure from egocentric video is crucial for robotic imitation learning and AR/VR applications, but existing methods discretize pressure signals and process frames independently, causing quantization errors and temporal inconsistencies. 研究背景: 從第一人稱視角影片估計手部表面接觸壓力對機器人模仿學習和 AR/VR 應用至關重要,但現有方法離散化壓力訊號並獨立處理幀,導致量化誤差和時間不一致性。
Technical Approach: EgoPressDiff uses a multimodal video diffusion model to jointly generate temporally consistent UV-domain hand pressure maps from egocentric RGB video. The diffusion process models the full pressure distribution over time rather than per-frame prediction, producing physically coherent contact sequences. 技術方法: EgoPressDiff 使用多模態影片擴散模型,從第一人稱 RGB 影片聯合生成時間一致的 UV 域手部壓力圖。擴散過程對壓力分布隨時間建模,而非逐幀預測,產生物理上連貫的接觸序列。
Key Takeaway: Video diffusion models for hand pressure estimation produce temporally consistent contact sequences that significantly improve downstream robotic imitation learning from egocentric demonstrations. 核心發現: 手部壓力估計的影片擴散模型產生時間一致的接觸序列,顯著改善從第一人稱示範進行的機器人模仿學習。
AxisGuide: Grounding Robot Action Coordinate System in RGB Observations for Robust Manipulation
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06761
Categories: cs.RO
Research Background: Visuomotor manipulation policies trained via large-scale behavior cloning achieve strong semantic understanding but fail under viewpoint or appearance distribution shifts because action coordinate systems are not grounded in visual observations. 研究背景: 透過大規模行為克隆訓練的視覺運動操作策略具有強大的語義理解,但因動作坐標系未在視覺觀察中接地而在視角或外觀分布漂移下失敗。
Technical Approach: AxisGuide explicitly grounds the robot’s action coordinate system in the current RGB observation by predicting coordinate axis directions from visual features. The grounded coordinate frame provides a consistent reference for action prediction across viewpoint variations, significantly reducing distribution-shift failures. 技術方法: AxisGuide 透過從視覺特徵預測坐標軸方向,明確地將機器人動作坐標系接地於當前 RGB 觀察。接地的坐標框架為跨視角變化的動作預測提供一致參考,大幅減少分布漂移失敗。
Key Takeaway: Grounding the robot action coordinate system in visual observations dramatically improves manipulation policy robustness under camera viewpoint and appearance distribution shifts. 核心發現: 將機器人動作坐標系接地於視覺觀察,在相機視角和外觀分布漂移下大幅提升操作策略魯棒性。
Optimal Control Approach for Non-prehensile Ball Juggling Using a 7-DoF Manipulator
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06704
Categories: cs.RO
Research Background: Non-prehensile manipulation — controlling objects without grasping them — requires precise dynamic control that remains challenging for high-DoF manipulators, especially for tasks demanding high-speed continuous interaction. 研究背景: 非抓握式操作——在不抓取物件的情況下控制它們——需要精確的動態控制,對高自由度機械手仍然具有挑戰性,尤其是對需要高速持續互動的任務。
Technical Approach: The paper formulates non-prehensile ball juggling as an optimal control problem for a 7-DoF robotic arm, deriving analytical models of ball dynamics under paddle interaction and solving a receding-horizon controller that generates feasible juggling motions. Both simulation and real-hardware experiments validate the approach. 技術方法: 本文將非抓握式球類拋接表述為 7 自由度機械臂的最優控制問題,推導槳板互動下的球動態解析模型,並求解生成可行拋接動作的後退時域控制器。模擬和真實硬體實驗均驗證此方法。
Key Takeaway: Analytical optimal control enables robust non-prehensile ball juggling on a 7-DoF manipulator, demonstrating that principled dynamic control can handle high-speed non-prehensile tasks. 核心發現: 解析最優控制實現 7 自由度機械手上魯棒的非抓握式球類拋接,展示有原則的動態控制可處理高速非抓握任務。
AEGIS: A Backup Reflex for Physical AI
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06660
Categories: cs.AI, cs.RO
Research Background: Long-horizon robot manipulation policies often fail gradually — one bad step degrades the state and the policy spirals into an unrecoverable basin — yet these failure trajectories are often detectable before full failure occurs. 研究背景: 長時域機器人操作策略常逐漸失敗——一個壞步驟降低狀態,策略螺旋進入不可恢復的盆地——但這些失敗軌跡通常在完全失敗前可被偵測。
Technical Approach: AEGIS (Activation-probe Early-warning, Gated Inference Switching) uses lightweight activation probes on the policy network to detect impending failures in real-time. When failure probability exceeds a threshold, AEGIS switches to a safe backup reflex controller that stabilizes the robot state without requiring a full policy reset. 技術方法: AEGIS(激活探針預警、閘控推理切換)在策略網路上使用輕量激活探針即時偵測即將發生的失敗。當失敗概率超過閾值時,AEGIS 切換到安全備份反射控制器,在不需要完整策略重置的情況下穩定機器人狀態。
Key Takeaway: Activation-probe failure detection enables a lightweight backup reflex to prevent cascading manipulation failures before they become unrecoverable, without requiring policy retraining. 核心發現: 激活探針失敗偵測使輕量備份反射能在失敗成為不可恢復之前阻止級聯操作失敗,無需策略重新訓練。
What Matters When Cotraining Robot Manipulation Policies on Everyday Human Video
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06627
Categories: cs.RO
Research Background: Human video datasets used for robot policy cotraining mostly consist of curated motion-capture demonstrations; leveraging the far more plentiful internet video requires understanding which properties of everyday human videos actually transfer to robot performance. 研究背景: 用於機器人策略聯合訓練的人類影片資料集主要由精心策劃的動作捕捉示範組成;利用更豐富的網路影片需要理解日常人類影片的哪些屬性實際上能遷移到機器人表現。
Technical Approach: The paper conducts a systematic empirical study isolating which properties of everyday internet video — action diversity, motion statistics, scene context, viewpoint distribution, temporal structure — contribute most to robot manipulation policy improvement when used for cotraining. Multiple cotraining configurations are tested across robot manipulation benchmarks. 技術方法: 本文進行系統性實證研究,隔離日常網路影片的哪些屬性——動作多樣性、動作統計、場景上下文、視角分布、時間結構——在用於聯合訓練時對機器人操作策略改進貢獻最大。在機器人操作基準測試中測試多種聯合訓練配置。
Key Takeaway: Action diversity and motion statistics of everyday human video are the most important factors for effective robot policy cotraining, more so than visual appearance or scene context. 核心發現: 日常人類影片的動作多樣性和動作統計是有效機器人策略聯合訓練中最重要的因素,比視覺外觀或場景上下文更重要。
ChronoForest: Closed-Loop Multi-Tree Diffusion Planning for Efficient Bridge Sealing
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06618
Categories: cs.RO
Research Background: Planning long-horizon routes that reach goals, visit required waypoints, and remain short is difficult when only short-horizon offline trajectory data is available — a common constraint in offline robot navigation. 研究背景: 當只有短時域離線軌跡資料可用時,規劃到達目標、訪問必要路標點且保持短路徑的長時域路線是困難的——這是離線機器人導航中的常見約束。
Technical Approach: ChronoForest maintains a multi-tree diffusion planner that builds a forest of short-horizon trajectory segments and connects them into closed-loop long-horizon plans. A chronological selection mechanism picks segments that minimize total path length while satisfying waypoint visit constraints, evaluated on bridge sealing inspection tasks. 技術方法: ChronoForest 維護一個多樹擴散規劃器,構建短時域軌跡段的樹林並將其連接成閉環長時域計劃。按時間順序選擇機制選擇最小化總路徑長度同時滿足路標點訪問約束的段,在橋樑密封檢查任務上評估。
Key Takeaway: Multi-tree diffusion planning composes short-horizon trajectory segments into optimal long-horizon plans, enabling effective closed-loop navigation without long-horizon training data. 核心發現: 多樹擴散規劃將短時域軌跡段組合成最優長時域計劃,在沒有長時域訓練資料的情況下實現有效的閉環導航。
HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Policies
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06493
Categories: cs.RO
Research Background: Humanoid whole-body controllers typically demand dense kinematic or spatial references from task planners, creating a mismatch: planners reason in task space while controllers operate in joint space, and this interface bottleneck limits autonomous deployment. 研究背景: 人形機器人全身控制器通常需要任務規劃器提供密集的運動學或空間參考,造成不匹配:規劃器在任務空間推理而控制器在關節空間操作,這個介面瓶頸限制了自主部署。
Technical Approach: HANDOFF introduces a task-space command interface where the planner issues high-level task-space goals, and a distilled complementary policy set handles the whole-body control translation. Teacher policies are distilled into a compact student that seamlessly bridges task-space semantics and full-body joint control. 技術方法: HANDOFF 引入任務空間指令介面,規劃器發出高層任務空間目標,蒸餾的互補策略集處理全身控制翻譯。教師策略被蒸餾為緊湊的學生策略,無縫橋接任務空間語義和全身關節控制。
Key Takeaway: Task-space command interfaces with distilled complementary policies enable seamless integration of high-level task planners with humanoid whole-body control for real-world deployment. 核心發現: 帶蒸餾互補策略的任務空間指令介面實現高層任務規劃器與人形全身控制的無縫整合,用於真實世界部署。
TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06491
Categories: cs.RO
Research Background: Robot manipulation alternates between fast transit phases and slow, precise contact phases, but existing VLA models inherit a single fixed execution speed from training demonstrations, missing this crucial temporal structure. 研究背景: 機器人操作在快速過渡階段和緩慢精確接觸階段之間交替,但現有 VLA 模型從訓練示範中繼承單一固定執行速度,錯過了這個關鍵的時間結構。
Technical Approach: TempoVLA introduces speed-controllable VLA policies by conditioning the model on an explicit speed token that signals whether the current phase requires fast or slow execution. A phase classifier automatically segments demonstrations into speed regimes, and the model learns to modulate trajectory velocity while maintaining task correctness. 技術方法: TempoVLA 引入速度可控的 VLA 策略,以顯式速度 token 為條件,指示當前階段是否需要快速或慢速執行。階段分類器自動將示範分割為速度模式,模型學習在保持任務正確性的同時調製軌跡速度。
Key Takeaway: Speed-controllable VLAs execute manipulation tasks significantly faster overall by accelerating transit phases while maintaining slow, precise control during critical contact phases. 核心發現: 速度可控的 VLA 在加速過渡階段的同時保持關鍵接觸階段的緩慢精確控制,整體上顯著更快地執行操作任務。
Flow-based Policy Adaptation without Policy Updates
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06461
Categories: cs.RO
Research Background: Pretrained robot policies — from foundation models, prior training, or human teleoperation — often produce suboptimal or misaligned actions that need correction without incurring the cost of full policy fine-tuning. 研究背景: 預訓練機器人策略——來自基礎模型、先前訓練或人類遠端操作——通常產生次優或不對齊的動作,需要在不承擔完整策略微調成本的情況下進行修正。
Technical Approach: GLOVE (the proposed method) uses flow-based transformations to adapt the action distribution of an existing policy at inference time, without modifying the policy parameters. A lightweight normalizing flow is trained to redirect policy outputs toward task-specific expert behavior, functioning as an action-space corrector. 技術方法: 提出的方法 GLOVE 使用基於流的變換在推理時適應現有策略的動作分布,而不修改策略參數。訓練輕量標準化流將策略輸出重定向到特定任務的專家行為,充當動作空間校正器。
Key Takeaway: Flow-based action-space adaptation corrects pretrained policy outputs at inference time without any policy parameter updates, making it a versatile zero-cost fine-tuning alternative. 核心發現: 基於流的動作空間適應在推理時修正預訓練策略輸出,無需任何策略參數更新,成為多功能的零成本微調替代方案。
PhyRoGen: Synthetic Generation of Physical Robot Manipulation Puzzles
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06569
Categories: cs.RO
Research Background: Learning manipulation skills for physical assembly and disassembly puzzles requires large training datasets that are time-consuming and tedious to collect with real hardware. 研究背景: 學習實體組裝和拆解拼圖的操作技能需要大型訓練資料集,使用真實硬體蒐集既耗時又繁瑣。
Technical Approach: PhyRoGen uses procedural generation to synthesize physically valid manipulation puzzle environments in simulation, generating diverse spatial configurations with correct mechanical constraints. The system produces large-scale training data for assembly/disassembly manipulation that would be impractical to collect physically. 技術方法: PhyRoGen 使用程序化生成在模擬中合成物理有效的操作拼圖環境,生成具有正確機械約束的多樣空間配置。系統產生大規模的組裝/拆解操作訓練資料,在物理上蒐集這些資料不切實際。
Key Takeaway: Procedural synthetic generation of physics-valid manipulation puzzles provides scalable training data that enables robust learning of assembly and disassembly manipulation skills. 核心發現: 物理有效操作拼圖的程序化合成生成提供可擴展的訓練資料,實現對組裝和拆解操作技能的穩健學習。
Ensuring Interaction Safety in Multitask Exoskeleton Control
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06370
Categories: cs.RO
Research Background: Wearable exoskeletons must adapt across diverse tasks while guaranteeing interaction safety — forces and torques must remain within safe bounds even as impedance parameters vary across activities. 研究背景: 可穿戴外骨骼必須在多樣任務中適應,同時保證互動安全——即使阻抗參數隨活動變化,力和力矩也必須保持在安全範圍內。
Technical Approach: The paper presents a simulation-trained variable impedance controller with stability guarantees that adapts impedance parameters per task while enforcing interaction safety constraints. The controller uses contraction theory to certify stability margins across the range of operating conditions. 技術方法: 本文提出一種帶穩定性保證的模擬訓練可變阻抗控制器,在執行互動安全約束的同時為每個任務調整阻抗參數。控制器使用收縮理論在整個操作條件範圍內認證穩定性邊界。
Key Takeaway: Variable impedance control with certified stability guarantees enables safe and adaptive exoskeleton assistance across diverse tasks without per-task engineering. 核心發現: 具有認證穩定性保證的可變阻抗控制,在不需要逐任務工程的情況下實現跨多樣任務的安全且自適應外骨骼輔助。
Waypoints Matter: A Systematic Study for Sampling-Based Trajectory Planning
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06366
Categories: cs.RO
Research Background: Real-time autonomous driving relies on sampling-based trajectory planners anchored to target waypoints, yet the effect of waypoint placement on planning feasibility and quality remains poorly characterized. 研究背景: 即時自動駕駛依賴以目標路標點為錨點的採樣式軌跡規劃器,但路標點放置對規劃可行性和品質的影響仍然特徵不明確。
Technical Approach: The paper conducts a systematic quantitative study varying waypoint spacing, density, and placement strategy across multiple sampling-based planners and driving scenarios. It analyzes how each factor impacts the existence of feasible trajectories, trajectory quality metrics, and planning compute cost. 技術方法: 本文在多種採樣式規劃器和駕駛場景中系統性地定量研究路標點間距、密度和放置策略的變化。分析每個因素如何影響可行軌跡的存在、軌跡品質指標和規劃計算成本。
Key Takeaway: Waypoint placement is a critical but underappreciated design parameter: denser, road-geometry-aligned waypoints consistently produce higher-quality feasible trajectories in sampling-based planners. 核心發現: 路標點放置是一個關鍵但被低估的設計參數:更密集、與道路幾何對齊的路標點在採樣式規劃器中一致地產生更高品質的可行軌跡。
VOLT: Vision and Language Trajectory Segmentation for Faster-than-Demonstration Robot Learning
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06323
Categories: cs.RO
Research Background: Humans demonstrate tasks at human pace, but industrial robots are required to execute the same tasks as fast as physically possible — current imitation learning methods learn the speed of the demonstration rather than the maximum feasible speed. 研究背景: 人類以人類速度示範任務,但工業機器人被要求以物理可能的最快速度執行同樣的任務——當前模仿學習方法學習示範的速度而非最大可行速度。
Technical Approach: VOLT uses vision-language models to automatically segment demonstration trajectories into semantically meaningful phases and learns phase-specific speed optimization policies. The method identifies which trajectory segments can be safely accelerated and by how much, enabling faster-than-demonstration execution without compromising task success. 技術方法: VOLT 使用視覺語言模型自動將示範軌跡分割為語義上有意義的階段,並學習特定階段的速度優化策略。方法識別哪些軌跡段可以安全加速以及加速程度,實現快於示範的執行而不影響任務成功。
Key Takeaway: Vision-language trajectory segmentation enables robots to execute learned manipulation tasks significantly faster than demonstrations while maintaining high success rates. 核心發現: 視覺語言軌跡分割使機器人在保持高成功率的同時,能以顯著快於示範的速度執行學習到的操作任務。
Multi-Resolution Tactile Imitation Learning for Contact-Rich Robotic Manipulation
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06281
Categories: cs.RO
Research Background: Contact-rich manipulation requires fine touch sensing, but exploiting multiple heterogeneous tactile sensors with different spatial resolutions and modalities in a unified imitation learning framework remains underexplored. 研究背景: 接觸豐富的操作需要精細觸覺感測,但在統一的模仿學習框架中利用具有不同空間解析度和模態的多種異質觸覺感測器仍未被充分探索。
Technical Approach: Multi-Resolution Tactile IL introduces a multi-scale tactile feature fusion architecture that aligns and integrates signals from diverse tactile sensors (high-res, low-res, shear-sensitive) into a unified representation for policy learning. Resolution-aware attention weights tactile modalities based on the current manipulation phase. 技術方法: Multi-Resolution Tactile IL 引入多尺度觸覺特徵融合架構,將來自多種觸覺感測器(高解析度、低解析度、剪切敏感)的訊號對齊並整合為統一的策略學習表示。解析度感知注意力根據當前操作階段加權觸覺模態。
Key Takeaway: Multi-resolution tactile fusion substantially improves imitation learning for contact-rich manipulation by capturing complementary information across heterogeneous touch sensors. 核心發現: 多解析度觸覺融合透過在異質觸覺感測器間捕捉互補資訊,大幅提升接觸豐富操作的模仿學習效果。
MPCoT: Reward-Guided Multi-Path Latent Reasoning for Test-Time Scalable VLA
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06245
Categories: cs.RO
Research Background: VLA policies in long-horizon, high-uncertainty tasks suffer from one-pass action decoding that provides no inference-time deliberation, and explicit chain-of-thought introduces token latency with an indirect text-to-action interface. 研究背景: 在長時域高不確定性任務中的 VLA 策略因單次動作解碼而缺乏推理時間的思考,而明確的思維鏈引入 token 延遲並有間接的文字到動作介面。
Technical Approach: MPCoT generates multiple latent reasoning paths in parallel and uses a reward model to select the best path before decoding the final action. The multi-path generation happens entirely in latent space (avoiding text token overhead), and a lightweight reward estimator scores paths based on expected task progress. 技術方法: MPCoT 並行生成多個潛在推理路徑,並使用獎勵模型在解碼最終動作前選擇最佳路徑。多路徑生成完全在潛在空間中進行(避免文字 token 開銷),輕量獎勵估計器根據預期任務進度對路徑評分。
Key Takeaway: Reward-guided multi-path latent reasoning provides effective test-time scaling for VLA models without the latency overhead of explicit chain-of-thought reasoning. 核心發現: 獎勵引導的多路徑潛在推理為 VLA 模型提供有效的測試時擴展,且無顯式思維鏈推理的延遲開銷。
TAM: Torque Adaptation Module for Robust Motion Transfer in Manipulation
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06218
Categories: cs.RO
Research Background: Policies tuned for one robot instance often behave differently on another due to sim-to-real gaps, unknown payloads, or inter-unit dynamics variation — in contact-rich manipulation even small discrepancies cause failure. 研究背景: 為一個機器人實例調整的策略常因模擬到真實差距、未知有效載荷或實例間動態差異而在另一個上表現不同——在接觸豐富的操作中即使微小差異也會導致失敗。
Technical Approach: TAM inserts a lightweight torque adaptation module between the policy and the robot’s low-level controller. It monitors actual versus expected torques in real-time and computes a compensatory offset that corrects for instance-specific dynamics without retraining the main policy. 技術方法: TAM 在策略和機器人低層控制器之間插入輕量力矩適應模塊。它即時監控實際與預期力矩,並計算補償偏移量以修正特定實例的動態特性,無需重新訓練主策略。
Key Takeaway: A lightweight torque adaptation module enables robust manipulation policy transfer across robot instances and payload variations without policy retraining. 核心發現: 輕量力矩適應模塊使操作策略在不重新訓練的情況下跨機器人實例和有效載荷變化實現魯棒遷移。
ActiveMimic: Egocentric Video Pretraining with Active Perception
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06194
Categories: cs.RO
Research Background: Egocentric human video offers a scalable pretraining source for robot policies, but models pretrained on such video consistently underperform those pretrained on robot data — the key missing signal is active perception behavior (gaze and head movement). 研究背景: 第一人稱人類影片為機器人策略提供可擴展的預訓練源,但在此影片上預訓練的模型持續不及在機器人資料上預訓練的模型——關鍵缺失訊號是主動感知行為(視線和頭部運動)。
Technical Approach: ActiveMimic identifies and extracts active perception signals (gaze fixation patterns, head motion trajectories) from egocentric video and includes these as additional pretraining supervision signals. The model learns to mimic both manipulation actions and the attention behavior that precedes them, closing the gap with robot-data pretraining. 技術方法: ActiveMimic 識別並從第一人稱影片中提取主動感知訊號(視線固定模式、頭部運動軌跡),並將這些作為額外的預訓練監督訊號。模型學習模仿操作動作和先於這些動作的注意力行為,縮小與機器人資料預訓練的差距。
Key Takeaway: Incorporating active perception signals (gaze and head motion) into egocentric video pretraining closes most of the performance gap between human-video and robot-data pretrained manipulation policies. 核心發現: 將主動感知訊號(視線和頭部運動)納入第一人稱影片預訓練,縮小了人類影片與機器人資料預訓練操作策略之間的大部分性能差距。
AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordances
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06155
Categories: cs.RO
Research Background: VLA models leverage pretrained VLM world knowledge for instruction-following manipulation, but the structural mismatch between VLM semantic spaces and embodied control requirements hinders learning of precise perceptual grounding for action. 研究背景: VLA 模型利用預訓練 VLM 世界知識進行指令跟隨操作,但 VLM 語義空間與具身控制需求之間的結構不匹配阻礙了精確感知接地的動作學習。
Technical Approach: AffordanceVLA bridges the VLM-control gap by using object affordances as an explicit intermediate representation. The model first predicts affordance regions (where and how to interact with objects) from the VLM’s semantic understanding, then conditions action generation on these grounded affordance representations. 技術方法: AffordanceVLA 透過使用物件可供性作為明確的中間表示來橋接 VLM 與控制之間的差距。模型首先從 VLM 的語義理解預測可供性區域(在哪裡以及如何與物件互動),然後以這些接地的可供性表示為條件生成動作。
Key Takeaway: Affordance-grounded intermediate representations bridge the semantic-control gap in VLA models, yielding significant improvements in manipulation precision and task success rates. 核心發現: 可供性接地的中間表示橋接 VLA 模型中的語義控制差距,在操作精度和任務成功率方面產生顯著改進。
MotionDisco: Motion Discovery for Extreme Humanoid Loco-Manipulation
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06139
Categories: cs.RO
Research Background: Generating contact-rich, long-horizon humanoid loco-manipulation motions (combining locomotion and manipulation) from scratch is extremely challenging because the contact interaction space grows combinatorially and prior methods depend on teleoperation or motion retargeting. 研究背景: 從頭生成接觸豐富的長時域人形機器人移動操作(結合運動和操作)動作極具挑戰性,因為接觸互動空間組合增長,且先前方法依賴遠端操作或動作重定向。
Technical Approach: MotionDisco discovers loco-manipulation motions by combining contact-aware motion primitive search with compositional motion planning. The framework iteratively discovers and assembles contact-rich motion segments into coherent long-horizon sequences without teleoperation data, using reward-guided exploration over the contact interaction space. 技術方法: MotionDisco 透過結合接觸感知動作原語搜索與組合動作規劃來發現移動操作動作。框架使用對接觸互動空間的獎勵引導探索,反復發現並組裝接觸豐富的動作段成為連貫的長時域序列,無需遠端操作資料。
Key Takeaway: MotionDisco discovers diverse, contact-rich humanoid loco-manipulation motions from scratch without teleoperation or motion capture, enabling scalable generation of complex whole-body robot behaviors. 核心發現: MotionDisco 無需遠端操作或動作捕捉即可從頭發現多樣且接觸豐富的人形機器人移動操作動作,實現複雜全身機器人行為的可擴展生成。
A Conversational Framework for Human-Robot Collaborative Manipulation with Distrust Handling
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06061
Categories: cs.RO
Research Background: Collaborative robot manipulation requires natural language communication, but most frameworks lack mechanisms for handling operator distrust or miscommunication that arises when robot behavior diverges from human expectations. 研究背景: 協作機器人操作需要自然語言溝通,但大多數框架缺乏處理機器人行為與人類預期不符時產生的操作員不信任或誤溝通的機制。
Technical Approach: The framework integrates local LLMs and VLMs with a ROS2 execution stack, with a dedicated distrust detection module that monitors operator feedback during task execution and triggers clarification dialogues when distrust signals are detected. Language understanding, visual grounding, and orchestration are distributed across the pipeline. 技術方法: 框架將本地 LLM 和 VLM 與 ROS2 執行棧整合,帶有專用的不信任偵測模塊,在任務執行期間監控操作員反饋,並在偵測到不信任訊號時觸發澄清對話。語言理解、視覺接地和協調分布在流水線中。
Key Takeaway: Integrating distrust detection into conversational HRI frameworks enables robots to proactively address operator concerns, significantly improving collaborative manipulation task success. 核心發現: 將不信任偵測整合到對話式 HRI 框架中,使機器人能夠主動解決操作員疑慮,顯著改善協作操作任務成功率。
Sample-efficient Low-level Motion Planning for Robotic Manipulation via Zero-shot Transfer
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06041
Categories: cs.RO
Research Background: Low-level motion planning models for robot manipulation become increasingly complex and slow to train as task diversity grows, requiring sample-efficient approaches that can generalize across scenarios. 研究背景: 隨著任務多樣性增長,用於機器人操作的低層動作規劃模型變得越來越複雜且訓練緩慢,需要能夠跨場景泛化的樣本效率方法。
Technical Approach: This work applies the Sample-efficient Cross-Entropy Method (iCEM) to low-level robot manipulation planning, leveraging evolutionary optimization to find feasible trajectories with minimal environment interactions. Zero-shot transfer capabilities are demonstrated across manipulation tasks without task-specific retraining. 技術方法: 本工作將樣本效率交叉熵方法(iCEM)應用於低層機器人操作規劃,利用演化優化以最少的環境互動找到可行軌跡。展示了跨操作任務的零樣本遷移能力,無需特定任務重新訓練。
Key Takeaway: Evolutionary motion planning methods achieve sample-efficient low-level manipulation planning with zero-shot generalization across diverse task configurations. 核心發現: 演化動作規劃方法實現樣本效率的低層操作規劃,並在多樣任務配置間具有零樣本泛化能力。
RealDexUMI: A Wearable Universal Manipulation Interface for Dexterous Robot Learning
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06033
Categories: cs.RO
Research Background: Dexterous manipulation learning requires demonstrations that preserve fine hand-object interactions but existing pipelines either lose dexterity through retargeting or require expensive robot-specific teleoperation hardware. 研究背景: 靈巧操作學習需要保留精細手物互動的示範,但現有流程要麼透過重定向失去靈巧性,要麼需要昂貴的特定機器人遠端操作硬體。
Technical Approach: RealDexUMI is a wearable data collection system that captures fine-grained hand-object interactions during natural human demonstrations and directly maps them to robot dexterous hand configurations. The system uses a compact wearable glove with RGB cameras and proprioceptive sensors to record deployable demonstration data. 技術方法: RealDexUMI 是一種可穿戴資料收集系統,在自然人類示範期間捕捉精細的手物互動並直接映射到機器人靈巧手配置。系統使用帶 RGB 相機和本體感受感測器的緊湊可穿戴手套記錄可部署的示範資料。
Key Takeaway: Wearable universal manipulation interfaces enable high-fidelity dexterous demonstration collection without teleoperation overhead, substantially improving dexterous imitation learning data quality. 核心發現: 可穿戴通用操作介面在沒有遠端操作開銷的情況下實現高保真靈巧示範收集,大幅提升靈巧模仿學習資料品質。
Merging Model-Based Control with Multi-Agent Reinforcement Learning for Multi-Robot Systems
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.06011
Categories: cs.RO
Research Background: Multi-agent reinforcement learning (MARL) for cooperative robot tasks can learn complex emergent policies but tends to produce physically infeasible actions, while model-based control guarantees feasibility but lacks the cooperative flexibility of MARL. 研究背景: 用於協作機器人任務的多智能體強化學習(MARL)可以學習複雜的湧現策略,但傾向於產生物理上不可行的動作,而基於模型的控制保證可行性但缺乏 MARL 的協作靈活性。
Technical Approach: The paper proposes a hybrid framework that uses MARL to learn high-level cooperative policies while a model-based controller enforces physical feasibility constraints at execution time. The MPC safety layer filters MARL action proposals to guarantee dynamically feasible, collision-free multi-robot coordination. 技術方法: 本文提出一種混合框架,使用 MARL 學習高層協作策略,同時基於模型的控制器在執行時執行物理可行性約束。MPC 安全層過濾 MARL 動作提議以保證動態可行的、無碰撞的多機器人協調。
Key Takeaway: Combining MARL cooperative policy learning with model-based feasibility filtering achieves both emergent cooperative behaviors and physical safety guarantees in multi-robot systems. 核心發現: 結合 MARL 協作策略學習與基於模型的可行性過濾,在多機器人系統中同時實現湧現協作行為和物理安全保證。
Robots Need More than VLA and World Models
Authors: (multiple authors) | Submitted: 2026-06-04 | arXiv: 2606.06556
Categories: cs.RO
Research Background: The prevailing paradigm frames generalist robot intelligence as a policy-scaling problem — collect more demonstrations, train larger VLA models, expect broader generalization — but this framing may be fundamentally incomplete. 研究背景: 主流範式將通用機器人智能框架為策略擴展問題——蒐集更多示範、訓練更大的 VLA 模型、期望更廣泛的泛化——但這種框架可能從根本上不完整。
Technical Approach: This position paper systematically argues that the VLA + world model paradigm ignores critical missing components: causal reasoning about physical interventions, systematic error recovery, compositional skill reuse, and grounded common-sense physical reasoning. It proposes a research agenda addressing these gaps with concrete architectural and training proposals. 技術方法: 這篇立場論文系統性地論證 VLA + 世界模型範式忽略了關鍵的缺失組件:關於物理干預的因果推理、系統性錯誤恢復、組合技能重用以及有接地的常識物理推理。提出針對這些差距的研究議程,包含具體的架構和訓練提議。
Key Takeaway: Scaling VLAs and world models alone is insufficient for generalist robot intelligence; the field needs explicit mechanisms for causal reasoning, error recovery, and compositional skill reuse. 核心發現: 單純擴展 VLA 和世界模型對通用機器人智能是不夠的;該領域需要用於因果推理、錯誤恢復和組合技能重用的明確機制。
World-Language-Action Model for Unified World Modeling, Language Reasoning, and Robot Action
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05979
Categories: cs.RO
Research Background: Current robot learning models are fragmented: world models, language reasoning, and action prediction are trained separately, missing the synergies of joint learning across all three modalities. 研究背景: 目前的機器人學習模型是碎片化的:世界模型、語言推理和動作預測分開訓練,錯過了跨三種模態聯合學習的協同效應。
Technical Approach: WLA (World-Language-Action) introduces a unified foundation model that jointly predicts textual subtask plans, subgoal images, and robot actions from language instructions, images, and robot states. Training combines large-scale internet video data (for world and language modeling) with robot demonstration data (for action prediction), enabling knowledge transfer across all modalities. 技術方法: WLA(世界語言動作)引入統一的基礎模型,從語言指令、圖像和機器人狀態聯合預測文字子任務計劃、子目標圖像和機器人動作。訓練結合大規模網路影片資料(用於世界和語言建模)與機器人示範資料(用於動作預測),實現跨所有模態的知識遷移。
Key Takeaway: Jointly training world modeling, language reasoning, and action prediction in a single model produces emergent cross-modal synergies that outperform each modality trained in isolation. 核心發現: 在單一模型中聯合訓練世界建模、語言推理和動作預測,產生超越各模態獨立訓練的湧現跨模態協同效應。
T-FunS3D: Task-Driven Hierarchical Open-Vocabulary 3D Functionality Segmentation
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05975
Categories: cs.CV, cs.RO
Research Background: Open-vocabulary 3D functionality segmentation — localizing functional object components in 3D scenes based on task requirements — is critical for enabling robots to identify relevant interaction points in unstructured environments. 研究背景: 開放詞彙 3D 功能分割——根據任務要求在 3D 場景中定位功能性物件組件——對於使機器人在非結構化環境中識別相關互動點至關重要。
Technical Approach: T-FunS3D introduces a hierarchical segmentation pipeline that operates at multiple semantic levels: object-level recognition, part-level localization, and functionality-level affordance prediction. The model uses task descriptions to dynamically reweight which object parts are relevant for the current manipulation goal. 技術方法: T-FunS3D 引入在多個語義層次操作的分層分割流水線:物件層次識別、部件層次定位和功能層次可供性預測。模型使用任務描述動態重新加權哪些物件部件與當前操作目標相關。
Key Takeaway: Task-driven hierarchical 3D functionality segmentation enables robots to identify manipulation-relevant object parts in open-vocabulary settings across diverse manipulation tasks. 核心發現: 任務驅動的分層 3D 功能分割使機器人在開放詞彙設置中識別跨多樣操作任務的操作相關物件部件。
Towards a Data Flywheel for Embodied Intelligence in Logistics
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05960
Categories: cs.RO
Research Background: Deploying embodied intelligence in logistics requires learning-based policies that scale with data, but bridging from lab demonstrations to industrial-scale deployment requires a systematic approach to data generation, policy learning, and continuous improvement. 研究背景: 在物流中部署具身智能需要隨資料擴展的學習策略,但從實驗室示範橋接到工業規模部署需要系統性的資料生成、策略學習和持續改進方法。
Technical Approach: The paper presents a data flywheel architecture for logistics robotics: deployed robots generate operational data, which trains improved policies, which are deployed to collect better data in a self-reinforcing cycle. The system architecture integrates sim-to-real transfer, active data selection, and online fine-tuning components. 技術方法: 本文提出物流機器人的資料飛輪架構:已部署的機器人生成運營資料,訓練改進的策略,再部署以在自我強化循環中蒐集更好的資料。系統架構整合模擬到真實遷移、主動資料選擇和在線微調組件。
Key Takeaway: A data flywheel architecture enables continuous self-improvement of embodied intelligence in logistics without relying on increasingly expensive manual demonstration collection. 核心發現: 資料飛輪架構使物流中的具身智能能夠持續自我改進,無需依賴日益昂貴的人工示範蒐集。
TAGA: Terrain-aware Active Gaze Learning for Generalizable Agile Humanoid Locomotion
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05880
Categories: cs.RO
Research Background: Agile humanoid locomotion across diverse challenging terrain demands both wide perceptual coverage and precise local geometry understanding, motivating active gaze control analogous to how humans selectively attend to terrain during locomotion. 研究背景: 在多樣挑戰性地形上的敏捷人形機器人運動需要廣泛的感知覆蓋和精確的局部幾何理解,促使主動視線控制類似人類在行走時選擇性地關注地形。
Technical Approach: TAGA learns a terrain-aware active gaze policy jointly with locomotion control, using attention mechanisms that predict where to look based on upcoming terrain features. The gaze policy provides targeted depth perception that feeds into the locomotion controller, improving performance on irregular terrain types. 技術方法: TAGA 與運動控制聯合學習地形感知主動視線策略,使用根據即將到來的地形特徵預測看向何處的注意力機制。視線策略提供有針對性的深度感知輸入運動控制器,提升在不規則地形類型上的表現。
Key Takeaway: Active terrain-aware gaze control substantially improves humanoid locomotion generalization across diverse terrain by directing perceptual resources to the most informative terrain regions. 核心發現: 主動的地形感知視線控制透過將感知資源定向到最有資訊的地形區域,大幅提升人形機器人在多樣地形上的運動泛化能力。
LadderMan: Learning Humanoid Perceptive Ladder Climbing
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05873
Categories: cs.RO
Research Background: Ladder climbing represents one of the most challenging humanoid locomotion tasks due to sparse footholds and handholds, complex whole-body coordination requirements, and high sensitivity to perception and control errors. 研究背景: 由於稀疏的踏腳點和把手、複雜的全身協調需求以及對感知和控制誤差的高敏感性,爬梯子是人形機器人最具挑戰性的運動任務之一。
Technical Approach: LadderMan uses a unified perceptive control framework that combines 3D rung detection, foothold and handhold planning, and whole-body RL policy into a single end-to-end trainable system. Sim-to-real transfer is achieved through adaptive domain randomization specifically designed for ladder geometry and surface friction variation. 技術方法: LadderMan 使用統一的感知控制框架,將 3D 橫檔偵測、踏腳點和把手規劃以及全身 RL 策略組合成單一端對端可訓練系統。透過專為梯子幾何形狀和表面摩擦變化設計的自適應領域隨機化實現模擬到真實遷移。
Key Takeaway: Unified perceptive control with ladder-specific domain randomization enables robust humanoid ladder climbing, transferring successfully from simulation to real hardware. 核心發現: 帶梯子特定領域隨機化的統一感知控制使人形機器人能魯棒地爬梯子,成功從模擬遷移到真實硬體。
PiL-World: A Chunk-Wise World Model for VLA Policy-in-the-Loop Evaluation
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05773
Categories: cs.RO
Research Background: Most world models for robot action evaluation are limited to open-loop prediction, missing the closed-loop dynamics where robot actions change subsequent observations — the primary mode of real VLA deployment. 研究背景: 大多數用於機器人動作評估的世界模型僅限於開環預測,錯過了機器人動作改變後續觀察的閉環動態——真實 VLA 部署的主要模式。
Technical Approach: PiL-World introduces a chunk-wise world model that maintains closed-loop VLA policy evaluation by conditioning video generation on executed action chunks. The model interleaves VLA action prediction with video generation in a synchronized feedback loop, enabling realistic evaluation without physical robot execution. 技術方法: PiL-World 引入塊式世界模型,透過以執行的動作塊為條件的影片生成維持閉環 VLA 策略評估。模型在同步反饋循環中交錯 VLA 動作預測與影片生成,無需物理機器人執行即可實現真實評估。
Key Takeaway: Chunk-wise policy-in-the-loop world models enable accurate closed-loop VLA evaluation, correlating strongly with real robot deployment success rates. 核心發現: 塊式策略在環世界模型實現精確的閉環 VLA 評估,與真實機器人部署成功率強相關。
Let It Be Simple: One-Step Action Generation for Vision-Language-Action Models
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05737
Categories: cs.CV, cs.RO
Research Background: Diffusion-based VLA models treat action generation as iterative denoising (inheriting from image generation), but VLA action generation has a fundamentally different structure — rich observations already fully specify the target actions, making multi-step denoising unnecessarily complex. 研究背景: 基於擴散的 VLA 模型將動作生成視為迭代去噪(繼承自圖像生成),但 VLA 動作生成具有根本不同的結構——豐富的觀察已完全指定目標動作,使多步去噪不必要地複雜。
Technical Approach: The paper demonstrates that one-step action generation (a single forward pass) matches or outperforms multi-step diffusion for VLA models when properly conditioned on rich observations. A carefully designed single-step decoder with flow-matching training produces actions at a fraction of the inference cost of diffusion-based approaches. 技術方法: 本文展示當以豐富觀察為適當條件時,對 VLA 模型,一步動作生成(單次前向傳遞)匹配或優於多步擴散。帶流匹配訓練的精心設計的單步解碼器以擴散方法推理成本的一小部分產生動作。
Key Takeaway: One-step action generation achieves competitive VLA manipulation performance at drastically lower inference cost than iterative diffusion, making real-time deployment practical. 核心發現: 一步動作生成以遠低於迭代擴散的推理成本實現競爭性 VLA 操作表現,使即時部署切實可行。
DexFuture: Hierarchical Future-State Visuomotor Targeting for Bimanual Dexterous Manipulation
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05699
Categories: cs.RO
Research Background: Bimanual dexterous tool-use requires coordinating high-dimensional hand configurations and complex hand-tool-object contact dynamics — most existing policies fail to reason ahead about the joint future states of both hands. 研究背景: 雙手靈巧工具使用需要協調高維手部配置和複雜的手工具物件接觸動態——大多數現有策略未能提前推理雙手的聯合未來狀態。
Technical Approach: DexFuture introduces hierarchical future-state visuomotor targeting: a high-level module predicts desired future hand-object configurations, and a low-level module generates control actions to achieve those future states. The future-state targets act as intermediate goals that decompose the bimanual dexterity problem into tractable sub-problems. 技術方法: DexFuture 引入分層未來狀態視覺運動瞄準:高層模塊預測期望的未來手物件配置,低層模塊生成控制動作以實現這些未來狀態。未來狀態目標作為中間目標,將雙手靈巧問題分解為可處理的子問題。
Key Takeaway: Hierarchical future-state targeting provides effective bimanual dexterity by decomposing the coordination problem into high-level state prediction and low-level action generation. 核心發現: 分層未來狀態瞄準透過將協調問題分解為高層狀態預測和低層動作生成,提供有效的雙手靈巧性。
Accelerating and Scaling MPC-Guided RL for Humanoid Locomotion
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05687
Categories: cs.RO
Research Background: Using MPC as a teacher within RL training for humanoid locomotion provides physics-grounded guidance but is computationally prohibitive — MPC problem construction and solving inside an RL training loop creates severe throughput bottlenecks. 研究背景: 在人形機器人運動的強化學習訓練中使用 MPC 作為教師提供基於物理的指導,但計算代價極高——在 RL 訓練循環中構建和求解 MPC 問題造成嚴重的吞吐量瓶頸。
Technical Approach: The paper introduces amortized MPC guidance that precomputes and caches MPC solutions for common state transitions, dramatically reducing the per-step cost of MPC guidance within RL training. Combined with GPU-parallel simulation, this enables scaling MPC-guided RL to the large-scale training regime required for robust humanoid locomotion. 技術方法: 本文引入分攤 MPC 引導,預計算並緩存常見狀態轉換的 MPC 解,大幅降低強化學習訓練中每步的 MPC 引導成本。結合 GPU 並行模擬,這使得 MPC 引導強化學習能擴展到魯棒人形機器人運動所需的大規模訓練範式。
Key Takeaway: Amortized MPC guidance with GPU-parallel simulation makes physics-grounded RL training for humanoid locomotion practical at scale, significantly improving final policy quality. 核心發現: 帶 GPU 並行模擬的分攤 MPC 引導使人形機器人運動的物理接地強化學習訓練在規模上切實可行,顯著提升最終策略品質。
Safe Embodied AI for Long-horizon Tasks: A Cross-layer Analysis
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05660
Categories: cs.RO
Research Background: Embodied AI systems operating over extended horizons in physical environments create safety risks that are qualitatively different from digital AI — physical failures can harm people and are often irreversible. 研究背景: 在物理環境中長時域運作的具身 AI 系統產生與數位 AI 性質不同的安全風險——物理失敗可能傷害人員且通常是不可逆的。
Technical Approach: The paper presents a cross-layer safety analysis framework for robotic manipulation, examining safety requirements and mechanisms across the perception, planning, action, and hardware layers. It identifies cross-layer safety interactions — failure modes that manifest at one layer but originate from another — and proposes co-design principles for safe long-horizon embodied AI. 技術方法: 本文提出機器人操作的跨層安全分析框架,檢查感知、規劃、動作和硬體層的安全要求和機制。識別跨層安全互動——在一層顯現但源自另一層的失敗模式——並提出安全長時域具身 AI 的協同設計原則。
Key Takeaway: Cross-layer safety co-design is essential for long-horizon embodied AI — treating each system layer in isolation misses critical failure modes that only emerge from inter-layer interactions. 核心發現: 跨層安全協同設計對長時域具身 AI 至關重要——獨立處理每個系統層會錯過僅從層間互動中出現的關鍵失敗模式。
Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learning
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05645
Categories: cs.RO
Research Background: End-to-end autonomous driving methods rely on direct state-to-action mappings that capture correlations without explicitly modeling action-conditioned dynamics, while continuous-latent world models struggle with scalability and editing flexibility. 研究背景: 端對端自動駕駛方法依賴直接的狀態到動作映射,在不明確建模動作條件動態的情況下捕捉相關性,而連續潛在世界模型在可擴展性和編輯靈活性上存在困難。
Technical Approach: Discrete-WAM tokenizes both visual observations and ego actions into a unified discrete vocabulary, enabling joint world modeling and policy learning through token prediction and editing. The discrete representation supports compositional world-policy learning and enables interpretable action-conditioned scene editing. 技術方法: Discrete-WAM 將視覺觀察和自我動作都標記化為統一的離散詞彙,透過 token 預測和編輯實現聯合世界建模和策略學習。離散表示支持組合世界策略學習,並實現可解釋的動作條件場景編輯。
Key Takeaway: Unified discrete vision-action tokenization enables compositional world-policy learning for autonomous driving, with interpretable action editing that improves policy transparency. 核心發現: 統一的離散視覺動作標記化使自動駕駛的組合世界策略學習成為可能,可解釋的動作編輯提升策略透明度。
Auditing Demonstration Curation Metrics: Action-Only Scorers Fail on Structural Quality
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05588
Categories: cs.RO
Research Background: Imitation learning policies inherit the quality of their training demonstrations, and automated curation metrics promise to filter low-quality demonstrations — but different metrics validated on different datasets make it unclear which to trust. 研究背景: 模仿學習策略繼承其訓練示範的品質,自動化策劃指標承諾過濾低品質示範——但在不同資料集上驗證的不同指標使人不清楚應信任哪個。
Technical Approach: The paper conducts a systematic audit of existing demonstration curation metrics, testing them on the same demonstration datasets with unified protocols. It reveals that action-only scoring metrics (which evaluate action dynamics in isolation) systematically fail to capture structural demonstration quality — completeness, task success, and motion coherence — that predicts policy performance. 技術方法: 本文對現有示範策劃指標進行系統性審計,使用統一協議在相同示範資料集上測試它們。揭示僅動作評分指標(孤立評估動作動態)系統性地未能捕捉預測策略表現的結構性示範品質——完整性、任務成功和動作連貫性。
Key Takeaway: Action-only demonstration curation metrics are systematically inadequate; effective curation requires metrics that evaluate structural demonstration quality including task completion and motion coherence. 核心發現: 僅動作示範策劃指標系統性地不足;有效策劃需要評估結構性示範品質(包括任務完成和動作連貫性)的指標。
What Objects Enable, Not What They Are: Functional Latent Spaces for Affordance Learning
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05533
Categories: cs.LG, cs.RO
Research Background: Robot planning systems rely on appearance-based object representations that organize latent spaces around visual similarity, but manipulation planning requires reasoning about object functionality — what a cart affords versus what it looks like. 研究背景: 機器人規劃系統依賴以視覺相似性組織潛在空間的基於外觀的物件表示,但操作規劃需要推理物件功能——手推車提供什麼可供性而非它看起來如何。
Technical Approach: The paper proposes functional latent spaces that organize object representations around affordance similarity rather than visual appearance. Contrastive training separates objects that look similar but afford different actions, and groups visually distinct objects that support the same manipulations. The resulting representation improves affordance-conditioned planning. 技術方法: 本文提出功能性潛在空間,以可供性相似性而非視覺外觀組織物件表示。對比訓練分離看起來相似但提供不同動作的物件,並將視覺上不同但支持相同操作的物件分組。所得表示改善了可供性條件規劃。
Key Takeaway: Organizing object latent spaces around affordance functionality rather than visual appearance substantially improves manipulation planning across semantically similar but functionally distinct objects. 核心發現: 以可供性功能而非視覺外觀組織物件潛在空間,在語義相似但功能不同的物件間大幅提升操作規劃效果。
Learning Contact Representation for Leg Odometry
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05501
Categories: cs.RO
Research Background: Legged robot odometry relies on stance-phase foot velocity assumptions that break down without accurate contact detection, making leg phase classification a critical component for state estimation accuracy. 研究背景: 腿式機器人里程計依賴在沒有精確接觸偵測的情況下會失效的站立相腳速度假設,使腿部相位分類成為狀態估計精度的關鍵組件。
Technical Approach: The paper learns a contact representation that encodes rich tactile and kinematic features for accurate leg contact-phase classification. The learned representation captures subtle contact dynamics beyond simple binary contact detection, improving velocity estimation reliability across diverse terrain types. 技術方法: 本文學習一種接觸表示,編碼豐富的觸覺和運動學特徵以實現精確的腿部接觸相位分類。學習的表示捕捉超越簡單二元接觸偵測的微妙接觸動態,提升在多樣地形類型上的速度估計可靠性。
Key Takeaway: Learned contact representations substantially improve legged robot odometry accuracy by capturing rich contact dynamics that simple threshold-based detection misses. 核心發現: 學習的接觸表示透過捕捉簡單閾值偵測遺漏的豐富接觸動態,大幅提升腿式機器人里程計精度。
FlowPRO: Reward-Free Reinforced Fine-Tuning of Flow-Matching VLAs via Proximal Optimization
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05468
Categories: cs.RO
Research Background: Post-training VLA models for reliable real-robot deployment is a major bottleneck — SFT and DAgger only exploit failure signals indirectly, and reward-based RL is bottlenecked by the difficulty of real-world reward design. 研究背景: 對 VLA 模型進行後訓練以實現可靠的真實機器人部署是主要瓶頸——SFT 和 DAgger 只間接利用失敗訊號,而基於獎勵的強化學習受真實世界獎勵設計困難所限制。
Technical Approach: FlowPRO applies proximal policy optimization (PPO-style) to flow-matching VLAs without requiring explicit rewards. It uses the flow model’s own likelihood as an implicit optimization signal, combined with human preference labels from deployment rollouts. The proximal constraint prevents mode collapse while fine-tuning the flow matching trajectory. 技術方法: FlowPRO 對流匹配 VLA 應用近端策略優化(PPO 風格),無需明確獎勵。它使用流模型自身的似然作為隱式優化訊號,結合部署展開中的人類偏好標籤。近端約束在微調流匹配軌跡時防止模式崩潰。
Key Takeaway: Reward-free proximal optimization of flow-matching VLAs achieves substantial deployment performance improvements using only binary success/failure feedback, without designing explicit reward functions. 核心發現: 流匹配 VLA 的無獎勵近端優化僅使用二元成功/失敗反饋即可實現大幅的部署性能改進,無需設計明確的獎勵函數。
Uncertainty-Aware Adaptive Sensor Fusion for Autonomous Navigation
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05437
Categories: cs.RO
Research Background: Visual-inertial odometry for autonomous navigation often fails under challenging conditions (low light, motion blur, degenerate geometry) because static fusion weights cannot adapt to sensor reliability changes. 研究背景: 自動導航的視覺慣性里程計在挑戰性條件下(低光、動態模糊、退化幾何)常常失敗,因為靜態融合權重無法適應感測器可靠性變化。
Technical Approach: The paper combines a Vision Transformer (ViT) for temporal feature extraction with an Unscented Kalman Filter (UKF), using deep uncertainty estimates to adaptively reweight sensor fusion. The ViT learns to predict its own uncertainty, which dynamically adjusts the UKF measurement trust during navigation. 技術方法: 本文結合用於時間特徵提取的視覺 Transformer(ViT)與無跡卡爾曼濾波器(UKF),使用深度不確定性估計自適應地重新加權感測器融合。ViT 學習預測其自身的不確定性,在導航期間動態調整 UKF 測量信任。
Key Takeaway: Uncertainty-aware adaptive sensor fusion enables robust visual-inertial odometry across diverse challenging conditions by dynamically weighting sensor contributions based on estimated reliability. 核心發現: 不確定性感知的自適應感測器融合透過基於估計可靠性動態加權感測器貢獻,在多樣挑戰性條件下實現魯棒的視覺慣性里程計。
Learning from Demonstrations over Riemannian Manifolds using Neural ODEs
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05422
Categories: cs.RO
Research Background: LfD is typically formulated in Euclidean space, but robot state (e.g., orientation) naturally evolves on curved Riemannian manifolds — forcing Euclidean approximations degrades motion quality and violates geometric constraints. 研究背景: LfD 通常在歐幾里德空間中公式化,但機器人狀態(例如方向)自然在彎曲的黎曼流形上演化——強制歐幾里德近似降低動作品質並違反幾何約束。
Technical Approach: The paper extends neural ODE-based imitation learning to Riemannian manifolds, formulating the dynamical system directly on the curved state space. Geodesic distances replace Euclidean distances in the loss, and Riemannian exponential/logarithmic maps handle the manifold arithmetic, enabling geometrically consistent motion learning. 技術方法: 本文將基於神經 ODE 的模仿學習擴展到黎曼流形,直接在彎曲狀態空間上公式化動態系統。測地距離替換損失中的歐幾里德距離,黎曼指數/對數映射處理流形算術,實現幾何一致的動作學習。
Key Takeaway: Riemannian manifold LfD with neural ODEs produces geometrically valid, smooth motions for orientation-sensitive manipulation tasks that Euclidean formulations systematically violate. 核心發現: 帶神經 ODE 的黎曼流形 LfD 為方向敏感的操作任務產生幾何有效、平滑的動作,而歐幾里德公式系統性地違反這一點。
MoDex: A Diffusion Policy for Sequential Multi-Object Dexterous Grasping
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05407
Categories: cs.RO
Research Background: Sequential grasping of multiple objects with a single dexterous hand without releasing previously held objects is a uniquely challenging manipulation problem that existing methods address poorly because they commit all degrees of freedom to a single grasp. 研究背景: 以單一靈巧手在不釋放已持有物件的情況下依序抓握多個物件,是現有方法處理不當的獨特挑戰性操作問題,因為這些方法將所有自由度投入單一抓握。
Technical Approach: MoDex introduces a diffusion policy specifically designed for sequential multi-object grasping, modeling the joint distribution of current grip states and new grasp targets. The policy learns to plan grasps that reserve finger redundancy for subsequent objects, using a diffusion process that conditions on already-held objects. 技術方法: MoDex 引入專為依序多物件抓握設計的擴散策略,對當前握持狀態和新抓握目標的聯合分布建模。策略學習規劃為後續物件保留手指冗餘的抓握,使用以已持有物件為條件的擴散過程。
Key Takeaway: Diffusion-based sequential grasping policies that reason about future grip states achieve robust multi-object dexterous grasping without compromising the stability of previously held objects. 核心發現: 推理未來握持狀態的基於擴散的依序抓握策略,在不影響已持有物件穩定性的情況下實現魯棒的多物件靈巧抓握。
VASO: Formally Verifiable Self-Evolving Skills for Physical AI Agents
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05395
Categories: cs.RO
Research Background: Foundation models have lowered the cost of creating reusable robot skills, but the cost of trusting them has not decreased — skill correctness verification remains manual and does not scale with automated skill generation pipelines. 研究背景: 基礎模型降低了創建可重用機器人技能的成本,但信任它們的成本並未降低——技能正確性驗證仍然是手動的,且不能隨自動化技能生成流程擴展。
Technical Approach: VASO introduces a self-evolving skill framework that automatically generates skills and simultaneously produces formal verification proofs of their correctness. The system iteratively improves skills while maintaining verifiable invariants, using symbolic execution and model checking to certify that generated skills satisfy specified pre/post-conditions. 技術方法: VASO 引入自我演化技能框架,自動生成技能並同時產生其正確性的形式驗證證明。系統在保持可驗證不變量的同時迭代改進技能,使用符號執行和模型檢查來認證生成的技能滿足指定的前/後置條件。
Key Takeaway: Automated formal verification of generated skills enables scalable trusted physical AI skill libraries, where each skill comes with a machine-checkable correctness certificate. 核心發現: 生成技能的自動形式驗證實現可擴展的可信物理 AI 技能庫,每個技能都附有機器可檢查的正確性證明。
GRAIL: Generating Humanoid Loco-Manipulation from 3D Assets and Video Priors
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05160
Categories: cs.RO
Research Background: Scaling humanoid loco-manipulation requires robot-compatible demonstrations across diverse objects and motions, but teleoperation and motion capture are difficult to scale due to physical setup requirements. 研究背景: 擴展人形機器人移動操作需要跨多樣物件和動作的機器人相容示範,但遠端操作和動作捕捉因物理設置要求難以擴展。
Technical Approach: GRAIL generates humanoid loco-manipulation demonstrations from 3D object assets and human video priors, automatically producing physically valid whole-body robot motion sequences. The system uses a retargeting pipeline from video-extracted human motion combined with 3D object geometry constraints to synthesize diverse training demonstrations at scale. 技術方法: GRAIL 從 3D 物件資產和人類影片先驗生成人形機器人移動操作示範,自動產生物理有效的全身機器人動作序列。系統使用從影片提取的人類動作結合 3D 物件幾何約束的重定向流程,大規模合成多樣訓練示範。
Key Takeaway: Generating humanoid loco-manipulation demonstrations from 3D assets and video priors scales training data production by orders of magnitude, enabling policies that generalize across diverse object categories. 核心發現: 從 3D 資產和影片先驗生成人形機器人移動操作示範,將訓練資料生產規模擴大數個數量級,實現跨多樣物件類別泛化的策略。
HORIZON: Recoverability-Governed Curriculum for Physical-Domain Scaling
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05143
Categories: cs.RO
Research Background: Scaling robust robot policies requires broader physical-domain randomization, but random curriculum progression often exposes agents to physics variations too difficult to recover from, making training unstable. 研究背景: 擴展魯棒機器人策略需要更廣泛的物理領域隨機化,但隨機課程進展常常使智能體暴露於過難以恢復的物理變化中,使訓練不穩定。
Technical Approach: HORIZON uses recoverability as the central constraint for curriculum progression: harder physics parameters are only introduced when the current policy demonstrates sufficient recovery ability from perturbations at its current difficulty level. A recoverability oracle measures how often the policy can return to a target state from challenging conditions. 技術方法: HORIZON 使用可恢復性作為課程進展的核心約束:只有當前策略在其當前難度級別顯示出足夠的擾動恢復能力時,才引入更困難的物理參數。可恢復性預言機測量策略能夠從挑戰性條件返回目標狀態的頻率。
Key Takeaway: Recoverability-governed curriculum progression enables stable physical-domain scaling, producing substantially more robust robot locomotion policies than randomization-based curricula. 核心發現: 可恢復性管控的課程進展實現穩定的物理領域擴展,產生比基於隨機化的課程顯著更魯棒的機器人運動策略。
Generalization of World Models under Environmental Variability for Vision-Based Robots
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05015
Categories: cs.RO
Research Background: World models for robot learning are a promising tool for sample efficiency, but their robustness to environmental variability — lighting, textures, object pose changes — remains poorly characterized, limiting deployment confidence. 研究背景: 機器人學習的世界模型是樣本效率的有前景工具,但它們對環境變異性——光照、紋理、物件姿態變化——的魯棒性仍然特徵不明確,限制了部署信心。
Technical Approach: The paper conducts a systematic study of world model generalization using vision-based quadrotor navigation as a testbed, varying visual appearance, scene complexity, and physics parameters independently. It identifies which types of environmental variability most degrade world model accuracy and proposes targeted augmentation strategies. 技術方法: 本文以基於視覺的四旋翼無人機導航為測試平台,對世界模型泛化進行系統性研究,獨立變化視覺外觀、場景複雜度和物理參數。識別哪些類型的環境變異性最降低世界模型精度,並提出有針對性的增強策略。
Key Takeaway: Visual appearance changes are the dominant source of world model degradation, while physics variation is more easily handled — targeted visual augmentation restores most generalization performance. 核心發現: 視覺外觀變化是世界模型退化的主要來源,而物理變化更容易處理——有針對性的視覺增強恢復了大部分泛化性能。
Flash-WAM: Modality-Aware Distillation for World Action Models
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05254
Categories: cs.LG, cs.RO
Research Background: World-action models that jointly generate future video and robot actions through iterative diffusion achieve strong manipulation performance but require tens of denoising steps — too slow for real-time robot control. 研究背景: 透過迭代擴散聯合生成未來影片和機器人動作的世界動作模型達到強大的操作表現,但需要數十個去噪步驟——對即時機器人控制過慢。
Technical Approach: Flash-WAM introduces modality-aware distillation that separately handles video and action modalities during step distillation. Standard step distillation degrades both modalities equally, but Flash-WAM recognizes that action prediction is more sensitive to distillation than video generation and uses modality-specific learning rates and loss weighting. 技術方法: Flash-WAM 引入模態感知蒸餾,在步驟蒸餾期間分別處理影片和動作模態。標準步驟蒸餾同等降低兩種模態,但 Flash-WAM 認識到動作預測比影片生成對蒸餾更敏感,並使用模態特定的學習率和損失加權。
Key Takeaway: Modality-aware distillation reduces world-action model inference to 1-2 steps while preserving action prediction quality, enabling real-time control with world model generalization. 核心發現: 模態感知蒸餾將世界動作模型推理減少到 1-2 步,同時保持動作預測品質,實現具有世界模型泛化的即時控制。
Potential-Guided Flow Matching for Vision-Language-Action Policy Improvement
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04968
Categories: cs.RO
Research Background: Large VLA policies trained as conditional generative models encounter deployment experience of mixed quality — successful demos, partial completions, recoverable mistakes, and failures — but standard imitation learning cannot effectively use this heterogeneous experience. 研究背景: 作為條件生成模型訓練的大型 VLA 策略,在部署中遇到混合品質的經驗——成功示範、部分完成、可恢復錯誤和失敗——但標準模仿學習無法有效利用這種異質經驗。
Technical Approach: This paper introduces potential-guided flow matching that uses a learned potential function to steer the flow matching trajectory toward high-quality action regions. The potential function is trained to predict trajectory quality from deployment rollouts, providing a differentiable guidance signal that improves flow matching convergence toward successful outcomes. 技術方法: 本文引入潛力引導流匹配,使用學習的潛力函數引導流匹配軌跡朝向高品質動作區域。潛力函數訓練為從部署展開預測軌跡品質,提供可微的引導訊號,改善流匹配收斂到成功結果。
Key Takeaway: Potential-guided flow matching effectively leverages mixed-quality deployment experience to substantially improve VLA policy performance without requiring clean reward signals. 核心發現: 潛力引導流匹配有效利用混合品質的部署經驗,大幅提升 VLA 策略表現,無需乾淨的獎勵訊號。
WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04907
Categories: cs.RO
Research Background: Reactive visual navigation policies that directly map observations to actions lack anticipatory reasoning, limiting their ability to proactively avoid obstacles and plan smooth, collision-free trajectories. 研究背景: 直接將觀察映射到動作的反應式視覺導航策略缺乏預測推理,限制了其主動避障和規劃平滑無碰撞軌跡的能力。
Technical Approach: WAM-Nav introduces asymmetric latent world-action modeling where the world model and action model share latent features but have asymmetric architectures optimized for their respective tasks. The world model provides future scene prediction that informs the action model’s anticipatory planning, unified in a single end-to-end framework. 技術方法: WAM-Nav 引入不對稱潛在世界動作建模,世界模型和動作模型共享潛在特徵,但具有針對各自任務優化的不對稱架構。世界模型提供未來場景預測,為動作模型的預測規劃提供信息,統一在單一端對端框架中。
Key Takeaway: Asymmetric world-action latent modeling enables proactive obstacle avoidance and smooth trajectory planning in visual navigation by providing structured future predictions to guide action selection. 核心發現: 不對稱世界動作潛在建模透過提供結構化的未來預測引導動作選擇,在視覺導航中實現主動避障和平滑軌跡規劃。
D³-MoE: Dual Disentangled Diffusion Mixture-of-Experts for Style-Controllable Locomotion
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04884
Categories: cs.RO
Research Background: End-to-end robot locomotion policies trained on high-variance human demonstrations suffer from “style averaging” — the policy learns a mean behavior that matches no individual driving style, producing homogenized outputs with poor style control. 研究背景: 在高方差人類示範上訓練的端對端機器人運動策略受「風格平均」困擾——策略學習匹配任何個人駕駛風格的均值行為,產生均質化輸出且風格控制差。
Technical Approach: D³-MoE uses a dual disentangled diffusion process with a Mixture-of-Experts architecture that separates style modeling from locomotion dynamics. Each expert specializes in a distinct motion style cluster, and a style-conditioned gating network selects the appropriate expert based on user preference or context, enabling controllable style transitions. 技術方法: D³-MoE 使用帶混合專家架構的雙重解耦擴散過程,將風格建模與運動動態分離。每個專家專門處理不同的動作風格集群,風格條件閘控網路根據用戶偏好或上下文選擇適當的專家,實現可控的風格轉換。
Key Takeaway: Dual disentangled diffusion with mixture-of-experts enables fine-grained style-controllable robot locomotion without compromising kinematic safety or motion quality. 核心發現: 帶混合專家的雙重解耦擴散實現細粒度風格可控的機器人運動,不影響運動學安全性或動作品質。
SENTINEL: Uncertainty-Aware SLAM — Teaching Robots to Say ‘I Don’t Know’
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04853
Categories: cs.RO
Research Background: Low-cost 2D LiDARs lack the intensity channel used by higher-end sensors to diagnose measurement failures, yet are widely deployed on budget robotics platforms where reliable SLAM is still required. 研究背景: 低成本 2D 激光雷達缺乏高端感測器用於診斷測量失敗的強度通道,但廣泛部署在仍需要可靠 SLAM 的預算機器人平台上。
Technical Approach: SENTINEL is a training-free, label-free reliability estimation framework that gives range-only LiDAR an effective uncertainty signal without requiring model training. It uses geometric consistency checks and scan-to-scan coherence metrics to flag unreliable measurements in real-time, enabling the SLAM system to gracefully handle poor-quality scans. 技術方法: SENTINEL 是一種無需訓練、無需標籤的可靠性估計框架,為僅測距激光雷達提供有效的不確定性訊號,無需模型訓練。它使用幾何一致性檢查和掃描到掃描連貫性指標即時標記不可靠的測量,使 SLAM 系統能優雅地處理低品質掃描。
Key Takeaway: Training-free geometric consistency checks enable budget 2D LiDARs to reliably detect and flag measurement failures, significantly improving SLAM robustness on low-cost robot platforms. 核心發現: 無需訓練的幾何一致性檢查使預算 2D 激光雷達能可靠偵測並標記測量失敗,在低成本機器人平台上顯著提升 SLAM 魯棒性。
M3imic: Learning a Versatile Whole-Body Controller for Multimodal Motion Mimicking
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04829
Categories: cs.RO
Research Background: Humanoid whole-body controllers require different motion reference modalities for different tasks — locomotion uses trajectory references while loco-manipulation uses object interaction references — but existing controllers specialize in a single modality. 研究背景: 人形機器人全身控制器對不同任務需要不同的動作參考模態——運動使用軌跡參考而移動操作使用物件互動參考——但現有控制器專門處理單一模態。
Technical Approach: M3imic trains a versatile whole-body controller that handles multiple motion reference modalities through a shared control backbone with modality-specific conditioning. The controller unifies locomotion, loco-manipulation, and motion imitation under a single policy by learning modality-aware feature extraction and mode-switching mechanisms. 技術方法: M3imic 透過帶模態特定條件的共享控制骨幹,訓練處理多種動作參考模態的多功能全身控制器。控制器透過學習模態感知特徵提取和模式切換機制,在單一策略下統一運動、移動操作和動作模仿。
Key Takeaway: A single versatile whole-body controller trained on multimodal motion references achieves competitive performance across diverse humanoid tasks compared to specialized single-modality controllers. 核心發現: 在多模態動作參考上訓練的單一多功能全身控制器,在多樣人形機器人任務中實現與專門的單模態控制器相當的競爭性表現。
HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Manipulation
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04825
Categories: cs.RO
Research Background: Despite the importance of tactile sensing for reliable manipulation, most VLA datasets remain vision-only and those that do include tactile signals lack the combined diversity of tasks, language conditioning, and action trajectories needed for general contact-rich manipulation. 研究背景: 儘管觸覺感測對可靠操作很重要,大多數 VLA 資料集仍然僅依賴視覺,而那些包含觸覺訊號的資料集缺乏通用接觸豐富操作所需的任務、語言條件和動作軌跡的組合多樣性。
Technical Approach: HapTile introduces a large-scale dataset combining haptic force feedback, tactile sensing, RGB vision, language instructions, and robot action trajectories across diverse contact-rich manipulation tasks. The dataset uses a custom haptic-enabled end-effector to simultaneously capture vision, tactile, and force signals during demonstrations. 技術方法: HapTile 引入結合觸覺力反饋、觸覺感測、RGB 視覺、語言指令和機器人動作軌跡的大規模資料集,跨越多樣的接觸豐富操作任務。資料集使用定制的觸覺啟用末端執行器在示範期間同時捕捉視覺、觸覺和力訊號。
Key Takeaway: HapTile establishes a benchmark for vision-tactile-haptic VLA training, showing that multi-modal tactile data substantially improves contact-rich manipulation success over vision-only baselines. 核心發現: HapTile 建立了視覺觸覺 VLA 訓練的基準,顯示多模態觸覺資料相比僅視覺基線大幅提升接觸豐富操作的成功率。
Inverse Manipulation through Symbolic Planning and Residual Operator Learning
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05248
Categories: cs.RO
Research Background: Inverting a robotic manipulation task — undoing a previous action — requires more than reversing symbolic state transitions or rewinding motor trajectories, because continuous interaction dynamics make simple inversion infeasible. 研究背景: 逆轉機器人操作任務——撤銷先前的動作——需要不僅僅是逆轉符號狀態轉換或倒放電機軌跡,因為連續互動動態使簡單逆轉不可行。
Technical Approach: GTP-FA presents a hybrid inverse manipulation framework: a symbolic planner generates inverse action sequences, and a residual operator learning module compensates for continuous dynamics effects that symbolic inversion misses. The residual module is trained from forward execution data to predict the corrections needed for successful inverse manipulation. 技術方法: GTP-FA 提出混合逆向操作框架:符號規劃器生成逆向動作序列,殘差算子學習模塊補償符號逆轉遺漏的連續動態效應。殘差模塊從前向執行資料訓練,以預測成功逆向操作所需的修正。
Key Takeaway: Combining symbolic inverse planning with learned residual corrections enables reliable robot task reversal despite continuous dynamics effects that purely symbolic approaches cannot handle. 核心發現: 結合符號逆向規劃與學習的殘差修正,儘管存在純符號方法無法處理的連續動態效應,仍能實現可靠的機器人任務逆轉。
SoftPINCH: EMG-Driven Soft Exoskeleton for Finger Flexion and Grasping Assistance
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04776
Categories: cs.RO
Research Background: EMG-driven hand exoskeletons for grasp assistance face reliability challenges because sEMG signals are noisy, sensitive to electrode placement, and affected by muscle fatigue — limiting clinical and daily-use deployability. 研究背景: 用於抓握輔助的 EMG 驅動手部外骨骼面臨可靠性挑戰,因為 sEMG 訊號嘈雜、對電極位置敏感且受肌肉疲勞影響——限制了臨床和日常使用的部署性。
Technical Approach: SoftPINCH combines a soft pneumatic exoskeleton actuator with an EMG signal processing pipeline that uses adaptive filtering to handle noise and fatigue-related signal drift. An intent-detection module translates processed EMG into pinch grasp commands with adjustable sensitivity thresholds for different users. 技術方法: SoftPINCH 結合軟氣動外骨骼驅動器與 EMG 訊號處理流水線,使用自適應濾波器處理噪聲和疲勞相關的訊號漂移。意圖偵測模塊將處理後的 EMG 轉換為捏合抓握指令,具有針對不同用戶的可調靈敏度閾值。
Key Takeaway: Adaptive EMG signal processing with a soft pneumatic exoskeleton enables reliable grasp assistance across users with varying muscle fatigue and electrode placement conditions. 核心發現: 帶軟氣動外骨骼的自適應 EMG 訊號處理,在不同肌肉疲勞和電極放置條件的用戶間實現可靠的抓握輔助。
CoRe-MoE: Contrastive Reweighted Mixture of Experts for Multi-Terrain Humanoid Locomotion
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04718
Categories: cs.RO, cs.AI
Research Background: Humanoid robots need to smoothly transition between walking and running across diverse terrain types, but existing approaches either specialize in one gait or learn a blended average that is neither natural nor efficient. 研究背景: 人形機器人需要在多樣地形類型上平滑地在行走和奔跑之間切換,但現有方法要麼專門處理一種步態,要麼學習既不自然也不高效的混合平均。
Technical Approach: CoRe-MoE uses a Mixture-of-Experts architecture with contrastive reweighting to learn distinct gait expert policies that activate based on terrain context. Contrastive learning separates gait representations across terrain types, while the MoE gating network learns to smoothly blend or transition between experts based on terrain features and velocity targets. 技術方法: CoRe-MoE 使用帶對比重新加權的混合專家架構,學習基於地形上下文激活的不同步態專家策略。對比學習在地形類型間分離步態表示,而 MoE 閘控網路學習根據地形特徵和速度目標平滑混合或在專家間切換。
Key Takeaway: Contrastive reweighted mixture-of-experts achieves natural gait transitions across terrain types for humanoid locomotion, with each gait mode specializing appropriately without training interference. 核心發現: 對比重新加權混合專家為人形機器人運動實現跨地形類型的自然步態切換,每種步態模式在沒有訓練干擾的情況下適當專門化。
TransTac: Visuo-Tactile Modality Transition via Ultraviolet-Encoded Transparent Sensor
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04477
Categories: cs.RO
Research Background: Vision-based tactile sensors (VBTS) provide high-resolution contact geometry but require opaque elastomers that block visual transparency, while RGB-D cameras provide global depth but degrade at close range — creating a coverage gap in robot manipulation perception. 研究背景: 視覺觸覺感測器(VBTS)提供高解析度接觸幾何但需要阻擋視覺透明度的不透明彈性體,而 RGB-D 相機提供全局深度但在近距離退化——在機器人操作感知中造成覆蓋差距。
Technical Approach: TransTac introduces ultraviolet-encoded transparent tactile sensing that allows simultaneous visual and tactile observation through the same sensor. UV-reactive patterns embedded in a transparent elastomer make contact patterns visible under UV illumination while remaining optically transparent under normal lighting, enabling a single sensor to provide both modalities. 技術方法: TransTac 引入紫外線編碼的透明觸覺感測,允許透過同一感測器同時進行視覺和觸覺觀察。嵌入透明彈性體的 UV 反應模式在 UV 照明下使接觸模式可見,同時在正常照明下保持光學透明,使單一感測器提供兩種模態。
Key Takeaway: UV-encoded transparent tactile sensors bridge the vision-tactile coverage gap in robot manipulation by enabling simultaneous contact sensing and unobstructed visual observation. 核心發現: UV 編碼的透明觸覺感測器透過實現同時接觸感測和不受阻礙的視覺觀察,橋接機器人操作中的視覺觸覺覆蓋差距。
OSCAR: Omni-Embodiment Action-Conditioned World Model for Robotics
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04463
Categories: cs.RO
Research Background: Video world models for robot policy evaluation face three main challenges: limited scenario diversity in training data, embodiment-specificity that prevents cross-robot generalization, and inaccurate action conditioning that misrepresents the effects of robot actions. 研究背景: 用於機器人策略評估的影片世界模型面臨三個主要挑戰:訓練資料中的場景多樣性有限、阻止跨機器人泛化的具身特異性,以及錯誤表示機器人動作效果的不精確動作條件。
Technical Approach: OSCAR introduces an omni-embodiment world model that generalizes across diverse robot morphologies and action spaces. It uses a unified action-conditioning mechanism that maps different robot action formats into a shared latent action space, and is trained on a large-scale multi-robot manipulation dataset to enable broad scenario diversity. 技術方法: OSCAR 引入跨多樣機器人型態和動作空間泛化的全具身世界模型。它使用統一的動作條件機制,將不同的機器人動作格式映射到共享的潛在動作空間,並在大規模多機器人操作資料集上訓練以實現廣泛的場景多樣性。
Key Takeaway: Omni-embodiment action-conditioned world models enable precise robot policy evaluation across diverse morphologies and scenarios without requiring embodiment-specific training. 核心發現: 全具身動作條件世界模型在不需要具身特定訓練的情況下,實現跨多樣型態和場景的精確機器人策略評估。
3DThinkVLA: Endowing VLA Models with Latent 3D Priors via 3D-Guided Co-Training
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04436
Categories: cs.CV, cs.RO
Research Background: VLA models operating from 2D images lack explicit 3D spatial understanding, which is critical for precise manipulation — actions need 3D geometry reasoning that 2D foundation model backbones do not inherently provide. 研究背景: 從 2D 圖像操作的 VLA 模型缺乏明確的 3D 空間理解,這對精確操作至關重要——動作需要 2D 基礎模型骨幹本身不提供的 3D 幾何推理。
Technical Approach: 3DThinkVLA introduces a 3D-thinking-guided co-training framework that disentangles 3D geometry perception from 3D spatial reasoning and trains both capabilities jointly with the VLA action prediction. Latent 3D priors are injected into the VLA via a co-training objective that forces the model to implicitly reason in 3D during action prediction. 技術方法: 3DThinkVLA 引入 3D 思維引導的聯合訓練框架,解耦 3D 幾何感知與 3D 空間推理,並將兩種能力與 VLA 動作預測聯合訓練。潛在 3D 先驗透過迫使模型在動作預測期間隱式地在 3D 中推理的聯合訓練目標注入到 VLA 中。
Key Takeaway: 3D-guided co-training endows VLA models with implicit 3D spatial reasoning that substantially improves manipulation precision without requiring explicit 3D sensors at deployment. 核心發現: 3D 引導的聯合訓練使 VLA 模型具備隱式 3D 空間推理,在部署時不需要明確的 3D 感測器的情況下大幅提升操作精度。
Think Fast and Far: Long-Horizon Online POMDP Planning via Rapid State Sampling
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04355
Categories: cs.RO
Research Background: POMDPs provide a principled framework for robot motion planning under uncertainty, but long-horizon POMDPs remain computationally intractable for real-time robot applications due to the belief-space explosion. 研究背景: POMDP 為不確定性下的機器人動作規劃提供有原則的框架,但長時域 POMDP 因信念空間爆炸對即時機器人應用在計算上仍然難以處理。
Technical Approach: This paper proposes rapid belief-state sampling for online POMDP planning, using learned importance weights to focus computational resources on high-probability belief regions. A neural sampler predicts which belief particles are most relevant for long-horizon planning, enabling effective approximation of the belief distribution with orders of magnitude fewer particles. 技術方法: 本文提出用於在線 POMDP 規劃的快速信念狀態採樣,使用學習的重要性權重將計算資源集中在高概率信念區域。神經採樣器預測哪些信念粒子對長時域規劃最相關,用少幾個數量級的粒子實現信念分布的有效近似。
Key Takeaway: Learned importance-weighted belief sampling makes long-horizon POMDP planning tractable for real-time robot applications by focusing computation on the most relevant belief states. 核心發現: 學習的重要性加權信念採樣透過將計算集中在最相關的信念狀態,使長時域 POMDP 規劃對即時機器人應用可處理。
OLIVE: Online Low-Rank Incremental Learning for Efficient Adaptive Exoskeletons
Authors: (multiple authors) | Submitted: 2026-06-03 | arXiv: 2606.05234
Categories: cs.RO
Research Background: Wearable exoskeleton controllers that use static gait policies cannot adapt to individual user characteristics or dynamic real-world environments, limiting their effectiveness for mobility assistance. 研究背景: 使用靜態步態策略的可穿戴外骨骼控制器無法適應個別用戶特性或動態真實世界環境,限制了其行動輔助的效果。
Technical Approach: OLIVE uses online low-rank incremental learning to continuously update the exoskeleton controller based on real-time user feedback and biomechanical signals. Low-rank updates prevent catastrophic forgetting while allowing the controller to specialize to the current user’s gait patterns and activity context. 技術方法: OLIVE 使用在線低秩增量學習,根據即時用戶反饋和生物力學訊號持續更新外骨骼控制器。低秩更新防止災難性遺忘,同時允許控制器專門化於當前用戶的步態模式和活動上下文。
Key Takeaway: Online low-rank incremental learning enables exoskeletons to continuously personalize their assistance to individual users without forgetting prior learned behaviors. 核心發現: 在線低秩增量學習使外骨骼能夠持續個性化輔助個別用戶,且不遺忘先前學習的行為。
Reinforcement Learning from Rich Feedback with Distributional DAgger
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05152
Categories: cs.LG, cs.RO
Research Background: Dominant RL-from-feedback recipes reward each response with a single binary signal (correct/incorrect), but many settings — including robot manipulation — provide richer feedback that current methods fail to exploit. 研究背景: 主流的基於反饋的強化學習方法用單一二元訊號(正確/錯誤)獎勵每個回應,但許多設置——包括機器人操作——提供當前方法未能利用的更豐富反饋。
Technical Approach: Distributional DAgger extends DAgger with a distributional feedback model that learns from dense, multi-dimensional feedback signals (e.g., partial credit, trajectory quality scores, physics constraint violations). The distributional model enables richer reward shaping that better guides policy improvement toward desired behaviors. 技術方法: Distributional DAgger 擴展 DAgger,帶有從密集、多維反饋訊號(如部分分數、軌跡品質分數、物理約束違規)學習的分布式反饋模型。分布式模型實現更豐富的獎勵塑形,更好地引導策略改進朝向期望的行為。
Key Takeaway: Distributional feedback modeling in DAgger-style learning leverages rich multi-dimensional feedback to achieve substantially faster policy improvement than binary reward approaches. 核心發現: DAgger 風格學習中的分布式反饋建模利用豐富的多維反饋,實現比二元獎勵方法顯著更快的策略改進。
Robust Scene Transfer for PointGoal Navigation via Privileged Sensor Guidance
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.05506
Categories: cs.CV, cs.RO
Research Background: Visual representation learning for embodied PointGoal navigation needs to generalize across visually diverse scenes, but standard contrastive approaches create representations that overfit to training environment appearance. 研究背景: 具身目標點導航的視覺表示學習需要跨視覺多樣場景泛化,但標準對比方法創建過度擬合訓練環境外觀的表示。
Technical Approach: This paper uses privileged LiDAR sensing during training to create geometry-aware contrastive objectives that guide RGB visual representations toward geometric structure. During deployment, only RGB input is required; the LiDAR guidance is used only during training to instill geometry-aware visual features. 技術方法: 本文在訓練期間使用特權激光雷達感測,創建幾何感知的對比目標,引導 RGB 視覺表示朝向幾何結構。在部署期間,只需要 RGB 輸入;激光雷達引導僅在訓練期間使用,以灌輸幾何感知的視覺特徵。
Key Takeaway: Privileged LiDAR guidance during training creates geometry-aware visual representations that transfer robustly across diverse scenes for PointGoal navigation without requiring LiDAR at deployment. 核心發現: 訓練期間的特權激光雷達引導創建幾何感知的視覺表示,在部署時不需要激光雷達的情況下,在多樣場景間魯棒地遷移用於目標點導航。
Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04811
Categories: cs.CV, cs.RO
Research Background: Video generation models produce visually compelling content but their outputs remain in the virtual domain — it is unclear how well their generated manipulation videos reflect the physical constraints that real robot execution must satisfy. 研究背景: 影片生成模型產生視覺上引人注目的內容,但其輸出仍在虛擬領域——不清楚其生成的操作影片在多大程度上反映了真實機器人執行必須滿足的物理約束。
Technical Approach: Dream.exe systematically evaluates video generation models on their ability to produce physically executable robot manipulation videos. Generated videos are physically parsed for action executability — whether the depicted actions are kinematically feasible, collision-free, and produce the stated manipulation outcomes — and compared against robot execution results. 技術方法: Dream.exe 系統性地評估影片生成模型產生物理可執行機器人操作影片的能力。生成的影片從動作可執行性——所描述的動作是否在運動學上可行、無碰撞並產生所述操作結果——進行物理解析,並與機器人執行結果比較。
Key Takeaway: Current video generation models produce visually plausible but physically inconsistent manipulation videos; closing this gap requires explicit physical grounding in the generation process. 核心發現: 當前影片生成模型產生視覺上合理但物理上不一致的操作影片;縮小這一差距需要在生成過程中明確的物理接地。
Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04269
Categories: cs.RO
Research Background: Deformable object manipulation (DOM) is uniquely challenging due to high-dimensional, partially observable states that evolve through long-horizon, topology-changing interactions with multiple valid manipulation modes. 研究背景: 可變形物件操作(DOM)因高維、部分可觀察的狀態在長時域、拓撲變化的互動中演化,具有多種有效操作模式,而獨特地具有挑戰性。
Technical Approach: Instant-Fold introduces in-context imitation learning for DOM: given a single demonstration video, the model adapts its policy in-context without gradient updates. A transformer-based architecture encodes the demonstration as context and conditions action prediction on it, enabling one-shot adaptation to new folding configurations. 技術方法: Instant-Fold 引入 DOM 的上下文模仿學習:給定單個示範影片,模型無需梯度更新即可在上下文中調整其策略。基於 transformer 的架構將示範編碼為上下文並以此為條件進行動作預測,實現對新折疊配置的一次性適應。
Key Takeaway: In-context imitation learning enables one-shot adaptation to new deformable object configurations without gradient updates, making DOM policies deployable across diverse folding tasks from a single demonstration. 核心發現: 上下文模仿學習使 DOM 策略無需梯度更新即可一次性適應新的可變形物件配置,使策略從單一示範可跨多樣折疊任務部署。
What Are We Actually Benchmarking in Robot Manipulation?
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04233
Categories: cs.RO
Research Background: Robotics benchmark scores are routinely treated as evidence of general manipulation capability, but systematic issues — shortcut solvability, limited evaluation coverage, and metric-performance gaps — may mean these scores do not reflect true generalization. 研究背景: 機器人基準測試分數通常被視為通用操作能力的證據,但系統性問題——捷徑可解性、有限的評估覆蓋和指標表現差距——可能意味著這些分數不反映真正的泛化能力。
Technical Approach: The paper conducts a systematic examination of robot manipulation benchmarks, identifying four failure modes: shortcut solvability (tasks solvable by simple heuristics), limited visual diversity, narrow task distributions, and metric-performance misalignment. It proposes diagnostic criteria for benchmark validity and suggests evaluation protocol improvements. 技術方法: 本文系統性地檢查機器人操作基準測試,識別四種失敗模式:捷徑可解性(可被簡單啟發式解決的任務)、有限的視覺多樣性、狹窄的任務分布和指標表現不對齊。提出基準有效性的診斷標準並建議評估協議改進。
Key Takeaway: Current robot manipulation benchmarks systematically overestimate capability due to shortcut solvability and narrow distributions; rigorous benchmark design requires explicit testing for these failure modes. 核心發現: 由於捷徑可解性和狹窄分布,當前機器人操作基準測試系統性地高估能力;嚴格的基準設計需要明確測試這些失敗模式。
PerceptTwin: Semantic Scene Reconstruction for Iterative LLM Planning and Verification
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04226
Categories: cs.RO
Research Background: Creating simulation environments for robot policy learning and planning verification traditionally requires manual setup per environment — a process that fails to scale to the diversity of real-world deployment scenarios. 研究背景: 為機器人策略學習和規劃驗證創建模擬環境傳統上需要每個環境的手動設置——這個過程無法擴展到真實世界部署場景的多樣性。
Technical Approach: PerceptTwin automatically reconstructs a semantic simulation twin from RGB-D observations using object detection, semantic segmentation, and 3D reconstruction. The reconstructed scene is then used by an LLM planner in an iterative loop where the planner generates action plans, simulates them in the twin, and refines based on execution verification. 技術方法: PerceptTwin 使用物件偵測、語義分割和 3D 重建,從 RGB-D 觀察自動重建語義模擬孿生。重建的場景接著被 LLM 規劃器在迭代循環中使用,規劃器生成動作計劃、在孿生中模擬並根據執行驗證進行精化。
Key Takeaway: Automatic semantic scene reconstruction enables scalable LLM-guided robot planning with simulation verification, without requiring manual environment modeling for each deployment scenario. 核心發現: 自動語義場景重建使可擴展的 LLM 引導機器人規劃帶模擬驗證成為可能,無需對每個部署場景進行手動環境建模。
DLO-Lab: Benchmarking Deformable Linear Object Manipulations
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04206
Categories: cs.RO
Research Background: Deformable linear object (DLO) manipulation — handling ropes, cables, and elastic bands — is an important robotic skill but lacks standardized benchmarks, making progress comparison across methods difficult. 研究背景: 可變形線性物件(DLO)操作——處理繩索、纜線和橡皮筋——是重要的機器人技能,但缺乏標準化基準,使跨方法的進度比較困難。
Technical Approach: DLO-Lab introduces a differentiable simulation benchmark for deformable linear object manipulation with standardized task suites (routing, knotting, loop formation, cable following). The differentiable simulator enables gradient-based policy optimization, and the benchmark provides fair comparison metrics across diverse DLO manipulation methods. 技術方法: DLO-Lab 引入帶標準化任務套件(路由、打結、環形成、纜線跟隨)的可微分模擬基準用於可變形線性物件操作。可微分模擬器支持基於梯度的策略優化,基準提供跨多樣 DLO 操作方法的公平比較指標。
Key Takeaway: A standardized differentiable DLO manipulation benchmark enables fair cross-method comparison and gradient-based policy optimization, accelerating progress in this underexplored manipulation domain. 核心發現: 標準化的可微分 DLO 操作基準實現公平的跨方法比較和基於梯度的策略優化,加速這個未充分探索的操作領域的進展。
Dual Advantage Fields for RL in Robot Learning
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04188
Categories: cs.LG
Research Background: Offline goal-conditioned RL requires both long-horizon reachability estimates (to know if a goal is achievable) and local action comparison (to know which action to take), but existing methods conflate these two distinct requirements. 研究背景: 離線目標條件強化學習需要長時域可達性估計(以知道目標是否可實現)和局部動作比較(以知道採取哪個動作),但現有方法混淆這兩個不同需求。
Technical Approach: Dual Advantage Fields introduces separate value fields: a reachability field capturing long-horizon goal connectivity, and an advantage field providing local action comparison. The dual representation allows each component to specialize, improving both planning horizon and action selection compared to unified value functions. 技術方法: Dual Advantage Fields 引入獨立的值域:捕捉長時域目標連接性的可達性域,和提供局部動作比較的優勢域。雙重表示允許每個組件專門化,相比統一的值函數改善規劃時域和動作選擇。
Key Takeaway: Separating reachability estimation from local action advantage enables substantially better offline goal-conditioned RL, particularly for tasks requiring long planning horizons. 核心發現: 將可達性估計與局部動作優勢分離,實現顯著更好的離線目標條件強化學習,特別是對需要長規劃時域的任務。
Distribution-Free Risk-Aware Planning and Control Under Uncertainty
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04185
Categories: cs.RO
Research Background: Safe robot navigation under uncertainty typically assumes knowledge of the uncertainty distribution, but in practice distributions are hard to characterize accurately from limited data or imperfect sensors. 研究背景: 不確定性下的安全機器人導航通常假設知道不確定性分布,但實際上從有限資料或不完美感測器難以準確表征分布。
Technical Approach: This paper uses conformal prediction to provide distribution-free risk-aware planning and control guarantees. The approach wraps arbitrary prediction models with conformal sets that contain the true trajectory with high probability, and integrates these sets into control barrier functions for provably safe navigation without distributional assumptions. 技術方法: 本文使用共形預測提供無分布的風險感知規劃和控制保證。方法用以高概率包含真實軌跡的共形集包裝任意預測模型,並將這些集合整合到控制屏障函數中,在沒有分布假設的情況下實現可證明安全的導航。
Key Takeaway: Conformal prediction provides distribution-free safety guarantees for robot navigation, making risk-aware planning practical even when true uncertainty distributions are unknown. 核心發現: 共形預測為機器人導航提供無分布的安全保證,即使在真實不確定性分布未知的情況下也使風險感知規劃切實可行。
Affordance2Action: Task-Conditioned Scene-Level Affordance Grounding for Real-Time Manipulation
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04172
Categories: cs.RO
Research Background: Task-conditioned manipulation requires grounding instructions to functional object parts rather than object categories — the same object may afford different interactions depending on the task, requiring dynamic affordance understanding. 研究背景: 任務條件操作需要將指令接地到功能性物件部件而非物件類別——同一物件可能根據任務提供不同的互動,需要動態的可供性理解。
Technical Approach: Affordance2Action performs task-conditioned scene-level affordance grounding that identifies which object regions are relevant for the specified task in cluttered scenes. An attention mechanism grounds task descriptions to 3D point cloud regions, and the grounded affordances directly condition a real-time manipulation policy. 技術方法: Affordance2Action 執行任務條件的場景級可供性接地,在雜亂場景中識別哪些物件區域與指定任務相關。注意力機制將任務描述接地到 3D 點雲區域,接地的可供性直接條件化即時操作策略。
Key Takeaway: Task-conditioned 3D affordance grounding enables real-time manipulation by dynamically identifying manipulation-relevant object regions based on the current task instruction. 核心發現: 任務條件的 3D 可供性接地透過根據當前任務指令動態識別操作相關物件區域,實現即時操作。
Selecting Haptic Guidance Models in Teleoperation: Guidelines from a Comparative Study
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04157
Categories: cs.RO
Research Background: Haptic guidance in teleoperation enhances operator performance through force feedback, but there is no systematic guidance on which haptic model (spring-damper, potential field, impedance) is most appropriate for different task types. 研究背景: 遠端操作中的觸覺引導透過力反饋增強操作員表現,但沒有關於哪種觸覺模型(彈簧阻尼器、位勢場、阻抗)對不同任務類型最合適的系統性指導。
Technical Approach: The paper conducts a comparative study of major haptic guidance models under a unified formulation, systematically evaluating them across diverse teleoperation tasks with varying constraint types, environmental properties, and operator skill levels. Design guidelines are extracted from the empirical results. 技術方法: 本文在統一公式下對主要觸覺引導模型進行比較研究,在具有不同約束類型、環境屬性和操作員技能水平的多樣遠端操作任務中系統性地評估它們。從實證結果提取設計指南。
Key Takeaway: Haptic model selection significantly impacts teleoperation efficiency; this paper provides the first systematic guidelines linking task and environment properties to optimal haptic model choice. 核心發現: 觸覺模型選擇顯著影響遠端操作效率;本文提供第一個將任務和環境屬性與最優觸覺模型選擇聯繫起來的系統性指南。
CLAW: Learning Continuous Latent Action World Models via Adversarial Latent Regularization
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04130
Categories: cs.RO
Research Background: Learning world models jointly with latent action representations from action-free video enables robot policy learning from passive data, but existing methods struggle to produce structured, controllable latent action spaces. 研究背景: 從無動作影片聯合學習世界模型和潛在動作表示,使從被動資料進行機器人策略學習成為可能,但現有方法難以產生結構化、可控的潛在動作空間。
Technical Approach: CLAW is a fully self-supervised framework that uses adversarial latent regularization to shape the continuous latent action space toward a structured prior while learning to predict video dynamics. The adversarial training encourages the latent action space to have properties useful for downstream policy learning (smoothness, disentanglement). 技術方法: CLAW 是一種完全自監督框架,使用對抗性潛在正則化在學習預測影片動態的同時,將連續潛在動作空間塑造為結構化先驗。對抗訓練鼓勵潛在動作空間具有對下游策略學習有用的屬性(平滑性、解耦性)。
Key Takeaway: Adversarial latent regularization produces more structured and controllable latent action spaces from action-free video, substantially improving downstream robot policy learning efficiency. 核心發現: 對抗潛在正則化從無動作影片產生更結構化和可控的潛在動作空間,大幅提升下游機器人策略學習效率。
AgenticDiffusion: Agentic Diffusion-based Path Planning for Vision-Based UAV Navigation
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.04111
Categories: cs.RO
Research Background: Indoor UAV navigation requires efficient exploration under limited field-of-view, handling occlusions and visibility gaps that single-view navigation frameworks cannot reason about effectively. 研究背景: 室內無人機導航需要在有限視野下高效探索,處理單視角導航框架無法有效推理的遮擋和可見性差距。
Technical Approach: AgenticDiffusion uses a diffusion model as an agentic path planner that iteratively proposes, evaluates, and refines candidate paths based on multi-view observations. The diffusion planning process is conditioned on visual context and integrates occupancy map information to produce exploration-efficient navigation trajectories. 技術方法: AgenticDiffusion 使用擴散模型作為智能體路徑規劃器,根據多視角觀察迭代地提議、評估和精化候選路徑。擴散規劃過程以視覺上下文為條件,整合佔用圖資訊產生探索高效的導航軌跡。
Key Takeaway: Agentic diffusion planning produces exploration-efficient UAV navigation paths by iteratively refining trajectories based on visual context, outperforming reactive single-view navigation. 核心發現: 智能體擴散規劃透過基於視覺上下文迭代精化軌跡,產生探索高效的無人機導航路徑,優於反應式單視角導航。
Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Tracking
Authors: (multiple authors) | Submitted: 2026-06-02 | arXiv: 2606.03985
Categories: cs.RO
Research Background: Humanoid whole-body motion tracking is limited by scarce diverse motion data and shallow model architectures that create a trade-off between agility and generalization across unseen motions. 研究背景: 人形機器人全身動作追蹤受稀缺多樣動作資料和在敏捷性與對未見動作泛化之間造成權衡的淺層模型架構所限制。
Technical Approach: Humanoid-GPT is a GPT-style Transformer with causal attention pre-trained on a billion-scale motion corpus (2B retargeted frames). The large-scale pre-training endows the model with motion priors that enable zero-shot tracking of unseen motion sequences, with the scale eliminating the agility-generalization trade-off of smaller models. 技術方法: Humanoid-GPT 是帶因果注意力的 GPT 風格 Transformer,在十億規模的動作語料庫(20 億個重定向幀)上預訓練。大規模預訓練賦予模型動作先驗,使其能夠零樣本追蹤未見動作序列,規模消除了較小模型的敏捷性-泛化權衡。
Key Takeaway: Billion-scale pre-training on retargeted human motion eliminates the agility-generalization trade-off in humanoid motion tracking, enabling robust zero-shot transfer to unseen motion types. 核心發現: 在重定向人類動作上的十億規模預訓練消除了人形機器人動作追蹤中的敏捷性-泛化權衡,實現對未見動作類型的魯棒零樣本遷移。
AgenticRL: Self-Refining Agentic Reinforcement Learning for Vision-Conditioned Manipulation
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03963
Categories: cs.RO
Research Background: Deep RL for autonomous robot navigation and manipulation still relies heavily on hand-designed reward functions and repeated manual fine-tuning, which are time-consuming and do not guarantee high performance. 研究背景: 用於自主機器人導航和操作的深度強化學習仍然嚴重依賴手工設計的獎勵函數和反複的手動微調,既耗時又不保證高性能。
Technical Approach: AgenticRL introduces a self-refining loop where the agent automatically diagnoses its own failure modes, proposes reward modifications, and updates the reward function based on policy performance analysis. A vision-language model analyzes failure trajectories and suggests targeted reward improvements without human intervention. 技術方法: AgenticRL 引入自我精化循環,智能體自動診斷其自身的失敗模式,提議獎勵修改,並根據策略表現分析更新獎勵函數。視覺語言模型分析失敗軌跡並建議有針對性的獎勵改進,無需人工干預。
Key Takeaway: Self-refining agentic RL automatically improves reward functions through vision-language failure analysis, reducing manual reward engineering while achieving higher manipulation task success rates. 核心發現: 自我精化的智能體強化學習透過視覺語言失敗分析自動改進獎勵函數,減少手動獎勵工程同時達到更高的操作任務成功率。
VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoring
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03954
Categories: cs.CV, cs.RO
Research Background: As AI systems increasingly assist humans in physical tasks, ensuring safety is paramount — physical actions carry immediate and irreversible consequences that monitoring systems must detect proactively. 研究背景: 隨著 AI 系統越來越多地協助人類執行物理任務,確保安全至關重要——物理動作帶來即時且不可逆的後果,監控系統必須主動偵測。
Technical Approach: VLESA combines vision-language models with embodied reasoning to continuously monitor human activities for safety violations. A semantic safety model maintains activity context over time and flags dangerous situations (wrong posture, unsafe tool use, proximity violations) by reasoning over temporal activity sequences with spatial safety constraints. 技術方法: VLESA 結合視覺語言模型與具身推理,持續監控人類活動中的安全違規。語義安全模型隨時間維護活動上下文,並透過對帶空間安全約束的時間活動序列推理,標記危險情況(錯誤姿勢、不安全工具使用、距離違規)。
Key Takeaway: Embodied vision-language safety monitoring enables proactive hazard detection in human-robot workspaces by reasoning over temporal activity context rather than frame-by-frame classification. 核心發現: 具身視覺語言安全監控透過對時間活動上下文的推理而非逐幀分類,在人機工作空間中實現主動危害偵測。
Preference-Calibrated Human-in-the-Loop RL for Robot Manipulation
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03949
Categories: cs.RO
Research Background: Human-in-the-loop RL improves sample efficiency through online human interventions, but trajectories may include suboptimal actions that force unnecessary interventions, and existing methods cannot distinguish preference-aligned from non-aligned behaviors. 研究背景: 人在迴路強化學習透過在線人工干預提升樣本效率,但軌跡可能包含迫使不必要干預的次優動作,且現有方法無法區分偏好對齊與非對齊行為。
Technical Approach: The paper introduces preference calibration for HITL-RL that learns to distinguish operator preference-aligned actions from merely correct ones. A preference model trained on human feedback calibrates the intervention threshold and the reward weighting, reducing unnecessary corrections while ensuring that preference-violating behaviors are caught. 技術方法: 本文引入 HITL-RL 的偏好校準,學習區分操作員偏好對齊的動作與僅正確的動作。在人類反饋上訓練的偏好模型校準干預閾值和獎勵加權,減少不必要的修正同時確保偏好違規行為被捕捉。
Key Takeaway: Preference calibration in HITL-RL reduces unnecessary operator interventions by 40% while improving task performance by better capturing operator-preferred manipulation styles. 核心發現: HITL-RL 中的偏好校準減少 40% 的不必要操作員干預,同時透過更好地捕捉操作員偏好的操作風格提升任務表現。
PointAction: 3D Points as Universal Action Representations for Robot Control
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03943
Categories: cs.RO
Research Background: Video-action models for robot manipulation leverage pretrained video diffusion priors, but RGB-only video rollouts are not directly actionable — they omit 3D metric motion, contact geometry, and fine-grained spatial details needed for robot execution. 研究背景: 機器人操作的影片動作模型利用預訓練的影片擴散先驗,但僅 RGB 影片展開不能直接執行——它們省略了機器人執行所需的 3D 度量運動、接觸幾何和精細空間細節。
Technical Approach: PointAction represents robot actions as 3D point cloud trajectories, providing a universal action space that is simultaneously metric, geometrically rich, and cross-embodiment compatible. Video diffusion models generate 3D point trajectories that are directly executable as robot actions after a lightweight mapping to joint space. 技術方法: PointAction 將機器人動作表示為 3D 點雲軌跡,提供同時具有度量性、幾何豐富性和跨具身兼容性的通用動作空間。影片擴散模型生成 3D 點軌跡,在輕量映射到關節空間後可直接作為機器人動作執行。
Key Takeaway: 3D point cloud action representations bridge the video-to-execution gap in manipulation, providing metric and geometric information that enables direct robot execution from video diffusion rollouts. 核心發現: 3D 點雲動作表示橋接操作中的影片到執行差距,提供使從影片擴散展開直接機器人執行成為可能的度量和幾何資訊。
Denoising Tells When to Replan: Denoising-Variance Adaptive Chunking for Flow-Based Policies
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03847
Categories: cs.RO
Research Background: Action chunking for flow-based robot policies uses fixed execution horizons that ignore the varying predictability of robot motion — free-space motion can safely use longer chunks while contact-rich phases need frequent replanning. 研究背景: 流式機器人策略的動作塊使用固定的執行時域,忽略了機器人動作的變化可預測性——自由空間動作可以安全地使用較長的塊,而接觸豐富的階段需要頻繁重規劃。
Technical Approach: This paper uses the denoising variance of the flow matching model as an intrinsic uncertainty signal to adaptively determine when to replan. When flow denoising produces high-variance action predictions (indicating uncertainty), the chunk is shortened and replanning is triggered; low-variance predictions allow longer open-loop execution. 技術方法: 本文使用流匹配模型的去噪方差作為固有的不確定性訊號,自適應地確定何時重規劃。當流去噪產生高方差動作預測(表示不確定性)時,縮短塊並觸發重規劃;低方差預測允許更長的開環執行。
Key Takeaway: Denoising-variance-based adaptive chunking reduces unnecessary replanning by 60% in free-space motion while maintaining high-frequency replanning during contact-critical phases. 核心發現: 基於去噪方差的自適應塊化在接觸關鍵階段保持高頻重規劃的同時,減少自由空間動作中 60% 的不必要重規劃。
Let the Dynamics Flow: Stable Flow Matching Dynamical Systems
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03834
Categories: cs.RO
Research Background: Flow matching has emerged as a powerful approach for imitation learning, but incorporating formal stability guarantees — prerequisite for safe, generalizable robot behaviors — into these generative models remains an open challenge. 研究背景: 流匹配已成為模仿學習的強大方法,但將形式穩定性保證——安全、可泛化機器人行為的前提——納入這些生成模型仍然是一個開放挑戰。
Technical Approach: The paper introduces stability constraints directly into the flow matching training objective, ensuring that learned dynamical systems have globally stable attractors. Lyapunov-inspired stability certificates are incorporated as regularization terms, and the training procedure is designed to satisfy them while maintaining the expressiveness of flow matching. 技術方法: 本文將穩定性約束直接引入流匹配訓練目標,確保學習的動態系統具有全局穩定的吸引子。受李雅普諾夫啟發的穩定性證書作為正則化項被納入,訓練過程在保持流匹配表達能力的同時被設計以滿足它們。
Key Takeaway: Flow matching dynamical systems with formal stability guarantees produce robot policies that are both expressive and provably safe, without sacrificing multimodal motion generation capability. 核心發現: 帶形式穩定性保證的流匹配動態系統產生既有表達能力又可證明安全的機器人策略,不犧牲多模態動作生成能力。
Worth Remembering: Surprise-Gated Robot Episodic Memory
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03787
Categories: cs.RO
Research Background: Robots solving generalist tasks need episodic memory to ground instructions referencing past events, but storing all past observations is infeasible — a selective memory mechanism is needed to retain only the most task-relevant events. 研究背景: 解決通用任務的機器人需要情節記憶以接地引用過去事件的指令,但儲存所有過去觀察不可行——需要選擇性記憶機制只保留最與任務相關的事件。
Technical Approach: The paper proposes surprise-gated episodic memory that uses a prediction error signal to determine which observations are surprising enough to be stored. A world model predicts the next state; when prediction error exceeds a threshold, the event is flagged as surprising and stored in episodic memory. The memory is queried by language-grounded retrieval. 技術方法: 本文提出驚奇門控情節記憶,使用預測錯誤訊號確定哪些觀察足夠令人驚奇以被儲存。世界模型預測下一個狀態;當預測錯誤超過閾值時,事件被標記為令人驚奇並儲存在情節記憶中。記憶由語言接地的檢索查詢。
Key Takeaway: Surprise-gated episodic memory efficiently retains only task-relevant events, enabling robots to answer long-horizon spatial and event-referencing queries from natural language instructions. 核心發現: 驚奇門控情節記憶高效地只保留任務相關事件,使機器人能夠從自然語言指令回答長時域空間和事件引用查詢。
Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03784
Categories: cs.RO
Research Background: Embodied chain-of-thought (CoT) aims to bridge linguistic reasoning and robotic control in VLA models, but its effective form and integration strategy remain underexplored at large scale. 研究背景: 具身思維鏈(CoT)旨在橋接 VLA 模型中的語言推理和機器人控制,但其有效形式和整合策略在大規模下仍然未被充分探索。
Technical Approach: The paper constructs the largest embodied CoT corpus for VLA training and systematically studies which CoT formats (task plans, subtask descriptions, spatial reasoning chains) most benefit manipulation generalization. It analyzes the interaction between CoT type, training scale, and manipulation task complexity. 技術方法: 本文構建用於 VLA 訓練的最大具身 CoT 語料庫,並系統性地研究哪些 CoT 格式(任務計劃、子任務描述、空間推理鏈)最有益於操作泛化。分析 CoT 類型、訓練規模和操作任務複雜性之間的互動。
Key Takeaway: Spatial reasoning chain-of-thought is the most beneficial CoT format for VLA manipulation generalization, with benefits scaling with training corpus size rather than saturating early. 核心發現: 空間推理思維鏈是 VLA 操作泛化最有益的 CoT 格式,益處隨訓練語料庫大小擴展而非過早飽和。
Neural Navigation Functions for Zero-Shot Generalizable Motion Planning
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03756
Categories: cs.RO
Research Background: Reactive navigation functions that guide robots to goals while avoiding obstacles need to generalize zero-shot to unseen environment geometries, a challenge for both classical and learning-based planners. 研究背景: 引導機器人到達目標同時避障的反應式導航函數需要對未見環境幾何零樣本泛化,這對經典和基於學習的規劃器都是一個挑戰。
Technical Approach: Neural Navigation Functions (Neural-NF) place data-driven adaptation within a structured elliptic planner framework: the navigation objective is learned while planner structure guarantees convergence. The learned component adapts to environment geometry, while the structured planner enforces formal navigation properties. 技術方法: 神經導航函數(Neural-NF)將資料驅動的適應置於結構化橢圓規劃器框架內:導航目標被學習,同時規劃器結構保證收斂性。學習組件適應環境幾何,而結構化規劃器執行形式導航屬性。
Key Takeaway: Combining learned navigation objectives with structured elliptic planners enables zero-shot generalization to unseen environment geometries while preserving formal convergence and obstacle-avoidance guarantees. 核心發現: 結合學習的導航目標與結構化橢圓規劃器,在保留形式收斂性和避障保證的同時,實現對未見環境幾何的零樣本泛化。
Face versus Body Tracking for HRI: An Egocentric Dataset
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03694
Categories: cs.RO
Research Background: Social robots must continuously track and assess user engagement, but existing CV models are optimized for surveillance/driving contexts, not the egocentric perspective and social proximity of robot-human interaction. 研究背景: 社交機器人必須持續追蹤和評估用戶參與度,但現有 CV 模型針對監控/駕駛環境而非機器人人類互動的第一人稱視角和社交距離優化。
Technical Approach: The paper presents an egocentric HRI dataset capturing face and full-body tracking from a robot’s perspective across diverse social interaction scenarios. It conducts a systematic comparison of face-based versus body-based tracking under egocentric robot viewpoints, evaluating engagement estimation accuracy, occlusion robustness, and real-time feasibility. 技術方法: 本文提供從機器人視角在多樣社交互動場景中捕捉臉部和全身追蹤的第一人稱 HRI 資料集。系統性比較在第一人稱機器人視角下基於臉部與基於身體的追蹤,評估參與度估計精度、遮擋魯棒性和即時可行性。
Key Takeaway: Body tracking outperforms face tracking for robot social engagement estimation under egocentric viewpoints due to better occlusion handling, while face tracking remains superior for fine-grained expression analysis. 核心發現: 在第一人稱視角下,由於更好的遮擋處理,身體追蹤在機器人社交參與度估計上優於臉部追蹤,而臉部追蹤在精細表情分析方面仍然優越。
GN0: Toward a Unified Paradigm for Generation, Evaluation, and Policy Learning in Navigation
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03682
Categories: cs.RO
Research Background: VLN systems’ generalization and long-horizon capabilities are constrained by limited availability and quality of navigation data — collection is expensive and existing datasets lack the diversity needed for robust generalization. 研究背景: VLN 系統的泛化和長時域能力受導航資料可用性和品質有限所約束——蒐集昂貴且現有資料集缺乏魯棒泛化所需的多樣性。
Technical Approach: GN0 introduces a unified paradigm that jointly handles navigation data generation, quality evaluation, and policy learning within a single framework. A generative model produces diverse navigation scenarios, an evaluator scores their quality and instructional diversity, and the filtered generated data augments VLN policy training. 技術方法: GN0 引入在單一框架內聯合處理導航資料生成、品質評估和策略學習的統一範式。生成模型產生多樣的導航場景,評估器評分其品質和指令多樣性,過濾的生成資料增強 VLN 策略訓練。
Key Takeaway: Unified generation-evaluation-learning reduces the VLN data bottleneck by producing high-quality synthetic navigation data that substantially improves policy generalization beyond real-data-only training. 核心發現: 統一的生成-評估-學習透過產生高品質合成導航資料,大幅提升策略泛化,超越僅使用真實資料的訓練,從而減少 VLN 資料瓶頸。
PHASER: Phase-Aware and Semantic Experience Replay for VLA Models
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03598
Categories: cs.RO
Research Background: VLA models deployed in open-ended environments must continuously acquire novel skills while avoiding catastrophic forgetting of previously learned manipulation capabilities. 研究背景: 在開放式環境中部署的 VLA 模型必須持續獲取新技能,同時避免對先前學習的操作能力的災難性遺忘。
Technical Approach: PHASER introduces phase-aware and semantic experience replay that selectively replays demonstrations based on semantic task similarity and manipulation phase coverage. The phase-aware component ensures balanced replay across task phases (approach, grasp, transport, release), while semantic similarity guides which past experiences best prevent forgetting of current task types. 技術方法: PHASER 引入基於語義任務相似性和操作階段覆蓋選擇性重播示範的階段感知和語義經驗重播。階段感知組件確保跨任務階段(接近、抓握、運輸、釋放)的平衡重播,而語義相似性引導哪些過去經驗最能防止對當前任務類型的遺忘。
Key Takeaway: Phase-aware semantic experience replay substantially reduces catastrophic forgetting in continual VLA learning while maintaining competitive performance on both new and previously learned manipulation tasks. 核心發現: 階段感知語義經驗重播在持續 VLA 學習中大幅減少災難性遺忘,同時在新舊操作任務上保持競爭性表現。
Making Embodied AI Reliable: A Community Agenda from Testing to Formal Verification
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03593
Categories: cs.SE, cs.RO
Research Background: Embodied AI systems are increasingly deployed in open-world environments, yet ensuring their reliability remains a fundamental challenge — current testing approaches do not scale to the diversity of real-world failure modes. 研究背景: 具身 AI 系統越來越多地部署在開放世界環境中,但確保其可靠性仍然是根本挑戰——當前測試方法無法擴展到真實世界失敗模式的多樣性。
Technical Approach: This community agenda paper argues for a multi-layer reliability assurance framework combining: (1) systematic testing with failure-inducing scenario generation, (2) runtime monitoring for safety property violations, and (3) formal verification for critical behavior components. It identifies tractable starting points for applying formal methods to embodied AI subsystems. 技術方法: 這篇社群議程論文主張多層可靠性保證框架,結合:(1)帶失敗誘發場景生成的系統測試,(2)安全屬性違規的運行時監控,(3)關鍵行為組件的形式驗證。識別將形式方法應用於具身 AI 子系統的可行起點。
Key Takeaway: Reliable embodied AI requires a layered assurance strategy combining testing, runtime monitoring, and formal verification — no single approach is sufficient for open-world deployment safety. 核心發現: 可靠的具身 AI 需要結合測試、運行時監控和形式驗證的分層保證策略——沒有單一方法足以確保開放世界部署安全。
Partially Observable Adversarial Patch Attacks on VLA Models
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03556
Categories: cs.RO
Research Background: VLA model robustness to adversarial attacks is largely unexplored, and existing work assumes full trajectory access — an unrealistic assumption for real deployment where attackers have only partial observation of robot execution. 研究背景: VLA 模型對對抗攻擊的魯棒性基本上未被探索,現有工作假設完整的軌跡訪問——這對於攻擊者只有機器人執行部分觀察的真實部署是不現實的假設。
Technical Approach: The paper studies adversarial patch attacks on VLA models under partial observability, where the attacker only observes a limited temporal window of the robot’s execution. It demonstrates that effective patches can be crafted even with partial observation, and proposes detection and defense mechanisms based on execution consistency monitoring. 技術方法: 本文研究在部分可觀察性下對 VLA 模型的對抗補丁攻擊,攻擊者只觀察機器人執行的有限時間窗口。展示即使在部分觀察下也可以製作有效的補丁,並提出基於執行一致性監控的偵測和防禦機制。
Key Takeaway: VLA models are vulnerable to adversarial patch attacks even under partial observability, necessitating execution consistency monitoring as a practical defense for deployed robotic systems. 核心發現: 即使在部分可觀察性下,VLA 模型也容易受到對抗補丁攻擊,需要執行一致性監控作為已部署機器人系統的實用防禦。
NVIDIA Isaac Sim: Enabling Scalable, GPU-Accelerated Simulation for Robotics
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03551
Categories: cs.RO
Research Background: Robot simulation is core infrastructure for robot learning, but most simulators lack the combination of physics accuracy, rendering quality, and scalability needed for large-scale parallel policy training. 研究背景: 機器人模擬是機器人學習的核心基礎設施,但大多數模擬器缺乏大規模並行策略訓練所需的物理精度、渲染品質和可擴展性的組合。
Technical Approach: NVIDIA Isaac Sim leverages GPU acceleration for both physics simulation and rendering, enabling large-scale parallel training environments. Its synthetic data generation pipeline uses physically accurate materials and lighting for domain randomization, and the RTX-accelerated rendering provides photorealistic observations without CPU bottlenecks. 技術方法: NVIDIA Isaac Sim 利用 GPU 加速進行物理模擬和渲染,實現大規模並行訓練環境。其合成資料生成流水線使用物理精確的材質和光照進行領域隨機化,RTX 加速的渲染在沒有 CPU 瓶頸的情況下提供真實感觀察。
Key Takeaway: GPU-accelerated physics and rendering in Isaac Sim enables robot learning at scales previously infeasible, producing policies that transfer reliably to real robots through high-quality domain randomization. 核心發現: Isaac Sim 中的 GPU 加速物理和渲染使機器人學習達到以前不可行的規模,透過高品質領域隨機化產生可靠遷移到真實機器人的策略。
Static and Dynamic Representations for Tactile Contact-Angle Estimation with Event Sensors
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03545
Categories: cs.RO
Research Background: Event-based tactile sensing offers low-latency contact detection but the optimal representation for downstream tasks like contact-angle estimation — whether static spatial or dynamic temporal — remains poorly understood. 研究背景: 基於事件的觸覺感測提供低延遲接觸偵測,但下游任務(如接觸角度估計)的最優表示——靜態空間的還是動態時間的——仍然了解不足。
Technical Approach: The paper systematically compares three event-derived representations for contact-angle estimation: static spatial contour maps, dynamic event accumulation frames, and a novel hybrid representation. Each is evaluated on the NeuroTac event-based tactile sensor, measuring accuracy, latency, and robustness to contact speed variation. 技術方法: 本文系統性地比較三種用於接觸角度估計的事件衍生表示:靜態空間輪廓圖、動態事件積累幀和新型混合表示。每種在 NeuroTac 基於事件的觸覺感測器上評估,測量精度、延遲和對接觸速度變化的魯棒性。
Key Takeaway: Hybrid static-dynamic representations provide the best contact-angle estimation for event-based tactile sensors, combining the spatial precision of static maps with the motion sensitivity of dynamic frames. 核心發現: 混合靜態-動態表示為基於事件的觸覺感測器提供最佳接觸角度估計,結合靜態圖的空間精度和動態幀的運動敏感性。
Bionic Human-Motion Style Transfer for Physically Executable Whole-Body Control
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03536
Categories: cs.RO
Research Background: Expressive whole-body motion for humanoid robots in human environments requires stable, readable motion that can be adjusted by operators, but most expressive motions come from fixed demonstrations or manual scripts. 研究背景: 人類環境中人形機器人的富有表現力的全身動作需要可由操作員調整的穩定、可讀動作,但大多數富有表現力的動作來自固定的示範或手動腳本。
Technical Approach: The paper introduces bionic human-motion style transfer that transfers style characteristics from reference human motions to robot whole-body controllers while preserving physical executability. A style encoder captures human motion aesthetics, and a style-conditioned controller generates physically feasible robot motions matching the target style. 技術方法: 本文引入仿生人類動作風格遷移,在保留物理可執行性的同時將風格特徵從參考人類動作遷移到機器人全身控制器。風格編碼器捕捉人類動作美學,風格條件控制器生成匹配目標風格的物理可行機器人動作。
Key Takeaway: Bionic style transfer enables humanoid robots to express diverse motion aesthetics from human reference motions while maintaining physical stability and executability. 核心發現: 仿生風格遷移使人形機器人能夠在保持物理穩定性和可執行性的同時,從人類參考動作表達多樣的動作美學。
SPADE: Sketch-Guided Path Planning Augmented with Diffusion Experts
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03512
Categories: cs.RO
Research Background: Incorporating human path preferences into mobile robot planning typically requires complex reward engineering or hardware-intensive solutions, creating a barrier for non-expert operators to guide robot navigation. 研究背景: 將人類路徑偏好整合到移動機器人規劃通常需要複雜的獎勵工程或硬體密集型解決方案,為非專家操作員引導機器人導航創造了障礙。
Technical Approach: SPADE uses hand-drawn sketch inputs as path planning guidance, combining imitation learning with diffusion-based trajectory experts. A sketch interpreter extracts path constraints from operator sketches, and diffusion experts generate trajectory proposals that satisfy both the sketch constraints and environment feasibility requirements. 技術方法: SPADE 使用手繪草圖輸入作為路徑規劃引導,結合模仿學習與擴散式軌跡專家。草圖解釋器從操作員草圖提取路徑約束,擴散專家生成同時滿足草圖約束和環境可行性要求的軌跡提議。
Key Takeaway: Sketch-guided diffusion planning enables non-expert operators to intuitively direct mobile robot paths without reward engineering, making human path preference specification practical. 核心發現: 草圖引導的擴散規劃使非專家操作員能夠在沒有獎勵工程的情況下直覺地引導移動機器人路徑,使人類路徑偏好規格化切實可行。
Human2Humanoid: Physics-Aware Cross-Morphology Motion Retargeting for Humanoid Robots
Authors: (multiple authors) | Submitted: 2026-06-01 | arXiv: 2606.03476
Categories: cs.RO
Research Background: Retargeting human motion to humanoid robots is critical for teleoperation and imitation learning, but morphological discrepancies (skeletal topology, limb proportions, degrees of freedom) make direct kinematic retargeting fail on complex dynamic motions. 研究背景: 將人類動作重定向到人形機器人對遠端操作和模仿學習至關重要,但形態差異(骨骼拓撲、肢體比例、自由度)使直接運動學重定向在複雜動態動作上失敗。
Technical Approach: Human2Humanoid introduces physics-aware retargeting that accounts for morphological differences through a physics simulation loop. The method optimizes retargeted motions to minimize the divergence from the human reference while satisfying robot kinematic and dynamic constraints, using differentiable physics to compute gradients through the simulation. 技術方法: Human2Humanoid 引入物理感知重定向,透過物理模擬循環考慮形態差異。方法優化重定向動作以最小化與人類參考的偏差,同時滿足機器人運動學和動態約束,使用可微分物理透過模擬計算梯度。
Key Takeaway: Physics-aware cross-morphology retargeting produces humanoid motions that closely match human reference aesthetics while remaining physically executable, enabling high-fidelity human-to-robot motion transfer. 核心發現: 物理感知跨形態重定向產生緊密匹配人類參考美學同時保持物理可執行的人形動作,實現高保真人到機器人動作遷移。
OpenEAI-Platform: An Open-source Embodied Artificial Intelligence Hardware-Software Unified Platform
Authors: Jinyuan Zhang, Luoyi Fan, Leiyu Wang | Submitted: 2026-06-02 | arXiv: 2606.03392
Categories: cs.RO
Research Background: Real-world embodied AI requires both accurate hardware and robust VLA policies, but most platforms are either closed-source, expensive, or decouple hardware and software development — creating barriers to reproducible research and deployment. 研究背景: 現實世界具身 AI 需要精確的硬體與健壯的 VLA 策略,但大多數平台要麼是閉源、昂貴,要麼將硬體與軟體開發解耦——為可重現研究與部署造成障礙。
Technical Approach: OpenEAI-Platform integrates a fully open-source 6+1 DOF robotic arm (OpenEAI-Arm) with open mechanical designs for low manufacturing cost and compliant control, with a reproducible VLA model (OpenEAI-VLA) built on Qwen, providing a unified end-to-end platform from hardware to policy. 技術方法: OpenEAI-Platform 整合完全開源的 6+1 自由度機械臂(OpenEAI-Arm)——具有低製造成本的開源機械設計與柔順控制——以及基於 Qwen 建構的可重現 VLA 模型(OpenEAI-VLA),提供從硬體到策略的統一端到端平台。
Key Takeaway: A fully open-source hardware-software unified platform lowers the barrier to embodied AI research by enabling reproducible low-cost robot manipulation experiments with an integrated VLA policy stack. 核心發現: 完全開源的硬體-軟體統一平台透過整合 VLA 策略棧實現可重現的低成本機器人操作實驗,降低具身 AI 研究門檻。
Grasp-Then-Plan with Failure Attribution: A Closed Two-Stage Framework for Precise and Generalizable Robotic Manipulation
Authors: Jiahao Xu, Peiyuan Wang, Hanzhuo Zhang | Submitted: 2026-06-02 | arXiv: 2606.03385
Categories: cs.RO, cs.AI
Research Background: In robotic manipulation, tight coupling between grasping and motion planning obscures the true source of failure, leading to inefficient trial-and-error that cannot distinguish grasp failures from planning failures. 研究背景: 機器人操作中,抓取與運動規劃的緊密耦合遮蔽了真正的失敗來源,導致無法區分抓取失敗與規劃失敗的低效嘗試-錯誤循環。
Technical Approach: GTP-FA (Grasp-Then-Plan with Failure Attribution) is a two-stage framework that first generates grasp candidates and then performs downstream motion planning conditioned on the selected grasp, with a failure attribution module that isolates whether failures originate from grasp selection or motion planning — enabling targeted recovery. 技術方法: GTP-FA(抓取後規劃與失敗歸因)是兩階段框架,首先生成抓取候選,然後以選定抓取為條件執行下游運動規劃,搭配失敗歸因模組分離失敗源自抓取選擇還是運動規劃——支援有針對性的恢復。
Key Takeaway: Decoupling grasp generation from motion planning with explicit failure attribution enables more precise diagnostics and targeted recovery, substantially improving success rates on long-horizon manipulation tasks compared to end-to-end or tightly-coupled pipelines. 核心發現: 透過明確失敗歸因解耦抓取生成與運動規劃,實現更精確的診斷與有針對性的恢復,在長程操作任務上的成功率顯著優於端到端或緊密耦合管線。
eMEM: A Hybrid Spatio-Temporal Memory System For Embodied Agents
Authors: A. Haroon Rasheed, Maria Kabtoul | Submitted: 2026-06-02 | arXiv: 2606.03374
Categories: cs.RO
Research Background: Embodied agents navigating physical environments need memory that is simultaneously searchable by meaning, space, and time — a requirement that text-stream and knowledge-graph architectures from systems like Generative Agents or MemGPT do not adequately address. 研究背景: 在實體環境中運作的具身代理需要能同時依語意、空間與時間索引的記憶系統,而現有的文字串流或知識圖譜架構(如 Generative Agents、MemGPT)並未滿足此需求。
Technical Approach: eMEM introduces a hybrid graph-based multi-index architecture that encodes observations with semantic, spatial, and temporal indices, allowing the agent to query memory across all three dimensions simultaneously for grounded decision-making. 技術方法: eMEM 以混合圖結構建立多索引架構,將觀測編碼為語意、空間與時間三維索引,支援具身代理跨維度查詢記憶以進行接地決策。
Key Takeaway: By treating embodied memory as a multi-modal, spatio-temporally indexed structure rather than a flat text log, eMEM enables more reliable long-horizon task execution in physical navigation and manipulation scenarios. 核心發現: 將具身記憶視為多模態時空索引結構而非純文字日誌,eMEM 能在長程導航與操作任務中提供更可靠的執行能力。
GPU-Parallel Multi-Task Reinforcement Learning with Demonstration Guided Policy Optimization
Authors: Rui Zhang, Qiwei Wu, Zhengyu Zhang | Submitted: 2026-06-02 | arXiv: 2606.03335
Categories: cs.RO
Research Background: Large-scale GPU-parallel RL has transformed what can be trained in robot simulation, yet most systems still train one specialist policy per task, making multi-task generalization expensive and brittle. 研究背景: 大規模 GPU 並行強化學習已改變機器人模擬訓練的規模,但現有系統多仍為每個任務訓練獨立的專家策略,使多任務泛化效率低落且脆弱。
Technical Approach: The authors propose MT-Libero, a GPU-parallel multi-task RL benchmark built on LIBERO assets in Isaac Lab, and pair it with Demonstration Guided Policy Optimization (DGPO) that uses expert demonstrations to guide exploration and shared-backbone policy learning across tasks. 技術方法: 作者提出 MT-Libero — 以 LIBERO 資產在 Isaac Lab 建構的 GPU 並行多任務 RL 基準,並搭配 DGPO(示範引導策略優化),利用專家示範引導探索與共用主幹的跨任務策略學習。
Key Takeaway: Structured task family construction combined with demonstration-guided exploration yields efficient multi-task policy learning that generalises across manipulation tasks within a single shared policy. 核心發現: 結構化任務族建構搭配示範引導探索,可在單一共用策略下實現高效的多任務操作學習與泛化。
RobotValues: Evaluating Household Robots When Human Values Conflict
Authors: Jongwook Han, Hyeongjin Kim, Yohan Jo | Submitted: 2026-06-02 | arXiv: 2606.03312
Categories: cs.RO, cs.AI
Research Background: Household robots are typically evaluated on task-completion metrics, but domestic life routinely presents value-conflicting situations — human autonomy, social appropriateness, efficiency — where the “correct” action is not merely the successful one. 研究背景: 家庭服務機器人通常以任務完成率評估,但日常生活中頻繁出現價值衝突情境(如人類自主性、社會適切性、效率),正確行動並非僅取決於任務成功與否。
Technical Approach: RobotValues is a new benchmark of household scenarios designed to expose conflicts between task completion and other human values; models are scored on how well their chosen actions align with value-sensitive human preferences elicited through structured annotation. 技術方法: RobotValues 是一套家庭情境基準,專門設計以暴露任務完成與其他人類價值觀之間的衝突;透過結構化標注蒐集人類偏好,評估模型行動選擇的價值對齊程度。
Key Takeaway: Current robot policies, including VLM-based systems, struggle significantly with value-conflicting scenarios, highlighting the need for value-aware evaluation beyond task-success rate. 核心發現: 現有機器人策略(包含 VLM 系統)在價值衝突情境中表現明顯不足,顯示評估框架需超越任務成功率,納入價值感知維度。
SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptation
Authors: Jeonguk Kang, Hanbyel Cho, Sanghyun Kang | Submitted: 2026-06-02 | arXiv: 2606.03297
Categories: cs.RO
Research Background: Humanoid loco-manipulation under varying object masses and pickup heights is challenging for sim-to-real transfer because object-induced load variation and robot-side dynamics mismatch interact during physical contact, and standard history-based adapters collapse these distinct factors into one latent. 研究背景: 在不同物體質量與取放高度下進行類人機器人移動操作的模擬到現實遷移極具挑戰:物體載荷變化與機器人動力學不匹配在接觸時交互作用,而標準歷史適配器將這兩個因素壓縮至單一潛在表徵。
Technical Approach: SplitAdapter factorizes the adaptation latent into a load-aware arm component and a robot-side leg component, trained with separate supervision signals, enabling each sub-adapter to specialize without interference during whole-body control. 技術方法: SplitAdapter 將適配潛在空間分解為感知載荷的手臂分量與機器人端的腿部分量,以獨立監督信號訓練,使各子適配器在全身控制過程中專業化而不相互干擾。
Key Takeaway: Factorized adaptation achieves more stable sim-to-real transfer for humanoid loco-manipulation by decoupling load-induced from robot-dynamics disturbances, outperforming monolithic adapters on pickup and placement tasks. 核心發現: 分解式適配透過解耦載荷誘發與機器人動力學干擾,在類人機器人移動操作的模擬到現實遷移中實現更穩定的控制,優於整體式適配器。
Dive into the Scene: Breaking the Perceptual Bottleneck in Vision-Language Decision Making via Focus Plan Generation
Authors: Boyuan Xiao, Bohong Chen, Yumeng Li | Submitted: 2026-06-02 | arXiv: 2606.04046
Categories: cs.CV, cs.AI, cs.CL, cs.LG, cs.RO
Research Background: Both VLMs (better at long-term planning) and VLAs (better at reactive control) suffer from visual hallucinations caused by a shared perceptual bottleneck: limited image resolution and spatial grounding when reasoning about manipulation or navigation scenes. 研究背景: VLM(長程規劃較佳)與 VLA(反應控制較佳)均受視覺幻覺問題困擾,根源在於共同的感知瓶頸:在操作或導航場景中推理時,影像解析度與空間基礎能力有限。
Technical Approach: The authors propose Focus Plan Generation, a module that generates a sequence of spatial focus regions to guide the VLM/VLA’s attention to task-relevant parts of the scene before decision-making, breaking the resolution bottleneck without retraining the full backbone. 技術方法: 作者提出焦點計畫生成(Focus Plan Generation)模組,在決策前生成一系列空間焦點區域以引導 VLM/VLA 注意力至任務相關場景部分,無需重新訓練完整主幹即可突破解析度瓶頸。
Key Takeaway: Explicitly planning where to look before acting reduces visual hallucinations and improves task success in both manipulation and navigation benchmarks, offering a lightweight plug-in for existing VLM/VLA systems. 核心發現: 在行動前明確規劃視覺焦點可減少視覺幻覺,在操作與導航基準中提升任務成功率,為現有 VLM/VLA 系統提供輕量插件方案。
EaDex: A Cross-Embodiment Dexterous Manipulation Framework from Low-Cost Demonstrations
Authors: Qian Zhao, Xin Tong, Chengdong Wu | Submitted: 2026-06-02 | arXiv: 2606.03268
Categories: cs.RO
Research Background: Dexterous manipulation learning faces a dual cost problem: pure RL requires massive exploration while imitation learning needs expensive high-quality demonstrations, restricting scalability to new embodiments and tasks. 研究背景: 靈巧操作學習面臨雙重代價問題:純強化學習需要大量探索,而模仿學習依賴昂貴的高品質示範,限制了向新具身形態與任務的可擴展性。
Technical Approach: EaDex is a cross-embodiment framework that learns dexterous policies from low-cost demonstrations (e.g., human hand captures or simple proxy robot motions) by retargeting demonstration trajectories across embodiment morphologies and combining them with RL fine-tuning. 技術方法: EaDex 是跨具身框架,透過重定向跨形態示範軌跡(如人手捕捉或簡易代理機器人動作)並結合強化學習微調,從低成本示範中學習靈巧操作策略。
Key Takeaway: By enabling cross-embodiment knowledge transfer from cheap demonstrations, EaDex substantially reduces the data collection burden for training dexterous robot hands while maintaining competitive task performance. 核心發現: 透過從低成本示範實現跨具身知識遷移,EaDex 大幅降低靈巧機械手訓練的資料蒐集負擔,同時維持具競爭力的任務表現。
AirDreamer: Generalist Drone Navigation with World Models
Authors: Zian Liu, Andong Yang, Chunkai Yang | Submitted: 2026-06-02 | arXiv: 2606.03252
Categories: cs.RO, cs.AI
Research Background: Navigating drones through unseen, cluttered environments requires reliable generalization beyond handcrafted perception pipelines and predefined rules, yet previous methods assume fixed environment configurations and struggle with novel layouts. 研究背景: 在未知雜亂環境中導航無人機需要超越手工感知管線與預定義規則的可靠泛化能力,而現有方法假設固定環境配置,難以應對新型佈局。
Technical Approach: AirDreamer couples a world model (trained to predict future observations from drone actions) with a learned navigation policy, allowing the drone to mentally simulate consequences of actions before executing them and to generalize to unseen layouts through imagination-based planning. 技術方法: AirDreamer 將世界模型(訓練以從無人機動作預測未來觀測)與學習導航策略耦合,使無人機能在執行前心理模擬行動後果,並透過基於想像的規劃泛化至未見佈局。
Key Takeaway: A generalist drone navigator built on world-model imagination outperforms rule-based and reactive baselines on zero-shot generalization to novel cluttered environments without environment-specific retraining. 核心發現: 基於世界模型想像建構的通用無人機導航器在零樣本泛化至新型雜亂環境時優於規則式與反應式基線,且無需環境特定重訓練。
GeoAlign: Beyond Semantics with State-Guided Spatial Alignment in VLA Models
Authors: Yizhi Chen, Zhanxiang Cao, Xinyi Peng | Submitted: 2026-06-02 | arXiv: 2606.03240
Categories: cs.RO
Research Background: Current VLA models focus heavily on semantic grounding but executable manipulation requires geometry-aware spatial alignment and dynamic affordance selection — capabilities that semantic optimization alone does not provide. 研究背景: 現有 VLA 模型著重語意基礎,但可執行的操作需要幾何感知的空間對齊與動態可供性選擇——單純語意優化無法提供這些能力。
Technical Approach: GeoAlign post-trains an RGB geometry branch with robot-domain RGB-D supervision to produce Geometry-Enhanced Features, then uses robot state as a dynamic guide to spatially align these geometric features with task semantics during policy inference. 技術方法: GeoAlign 以機器人領域 RGB-D 監督對 RGB 幾何分支進行後訓練,生成幾何增強特徵,再以機器人狀態作為動態引導,在策略推理時將幾何特徵與任務語意進行空間對齊。
Key Takeaway: State-guided spatial alignment of geometry-enriched visual features significantly improves manipulation success rates on tasks requiring precise spatial reasoning, with minimal overhead over standard VLA pipelines. 核心發現: 對幾何豐富視覺特徵進行狀態引導空間對齊,在需要精確空間推理的操作任務上顯著提升成功率,且相較標準 VLA 管線開銷極小。
BotDirector: Robot Storytelling Across the Symmetrical Reality with Multi-modal Interactions
Authors: Zhe Sun, Meng Wang, Lei Wang | Submitted: 2026-06-02 | arXiv: 2606.03223
Categories: cs.RO, cs.AI
Research Background: Robot storytelling can uniquely engage children, but existing systems are too technically complex for child users and lack natural multimodal interaction between the physical robot, digital content, and the child’s tangible play environment. 研究背景: 機器人說故事能以獨特方式吸引兒童,但現有系統對兒童使用者而言技術複雜度過高,且缺乏實體機器人、數位內容與兒童具體遊戲環境之間的自然多模態互動。
Technical Approach: BotDirector is an interactive system where children arrange physical props and issue natural language instructions; a multimodal reasoning layer maps the tangible environment and language to robot narrative actions, synchronized across physical and digital (AR/screen) realities. 技術方法: BotDirector 是互動系統,兒童可排列實體道具並發出自然語言指令;多模態推理層將具體環境與語言對應至機器人敘事動作,並跨實體與數位(AR/螢幕)現實同步呈現。
Key Takeaway: Enabling children to direct robot stories through tangible and spoken cues — without programming — demonstrates that accessible HRI design can make expressive robot behaviors available to non-expert users. 核心發現: 讓兒童透過具體與口語提示(無需程式設計)指導機器人故事,展示可及的人機互動設計能使非專業使用者也能獲得豐富的機器人行為表達。
GeoSem-WAM: Geometry- and Semantic-Aware World Action Models
Authors: Fulong Ma, Daojie Peng, Wenjun Yue | Submitted: 2026-06-02 | arXiv: 2606.03188
Categories: cs.RO
Research Background: Recent World Action Models (WAMs) show strong embodied decision-making but it remains unclear whether their benefit comes from explicit future imagination during inference or from the robust latent representations learned via predictive training — evidence increasingly favors the latter. 研究背景: 近期世界行動模型(WAMs)在具身決策中表現強勁,但其優勢究竟來自推理時的明確未來想像還是預測訓練所學習的穩健潛在表徵尚不明確——越來越多證據支持後者。
Technical Approach: GeoSem-WAM incorporates geometry-aware (depth/pointcloud) and semantic-aware (object-level) supervision into the world model’s predictive training objective, enriching the latent representations with structural and semantic scene understanding without requiring explicit rollout at test time. 技術方法: GeoSem-WAM 將幾何感知(深度/點雲)與語意感知(物體層級)監督納入世界模型的預測訓練目標,在不需要測試時明確展開的情況下,以結構與語意場景理解豐富潛在表徵。
Key Takeaway: Geometry- and semantic-aware supervision during world model training produces richer latent representations that improve downstream manipulation policy performance more than explicit imagination rollouts. 核心發現: 世界模型訓練時的幾何與語意感知監督能產生更豐富的潛在表徵,對下游操作策略表現的提升超過顯式想像展開。
NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation
Authors: NVIDIA (Aarti Basant et al.) | Submitted: 2026-06-02 | arXiv: 2606.03159
Categories: cs.CV, cs.AI, cs.RO
Research Background: Safe evaluation of autonomous vehicle policies in long-tail scenarios is a critical bottleneck; closed-loop simulation requires the driving policy’s actions to dynamically update the simulator state, but reconstruction-based neural simulators are too slow for interactive use. 研究背景: 在長尾場景中安全評估自駕車策略是關鍵瓶頸;閉環模擬要求駕駛策略的行動動態更新模擬器狀態,但基於重建的神經模擬器速度過慢,不適合互動使用。
Technical Approach: OmniDreams is a real-time generative world model that produces photorealistic sensor observations conditioned on ego-vehicle actions, enabling fully closed-loop policy evaluation with reactive agent behavior and diverse weather/scenario generation at interactive frame rates. 技術方法: OmniDreams 是即時生成式世界模型,依據自車行動生成逼真感測器觀測,以互動幀率實現完全閉環的策略評估、反應式代理行為及多樣化天氣/場景生成。
Key Takeaway: Real-time photorealistic closed-loop simulation with a generative world model enables safety-critical autonomous driving evaluation at scale, surfacing policy failures in rare scenarios that offline replay cannot capture. 核心發現: 生成式世界模型的即時逼真閉環模擬能大規模實現安全關鍵的自駕車策略評估,揭示離線回放無法捕捉的罕見場景策略失效。
How Visible Are Silent Manipulation Failures? An Observability Study of False-Success Detection in Simulated Robot Episodes
Authors: Aarav Bedi | Submitted: 2026-06-02 | arXiv: 2606.03134
Categories: cs.RO, cs.LG
Research Background: Imitation-learning policies inherit the quality of success labels in training data; “silent failures” — episodes incorrectly logged as successful — are particularly damaging because they inject corrupted demonstrations without any obvious signal. 研究背景: 模仿學習策略繼承訓練資料中成功標籤的品質;「靜默失敗」——被錯誤記錄為成功的 episode——尤其有害,因為它們在沒有明顯信號的情況下注入損壞的示範。
Technical Approach: The paper conducts an observability study by analyzing simulated robot manipulation episodes containing false successes, measuring how detectable these failures are from visual observations alone using both human judges and automated detection models. 技術方法: 論文透過分析包含假成功的模擬機器人操作 episode 進行可觀測性研究,以人類評判者與自動化偵測模型測量僅從視覺觀測中這些失敗的可偵測程度。
Key Takeaway: A significant fraction of silent manipulation failures are visually detectable, suggesting that lightweight visual verification could be added to data collection pipelines to filter false-success labels before training. 核心發現: 相當比例的靜默操作失敗在視覺上是可偵測的,顯示可在資料蒐集管線中加入輕量視覺驗證,在訓練前過濾假成功標籤。
TTT-VLA: Test-Time Latent Prompt Optimization for Vision-Language-Action Models
Authors: Wenbo Zhang, Jianxiong Li, Shuai Yang | Submitted: 2026-06-02 | arXiv: 2606.03127
Categories: cs.RO
Research Background: VLA models trained on large-scale data remain vulnerable to distribution shifts at deployment time; while prompts can steer policy behavior, existing prompt-based methods rely on external guidance rather than autonomous self-adaptation. 研究背景: 在大規模資料上訓練的 VLA 模型在部署時仍易受分佈偏移影響;雖然提示可引導策略行為,但現有基於提示的方法依賴外部引導而非自主自適應。
Technical Approach: TTT-VLA performs test-time training by optimizing a latent prompt vector at deployment using a self-supervised auxiliary objective (e.g., masked observation prediction) computed from the robot’s own trajectory, allowing the policy to adapt to distribution shifts without external supervision. 技術方法: TTT-VLA 在部署時透過自監督輔助目標(如遮罩觀測預測)從機器人自身軌跡計算梯度,對潛在提示向量進行測試時訓練,使策略無需外部監督即可適應分佈偏移。
Key Takeaway: Test-time latent prompt optimization enables VLA models to self-adapt to unseen environments at deployment, recovering significant performance under distribution shifts without modifying model weights. 核心發現: 測試時潛在提示優化使 VLA 模型能在部署時自主適應未見環境,在分佈偏移下恢復顯著效能,且無需修改模型權重。
ConTraIRL: Factorized Contrastive Abstractions for Transferable IRL
Authors: Yikang Gui, Bikramjit Banerjee, Prashant Doshi | Submitted: 2026-06-02 | arXiv: 2606.03017
Categories: cs.LG, cs.AI, cs.RO
Research Background: Reward transfer in Inverse Reinforcement Learning is unreliable when policies must generalize to unseen combinations of environment dynamics and task goals, because standard IRL conflates these two factors in a single reward representation. 研究背景: 逆強化學習中的獎勵遷移在策略需泛化至未見環境動力學與任務目標組合時不可靠,因為標準 IRL 在單一獎勵表徵中混淆了這兩個因素。
Technical Approach: ConTraIRL learns decoupled latent representations of environment dynamics and task goals via a dual-encoder architecture with contrastive training objectives, enabling compositional reward transfer to new combinations not seen during training. 技術方法: ConTraIRL 透過具對比訓練目標的雙編碼器架構學習環境動力學與任務目標的解耦潛在表徵,支援組合式獎勵遷移至訓練時未見的新組合。
Key Takeaway: Factorized contrastive abstractions enable reliable reward transfer across novel dynamics-goal combinations, substantially improving IRL generalization over monolithic reward representations in compositional transfer benchmarks. 核心發現: 分解式對比抽象在新穎動力學-目標組合間實現可靠的獎勵遷移,在組合遷移基準中顯著優於整體式獎勵表徵的 IRL 泛化能力。
Unified Video-Action Joint Denoising for Dexterous Action and Data Generation
Authors: Dingrui Wang, YuAn Wang, Jinkun Liu | Submitted: 2026-06-02 | arXiv: 2606.03868
Categories: cs.CV
Research Background: World action models align video foundation models with robot actions, but existing formulations narrow the distribution to an observation-conditioned policy, discarding the richer joint distribution over future observations and actions that video models capture. 研究背景: 世界行動模型將視頻基礎模型與機器人動作對齊,但現有方案將分佈縮窄至觀測條件策略,捨棄了視頻模型所捕捉的更豐富的未來觀測與動作聯合分佈。
Technical Approach: The paper proposes unified video-action joint denoising, modeling the joint space of future video frames and actions with a single diffusion process, so the model simultaneously generates plausible future observations and executable actions through joint denoising. 技術方法: 論文提出統一視頻-動作聯合去噪,以單一擴散過程建模未來視頻幀與動作的聯合空間,使模型透過聯合去噪同時生成合理的未來觀測與可執行動作。
Key Takeaway: Joint video-action diffusion produces higher-quality dexterous action predictions and can serve as a data generator, augmenting training sets with synthesized video-action pairs that improve downstream policy learning. 核心發現: 聯合視頻-動作擴散生成更高品質的靈巧動作預測,並可作為資料生成器,以合成視頻-動作對增強訓練集,提升下游策略學習效果。
EvoMemNav: Efficient Self-Evolving Fine-Grained Memory for Zero-Shot Embodied Navigation
Authors: Zuhao Ge, Xiaosong Jia, Chao Wu | Submitted: 2026-06-02 | arXiv: 2606.03509
Categories: cs.CV
Research Background: Zero-shot embodied navigation requires building rich scene memory online, but detector-centric scene graphs compress observations into sparse nodes that lose fine-grained visual evidence, while 3D reconstruction methods are computationally prohibitive. 研究背景: 零樣本具身導航需要線上建構豐富的場景記憶,但以偵測器為中心的場景圖將觀測壓縮為稀疏節點而丟失細粒度視覺證據,而 3D 重建方法計算代價過高。
Technical Approach: EvoMemNav builds a self-evolving fine-grained memory that incrementally updates visual feature maps without explicit 3D reconstruction, using a selective pruning and merging mechanism to maintain a compact, high-fidelity scene representation that is queried for navigation decisions. 技術方法: EvoMemNav 建構自進化細粒度記憶,無需明確 3D 重建即可增量更新視覺特徵圖,利用選擇性剪枝與合併機制維護緊湊高保真的場景表徵,供導航決策查詢。
Key Takeaway: Self-evolving fine-grained memory achieves competitive zero-shot navigation performance with lower computational cost than reconstruction-based methods, enabling deployment on memory-constrained embodied platforms. 核心發現: 自進化細粒度記憶以低於重建方法的計算代價實現具競爭力的零樣本導航效能,支援在記憶體受限的具身平台上部署。
Reinforcement Learning from Cross-domain Videos with Video Prediction Model
Authors: Zhao Yang, Xinrui Zu, Jacob E. Kooi | Submitted: 2026-06-02 | arXiv: 2606.03201
Categories: cs.CV, cs.AI
Research Background: Learning robot policies from expert videos in visually distinct domains is challenging: there is no reward signal and a domain gap (different agent appearance, morphology, or sim-to-real) that prevents direct imitation. 研究背景: 從視覺差異顯著域的專家視頻學習機器人策略極具挑戰:既無獎勵信號,又存在領域差距(不同代理外觀、形態或模擬到現實),阻礙直接模仿。
Technical Approach: XIPER (Cross-domain Video Prediction Reward) trains a video prediction model on the cross-domain expert videos and derives a reward signal by measuring how well the agent’s own future predictions match the expert demonstrations in latent space, bridging domain gaps without explicit alignment. 技術方法: XIPER(跨領域視頻預測獎勵)在跨領域專家視頻上訓練視頻預測模型,透過衡量代理自身未來預測在潛在空間中與專家示範的匹配程度來導出獎勵信號,無需明確對齊即可橋接領域差距。
Key Takeaway: Video prediction-based rewards bridge the domain gap for cross-domain imitation without manual alignment, enabling RL agents to learn effectively from visually dissimilar expert videos across sim-to-real and morphology gaps. 核心發現: 基於視頻預測的獎勵無需手動對齊即可橋接跨領域模仿的領域差距,使 RL 代理能有效從視覺上不相似的專家視頻中學習,跨越模擬到現實與形態差距。
Cosmos 3: Omnimodal World Models for Physical AI
Authors: NVIDIA (Aditi, Niket Agarwal, Arslan Ali et al.) | Submitted: 2026-06-01 | arXiv: 2606.02800
Categories: cs.CV, cs.AI, cs.LG, cs.MM, cs.RO
Research Background: Physical AI systems require world models that jointly process language, image, video, audio, and action — but most existing models are unimodal or handle only two to three modalities, requiring separate systems for different tasks. 研究背景: 實體 AI 系統需要能聯合處理語言、影像、視頻、音頻與動作的世界模型,但現有模型多為單模態或僅處理兩到三種模態,需要為不同任務使用獨立系統。
Technical Approach: Cosmos 3 is a family of omnimodal world models built on a unified mixture-of-transformers architecture that jointly processes and generates across all five modalities (language, image, video, audio, action), effectively subsuming VLMs, video generators, world models, and robot action models into one framework. 技術方法: Cosmos 3 是基於統一混合變換器架構的全模態世界模型族,能跨五種模態(語言、影像、視頻、音頻、動作)聯合處理與生成,有效將 VLM、視頻生成器、世界模型與機器人動作模型整合為單一框架。
Key Takeaway: A single omnimodal mixture-of-transformers architecture can unify all Physical AI modalities, enabling cross-modal transfer and eliminating the need for separate specialized models across robotics, autonomous driving, and video understanding tasks. 核心發現: 單一全模態混合變換器架構可統一所有實體 AI 模態,實現跨模態遷移,消除機器人、自駕車與視頻理解任務中對獨立專用模型的需求。
AURA: Action-Gated Memory for Robot Policies at Constant VRAM
Authors: Josef Chen | Submitted: 2026-06-01 | arXiv: 2606.02775
Categories: cs.AI, cs.AR, cs.DC, cs.PF, cs.RO
Research Background: Standard KV-cache memory grows unboundedly during long robot episodes, making it unsuitable for edge hardware with limited VRAM and flash write endurance — a fundamentally different compute regime from the datacenter batched inference KV-cache was designed for. 研究背景: 標準 KV 快取記憶體在長時機器人 episode 中無限增長,使其不適合 VRAM 受限且快閃記憶體寫入耐久度有限的邊緣硬體——這與 KV 快取為之設計的資料中心批次推理有根本不同的計算環境。
Technical Approach: AURA introduces action-gated memory: a fixed-size memory bank updated only when the robot’s action changes meaningfully, ensuring constant VRAM usage throughout arbitrarily long episodes while preserving the most decision-relevant context. 技術方法: AURA 引入動作閘控記憶體:一個固定大小的記憶體庫,僅在機器人動作有意義變化時更新,確保在任意長度 episode 中 VRAM 用量恆定,同時保留最具決策相關性的上下文。
Key Takeaway: Action-gated constant-VRAM memory enables transformer-based robot policies to run indefinitely on edge hardware without memory growth, with minimal policy performance degradation compared to full KV-cache baselines. 核心發現: 動作閘控恆定 VRAM 記憶體使基於 Transformer 的機器人策略能在邊緣硬體上無限期運行而不增加記憶體用量,相較完整 KV 快取基線策略效能退化極小。
SeeTraceAct: Visibility-Aware Latent Planning from Cross-Embodiment Demonstration Videos
Authors: Jaehyeon Son, Junhyun Kim, Kyle Kam | Submitted: 2026-06-01 | arXiv: 2606.02745
Categories: cs.RO, cs.LG
Research Background: VLAs are promising general-purpose robot policies, but adapting them to new tasks usually requires costly task-specific teleoperation data; one-shot demo-conditioned VLAs that use a single demonstration video offer an alternative, yet end-to-end approaches struggle when successful task execution is not fully visible in the demo. 研究背景: VLA 是有前途的通用機器人策略,但適配新任務通常需要昂貴的任務特定遠程操控資料;以單次示範視頻為條件的單樣本示範條件 VLA 提供了替代方案,但當成功執行在示範中不完全可見時,端到端方法表現欠佳。
Technical Approach: SeeTraceAct introduces visibility-aware latent planning: it estimates which parts of the demonstration trajectory are visible vs. occluded, then plans in latent space only over the visible trace segments while hallucinating plausible continuations for occluded portions, using cross-embodiment video priors. 技術方法: SeeTraceAct 引入可見性感知潛在規劃:估計示範軌跡的哪些部分可見/被遮擋,僅對可見軌跡段在潛在空間規劃,同時利用跨具身視頻先驗對遮擋部分進行合理延伸。
Key Takeaway: Visibility-aware latent planning from cross-embodiment demos enables robust one-shot task adaptation even when demonstrations contain occlusions, outperforming end-to-end baselines on partially-visible manipulation tasks. 核心發現: 基於跨具身示範的可見性感知潛在規劃即使在示範含遮擋時也能實現穩健的單樣本任務適配,在部分可見操作任務上優於端到端基線。
See Less, Specify More: Visual Evidence Budgets for Generalizable VLAs
Authors: Yueh-Hua Wu, Tatsuya Matsushima, Kei Ota | Submitted: 2026-06-01 | arXiv: 2606.02735
Categories: cs.RO, cs.AI, cs.LG
Research Background: VLA generalization fails under distractors, appearance shifts, and semantically similar tasks because the policy must simultaneously identify which image regions matter for control and infer local execution details from coarse instructions — conflating attention selection with action generation. 研究背景: VLA 泛化在干擾物、外觀偏移與語意相似任務下失效,因為策略必須同時識別哪些影像區域對控制重要,並從粗略指令中推斷局部執行細節——混淆了注意力選取與動作生成。
Technical Approach: S2 (See Less, Specify More) trains the policy with a visual evidence budget: it must select a small, bounded set of image tokens as evidence for its action, forcing the model to explicitly commit to what it sees before acting, and is trained to predict missing details from compact visual evidence. 技術方法: S2(少看多指定)以視覺證據預算訓練策略:模型必須選取少量有界影像 token 作為動作的證據,強迫模型在行動前明確承認所見,並訓練其從緊湊視覺證據中預測缺失細節。
Key Takeaway: Constraining the visual evidence that a VLA policy uses for each action improves generalization to distractor-rich and appearance-shifted environments, because the policy learns to focus on task-relevant image regions rather than overfitting to spurious correlations. 核心發現: 限制 VLA 策略每次動作所用的視覺證據可改善對干擾豐富與外觀偏移環境的泛化,因為策略學會聚焦於任務相關影像區域而非過擬合偽相關。
RoboDream: Compositional World Models for Scalable Robot Data Synthesis
Authors: Junjie Ye, Rong Xue, Basile Van Hoorick | Submitted: 2026-06-01 | arXiv: 2606.02577
Categories: cs.RO, cs.CV
Research Background: Scaling robot learning requires large, diverse demonstrations, but real-world teleoperation is expensive; video diffusion models offer data scaling potential but existing approaches produce superficial visual augmentation or embodiment hallucinations with physically infeasible robot motions. 研究背景: 擴展機器人學習需要大量多樣化示範,但實際遠程操控代價高昂;視頻擴散模型提供資料擴展潛力,但現有方法產生的是表面視覺增強或含物理不可行機器人動作的具身幻覺。
Technical Approach: RoboDream uses compositional world models that separately model scene background, foreground objects, and robot embodiment, then composites them during synthesis to generate physically consistent demonstrations with novel object arrangements, backgrounds, and embodiment variations. 技術方法: RoboDream 使用組合式世界模型,分別建模場景背景、前景物體與機器人具身,在合成時組合生成具有新型物體排列、背景與具身變化的物理一致示範。
Key Takeaway: Compositional synthesis preserves physical consistency by independently modeling scene components, generating diverse yet grounded robot demonstrations that improve downstream policy learning beyond simple visual augmentation. 核心發現: 組合式合成透過獨立建模場景組件保持物理一致性,生成多樣但接地的機器人示範,在下游策略學習上的提升超越簡單視覺增強。
AFUN: Towards an Affordance Foundation Model for Functionality Understanding
Authors: Zhaoning Wang, Yi Zhong, Jiawei Fu | Submitted: 2026-06-01 | arXiv: 2606.02551
Categories: cs.RO, cs.CV
Research Background: Affordance understanding — knowing where and how to interact with objects — bridges visual perception and physical action, but building a foundation model for affordances that generalizes across diverse environments, objects, and tasks remains a long-standing challenge. 研究背景: 可供性理解——知道在哪裡以及如何與物體互動——橋接視覺感知與物理動作,但建構能跨多樣環境、物體與任務泛化的可供性基礎模型一直是長期挑戰。
Technical Approach: AFUN trains an affordance foundation model using a large-scale dataset of object-action pairs with functional annotations, learning both where to interact (spatial affordance) and what interaction achieves (functional affordance), generalized via large-scale pretraining with cross-object and cross-task transfer. 技術方法: AFUN 利用帶功能標注的物體-動作對大規模資料集訓練可供性基礎模型,學習互動位置(空間可供性)與互動實現效果(功能可供性),透過跨物體與跨任務遷移的大規模預訓練實現泛化。
Key Takeaway: A unified affordance foundation model that understands both spatial and functional aspects of interactions provides more reliable grounding for robot manipulation policies across novel objects and environments than task-specific affordance models. 核心發現: 理解互動空間與功能兩個方面的統一可供性基礎模型,在新型物體與環境中為機器人操作策略提供比任務特定可供性模型更可靠的基礎。
IMAC-AgriVLN: Can Agricultural Vision-and-Language Navigation Agents be Aware of Instruction Mistakes?
Authors: Xiaobei Zhao, Xingqi Lyu, Xin Chen | Submitted: 2026-06-01 | arXiv: 2606.02519
Categories: cs.RO
Research Background: Agricultural robots navigating via natural language instructions face a unique challenge: instructions from non-expert farmers may contain mistakes, ambiguities, or errors that standard VLN agents cannot handle, yet robustness to instruction mistakes is not addressed by existing agricultural navigation benchmarks. 研究背景: 透過自然語言指令導航的農業機器人面臨獨特挑戰:來自非專業農民的指令可能含錯誤、歧義或失誤,而標準 VLN 代理無法應對,現有農業導航基準亦未涉及指令錯誤的健壯性。
Technical Approach: IMAC-AgriVLN extends the AgriVLN framework and A2A benchmark with instruction mistake awareness: agents are trained and evaluated on scenarios where navigation instructions contain deliberate errors, and must detect mistake types and navigate to the correct target despite erroneous guidance. 技術方法: IMAC-AgriVLN 擴展 AgriVLN 框架與 A2A 基準,加入指令錯誤感知:代理在含刻意錯誤的導航指令情境中訓練與評估,必須偵測錯誤類型並儘管指引有誤仍導航至正確目標。
Key Takeaway: Agricultural VLN agents can be trained to detect and compensate for instruction mistakes, substantially improving navigation success in real-world deployments where non-expert users provide imperfect natural language guidance. 核心發現: 農業 VLN 代理可被訓練以偵測並補償指令錯誤,在非專業使用者提供不完美自然語言引導的實際部署中顯著提升導航成功率。
Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation
Authors: Shahram Najam Syed, Arthur Jakobsson, Haoran Hao | Submitted: 2026-06-01 | arXiv: 2606.02486
Categories: cs.RO
Research Background: VLA models fail when objects move during task execution because they map the current observation to an action assuming a stationary scene, causing latency errors: by the time the action executes, a moving object has already departed from the predicted position. 研究背景: VLA 模型在任務執行期間物體移動時失效,因為它們假設靜態場景將當前觀測對應至動作,導致延遲錯誤:動作執行時,移動物體已離開預測位置。
Technical Approach: AHEAD (Anticipatory Horizon Extrapolation with a Dynamic world model) builds a latent-space predictive world model that forecasts where objects will be at action execution time, conditioning the VLA policy on the predicted future state rather than the current observation to preemptively intercept moving targets. 技術方法: AHEAD(動態世界模型預測視界外推)建構潛在空間預測世界模型,預測動作執行時物體的位置,使 VLA 策略以預測的未來狀態而非當前觀測為條件,主動攔截移動目標。
Key Takeaway: Conditioning VLA policies on latent future state predictions rather than current observations enables reliable manipulation of moving objects, closing the latency gap that makes standard VLAs fail on dynamic grasping tasks. 核心發現: 以潛在未來狀態預測而非當前觀測為 VLA 策略提供條件,能可靠地操作移動物體,填補使標準 VLA 在動態抓取任務中失效的延遲差距。
NDPP-Grasp: Non-Differentiable Physical Plausibility Constraint-Guided Task-Oriented Dexterous Grasp Generation
Authors: Qiuchi Xiang, Haoxuan Qu, Hossein Rahmani | Submitted: 2026-06-01 | arXiv: 2606.02432
Categories: cs.RO
Research Background: Task-oriented dexterous grasp generation must be both physically plausible and functionally appropriate, but existing diffusion-based methods decouple these requirements — training for task alignment first, then post-hoc physical refinement — leading to mismatched grasps. 研究背景: 面向任務的靈巧抓取生成必須同時具有物理合理性與功能適切性,但現有擴散方法解耦這兩項要求——先訓練任務對齊,再進行後驗物理精煉——導致抓取不匹配。
Technical Approach: NDPP-Grasp integrates non-differentiable physical plausibility constraints directly into the diffusion sampling process via a constraint-guided scoring mechanism, steering generation toward poses that simultaneously satisfy task functionality and physical feasibility without requiring post-generation refinement. 技術方法: NDPP-Grasp 透過約束引導評分機制將不可微分物理合理性約束直接整合至擴散採樣過程,引導生成同時滿足任務功能與物理可行性的姿態,無需生成後精煉。
Key Takeaway: Integrating physical plausibility constraints into the diffusion process itself (rather than post-hoc) yields task-oriented grasps that are both functionally aligned and physically consistent, improving grasp success rates on dexterous manipulation benchmarks. 核心發現: 將物理合理性約束直接整合至擴散過程(而非後驗處理)可生成功能對齊且物理一致的面向任務抓取,在靈巧操作基準上提升抓取成功率。
Towards Precise Intent-Aligned VLA Aerial Navigation via Expert-Guided GRPO
Authors: Tianyang Chen, Wenjun Li, Xin Zhou | Submitted: 2026-06-01 | arXiv: 2606.02313
Categories: cs.RO
Research Background: VLA models for UAV navigation trained with supervised fine-tuning suffer from data scarcity, limited generalization, and weak supervision for nuanced human intents — particularly when instructions are fine-grained or require reasoning about aerial context. 研究背景: 以監督微調訓練的無人機導航 VLA 模型受資料稀缺、泛化有限與細緻人類意圖監督不足的困擾——尤其當指令細粒度或需推理航空情境時。
Technical Approach: The authors apply Expert-Guided GRPO (Group Relative Policy Optimization), a reinforcement fine-tuning method that uses expert UAV trajectory rollouts as group-level reference rewards, providing relative preference signals that steer the VLA policy toward precise intent-aligned aerial actions without dense per-step annotations. 技術方法: 作者應用專家引導 GRPO(群組相對策略優化),一種使用專家無人機軌跡展開作為群組級參考獎勵的強化微調方法,提供相對偏好信號引導 VLA 策略走向精確意圖對齊的航空動作,無需密集逐步標注。
Key Takeaway: Reinforcement fine-tuning with expert-guided group rewards significantly improves intent alignment and generalization for aerial navigation VLAs, outperforming supervised fine-tuning on fine-grained instruction following benchmarks. 核心發現: 以專家引導群組獎勵進行強化微調顯著提升航空導航 VLA 的意圖對齊與泛化能力,在細粒度指令跟隨基準上優於監督微調。
FATE-VLA: Failure-Aware Test Generation for Vision-Language-Action Models
Authors: Arusa Kanwal, Pablo Valle, Shaukat Ali | Submitted: 2026-06-01 | arXiv: 2606.02307
Categories: cs.RO
Research Background: VLA model evaluation relies on static benchmarks that randomly sample task scenes, but in high-dimensional embodied spaces, failures are sparse and clustered — meaning random sampling systematically underestimates robustness risks by rarely encountering the specific conditions where policies fail. 研究背景: VLA 模型評估依賴隨機採樣任務場景的靜態基準,但在高維具身空間中,失敗是稀疏且集中的——意味著隨機採樣系統性地低估健壯性風險,因為很少遇到策略失效的特定條件。
Technical Approach: FATE-VLA reframes VLA evaluation as active failure discovery: it uses failure-aware test generation to intelligently search the embodied configuration space, guided by learned failure predictors that concentrate test generation in high-failure-probability regions. 技術方法: FATE-VLA 將 VLA 評估重構為主動失敗發現:使用失敗感知測試生成智能搜索具身配置空間,由學習的失敗預測器引導,將測試生成集中在高失敗概率區域。
Key Takeaway: Active failure-discovery testing exposes a significantly higher density of VLA failure modes than random static benchmarks, providing a more accurate picture of robustness and guiding more targeted improvements to robot policies. 核心發現: 主動失敗發現測試比隨機靜態基準揭示更高密度的 VLA 失效模式,提供更準確的健壯性評估,並引導更有針對性的機器人策略改進。
Dynamics Are Learned, Not Told: Semi-Supervised Discovery of Latent Dynamics Geometries For Zero-Shot Policy Adaptation
Authors: Zhiming Xu, Weitao Zhou, Xianghui Pan | Submitted: 2026-06-01 | arXiv: 2606.02280
Categories: cs.RO
Research Background: Real-world dynamics shifts (changing friction, payload, terrain) cause catastrophic policy failure in RL robotics, but existing adaptation methods rely on encoding explicitly identified physical parameters — a parameter-centric paradigm that breaks when the relevant axes of variation are unknown or unlabeled. 研究背景: 現實世界動力學偏移(摩擦力、載荷、地形變化)導致 RL 機器人策略災難性失效,但現有適配方法依賴編碼明確識別的物理參數——當相關變化軸未知或未標注時,這種以參數為中心的範式會失效。
Technical Approach: The method semi-supervisedly discovers latent dynamics geometries without explicit parameter labels by learning a geometric latent space in which trajectories with similar dynamics cluster together, enabling zero-shot adaptation through nearest-neighbor retrieval of the appropriate dynamics context at test time. 技術方法: 該方法無需明確參數標籤,透過學習動力學相似軌跡聚集在一起的幾何潛在空間,半監督式地發現潛在動力學幾何,在測試時透過最近鄰檢索合適動力學上下文實現零樣本適配。
Key Takeaway: Learning latent dynamics geometries without explicit parameter supervision enables zero-shot adaptation to unseen dynamics conditions, outperforming parameter-centric adaptation methods when the axes of dynamics variation are not pre-specified. 核心發現: 無需明確參數監督學習潛在動力學幾何可實現對未見動力學條件的零樣本適配,在動力學變化軸未預先指定時優於以參數為中心的適配方法。
RoboSemanticBench: Diagnosing Semantic Grounding in Action Prediction for VLA Models
Authors: Bin Yu, Yao Zhang, Haishan Liu | Submitted: 2026-06-01 | arXiv: 2606.02277
Categories: cs.RO
Research Background: VLA models assume that semantic understanding from pretrained backbones guides action prediction, but robot fine-tuning optimizes imitation over task-specific distributions, and many benchmarks can be solved via visual or instruction-action shortcuts rather than genuine semantic grounding. 研究背景: VLA 模型假設預訓練主幹的語意理解引導動作預測,但機器人微調對任務特定分佈優化模仿,許多基準可透過視覺或指令-動作捷徑解決,而非真正的語意基礎。
Technical Approach: RoboSemanticBench (RSB) is a diagnostic benchmark that constructs evaluation scenarios specifically designed to require genuine semantic grounding — removing shortcuts by varying object appearance, instruction phrasing, and task context while holding action distributions constant. 技術方法: RoboSemanticBench(RSB)是診斷基準,構建專門需要真正語意基礎的評估情境——透過改變物體外觀、指令措辭與任務情境同時保持動作分佈恆定來消除捷徑。
Key Takeaway: Current VLA models rely heavily on visual and instruction shortcuts rather than semantic grounding; RSB exposes this gap and provides a benchmark for measuring genuine semantic understanding in robot action prediction. 核心發現: 現有 VLA 模型嚴重依賴視覺與指令捷徑而非語意基礎;RSB 揭示這一差距並提供衡量機器人動作預測中真正語意理解的基準。
Dexterity-BEV: Aligning 3D World and Actions for Generalizable Robot Policies Learning
Authors: Huayi Zhou, Wei Gao, Dekun Lu | Submitted: 2026-06-01 | arXiv: 2606.02274
Categories: cs.RO
Research Background: End-to-end manipulation policies using VLMs inherit two key limitations from 2D foundation models: reliance on 2D RGB inputs that ignores the 3D nature of manipulation, and lack of spatial 3D alignment between input and output spaces that causes policy errors under viewpoint changes. 研究背景: 使用 VLM 的端到端操作策略繼承了 2D 基礎模型的兩個關鍵限制:依賴忽略操作 3D 本質的 2D RGB 輸入,以及輸入輸出空間之間缺乏空間 3D 對齊,在視角變化時導致策略錯誤。
Technical Approach: Dexterity-BEV lifts RGB observations to Bird’s-Eye View (BEV) representations using depth and camera geometry, aligning the 3D world model with 3D action space, and trains manipulation policies in this unified 3D-consistent representation space that is invariant to viewpoint changes. 技術方法: Dexterity-BEV 利用深度與相機幾何將 RGB 觀測提升至鳥瞰圖(BEV)表徵,對齊 3D 世界模型與 3D 動作空間,在對視角變化不變的統一 3D 一致表徵空間中訓練操作策略。
Key Takeaway: BEV-based 3D-aligned policy learning achieves stronger generalization across viewpoints and object configurations than 2D-RGB policies, closing a key gap in using VLM backbones for dexterous manipulation. 核心發現: 基於 BEV 的 3D 對齊策略學習在視角與物體配置間實現比 2D RGB 策略更強的泛化,填補使用 VLM 主幹進行靈巧操作的關鍵差距。
Motion Planning in Dynamic Environments: A Survey from Classical to Modern Methods
Authors: Zongyuan Shen, Yaming Ou, Shalabh Gupta | Submitted: 2026-06-01 | arXiv: 2606.02677
Categories: cs.RO
Research Background: Motion planning in dynamic environments — where robots must continuously adapt paths around moving obstacles and agents — lacks comprehensive systematic review covering both classical and modern learning-based methods across the spectrum of approaches. 研究背景: 動態環境中的運動規劃——機器人必須持續調整路徑以規避移動障礙物與代理——缺乏涵蓋傳統與現代學習方法的全面系統性綜述。
Technical Approach: A comprehensive survey of 138 works (2015–2025) covering classical planners (RRT, PRM, potential fields), reactive methods (DWA, MPC), learning-based approaches (RL, imitation learning, neural planners), and hybrid methods, organized by problem setting and algorithm family with benchmark comparisons. 技術方法: 涵蓋 138 篇作品(2015–2025)的全面綜述,包括傳統規劃器(RRT、PRM、勢場)、反應方法(DWA、MPC)、學習方法(RL、模仿學習、神經規劃器)與混合方法,按問題設置與演算法族組織並附基準比較。
Key Takeaway: Modern learning-based planners are increasingly competitive with classical methods in dynamic environments, but lack the safety guarantees and interpretability of classical approaches; the survey identifies hybrid methods as the most promising direction for deployment in safety-critical robotics. 核心發現: 現代學習規劃器在動態環境中越來越與傳統方法競爭,但缺乏傳統方法的安全保證與可解釋性;綜述認為混合方法是安全關鍵機器人部署最有前途的方向。
World-Task Factorization for Robot Learning
Authors: Eduardo Sebastián, Adrian Pfisterer, Vito Mengers | Submitted: 2026-06-01 | arXiv: 2606.02027
Categories: cs.RO, cs.LG, cs.MA
Research Background: Robot policies must generalize to new combinations of constraints, teammates, and environments, but this requires structural factorization of what should generalize, what requires retraining, and what remains entangled — a choice that existing methods span widely without principled guidance. 研究背景: 機器人策略必須泛化至新的約束、隊友與環境組合,但這需要對什麼應泛化、什麼需重訓練、什麼保持纏繞進行結構性分解——現有方法在缺乏原則性指導的情況下差異顯著。
Technical Approach: World-Task Factorization (WTF) explicitly separates the world model (environment dynamics, physical constraints) from the task model (goal specification, reward), training each component to factor out entangled variation so the task component can be retrained independently for new goals while the world model transfers. 技術方法: 世界-任務分解(WTF)明確分離世界模型(環境動力學、物理約束)與任務模型(目標規格、獎勵),訓練每個組件以分解纏繞的變化,使任務組件可為新目標獨立重訓練,同時世界模型可遷移。
Key Takeaway: Principled world-task factorization enables modular robot learning where the world model transfers across task changes and the task model is efficiently retrained, achieving better generalization than end-to-end or fully-shared policies. 核心發現: 原則性世界-任務分解實現模組化機器人學習,世界模型可跨任務變化遷移,任務模型可高效重訓練,泛化能力優於端到端或完全共用策略。
Market-Based Replanning for Safety-Critical UAV Swarms in Search and Rescue Missions
Authors: Luiz Giacomossi, Andrea Haglund, Claire Namatovu | Submitted: 2026-06-01 | arXiv: 2606.01970
Categories: cs.RO, cs.MA, eess.SY
Research Background: Safety-critical UAV swarm coordination for Search and Rescue (SAR) requires fault-tolerant replanning that can sustain operations when individual agents degrade or fail, but distributed coordination under resource constraints is difficult without centralized communication. 研究背景: 搜救任務中安全關鍵無人機群協調需要容錯重規劃,能在個體代理退化或失效時維持運作,但在資源受限下無集中通訊的分散式協調極具困難。
Technical Approach: IRDS (Intelligent Replanning Drone Swarm) uses a Reverse-Auction market mechanism where degraded agents auction their task assignments to healthy neighbors, enabling distributed fault-tolerant replanning without global communication while respecting resource constraints. 技術方法: IRDS(智能重規劃無人機群)使用反向拍賣市場機制,退化代理將任務分配競拍給健康鄰居,在不依賴全局通訊的情況下實現分散式容錯重規劃,同時遵守資源約束。
Key Takeaway: Market-based task reallocation via reverse auction enables fault-tolerant SAR drone swarms that maintain mission coverage even under significant agent failures, outperforming fixed-assignment and broadcast-based replanning strategies. 核心發現: 反向拍賣市場式任務重分配使容錯搜救無人機群在重大代理失效下維持任務覆蓋,優於固定分配與廣播式重規劃策略。
WALL-WM: Carving World Action Modeling at the Event Joints
Authors: Shalfun Li, Victor Yao, Charles Yang | Submitted: 2026-06-01 | arXiv: 2606.01955
Categories: cs.RO, cs.CV
Research Background: Existing World Action Models (WAMs) optimize fixed-length action chunks conditioned on the current observation, using the frame as the atomic learning unit — but frames lack semantic coherence, causing the model to overfit to temporal artifacts rather than learning action semantics. 研究背景: 現有世界行動模型(WAMs)優化以當前觀測為條件的固定長度動作塊,以幀為原子學習單元——但幀缺乏語意一致性,導致模型過擬合至時間偽影而非學習動作語意。
Technical Approach: WALL-WM shifts from chunk-centric to event-grounded learning, using semantically coherent action events as the atomic unit of VLA pretraining, identifying event boundaries via a semantic segmentation of the trajectory and training the world model to predict event-level futures rather than per-frame predictions. 技術方法: WALL-WM 從以塊為中心轉向事件接地學習,以語意一致的動作事件作為 VLA 預訓練的原子單元,透過軌跡語意分割識別事件邊界,訓練世界模型預測事件級未來而非逐幀預測。
Key Takeaway: Event-grounded VLA pretraining produces richer action representations than frame-chunk-based WAMs, improving manipulation task performance and generalization by learning semantically coherent action units rather than arbitrary temporal fragments. 核心發現: 事件接地 VLA 預訓練比基於幀塊的 WAMs 產生更豐富的動作表徵,透過學習語意一致的動作單元而非任意時間片段改善操作任務效能與泛化。
Co-training with Ego-centric Video and Demonstration for Robot Navigation Task
Authors: Shoya Kuno, Yumo Ouchi, Kanata Suzuki | Submitted: 2026-06-01 | arXiv: 2606.01951
Categories: cs.RO
Research Background: VLA models require large-scale high-quality training data for navigation, but real robot data collection is costly; prior work augments manipulation datasets with human egocentric video, yet applying this to mobile robot navigation is challenging due to viewpoint and embodiment differences. 研究背景: VLA 模型需要大規模高品質導航訓練資料,但真實機器人資料蒐集代價高昂;先前工作以人類自我中心視頻增強操作資料集,但因視角與具身差異,將此方法應用於移動機器人導航仍具挑戰。
Technical Approach: The paper proposes co-training that jointly optimizes on ego-centric human walking videos and robot navigation demonstrations, using a shared VLA backbone with embodiment-specific adaptation heads and a viewpoint alignment module to bridge the visual domain gap between human and robot perspectives. 技術方法: 論文提出協同訓練,在自我中心人類行走視頻與機器人導航示範上聯合優化,使用具具身特定適配頭的共用 VLA 主幹和視角對齊模組,橋接人類與機器人視角間的視覺領域差距。
Key Takeaway: Co-training with freely available human egocentric walking videos substantially improves mobile robot navigation VLA performance, providing a low-cost data augmentation strategy that transfers human locomotion priors to robot navigation. 核心發現: 與免費人類自我中心行走視頻協同訓練顯著提升移動機器人導航 VLA 效能,提供低成本資料增強策略,將人類移動先驗遷移至機器人導航。
Learning Action-Conditional and Object-Centric Gaussian Splatting World Models for Rigid Objects
Authors: Jens U. Kreber, Lukas Mack, Joerg Stueckler | Submitted: 2026-06-01 | arXiv: 2606.01950
Categories: cs.RO, cs.CV, cs.LG
Research Background: World models for robot manipulation need to predict how actions affect 3D object configurations, but most world models operate in 2D pixel space or latent space without explicit 3D object structure, limiting physical interpretability and generalization across novel viewpoints. 研究背景: 機器人操作世界模型需要預測動作如何影響 3D 物體配置,但大多數世界模型在 2D 像素空間或潛在空間中運作,缺乏明確的 3D 物體結構,限制了物理可解釋性與新視角泛化。
Technical Approach: MRO-GWM (Multi Rigid Object Gaussian World Model) represents scenes as object-centric 3D Gaussians and learns action-conditional dynamics of rigid objects in 3D, predicting how each Gaussian should transform in response to robot actions using a novel structured prediction architecture. 技術方法: MRO-GWM(多剛體物件高斯世界模型)以物體中心 3D 高斯表示場景,學習 3D 中剛體物件的動作條件動力學,使用新型結構化預測架構預測每個高斯應如何響應機器人動作而變換。
Key Takeaway: Object-centric 3D Gaussian world models learn physically interpretable action-conditional dynamics for multi-object manipulation, enabling novel viewpoint rendering and more reliable planning than pixel-space or unstructured latent world models. 核心發現: 物體中心 3D 高斯世界模型學習多物體操作的物理可解釋動作條件動力學,能進行新視角渲染,並比像素空間或非結構化潛在世界模型實現更可靠的規劃。
Set-Supervised Diffusion Policy: Learning Action-Chunking Diffusion through Corrections
Authors: Zhaoting Li, Gang Chen, Javier Alonso-Mora | Submitted: 2026-06-01 | arXiv: 2606.01865
Categories: cs.RO
Research Background: Diffusion policies are powerful for robotic manipulation but remain vulnerable to distributional shift; human-in-the-loop corrections during deployment produce paired (undesired action, corrected action) supervision, but existing methods do not effectively exploit this correction signal for policy improvement. 研究背景: 擴散策略在機器人操作中表現強勁,但易受分佈偏移影響;部署時的人在環路修正產生配對(不良動作、修正動作)監督,但現有方法未有效利用此修正信號改善策略。
Technical Approach: Set-Supervised Diffusion Policy uses correction pairs as set-level supervision: given the set {undesired, corrected}, the diffusion policy is trained to assign higher probability to the correction and lower to the undesired action via a set-contrastive learning objective applied to action chunks. 技術方法: 集合監督擴散策略使用修正對作為集合級監督:給定集合 {不良、修正},透過對動作塊施加集合對比學習目標,訓練擴散策略對修正動作賦予較高概率,對不良動作賦予較低概率。
Key Takeaway: Learning from human correction pairs via set-supervised diffusion substantially reduces distributional shift errors, enabling continuous policy improvement from natural human-in-the-loop interactions without full retraining. 核心發現: 透過集合監督擴散從人類修正對學習顯著降低分佈偏移錯誤,使策略能從自然人在環路互動中持續改善,無需完整重訓練。
PHASOR: Phase-Anchored Universal Action Representations for Humanoid Embodiments
Authors: Kihyun Kim, Chaeyun Kim, Jongho Shin | Submitted: 2026-06-01 | arXiv: 2606.01851
Categories: cs.RO
Research Background: Existing robot policy learning methods treat action latents as task-specific intermediates rather than first-class representations, yielding unstructured, embodiment-specific latents with weak ties to motion semantics — limiting interpretability, controllability, and cross-embodiment transferability. 研究背景: 現有機器人策略學習方法將動作潛在量視為任務特定中間量而非一等表徵,產生結構化程度低、具身特定且與動作語意聯繫薄弱的潛在量——限制了可解釋性、可控性與跨具身遷移性。
Technical Approach: PHASOR learns phase-anchored universal action representations by embedding actions into a phase space where periodic motion primitives are explicitly encoded, making action latents interpretable as motion phases and enabling cross-embodiment transfer by anchoring representations to shared phase semantics rather than joint-specific coordinates. 技術方法: PHASOR 透過將動作嵌入明確編碼週期性動作原語的相位空間,學習相位錨定的通用動作表徵,使動作潛在量可解釋為運動相位,並透過將表徵錨定至共享相位語意而非關節特定座標實現跨具身遷移。
Key Takeaway: Phase-anchored universal action representations enable interpretable, controllable, and cross-embodiment transferable humanoid policies, providing a principled action embedding space that supports motion editing and robot-to-robot skill transfer. 核心發現: 相位錨定通用動作表徵實現可解釋、可控且跨具身可遷移的類人機器人策略,提供支援動作編輯與機器人間技能遷移的原則性動作嵌入空間。
The Lie We Tell: Correcting the Euclidean Fallacy in VLA Policies via Score Matching on Tangent Space
Authors: Bing-Cheng Chuang, I-Hsuan Chu, Bor-Jiun Lin | Submitted: 2026-06-01 | arXiv: 2606.01847
Categories: cs.RO, cs.LG
Research Background: Diffusion-based VLA policies commit what the authors call the Euclidean Fallacy: representing SE(3) poses as flat R12 vectors, which violates SO(3) constraints, breaks equivariance under coordinate transformations, and produces non-geodesic trajectories that drift off the rotation manifold. 研究背景: 基於擴散的 VLA 策略犯下作者稱之為歐幾里得謬誤的錯誤:將 SE(3) 姿態表示為平坦的 R12 向量,這違反了 SO(3) 約束、破壞座標變換下的等變性,並產生偏離旋轉流形的非測地軌跡。
Technical Approach: The paper reformulates VLA diffusion policies using score matching on the tangent space of SE(3), keeping the denoising process on the Riemannian manifold rather than Euclidean space, ensuring generated poses remain valid SE(3) elements throughout the diffusion trajectory. 技術方法: 論文使用 SE(3) 切空間上的分數匹配重構 VLA 擴散策略,使去噪過程保持在黎曼流形而非歐幾里得空間上,確保生成的姿態在整個擴散軌跡中保持有效的 SE(3) 元素。
Key Takeaway: Manifold-aware score matching on SE(3) tangent space corrects the Euclidean Fallacy in VLA diffusion policies, eliminating manifold drift and improving rotation accuracy in manipulation tasks where precise end-effector pose is critical. 核心發現: SE(3) 切空間上的流形感知分數匹配糾正 VLA 擴散策略中的歐幾里得謬誤,消除流形漂移並提升精確末端執行器姿態至關重要的操作任務中的旋轉精確度。
Trans2Occ: Voxel Occupancy Estimation and Grasp for Transparent Objects from Simulation to Reality
Authors: Yixuan Yang, Sha Zhang, Rui Li | Submitted: 2026-06-01 | arXiv: 2606.01777
Categories: cs.RO
Research Background: Transparent objects are persistently challenging for robot perception because refraction and reflection produce unreliable depth sensor readings, while prior multi-view reconstruction or depth completion approaches are difficult to scale or deploy in real robot systems. 研究背景: 透明物體對機器人感知持續構成挑戰,因為折射與反射產生不可靠的深度感測讀數,而先前的多視角重建或深度補全方法難以在真實機器人系統中擴展或部署。
Technical Approach: Trans2Occ is a practical sim-to-real framework that estimates voxel occupancy of transparent objects from a single RGB view, trained in simulation using physically-based rendering of transparent materials and transferred to real grasping through domain-adaptation techniques. 技術方法: Trans2Occ 是實用的模擬到現實框架,從單一 RGB 視角估計透明物體的體素佔據率,使用透明材質物理渲染在模擬中訓練,並透過領域適配技術遷移至真實抓取。
Key Takeaway: Single-view voxel occupancy estimation via sim-to-real transfer enables reliable grasping of transparent objects without multi-view setups or specialized depth sensors, making transparent object manipulation practical for deployment. 核心發現: 透過模擬到現實遷移的單視角體素佔據估計,無需多視角裝置或特殊深度感測器即可實現透明物體的可靠抓取,使透明物體操作具備部署實用性。
FlipItRight: Stable Pose-Targeted Throw-Flip Across Diverse Objects
Authors: Axel Dawne, Shinkyu Park | Submitted: 2026-06-01 | arXiv: 2606.01713
Categories: cs.RO, eess.SY, math.OC
Research Background: Throw-flip manipulation — launching an object so it lands in a desired planar pose — requires reasoning about release dynamics, aerodynamics, and landing contact simultaneously, which is difficult to plan reliably across objects with diverse shapes and mass distributions. 研究背景: 拋擲翻轉操作——投擲物體使其以目標平面姿態著陸——需要同時推理釋放動力學、空氣動力學與著陸接觸,在形狀與質量分佈多樣的物體中難以可靠規劃。
Technical Approach: FlipItRight decomposes the problem into an object-level planner that generates candidate release states satisfying the desired landing pose, and a robot-level planner that evaluates executability and constructs a feasible swing motion, using the release state as an explicit intermediate representation bridging object and robot planning. 技術方法: FlipItRight 將問題分解為生成滿足目標著陸姿態的候選釋放狀態的物體級規劃器,以及評估可執行性並構建可行搖擺動作的機器人級規劃器,以釋放狀態作為橋接物體與機器人規劃的明確中間表徵。
Key Takeaway: Hierarchical decomposition into object-level release planning and robot-level motion planning achieves stable, pose-targeted throw-flip across diverse objects using a high-DoF manipulator without object-specific calibration. 核心發現: 分層分解為物體級釋放規劃與機器人級動作規劃,無需物體特定校準即可使用高自由度機械臂在多樣物體上實現穩定的目標姿態拋擲翻轉。
Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation
Authors: Muyi Bao, Yuxin Cai, Hang Xu | Submitted: 2026-06-01 | arXiv: 2606.01621
Categories: cs.CV, cs.RO
Research Background: VLM-based VLN methods cast navigation as low-level action prediction, an interface that is ambiguous, tied to short-horizon motion primitives, and inefficient due to repeated VLM querying at each navigation step. 研究背景: 基於 VLM 的 VLN 方法將導航視為低層次動作預測,這是一個模糊、受限於短視界運動原語且因每步重複查詢 VLM 而效率低下的介面。
Technical Approach: Goal2Pixel reformulates VLN as a pure pixel-space goal grounding task: the VLM predicts the goal pixel location in the current image (where to go), and a lightweight motion planner executes navigation toward that pixel goal, reducing VLM calls from per-step to per-waypoint frequency. 技術方法: Goal2Pixel 將 VLN 重構為純像素空間目標基礎任務:VLM 在當前影像中預測目標像素位置(前往何處),輕量運動規劃器執行朝該像素目標的導航,將 VLM 調用頻率從每步降至每路點。
Key Takeaway: Grounding navigation goals to pixel locations rather than action primitives reduces VLM query overhead and improves long-horizon navigation success by providing unambiguous spatial goals that decouple high-level planning from low-level locomotion. 核心發現: 將導航目標基礎化至像素位置而非動作原語,降低 VLM 查詢開銷並透過提供解耦高層規劃與低層運動的明確空間目標改善長程導航成功率。
Embedding Semantic Risk into Distance Fields and CBFs for Online Monocular Safe Control
Authors: Dawei Zhang, Nuo Chen, Shuo Liu | Submitted: 2026-06-01 | arXiv: 2606.01605
Categories: cs.RO
Research Background: Perception-based safety filters for robot navigation typically assign equal distance-based safety margins to all obstacles regardless of semantic context — treating a human the same as a wall — rather than encoding semantic risk directly into the safety constraint formulation. 研究背景: 機器人導航的感知安全過濾器通常對所有障礙物分配相同的基於距離的安全邊距,無論語意情境如何——將人類與牆壁同等對待——而非將語意風險直接編碼至安全約束公式。
Technical Approach: An online monocular framework embeds semantic risk scores (derived from a segmentation model) directly into the distance field used by CBF-based safe control, so CBF constraints are tightened around semantically high-risk entities (humans, children, pets) and relaxed around low-risk static obstacles. 技術方法: 線上單目框架將來自分割模型的語意風險評分直接嵌入 CBF 安全控制所用的距離場,使 CBF 約束在語意高風險實體(人、兒童、寵物)周圍收緊,在低風險靜態障礙物周圍放鬆。
Key Takeaway: Semantic-risk-aware CBF control enables context-sensitive safe navigation that maintains larger safety buffers around vulnerable entities without sacrificing performance near static obstacles, using only monocular perception online. 核心發現: 語意風險感知 CBF 控制實現情境敏感的安全導航,在易受傷害實體周圍維持更大安全緩衝而不犧牲靜態障礙物附近的效能,且僅需單目感知在線運行。
RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation
Authors: Huiqiong Li, Jiayu Wang, Zhiting Mei | Submitted: 2026-06-01 | arXiv: 2606.01600
Categories: cs.CV, cs.CL, cs.RO
Research Background: Video world models used in robotic manipulation are typically evaluated under valid, feasible, and safe instructions, but their trustworthiness under constraint-sensitive, counterfactual, and adversarial conditions is not systematically assessed. 研究背景: 用於機器人操作的視頻世界模型通常在有效、可行且安全的指令下評估,但在約束敏感、反事實與對抗條件下的可信度未被系統評估。
Technical Approach: RoboTrustBench is a benchmark built from real-world DROID episodes that evaluates video world models across four scenario categories: Normal, Constraint-Sensitive (unusual physical constraints), Counterfactual (impossible or logically inconsistent instructions), and Adversarial (perturbations designed to cause failure). 技術方法: RoboTrustBench 從真實 DROID episodes 建構,跨四類情境評估視頻世界模型:正常、約束敏感(異常物理約束)、反事實(不可能或邏輯不一致指令)與對抗(設計以引發失敗的擾動)。
Key Takeaway: Current video world models for manipulation perform well on Normal scenarios but show significant trustworthiness gaps under constraint-sensitive, counterfactual, and adversarial conditions, highlighting the need for more robust training objectives. 核心發現: 現有操作視頻世界模型在正常情境下表現良好,但在約束敏感、反事實與對抗條件下顯示顯著可信度差距,突顯需要更健壯的訓練目標。
Physics-Informed Modeling and Control of Emergent Behaviors in Robot Swarms
Authors: Zixuan Jin, Wenzhuo Zhang, Shuxian Quan | Submitted: 2026-06-01 | arXiv: 2606.01597
Categories: cs.RO, cs.MA
Research Background: Robot swarms exhibit coherent collective behaviors through local perception and decentralized decision-making, but modeling and controlling multi-stage emergent behavior — which unfolds over multiple phases with distinct dynamics — remains a fundamental challenge. 研究背景: 機器人群透過局部感知與分散決策表現出一致的集體行為,但建模與控制多階段湧現行為——以具有不同動力學的多個相位展開——仍是根本性挑戰。
Technical Approach: PhySwarm introduces a physics-informed micro-macro framework that represents multi-stage swarm emergence as physically constrained density-field dynamics, using PDE-based macro models informed by micro-level agent physics to enable both accurate simulation and principled control of collective behavior phases. 技術方法: PhySwarm 引入物理告知的微觀-宏觀框架,將多階段群體湧現表示為物理約束密度場動力學,使用基於微觀代理物理告知的 PDE 宏觀模型,實現對集體行為相位的精確模擬與原則性控制。
Key Takeaway: Physics-informed density-field models bridge micro-level agent behavior and macro-level emergent dynamics, enabling principled control of multi-stage swarm phenomena that purely data-driven approaches cannot capture. 核心發現: 物理告知密度場模型橋接微觀代理行為與宏觀湧現動力學,實現對純資料驅動方法無法捕捉的多階段群體現象的原則性控制。
Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation
Authors: Xiang Fang, Wanlong Fang, Changshuo Wang | Submitted: 2026-06-01 | arXiv: 2606.01565
Categories: cs.RO, cs.CV
Research Background: VLN in continuous environments (VLN-CE) requires integrating natural language instructions with visual observations to navigate complex 3D indoor spaces, but existing approaches falter on long-horizon tasks due to limited scene understanding and inefficient planning. 研究背景: 連續環境視覺語言導航(VLN-CE)需要整合自然語言指令與視覺觀測以導航複雜 3D 室內空間,但現有方法因場景理解有限與規劃效率低下在長程任務中表現不佳。
Technical Approach: The framework combines hierarchical semantic augmentation (enriching observations with multi-level semantic context), optimal transport for robust instruction-observation alignment, and graph-driven reasoning over a topological scene graph to support long-horizon navigation decisions. 技術方法: 框架結合層次語意增強(以多層次語意情境豐富觀測)、用於穩健指令-觀測對齊的最優輸送,以及在拓撲場景圖上的圖驅動推理,支援長程導航決策。
Key Takeaway: Combining hierarchical semantics, optimal-transport alignment, and graph reasoning outperforms prior VLN-CE methods on long-horizon navigation benchmarks, particularly in environments requiring multi-step semantic reasoning. 核心發現: 結合層次語意、最優輸送對齊與圖推理在長程導航基準上優於先前 VLN-CE 方法,特別是在需要多步驟語意推理的環境中。
Hierarchical Object Representation for Spatial Robot Perception: Points, Meshes, and Superquadrics
Authors: Ceng Zhang, Wan Su, Mohamed Samshad | Submitted: 2026-06-01 | arXiv: 2606.01545
Categories: cs.RO
Research Background: Hierarchical 3D Scene Graphs (3DSG) are powerful for long-term robot autonomy, but existing methods use simplified object geometry (point clouds, bounding boxes) that lacks the detail needed for fine-grained manipulation planning and contact reasoning. 研究背景: 層次 3D 場景圖(3DSG)對長期機器人自主性具有強大作用,但現有方法使用缺乏細粒度操作規劃與接觸推理所需細節的簡化物體幾何(點雲、邊界框)。
Technical Approach: A hierarchical object representation system incrementally builds multi-level geometric models of objects — from sparse points to dense meshes to compact superquadric approximations — integrated within a 3DSG, selecting the appropriate level of detail based on task requirements and available sensor data. 技術方法: 層次物體表徵系統在 3DSG 中增量建構物體的多層次幾何模型——從稀疏點雲到密集網格再到緊湊超二次曲面近似——根據任務需求與可用感測器資料選擇適當細節層次。
Key Takeaway: Multi-level hierarchical object representations within scene graphs enable robots to select appropriate geometric fidelity per task, improving both spatial reasoning for navigation and contact precision for manipulation within a unified scene representation. 核心發現: 場景圖中的多層次層次物體表徵使機器人能按任務選擇適當幾何保真度,在統一場景表徵中改善導航的空間推理與操作的接觸精確度。
RDA: Reward Design Agent for Reinforcement Learning
Authors: Hojoon Lee, Ajay Subramanian, Ben Abbatematteo | Submitted: 2026-06-01 | arXiv: 2606.01672
Categories: cs.LG
Research Background: RL requires hand-crafted reward functions that are slow to design and hard to align with human intent; LLM-based automation (like Eureka) iteratively generates reward code but relies on coarse feedback signals like success rate, missing fine-grained behavioral signals needed for complex manipulation. 研究背景: 強化學習需要緩慢設計且難以與人類意圖對齊的手工獎勵函數;基於 LLM 的自動化(如 Eureka)迭代生成獎勵程式碼,但依賴如成功率等粗糙反饋信號,缺乏複雜操作所需的細粒度行為信號。
Technical Approach: RDA (Reward Design Agent) is an LLM-based agent that iteratively designs and refines reward functions using fine-grained behavioral feedback from policy rollouts — including sub-goal completion, trajectory analysis, and failure mode diagnosis — enabling more targeted reward improvement cycles. 技術方法: RDA(獎勵設計代理)是基於 LLM 的代理,使用來自策略展開的細粒度行為反饋——包括子目標完成度、軌跡分析與失敗模式診斷——迭代設計與精煉獎勵函數,實現更有針對性的獎勵改進循環。
Key Takeaway: Fine-grained behavioral feedback enables LLM-based reward design agents to produce significantly better reward functions for complex manipulation tasks than coarse success-rate feedback, accelerating RL training and improving final policy quality. 核心發現: 細粒度行為反饋使基於 LLM 的獎勵設計代理能為複雜操作任務生成顯著優於粗糙成功率反饋的獎勵函數,加速強化學習訓練並提升最終策略品質。
Symmetry-Aware 9D Pose Estimation with Sim(3)-Consistent Feature and Spherical Inception Convolution
Authors: Panfei Cheng, Hongshan Yu, Wenrui Chen | Submitted: 2026-06-01 | arXiv: 2606.02219
Categories: cs.CV
Research Background: Category-level object pose estimation must generalize to unseen objects but struggles with the non-linear Sim(3) space and intra-class variations; symmetric objects introduce additional ambiguity that standard pose estimation pipelines handle poorly. 研究背景: 類別級物體姿態估計必須泛化至未見物體,但受非線性 Sim(3) 空間與類內變化困擾;對稱物體引入額外歧義,標準姿態估計管線處理不佳。
Technical Approach: The method introduces Sim(3)-consistent features that respect the geometry of the Sim(3) group, combined with Spherical Inception Convolutions that extract rotation-aware local features from point clouds, and explicit symmetry handling that treats symmetric pose ambiguities as a constrained equivalence class during training and inference. 技術方法: 該方法引入遵守 Sim(3) 群幾何的 Sim(3) 一致特徵,結合從點雲提取旋轉感知局部特徵的球面 Inception 卷積,以及在訓練和推理期間將對稱姿態歧義視為約束等價類的明確對稱處理。
Key Takeaway: Sim(3)-consistent features with spherical convolutions and explicit symmetry handling achieve state-of-the-art category-level 9D pose estimation on benchmark datasets, with improved generalization to symmetric and unseen object instances. 核心發現: 具有球面卷積與明確對稱處理的 Sim(3) 一致特徵在基準資料集上達到最先進的類別級 9D 姿態估計,對對稱與未見物體實例泛化能力更強。
Adversarial Attacks on Robot Localization Systems via Deep Feature Perturbation
Authors: Zhenyu Li, Tianyi Shang | Submitted: 2026-06-01 | arXiv: 2606.01892
Categories: cs.CV
Research Background: Robot localization systems based on deep learning are critical for autonomous navigation safety, but their vulnerability to adversarial perturbations — which can cause mislocalization and navigation errors — is not well understood in the context of physical robotic deployment. 研究背景: 基於深度學習的機器人定位系統對自主導航安全至關重要,但在實際機器人部署情境中,其對對抗性擾動(可導致定位錯誤與導航失誤)的脆弱性尚未充分理解。
Technical Approach: The paper develops a framework for generating adversarial attacks on deep-feature-based localization pipelines via targeted deep feature perturbation, evaluating attack transferability across different localization architectures and the potential for physical-world patch-based attacks on navigation. 技術方法: 論文透過有針對性的深度特徵擾動,開發針對基於深度特徵的定位管線的對抗攻擊框架,評估攻擊在不同定位架構間的可遷移性以及基於物理世界貼片攻擊導航的潛力。
Key Takeaway: Deep learning localization systems are meaningfully vulnerable to adversarial feature perturbations, including physically realizable patch attacks, motivating the development of adversarially robust perception for safety-critical robot navigation. 核心發現: 深度學習定位系統對對抗性特徵擾動(包括物理可實現的貼片攻擊)存在顯著脆弱性,促使為安全關鍵機器人導航開發對抗性健壯感知。
RescueBench: Can Embodied Agents Save Lives in the Wild?
Authors: Kui Wu, Beiyu Guo, Hao Chen | Submitted: 2026-06-01 | arXiv: 2606.01848
Categories: cs.CV
Research Background: Search-and-rescue (SAR) requires embodied agents to explore unfamiliar environments under multimodal uncertainty, perform multi-stage interactions, and maintain spatial memory over long horizons — capabilities that existing benchmarks evaluate in isolation rather than in compound realistic workflows. 研究背景: 搜索救援(SAR)要求具身代理在多模態不確定性下探索陌生環境、執行多階段互動,並在長時視野中維持空間記憶——現有基準孤立評估這些能力,而非在複合現實工作流程中評估。
Technical Approach: RescueBench is a photorealistic SAR benchmark that places embodied agents in complex disaster-scenario environments, requiring composition of exploration, victim detection, interaction planning, and long-horizon memory — evaluating how failures in each capability compound when combined in realistic SAR workflows. 技術方法: RescueBench 是逼真 SAR 基準,在複雜災難情境環境中放置具身代理,需要組合探索、受害者偵測、互動規劃與長程記憶——評估在現實 SAR 工作流程中組合時各能力失敗如何疊加。